Nov 03 12:12:33 user nova-compute[74960]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=74960) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=74960) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=74960) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 03 12:12:33 user nova-compute[74960]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.022s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:12:33 user nova-compute[74960]: INFO nova.virt.driver [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] Loading compute driver 'libvirt.LibvirtDriver'
Nov 03 12:12:33 user nova-compute[74960]: INFO nova.compute.provider_config [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] Acquiring lock "singleton_lock" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] Acquired lock "singleton_lock" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] Releasing lock "singleton_lock" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] Full set of CONF: {{(pid=74960) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] ******************************************************************************** {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] Configuration options gathered from: {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] ================================================================================ {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] allow_resize_to_same_host      = True {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] arq_binding_timeout            = 300 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] backdoor_port                  = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] backdoor_socket                = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] block_device_allocate_retries  = 300 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] block_device_allocate_retries_interval = 5 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] cert                           = self.pem {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] compute_monitors               = [] {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] config_dir                     = [] {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] config_drive_format            = iso9660 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] config_source                  = [] {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] console_host                   = user {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] control_exchange               = nova {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] cpu_allocation_ratio           = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] daemon                         = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] debug                          = True {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] default_access_ip_network_name = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] default_availability_zone      = nova {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] default_ephemeral_format       = ext4 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] default_green_pool_size        = 1000 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] default_schedule_zone          = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] disk_allocation_ratio          = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] enable_new_services            = True {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] enabled_apis                   = ['osapi_compute'] {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] enabled_ssl_apis               = [] {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] flat_injected                  = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] force_config_drive             = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] force_raw_images               = True {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] graceful_shutdown_timeout      = 5 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] heal_instance_info_cache_interval = 60 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] host                           = user {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] instance_build_timeout         = 0 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] instance_delete_interval       = 300 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] instance_format                = [instance: %(uuid)s]  {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] instance_name_template         = instance-%08x {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] instance_usage_audit           = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] instance_usage_audit_period    = month {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] internal_service_availability_zone = internal {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] key                            = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] live_migration_retry_count     = 30 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] log_config_append              = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] log_dir                        = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] log_file                       = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] log_options                    = True {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] log_rotate_interval            = 1 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] log_rotate_interval_type       = days {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] log_rotation_type              = none {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] long_rpc_timeout               = 1800 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] max_concurrent_builds          = 10 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] max_concurrent_live_migrations = 1 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] max_concurrent_snapshots       = 5 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] max_local_block_devices        = 3 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] max_logfile_count              = 30 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] max_logfile_size_mb            = 200 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] maximum_instance_delete_attempts = 5 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] metadata_listen                = 0.0.0.0 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] metadata_listen_port           = 8775 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] metadata_workers               = 3 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] migrate_max_retries            = -1 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] mkisofs_cmd                    = genisoimage {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] my_ip                          = 10.0.0.210 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] network_allocate_retries       = 0 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] osapi_compute_listen_port      = 8774 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] osapi_compute_unique_server_name_scope =  {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] osapi_compute_workers          = 3 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] password_length                = 12 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] periodic_enable                = True {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] periodic_fuzzy_delay           = 60 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] pointer_model                  = ps2mouse {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] preallocate_images             = none {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] publish_errors                 = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] pybasedir                      = /opt/stack/nova {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] ram_allocation_ratio           = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] rate_limit_burst               = 0 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] rate_limit_except_level        = CRITICAL {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] rate_limit_interval            = 0 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] reboot_timeout                 = 0 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] reclaim_instance_interval      = 0 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] record                         = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] reimage_timeout_per_gb         = 60 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] report_interval                = 120 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] rescue_timeout                 = 0 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] reserved_host_cpus             = 0 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] reserved_host_disk_mb          = 0 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] reserved_host_memory_mb        = 512 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] reserved_huge_pages            = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] resize_confirm_window          = 0 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] resize_fs_using_block_device   = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] resume_guests_state_on_host_boot = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] rpc_response_timeout           = 60 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] run_external_periodic_tasks    = True {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] running_deleted_instance_action = reap {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] running_deleted_instance_poll_interval = 1800 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] running_deleted_instance_timeout = 0 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] scheduler_instance_sync_interval = 120 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] service_down_time              = 720 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] servicegroup_driver            = db {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] shelved_offload_time           = 0 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] shelved_poll_interval          = 3600 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] shutdown_timeout               = 0 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] source_is_ipv6                 = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] ssl_only                       = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] state_path                     = /opt/stack/data/nova {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] sync_power_state_interval      = 600 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] sync_power_state_pool_size     = 1000 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] syslog_log_facility            = LOG_USER {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] tempdir                        = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] timeout_nbd                    = 10 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] transport_url                  = **** {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] update_resources_interval      = 0 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] use_cow_images                 = True {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] use_eventlog                   = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] use_journal                    = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] use_json                       = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] use_rootwrap_daemon            = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] use_stderr                     = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] use_syslog                     = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] vcpu_pin_set                   = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] vif_plugging_is_fatal          = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] vif_plugging_timeout           = 0 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] virt_mkfs                      = [] {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] volume_usage_poll_interval     = 0 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] watch_log_file                 = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] web                            = /usr/share/spice-html5 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] oslo_concurrency.disable_process_locking = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] api.auth_strategy              = keystone {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] api.compute_link_prefix        = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] api.dhcp_domain                = novalocal {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] api.enable_instance_password   = True {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] api.glance_link_prefix         = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] api.instance_list_per_project_cells = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] api.list_records_by_skipping_down_cells = True {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] api.local_metadata_per_cell    = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] api.max_limit                  = 1000 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] api.metadata_cache_expiration  = 15 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] api.neutron_default_tenant_id  = default {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] api.use_forwarded_for          = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] api.use_neutron_default_nets   = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] api.vendordata_dynamic_targets = [] {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] api.vendordata_jsonfile_path   = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] cache.backend                  = dogpile.cache.memcached {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] cache.backend_argument         = **** {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] cache.config_prefix            = cache.oslo {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] cache.dead_timeout             = 60.0 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] cache.debug_cache_backend      = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] cache.enable_retry_client      = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] cache.enable_socket_keepalive  = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] cache.enabled                  = True {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] cache.expiration_time          = 600 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] cache.hashclient_retry_attempts = 2 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] cache.memcache_dead_retry      = 300 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] cache.memcache_password        =  {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] cache.memcache_pool_maxsize    = 10 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] cache.memcache_sasl_enabled    = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] cache.memcache_username        =  {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] cache.proxies                  = [] {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] cache.retry_attempts           = 2 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] cache.retry_delay              = 0.0 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] cache.socket_keepalive_count   = 1 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] cache.socket_keepalive_idle    = 1 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] cache.socket_keepalive_interval = 1 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] cache.tls_allowed_ciphers      = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] cache.tls_cafile               = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] cache.tls_certfile             = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] cache.tls_enabled              = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] cache.tls_keyfile              = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] cinder.auth_section            = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] cinder.auth_type               = password {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] cinder.cafile                  = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] cinder.certfile                = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] cinder.collect_timing          = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] cinder.cross_az_attach         = True {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] cinder.debug                   = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] cinder.endpoint_template       = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] cinder.http_retries            = 3 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] cinder.insecure                = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] cinder.keyfile                 = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] cinder.os_region_name          = RegionOne {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] cinder.split_loggers           = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] cinder.timeout                 = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] compute.cpu_dedicated_set      = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] compute.cpu_shared_set         = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] compute.image_type_exclude_list = [] {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] compute.max_concurrent_disk_ops = 0 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] compute.max_disk_devices_to_attach = -1 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] compute.resource_provider_association_refresh = 300 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] compute.shutdown_retry_interval = 10 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] conductor.workers              = 3 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] console.allowed_origins        = [] {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] console.ssl_ciphers            = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] console.ssl_minimum_version    = default {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] consoleauth.token_ttl          = 600 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] cyborg.cafile                  = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] cyborg.certfile                = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] cyborg.collect_timing          = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] cyborg.connect_retries         = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] cyborg.connect_retry_delay     = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] cyborg.endpoint_override       = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] cyborg.insecure                = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] cyborg.keyfile                 = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] cyborg.max_version             = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] cyborg.min_version             = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] cyborg.region_name             = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] cyborg.service_name            = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] cyborg.service_type            = accelerator {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] cyborg.split_loggers           = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] cyborg.status_code_retries     = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] cyborg.status_code_retry_delay = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] cyborg.timeout                 = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] cyborg.version                 = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] database.backend               = sqlalchemy {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] database.connection            = **** {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] database.connection_debug      = 0 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] database.connection_parameters =  {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] database.connection_recycle_time = 3600 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] database.connection_trace      = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] database.db_inc_retry_interval = True {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] database.db_max_retries        = 20 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] database.db_max_retry_interval = 10 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] database.db_retry_interval     = 1 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] database.max_overflow          = 50 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] database.max_pool_size         = 5 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] database.max_retries           = 10 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] database.mysql_wsrep_sync_wait = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] database.pool_timeout          = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] database.retry_interval        = 10 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] database.slave_connection      = **** {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] database.sqlite_synchronous    = True {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] api_database.backend           = sqlalchemy {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] api_database.connection        = **** {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] api_database.connection_debug  = 0 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] api_database.connection_parameters =  {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] api_database.connection_recycle_time = 3600 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] api_database.connection_trace  = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] api_database.db_inc_retry_interval = True {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] api_database.db_max_retries    = 20 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] api_database.db_max_retry_interval = 10 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] api_database.db_retry_interval = 1 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] api_database.max_overflow      = 50 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] api_database.max_pool_size     = 5 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] api_database.max_retries       = 10 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] api_database.pool_timeout      = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] api_database.retry_interval    = 10 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] api_database.slave_connection  = **** {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] api_database.sqlite_synchronous = True {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] devices.enabled_mdev_types     = [] {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] ephemeral_storage_encryption.enabled = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] glance.api_servers             = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] glance.cafile                  = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] glance.certfile                = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] glance.collect_timing          = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] glance.connect_retries         = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] glance.connect_retry_delay     = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] glance.debug                   = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] glance.default_trusted_certificate_ids = [] {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] glance.enable_certificate_validation = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] glance.enable_rbd_download     = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] glance.endpoint_override       = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] glance.insecure                = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] glance.keyfile                 = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] glance.max_version             = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] glance.min_version             = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] glance.num_retries             = 3 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] glance.rbd_ceph_conf           =  {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] glance.rbd_connect_timeout     = 5 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] glance.rbd_pool                =  {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] glance.rbd_user                =  {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] glance.region_name             = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] glance.service_name            = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] glance.service_type            = image {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] glance.split_loggers           = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] glance.status_code_retries     = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] glance.status_code_retry_delay = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] glance.timeout                 = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] glance.verify_glance_signatures = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] glance.version                 = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] guestfs.debug                  = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] hyperv.config_drive_cdrom      = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] hyperv.config_drive_inject_password = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] hyperv.enable_instance_metrics_collection = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] hyperv.enable_remotefx         = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] hyperv.instances_path_share    =  {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] hyperv.iscsi_initiator_list    = [] {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] hyperv.limit_cpu_features      = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] hyperv.power_state_check_timeframe = 60 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] hyperv.use_multipath_io        = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] hyperv.volume_attach_retry_count = 10 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] hyperv.vswitch_name            = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] mks.enabled                    = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] image_cache.manager_interval   = 2400 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] image_cache.precache_concurrency = 1 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] image_cache.remove_unused_base_images = True {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] image_cache.subdirectory_name  = _base {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] ironic.api_max_retries         = 60 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] ironic.api_retry_interval      = 2 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] ironic.auth_section            = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] ironic.auth_type               = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] ironic.cafile                  = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] ironic.certfile                = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] ironic.collect_timing          = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] ironic.conductor_group         = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] ironic.connect_retries         = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] ironic.connect_retry_delay     = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] ironic.endpoint_override       = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] ironic.insecure                = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] ironic.keyfile                 = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] ironic.max_version             = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] ironic.min_version             = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] ironic.peer_list               = [] {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] ironic.region_name             = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] ironic.serial_console_state_timeout = 10 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] ironic.service_name            = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] ironic.service_type            = baremetal {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] ironic.split_loggers           = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] ironic.status_code_retries     = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] ironic.status_code_retry_delay = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] ironic.timeout                 = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] ironic.version                 = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] key_manager.fixed_key          = **** {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] barbican.barbican_api_version  = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] barbican.barbican_endpoint     = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] barbican.barbican_endpoint_type = public {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] barbican.barbican_region_name  = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] barbican.cafile                = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] barbican.certfile              = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] barbican.collect_timing        = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] barbican.insecure              = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] barbican.keyfile               = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] barbican.number_of_retries     = 60 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] barbican.retry_delay           = 1 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] barbican.send_service_user_token = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] barbican.split_loggers         = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] barbican.timeout               = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] barbican.verify_ssl            = True {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] barbican.verify_ssl_path       = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] barbican_service_user.auth_section = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] barbican_service_user.auth_type = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] barbican_service_user.cafile   = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] barbican_service_user.certfile = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] barbican_service_user.collect_timing = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] barbican_service_user.insecure = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] barbican_service_user.keyfile  = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] barbican_service_user.split_loggers = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] barbican_service_user.timeout  = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] vault.approle_role_id          = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] vault.approle_secret_id        = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] vault.cafile                   = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] vault.certfile                 = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] vault.collect_timing           = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] vault.insecure                 = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] vault.keyfile                  = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] vault.kv_mountpoint            = secret {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] vault.kv_path                  = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] vault.kv_version               = 2 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] vault.namespace                = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] vault.root_token_id            = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] vault.split_loggers            = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] vault.ssl_ca_crt_file          = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] vault.timeout                  = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] vault.use_ssl                  = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] keystone.auth_section          = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] keystone.auth_type             = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] keystone.cafile                = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] keystone.certfile              = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] keystone.collect_timing        = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] keystone.connect_retries       = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] keystone.connect_retry_delay   = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] keystone.endpoint_override     = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] keystone.insecure              = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] keystone.keyfile               = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] keystone.max_version           = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] keystone.min_version           = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] keystone.region_name           = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] keystone.service_name          = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] keystone.service_type          = identity {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] keystone.split_loggers         = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] keystone.status_code_retries   = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] keystone.status_code_retry_delay = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] keystone.timeout               = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] keystone.version               = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] libvirt.connection_uri         =  {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] libvirt.cpu_mode               = custom {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: WARNING oslo_config.cfg [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] libvirt.cpu_power_governor_high = performance {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] libvirt.cpu_power_governor_low = powersave {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] libvirt.cpu_power_management   = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] libvirt.device_detach_attempts = 8 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] libvirt.device_detach_timeout  = 20 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] libvirt.disk_cachemodes        = [] {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] libvirt.disk_prefix            = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] libvirt.enabled_perf_events    = [] {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] libvirt.file_backed_memory     = 0 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] libvirt.gid_maps               = [] {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] libvirt.hw_disk_discard        = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] libvirt.hw_machine_type        = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] libvirt.images_rbd_glance_store_name =  {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] libvirt.images_rbd_pool        = rbd {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] libvirt.images_type            = default {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] libvirt.images_volume_group    = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] libvirt.inject_key             = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] libvirt.inject_partition       = -2 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] libvirt.inject_password        = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] libvirt.iscsi_iface            = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] libvirt.iser_use_multipath     = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] libvirt.live_migration_bandwidth = 0 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] libvirt.live_migration_downtime = 500 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] libvirt.live_migration_inbound_addr = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] libvirt.live_migration_permit_post_copy = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] libvirt.live_migration_scheme  = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] libvirt.live_migration_timeout_action = abort {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] libvirt.live_migration_tunnelled = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: WARNING oslo_config.cfg [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Nov 03 12:12:33 user nova-compute[74960]: live_migration_uri is deprecated for removal in favor of two other options that
Nov 03 12:12:33 user nova-compute[74960]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Nov 03 12:12:33 user nova-compute[74960]: and ``live_migration_inbound_addr`` respectively.
Nov 03 12:12:33 user nova-compute[74960]: ).  Its value may be silently ignored in the future.
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] libvirt.live_migration_with_native_tls = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] libvirt.max_queues             = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] libvirt.nfs_mount_options      = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] libvirt.num_memory_encrypted_guests = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] libvirt.num_pcie_ports         = 0 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] libvirt.pmem_namespaces        = [] {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] libvirt.quobyte_client_cfg     = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] libvirt.rbd_secret_uuid        = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] libvirt.rbd_user               = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] libvirt.remote_filesystem_transport = ssh {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] libvirt.rescue_image_id        = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] libvirt.rescue_kernel_id       = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] libvirt.rescue_ramdisk_id      = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] libvirt.rx_queue_size          = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] libvirt.smbfs_mount_options    =  {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] libvirt.snapshot_compression   = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] libvirt.snapshot_image_format  = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] libvirt.sparse_logical_volumes = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] libvirt.swtpm_enabled          = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] libvirt.swtpm_group            = tss {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] libvirt.swtpm_user             = tss {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] libvirt.sysinfo_serial         = unique {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] libvirt.tb_cache_size          = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] libvirt.tx_queue_size          = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] libvirt.uid_maps               = [] {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] libvirt.use_virtio_for_bridges = True {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] libvirt.virt_type              = kvm {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] libvirt.volume_clear           = zero {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] libvirt.volume_clear_size      = 0 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] libvirt.volume_use_multipath   = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] libvirt.vzstorage_cache_path   = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] libvirt.vzstorage_mount_user   = stack {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] neutron.auth_section           = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] neutron.auth_type              = password {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] neutron.cafile                 = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] neutron.certfile               = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] neutron.collect_timing         = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] neutron.connect_retries        = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] neutron.connect_retry_delay    = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] neutron.default_floating_pool  = public {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] neutron.endpoint_override      = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] neutron.extension_sync_interval = 600 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] neutron.http_retries           = 3 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] neutron.insecure               = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] neutron.keyfile                = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] neutron.max_version            = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] neutron.min_version            = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] neutron.ovs_bridge             = br-int {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] neutron.physnets               = [] {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] neutron.region_name            = RegionOne {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] neutron.service_metadata_proxy = True {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] neutron.service_name           = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] neutron.service_type           = network {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] neutron.split_loggers          = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] neutron.status_code_retries    = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] neutron.status_code_retry_delay = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] neutron.timeout                = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] neutron.version                = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] notifications.bdms_in_notifications = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] notifications.default_level    = INFO {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] notifications.notification_format = unversioned {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] notifications.notify_on_state_change = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] pci.alias                      = [] {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] pci.device_spec                = [] {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] pci.report_in_placement        = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] placement.auth_section         = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] placement.auth_type            = password {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] placement.cafile               = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] placement.certfile             = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] placement.collect_timing       = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] placement.connect_retries      = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] placement.connect_retry_delay  = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] placement.default_domain_id    = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] placement.default_domain_name  = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] placement.domain_id            = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] placement.domain_name          = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] placement.endpoint_override    = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] placement.insecure             = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] placement.keyfile              = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] placement.max_version          = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] placement.min_version          = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] placement.password             = **** {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] placement.project_domain_id    = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] placement.project_domain_name  = Default {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] placement.project_id           = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] placement.project_name         = service {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] placement.region_name          = RegionOne {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] placement.service_name         = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] placement.service_type         = placement {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] placement.split_loggers        = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] placement.status_code_retries  = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] placement.status_code_retry_delay = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] placement.system_scope         = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] placement.timeout              = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] placement.trust_id             = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] placement.user_domain_id       = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] placement.user_domain_name     = Default {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] placement.user_id              = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] placement.username             = placement {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] placement.version              = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] quota.cores                    = 20 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] quota.count_usage_from_placement = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] quota.injected_file_content_bytes = 10240 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] quota.injected_file_path_length = 255 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] quota.injected_files           = 5 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] quota.instances                = 10 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] quota.key_pairs                = 100 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] quota.metadata_items           = 128 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] quota.ram                      = 51200 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] quota.recheck_quota            = True {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] quota.server_group_members     = 10 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] quota.server_groups            = 10 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] rdp.enabled                    = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] scheduler.image_metadata_prefilter = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] scheduler.max_attempts         = 3 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] scheduler.max_placement_results = 1000 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] scheduler.query_placement_for_image_type_support = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] scheduler.workers              = 3 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] filter_scheduler.host_subset_size = 1 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] filter_scheduler.isolated_hosts = [] {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] filter_scheduler.isolated_images = [] {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] filter_scheduler.pci_in_placement = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] filter_scheduler.track_instance_changes = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] metrics.required               = True {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] metrics.weight_multiplier      = 1.0 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] metrics.weight_setting         = [] {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] serial_console.enabled         = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] serial_console.port_range      = 10000:20000 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] serial_console.serialproxy_port = 6083 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] service_user.auth_section      = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] service_user.auth_type         = password {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] service_user.cafile            = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] service_user.certfile          = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] service_user.collect_timing    = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] service_user.insecure          = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] service_user.keyfile           = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] service_user.send_service_user_token = True {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] service_user.split_loggers     = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] service_user.timeout           = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] spice.agent_enabled            = True {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] spice.enabled                  = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] spice.html5proxy_port          = 6082 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] spice.image_compression        = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] spice.jpeg_compression         = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] spice.playback_compression     = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] spice.server_listen            = 127.0.0.1 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] spice.streaming_mode           = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] spice.zlib_compression         = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] upgrade_levels.baseapi         = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] upgrade_levels.cert            = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] upgrade_levels.compute         = auto {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] upgrade_levels.conductor       = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] upgrade_levels.scheduler       = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] vendordata_dynamic_auth.auth_section = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] vendordata_dynamic_auth.auth_type = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] vendordata_dynamic_auth.cafile = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] vendordata_dynamic_auth.certfile = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] vendordata_dynamic_auth.insecure = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] vendordata_dynamic_auth.keyfile = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] vendordata_dynamic_auth.timeout = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] vmware.api_retry_count         = 10 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] vmware.ca_file                 = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] vmware.cache_prefix            = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] vmware.cluster_name            = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] vmware.connection_pool_size    = 10 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] vmware.console_delay_seconds   = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] vmware.datastore_regex         = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] vmware.host_ip                 = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] vmware.host_password           = **** {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] vmware.host_port               = 443 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] vmware.host_username           = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] vmware.insecure                = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] vmware.integration_bridge      = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] vmware.maximum_objects         = 100 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] vmware.pbm_default_policy      = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] vmware.pbm_enabled             = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] vmware.pbm_wsdl_location       = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] vmware.serial_port_proxy_uri   = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] vmware.serial_port_service_uri = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] vmware.task_poll_interval      = 0.5 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] vmware.use_linked_clone        = True {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] vmware.vnc_keymap              = en-us {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] vmware.vnc_port                = 5900 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] vmware.vnc_port_total          = 10000 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] vnc.auth_schemes               = ['none'] {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] vnc.enabled                    = True {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] vnc.novncproxy_port            = 6080 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] vnc.server_listen              = 0.0.0.0 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] vnc.vencrypt_ca_certs          = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] vnc.vencrypt_client_cert       = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] vnc.vencrypt_client_key        = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] workarounds.disable_rootwrap   = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] workarounds.enable_numa_live_migration = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] workarounds.libvirt_disable_apic = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] wsgi.client_socket_timeout     = 900 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] wsgi.default_pool_size         = 1000 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] wsgi.keep_alive                = True {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] wsgi.max_header_line           = 16384 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] wsgi.ssl_ca_file               = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] wsgi.ssl_cert_file             = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] wsgi.ssl_key_file              = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] wsgi.tcp_keepidle              = 600 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] zvm.ca_file                    = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] zvm.cloud_connector_url        = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] zvm.reachable_timeout          = 300 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] oslo_policy.enforce_new_defaults = True {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] oslo_policy.enforce_scope      = True {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] oslo_policy.policy_default_rule = default {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] oslo_policy.policy_file        = policy.yaml {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] profiler.connection_string     = messaging:// {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] profiler.enabled               = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] profiler.es_doc_type           = notification {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] profiler.es_scroll_size        = 10000 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] profiler.es_scroll_time        = 2m {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] profiler.filter_error_trace    = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] profiler.hmac_keys             = **** {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] profiler.sentinel_service_name = mymaster {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] profiler.socket_timeout        = 0.1 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] profiler.trace_requests        = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] profiler.trace_sqlalchemy      = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] profiler_jaeger.process_tags   = {} {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] profiler_jaeger.service_name_prefix = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] profiler_otlp.service_name_prefix = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] remote_debug.host              = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] remote_debug.port              = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] oslo_messaging_rabbit.ssl      = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] oslo_messaging_notifications.retry = -1 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] oslo_messaging_notifications.transport_url = **** {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] oslo_limit.auth_section        = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] oslo_limit.auth_type           = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] oslo_limit.cafile              = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] oslo_limit.certfile            = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] oslo_limit.collect_timing      = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] oslo_limit.connect_retries     = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] oslo_limit.connect_retry_delay = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] oslo_limit.endpoint_id         = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] oslo_limit.endpoint_override   = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] oslo_limit.insecure            = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] oslo_limit.keyfile             = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] oslo_limit.max_version         = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] oslo_limit.min_version         = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] oslo_limit.region_name         = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] oslo_limit.service_name        = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] oslo_limit.service_type        = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] oslo_limit.split_loggers       = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] oslo_limit.status_code_retries = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] oslo_limit.status_code_retry_delay = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] oslo_limit.timeout             = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] oslo_limit.valid_interfaces    = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] oslo_limit.version             = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] oslo_reports.file_event_handler = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] oslo_reports.log_dir           = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] vif_plug_ovs_privileged.group  = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] vif_plug_ovs_privileged.user   = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] os_vif_linux_bridge.flat_interface = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] os_vif_ovs.isolate_vif         = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:33 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:34 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:34 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:34 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:34 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] os_vif_ovs.per_port_bridge     = False {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:34 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] os_brick.lock_path             = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:34 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] privsep_osbrick.capabilities   = [21] {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:34 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] privsep_osbrick.group          = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:34 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] privsep_osbrick.helper_command = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:34 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:34 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:34 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] privsep_osbrick.user           = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:34 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:34 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] nova_sys_admin.group           = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:34 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] nova_sys_admin.helper_command  = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:34 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:34 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:34 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] nova_sys_admin.user            = None {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 12:12:34 user nova-compute[74960]: DEBUG oslo_service.service [None req-0f9968f8-15a7-4ba5-900c-f186b0c513b7 None None] ******************************************************************************** {{(pid=74960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Nov 03 12:12:34 user nova-compute[74960]: INFO nova.service [-] Starting compute node (version 0.0.0)
Nov 03 12:12:34 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-fb4353de-ffac-4cd0-ae62-b5aea0300ae4 None None] Connecting to libvirt: qemu:///system {{(pid=74960) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Nov 03 12:12:34 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-fb4353de-ffac-4cd0-ae62-b5aea0300ae4 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f9aad72efe0> {{(pid=74960) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Nov 03 12:12:34 user nova-compute[74960]: libvirt:  error : internal error: could not initialize domain event timer
Nov 03 12:12:34 user nova-compute[74960]: WARNING nova.virt.libvirt.host [None req-fb4353de-ffac-4cd0-ae62-b5aea0300ae4 None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Nov 03 12:12:34 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-fb4353de-ffac-4cd0-ae62-b5aea0300ae4 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f9aad72efe0> {{(pid=74960) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Nov 03 12:12:34 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-fb4353de-ffac-4cd0-ae62-b5aea0300ae4 None None] Starting native event thread {{(pid=74960) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Nov 03 12:12:34 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-fb4353de-ffac-4cd0-ae62-b5aea0300ae4 None None] Starting green dispatch thread {{(pid=74960) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Nov 03 12:12:34 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-fb4353de-ffac-4cd0-ae62-b5aea0300ae4 None None] Starting connection event dispatch thread {{(pid=74960) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Nov 03 12:12:34 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-fb4353de-ffac-4cd0-ae62-b5aea0300ae4 None None] Connection event '1' reason 'None'
Nov 03 12:12:34 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-fb4353de-ffac-4cd0-ae62-b5aea0300ae4 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 03 12:12:34 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.mount [None req-fb4353de-ffac-4cd0-ae62-b5aea0300ae4 None None] Initialising _HostMountState generation 0 {{(pid=74960) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Nov 03 12:12:41 user nova-compute[74960]: INFO nova.virt.libvirt.host [None req-fb4353de-ffac-4cd0-ae62-b5aea0300ae4 None None] Libvirt host capabilities <capabilities>
Nov 03 12:12:41 user nova-compute[74960]:   <host>
Nov 03 12:12:41 user nova-compute[74960]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Nov 03 12:12:41 user nova-compute[74960]:     <cpu>
Nov 03 12:12:41 user nova-compute[74960]:       <arch>x86_64</arch>
Nov 03 12:12:41 user nova-compute[74960]:       <model>IvyBridge-IBRS</model>
Nov 03 12:12:41 user nova-compute[74960]:       <vendor>Intel</vendor>
Nov 03 12:12:41 user nova-compute[74960]:       <microcode version='1070'/>
Nov 03 12:12:41 user nova-compute[74960]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Nov 03 12:12:41 user nova-compute[74960]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature name='ss'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature name='vmx'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature name='pcid'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature name='osxsave'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature name='hypervisor'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature name='arat'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature name='tsc_adjust'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature name='md-clear'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature name='stibp'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature name='arch-capabilities'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature name='ssbd'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature name='invtsc'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature name='rsba'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature name='skip-l1dfl-vmentry'/>
Nov 03 12:12:41 user nova-compute[74960]:       <pages unit='KiB' size='4'/>
Nov 03 12:12:41 user nova-compute[74960]:       <pages unit='KiB' size='2048'/>
Nov 03 12:12:41 user nova-compute[74960]:     </cpu>
Nov 03 12:12:41 user nova-compute[74960]:     <power_management>
Nov 03 12:12:41 user nova-compute[74960]:       <suspend_mem/>
Nov 03 12:12:41 user nova-compute[74960]:       <suspend_disk/>
Nov 03 12:12:41 user nova-compute[74960]:       <suspend_hybrid/>
Nov 03 12:12:41 user nova-compute[74960]:     </power_management>
Nov 03 12:12:41 user nova-compute[74960]:     <iommu support='no'/>
Nov 03 12:12:41 user nova-compute[74960]:     <migration_features>
Nov 03 12:12:41 user nova-compute[74960]:       <live/>
Nov 03 12:12:41 user nova-compute[74960]:       <uri_transports>
Nov 03 12:12:41 user nova-compute[74960]:         <uri_transport>tcp</uri_transport>
Nov 03 12:12:41 user nova-compute[74960]:         <uri_transport>rdma</uri_transport>
Nov 03 12:12:41 user nova-compute[74960]:       </uri_transports>
Nov 03 12:12:41 user nova-compute[74960]:     </migration_features>
Nov 03 12:12:41 user nova-compute[74960]:     <topology>
Nov 03 12:12:41 user nova-compute[74960]:       <cells num='2'>
Nov 03 12:12:41 user nova-compute[74960]:         <cell id='0'>
Nov 03 12:12:41 user nova-compute[74960]:           <memory unit='KiB'>8140616</memory>
Nov 03 12:12:41 user nova-compute[74960]:           <pages unit='KiB' size='4'>2035154</pages>
Nov 03 12:12:41 user nova-compute[74960]:           <pages unit='KiB' size='2048'>0</pages>
Nov 03 12:12:41 user nova-compute[74960]:           <distances>
Nov 03 12:12:41 user nova-compute[74960]:             <sibling id='0' value='10'/>
Nov 03 12:12:41 user nova-compute[74960]:             <sibling id='1' value='20'/>
Nov 03 12:12:41 user nova-compute[74960]:           </distances>
Nov 03 12:12:41 user nova-compute[74960]:           <cpus num='6'>
Nov 03 12:12:41 user nova-compute[74960]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Nov 03 12:12:41 user nova-compute[74960]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Nov 03 12:12:41 user nova-compute[74960]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Nov 03 12:12:41 user nova-compute[74960]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Nov 03 12:12:41 user nova-compute[74960]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Nov 03 12:12:41 user nova-compute[74960]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Nov 03 12:12:41 user nova-compute[74960]:           </cpus>
Nov 03 12:12:41 user nova-compute[74960]:         </cell>
Nov 03 12:12:41 user nova-compute[74960]:         <cell id='1'>
Nov 03 12:12:41 user nova-compute[74960]:           <memory unit='KiB'>8255068</memory>
Nov 03 12:12:41 user nova-compute[74960]:           <pages unit='KiB' size='4'>2063767</pages>
Nov 03 12:12:41 user nova-compute[74960]:           <pages unit='KiB' size='2048'>0</pages>
Nov 03 12:12:41 user nova-compute[74960]:           <distances>
Nov 03 12:12:41 user nova-compute[74960]:             <sibling id='0' value='20'/>
Nov 03 12:12:41 user nova-compute[74960]:             <sibling id='1' value='10'/>
Nov 03 12:12:41 user nova-compute[74960]:           </distances>
Nov 03 12:12:41 user nova-compute[74960]:           <cpus num='6'>
Nov 03 12:12:41 user nova-compute[74960]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Nov 03 12:12:41 user nova-compute[74960]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Nov 03 12:12:41 user nova-compute[74960]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Nov 03 12:12:41 user nova-compute[74960]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Nov 03 12:12:41 user nova-compute[74960]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Nov 03 12:12:41 user nova-compute[74960]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Nov 03 12:12:41 user nova-compute[74960]:           </cpus>
Nov 03 12:12:41 user nova-compute[74960]:         </cell>
Nov 03 12:12:41 user nova-compute[74960]:       </cells>
Nov 03 12:12:41 user nova-compute[74960]:     </topology>
Nov 03 12:12:41 user nova-compute[74960]:     <cache>
Nov 03 12:12:41 user nova-compute[74960]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Nov 03 12:12:41 user nova-compute[74960]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Nov 03 12:12:41 user nova-compute[74960]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Nov 03 12:12:41 user nova-compute[74960]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Nov 03 12:12:41 user nova-compute[74960]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Nov 03 12:12:41 user nova-compute[74960]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Nov 03 12:12:41 user nova-compute[74960]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Nov 03 12:12:41 user nova-compute[74960]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Nov 03 12:12:41 user nova-compute[74960]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Nov 03 12:12:41 user nova-compute[74960]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Nov 03 12:12:41 user nova-compute[74960]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Nov 03 12:12:41 user nova-compute[74960]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Nov 03 12:12:41 user nova-compute[74960]:     </cache>
Nov 03 12:12:41 user nova-compute[74960]:     <secmodel>
Nov 03 12:12:41 user nova-compute[74960]:       <model>apparmor</model>
Nov 03 12:12:41 user nova-compute[74960]:       <doi>0</doi>
Nov 03 12:12:41 user nova-compute[74960]:     </secmodel>
Nov 03 12:12:41 user nova-compute[74960]:     <secmodel>
Nov 03 12:12:41 user nova-compute[74960]:       <model>dac</model>
Nov 03 12:12:41 user nova-compute[74960]:       <doi>0</doi>
Nov 03 12:12:41 user nova-compute[74960]:       <baselabel type='kvm'>+64055:+108</baselabel>
Nov 03 12:12:41 user nova-compute[74960]:       <baselabel type='qemu'>+64055:+108</baselabel>
Nov 03 12:12:41 user nova-compute[74960]:     </secmodel>
Nov 03 12:12:41 user nova-compute[74960]:   </host>
Nov 03 12:12:41 user nova-compute[74960]:   <guest>
Nov 03 12:12:41 user nova-compute[74960]:     <os_type>hvm</os_type>
Nov 03 12:12:41 user nova-compute[74960]:     <arch name='alpha'>
Nov 03 12:12:41 user nova-compute[74960]:       <wordsize>64</wordsize>
Nov 03 12:12:41 user nova-compute[74960]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='4'>clipper</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <domain type='qemu'/>
Nov 03 12:12:41 user nova-compute[74960]:     </arch>
Nov 03 12:12:41 user nova-compute[74960]:     <features>
Nov 03 12:12:41 user nova-compute[74960]:       <cpuselection/>
Nov 03 12:12:41 user nova-compute[74960]:       <deviceboot/>
Nov 03 12:12:41 user nova-compute[74960]:       <disksnapshot default='on' toggle='no'/>
Nov 03 12:12:41 user nova-compute[74960]:     </features>
Nov 03 12:12:41 user nova-compute[74960]:   </guest>
Nov 03 12:12:41 user nova-compute[74960]:   <guest>
Nov 03 12:12:41 user nova-compute[74960]:     <os_type>hvm</os_type>
Nov 03 12:12:41 user nova-compute[74960]:     <arch name='armv6l'>
Nov 03 12:12:41 user nova-compute[74960]:       <wordsize>32</wordsize>
Nov 03 12:12:41 user nova-compute[74960]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>integratorcp</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>borzoi</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>spitz</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2'>nuri</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2'>musca-b1</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>versatileab</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>kzm</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2'>musca-a</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2'>smdkc210</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>sx1</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>z2</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>tosa</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='4'>sabrelite</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>realview-eb</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>n810</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>n800</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>versatilepb</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>terrier</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>mainstone</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='4'>midway</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>musicpal</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>microbit</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>cubieboard</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>verdex</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>netduino2</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='4'>raspi2b</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>cheetah</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='4'>highbank</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>akita</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>connex</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>collie</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>raspi0</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <domain type='qemu'/>
Nov 03 12:12:41 user nova-compute[74960]:     </arch>
Nov 03 12:12:41 user nova-compute[74960]:     <features>
Nov 03 12:12:41 user nova-compute[74960]:       <cpuselection/>
Nov 03 12:12:41 user nova-compute[74960]:       <deviceboot/>
Nov 03 12:12:41 user nova-compute[74960]:       <disksnapshot default='on' toggle='no'/>
Nov 03 12:12:41 user nova-compute[74960]:     </features>
Nov 03 12:12:41 user nova-compute[74960]:   </guest>
Nov 03 12:12:41 user nova-compute[74960]:   <guest>
Nov 03 12:12:41 user nova-compute[74960]:     <os_type>hvm</os_type>
Nov 03 12:12:41 user nova-compute[74960]:     <arch name='armv7l'>
Nov 03 12:12:41 user nova-compute[74960]:       <wordsize>32</wordsize>
Nov 03 12:12:41 user nova-compute[74960]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>integratorcp</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>borzoi</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>spitz</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2'>nuri</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2'>musca-b1</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>versatileab</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>kzm</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2'>musca-a</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2'>smdkc210</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>sx1</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>z2</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>tosa</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='4'>sabrelite</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>realview-eb</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>n810</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>n800</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>versatilepb</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>terrier</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>mainstone</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='4'>midway</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>musicpal</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>microbit</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>cubieboard</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>verdex</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>netduino2</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='4'>raspi2b</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>cheetah</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='4'>highbank</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>akita</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>connex</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>collie</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>raspi0</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <domain type='qemu'/>
Nov 03 12:12:41 user nova-compute[74960]:     </arch>
Nov 03 12:12:41 user nova-compute[74960]:     <features>
Nov 03 12:12:41 user nova-compute[74960]:       <cpuselection/>
Nov 03 12:12:41 user nova-compute[74960]:       <deviceboot/>
Nov 03 12:12:41 user nova-compute[74960]:       <disksnapshot default='on' toggle='no'/>
Nov 03 12:12:41 user nova-compute[74960]:     </features>
Nov 03 12:12:41 user nova-compute[74960]:   </guest>
Nov 03 12:12:41 user nova-compute[74960]:   <guest>
Nov 03 12:12:41 user nova-compute[74960]:     <os_type>hvm</os_type>
Nov 03 12:12:41 user nova-compute[74960]:     <arch name='aarch64'>
Nov 03 12:12:41 user nova-compute[74960]:       <wordsize>64</wordsize>
Nov 03 12:12:41 user nova-compute[74960]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>integratorcp</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>borzoi</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>spitz</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2'>nuri</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2'>musca-b1</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>versatileab</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>kzm</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2'>musca-a</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2'>smdkc210</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>sx1</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>z2</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>tosa</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='4'>sabrelite</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>realview-eb</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='512'>sbsa-ref</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>n810</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>n800</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>versatilepb</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>terrier</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>mainstone</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='4'>midway</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>musicpal</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>microbit</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='4'>raspi3ap</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>cubieboard</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>verdex</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>netduino2</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='4'>raspi3b</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='4'>raspi2b</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>cheetah</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='4'>highbank</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>akita</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>connex</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>collie</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>raspi0</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <domain type='qemu'/>
Nov 03 12:12:41 user nova-compute[74960]:     </arch>
Nov 03 12:12:41 user nova-compute[74960]:     <features>
Nov 03 12:12:41 user nova-compute[74960]:       <acpi default='on' toggle='yes'/>
Nov 03 12:12:41 user nova-compute[74960]:       <cpuselection/>
Nov 03 12:12:41 user nova-compute[74960]:       <deviceboot/>
Nov 03 12:12:41 user nova-compute[74960]:       <disksnapshot default='on' toggle='no'/>
Nov 03 12:12:41 user nova-compute[74960]:     </features>
Nov 03 12:12:41 user nova-compute[74960]:   </guest>
Nov 03 12:12:41 user nova-compute[74960]:   <guest>
Nov 03 12:12:41 user nova-compute[74960]:     <os_type>hvm</os_type>
Nov 03 12:12:41 user nova-compute[74960]:     <arch name='cris'>
Nov 03 12:12:41 user nova-compute[74960]:       <wordsize>32</wordsize>
Nov 03 12:12:41 user nova-compute[74960]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>axis-dev88</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <domain type='qemu'/>
Nov 03 12:12:41 user nova-compute[74960]:     </arch>
Nov 03 12:12:41 user nova-compute[74960]:     <features>
Nov 03 12:12:41 user nova-compute[74960]:       <cpuselection/>
Nov 03 12:12:41 user nova-compute[74960]:       <deviceboot/>
Nov 03 12:12:41 user nova-compute[74960]:       <disksnapshot default='on' toggle='no'/>
Nov 03 12:12:41 user nova-compute[74960]:     </features>
Nov 03 12:12:41 user nova-compute[74960]:   </guest>
Nov 03 12:12:41 user nova-compute[74960]:   <guest>
Nov 03 12:12:41 user nova-compute[74960]:     <os_type>hvm</os_type>
Nov 03 12:12:41 user nova-compute[74960]:     <arch name='i686'>
Nov 03 12:12:41 user nova-compute[74960]:       <wordsize>32</wordsize>
Nov 03 12:12:41 user nova-compute[74960]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>x-remote</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>isapc</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='288'>microvm</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <domain type='qemu'/>
Nov 03 12:12:41 user nova-compute[74960]:       <domain type='kvm'/>
Nov 03 12:12:41 user nova-compute[74960]:     </arch>
Nov 03 12:12:41 user nova-compute[74960]:     <features>
Nov 03 12:12:41 user nova-compute[74960]:       <pae/>
Nov 03 12:12:41 user nova-compute[74960]:       <nonpae/>
Nov 03 12:12:41 user nova-compute[74960]:       <acpi default='on' toggle='yes'/>
Nov 03 12:12:41 user nova-compute[74960]:       <apic default='on' toggle='no'/>
Nov 03 12:12:41 user nova-compute[74960]:       <cpuselection/>
Nov 03 12:12:41 user nova-compute[74960]:       <deviceboot/>
Nov 03 12:12:41 user nova-compute[74960]:       <disksnapshot default='on' toggle='no'/>
Nov 03 12:12:41 user nova-compute[74960]:     </features>
Nov 03 12:12:41 user nova-compute[74960]:   </guest>
Nov 03 12:12:41 user nova-compute[74960]:   <guest>
Nov 03 12:12:41 user nova-compute[74960]:     <os_type>hvm</os_type>
Nov 03 12:12:41 user nova-compute[74960]:     <arch name='m68k'>
Nov 03 12:12:41 user nova-compute[74960]:       <wordsize>32</wordsize>
Nov 03 12:12:41 user nova-compute[74960]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>mcf5208evb</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>an5206</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>virt-6.0</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>q800</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>virt-6.2</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>next-cube</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>virt-6.1</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <domain type='qemu'/>
Nov 03 12:12:41 user nova-compute[74960]:     </arch>
Nov 03 12:12:41 user nova-compute[74960]:     <features>
Nov 03 12:12:41 user nova-compute[74960]:       <cpuselection/>
Nov 03 12:12:41 user nova-compute[74960]:       <deviceboot/>
Nov 03 12:12:41 user nova-compute[74960]:       <disksnapshot default='on' toggle='no'/>
Nov 03 12:12:41 user nova-compute[74960]:     </features>
Nov 03 12:12:41 user nova-compute[74960]:   </guest>
Nov 03 12:12:41 user nova-compute[74960]:   <guest>
Nov 03 12:12:41 user nova-compute[74960]:     <os_type>hvm</os_type>
Nov 03 12:12:41 user nova-compute[74960]:     <arch name='microblaze'>
Nov 03 12:12:41 user nova-compute[74960]:       <wordsize>32</wordsize>
Nov 03 12:12:41 user nova-compute[74960]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <domain type='qemu'/>
Nov 03 12:12:41 user nova-compute[74960]:     </arch>
Nov 03 12:12:41 user nova-compute[74960]:     <features>
Nov 03 12:12:41 user nova-compute[74960]:       <cpuselection/>
Nov 03 12:12:41 user nova-compute[74960]:       <deviceboot/>
Nov 03 12:12:41 user nova-compute[74960]:       <disksnapshot default='on' toggle='no'/>
Nov 03 12:12:41 user nova-compute[74960]:     </features>
Nov 03 12:12:41 user nova-compute[74960]:   </guest>
Nov 03 12:12:41 user nova-compute[74960]:   <guest>
Nov 03 12:12:41 user nova-compute[74960]:     <os_type>hvm</os_type>
Nov 03 12:12:41 user nova-compute[74960]:     <arch name='microblazeel'>
Nov 03 12:12:41 user nova-compute[74960]:       <wordsize>32</wordsize>
Nov 03 12:12:41 user nova-compute[74960]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <domain type='qemu'/>
Nov 03 12:12:41 user nova-compute[74960]:     </arch>
Nov 03 12:12:41 user nova-compute[74960]:     <features>
Nov 03 12:12:41 user nova-compute[74960]:       <cpuselection/>
Nov 03 12:12:41 user nova-compute[74960]:       <deviceboot/>
Nov 03 12:12:41 user nova-compute[74960]:       <disksnapshot default='on' toggle='no'/>
Nov 03 12:12:41 user nova-compute[74960]:     </features>
Nov 03 12:12:41 user nova-compute[74960]:   </guest>
Nov 03 12:12:41 user nova-compute[74960]:   <guest>
Nov 03 12:12:41 user nova-compute[74960]:     <os_type>hvm</os_type>
Nov 03 12:12:41 user nova-compute[74960]:     <arch name='mips'>
Nov 03 12:12:41 user nova-compute[74960]:       <wordsize>32</wordsize>
Nov 03 12:12:41 user nova-compute[74960]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='16'>malta</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>mipssim</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <domain type='qemu'/>
Nov 03 12:12:41 user nova-compute[74960]:     </arch>
Nov 03 12:12:41 user nova-compute[74960]:     <features>
Nov 03 12:12:41 user nova-compute[74960]:       <cpuselection/>
Nov 03 12:12:41 user nova-compute[74960]:       <deviceboot/>
Nov 03 12:12:41 user nova-compute[74960]:       <disksnapshot default='on' toggle='no'/>
Nov 03 12:12:41 user nova-compute[74960]:     </features>
Nov 03 12:12:41 user nova-compute[74960]:   </guest>
Nov 03 12:12:41 user nova-compute[74960]:   <guest>
Nov 03 12:12:41 user nova-compute[74960]:     <os_type>hvm</os_type>
Nov 03 12:12:41 user nova-compute[74960]:     <arch name='mipsel'>
Nov 03 12:12:41 user nova-compute[74960]:       <wordsize>32</wordsize>
Nov 03 12:12:41 user nova-compute[74960]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='16'>malta</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>mipssim</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <domain type='qemu'/>
Nov 03 12:12:41 user nova-compute[74960]:     </arch>
Nov 03 12:12:41 user nova-compute[74960]:     <features>
Nov 03 12:12:41 user nova-compute[74960]:       <cpuselection/>
Nov 03 12:12:41 user nova-compute[74960]:       <deviceboot/>
Nov 03 12:12:41 user nova-compute[74960]:       <disksnapshot default='on' toggle='no'/>
Nov 03 12:12:41 user nova-compute[74960]:     </features>
Nov 03 12:12:41 user nova-compute[74960]:   </guest>
Nov 03 12:12:41 user nova-compute[74960]:   <guest>
Nov 03 12:12:41 user nova-compute[74960]:     <os_type>hvm</os_type>
Nov 03 12:12:41 user nova-compute[74960]:     <arch name='mips64'>
Nov 03 12:12:41 user nova-compute[74960]:       <wordsize>64</wordsize>
Nov 03 12:12:41 user nova-compute[74960]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='16'>malta</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>mipssim</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>pica61</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>magnum</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <domain type='qemu'/>
Nov 03 12:12:41 user nova-compute[74960]:     </arch>
Nov 03 12:12:41 user nova-compute[74960]:     <features>
Nov 03 12:12:41 user nova-compute[74960]:       <cpuselection/>
Nov 03 12:12:41 user nova-compute[74960]:       <deviceboot/>
Nov 03 12:12:41 user nova-compute[74960]:       <disksnapshot default='on' toggle='no'/>
Nov 03 12:12:41 user nova-compute[74960]:     </features>
Nov 03 12:12:41 user nova-compute[74960]:   </guest>
Nov 03 12:12:41 user nova-compute[74960]:   <guest>
Nov 03 12:12:41 user nova-compute[74960]:     <os_type>hvm</os_type>
Nov 03 12:12:41 user nova-compute[74960]:     <arch name='mips64el'>
Nov 03 12:12:41 user nova-compute[74960]:       <wordsize>64</wordsize>
Nov 03 12:12:41 user nova-compute[74960]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='16'>malta</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='16'>loongson3-virt</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>mipssim</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>pica61</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>magnum</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='16'>boston</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>fuloong2e</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <domain type='qemu'/>
Nov 03 12:12:41 user nova-compute[74960]:     </arch>
Nov 03 12:12:41 user nova-compute[74960]:     <features>
Nov 03 12:12:41 user nova-compute[74960]:       <cpuselection/>
Nov 03 12:12:41 user nova-compute[74960]:       <deviceboot/>
Nov 03 12:12:41 user nova-compute[74960]:       <disksnapshot default='on' toggle='no'/>
Nov 03 12:12:41 user nova-compute[74960]:     </features>
Nov 03 12:12:41 user nova-compute[74960]:   </guest>
Nov 03 12:12:41 user nova-compute[74960]:   <guest>
Nov 03 12:12:41 user nova-compute[74960]:     <os_type>hvm</os_type>
Nov 03 12:12:41 user nova-compute[74960]:     <arch name='ppc'>
Nov 03 12:12:41 user nova-compute[74960]:       <wordsize>32</wordsize>
Nov 03 12:12:41 user nova-compute[74960]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>g3beige</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>mac99</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='32'>ppce500</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>pegasos2</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>sam460ex</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>bamboo</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>40p</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>ref405ep</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>taihu</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <domain type='qemu'/>
Nov 03 12:12:41 user nova-compute[74960]:     </arch>
Nov 03 12:12:41 user nova-compute[74960]:     <features>
Nov 03 12:12:41 user nova-compute[74960]:       <cpuselection/>
Nov 03 12:12:41 user nova-compute[74960]:       <deviceboot/>
Nov 03 12:12:41 user nova-compute[74960]:       <disksnapshot default='on' toggle='no'/>
Nov 03 12:12:41 user nova-compute[74960]:     </features>
Nov 03 12:12:41 user nova-compute[74960]:   </guest>
Nov 03 12:12:41 user nova-compute[74960]:   <guest>
Nov 03 12:12:41 user nova-compute[74960]:     <os_type>hvm</os_type>
Nov 03 12:12:41 user nova-compute[74960]:     <arch name='ppc64'>
Nov 03 12:12:41 user nova-compute[74960]:       <wordsize>64</wordsize>
Nov 03 12:12:41 user nova-compute[74960]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2048'>powernv9</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>taihu</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2048'>powernv10</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='32'>ppce500</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>40p</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>pegasos2</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>bamboo</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>g3beige</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>mac99</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>sam460ex</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>ref405ep</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2048'>powernv8</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <domain type='qemu'/>
Nov 03 12:12:41 user nova-compute[74960]:     </arch>
Nov 03 12:12:41 user nova-compute[74960]:     <features>
Nov 03 12:12:41 user nova-compute[74960]:       <cpuselection/>
Nov 03 12:12:41 user nova-compute[74960]:       <deviceboot/>
Nov 03 12:12:41 user nova-compute[74960]:       <disksnapshot default='on' toggle='no'/>
Nov 03 12:12:41 user nova-compute[74960]:     </features>
Nov 03 12:12:41 user nova-compute[74960]:   </guest>
Nov 03 12:12:41 user nova-compute[74960]:   <guest>
Nov 03 12:12:41 user nova-compute[74960]:     <os_type>hvm</os_type>
Nov 03 12:12:41 user nova-compute[74960]:     <arch name='ppc64le'>
Nov 03 12:12:41 user nova-compute[74960]:       <wordsize>64</wordsize>
Nov 03 12:12:41 user nova-compute[74960]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2048'>powernv9</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>taihu</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2048'>powernv10</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='32'>ppce500</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>40p</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>pegasos2</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>bamboo</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>g3beige</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>mac99</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>sam460ex</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>ref405ep</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2048'>powernv8</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <domain type='qemu'/>
Nov 03 12:12:41 user nova-compute[74960]:     </arch>
Nov 03 12:12:41 user nova-compute[74960]:     <features>
Nov 03 12:12:41 user nova-compute[74960]:       <cpuselection/>
Nov 03 12:12:41 user nova-compute[74960]:       <deviceboot/>
Nov 03 12:12:41 user nova-compute[74960]:       <disksnapshot default='on' toggle='no'/>
Nov 03 12:12:41 user nova-compute[74960]:     </features>
Nov 03 12:12:41 user nova-compute[74960]:   </guest>
Nov 03 12:12:41 user nova-compute[74960]:   <guest>
Nov 03 12:12:41 user nova-compute[74960]:     <os_type>hvm</os_type>
Nov 03 12:12:41 user nova-compute[74960]:     <arch name='riscv32'>
Nov 03 12:12:41 user nova-compute[74960]:       <wordsize>32</wordsize>
Nov 03 12:12:41 user nova-compute[74960]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='8'>spike</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>opentitan</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='5'>sifive_u</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>sifive_e</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='8'>virt</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <domain type='qemu'/>
Nov 03 12:12:41 user nova-compute[74960]:     </arch>
Nov 03 12:12:41 user nova-compute[74960]:     <features>
Nov 03 12:12:41 user nova-compute[74960]:       <cpuselection/>
Nov 03 12:12:41 user nova-compute[74960]:       <deviceboot/>
Nov 03 12:12:41 user nova-compute[74960]:       <disksnapshot default='on' toggle='no'/>
Nov 03 12:12:41 user nova-compute[74960]:     </features>
Nov 03 12:12:41 user nova-compute[74960]:   </guest>
Nov 03 12:12:41 user nova-compute[74960]:   <guest>
Nov 03 12:12:41 user nova-compute[74960]:     <os_type>hvm</os_type>
Nov 03 12:12:41 user nova-compute[74960]:     <arch name='riscv64'>
Nov 03 12:12:41 user nova-compute[74960]:       <wordsize>64</wordsize>
Nov 03 12:12:41 user nova-compute[74960]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='8'>spike</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='5'>sifive_u</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>shakti_c</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>sifive_e</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='8'>virt</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <domain type='qemu'/>
Nov 03 12:12:41 user nova-compute[74960]:     </arch>
Nov 03 12:12:41 user nova-compute[74960]:     <features>
Nov 03 12:12:41 user nova-compute[74960]:       <cpuselection/>
Nov 03 12:12:41 user nova-compute[74960]:       <deviceboot/>
Nov 03 12:12:41 user nova-compute[74960]:       <disksnapshot default='on' toggle='no'/>
Nov 03 12:12:41 user nova-compute[74960]:     </features>
Nov 03 12:12:41 user nova-compute[74960]:   </guest>
Nov 03 12:12:41 user nova-compute[74960]:   <guest>
Nov 03 12:12:41 user nova-compute[74960]:     <os_type>hvm</os_type>
Nov 03 12:12:41 user nova-compute[74960]:     <arch name='s390x'>
Nov 03 12:12:41 user nova-compute[74960]:       <wordsize>64</wordsize>
Nov 03 12:12:41 user nova-compute[74960]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <domain type='qemu'/>
Nov 03 12:12:41 user nova-compute[74960]:     </arch>
Nov 03 12:12:41 user nova-compute[74960]:     <features>
Nov 03 12:12:41 user nova-compute[74960]:       <cpuselection/>
Nov 03 12:12:41 user nova-compute[74960]:       <deviceboot/>
Nov 03 12:12:41 user nova-compute[74960]:       <disksnapshot default='on' toggle='no'/>
Nov 03 12:12:41 user nova-compute[74960]:     </features>
Nov 03 12:12:41 user nova-compute[74960]:   </guest>
Nov 03 12:12:41 user nova-compute[74960]:   <guest>
Nov 03 12:12:41 user nova-compute[74960]:     <os_type>hvm</os_type>
Nov 03 12:12:41 user nova-compute[74960]:     <arch name='sh4'>
Nov 03 12:12:41 user nova-compute[74960]:       <wordsize>32</wordsize>
Nov 03 12:12:41 user nova-compute[74960]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>shix</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>r2d</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <domain type='qemu'/>
Nov 03 12:12:41 user nova-compute[74960]:     </arch>
Nov 03 12:12:41 user nova-compute[74960]:     <features>
Nov 03 12:12:41 user nova-compute[74960]:       <cpuselection/>
Nov 03 12:12:41 user nova-compute[74960]:       <deviceboot/>
Nov 03 12:12:41 user nova-compute[74960]:       <disksnapshot default='on' toggle='no'/>
Nov 03 12:12:41 user nova-compute[74960]:     </features>
Nov 03 12:12:41 user nova-compute[74960]:   </guest>
Nov 03 12:12:41 user nova-compute[74960]:   <guest>
Nov 03 12:12:41 user nova-compute[74960]:     <os_type>hvm</os_type>
Nov 03 12:12:41 user nova-compute[74960]:     <arch name='sh4eb'>
Nov 03 12:12:41 user nova-compute[74960]:       <wordsize>64</wordsize>
Nov 03 12:12:41 user nova-compute[74960]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>shix</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>r2d</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <domain type='qemu'/>
Nov 03 12:12:41 user nova-compute[74960]:     </arch>
Nov 03 12:12:41 user nova-compute[74960]:     <features>
Nov 03 12:12:41 user nova-compute[74960]:       <cpuselection/>
Nov 03 12:12:41 user nova-compute[74960]:       <deviceboot/>
Nov 03 12:12:41 user nova-compute[74960]:       <disksnapshot default='on' toggle='no'/>
Nov 03 12:12:41 user nova-compute[74960]:     </features>
Nov 03 12:12:41 user nova-compute[74960]:   </guest>
Nov 03 12:12:41 user nova-compute[74960]:   <guest>
Nov 03 12:12:41 user nova-compute[74960]:     <os_type>hvm</os_type>
Nov 03 12:12:41 user nova-compute[74960]:     <arch name='sparc'>
Nov 03 12:12:41 user nova-compute[74960]:       <wordsize>32</wordsize>
Nov 03 12:12:41 user nova-compute[74960]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>SS-5</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='4'>SS-20</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>LX</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>SPARCClassic</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>leon3_generic</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>SPARCbook</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>SS-4</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='4'>SS-600MP</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='4'>SS-10</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>Voyager</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <domain type='qemu'/>
Nov 03 12:12:41 user nova-compute[74960]:     </arch>
Nov 03 12:12:41 user nova-compute[74960]:     <features>
Nov 03 12:12:41 user nova-compute[74960]:       <cpuselection/>
Nov 03 12:12:41 user nova-compute[74960]:       <deviceboot/>
Nov 03 12:12:41 user nova-compute[74960]:       <disksnapshot default='on' toggle='no'/>
Nov 03 12:12:41 user nova-compute[74960]:     </features>
Nov 03 12:12:41 user nova-compute[74960]:   </guest>
Nov 03 12:12:41 user nova-compute[74960]:   <guest>
Nov 03 12:12:41 user nova-compute[74960]:     <os_type>hvm</os_type>
Nov 03 12:12:41 user nova-compute[74960]:     <arch name='sparc64'>
Nov 03 12:12:41 user nova-compute[74960]:       <wordsize>64</wordsize>
Nov 03 12:12:41 user nova-compute[74960]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>sun4u</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>niagara</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>sun4v</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <domain type='qemu'/>
Nov 03 12:12:41 user nova-compute[74960]:     </arch>
Nov 03 12:12:41 user nova-compute[74960]:     <features>
Nov 03 12:12:41 user nova-compute[74960]:       <cpuselection/>
Nov 03 12:12:41 user nova-compute[74960]:       <deviceboot/>
Nov 03 12:12:41 user nova-compute[74960]:       <disksnapshot default='on' toggle='no'/>
Nov 03 12:12:41 user nova-compute[74960]:     </features>
Nov 03 12:12:41 user nova-compute[74960]:   </guest>
Nov 03 12:12:41 user nova-compute[74960]:   <guest>
Nov 03 12:12:41 user nova-compute[74960]:     <os_type>hvm</os_type>
Nov 03 12:12:41 user nova-compute[74960]:     <arch name='x86_64'>
Nov 03 12:12:41 user nova-compute[74960]:       <wordsize>64</wordsize>
Nov 03 12:12:41 user nova-compute[74960]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>x-remote</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='1'>isapc</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='288'>microvm</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <domain type='qemu'/>
Nov 03 12:12:41 user nova-compute[74960]:       <domain type='kvm'/>
Nov 03 12:12:41 user nova-compute[74960]:     </arch>
Nov 03 12:12:41 user nova-compute[74960]:     <features>
Nov 03 12:12:41 user nova-compute[74960]:       <acpi default='on' toggle='yes'/>
Nov 03 12:12:41 user nova-compute[74960]:       <apic default='on' toggle='no'/>
Nov 03 12:12:41 user nova-compute[74960]:       <cpuselection/>
Nov 03 12:12:41 user nova-compute[74960]:       <deviceboot/>
Nov 03 12:12:41 user nova-compute[74960]:       <disksnapshot default='on' toggle='no'/>
Nov 03 12:12:41 user nova-compute[74960]:     </features>
Nov 03 12:12:41 user nova-compute[74960]:   </guest>
Nov 03 12:12:41 user nova-compute[74960]:   <guest>
Nov 03 12:12:41 user nova-compute[74960]:     <os_type>hvm</os_type>
Nov 03 12:12:41 user nova-compute[74960]:     <arch name='xtensa'>
Nov 03 12:12:41 user nova-compute[74960]:       <wordsize>32</wordsize>
Nov 03 12:12:41 user nova-compute[74960]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='4'>sim</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='32'>kc705</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='32'>ml605</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='32'>virt</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='32'>lx200</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='32'>lx60</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <domain type='qemu'/>
Nov 03 12:12:41 user nova-compute[74960]:     </arch>
Nov 03 12:12:41 user nova-compute[74960]:     <features>
Nov 03 12:12:41 user nova-compute[74960]:       <cpuselection/>
Nov 03 12:12:41 user nova-compute[74960]:       <deviceboot/>
Nov 03 12:12:41 user nova-compute[74960]:       <disksnapshot default='on' toggle='no'/>
Nov 03 12:12:41 user nova-compute[74960]:     </features>
Nov 03 12:12:41 user nova-compute[74960]:   </guest>
Nov 03 12:12:41 user nova-compute[74960]:   <guest>
Nov 03 12:12:41 user nova-compute[74960]:     <os_type>hvm</os_type>
Nov 03 12:12:41 user nova-compute[74960]:     <arch name='xtensaeb'>
Nov 03 12:12:41 user nova-compute[74960]:       <wordsize>32</wordsize>
Nov 03 12:12:41 user nova-compute[74960]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='4'>sim</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='32'>kc705</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='32'>ml605</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='32'>virt</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='32'>lx200</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='32'>lx60</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 03 12:12:41 user nova-compute[74960]:       <domain type='qemu'/>
Nov 03 12:12:41 user nova-compute[74960]:     </arch>
Nov 03 12:12:41 user nova-compute[74960]:     <features>
Nov 03 12:12:41 user nova-compute[74960]:       <cpuselection/>
Nov 03 12:12:41 user nova-compute[74960]:       <deviceboot/>
Nov 03 12:12:41 user nova-compute[74960]:       <disksnapshot default='on' toggle='no'/>
Nov 03 12:12:41 user nova-compute[74960]:     </features>
Nov 03 12:12:41 user nova-compute[74960]:   </guest>
Nov 03 12:12:41 user nova-compute[74960]: </capabilities>
Nov 03 12:12:41 user nova-compute[74960]: 
Nov 03 12:12:41 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-fb4353de-ffac-4cd0-ae62-b5aea0300ae4 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=74960) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 03 12:12:41 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-fb4353de-ffac-4cd0-ae62-b5aea0300ae4 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=74960) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 03 12:12:41 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-fb4353de-ffac-4cd0-ae62-b5aea0300ae4 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=74960) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 03 12:12:41 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-fb4353de-ffac-4cd0-ae62-b5aea0300ae4 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74960) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 03 12:12:41 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-fb4353de-ffac-4cd0-ae62-b5aea0300ae4 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74960) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 03 12:12:41 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-fb4353de-ffac-4cd0-ae62-b5aea0300ae4 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=74960) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 03 12:12:41 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-fb4353de-ffac-4cd0-ae62-b5aea0300ae4 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74960) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 03 12:12:41 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-fb4353de-ffac-4cd0-ae62-b5aea0300ae4 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=74960) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 03 12:12:41 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-fb4353de-ffac-4cd0-ae62-b5aea0300ae4 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=74960) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 03 12:12:41 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-fb4353de-ffac-4cd0-ae62-b5aea0300ae4 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=74960) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 03 12:12:41 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-fb4353de-ffac-4cd0-ae62-b5aea0300ae4 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=74960) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 03 12:12:41 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-fb4353de-ffac-4cd0-ae62-b5aea0300ae4 None None] Getting domain capabilities for i686 via machine types: {'ubuntu-q35', 'ubuntu', 'q35', 'pc'} {{(pid=74960) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 03 12:12:41 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-fb4353de-ffac-4cd0-ae62-b5aea0300ae4 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Nov 03 12:12:41 user nova-compute[74960]: <domainCapabilities>
Nov 03 12:12:41 user nova-compute[74960]:   <path>/usr/bin/qemu-system-i386</path>
Nov 03 12:12:41 user nova-compute[74960]:   <domain>kvm</domain>
Nov 03 12:12:41 user nova-compute[74960]:   <machine>pc-q35-jammy</machine>
Nov 03 12:12:41 user nova-compute[74960]:   <arch>i686</arch>
Nov 03 12:12:41 user nova-compute[74960]:   <vcpu max='288'/>
Nov 03 12:12:41 user nova-compute[74960]:   <iothreads supported='yes'/>
Nov 03 12:12:41 user nova-compute[74960]:   <os supported='yes'>
Nov 03 12:12:41 user nova-compute[74960]:     <enum name='firmware'/>
Nov 03 12:12:41 user nova-compute[74960]:     <loader supported='yes'>
Nov 03 12:12:41 user nova-compute[74960]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 03 12:12:41 user nova-compute[74960]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 03 12:12:41 user nova-compute[74960]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 03 12:12:41 user nova-compute[74960]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 03 12:12:41 user nova-compute[74960]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='type'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>rom</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>pflash</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='readonly'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>yes</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>no</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='secure'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>no</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:     </loader>
Nov 03 12:12:41 user nova-compute[74960]:   </os>
Nov 03 12:12:41 user nova-compute[74960]:   <cpu>
Nov 03 12:12:41 user nova-compute[74960]:     <mode name='host-passthrough' supported='yes'>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='hostPassthroughMigratable'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>off</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:     </mode>
Nov 03 12:12:41 user nova-compute[74960]:     <mode name='maximum' supported='yes'>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='maximumMigratable'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>on</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>off</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:     </mode>
Nov 03 12:12:41 user nova-compute[74960]:     <mode name='host-model' supported='yes'>
Nov 03 12:12:41 user nova-compute[74960]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 03 12:12:41 user nova-compute[74960]:       <vendor>Intel</vendor>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='ss'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='vmx'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='pcid'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='hypervisor'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='arat'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='tsc_adjust'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='umip'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='md-clear'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='stibp'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='arch-capabilities'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='ssbd'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='ibpb'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='ibrs'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='amd-stibp'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='amd-ssbd'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='disable' name='erms'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='disable' name='xsaveopt'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='disable' name='lm'/>
Nov 03 12:12:41 user nova-compute[74960]:     </mode>
Nov 03 12:12:41 user nova-compute[74960]:     <mode name='custom' supported='yes'>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>qemu64</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='yes'>qemu32</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>phenom</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='yes'>pentium3</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='yes'>pentium2</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='yes'>pentium</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>n270</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>kvm64</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='yes'>kvm32</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='yes'>coreduo</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>core2duo</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>athlon</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Westmere-IBRS</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Westmere</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Snowridge</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Skylake-Server</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Skylake-Client</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>SandyBridge</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Penryn</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Opteron_G5</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Opteron_G4</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Opteron_G3</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Opteron_G2</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Opteron_G1</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Nehalem-IBRS</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Nehalem</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>IvyBridge</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Icelake-Server</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Haswell-noTSX</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Haswell-IBRS</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Haswell</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>EPYC-Rome</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>EPYC-Milan</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>EPYC-IBPB</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>EPYC</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Dhyana</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Cooperlake</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Conroe</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Cascadelake-Server</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Broadwell-noTSX</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Broadwell-IBRS</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Broadwell</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='yes'>486</model>
Nov 03 12:12:41 user nova-compute[74960]:     </mode>
Nov 03 12:12:41 user nova-compute[74960]:   </cpu>
Nov 03 12:12:41 user nova-compute[74960]:   <memoryBacking supported='yes'>
Nov 03 12:12:41 user nova-compute[74960]:     <enum name='sourceType'>
Nov 03 12:12:41 user nova-compute[74960]:       <value>file</value>
Nov 03 12:12:41 user nova-compute[74960]:       <value>anonymous</value>
Nov 03 12:12:41 user nova-compute[74960]:       <value>memfd</value>
Nov 03 12:12:41 user nova-compute[74960]:     </enum>
Nov 03 12:12:41 user nova-compute[74960]:   </memoryBacking>
Nov 03 12:12:41 user nova-compute[74960]:   <devices>
Nov 03 12:12:41 user nova-compute[74960]:     <disk supported='yes'>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='diskDevice'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>disk</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>cdrom</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>floppy</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>lun</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='bus'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>fdc</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>scsi</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>virtio</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>usb</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>sata</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='model'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>virtio</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>virtio-transitional</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>virtio-non-transitional</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:     </disk>
Nov 03 12:12:41 user nova-compute[74960]:     <graphics supported='yes'>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='type'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>sdl</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>vnc</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>spice</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>egl-headless</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:     </graphics>
Nov 03 12:12:41 user nova-compute[74960]:     <video supported='yes'>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='modelType'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>vga</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>cirrus</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>vmvga</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>qxl</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>virtio</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>none</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>bochs</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>ramfb</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:     </video>
Nov 03 12:12:41 user nova-compute[74960]:     <hostdev supported='yes'>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='mode'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>subsystem</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='startupPolicy'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>default</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>mandatory</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>requisite</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>optional</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='subsysType'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>usb</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>pci</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>scsi</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='capsType'/>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='pciBackend'/>
Nov 03 12:12:41 user nova-compute[74960]:     </hostdev>
Nov 03 12:12:41 user nova-compute[74960]:     <rng supported='yes'>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='model'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>virtio</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>virtio-transitional</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>virtio-non-transitional</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='backendModel'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>random</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>egd</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>builtin</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:     </rng>
Nov 03 12:12:41 user nova-compute[74960]:     <filesystem supported='yes'>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='driverType'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>path</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>handle</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>virtiofs</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:     </filesystem>
Nov 03 12:12:41 user nova-compute[74960]:     <tpm supported='yes'>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='model'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>tpm-tis</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>tpm-crb</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='backendModel'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>passthrough</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>emulator</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:     </tpm>
Nov 03 12:12:41 user nova-compute[74960]:   </devices>
Nov 03 12:12:41 user nova-compute[74960]:   <features>
Nov 03 12:12:41 user nova-compute[74960]:     <gic supported='no'/>
Nov 03 12:12:41 user nova-compute[74960]:     <vmcoreinfo supported='yes'/>
Nov 03 12:12:41 user nova-compute[74960]:     <genid supported='yes'/>
Nov 03 12:12:41 user nova-compute[74960]:     <backingStoreInput supported='yes'/>
Nov 03 12:12:41 user nova-compute[74960]:     <backup supported='yes'/>
Nov 03 12:12:41 user nova-compute[74960]:     <sev supported='no'/>
Nov 03 12:12:41 user nova-compute[74960]:   </features>
Nov 03 12:12:41 user nova-compute[74960]: </domainCapabilities>
Nov 03 12:12:41 user nova-compute[74960]:  {{(pid=74960) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 03 12:12:41 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-fb4353de-ffac-4cd0-ae62-b5aea0300ae4 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Nov 03 12:12:41 user nova-compute[74960]: <domainCapabilities>
Nov 03 12:12:41 user nova-compute[74960]:   <path>/usr/bin/qemu-system-i386</path>
Nov 03 12:12:41 user nova-compute[74960]:   <domain>kvm</domain>
Nov 03 12:12:41 user nova-compute[74960]:   <machine>pc-i440fx-jammy</machine>
Nov 03 12:12:41 user nova-compute[74960]:   <arch>i686</arch>
Nov 03 12:12:41 user nova-compute[74960]:   <vcpu max='255'/>
Nov 03 12:12:41 user nova-compute[74960]:   <iothreads supported='yes'/>
Nov 03 12:12:41 user nova-compute[74960]:   <os supported='yes'>
Nov 03 12:12:41 user nova-compute[74960]:     <enum name='firmware'/>
Nov 03 12:12:41 user nova-compute[74960]:     <loader supported='yes'>
Nov 03 12:12:41 user nova-compute[74960]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 03 12:12:41 user nova-compute[74960]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 03 12:12:41 user nova-compute[74960]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 03 12:12:41 user nova-compute[74960]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 03 12:12:41 user nova-compute[74960]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='type'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>rom</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>pflash</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='readonly'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>yes</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>no</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='secure'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>no</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:     </loader>
Nov 03 12:12:41 user nova-compute[74960]:   </os>
Nov 03 12:12:41 user nova-compute[74960]:   <cpu>
Nov 03 12:12:41 user nova-compute[74960]:     <mode name='host-passthrough' supported='yes'>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='hostPassthroughMigratable'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>off</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:     </mode>
Nov 03 12:12:41 user nova-compute[74960]:     <mode name='maximum' supported='yes'>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='maximumMigratable'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>on</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>off</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:     </mode>
Nov 03 12:12:41 user nova-compute[74960]:     <mode name='host-model' supported='yes'>
Nov 03 12:12:41 user nova-compute[74960]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 03 12:12:41 user nova-compute[74960]:       <vendor>Intel</vendor>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='ss'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='vmx'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='pcid'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='hypervisor'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='arat'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='tsc_adjust'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='umip'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='md-clear'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='stibp'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='arch-capabilities'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='ssbd'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='ibpb'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='ibrs'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='amd-stibp'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='amd-ssbd'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='disable' name='erms'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='disable' name='xsaveopt'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='disable' name='lm'/>
Nov 03 12:12:41 user nova-compute[74960]:     </mode>
Nov 03 12:12:41 user nova-compute[74960]:     <mode name='custom' supported='yes'>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>qemu64</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='yes'>qemu32</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>phenom</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='yes'>pentium3</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='yes'>pentium2</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='yes'>pentium</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>n270</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>kvm64</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='yes'>kvm32</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='yes'>coreduo</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>core2duo</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>athlon</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Westmere-IBRS</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Westmere</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Snowridge</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Skylake-Server</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Skylake-Client</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>SandyBridge</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Penryn</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Opteron_G5</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Opteron_G4</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Opteron_G3</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Opteron_G2</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Opteron_G1</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Nehalem-IBRS</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Nehalem</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>IvyBridge</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Icelake-Server</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Haswell-noTSX</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Haswell-IBRS</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Haswell</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>EPYC-Rome</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>EPYC-Milan</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>EPYC-IBPB</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>EPYC</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Dhyana</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Cooperlake</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Conroe</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Cascadelake-Server</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Broadwell-noTSX</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Broadwell-IBRS</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Broadwell</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='yes'>486</model>
Nov 03 12:12:41 user nova-compute[74960]:     </mode>
Nov 03 12:12:41 user nova-compute[74960]:   </cpu>
Nov 03 12:12:41 user nova-compute[74960]:   <memoryBacking supported='yes'>
Nov 03 12:12:41 user nova-compute[74960]:     <enum name='sourceType'>
Nov 03 12:12:41 user nova-compute[74960]:       <value>file</value>
Nov 03 12:12:41 user nova-compute[74960]:       <value>anonymous</value>
Nov 03 12:12:41 user nova-compute[74960]:       <value>memfd</value>
Nov 03 12:12:41 user nova-compute[74960]:     </enum>
Nov 03 12:12:41 user nova-compute[74960]:   </memoryBacking>
Nov 03 12:12:41 user nova-compute[74960]:   <devices>
Nov 03 12:12:41 user nova-compute[74960]:     <disk supported='yes'>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='diskDevice'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>disk</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>cdrom</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>floppy</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>lun</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='bus'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>ide</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>fdc</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>scsi</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>virtio</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>usb</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>sata</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='model'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>virtio</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>virtio-transitional</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>virtio-non-transitional</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:     </disk>
Nov 03 12:12:41 user nova-compute[74960]:     <graphics supported='yes'>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='type'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>sdl</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>vnc</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>spice</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>egl-headless</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:     </graphics>
Nov 03 12:12:41 user nova-compute[74960]:     <video supported='yes'>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='modelType'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>vga</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>cirrus</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>vmvga</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>qxl</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>virtio</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>none</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>bochs</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>ramfb</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:     </video>
Nov 03 12:12:41 user nova-compute[74960]:     <hostdev supported='yes'>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='mode'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>subsystem</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='startupPolicy'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>default</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>mandatory</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>requisite</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>optional</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='subsysType'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>usb</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>pci</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>scsi</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='capsType'/>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='pciBackend'/>
Nov 03 12:12:41 user nova-compute[74960]:     </hostdev>
Nov 03 12:12:41 user nova-compute[74960]:     <rng supported='yes'>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='model'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>virtio</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>virtio-transitional</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>virtio-non-transitional</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='backendModel'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>random</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>egd</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>builtin</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:     </rng>
Nov 03 12:12:41 user nova-compute[74960]:     <filesystem supported='yes'>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='driverType'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>path</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>handle</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>virtiofs</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:     </filesystem>
Nov 03 12:12:41 user nova-compute[74960]:     <tpm supported='yes'>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='model'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>tpm-tis</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>tpm-crb</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='backendModel'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>passthrough</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>emulator</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:     </tpm>
Nov 03 12:12:41 user nova-compute[74960]:   </devices>
Nov 03 12:12:41 user nova-compute[74960]:   <features>
Nov 03 12:12:41 user nova-compute[74960]:     <gic supported='no'/>
Nov 03 12:12:41 user nova-compute[74960]:     <vmcoreinfo supported='yes'/>
Nov 03 12:12:41 user nova-compute[74960]:     <genid supported='yes'/>
Nov 03 12:12:41 user nova-compute[74960]:     <backingStoreInput supported='yes'/>
Nov 03 12:12:41 user nova-compute[74960]:     <backup supported='yes'/>
Nov 03 12:12:41 user nova-compute[74960]:     <sev supported='no'/>
Nov 03 12:12:41 user nova-compute[74960]:   </features>
Nov 03 12:12:41 user nova-compute[74960]: </domainCapabilities>
Nov 03 12:12:41 user nova-compute[74960]:  {{(pid=74960) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 03 12:12:41 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-fb4353de-ffac-4cd0-ae62-b5aea0300ae4 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Nov 03 12:12:41 user nova-compute[74960]: <domainCapabilities>
Nov 03 12:12:41 user nova-compute[74960]:   <path>/usr/bin/qemu-system-i386</path>
Nov 03 12:12:41 user nova-compute[74960]:   <domain>kvm</domain>
Nov 03 12:12:41 user nova-compute[74960]:   <machine>pc-q35-6.2</machine>
Nov 03 12:12:41 user nova-compute[74960]:   <arch>i686</arch>
Nov 03 12:12:41 user nova-compute[74960]:   <vcpu max='288'/>
Nov 03 12:12:41 user nova-compute[74960]:   <iothreads supported='yes'/>
Nov 03 12:12:41 user nova-compute[74960]:   <os supported='yes'>
Nov 03 12:12:41 user nova-compute[74960]:     <enum name='firmware'/>
Nov 03 12:12:41 user nova-compute[74960]:     <loader supported='yes'>
Nov 03 12:12:41 user nova-compute[74960]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 03 12:12:41 user nova-compute[74960]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 03 12:12:41 user nova-compute[74960]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 03 12:12:41 user nova-compute[74960]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 03 12:12:41 user nova-compute[74960]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='type'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>rom</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>pflash</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='readonly'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>yes</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>no</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='secure'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>no</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:     </loader>
Nov 03 12:12:41 user nova-compute[74960]:   </os>
Nov 03 12:12:41 user nova-compute[74960]:   <cpu>
Nov 03 12:12:41 user nova-compute[74960]:     <mode name='host-passthrough' supported='yes'>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='hostPassthroughMigratable'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>off</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:     </mode>
Nov 03 12:12:41 user nova-compute[74960]:     <mode name='maximum' supported='yes'>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='maximumMigratable'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>on</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>off</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:     </mode>
Nov 03 12:12:41 user nova-compute[74960]:     <mode name='host-model' supported='yes'>
Nov 03 12:12:41 user nova-compute[74960]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 03 12:12:41 user nova-compute[74960]:       <vendor>Intel</vendor>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='ss'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='vmx'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='pcid'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='hypervisor'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='arat'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='tsc_adjust'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='umip'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='md-clear'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='stibp'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='arch-capabilities'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='ssbd'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='ibpb'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='ibrs'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='amd-stibp'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='amd-ssbd'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='disable' name='erms'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='disable' name='xsaveopt'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='disable' name='lm'/>
Nov 03 12:12:41 user nova-compute[74960]:     </mode>
Nov 03 12:12:41 user nova-compute[74960]:     <mode name='custom' supported='yes'>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>qemu64</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='yes'>qemu32</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>phenom</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='yes'>pentium3</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='yes'>pentium2</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='yes'>pentium</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>n270</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>kvm64</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='yes'>kvm32</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='yes'>coreduo</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>core2duo</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>athlon</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Westmere-IBRS</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Westmere</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Snowridge</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Skylake-Server</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Skylake-Client</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>SandyBridge</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Penryn</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Opteron_G5</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Opteron_G4</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Opteron_G3</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Opteron_G2</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Opteron_G1</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Nehalem-IBRS</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Nehalem</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>IvyBridge</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Icelake-Server</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Haswell-noTSX</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Haswell-IBRS</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Haswell</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>EPYC-Rome</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>EPYC-Milan</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>EPYC-IBPB</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>EPYC</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Dhyana</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Cooperlake</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Conroe</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Cascadelake-Server</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Broadwell-noTSX</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Broadwell-IBRS</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Broadwell</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='yes'>486</model>
Nov 03 12:12:41 user nova-compute[74960]:     </mode>
Nov 03 12:12:41 user nova-compute[74960]:   </cpu>
Nov 03 12:12:41 user nova-compute[74960]:   <memoryBacking supported='yes'>
Nov 03 12:12:41 user nova-compute[74960]:     <enum name='sourceType'>
Nov 03 12:12:41 user nova-compute[74960]:       <value>file</value>
Nov 03 12:12:41 user nova-compute[74960]:       <value>anonymous</value>
Nov 03 12:12:41 user nova-compute[74960]:       <value>memfd</value>
Nov 03 12:12:41 user nova-compute[74960]:     </enum>
Nov 03 12:12:41 user nova-compute[74960]:   </memoryBacking>
Nov 03 12:12:41 user nova-compute[74960]:   <devices>
Nov 03 12:12:41 user nova-compute[74960]:     <disk supported='yes'>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='diskDevice'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>disk</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>cdrom</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>floppy</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>lun</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='bus'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>fdc</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>scsi</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>virtio</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>usb</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>sata</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='model'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>virtio</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>virtio-transitional</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>virtio-non-transitional</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:     </disk>
Nov 03 12:12:41 user nova-compute[74960]:     <graphics supported='yes'>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='type'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>sdl</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>vnc</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>spice</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>egl-headless</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:     </graphics>
Nov 03 12:12:41 user nova-compute[74960]:     <video supported='yes'>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='modelType'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>vga</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>cirrus</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>vmvga</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>qxl</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>virtio</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>none</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>bochs</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>ramfb</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:     </video>
Nov 03 12:12:41 user nova-compute[74960]:     <hostdev supported='yes'>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='mode'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>subsystem</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='startupPolicy'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>default</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>mandatory</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>requisite</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>optional</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='subsysType'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>usb</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>pci</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>scsi</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='capsType'/>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='pciBackend'/>
Nov 03 12:12:41 user nova-compute[74960]:     </hostdev>
Nov 03 12:12:41 user nova-compute[74960]:     <rng supported='yes'>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='model'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>virtio</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>virtio-transitional</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>virtio-non-transitional</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='backendModel'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>random</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>egd</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>builtin</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:     </rng>
Nov 03 12:12:41 user nova-compute[74960]:     <filesystem supported='yes'>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='driverType'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>path</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>handle</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>virtiofs</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:     </filesystem>
Nov 03 12:12:41 user nova-compute[74960]:     <tpm supported='yes'>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='model'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>tpm-tis</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>tpm-crb</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='backendModel'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>passthrough</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>emulator</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:     </tpm>
Nov 03 12:12:41 user nova-compute[74960]:   </devices>
Nov 03 12:12:41 user nova-compute[74960]:   <features>
Nov 03 12:12:41 user nova-compute[74960]:     <gic supported='no'/>
Nov 03 12:12:41 user nova-compute[74960]:     <vmcoreinfo supported='yes'/>
Nov 03 12:12:41 user nova-compute[74960]:     <genid supported='yes'/>
Nov 03 12:12:41 user nova-compute[74960]:     <backingStoreInput supported='yes'/>
Nov 03 12:12:41 user nova-compute[74960]:     <backup supported='yes'/>
Nov 03 12:12:41 user nova-compute[74960]:     <sev supported='no'/>
Nov 03 12:12:41 user nova-compute[74960]:   </features>
Nov 03 12:12:41 user nova-compute[74960]: </domainCapabilities>
Nov 03 12:12:41 user nova-compute[74960]:  {{(pid=74960) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 03 12:12:41 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-fb4353de-ffac-4cd0-ae62-b5aea0300ae4 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Nov 03 12:12:41 user nova-compute[74960]: <domainCapabilities>
Nov 03 12:12:41 user nova-compute[74960]:   <path>/usr/bin/qemu-system-i386</path>
Nov 03 12:12:41 user nova-compute[74960]:   <domain>kvm</domain>
Nov 03 12:12:41 user nova-compute[74960]:   <machine>pc-i440fx-6.2</machine>
Nov 03 12:12:41 user nova-compute[74960]:   <arch>i686</arch>
Nov 03 12:12:41 user nova-compute[74960]:   <vcpu max='255'/>
Nov 03 12:12:41 user nova-compute[74960]:   <iothreads supported='yes'/>
Nov 03 12:12:41 user nova-compute[74960]:   <os supported='yes'>
Nov 03 12:12:41 user nova-compute[74960]:     <enum name='firmware'/>
Nov 03 12:12:41 user nova-compute[74960]:     <loader supported='yes'>
Nov 03 12:12:41 user nova-compute[74960]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 03 12:12:41 user nova-compute[74960]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 03 12:12:41 user nova-compute[74960]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 03 12:12:41 user nova-compute[74960]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 03 12:12:41 user nova-compute[74960]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='type'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>rom</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>pflash</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='readonly'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>yes</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>no</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='secure'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>no</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:     </loader>
Nov 03 12:12:41 user nova-compute[74960]:   </os>
Nov 03 12:12:41 user nova-compute[74960]:   <cpu>
Nov 03 12:12:41 user nova-compute[74960]:     <mode name='host-passthrough' supported='yes'>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='hostPassthroughMigratable'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>off</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:     </mode>
Nov 03 12:12:41 user nova-compute[74960]:     <mode name='maximum' supported='yes'>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='maximumMigratable'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>on</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>off</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:     </mode>
Nov 03 12:12:41 user nova-compute[74960]:     <mode name='host-model' supported='yes'>
Nov 03 12:12:41 user nova-compute[74960]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 03 12:12:41 user nova-compute[74960]:       <vendor>Intel</vendor>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='ss'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='vmx'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='pcid'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='hypervisor'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='arat'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='tsc_adjust'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='umip'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='md-clear'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='stibp'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='arch-capabilities'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='ssbd'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='ibpb'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='ibrs'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='amd-stibp'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='amd-ssbd'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='disable' name='erms'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='disable' name='xsaveopt'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='disable' name='lm'/>
Nov 03 12:12:41 user nova-compute[74960]:     </mode>
Nov 03 12:12:41 user nova-compute[74960]:     <mode name='custom' supported='yes'>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>qemu64</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='yes'>qemu32</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>phenom</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='yes'>pentium3</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='yes'>pentium2</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='yes'>pentium</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>n270</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>kvm64</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='yes'>kvm32</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='yes'>coreduo</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>core2duo</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>athlon</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Westmere-IBRS</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Westmere</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Snowridge</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Skylake-Server</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Skylake-Client</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>SandyBridge</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Penryn</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Opteron_G5</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Opteron_G4</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Opteron_G3</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Opteron_G2</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Opteron_G1</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Nehalem-IBRS</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Nehalem</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>IvyBridge</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Icelake-Server</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Haswell-noTSX</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Haswell-IBRS</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Haswell</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>EPYC-Rome</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>EPYC-Milan</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>EPYC-IBPB</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>EPYC</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Dhyana</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Cooperlake</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Conroe</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Cascadelake-Server</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Broadwell-noTSX</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Broadwell-IBRS</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Broadwell</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='yes'>486</model>
Nov 03 12:12:41 user nova-compute[74960]:     </mode>
Nov 03 12:12:41 user nova-compute[74960]:   </cpu>
Nov 03 12:12:41 user nova-compute[74960]:   <memoryBacking supported='yes'>
Nov 03 12:12:41 user nova-compute[74960]:     <enum name='sourceType'>
Nov 03 12:12:41 user nova-compute[74960]:       <value>file</value>
Nov 03 12:12:41 user nova-compute[74960]:       <value>anonymous</value>
Nov 03 12:12:41 user nova-compute[74960]:       <value>memfd</value>
Nov 03 12:12:41 user nova-compute[74960]:     </enum>
Nov 03 12:12:41 user nova-compute[74960]:   </memoryBacking>
Nov 03 12:12:41 user nova-compute[74960]:   <devices>
Nov 03 12:12:41 user nova-compute[74960]:     <disk supported='yes'>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='diskDevice'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>disk</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>cdrom</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>floppy</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>lun</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='bus'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>ide</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>fdc</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>scsi</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>virtio</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>usb</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>sata</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='model'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>virtio</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>virtio-transitional</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>virtio-non-transitional</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:     </disk>
Nov 03 12:12:41 user nova-compute[74960]:     <graphics supported='yes'>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='type'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>sdl</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>vnc</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>spice</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>egl-headless</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:     </graphics>
Nov 03 12:12:41 user nova-compute[74960]:     <video supported='yes'>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='modelType'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>vga</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>cirrus</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>vmvga</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>qxl</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>virtio</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>none</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>bochs</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>ramfb</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:     </video>
Nov 03 12:12:41 user nova-compute[74960]:     <hostdev supported='yes'>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='mode'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>subsystem</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='startupPolicy'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>default</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>mandatory</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>requisite</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>optional</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='subsysType'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>usb</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>pci</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>scsi</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='capsType'/>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='pciBackend'/>
Nov 03 12:12:41 user nova-compute[74960]:     </hostdev>
Nov 03 12:12:41 user nova-compute[74960]:     <rng supported='yes'>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='model'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>virtio</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>virtio-transitional</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>virtio-non-transitional</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='backendModel'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>random</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>egd</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>builtin</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:     </rng>
Nov 03 12:12:41 user nova-compute[74960]:     <filesystem supported='yes'>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='driverType'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>path</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>handle</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>virtiofs</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:     </filesystem>
Nov 03 12:12:41 user nova-compute[74960]:     <tpm supported='yes'>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='model'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>tpm-tis</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>tpm-crb</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='backendModel'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>passthrough</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>emulator</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:     </tpm>
Nov 03 12:12:41 user nova-compute[74960]:   </devices>
Nov 03 12:12:41 user nova-compute[74960]:   <features>
Nov 03 12:12:41 user nova-compute[74960]:     <gic supported='no'/>
Nov 03 12:12:41 user nova-compute[74960]:     <vmcoreinfo supported='yes'/>
Nov 03 12:12:41 user nova-compute[74960]:     <genid supported='yes'/>
Nov 03 12:12:41 user nova-compute[74960]:     <backingStoreInput supported='yes'/>
Nov 03 12:12:41 user nova-compute[74960]:     <backup supported='yes'/>
Nov 03 12:12:41 user nova-compute[74960]:     <sev supported='no'/>
Nov 03 12:12:41 user nova-compute[74960]:   </features>
Nov 03 12:12:41 user nova-compute[74960]: </domainCapabilities>
Nov 03 12:12:41 user nova-compute[74960]:  {{(pid=74960) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 03 12:12:41 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-fb4353de-ffac-4cd0-ae62-b5aea0300ae4 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=74960) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 03 12:12:41 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-fb4353de-ffac-4cd0-ae62-b5aea0300ae4 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74960) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 03 12:12:41 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-fb4353de-ffac-4cd0-ae62-b5aea0300ae4 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74960) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 03 12:12:41 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-fb4353de-ffac-4cd0-ae62-b5aea0300ae4 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=74960) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 03 12:12:41 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-fb4353de-ffac-4cd0-ae62-b5aea0300ae4 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=74960) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 03 12:12:41 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-fb4353de-ffac-4cd0-ae62-b5aea0300ae4 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=74960) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 03 12:12:41 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-fb4353de-ffac-4cd0-ae62-b5aea0300ae4 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=74960) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 03 12:12:41 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-fb4353de-ffac-4cd0-ae62-b5aea0300ae4 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=74960) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 03 12:12:41 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-fb4353de-ffac-4cd0-ae62-b5aea0300ae4 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=74960) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 03 12:12:41 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-fb4353de-ffac-4cd0-ae62-b5aea0300ae4 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=74960) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 03 12:12:41 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-fb4353de-ffac-4cd0-ae62-b5aea0300ae4 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=74960) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 03 12:12:41 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-fb4353de-ffac-4cd0-ae62-b5aea0300ae4 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=74960) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 03 12:12:41 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-fb4353de-ffac-4cd0-ae62-b5aea0300ae4 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=74960) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 03 12:12:41 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-fb4353de-ffac-4cd0-ae62-b5aea0300ae4 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=74960) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 03 12:12:41 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-fb4353de-ffac-4cd0-ae62-b5aea0300ae4 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=74960) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 03 12:12:41 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-fb4353de-ffac-4cd0-ae62-b5aea0300ae4 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=74960) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 03 12:12:41 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-fb4353de-ffac-4cd0-ae62-b5aea0300ae4 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=74960) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 03 12:12:41 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-fb4353de-ffac-4cd0-ae62-b5aea0300ae4 None None] Getting domain capabilities for ppc64 via machine types: {'powernv', 'pseries', None} {{(pid=74960) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 03 12:12:41 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-fb4353de-ffac-4cd0-ae62-b5aea0300ae4 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74960) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 03 12:12:41 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-fb4353de-ffac-4cd0-ae62-b5aea0300ae4 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74960) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 03 12:12:41 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-fb4353de-ffac-4cd0-ae62-b5aea0300ae4 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74960) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 03 12:12:41 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-fb4353de-ffac-4cd0-ae62-b5aea0300ae4 None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=74960) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 03 12:12:41 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-fb4353de-ffac-4cd0-ae62-b5aea0300ae4 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74960) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 03 12:12:41 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-fb4353de-ffac-4cd0-ae62-b5aea0300ae4 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74960) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 03 12:12:41 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-fb4353de-ffac-4cd0-ae62-b5aea0300ae4 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=74960) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 03 12:12:41 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-fb4353de-ffac-4cd0-ae62-b5aea0300ae4 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=74960) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 03 12:12:41 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-fb4353de-ffac-4cd0-ae62-b5aea0300ae4 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=74960) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 03 12:12:41 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-fb4353de-ffac-4cd0-ae62-b5aea0300ae4 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=74960) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 03 12:12:41 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-fb4353de-ffac-4cd0-ae62-b5aea0300ae4 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=74960) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 03 12:12:41 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-fb4353de-ffac-4cd0-ae62-b5aea0300ae4 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=74960) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 03 12:12:41 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-fb4353de-ffac-4cd0-ae62-b5aea0300ae4 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=74960) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 03 12:12:41 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-fb4353de-ffac-4cd0-ae62-b5aea0300ae4 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=74960) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 03 12:12:41 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-fb4353de-ffac-4cd0-ae62-b5aea0300ae4 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=74960) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 03 12:12:41 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-fb4353de-ffac-4cd0-ae62-b5aea0300ae4 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=74960) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 03 12:12:41 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-fb4353de-ffac-4cd0-ae62-b5aea0300ae4 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=74960) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 03 12:12:41 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-fb4353de-ffac-4cd0-ae62-b5aea0300ae4 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=74960) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 03 12:12:41 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-fb4353de-ffac-4cd0-ae62-b5aea0300ae4 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=74960) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 03 12:12:41 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-fb4353de-ffac-4cd0-ae62-b5aea0300ae4 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=74960) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 03 12:12:41 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-fb4353de-ffac-4cd0-ae62-b5aea0300ae4 None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu-q35', 'ubuntu', 'q35', 'pc'} {{(pid=74960) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 03 12:12:41 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-fb4353de-ffac-4cd0-ae62-b5aea0300ae4 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Nov 03 12:12:41 user nova-compute[74960]: <domainCapabilities>
Nov 03 12:12:41 user nova-compute[74960]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 03 12:12:41 user nova-compute[74960]:   <domain>kvm</domain>
Nov 03 12:12:41 user nova-compute[74960]:   <machine>pc-q35-jammy</machine>
Nov 03 12:12:41 user nova-compute[74960]:   <arch>x86_64</arch>
Nov 03 12:12:41 user nova-compute[74960]:   <vcpu max='288'/>
Nov 03 12:12:41 user nova-compute[74960]:   <iothreads supported='yes'/>
Nov 03 12:12:41 user nova-compute[74960]:   <os supported='yes'>
Nov 03 12:12:41 user nova-compute[74960]:     <enum name='firmware'>
Nov 03 12:12:41 user nova-compute[74960]:       <value>efi</value>
Nov 03 12:12:41 user nova-compute[74960]:     </enum>
Nov 03 12:12:41 user nova-compute[74960]:     <loader supported='yes'>
Nov 03 12:12:41 user nova-compute[74960]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 03 12:12:41 user nova-compute[74960]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 03 12:12:41 user nova-compute[74960]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='type'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>rom</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>pflash</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='readonly'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>yes</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>no</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='secure'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>yes</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>no</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:     </loader>
Nov 03 12:12:41 user nova-compute[74960]:   </os>
Nov 03 12:12:41 user nova-compute[74960]:   <cpu>
Nov 03 12:12:41 user nova-compute[74960]:     <mode name='host-passthrough' supported='yes'>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='hostPassthroughMigratable'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>on</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>off</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:     </mode>
Nov 03 12:12:41 user nova-compute[74960]:     <mode name='maximum' supported='yes'>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='maximumMigratable'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>on</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>off</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:     </mode>
Nov 03 12:12:41 user nova-compute[74960]:     <mode name='host-model' supported='yes'>
Nov 03 12:12:41 user nova-compute[74960]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 03 12:12:41 user nova-compute[74960]:       <vendor>Intel</vendor>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='ss'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='vmx'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='pcid'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='hypervisor'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='arat'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='tsc_adjust'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='umip'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='md-clear'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='stibp'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='arch-capabilities'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='ssbd'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='invtsc'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='ibpb'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='ibrs'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='amd-stibp'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='amd-ssbd'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='rsba'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='pschange-mc-no'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='disable' name='erms'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='disable' name='xsaveopt'/>
Nov 03 12:12:41 user nova-compute[74960]:     </mode>
Nov 03 12:12:41 user nova-compute[74960]:     <mode name='custom' supported='yes'>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>qemu64</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='yes'>qemu32</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>phenom</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='yes'>pentium3</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='yes'>pentium2</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='yes'>pentium</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>n270</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='yes'>kvm64</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='yes'>kvm32</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='yes'>coreduo</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='yes'>core2duo</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>athlon</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='yes'>Westmere-IBRS</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='yes'>Westmere</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Snowridge</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Skylake-Server</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Skylake-Client</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>SandyBridge</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='yes'>Penryn</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Opteron_G5</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Opteron_G4</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Opteron_G3</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Opteron_G2</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='yes'>Opteron_G1</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='yes'>Nehalem</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>IvyBridge</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Icelake-Server</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Haswell-noTSX</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Haswell-IBRS</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Haswell</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>EPYC-Rome</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>EPYC-Milan</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>EPYC-IBPB</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>EPYC</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Dhyana</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Cooperlake</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='yes'>Conroe</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Cascadelake-Server</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Broadwell-noTSX</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Broadwell-IBRS</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Broadwell</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='yes'>486</model>
Nov 03 12:12:41 user nova-compute[74960]:     </mode>
Nov 03 12:12:41 user nova-compute[74960]:   </cpu>
Nov 03 12:12:41 user nova-compute[74960]:   <memoryBacking supported='yes'>
Nov 03 12:12:41 user nova-compute[74960]:     <enum name='sourceType'>
Nov 03 12:12:41 user nova-compute[74960]:       <value>file</value>
Nov 03 12:12:41 user nova-compute[74960]:       <value>anonymous</value>
Nov 03 12:12:41 user nova-compute[74960]:       <value>memfd</value>
Nov 03 12:12:41 user nova-compute[74960]:     </enum>
Nov 03 12:12:41 user nova-compute[74960]:   </memoryBacking>
Nov 03 12:12:41 user nova-compute[74960]:   <devices>
Nov 03 12:12:41 user nova-compute[74960]:     <disk supported='yes'>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='diskDevice'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>disk</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>cdrom</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>floppy</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>lun</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='bus'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>fdc</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>scsi</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>virtio</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>usb</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>sata</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='model'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>virtio</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>virtio-transitional</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>virtio-non-transitional</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:     </disk>
Nov 03 12:12:41 user nova-compute[74960]:     <graphics supported='yes'>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='type'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>sdl</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>vnc</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>spice</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>egl-headless</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:     </graphics>
Nov 03 12:12:41 user nova-compute[74960]:     <video supported='yes'>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='modelType'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>vga</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>cirrus</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>vmvga</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>qxl</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>virtio</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>none</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>bochs</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>ramfb</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:     </video>
Nov 03 12:12:41 user nova-compute[74960]:     <hostdev supported='yes'>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='mode'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>subsystem</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='startupPolicy'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>default</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>mandatory</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>requisite</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>optional</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='subsysType'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>usb</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>pci</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>scsi</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='capsType'/>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='pciBackend'/>
Nov 03 12:12:41 user nova-compute[74960]:     </hostdev>
Nov 03 12:12:41 user nova-compute[74960]:     <rng supported='yes'>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='model'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>virtio</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>virtio-transitional</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>virtio-non-transitional</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='backendModel'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>random</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>egd</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>builtin</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:     </rng>
Nov 03 12:12:41 user nova-compute[74960]:     <filesystem supported='yes'>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='driverType'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>path</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>handle</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>virtiofs</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:     </filesystem>
Nov 03 12:12:41 user nova-compute[74960]:     <tpm supported='yes'>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='model'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>tpm-tis</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>tpm-crb</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='backendModel'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>passthrough</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>emulator</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:     </tpm>
Nov 03 12:12:41 user nova-compute[74960]:   </devices>
Nov 03 12:12:41 user nova-compute[74960]:   <features>
Nov 03 12:12:41 user nova-compute[74960]:     <gic supported='no'/>
Nov 03 12:12:41 user nova-compute[74960]:     <vmcoreinfo supported='yes'/>
Nov 03 12:12:41 user nova-compute[74960]:     <genid supported='yes'/>
Nov 03 12:12:41 user nova-compute[74960]:     <backingStoreInput supported='yes'/>
Nov 03 12:12:41 user nova-compute[74960]:     <backup supported='yes'/>
Nov 03 12:12:41 user nova-compute[74960]:     <sev supported='no'/>
Nov 03 12:12:41 user nova-compute[74960]:   </features>
Nov 03 12:12:41 user nova-compute[74960]: </domainCapabilities>
Nov 03 12:12:41 user nova-compute[74960]:  {{(pid=74960) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 03 12:12:41 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-fb4353de-ffac-4cd0-ae62-b5aea0300ae4 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Nov 03 12:12:41 user nova-compute[74960]: <domainCapabilities>
Nov 03 12:12:41 user nova-compute[74960]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 03 12:12:41 user nova-compute[74960]:   <domain>kvm</domain>
Nov 03 12:12:41 user nova-compute[74960]:   <machine>pc-i440fx-jammy</machine>
Nov 03 12:12:41 user nova-compute[74960]:   <arch>x86_64</arch>
Nov 03 12:12:41 user nova-compute[74960]:   <vcpu max='255'/>
Nov 03 12:12:41 user nova-compute[74960]:   <iothreads supported='yes'/>
Nov 03 12:12:41 user nova-compute[74960]:   <os supported='yes'>
Nov 03 12:12:41 user nova-compute[74960]:     <enum name='firmware'>
Nov 03 12:12:41 user nova-compute[74960]:       <value>efi</value>
Nov 03 12:12:41 user nova-compute[74960]:     </enum>
Nov 03 12:12:41 user nova-compute[74960]:     <loader supported='yes'>
Nov 03 12:12:41 user nova-compute[74960]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='type'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>rom</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>pflash</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='readonly'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>yes</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>no</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='secure'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>no</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:     </loader>
Nov 03 12:12:41 user nova-compute[74960]:   </os>
Nov 03 12:12:41 user nova-compute[74960]:   <cpu>
Nov 03 12:12:41 user nova-compute[74960]:     <mode name='host-passthrough' supported='yes'>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='hostPassthroughMigratable'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>on</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>off</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:     </mode>
Nov 03 12:12:41 user nova-compute[74960]:     <mode name='maximum' supported='yes'>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='maximumMigratable'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>on</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>off</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:     </mode>
Nov 03 12:12:41 user nova-compute[74960]:     <mode name='host-model' supported='yes'>
Nov 03 12:12:41 user nova-compute[74960]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 03 12:12:41 user nova-compute[74960]:       <vendor>Intel</vendor>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='ss'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='vmx'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='pcid'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='hypervisor'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='arat'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='tsc_adjust'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='umip'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='md-clear'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='stibp'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='arch-capabilities'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='ssbd'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='invtsc'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='ibpb'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='ibrs'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='amd-stibp'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='amd-ssbd'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='rsba'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='pschange-mc-no'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='disable' name='erms'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='disable' name='xsaveopt'/>
Nov 03 12:12:41 user nova-compute[74960]:     </mode>
Nov 03 12:12:41 user nova-compute[74960]:     <mode name='custom' supported='yes'>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>qemu64</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='yes'>qemu32</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>phenom</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='yes'>pentium3</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='yes'>pentium2</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='yes'>pentium</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>n270</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='yes'>kvm64</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='yes'>kvm32</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='yes'>coreduo</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='yes'>core2duo</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>athlon</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='yes'>Westmere-IBRS</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='yes'>Westmere</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Snowridge</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Skylake-Server</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Skylake-Client</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>SandyBridge</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='yes'>Penryn</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Opteron_G5</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Opteron_G4</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Opteron_G3</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Opteron_G2</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='yes'>Opteron_G1</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='yes'>Nehalem</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>IvyBridge</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Icelake-Server</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Haswell-noTSX</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Haswell-IBRS</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Haswell</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>EPYC-Rome</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>EPYC-Milan</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>EPYC-IBPB</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>EPYC</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Dhyana</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Cooperlake</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='yes'>Conroe</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Cascadelake-Server</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Broadwell-noTSX</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Broadwell-IBRS</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Broadwell</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='yes'>486</model>
Nov 03 12:12:41 user nova-compute[74960]:     </mode>
Nov 03 12:12:41 user nova-compute[74960]:   </cpu>
Nov 03 12:12:41 user nova-compute[74960]:   <memoryBacking supported='yes'>
Nov 03 12:12:41 user nova-compute[74960]:     <enum name='sourceType'>
Nov 03 12:12:41 user nova-compute[74960]:       <value>file</value>
Nov 03 12:12:41 user nova-compute[74960]:       <value>anonymous</value>
Nov 03 12:12:41 user nova-compute[74960]:       <value>memfd</value>
Nov 03 12:12:41 user nova-compute[74960]:     </enum>
Nov 03 12:12:41 user nova-compute[74960]:   </memoryBacking>
Nov 03 12:12:41 user nova-compute[74960]:   <devices>
Nov 03 12:12:41 user nova-compute[74960]:     <disk supported='yes'>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='diskDevice'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>disk</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>cdrom</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>floppy</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>lun</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='bus'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>ide</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>fdc</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>scsi</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>virtio</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>usb</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>sata</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='model'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>virtio</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>virtio-transitional</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>virtio-non-transitional</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:     </disk>
Nov 03 12:12:41 user nova-compute[74960]:     <graphics supported='yes'>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='type'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>sdl</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>vnc</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>spice</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>egl-headless</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:     </graphics>
Nov 03 12:12:41 user nova-compute[74960]:     <video supported='yes'>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='modelType'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>vga</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>cirrus</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>vmvga</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>qxl</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>virtio</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>none</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>bochs</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>ramfb</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:     </video>
Nov 03 12:12:41 user nova-compute[74960]:     <hostdev supported='yes'>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='mode'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>subsystem</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='startupPolicy'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>default</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>mandatory</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>requisite</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>optional</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='subsysType'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>usb</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>pci</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>scsi</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='capsType'/>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='pciBackend'/>
Nov 03 12:12:41 user nova-compute[74960]:     </hostdev>
Nov 03 12:12:41 user nova-compute[74960]:     <rng supported='yes'>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='model'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>virtio</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>virtio-transitional</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>virtio-non-transitional</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='backendModel'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>random</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>egd</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>builtin</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:     </rng>
Nov 03 12:12:41 user nova-compute[74960]:     <filesystem supported='yes'>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='driverType'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>path</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>handle</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>virtiofs</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:     </filesystem>
Nov 03 12:12:41 user nova-compute[74960]:     <tpm supported='yes'>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='model'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>tpm-tis</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>tpm-crb</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='backendModel'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>passthrough</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>emulator</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:     </tpm>
Nov 03 12:12:41 user nova-compute[74960]:   </devices>
Nov 03 12:12:41 user nova-compute[74960]:   <features>
Nov 03 12:12:41 user nova-compute[74960]:     <gic supported='no'/>
Nov 03 12:12:41 user nova-compute[74960]:     <vmcoreinfo supported='yes'/>
Nov 03 12:12:41 user nova-compute[74960]:     <genid supported='yes'/>
Nov 03 12:12:41 user nova-compute[74960]:     <backingStoreInput supported='yes'/>
Nov 03 12:12:41 user nova-compute[74960]:     <backup supported='yes'/>
Nov 03 12:12:41 user nova-compute[74960]:     <sev supported='no'/>
Nov 03 12:12:41 user nova-compute[74960]:   </features>
Nov 03 12:12:41 user nova-compute[74960]: </domainCapabilities>
Nov 03 12:12:41 user nova-compute[74960]:  {{(pid=74960) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 03 12:12:41 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-fb4353de-ffac-4cd0-ae62-b5aea0300ae4 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Nov 03 12:12:41 user nova-compute[74960]: <domainCapabilities>
Nov 03 12:12:41 user nova-compute[74960]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 03 12:12:41 user nova-compute[74960]:   <domain>kvm</domain>
Nov 03 12:12:41 user nova-compute[74960]:   <machine>pc-q35-6.2</machine>
Nov 03 12:12:41 user nova-compute[74960]:   <arch>x86_64</arch>
Nov 03 12:12:41 user nova-compute[74960]:   <vcpu max='288'/>
Nov 03 12:12:41 user nova-compute[74960]:   <iothreads supported='yes'/>
Nov 03 12:12:41 user nova-compute[74960]:   <os supported='yes'>
Nov 03 12:12:41 user nova-compute[74960]:     <enum name='firmware'>
Nov 03 12:12:41 user nova-compute[74960]:       <value>efi</value>
Nov 03 12:12:41 user nova-compute[74960]:     </enum>
Nov 03 12:12:41 user nova-compute[74960]:     <loader supported='yes'>
Nov 03 12:12:41 user nova-compute[74960]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 03 12:12:41 user nova-compute[74960]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 03 12:12:41 user nova-compute[74960]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='type'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>rom</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>pflash</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='readonly'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>yes</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>no</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='secure'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>yes</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>no</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:     </loader>
Nov 03 12:12:41 user nova-compute[74960]:   </os>
Nov 03 12:12:41 user nova-compute[74960]:   <cpu>
Nov 03 12:12:41 user nova-compute[74960]:     <mode name='host-passthrough' supported='yes'>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='hostPassthroughMigratable'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>on</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>off</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:     </mode>
Nov 03 12:12:41 user nova-compute[74960]:     <mode name='maximum' supported='yes'>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='maximumMigratable'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>on</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>off</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:     </mode>
Nov 03 12:12:41 user nova-compute[74960]:     <mode name='host-model' supported='yes'>
Nov 03 12:12:41 user nova-compute[74960]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 03 12:12:41 user nova-compute[74960]:       <vendor>Intel</vendor>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='ss'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='vmx'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='pcid'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='hypervisor'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='arat'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='tsc_adjust'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='umip'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='md-clear'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='stibp'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='arch-capabilities'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='ssbd'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='invtsc'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='ibpb'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='ibrs'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='amd-stibp'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='amd-ssbd'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='rsba'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='pschange-mc-no'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='disable' name='erms'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='disable' name='xsaveopt'/>
Nov 03 12:12:41 user nova-compute[74960]:     </mode>
Nov 03 12:12:41 user nova-compute[74960]:     <mode name='custom' supported='yes'>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>qemu64</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='yes'>qemu32</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>phenom</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='yes'>pentium3</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='yes'>pentium2</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='yes'>pentium</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>n270</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='yes'>kvm64</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='yes'>kvm32</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='yes'>coreduo</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='yes'>core2duo</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>athlon</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='yes'>Westmere-IBRS</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='yes'>Westmere</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Snowridge</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Skylake-Server</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Skylake-Client</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>SandyBridge</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='yes'>Penryn</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Opteron_G5</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Opteron_G4</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Opteron_G3</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Opteron_G2</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='yes'>Opteron_G1</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='yes'>Nehalem</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>IvyBridge</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Icelake-Server</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Haswell-noTSX</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Haswell-IBRS</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Haswell</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>EPYC-Rome</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>EPYC-Milan</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>EPYC-IBPB</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>EPYC</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Dhyana</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Cooperlake</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='yes'>Conroe</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Cascadelake-Server</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Broadwell-noTSX</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Broadwell-IBRS</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Broadwell</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='yes'>486</model>
Nov 03 12:12:41 user nova-compute[74960]:     </mode>
Nov 03 12:12:41 user nova-compute[74960]:   </cpu>
Nov 03 12:12:41 user nova-compute[74960]:   <memoryBacking supported='yes'>
Nov 03 12:12:41 user nova-compute[74960]:     <enum name='sourceType'>
Nov 03 12:12:41 user nova-compute[74960]:       <value>file</value>
Nov 03 12:12:41 user nova-compute[74960]:       <value>anonymous</value>
Nov 03 12:12:41 user nova-compute[74960]:       <value>memfd</value>
Nov 03 12:12:41 user nova-compute[74960]:     </enum>
Nov 03 12:12:41 user nova-compute[74960]:   </memoryBacking>
Nov 03 12:12:41 user nova-compute[74960]:   <devices>
Nov 03 12:12:41 user nova-compute[74960]:     <disk supported='yes'>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='diskDevice'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>disk</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>cdrom</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>floppy</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>lun</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='bus'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>fdc</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>scsi</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>virtio</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>usb</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>sata</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='model'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>virtio</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>virtio-transitional</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>virtio-non-transitional</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:     </disk>
Nov 03 12:12:41 user nova-compute[74960]:     <graphics supported='yes'>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='type'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>sdl</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>vnc</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>spice</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>egl-headless</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:     </graphics>
Nov 03 12:12:41 user nova-compute[74960]:     <video supported='yes'>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='modelType'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>vga</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>cirrus</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>vmvga</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>qxl</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>virtio</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>none</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>bochs</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>ramfb</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:     </video>
Nov 03 12:12:41 user nova-compute[74960]:     <hostdev supported='yes'>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='mode'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>subsystem</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='startupPolicy'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>default</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>mandatory</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>requisite</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>optional</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='subsysType'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>usb</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>pci</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>scsi</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='capsType'/>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='pciBackend'/>
Nov 03 12:12:41 user nova-compute[74960]:     </hostdev>
Nov 03 12:12:41 user nova-compute[74960]:     <rng supported='yes'>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='model'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>virtio</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>virtio-transitional</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>virtio-non-transitional</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='backendModel'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>random</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>egd</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>builtin</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:     </rng>
Nov 03 12:12:41 user nova-compute[74960]:     <filesystem supported='yes'>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='driverType'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>path</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>handle</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>virtiofs</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:     </filesystem>
Nov 03 12:12:41 user nova-compute[74960]:     <tpm supported='yes'>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='model'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>tpm-tis</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>tpm-crb</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='backendModel'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>passthrough</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>emulator</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:     </tpm>
Nov 03 12:12:41 user nova-compute[74960]:   </devices>
Nov 03 12:12:41 user nova-compute[74960]:   <features>
Nov 03 12:12:41 user nova-compute[74960]:     <gic supported='no'/>
Nov 03 12:12:41 user nova-compute[74960]:     <vmcoreinfo supported='yes'/>
Nov 03 12:12:41 user nova-compute[74960]:     <genid supported='yes'/>
Nov 03 12:12:41 user nova-compute[74960]:     <backingStoreInput supported='yes'/>
Nov 03 12:12:41 user nova-compute[74960]:     <backup supported='yes'/>
Nov 03 12:12:41 user nova-compute[74960]:     <sev supported='no'/>
Nov 03 12:12:41 user nova-compute[74960]:   </features>
Nov 03 12:12:41 user nova-compute[74960]: </domainCapabilities>
Nov 03 12:12:41 user nova-compute[74960]:  {{(pid=74960) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 03 12:12:41 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-fb4353de-ffac-4cd0-ae62-b5aea0300ae4 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Nov 03 12:12:41 user nova-compute[74960]: <domainCapabilities>
Nov 03 12:12:41 user nova-compute[74960]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 03 12:12:41 user nova-compute[74960]:   <domain>kvm</domain>
Nov 03 12:12:41 user nova-compute[74960]:   <machine>pc-i440fx-6.2</machine>
Nov 03 12:12:41 user nova-compute[74960]:   <arch>x86_64</arch>
Nov 03 12:12:41 user nova-compute[74960]:   <vcpu max='255'/>
Nov 03 12:12:41 user nova-compute[74960]:   <iothreads supported='yes'/>
Nov 03 12:12:41 user nova-compute[74960]:   <os supported='yes'>
Nov 03 12:12:41 user nova-compute[74960]:     <enum name='firmware'>
Nov 03 12:12:41 user nova-compute[74960]:       <value>efi</value>
Nov 03 12:12:41 user nova-compute[74960]:     </enum>
Nov 03 12:12:41 user nova-compute[74960]:     <loader supported='yes'>
Nov 03 12:12:41 user nova-compute[74960]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='type'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>rom</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>pflash</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='readonly'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>yes</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>no</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='secure'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>no</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:     </loader>
Nov 03 12:12:41 user nova-compute[74960]:   </os>
Nov 03 12:12:41 user nova-compute[74960]:   <cpu>
Nov 03 12:12:41 user nova-compute[74960]:     <mode name='host-passthrough' supported='yes'>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='hostPassthroughMigratable'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>on</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>off</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:     </mode>
Nov 03 12:12:41 user nova-compute[74960]:     <mode name='maximum' supported='yes'>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='maximumMigratable'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>on</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>off</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:     </mode>
Nov 03 12:12:41 user nova-compute[74960]:     <mode name='host-model' supported='yes'>
Nov 03 12:12:41 user nova-compute[74960]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 03 12:12:41 user nova-compute[74960]:       <vendor>Intel</vendor>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='ss'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='vmx'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='pcid'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='hypervisor'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='arat'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='tsc_adjust'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='umip'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='md-clear'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='stibp'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='arch-capabilities'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='ssbd'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='invtsc'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='ibpb'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='ibrs'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='amd-stibp'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='amd-ssbd'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='rsba'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='require' name='pschange-mc-no'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='disable' name='erms'/>
Nov 03 12:12:41 user nova-compute[74960]:       <feature policy='disable' name='xsaveopt'/>
Nov 03 12:12:41 user nova-compute[74960]:     </mode>
Nov 03 12:12:41 user nova-compute[74960]:     <mode name='custom' supported='yes'>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>qemu64</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='yes'>qemu32</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>phenom</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='yes'>pentium3</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='yes'>pentium2</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='yes'>pentium</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>n270</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='yes'>kvm64</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='yes'>kvm32</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='yes'>coreduo</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='yes'>core2duo</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>athlon</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='yes'>Westmere-IBRS</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='yes'>Westmere</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Snowridge</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Skylake-Server</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Skylake-Client</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>SandyBridge</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='yes'>Penryn</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Opteron_G5</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Opteron_G4</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Opteron_G3</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Opteron_G2</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='yes'>Opteron_G1</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='yes'>Nehalem</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>IvyBridge</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Icelake-Server</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Haswell-noTSX</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Haswell-IBRS</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Haswell</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>EPYC-Rome</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>EPYC-Milan</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>EPYC-IBPB</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>EPYC</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Dhyana</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Cooperlake</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='yes'>Conroe</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Cascadelake-Server</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Broadwell-noTSX</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Broadwell-IBRS</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='no'>Broadwell</model>
Nov 03 12:12:41 user nova-compute[74960]:       <model usable='yes'>486</model>
Nov 03 12:12:41 user nova-compute[74960]:     </mode>
Nov 03 12:12:41 user nova-compute[74960]:   </cpu>
Nov 03 12:12:41 user nova-compute[74960]:   <memoryBacking supported='yes'>
Nov 03 12:12:41 user nova-compute[74960]:     <enum name='sourceType'>
Nov 03 12:12:41 user nova-compute[74960]:       <value>file</value>
Nov 03 12:12:41 user nova-compute[74960]:       <value>anonymous</value>
Nov 03 12:12:41 user nova-compute[74960]:       <value>memfd</value>
Nov 03 12:12:41 user nova-compute[74960]:     </enum>
Nov 03 12:12:41 user nova-compute[74960]:   </memoryBacking>
Nov 03 12:12:41 user nova-compute[74960]:   <devices>
Nov 03 12:12:41 user nova-compute[74960]:     <disk supported='yes'>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='diskDevice'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>disk</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>cdrom</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>floppy</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>lun</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='bus'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>ide</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>fdc</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>scsi</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>virtio</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>usb</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>sata</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='model'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>virtio</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>virtio-transitional</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>virtio-non-transitional</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:     </disk>
Nov 03 12:12:41 user nova-compute[74960]:     <graphics supported='yes'>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='type'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>sdl</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>vnc</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>spice</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>egl-headless</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:     </graphics>
Nov 03 12:12:41 user nova-compute[74960]:     <video supported='yes'>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='modelType'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>vga</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>cirrus</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>vmvga</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>qxl</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>virtio</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>none</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>bochs</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>ramfb</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:     </video>
Nov 03 12:12:41 user nova-compute[74960]:     <hostdev supported='yes'>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='mode'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>subsystem</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='startupPolicy'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>default</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>mandatory</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>requisite</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>optional</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='subsysType'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>usb</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>pci</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>scsi</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='capsType'/>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='pciBackend'/>
Nov 03 12:12:41 user nova-compute[74960]:     </hostdev>
Nov 03 12:12:41 user nova-compute[74960]:     <rng supported='yes'>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='model'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>virtio</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>virtio-transitional</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>virtio-non-transitional</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='backendModel'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>random</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>egd</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>builtin</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:     </rng>
Nov 03 12:12:41 user nova-compute[74960]:     <filesystem supported='yes'>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='driverType'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>path</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>handle</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>virtiofs</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:     </filesystem>
Nov 03 12:12:41 user nova-compute[74960]:     <tpm supported='yes'>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='model'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>tpm-tis</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>tpm-crb</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:       <enum name='backendModel'>
Nov 03 12:12:41 user nova-compute[74960]:         <value>passthrough</value>
Nov 03 12:12:41 user nova-compute[74960]:         <value>emulator</value>
Nov 03 12:12:41 user nova-compute[74960]:       </enum>
Nov 03 12:12:41 user nova-compute[74960]:     </tpm>
Nov 03 12:12:41 user nova-compute[74960]:   </devices>
Nov 03 12:12:41 user nova-compute[74960]:   <features>
Nov 03 12:12:41 user nova-compute[74960]:     <gic supported='no'/>
Nov 03 12:12:41 user nova-compute[74960]:     <vmcoreinfo supported='yes'/>
Nov 03 12:12:41 user nova-compute[74960]:     <genid supported='yes'/>
Nov 03 12:12:41 user nova-compute[74960]:     <backingStoreInput supported='yes'/>
Nov 03 12:12:41 user nova-compute[74960]:     <backup supported='yes'/>
Nov 03 12:12:41 user nova-compute[74960]:     <sev supported='no'/>
Nov 03 12:12:41 user nova-compute[74960]:   </features>
Nov 03 12:12:41 user nova-compute[74960]: </domainCapabilities>
Nov 03 12:12:41 user nova-compute[74960]:  {{(pid=74960) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 03 12:12:41 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-fb4353de-ffac-4cd0-ae62-b5aea0300ae4 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=74960) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 03 12:12:41 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-fb4353de-ffac-4cd0-ae62-b5aea0300ae4 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=74960) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 03 12:12:41 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-fb4353de-ffac-4cd0-ae62-b5aea0300ae4 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=74960) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 03 12:12:41 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-fb4353de-ffac-4cd0-ae62-b5aea0300ae4 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=74960) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 03 12:12:41 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-fb4353de-ffac-4cd0-ae62-b5aea0300ae4 None None] Checking secure boot support for host arch (x86_64) {{(pid=74960) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 03 12:12:41 user nova-compute[74960]: INFO nova.virt.libvirt.host [None req-fb4353de-ffac-4cd0-ae62-b5aea0300ae4 None None] Secure Boot support detected
Nov 03 12:12:41 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-fb4353de-ffac-4cd0-ae62-b5aea0300ae4 None None] cpu compare xml: <cpu match="exact">
Nov 03 12:12:41 user nova-compute[74960]:   <model>Nehalem</model>
Nov 03 12:12:41 user nova-compute[74960]: </cpu>
Nov 03 12:12:41 user nova-compute[74960]:  {{(pid=74960) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Nov 03 12:12:41 user nova-compute[74960]: INFO nova.virt.node [None req-fb4353de-ffac-4cd0-ae62-b5aea0300ae4 None None] Generated node identity 7ff44b50-6156-4cbc-80af-836e3c9d53d0
Nov 03 12:12:41 user nova-compute[74960]: INFO nova.virt.node [None req-fb4353de-ffac-4cd0-ae62-b5aea0300ae4 None None] Wrote node identity 7ff44b50-6156-4cbc-80af-836e3c9d53d0 to /opt/stack/data/nova/compute_id
Nov 03 12:12:41 user nova-compute[74960]: WARNING nova.compute.manager [None req-fb4353de-ffac-4cd0-ae62-b5aea0300ae4 None None] Compute nodes ['7ff44b50-6156-4cbc-80af-836e3c9d53d0'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Nov 03 12:12:41 user nova-compute[74960]: INFO nova.compute.manager [None req-fb4353de-ffac-4cd0-ae62-b5aea0300ae4 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Nov 03 12:12:41 user nova-compute[74960]: WARNING nova.compute.manager [None req-fb4353de-ffac-4cd0-ae62-b5aea0300ae4 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 03 12:12:41 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-fb4353de-ffac-4cd0-ae62-b5aea0300ae4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:12:41 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-fb4353de-ffac-4cd0-ae62-b5aea0300ae4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:12:41 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-fb4353de-ffac-4cd0-ae62-b5aea0300ae4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:12:41 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-fb4353de-ffac-4cd0-ae62-b5aea0300ae4 None None] Auditing locally available compute resources for user (node: user) {{(pid=74960) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 12:12:42 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-fb4353de-ffac-4cd0-ae62-b5aea0300ae4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:12:42 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-fb4353de-ffac-4cd0-ae62-b5aea0300ae4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:12:42 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-fb4353de-ffac-4cd0-ae62-b5aea0300ae4 None None] Hypervisor/Node resource view: name=user free_ram=10989MB free_disk=26.115310668945312GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74960) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 12:12:42 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-fb4353de-ffac-4cd0-ae62-b5aea0300ae4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:12:42 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-fb4353de-ffac-4cd0-ae62-b5aea0300ae4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:12:42 user nova-compute[74960]: WARNING nova.compute.resource_tracker [None req-fb4353de-ffac-4cd0-ae62-b5aea0300ae4 None None] No compute node record for user:7ff44b50-6156-4cbc-80af-836e3c9d53d0: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 7ff44b50-6156-4cbc-80af-836e3c9d53d0 could not be found.
Nov 03 12:12:42 user nova-compute[74960]: INFO nova.compute.resource_tracker [None req-fb4353de-ffac-4cd0-ae62-b5aea0300ae4 None None] Compute node record created for user:user with uuid: 7ff44b50-6156-4cbc-80af-836e3c9d53d0
Nov 03 12:12:42 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-fb4353de-ffac-4cd0-ae62-b5aea0300ae4 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74960) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 12:12:42 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-fb4353de-ffac-4cd0-ae62-b5aea0300ae4 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74960) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 12:12:42 user nova-compute[74960]: INFO nova.scheduler.client.report [None req-fb4353de-ffac-4cd0-ae62-b5aea0300ae4 None None] [req-b9ae200d-2b60-44dd-87c7-76383511b426] Created resource provider record via placement API for resource provider with UUID 7ff44b50-6156-4cbc-80af-836e3c9d53d0 and name user.
Nov 03 12:12:42 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-fb4353de-ffac-4cd0-ae62-b5aea0300ae4 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=74960) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Nov 03 12:12:42 user nova-compute[74960]: INFO nova.virt.libvirt.host [None req-fb4353de-ffac-4cd0-ae62-b5aea0300ae4 None None] kernel doesn't support AMD SEV
Nov 03 12:12:42 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-fb4353de-ffac-4cd0-ae62-b5aea0300ae4 None None] Updating inventory in ProviderTree for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 03 12:12:42 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-fb4353de-ffac-4cd0-ae62-b5aea0300ae4 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74960) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 12:12:42 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-fb4353de-ffac-4cd0-ae62-b5aea0300ae4 None None] Libvirt baseline CPU <cpu>
Nov 03 12:12:42 user nova-compute[74960]:   <arch>x86_64</arch>
Nov 03 12:12:42 user nova-compute[74960]:   <model>Nehalem</model>
Nov 03 12:12:42 user nova-compute[74960]:   <vendor>Intel</vendor>
Nov 03 12:12:42 user nova-compute[74960]:   <topology sockets="6" cores="1" threads="1"/>
Nov 03 12:12:42 user nova-compute[74960]: </cpu>
Nov 03 12:12:42 user nova-compute[74960]:  {{(pid=74960) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Nov 03 12:12:42 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-fb4353de-ffac-4cd0-ae62-b5aea0300ae4 None None] Updated inventory for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Nov 03 12:12:42 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-fb4353de-ffac-4cd0-ae62-b5aea0300ae4 None None] Updating resource provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 generation from 0 to 1 during operation: update_inventory {{(pid=74960) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 03 12:12:42 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-fb4353de-ffac-4cd0-ae62-b5aea0300ae4 None None] Updating inventory in ProviderTree for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 03 12:12:42 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-fb4353de-ffac-4cd0-ae62-b5aea0300ae4 None None] Updating resource provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 generation from 1 to 2 during operation: update_traits {{(pid=74960) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 03 12:12:42 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-fb4353de-ffac-4cd0-ae62-b5aea0300ae4 None None] Compute_service record updated for user:user {{(pid=74960) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 12:12:42 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-fb4353de-ffac-4cd0-ae62-b5aea0300ae4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.651s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:12:42 user nova-compute[74960]: DEBUG nova.service [None req-fb4353de-ffac-4cd0-ae62-b5aea0300ae4 None None] Creating RPC server for service compute {{(pid=74960) start /opt/stack/nova/nova/service.py:182}}
Nov 03 12:12:42 user nova-compute[74960]: DEBUG nova.service [None req-fb4353de-ffac-4cd0-ae62-b5aea0300ae4 None None] Join ServiceGroup membership for this service compute {{(pid=74960) start /opt/stack/nova/nova/service.py:199}}
Nov 03 12:12:42 user nova-compute[74960]: DEBUG nova.servicegroup.drivers.db [None req-fb4353de-ffac-4cd0-ae62-b5aea0300ae4 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=74960) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Nov 03 12:13:34 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:13:34 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:13:34 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Starting heal instance info cache {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 12:13:34 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Rebuilding the list of instances to heal {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 03 12:13:34 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Didn't find any instances for network info cache update. {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 03 12:13:34 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:13:34 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:13:34 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:13:34 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:13:34 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:13:34 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._sync_power_states {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:13:34 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:13:34 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74960) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 12:13:34 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:13:34 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:13:34 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:13:34 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:13:34 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Auditing locally available compute resources for user (node: user) {{(pid=74960) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 12:13:35 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:13:35 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:13:35 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Hypervisor/Node resource view: name=user free_ram=10339MB free_disk=26.019176483154297GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74960) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 12:13:35 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:13:35 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:13:35 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74960) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 12:13:35 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74960) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 12:13:35 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:13:35 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:13:35 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Compute_service record updated for user:user {{(pid=74960) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 12:13:35 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.172s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:13:35 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:14:33 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:14:33 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:14:33 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:14:34 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:14:34 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Starting heal instance info cache {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 12:14:34 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Rebuilding the list of instances to heal {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 03 12:14:34 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Didn't find any instances for network info cache update. {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 03 12:14:34 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:14:34 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:14:34 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:14:34 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:14:34 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74960) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 12:14:34 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:14:34 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:14:34 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:14:34 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:14:34 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Auditing locally available compute resources for user (node: user) {{(pid=74960) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 12:14:34 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:14:34 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:14:34 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Hypervisor/Node resource view: name=user free_ram=10335MB free_disk=26.083114624023438GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74960) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 12:14:34 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:14:34 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:14:34 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74960) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 12:14:34 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74960) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 12:14:34 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:14:34 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:14:34 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Compute_service record updated for user:user {{(pid=74960) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 12:14:34 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.125s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:14:35 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:15:33 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:15:34 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:15:34 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:15:34 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:15:34 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:15:34 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:15:34 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Auditing locally available compute resources for user (node: user) {{(pid=74960) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 12:15:34 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:15:34 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:15:34 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Hypervisor/Node resource view: name=user free_ram=10385MB free_disk=25.83690643310547GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74960) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 12:15:34 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:15:34 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:15:34 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74960) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 12:15:34 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74960) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 12:15:34 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:15:34 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:15:34 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Compute_service record updated for user:user {{(pid=74960) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 12:15:34 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.132s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:15:35 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:15:35 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Starting heal instance info cache {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 12:15:35 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Rebuilding the list of instances to heal {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 03 12:15:35 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Didn't find any instances for network info cache update. {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 03 12:15:35 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:15:35 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:15:35 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:15:35 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74960) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 12:15:36 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:15:37 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:16:33 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:16:35 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:16:36 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:16:36 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:16:36 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Starting heal instance info cache {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 12:16:36 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Rebuilding the list of instances to heal {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 03 12:16:36 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Didn't find any instances for network info cache update. {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 03 12:16:36 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:16:36 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:16:36 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:16:36 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:16:36 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:16:36 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Auditing locally available compute resources for user (node: user) {{(pid=74960) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 12:16:36 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:16:36 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:16:36 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Hypervisor/Node resource view: name=user free_ram=9629MB free_disk=25.864173889160156GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74960) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 12:16:36 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:16:36 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:16:36 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74960) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 12:16:36 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74960) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 12:16:37 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:16:37 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:16:37 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Compute_service record updated for user:user {{(pid=74960) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 12:16:37 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.172s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:16:38 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:16:38 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:16:38 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74960) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 12:16:38 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:16:38 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:16:40 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Acquiring lock "39e6c635-4602-4ed6-abbd-80c96f056715" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:16:40 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Lock "39e6c635-4602-4ed6-abbd-80c96f056715" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:16:40 user nova-compute[74960]: DEBUG nova.compute.manager [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] [instance: 39e6c635-4602-4ed6-abbd-80c96f056715] Starting instance... {{(pid=74960) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 12:16:40 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:16:40 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:16:40 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74960) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 12:16:40 user nova-compute[74960]: INFO nova.compute.claims [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] [instance: 39e6c635-4602-4ed6-abbd-80c96f056715] Claim successful on node user
Nov 03 12:16:41 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:16:41 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:16:41 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.508s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:16:41 user nova-compute[74960]: DEBUG nova.compute.manager [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] [instance: 39e6c635-4602-4ed6-abbd-80c96f056715] Start building networks asynchronously for instance. {{(pid=74960) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 12:16:41 user nova-compute[74960]: DEBUG nova.compute.manager [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] [instance: 39e6c635-4602-4ed6-abbd-80c96f056715] Allocating IP information in the background. {{(pid=74960) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 12:16:41 user nova-compute[74960]: DEBUG nova.network.neutron [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] [instance: 39e6c635-4602-4ed6-abbd-80c96f056715] allocate_for_instance() {{(pid=74960) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 12:16:41 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] [instance: 39e6c635-4602-4ed6-abbd-80c96f056715] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 12:16:41 user nova-compute[74960]: DEBUG nova.compute.manager [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] [instance: 39e6c635-4602-4ed6-abbd-80c96f056715] Start building block device mappings for instance. {{(pid=74960) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 12:16:41 user nova-compute[74960]: DEBUG nova.compute.manager [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] [instance: 39e6c635-4602-4ed6-abbd-80c96f056715] Start spawning the instance on the hypervisor. {{(pid=74960) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 12:16:41 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] [instance: 39e6c635-4602-4ed6-abbd-80c96f056715] Creating instance directory {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 12:16:41 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] [instance: 39e6c635-4602-4ed6-abbd-80c96f056715] Creating image(s)
Nov 03 12:16:41 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Acquiring lock "/opt/stack/data/nova/instances/39e6c635-4602-4ed6-abbd-80c96f056715/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:16:41 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Lock "/opt/stack/data/nova/instances/39e6c635-4602-4ed6-abbd-80c96f056715/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:16:41 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Lock "/opt/stack/data/nova/instances/39e6c635-4602-4ed6-abbd-80c96f056715/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.011s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:16:41 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Acquiring lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:16:41 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:16:42 user nova-compute[74960]: DEBUG nova.policy [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ce5640786940482c9e01e3c5139cf013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23bb45aea3d244e298d314a3c9800397', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74960) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 12:16:42 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910.part --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:16:43 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910.part --force-share --output=json" returned: 0 in 0.203s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:16:43 user nova-compute[74960]: DEBUG nova.virt.images [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] 549f51ba-ac69-494b-8de1-34635aa2d7cf was qcow2, converting to raw {{(pid=74960) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 03 12:16:43 user nova-compute[74960]: DEBUG nova.privsep.utils [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74960) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 03 12:16:43 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910.part /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910.converted {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:16:43 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910.part /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910.converted" returned: 0 in 0.365s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:16:43 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910.converted --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:16:43 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910.converted --force-share --output=json" returned: 0 in 0.219s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:16:43 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.883s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:16:43 user nova-compute[74960]: INFO oslo.privsep.daemon [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpvs25kdea/privsep.sock']
Nov 03 12:16:43 user sudo[84200]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpvs25kdea/privsep.sock
Nov 03 12:16:43 user sudo[84200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 03 12:16:44 user nova-compute[74960]: DEBUG nova.network.neutron [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] [instance: 39e6c635-4602-4ed6-abbd-80c96f056715] Successfully created port: 948c9582-33b7-486d-889a-65c37267d98d {{(pid=74960) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 12:16:45 user sudo[84200]: pam_unix(sudo:session): session closed for user root
Nov 03 12:16:45 user nova-compute[74960]: INFO oslo.privsep.daemon [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Spawned new privsep daemon via rootwrap
Nov 03 12:16:45 user nova-compute[74960]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 03 12:16:45 user nova-compute[74960]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 03 12:16:45 user nova-compute[74960]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 03 12:16:45 user nova-compute[74960]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84203
Nov 03 12:16:45 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:16:45 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.154s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:16:45 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Acquiring lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:16:45 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:16:45 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:16:45 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.202s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:16:45 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910,backing_fmt=raw /opt/stack/data/nova/instances/39e6c635-4602-4ed6-abbd-80c96f056715/disk 1073741824 {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:16:45 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910,backing_fmt=raw /opt/stack/data/nova/instances/39e6c635-4602-4ed6-abbd-80c96f056715/disk 1073741824" returned: 0 in 0.047s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:16:45 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:16:45 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:16:46 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.205s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:16:46 user nova-compute[74960]: DEBUG nova.virt.disk.api [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Checking if we can resize image /opt/stack/data/nova/instances/39e6c635-4602-4ed6-abbd-80c96f056715/disk. size=1073741824 {{(pid=74960) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 12:16:46 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39e6c635-4602-4ed6-abbd-80c96f056715/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:16:46 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39e6c635-4602-4ed6-abbd-80c96f056715/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:16:46 user nova-compute[74960]: DEBUG nova.virt.disk.api [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Cannot resize image /opt/stack/data/nova/instances/39e6c635-4602-4ed6-abbd-80c96f056715/disk to a smaller size. {{(pid=74960) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 12:16:46 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] [instance: 39e6c635-4602-4ed6-abbd-80c96f056715] Created local disks {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 12:16:46 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] [instance: 39e6c635-4602-4ed6-abbd-80c96f056715] Ensure instance console log exists: /opt/stack/data/nova/instances/39e6c635-4602-4ed6-abbd-80c96f056715/console.log {{(pid=74960) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 12:16:46 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:16:46 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:16:46 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:16:47 user nova-compute[74960]: DEBUG nova.network.neutron [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] [instance: 39e6c635-4602-4ed6-abbd-80c96f056715] Successfully updated port: 948c9582-33b7-486d-889a-65c37267d98d {{(pid=74960) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 12:16:47 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Acquiring lock "refresh_cache-39e6c635-4602-4ed6-abbd-80c96f056715" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:16:47 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Acquired lock "refresh_cache-39e6c635-4602-4ed6-abbd-80c96f056715" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:16:47 user nova-compute[74960]: DEBUG nova.network.neutron [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] [instance: 39e6c635-4602-4ed6-abbd-80c96f056715] Building network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 12:16:47 user nova-compute[74960]: DEBUG nova.network.neutron [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] [instance: 39e6c635-4602-4ed6-abbd-80c96f056715] Instance cache missing network info. {{(pid=74960) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 12:16:48 user nova-compute[74960]: DEBUG nova.compute.manager [req-20d91a37-7ab3-42a8-81c3-0225e98368e5 req-bcb30618-187b-4e9c-ae56-f3b52e7f549c service nova] [instance: 39e6c635-4602-4ed6-abbd-80c96f056715] Received event network-changed-948c9582-33b7-486d-889a-65c37267d98d {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:16:48 user nova-compute[74960]: DEBUG nova.compute.manager [req-20d91a37-7ab3-42a8-81c3-0225e98368e5 req-bcb30618-187b-4e9c-ae56-f3b52e7f549c service nova] [instance: 39e6c635-4602-4ed6-abbd-80c96f056715] Refreshing instance network info cache due to event network-changed-948c9582-33b7-486d-889a-65c37267d98d. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 12:16:48 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-20d91a37-7ab3-42a8-81c3-0225e98368e5 req-bcb30618-187b-4e9c-ae56-f3b52e7f549c service nova] Acquiring lock "refresh_cache-39e6c635-4602-4ed6-abbd-80c96f056715" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:16:48 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-1fcfc153-b24b-4c09-91d4-cce01b3db0b5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Acquiring lock "7e5ec97f-80c4-4499-94bf-2584fc0eae03" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:16:48 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-1fcfc153-b24b-4c09-91d4-cce01b3db0b5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Lock "7e5ec97f-80c4-4499-94bf-2584fc0eae03" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:16:48 user nova-compute[74960]: DEBUG nova.compute.manager [None req-1fcfc153-b24b-4c09-91d4-cce01b3db0b5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Starting instance... {{(pid=74960) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 12:16:48 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-1fcfc153-b24b-4c09-91d4-cce01b3db0b5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:16:48 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-1fcfc153-b24b-4c09-91d4-cce01b3db0b5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:16:48 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-1fcfc153-b24b-4c09-91d4-cce01b3db0b5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74960) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 12:16:48 user nova-compute[74960]: INFO nova.compute.claims [None req-1fcfc153-b24b-4c09-91d4-cce01b3db0b5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Claim successful on node user
Nov 03 12:16:49 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-1fcfc153-b24b-4c09-91d4-cce01b3db0b5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:16:49 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-1fcfc153-b24b-4c09-91d4-cce01b3db0b5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:16:49 user nova-compute[74960]: DEBUG nova.network.neutron [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] [instance: 39e6c635-4602-4ed6-abbd-80c96f056715] Updating instance_info_cache with network_info: [{"id": "948c9582-33b7-486d-889a-65c37267d98d", "address": "fa:16:3e:7c:0d:76", "network": {"id": "accc48f4-76c2-486d-9494-27f72e339655", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1003203293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23bb45aea3d244e298d314a3c9800397", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap948c9582-33", "ovs_interfaceid": "948c9582-33b7-486d-889a-65c37267d98d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:16:49 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-1fcfc153-b24b-4c09-91d4-cce01b3db0b5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.362s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:16:49 user nova-compute[74960]: DEBUG nova.compute.manager [None req-1fcfc153-b24b-4c09-91d4-cce01b3db0b5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Start building networks asynchronously for instance. {{(pid=74960) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 12:16:49 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Releasing lock "refresh_cache-39e6c635-4602-4ed6-abbd-80c96f056715" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:16:49 user nova-compute[74960]: DEBUG nova.compute.manager [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] [instance: 39e6c635-4602-4ed6-abbd-80c96f056715] Instance network_info: |[{"id": "948c9582-33b7-486d-889a-65c37267d98d", "address": "fa:16:3e:7c:0d:76", "network": {"id": "accc48f4-76c2-486d-9494-27f72e339655", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1003203293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23bb45aea3d244e298d314a3c9800397", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap948c9582-33", "ovs_interfaceid": "948c9582-33b7-486d-889a-65c37267d98d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74960) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 12:16:49 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-20d91a37-7ab3-42a8-81c3-0225e98368e5 req-bcb30618-187b-4e9c-ae56-f3b52e7f549c service nova] Acquired lock "refresh_cache-39e6c635-4602-4ed6-abbd-80c96f056715" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:16:49 user nova-compute[74960]: DEBUG nova.network.neutron [req-20d91a37-7ab3-42a8-81c3-0225e98368e5 req-bcb30618-187b-4e9c-ae56-f3b52e7f549c service nova] [instance: 39e6c635-4602-4ed6-abbd-80c96f056715] Refreshing network info cache for port 948c9582-33b7-486d-889a-65c37267d98d {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 12:16:49 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] [instance: 39e6c635-4602-4ed6-abbd-80c96f056715] Start _get_guest_xml network_info=[{"id": "948c9582-33b7-486d-889a-65c37267d98d", "address": "fa:16:3e:7c:0d:76", "network": {"id": "accc48f4-76c2-486d-9494-27f72e339655", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1003203293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23bb45aea3d244e298d314a3c9800397", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap948c9582-33", "ovs_interfaceid": "948c9582-33b7-486d-889a-65c37267d98d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=549f51ba-ac69-494b-8de1-34635aa2d7cf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='63ee9c80c632442fb0379f47b784bd20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T12:13:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'image_id': '549f51ba-ac69-494b-8de1-34635aa2d7cf'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 12:16:49 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:16:49 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:16:49 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 12:16:49 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] CPU controller missing on host. {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 12:16:49 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 12:16:49 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] CPU controller found on host. {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 12:16:49 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74960) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 12:16:49 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=549f51ba-ac69-494b-8de1-34635aa2d7cf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='63ee9c80c632442fb0379f47b784bd20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T12:13:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 12:16:49 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Flavor limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 12:16:49 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Image limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 12:16:49 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Flavor pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 12:16:49 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Image pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 12:16:49 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 12:16:49 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 12:16:49 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 12:16:49 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Got 1 possible topologies {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 12:16:49 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 12:16:49 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 12:16:49 user nova-compute[74960]: DEBUG nova.privsep.utils [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74960) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 03 12:16:49 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:16:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-2037102644',display_name='tempest-DeleteServersTestJSON-server-2037102644',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-2037102644',id=1,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='23bb45aea3d244e298d314a3c9800397',ramdisk_id='',reservation_id='r-99ri8kfh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-705662120',owner_user_name='tempest-DeleteServersTestJSON-705662120-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:16:42Z,user_data=None,user_id='ce5640786940482c9e01e3c5139cf013',uuid=39e6c635-4602-4ed6-abbd-80c96f056715,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "948c9582-33b7-486d-889a-65c37267d98d", "address": "fa:16:3e:7c:0d:76", "network": {"id": "accc48f4-76c2-486d-9494-27f72e339655", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1003203293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23bb45aea3d244e298d314a3c9800397", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap948c9582-33", "ovs_interfaceid": "948c9582-33b7-486d-889a-65c37267d98d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74960) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 12:16:49 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Converting VIF {"id": "948c9582-33b7-486d-889a-65c37267d98d", "address": "fa:16:3e:7c:0d:76", "network": {"id": "accc48f4-76c2-486d-9494-27f72e339655", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1003203293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23bb45aea3d244e298d314a3c9800397", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap948c9582-33", "ovs_interfaceid": "948c9582-33b7-486d-889a-65c37267d98d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:16:49 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:0d:76,bridge_name='br-int',has_traffic_filtering=True,id=948c9582-33b7-486d-889a-65c37267d98d,network=Network(accc48f4-76c2-486d-9494-27f72e339655),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap948c9582-33') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:16:49 user nova-compute[74960]: DEBUG nova.objects.instance [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Lazy-loading 'pci_devices' on Instance uuid 39e6c635-4602-4ed6-abbd-80c96f056715 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:16:49 user nova-compute[74960]: DEBUG nova.compute.manager [None req-1fcfc153-b24b-4c09-91d4-cce01b3db0b5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Allocating IP information in the background. {{(pid=74960) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 12:16:49 user nova-compute[74960]: DEBUG nova.network.neutron [None req-1fcfc153-b24b-4c09-91d4-cce01b3db0b5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] allocate_for_instance() {{(pid=74960) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 12:16:49 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] [instance: 39e6c635-4602-4ed6-abbd-80c96f056715] End _get_guest_xml xml=<domain type="kvm">
Nov 03 12:16:49 user nova-compute[74960]:   <uuid>39e6c635-4602-4ed6-abbd-80c96f056715</uuid>
Nov 03 12:16:49 user nova-compute[74960]:   <name>instance-00000001</name>
Nov 03 12:16:49 user nova-compute[74960]:   <memory>524288</memory>
Nov 03 12:16:49 user nova-compute[74960]:   <vcpu>1</vcpu>
Nov 03 12:16:49 user nova-compute[74960]:   <metadata>
Nov 03 12:16:49 user nova-compute[74960]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 12:16:49 user nova-compute[74960]:       <nova:package version="0.0.0"/>
Nov 03 12:16:49 user nova-compute[74960]:       <nova:name>tempest-DeleteServersTestJSON-server-2037102644</nova:name>
Nov 03 12:16:49 user nova-compute[74960]:       <nova:creationTime>2023-11-03 12:16:49</nova:creationTime>
Nov 03 12:16:49 user nova-compute[74960]:       <nova:flavor name="m1.tiny">
Nov 03 12:16:49 user nova-compute[74960]:         <nova:memory>512</nova:memory>
Nov 03 12:16:49 user nova-compute[74960]:         <nova:disk>1</nova:disk>
Nov 03 12:16:49 user nova-compute[74960]:         <nova:swap>0</nova:swap>
Nov 03 12:16:49 user nova-compute[74960]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 12:16:49 user nova-compute[74960]:         <nova:vcpus>1</nova:vcpus>
Nov 03 12:16:49 user nova-compute[74960]:       </nova:flavor>
Nov 03 12:16:49 user nova-compute[74960]:       <nova:owner>
Nov 03 12:16:49 user nova-compute[74960]:         <nova:user uuid="ce5640786940482c9e01e3c5139cf013">tempest-DeleteServersTestJSON-705662120-project-member</nova:user>
Nov 03 12:16:49 user nova-compute[74960]:         <nova:project uuid="23bb45aea3d244e298d314a3c9800397">tempest-DeleteServersTestJSON-705662120</nova:project>
Nov 03 12:16:49 user nova-compute[74960]:       </nova:owner>
Nov 03 12:16:49 user nova-compute[74960]:       <nova:root type="image" uuid="549f51ba-ac69-494b-8de1-34635aa2d7cf"/>
Nov 03 12:16:49 user nova-compute[74960]:       <nova:ports>
Nov 03 12:16:49 user nova-compute[74960]:         <nova:port uuid="948c9582-33b7-486d-889a-65c37267d98d">
Nov 03 12:16:49 user nova-compute[74960]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 03 12:16:49 user nova-compute[74960]:         </nova:port>
Nov 03 12:16:49 user nova-compute[74960]:       </nova:ports>
Nov 03 12:16:49 user nova-compute[74960]:     </nova:instance>
Nov 03 12:16:49 user nova-compute[74960]:   </metadata>
Nov 03 12:16:49 user nova-compute[74960]:   <sysinfo type="smbios">
Nov 03 12:16:49 user nova-compute[74960]:     <system>
Nov 03 12:16:49 user nova-compute[74960]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 12:16:49 user nova-compute[74960]:       <entry name="product">OpenStack Nova</entry>
Nov 03 12:16:49 user nova-compute[74960]:       <entry name="version">0.0.0</entry>
Nov 03 12:16:49 user nova-compute[74960]:       <entry name="serial">39e6c635-4602-4ed6-abbd-80c96f056715</entry>
Nov 03 12:16:49 user nova-compute[74960]:       <entry name="uuid">39e6c635-4602-4ed6-abbd-80c96f056715</entry>
Nov 03 12:16:49 user nova-compute[74960]:       <entry name="family">Virtual Machine</entry>
Nov 03 12:16:49 user nova-compute[74960]:     </system>
Nov 03 12:16:49 user nova-compute[74960]:   </sysinfo>
Nov 03 12:16:49 user nova-compute[74960]:   <os>
Nov 03 12:16:49 user nova-compute[74960]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 12:16:49 user nova-compute[74960]:     <boot dev="hd"/>
Nov 03 12:16:49 user nova-compute[74960]:     <smbios mode="sysinfo"/>
Nov 03 12:16:49 user nova-compute[74960]:   </os>
Nov 03 12:16:49 user nova-compute[74960]:   <features>
Nov 03 12:16:49 user nova-compute[74960]:     <acpi/>
Nov 03 12:16:49 user nova-compute[74960]:     <apic/>
Nov 03 12:16:49 user nova-compute[74960]:     <vmcoreinfo/>
Nov 03 12:16:49 user nova-compute[74960]:   </features>
Nov 03 12:16:49 user nova-compute[74960]:   <clock offset="utc">
Nov 03 12:16:49 user nova-compute[74960]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 12:16:49 user nova-compute[74960]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 12:16:49 user nova-compute[74960]:     <timer name="hpet" present="no"/>
Nov 03 12:16:49 user nova-compute[74960]:   </clock>
Nov 03 12:16:49 user nova-compute[74960]:   <cpu mode="custom" match="exact">
Nov 03 12:16:49 user nova-compute[74960]:     <model>Nehalem</model>
Nov 03 12:16:49 user nova-compute[74960]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 12:16:49 user nova-compute[74960]:   </cpu>
Nov 03 12:16:49 user nova-compute[74960]:   <devices>
Nov 03 12:16:49 user nova-compute[74960]:     <disk type="file" device="disk">
Nov 03 12:16:49 user nova-compute[74960]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 12:16:49 user nova-compute[74960]:       <source file="/opt/stack/data/nova/instances/39e6c635-4602-4ed6-abbd-80c96f056715/disk"/>
Nov 03 12:16:49 user nova-compute[74960]:       <target dev="vda" bus="virtio"/>
Nov 03 12:16:49 user nova-compute[74960]:     </disk>
Nov 03 12:16:49 user nova-compute[74960]:     <interface type="ethernet">
Nov 03 12:16:49 user nova-compute[74960]:       <mac address="fa:16:3e:7c:0d:76"/>
Nov 03 12:16:49 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:16:49 user nova-compute[74960]:       <mtu size="1442"/>
Nov 03 12:16:49 user nova-compute[74960]:       <target dev="tap948c9582-33"/>
Nov 03 12:16:49 user nova-compute[74960]:     </interface>
Nov 03 12:16:49 user nova-compute[74960]:     <serial type="pty">
Nov 03 12:16:49 user nova-compute[74960]:       <log file="/opt/stack/data/nova/instances/39e6c635-4602-4ed6-abbd-80c96f056715/console.log" append="off"/>
Nov 03 12:16:49 user nova-compute[74960]:     </serial>
Nov 03 12:16:49 user nova-compute[74960]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 12:16:49 user nova-compute[74960]:     <video>
Nov 03 12:16:49 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:16:49 user nova-compute[74960]:     </video>
Nov 03 12:16:49 user nova-compute[74960]:     <rng model="virtio">
Nov 03 12:16:49 user nova-compute[74960]:       <backend model="random">/dev/urandom</backend>
Nov 03 12:16:49 user nova-compute[74960]:     </rng>
Nov 03 12:16:49 user nova-compute[74960]:     <controller type="usb" index="0" model="none"/>
Nov 03 12:16:49 user nova-compute[74960]:     <memballoon model="virtio">
Nov 03 12:16:49 user nova-compute[74960]:       <stats period="10"/>
Nov 03 12:16:49 user nova-compute[74960]:     </memballoon>
Nov 03 12:16:49 user nova-compute[74960]:   </devices>
Nov 03 12:16:49 user nova-compute[74960]: </domain>
Nov 03 12:16:49 user nova-compute[74960]:  {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 12:16:49 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:16:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-2037102644',display_name='tempest-DeleteServersTestJSON-server-2037102644',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-2037102644',id=1,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='23bb45aea3d244e298d314a3c9800397',ramdisk_id='',reservation_id='r-99ri8kfh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-705662120',owner_user_name='tempest-DeleteServersTestJSON-705662120-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:16:42Z,user_data=None,user_id='ce5640786940482c9e01e3c5139cf013',uuid=39e6c635-4602-4ed6-abbd-80c96f056715,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "948c9582-33b7-486d-889a-65c37267d98d", "address": "fa:16:3e:7c:0d:76", "network": {"id": "accc48f4-76c2-486d-9494-27f72e339655", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1003203293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23bb45aea3d244e298d314a3c9800397", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap948c9582-33", "ovs_interfaceid": "948c9582-33b7-486d-889a-65c37267d98d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 12:16:49 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Converting VIF {"id": "948c9582-33b7-486d-889a-65c37267d98d", "address": "fa:16:3e:7c:0d:76", "network": {"id": "accc48f4-76c2-486d-9494-27f72e339655", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1003203293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23bb45aea3d244e298d314a3c9800397", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap948c9582-33", "ovs_interfaceid": "948c9582-33b7-486d-889a-65c37267d98d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:16:49 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:0d:76,bridge_name='br-int',has_traffic_filtering=True,id=948c9582-33b7-486d-889a-65c37267d98d,network=Network(accc48f4-76c2-486d-9494-27f72e339655),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap948c9582-33') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:16:49 user nova-compute[74960]: DEBUG os_vif [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:0d:76,bridge_name='br-int',has_traffic_filtering=True,id=948c9582-33b7-486d-889a-65c37267d98d,network=Network(accc48f4-76c2-486d-9494-27f72e339655),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap948c9582-33') {{(pid=74960) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 12:16:49 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-1fcfc153-b24b-4c09-91d4-cce01b3db0b5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 12:16:49 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Created schema index Interface.name {{(pid=74960) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 03 12:16:49 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Created schema index Port.name {{(pid=74960) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 03 12:16:49 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Created schema index Bridge.name {{(pid=74960) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 03 12:16:49 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=74960) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 12:16:49 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] [POLLOUT] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:16:49 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74960) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 12:16:49 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:16:49 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:16:49 user nova-compute[74960]: DEBUG nova.policy [None req-1fcfc153-b24b-4c09-91d4-cce01b3db0b5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fae69462930546bdb9cf6e2a11a0df2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c216dd7629274eafbf0a5968ff2378a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74960) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 12:16:49 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:16:49 user nova-compute[74960]: DEBUG nova.compute.manager [None req-1fcfc153-b24b-4c09-91d4-cce01b3db0b5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Start building block device mappings for instance. {{(pid=74960) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 12:16:49 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:16:49 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:16:49 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 12:16:49 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:16:49 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '52791e5c-9f0e-5640-9097-37d4c148e646', '_type': 'linux-noop'}}, row=False) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:16:49 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:16:49 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:16:49 user nova-compute[74960]: INFO oslo.privsep.daemon [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpc1c291eu/privsep.sock']
Nov 03 12:16:49 user sudo[84236]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpc1c291eu/privsep.sock
Nov 03 12:16:49 user sudo[84236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 03 12:16:49 user nova-compute[74960]: DEBUG nova.compute.manager [None req-1fcfc153-b24b-4c09-91d4-cce01b3db0b5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Start spawning the instance on the hypervisor. {{(pid=74960) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 12:16:49 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-1fcfc153-b24b-4c09-91d4-cce01b3db0b5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Creating instance directory {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 12:16:49 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-1fcfc153-b24b-4c09-91d4-cce01b3db0b5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Creating image(s)
Nov 03 12:16:49 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-1fcfc153-b24b-4c09-91d4-cce01b3db0b5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Acquiring lock "/opt/stack/data/nova/instances/7e5ec97f-80c4-4499-94bf-2584fc0eae03/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:16:49 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-1fcfc153-b24b-4c09-91d4-cce01b3db0b5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Lock "/opt/stack/data/nova/instances/7e5ec97f-80c4-4499-94bf-2584fc0eae03/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:16:49 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-1fcfc153-b24b-4c09-91d4-cce01b3db0b5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Lock "/opt/stack/data/nova/instances/7e5ec97f-80c4-4499-94bf-2584fc0eae03/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:16:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-1fcfc153-b24b-4c09-91d4-cce01b3db0b5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:16:49 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-def79da1-a3da-487e-81b2-26d1246a119f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Acquiring lock "7769e3c5-136f-4282-8e3e-224e3a80922c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:16:49 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-def79da1-a3da-487e-81b2-26d1246a119f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Lock "7769e3c5-136f-4282-8e3e-224e3a80922c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.008s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:16:49 user nova-compute[74960]: DEBUG nova.compute.manager [None req-def79da1-a3da-487e-81b2-26d1246a119f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: 7769e3c5-136f-4282-8e3e-224e3a80922c] Starting instance... {{(pid=74960) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 12:16:49 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:16:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-1fcfc153-b24b-4c09-91d4-cce01b3db0b5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.213s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:16:49 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-1fcfc153-b24b-4c09-91d4-cce01b3db0b5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Acquiring lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:16:50 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-1fcfc153-b24b-4c09-91d4-cce01b3db0b5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:16:50 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-1fcfc153-b24b-4c09-91d4-cce01b3db0b5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:16:50 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-def79da1-a3da-487e-81b2-26d1246a119f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:16:50 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-def79da1-a3da-487e-81b2-26d1246a119f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:16:50 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-def79da1-a3da-487e-81b2-26d1246a119f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74960) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 12:16:50 user nova-compute[74960]: INFO nova.compute.claims [None req-def79da1-a3da-487e-81b2-26d1246a119f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: 7769e3c5-136f-4282-8e3e-224e3a80922c] Claim successful on node user
Nov 03 12:16:50 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-1fcfc153-b24b-4c09-91d4-cce01b3db0b5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.236s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:16:50 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-1fcfc153-b24b-4c09-91d4-cce01b3db0b5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910,backing_fmt=raw /opt/stack/data/nova/instances/7e5ec97f-80c4-4499-94bf-2584fc0eae03/disk 1073741824 {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:16:50 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-1fcfc153-b24b-4c09-91d4-cce01b3db0b5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910,backing_fmt=raw /opt/stack/data/nova/instances/7e5ec97f-80c4-4499-94bf-2584fc0eae03/disk 1073741824" returned: 0 in 0.045s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:16:50 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-1fcfc153-b24b-4c09-91d4-cce01b3db0b5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.285s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:16:50 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-1fcfc153-b24b-4c09-91d4-cce01b3db0b5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:16:50 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-def79da1-a3da-487e-81b2-26d1246a119f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:16:50 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-1fcfc153-b24b-4c09-91d4-cce01b3db0b5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.173s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:16:50 user nova-compute[74960]: DEBUG nova.virt.disk.api [None req-1fcfc153-b24b-4c09-91d4-cce01b3db0b5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7e5ec97f-80c4-4499-94bf-2584fc0eae03/disk. size=1073741824 {{(pid=74960) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 12:16:50 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-1fcfc153-b24b-4c09-91d4-cce01b3db0b5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e5ec97f-80c4-4499-94bf-2584fc0eae03/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:16:50 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-def79da1-a3da-487e-81b2-26d1246a119f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:16:50 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-def79da1-a3da-487e-81b2-26d1246a119f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.486s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:16:50 user nova-compute[74960]: DEBUG nova.compute.manager [None req-def79da1-a3da-487e-81b2-26d1246a119f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: 7769e3c5-136f-4282-8e3e-224e3a80922c] Start building networks asynchronously for instance. {{(pid=74960) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 12:16:50 user nova-compute[74960]: DEBUG nova.network.neutron [req-20d91a37-7ab3-42a8-81c3-0225e98368e5 req-bcb30618-187b-4e9c-ae56-f3b52e7f549c service nova] [instance: 39e6c635-4602-4ed6-abbd-80c96f056715] Updated VIF entry in instance network info cache for port 948c9582-33b7-486d-889a-65c37267d98d. {{(pid=74960) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 12:16:50 user nova-compute[74960]: DEBUG nova.network.neutron [req-20d91a37-7ab3-42a8-81c3-0225e98368e5 req-bcb30618-187b-4e9c-ae56-f3b52e7f549c service nova] [instance: 39e6c635-4602-4ed6-abbd-80c96f056715] Updating instance_info_cache with network_info: [{"id": "948c9582-33b7-486d-889a-65c37267d98d", "address": "fa:16:3e:7c:0d:76", "network": {"id": "accc48f4-76c2-486d-9494-27f72e339655", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1003203293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23bb45aea3d244e298d314a3c9800397", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap948c9582-33", "ovs_interfaceid": "948c9582-33b7-486d-889a-65c37267d98d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:16:50 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-20d91a37-7ab3-42a8-81c3-0225e98368e5 req-bcb30618-187b-4e9c-ae56-f3b52e7f549c service nova] Releasing lock "refresh_cache-39e6c635-4602-4ed6-abbd-80c96f056715" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:16:50 user nova-compute[74960]: DEBUG nova.compute.manager [None req-def79da1-a3da-487e-81b2-26d1246a119f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: 7769e3c5-136f-4282-8e3e-224e3a80922c] Allocating IP information in the background. {{(pid=74960) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 12:16:50 user nova-compute[74960]: DEBUG nova.network.neutron [None req-def79da1-a3da-487e-81b2-26d1246a119f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: 7769e3c5-136f-4282-8e3e-224e3a80922c] allocate_for_instance() {{(pid=74960) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 12:16:50 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-def79da1-a3da-487e-81b2-26d1246a119f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: 7769e3c5-136f-4282-8e3e-224e3a80922c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 12:16:50 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-1fcfc153-b24b-4c09-91d4-cce01b3db0b5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e5ec97f-80c4-4499-94bf-2584fc0eae03/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:16:50 user nova-compute[74960]: DEBUG nova.virt.disk.api [None req-1fcfc153-b24b-4c09-91d4-cce01b3db0b5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Cannot resize image /opt/stack/data/nova/instances/7e5ec97f-80c4-4499-94bf-2584fc0eae03/disk to a smaller size. {{(pid=74960) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 12:16:50 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-1fcfc153-b24b-4c09-91d4-cce01b3db0b5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Created local disks {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 12:16:50 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-1fcfc153-b24b-4c09-91d4-cce01b3db0b5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Ensure instance console log exists: /opt/stack/data/nova/instances/7e5ec97f-80c4-4499-94bf-2584fc0eae03/console.log {{(pid=74960) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 12:16:50 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-1fcfc153-b24b-4c09-91d4-cce01b3db0b5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:16:50 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-1fcfc153-b24b-4c09-91d4-cce01b3db0b5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:16:50 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-1fcfc153-b24b-4c09-91d4-cce01b3db0b5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:16:50 user nova-compute[74960]: DEBUG nova.compute.manager [None req-def79da1-a3da-487e-81b2-26d1246a119f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: 7769e3c5-136f-4282-8e3e-224e3a80922c] Start building block device mappings for instance. {{(pid=74960) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 12:16:50 user nova-compute[74960]: DEBUG nova.compute.manager [None req-def79da1-a3da-487e-81b2-26d1246a119f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: 7769e3c5-136f-4282-8e3e-224e3a80922c] Start spawning the instance on the hypervisor. {{(pid=74960) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 12:16:50 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-def79da1-a3da-487e-81b2-26d1246a119f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: 7769e3c5-136f-4282-8e3e-224e3a80922c] Creating instance directory {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 12:16:50 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-def79da1-a3da-487e-81b2-26d1246a119f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: 7769e3c5-136f-4282-8e3e-224e3a80922c] Creating image(s)
Nov 03 12:16:50 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-def79da1-a3da-487e-81b2-26d1246a119f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Acquiring lock "/opt/stack/data/nova/instances/7769e3c5-136f-4282-8e3e-224e3a80922c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:16:50 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-def79da1-a3da-487e-81b2-26d1246a119f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Lock "/opt/stack/data/nova/instances/7769e3c5-136f-4282-8e3e-224e3a80922c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:16:50 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-def79da1-a3da-487e-81b2-26d1246a119f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Lock "/opt/stack/data/nova/instances/7769e3c5-136f-4282-8e3e-224e3a80922c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:16:50 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-def79da1-a3da-487e-81b2-26d1246a119f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:16:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-def79da1-a3da-487e-81b2-26d1246a119f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.184s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:16:51 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-def79da1-a3da-487e-81b2-26d1246a119f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Acquiring lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:16:51 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-def79da1-a3da-487e-81b2-26d1246a119f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:16:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-def79da1-a3da-487e-81b2-26d1246a119f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:16:51 user nova-compute[74960]: DEBUG nova.policy [None req-def79da1-a3da-487e-81b2-26d1246a119f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '60d8d224d7204ede84c09433a3d82d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5320673ee4f0422989a3708915375cdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74960) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 12:16:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-def79da1-a3da-487e-81b2-26d1246a119f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.271s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:16:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-def79da1-a3da-487e-81b2-26d1246a119f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910,backing_fmt=raw /opt/stack/data/nova/instances/7769e3c5-136f-4282-8e3e-224e3a80922c/disk 1073741824 {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:16:51 user sudo[84236]: pam_unix(sudo:session): session closed for user root
Nov 03 12:16:51 user nova-compute[74960]: INFO oslo.privsep.daemon [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Spawned new privsep daemon via rootwrap
Nov 03 12:16:51 user nova-compute[74960]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 03 12:16:51 user nova-compute[74960]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 03 12:16:51 user nova-compute[74960]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Nov 03 12:16:51 user nova-compute[74960]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84260
Nov 03 12:16:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-def79da1-a3da-487e-81b2-26d1246a119f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910,backing_fmt=raw /opt/stack/data/nova/instances/7769e3c5-136f-4282-8e3e-224e3a80922c/disk 1073741824" returned: 0 in 0.083s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:16:51 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-def79da1-a3da-487e-81b2-26d1246a119f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.357s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:16:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-def79da1-a3da-487e-81b2-26d1246a119f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:16:51 user nova-compute[74960]: DEBUG nova.network.neutron [None req-1fcfc153-b24b-4c09-91d4-cce01b3db0b5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Successfully created port: e91b8148-e2ff-4124-9799-ba4efae837ff {{(pid=74960) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 12:16:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-def79da1-a3da-487e-81b2-26d1246a119f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.159s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:16:51 user nova-compute[74960]: DEBUG nova.virt.disk.api [None req-def79da1-a3da-487e-81b2-26d1246a119f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7769e3c5-136f-4282-8e3e-224e3a80922c/disk. size=1073741824 {{(pid=74960) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 12:16:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-def79da1-a3da-487e-81b2-26d1246a119f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7769e3c5-136f-4282-8e3e-224e3a80922c/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:16:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-def79da1-a3da-487e-81b2-26d1246a119f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7769e3c5-136f-4282-8e3e-224e3a80922c/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:16:51 user nova-compute[74960]: DEBUG nova.virt.disk.api [None req-def79da1-a3da-487e-81b2-26d1246a119f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Cannot resize image /opt/stack/data/nova/instances/7769e3c5-136f-4282-8e3e-224e3a80922c/disk to a smaller size. {{(pid=74960) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 12:16:51 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-def79da1-a3da-487e-81b2-26d1246a119f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: 7769e3c5-136f-4282-8e3e-224e3a80922c] Created local disks {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 12:16:51 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-def79da1-a3da-487e-81b2-26d1246a119f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: 7769e3c5-136f-4282-8e3e-224e3a80922c] Ensure instance console log exists: /opt/stack/data/nova/instances/7769e3c5-136f-4282-8e3e-224e3a80922c/console.log {{(pid=74960) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 12:16:51 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-def79da1-a3da-487e-81b2-26d1246a119f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:16:51 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-def79da1-a3da-487e-81b2-26d1246a119f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:16:51 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-def79da1-a3da-487e-81b2-26d1246a119f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:16:52 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:16:52 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap948c9582-33, may_exist=True, interface_attrs={}) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:16:52 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap948c9582-33, col_values=(('qos', UUID('da44b5eb-caf3-461d-be11-28f17cd58808')),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:16:52 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap948c9582-33, col_values=(('external_ids', {'iface-id': '948c9582-33b7-486d-889a-65c37267d98d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7c:0d:76', 'vm-uuid': '39e6c635-4602-4ed6-abbd-80c96f056715'}),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:16:52 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:16:52 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:16:52 user nova-compute[74960]: INFO os_vif [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:0d:76,bridge_name='br-int',has_traffic_filtering=True,id=948c9582-33b7-486d-889a-65c37267d98d,network=Network(accc48f4-76c2-486d-9494-27f72e339655),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap948c9582-33')
Nov 03 12:16:52 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] No BDM found with device name vda, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:16:52 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] No VIF found with MAC fa:16:3e:7c:0d:76, not building metadata {{(pid=74960) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 12:16:52 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:16:52 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:16:52 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:16:52 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:16:53 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:16:53 user nova-compute[74960]: DEBUG nova.network.neutron [None req-1fcfc153-b24b-4c09-91d4-cce01b3db0b5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Successfully updated port: e91b8148-e2ff-4124-9799-ba4efae837ff {{(pid=74960) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 12:16:53 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-1fcfc153-b24b-4c09-91d4-cce01b3db0b5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Acquiring lock "refresh_cache-7e5ec97f-80c4-4499-94bf-2584fc0eae03" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:16:53 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-1fcfc153-b24b-4c09-91d4-cce01b3db0b5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Acquired lock "refresh_cache-7e5ec97f-80c4-4499-94bf-2584fc0eae03" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:16:53 user nova-compute[74960]: DEBUG nova.network.neutron [None req-1fcfc153-b24b-4c09-91d4-cce01b3db0b5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Building network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 12:16:53 user nova-compute[74960]: DEBUG nova.network.neutron [None req-def79da1-a3da-487e-81b2-26d1246a119f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: 7769e3c5-136f-4282-8e3e-224e3a80922c] Successfully created port: 8fe46c5c-9093-43c4-8b0d-baf325c2e18b {{(pid=74960) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 12:16:53 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:16:53 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:16:53 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:16:53 user nova-compute[74960]: DEBUG nova.network.neutron [None req-1fcfc153-b24b-4c09-91d4-cce01b3db0b5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Instance cache missing network info. {{(pid=74960) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 12:16:53 user nova-compute[74960]: DEBUG nova.compute.manager [req-367823f8-e543-494f-99cf-74ca537ce4c9 req-3476dceb-0bd4-4e81-a2bd-0562ae9983d7 service nova] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Received event network-changed-e91b8148-e2ff-4124-9799-ba4efae837ff {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:16:53 user nova-compute[74960]: DEBUG nova.compute.manager [req-367823f8-e543-494f-99cf-74ca537ce4c9 req-3476dceb-0bd4-4e81-a2bd-0562ae9983d7 service nova] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Refreshing instance network info cache due to event network-changed-e91b8148-e2ff-4124-9799-ba4efae837ff. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 12:16:53 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-367823f8-e543-494f-99cf-74ca537ce4c9 req-3476dceb-0bd4-4e81-a2bd-0562ae9983d7 service nova] Acquiring lock "refresh_cache-7e5ec97f-80c4-4499-94bf-2584fc0eae03" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:16:54 user nova-compute[74960]: DEBUG nova.network.neutron [None req-1fcfc153-b24b-4c09-91d4-cce01b3db0b5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Updating instance_info_cache with network_info: [{"id": "e91b8148-e2ff-4124-9799-ba4efae837ff", "address": "fa:16:3e:40:35:d4", "network": {"id": "c03e854d-75a3-4e81-9cdf-f1139841266c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1632999031-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c216dd7629274eafbf0a5968ff2378a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape91b8148-e2", "ovs_interfaceid": "e91b8148-e2ff-4124-9799-ba4efae837ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:16:54 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-1fcfc153-b24b-4c09-91d4-cce01b3db0b5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Releasing lock "refresh_cache-7e5ec97f-80c4-4499-94bf-2584fc0eae03" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:16:54 user nova-compute[74960]: DEBUG nova.compute.manager [None req-1fcfc153-b24b-4c09-91d4-cce01b3db0b5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Instance network_info: |[{"id": "e91b8148-e2ff-4124-9799-ba4efae837ff", "address": "fa:16:3e:40:35:d4", "network": {"id": "c03e854d-75a3-4e81-9cdf-f1139841266c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1632999031-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c216dd7629274eafbf0a5968ff2378a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape91b8148-e2", "ovs_interfaceid": "e91b8148-e2ff-4124-9799-ba4efae837ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74960) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 12:16:54 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-367823f8-e543-494f-99cf-74ca537ce4c9 req-3476dceb-0bd4-4e81-a2bd-0562ae9983d7 service nova] Acquired lock "refresh_cache-7e5ec97f-80c4-4499-94bf-2584fc0eae03" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:16:54 user nova-compute[74960]: DEBUG nova.network.neutron [req-367823f8-e543-494f-99cf-74ca537ce4c9 req-3476dceb-0bd4-4e81-a2bd-0562ae9983d7 service nova] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Refreshing network info cache for port e91b8148-e2ff-4124-9799-ba4efae837ff {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 12:16:54 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-1fcfc153-b24b-4c09-91d4-cce01b3db0b5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Start _get_guest_xml network_info=[{"id": "e91b8148-e2ff-4124-9799-ba4efae837ff", "address": "fa:16:3e:40:35:d4", "network": {"id": "c03e854d-75a3-4e81-9cdf-f1139841266c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1632999031-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c216dd7629274eafbf0a5968ff2378a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape91b8148-e2", "ovs_interfaceid": "e91b8148-e2ff-4124-9799-ba4efae837ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=549f51ba-ac69-494b-8de1-34635aa2d7cf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='63ee9c80c632442fb0379f47b784bd20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T12:13:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'image_id': '549f51ba-ac69-494b-8de1-34635aa2d7cf'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 12:16:55 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-1fcfc153-b24b-4c09-91d4-cce01b3db0b5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:16:55 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-1fcfc153-b24b-4c09-91d4-cce01b3db0b5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:16:55 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-1fcfc153-b24b-4c09-91d4-cce01b3db0b5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 12:16:55 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-1fcfc153-b24b-4c09-91d4-cce01b3db0b5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] CPU controller missing on host. {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 12:16:55 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-1fcfc153-b24b-4c09-91d4-cce01b3db0b5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 12:16:55 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-1fcfc153-b24b-4c09-91d4-cce01b3db0b5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] CPU controller found on host. {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 12:16:55 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-1fcfc153-b24b-4c09-91d4-cce01b3db0b5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74960) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 12:16:55 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-1fcfc153-b24b-4c09-91d4-cce01b3db0b5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=549f51ba-ac69-494b-8de1-34635aa2d7cf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='63ee9c80c632442fb0379f47b784bd20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T12:13:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 12:16:55 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-1fcfc153-b24b-4c09-91d4-cce01b3db0b5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Flavor limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 12:16:55 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-1fcfc153-b24b-4c09-91d4-cce01b3db0b5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Image limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 12:16:55 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-1fcfc153-b24b-4c09-91d4-cce01b3db0b5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Flavor pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 12:16:55 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-1fcfc153-b24b-4c09-91d4-cce01b3db0b5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Image pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 12:16:55 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-1fcfc153-b24b-4c09-91d4-cce01b3db0b5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 12:16:55 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-1fcfc153-b24b-4c09-91d4-cce01b3db0b5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 12:16:55 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-1fcfc153-b24b-4c09-91d4-cce01b3db0b5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 12:16:55 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-1fcfc153-b24b-4c09-91d4-cce01b3db0b5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Got 1 possible topologies {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 12:16:55 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-1fcfc153-b24b-4c09-91d4-cce01b3db0b5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 12:16:55 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-1fcfc153-b24b-4c09-91d4-cce01b3db0b5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 12:16:55 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-1fcfc153-b24b-4c09-91d4-cce01b3db0b5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:16:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1395691218',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1395691218',id=2,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBORt24KiW0SvTfIC0cB1xZzGZhRsfKuon1UNTHIJ3rRPiaZtETCLFnldW9E15ZppsL+VgujOvzTcrAMfw0cF0wSfKUfWVBhncCb8D3gHhw/5cFu8NPOkNxszgCJRdkKvEg==',key_name='tempest-keypair-1234685962',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c216dd7629274eafbf0a5968ff2378a9',ramdisk_id='',reservation_id='r-36b8brxz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-258463843',owner_user_name='tempest-AttachVolumeShelveTestJSON-258463843-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:16:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fae69462930546bdb9cf6e2a11a0df2a',uuid=7e5ec97f-80c4-4499-94bf-2584fc0eae03,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e91b8148-e2ff-4124-9799-ba4efae837ff", "address": "fa:16:3e:40:35:d4", "network": {"id": "c03e854d-75a3-4e81-9cdf-f1139841266c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1632999031-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c216dd7629274eafbf0a5968ff2378a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape91b8148-e2", "ovs_interfaceid": "e91b8148-e2ff-4124-9799-ba4efae837ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74960) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 12:16:55 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-1fcfc153-b24b-4c09-91d4-cce01b3db0b5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Converting VIF {"id": "e91b8148-e2ff-4124-9799-ba4efae837ff", "address": "fa:16:3e:40:35:d4", "network": {"id": "c03e854d-75a3-4e81-9cdf-f1139841266c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1632999031-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c216dd7629274eafbf0a5968ff2378a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape91b8148-e2", "ovs_interfaceid": "e91b8148-e2ff-4124-9799-ba4efae837ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:16:55 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-1fcfc153-b24b-4c09-91d4-cce01b3db0b5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:35:d4,bridge_name='br-int',has_traffic_filtering=True,id=e91b8148-e2ff-4124-9799-ba4efae837ff,network=Network(c03e854d-75a3-4e81-9cdf-f1139841266c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape91b8148-e2') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:16:55 user nova-compute[74960]: DEBUG nova.objects.instance [None req-1fcfc153-b24b-4c09-91d4-cce01b3db0b5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Lazy-loading 'pci_devices' on Instance uuid 7e5ec97f-80c4-4499-94bf-2584fc0eae03 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:16:55 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-1fcfc153-b24b-4c09-91d4-cce01b3db0b5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] End _get_guest_xml xml=<domain type="kvm">
Nov 03 12:16:55 user nova-compute[74960]:   <uuid>7e5ec97f-80c4-4499-94bf-2584fc0eae03</uuid>
Nov 03 12:16:55 user nova-compute[74960]:   <name>instance-00000002</name>
Nov 03 12:16:55 user nova-compute[74960]:   <memory>524288</memory>
Nov 03 12:16:55 user nova-compute[74960]:   <vcpu>1</vcpu>
Nov 03 12:16:55 user nova-compute[74960]:   <metadata>
Nov 03 12:16:55 user nova-compute[74960]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 12:16:55 user nova-compute[74960]:       <nova:package version="0.0.0"/>
Nov 03 12:16:55 user nova-compute[74960]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1395691218</nova:name>
Nov 03 12:16:55 user nova-compute[74960]:       <nova:creationTime>2023-11-03 12:16:55</nova:creationTime>
Nov 03 12:16:55 user nova-compute[74960]:       <nova:flavor name="m1.tiny">
Nov 03 12:16:55 user nova-compute[74960]:         <nova:memory>512</nova:memory>
Nov 03 12:16:55 user nova-compute[74960]:         <nova:disk>1</nova:disk>
Nov 03 12:16:55 user nova-compute[74960]:         <nova:swap>0</nova:swap>
Nov 03 12:16:55 user nova-compute[74960]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 12:16:55 user nova-compute[74960]:         <nova:vcpus>1</nova:vcpus>
Nov 03 12:16:55 user nova-compute[74960]:       </nova:flavor>
Nov 03 12:16:55 user nova-compute[74960]:       <nova:owner>
Nov 03 12:16:55 user nova-compute[74960]:         <nova:user uuid="fae69462930546bdb9cf6e2a11a0df2a">tempest-AttachVolumeShelveTestJSON-258463843-project-member</nova:user>
Nov 03 12:16:55 user nova-compute[74960]:         <nova:project uuid="c216dd7629274eafbf0a5968ff2378a9">tempest-AttachVolumeShelveTestJSON-258463843</nova:project>
Nov 03 12:16:55 user nova-compute[74960]:       </nova:owner>
Nov 03 12:16:55 user nova-compute[74960]:       <nova:root type="image" uuid="549f51ba-ac69-494b-8de1-34635aa2d7cf"/>
Nov 03 12:16:55 user nova-compute[74960]:       <nova:ports>
Nov 03 12:16:55 user nova-compute[74960]:         <nova:port uuid="e91b8148-e2ff-4124-9799-ba4efae837ff">
Nov 03 12:16:55 user nova-compute[74960]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 03 12:16:55 user nova-compute[74960]:         </nova:port>
Nov 03 12:16:55 user nova-compute[74960]:       </nova:ports>
Nov 03 12:16:55 user nova-compute[74960]:     </nova:instance>
Nov 03 12:16:55 user nova-compute[74960]:   </metadata>
Nov 03 12:16:55 user nova-compute[74960]:   <sysinfo type="smbios">
Nov 03 12:16:55 user nova-compute[74960]:     <system>
Nov 03 12:16:55 user nova-compute[74960]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 12:16:55 user nova-compute[74960]:       <entry name="product">OpenStack Nova</entry>
Nov 03 12:16:55 user nova-compute[74960]:       <entry name="version">0.0.0</entry>
Nov 03 12:16:55 user nova-compute[74960]:       <entry name="serial">7e5ec97f-80c4-4499-94bf-2584fc0eae03</entry>
Nov 03 12:16:55 user nova-compute[74960]:       <entry name="uuid">7e5ec97f-80c4-4499-94bf-2584fc0eae03</entry>
Nov 03 12:16:55 user nova-compute[74960]:       <entry name="family">Virtual Machine</entry>
Nov 03 12:16:55 user nova-compute[74960]:     </system>
Nov 03 12:16:55 user nova-compute[74960]:   </sysinfo>
Nov 03 12:16:55 user nova-compute[74960]:   <os>
Nov 03 12:16:55 user nova-compute[74960]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 12:16:55 user nova-compute[74960]:     <boot dev="hd"/>
Nov 03 12:16:55 user nova-compute[74960]:     <smbios mode="sysinfo"/>
Nov 03 12:16:55 user nova-compute[74960]:   </os>
Nov 03 12:16:55 user nova-compute[74960]:   <features>
Nov 03 12:16:55 user nova-compute[74960]:     <acpi/>
Nov 03 12:16:55 user nova-compute[74960]:     <apic/>
Nov 03 12:16:55 user nova-compute[74960]:     <vmcoreinfo/>
Nov 03 12:16:55 user nova-compute[74960]:   </features>
Nov 03 12:16:55 user nova-compute[74960]:   <clock offset="utc">
Nov 03 12:16:55 user nova-compute[74960]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 12:16:55 user nova-compute[74960]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 12:16:55 user nova-compute[74960]:     <timer name="hpet" present="no"/>
Nov 03 12:16:55 user nova-compute[74960]:   </clock>
Nov 03 12:16:55 user nova-compute[74960]:   <cpu mode="custom" match="exact">
Nov 03 12:16:55 user nova-compute[74960]:     <model>Nehalem</model>
Nov 03 12:16:55 user nova-compute[74960]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 12:16:55 user nova-compute[74960]:   </cpu>
Nov 03 12:16:55 user nova-compute[74960]:   <devices>
Nov 03 12:16:55 user nova-compute[74960]:     <disk type="file" device="disk">
Nov 03 12:16:55 user nova-compute[74960]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 12:16:55 user nova-compute[74960]:       <source file="/opt/stack/data/nova/instances/7e5ec97f-80c4-4499-94bf-2584fc0eae03/disk"/>
Nov 03 12:16:55 user nova-compute[74960]:       <target dev="vda" bus="virtio"/>
Nov 03 12:16:55 user nova-compute[74960]:     </disk>
Nov 03 12:16:55 user nova-compute[74960]:     <interface type="ethernet">
Nov 03 12:16:55 user nova-compute[74960]:       <mac address="fa:16:3e:40:35:d4"/>
Nov 03 12:16:55 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:16:55 user nova-compute[74960]:       <mtu size="1442"/>
Nov 03 12:16:55 user nova-compute[74960]:       <target dev="tape91b8148-e2"/>
Nov 03 12:16:55 user nova-compute[74960]:     </interface>
Nov 03 12:16:55 user nova-compute[74960]:     <serial type="pty">
Nov 03 12:16:55 user nova-compute[74960]:       <log file="/opt/stack/data/nova/instances/7e5ec97f-80c4-4499-94bf-2584fc0eae03/console.log" append="off"/>
Nov 03 12:16:55 user nova-compute[74960]:     </serial>
Nov 03 12:16:55 user nova-compute[74960]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 12:16:55 user nova-compute[74960]:     <video>
Nov 03 12:16:55 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:16:55 user nova-compute[74960]:     </video>
Nov 03 12:16:55 user nova-compute[74960]:     <rng model="virtio">
Nov 03 12:16:55 user nova-compute[74960]:       <backend model="random">/dev/urandom</backend>
Nov 03 12:16:55 user nova-compute[74960]:     </rng>
Nov 03 12:16:55 user nova-compute[74960]:     <controller type="usb" index="0" model="none"/>
Nov 03 12:16:55 user nova-compute[74960]:     <memballoon model="virtio">
Nov 03 12:16:55 user nova-compute[74960]:       <stats period="10"/>
Nov 03 12:16:55 user nova-compute[74960]:     </memballoon>
Nov 03 12:16:55 user nova-compute[74960]:   </devices>
Nov 03 12:16:55 user nova-compute[74960]: </domain>
Nov 03 12:16:55 user nova-compute[74960]:  {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 12:16:55 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-1fcfc153-b24b-4c09-91d4-cce01b3db0b5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:16:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1395691218',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1395691218',id=2,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBORt24KiW0SvTfIC0cB1xZzGZhRsfKuon1UNTHIJ3rRPiaZtETCLFnldW9E15ZppsL+VgujOvzTcrAMfw0cF0wSfKUfWVBhncCb8D3gHhw/5cFu8NPOkNxszgCJRdkKvEg==',key_name='tempest-keypair-1234685962',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c216dd7629274eafbf0a5968ff2378a9',ramdisk_id='',reservation_id='r-36b8brxz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-258463843',owner_user_name='tempest-AttachVolumeShelveTestJSON-258463843-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:16:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fae69462930546bdb9cf6e2a11a0df2a',uuid=7e5ec97f-80c4-4499-94bf-2584fc0eae03,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e91b8148-e2ff-4124-9799-ba4efae837ff", "address": "fa:16:3e:40:35:d4", "network": {"id": "c03e854d-75a3-4e81-9cdf-f1139841266c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1632999031-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c216dd7629274eafbf0a5968ff2378a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape91b8148-e2", "ovs_interfaceid": "e91b8148-e2ff-4124-9799-ba4efae837ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 12:16:55 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-1fcfc153-b24b-4c09-91d4-cce01b3db0b5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Converting VIF {"id": "e91b8148-e2ff-4124-9799-ba4efae837ff", "address": "fa:16:3e:40:35:d4", "network": {"id": "c03e854d-75a3-4e81-9cdf-f1139841266c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1632999031-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c216dd7629274eafbf0a5968ff2378a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape91b8148-e2", "ovs_interfaceid": "e91b8148-e2ff-4124-9799-ba4efae837ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:16:55 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-1fcfc153-b24b-4c09-91d4-cce01b3db0b5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:35:d4,bridge_name='br-int',has_traffic_filtering=True,id=e91b8148-e2ff-4124-9799-ba4efae837ff,network=Network(c03e854d-75a3-4e81-9cdf-f1139841266c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape91b8148-e2') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:16:55 user nova-compute[74960]: DEBUG os_vif [None req-1fcfc153-b24b-4c09-91d4-cce01b3db0b5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:35:d4,bridge_name='br-int',has_traffic_filtering=True,id=e91b8148-e2ff-4124-9799-ba4efae837ff,network=Network(c03e854d-75a3-4e81-9cdf-f1139841266c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape91b8148-e2') {{(pid=74960) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 12:16:55 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:16:55 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:16:55 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 12:16:55 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:16:55 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'df4a411b-2343-57e4-88d3-068c1c8814a2', '_type': 'linux-noop'}}, row=False) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:16:55 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:16:55 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:16:55 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:16:55 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape91b8148-e2, may_exist=True, interface_attrs={}) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:16:55 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape91b8148-e2, col_values=(('qos', UUID('17457a02-8e72-4592-b7b2-9ffa553f2004')),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:16:55 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape91b8148-e2, col_values=(('external_ids', {'iface-id': 'e91b8148-e2ff-4124-9799-ba4efae837ff', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:40:35:d4', 'vm-uuid': '7e5ec97f-80c4-4499-94bf-2584fc0eae03'}),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:16:55 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:16:55 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:16:55 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:16:55 user nova-compute[74960]: INFO os_vif [None req-1fcfc153-b24b-4c09-91d4-cce01b3db0b5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:35:d4,bridge_name='br-int',has_traffic_filtering=True,id=e91b8148-e2ff-4124-9799-ba4efae837ff,network=Network(c03e854d-75a3-4e81-9cdf-f1139841266c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape91b8148-e2')
Nov 03 12:16:55 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-1fcfc153-b24b-4c09-91d4-cce01b3db0b5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] No BDM found with device name vda, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:16:55 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-1fcfc153-b24b-4c09-91d4-cce01b3db0b5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] No VIF found with MAC fa:16:3e:40:35:d4, not building metadata {{(pid=74960) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 12:16:55 user nova-compute[74960]: DEBUG nova.compute.manager [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] [instance: 39e6c635-4602-4ed6-abbd-80c96f056715] Instance event wait completed in 0 seconds for  {{(pid=74960) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 12:16:55 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] [instance: 39e6c635-4602-4ed6-abbd-80c96f056715] Guest created on hypervisor {{(pid=74960) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 12:16:55 user nova-compute[74960]: DEBUG nova.network.neutron [None req-def79da1-a3da-487e-81b2-26d1246a119f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: 7769e3c5-136f-4282-8e3e-224e3a80922c] Successfully updated port: 8fe46c5c-9093-43c4-8b0d-baf325c2e18b {{(pid=74960) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 12:16:55 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: 39e6c635-4602-4ed6-abbd-80c96f056715] Instance spawned successfully.
Nov 03 12:16:55 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] [instance: 39e6c635-4602-4ed6-abbd-80c96f056715] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 12:16:55 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-def79da1-a3da-487e-81b2-26d1246a119f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Acquiring lock "refresh_cache-7769e3c5-136f-4282-8e3e-224e3a80922c" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:16:55 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-def79da1-a3da-487e-81b2-26d1246a119f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Acquired lock "refresh_cache-7769e3c5-136f-4282-8e3e-224e3a80922c" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:16:55 user nova-compute[74960]: DEBUG nova.network.neutron [None req-def79da1-a3da-487e-81b2-26d1246a119f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: 7769e3c5-136f-4282-8e3e-224e3a80922c] Building network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 12:16:55 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] [instance: 39e6c635-4602-4ed6-abbd-80c96f056715] Found default for hw_cdrom_bus of ide {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:16:55 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] [instance: 39e6c635-4602-4ed6-abbd-80c96f056715] Found default for hw_disk_bus of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:16:55 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] [instance: 39e6c635-4602-4ed6-abbd-80c96f056715] Found default for hw_input_bus of None {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:16:55 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] [instance: 39e6c635-4602-4ed6-abbd-80c96f056715] Found default for hw_pointer_model of None {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:16:55 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] [instance: 39e6c635-4602-4ed6-abbd-80c96f056715] Found default for hw_video_model of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:16:55 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] [instance: 39e6c635-4602-4ed6-abbd-80c96f056715] Found default for hw_vif_model of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:16:55 user nova-compute[74960]: DEBUG nova.compute.manager [req-40c7387c-7cde-4bf6-a380-9016e6c24a1c req-709a7889-0e7d-4fb2-b548-1b6d185153bf service nova] [instance: 7769e3c5-136f-4282-8e3e-224e3a80922c] Received event network-changed-8fe46c5c-9093-43c4-8b0d-baf325c2e18b {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:16:55 user nova-compute[74960]: DEBUG nova.compute.manager [req-40c7387c-7cde-4bf6-a380-9016e6c24a1c req-709a7889-0e7d-4fb2-b548-1b6d185153bf service nova] [instance: 7769e3c5-136f-4282-8e3e-224e3a80922c] Refreshing instance network info cache due to event network-changed-8fe46c5c-9093-43c4-8b0d-baf325c2e18b. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 12:16:55 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-40c7387c-7cde-4bf6-a380-9016e6c24a1c req-709a7889-0e7d-4fb2-b548-1b6d185153bf service nova] Acquiring lock "refresh_cache-7769e3c5-136f-4282-8e3e-224e3a80922c" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:16:55 user nova-compute[74960]: DEBUG nova.network.neutron [None req-def79da1-a3da-487e-81b2-26d1246a119f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: 7769e3c5-136f-4282-8e3e-224e3a80922c] Instance cache missing network info. {{(pid=74960) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 12:16:55 user nova-compute[74960]: INFO nova.compute.manager [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] [instance: 39e6c635-4602-4ed6-abbd-80c96f056715] Took 13.71 seconds to spawn the instance on the hypervisor.
Nov 03 12:16:55 user nova-compute[74960]: DEBUG nova.compute.manager [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] [instance: 39e6c635-4602-4ed6-abbd-80c96f056715] Checking state {{(pid=74960) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 12:16:55 user nova-compute[74960]: INFO nova.compute.manager [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] [instance: 39e6c635-4602-4ed6-abbd-80c96f056715] Took 15.11 seconds to build instance.
Nov 03 12:16:55 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-f54dceeb-07e1-4a8c-bffa-87465c72897c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Lock "39e6c635-4602-4ed6-abbd-80c96f056715" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.412s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:16:55 user nova-compute[74960]: DEBUG nova.network.neutron [None req-def79da1-a3da-487e-81b2-26d1246a119f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: 7769e3c5-136f-4282-8e3e-224e3a80922c] Updating instance_info_cache with network_info: [{"id": "8fe46c5c-9093-43c4-8b0d-baf325c2e18b", "address": "fa:16:3e:ba:d5:3a", "network": {"id": "9c5fae09-5df5-45a3-b9cd-7ac3763ba878", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1736223258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5320673ee4f0422989a3708915375cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fe46c5c-90", "ovs_interfaceid": "8fe46c5c-9093-43c4-8b0d-baf325c2e18b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:16:55 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-def79da1-a3da-487e-81b2-26d1246a119f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Releasing lock "refresh_cache-7769e3c5-136f-4282-8e3e-224e3a80922c" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:16:55 user nova-compute[74960]: DEBUG nova.compute.manager [None req-def79da1-a3da-487e-81b2-26d1246a119f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: 7769e3c5-136f-4282-8e3e-224e3a80922c] Instance network_info: |[{"id": "8fe46c5c-9093-43c4-8b0d-baf325c2e18b", "address": "fa:16:3e:ba:d5:3a", "network": {"id": "9c5fae09-5df5-45a3-b9cd-7ac3763ba878", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1736223258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5320673ee4f0422989a3708915375cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fe46c5c-90", "ovs_interfaceid": "8fe46c5c-9093-43c4-8b0d-baf325c2e18b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74960) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 12:16:55 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-40c7387c-7cde-4bf6-a380-9016e6c24a1c req-709a7889-0e7d-4fb2-b548-1b6d185153bf service nova] Acquired lock "refresh_cache-7769e3c5-136f-4282-8e3e-224e3a80922c" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:16:55 user nova-compute[74960]: DEBUG nova.network.neutron [req-40c7387c-7cde-4bf6-a380-9016e6c24a1c req-709a7889-0e7d-4fb2-b548-1b6d185153bf service nova] [instance: 7769e3c5-136f-4282-8e3e-224e3a80922c] Refreshing network info cache for port 8fe46c5c-9093-43c4-8b0d-baf325c2e18b {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 12:16:55 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-def79da1-a3da-487e-81b2-26d1246a119f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: 7769e3c5-136f-4282-8e3e-224e3a80922c] Start _get_guest_xml network_info=[{"id": "8fe46c5c-9093-43c4-8b0d-baf325c2e18b", "address": "fa:16:3e:ba:d5:3a", "network": {"id": "9c5fae09-5df5-45a3-b9cd-7ac3763ba878", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1736223258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5320673ee4f0422989a3708915375cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fe46c5c-90", "ovs_interfaceid": "8fe46c5c-9093-43c4-8b0d-baf325c2e18b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=549f51ba-ac69-494b-8de1-34635aa2d7cf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='63ee9c80c632442fb0379f47b784bd20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T12:13:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'image_id': '549f51ba-ac69-494b-8de1-34635aa2d7cf'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 12:16:55 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-def79da1-a3da-487e-81b2-26d1246a119f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:16:55 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-def79da1-a3da-487e-81b2-26d1246a119f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:16:55 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-def79da1-a3da-487e-81b2-26d1246a119f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 12:16:55 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-def79da1-a3da-487e-81b2-26d1246a119f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] CPU controller missing on host. {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 12:16:55 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-def79da1-a3da-487e-81b2-26d1246a119f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 12:16:55 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-def79da1-a3da-487e-81b2-26d1246a119f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] CPU controller found on host. {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 12:16:55 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-def79da1-a3da-487e-81b2-26d1246a119f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74960) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 12:16:55 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-def79da1-a3da-487e-81b2-26d1246a119f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=549f51ba-ac69-494b-8de1-34635aa2d7cf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='63ee9c80c632442fb0379f47b784bd20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T12:13:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 12:16:55 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-def79da1-a3da-487e-81b2-26d1246a119f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Flavor limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 12:16:55 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-def79da1-a3da-487e-81b2-26d1246a119f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Image limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 12:16:55 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-def79da1-a3da-487e-81b2-26d1246a119f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Flavor pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 12:16:55 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-def79da1-a3da-487e-81b2-26d1246a119f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Image pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 12:16:55 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-def79da1-a3da-487e-81b2-26d1246a119f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 12:16:55 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-def79da1-a3da-487e-81b2-26d1246a119f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 12:16:55 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-def79da1-a3da-487e-81b2-26d1246a119f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 12:16:55 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-def79da1-a3da-487e-81b2-26d1246a119f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Got 1 possible topologies {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 12:16:55 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-def79da1-a3da-487e-81b2-26d1246a119f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 12:16:55 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-def79da1-a3da-487e-81b2-26d1246a119f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 12:16:55 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-def79da1-a3da-487e-81b2-26d1246a119f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:16:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1764770627',display_name='tempest-ServerActionsTestOtherA-server-1764770627',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1764770627',id=3,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPAz3yp3EJUzWOfLmandSosNLGmmwlB9ouRsIIfsq3JGgx5t4USdyA4JVa+9y90auzNv5yGmALwIZZVdM/LzHirlYfhZGk/2geYmtQFtCuY7KHcICqsra/ZIlPsAiI2BYw==',key_name='tempest-keypair-1847755946',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5320673ee4f0422989a3708915375cdb',ramdisk_id='',reservation_id='r-mv8ko31k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1651581249',owner_user_name='tempest-ServerActionsTestOtherA-1651581249-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:16:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60d8d224d7204ede84c09433a3d82d0f',uuid=7769e3c5-136f-4282-8e3e-224e3a80922c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8fe46c5c-9093-43c4-8b0d-baf325c2e18b", "address": "fa:16:3e:ba:d5:3a", "network": {"id": "9c5fae09-5df5-45a3-b9cd-7ac3763ba878", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1736223258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5320673ee4f0422989a3708915375cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fe46c5c-90", "ovs_interfaceid": "8fe46c5c-9093-43c4-8b0d-baf325c2e18b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74960) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 12:16:55 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-def79da1-a3da-487e-81b2-26d1246a119f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Converting VIF {"id": "8fe46c5c-9093-43c4-8b0d-baf325c2e18b", "address": "fa:16:3e:ba:d5:3a", "network": {"id": "9c5fae09-5df5-45a3-b9cd-7ac3763ba878", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1736223258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5320673ee4f0422989a3708915375cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fe46c5c-90", "ovs_interfaceid": "8fe46c5c-9093-43c4-8b0d-baf325c2e18b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:16:55 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-def79da1-a3da-487e-81b2-26d1246a119f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:d5:3a,bridge_name='br-int',has_traffic_filtering=True,id=8fe46c5c-9093-43c4-8b0d-baf325c2e18b,network=Network(9c5fae09-5df5-45a3-b9cd-7ac3763ba878),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fe46c5c-90') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:16:55 user nova-compute[74960]: DEBUG nova.objects.instance [None req-def79da1-a3da-487e-81b2-26d1246a119f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Lazy-loading 'pci_devices' on Instance uuid 7769e3c5-136f-4282-8e3e-224e3a80922c {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:16:55 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-def79da1-a3da-487e-81b2-26d1246a119f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: 7769e3c5-136f-4282-8e3e-224e3a80922c] End _get_guest_xml xml=<domain type="kvm">
Nov 03 12:16:55 user nova-compute[74960]:   <uuid>7769e3c5-136f-4282-8e3e-224e3a80922c</uuid>
Nov 03 12:16:55 user nova-compute[74960]:   <name>instance-00000003</name>
Nov 03 12:16:55 user nova-compute[74960]:   <memory>524288</memory>
Nov 03 12:16:55 user nova-compute[74960]:   <vcpu>1</vcpu>
Nov 03 12:16:55 user nova-compute[74960]:   <metadata>
Nov 03 12:16:55 user nova-compute[74960]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 12:16:55 user nova-compute[74960]:       <nova:package version="0.0.0"/>
Nov 03 12:16:55 user nova-compute[74960]:       <nova:name>tempest-ServerActionsTestOtherA-server-1764770627</nova:name>
Nov 03 12:16:55 user nova-compute[74960]:       <nova:creationTime>2023-11-03 12:16:55</nova:creationTime>
Nov 03 12:16:55 user nova-compute[74960]:       <nova:flavor name="m1.tiny">
Nov 03 12:16:55 user nova-compute[74960]:         <nova:memory>512</nova:memory>
Nov 03 12:16:55 user nova-compute[74960]:         <nova:disk>1</nova:disk>
Nov 03 12:16:55 user nova-compute[74960]:         <nova:swap>0</nova:swap>
Nov 03 12:16:55 user nova-compute[74960]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 12:16:55 user nova-compute[74960]:         <nova:vcpus>1</nova:vcpus>
Nov 03 12:16:55 user nova-compute[74960]:       </nova:flavor>
Nov 03 12:16:55 user nova-compute[74960]:       <nova:owner>
Nov 03 12:16:55 user nova-compute[74960]:         <nova:user uuid="60d8d224d7204ede84c09433a3d82d0f">tempest-ServerActionsTestOtherA-1651581249-project-member</nova:user>
Nov 03 12:16:55 user nova-compute[74960]:         <nova:project uuid="5320673ee4f0422989a3708915375cdb">tempest-ServerActionsTestOtherA-1651581249</nova:project>
Nov 03 12:16:55 user nova-compute[74960]:       </nova:owner>
Nov 03 12:16:55 user nova-compute[74960]:       <nova:root type="image" uuid="549f51ba-ac69-494b-8de1-34635aa2d7cf"/>
Nov 03 12:16:55 user nova-compute[74960]:       <nova:ports>
Nov 03 12:16:55 user nova-compute[74960]:         <nova:port uuid="8fe46c5c-9093-43c4-8b0d-baf325c2e18b">
Nov 03 12:16:55 user nova-compute[74960]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 03 12:16:55 user nova-compute[74960]:         </nova:port>
Nov 03 12:16:55 user nova-compute[74960]:       </nova:ports>
Nov 03 12:16:55 user nova-compute[74960]:     </nova:instance>
Nov 03 12:16:55 user nova-compute[74960]:   </metadata>
Nov 03 12:16:55 user nova-compute[74960]:   <sysinfo type="smbios">
Nov 03 12:16:55 user nova-compute[74960]:     <system>
Nov 03 12:16:55 user nova-compute[74960]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 12:16:55 user nova-compute[74960]:       <entry name="product">OpenStack Nova</entry>
Nov 03 12:16:55 user nova-compute[74960]:       <entry name="version">0.0.0</entry>
Nov 03 12:16:55 user nova-compute[74960]:       <entry name="serial">7769e3c5-136f-4282-8e3e-224e3a80922c</entry>
Nov 03 12:16:55 user nova-compute[74960]:       <entry name="uuid">7769e3c5-136f-4282-8e3e-224e3a80922c</entry>
Nov 03 12:16:55 user nova-compute[74960]:       <entry name="family">Virtual Machine</entry>
Nov 03 12:16:55 user nova-compute[74960]:     </system>
Nov 03 12:16:55 user nova-compute[74960]:   </sysinfo>
Nov 03 12:16:55 user nova-compute[74960]:   <os>
Nov 03 12:16:55 user nova-compute[74960]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 12:16:55 user nova-compute[74960]:     <boot dev="hd"/>
Nov 03 12:16:55 user nova-compute[74960]:     <smbios mode="sysinfo"/>
Nov 03 12:16:55 user nova-compute[74960]:   </os>
Nov 03 12:16:55 user nova-compute[74960]:   <features>
Nov 03 12:16:55 user nova-compute[74960]:     <acpi/>
Nov 03 12:16:55 user nova-compute[74960]:     <apic/>
Nov 03 12:16:55 user nova-compute[74960]:     <vmcoreinfo/>
Nov 03 12:16:55 user nova-compute[74960]:   </features>
Nov 03 12:16:55 user nova-compute[74960]:   <clock offset="utc">
Nov 03 12:16:55 user nova-compute[74960]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 12:16:55 user nova-compute[74960]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 12:16:55 user nova-compute[74960]:     <timer name="hpet" present="no"/>
Nov 03 12:16:55 user nova-compute[74960]:   </clock>
Nov 03 12:16:55 user nova-compute[74960]:   <cpu mode="custom" match="exact">
Nov 03 12:16:55 user nova-compute[74960]:     <model>Nehalem</model>
Nov 03 12:16:55 user nova-compute[74960]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 12:16:55 user nova-compute[74960]:   </cpu>
Nov 03 12:16:55 user nova-compute[74960]:   <devices>
Nov 03 12:16:55 user nova-compute[74960]:     <disk type="file" device="disk">
Nov 03 12:16:55 user nova-compute[74960]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 12:16:55 user nova-compute[74960]:       <source file="/opt/stack/data/nova/instances/7769e3c5-136f-4282-8e3e-224e3a80922c/disk"/>
Nov 03 12:16:55 user nova-compute[74960]:       <target dev="vda" bus="virtio"/>
Nov 03 12:16:55 user nova-compute[74960]:     </disk>
Nov 03 12:16:55 user nova-compute[74960]:     <interface type="ethernet">
Nov 03 12:16:55 user nova-compute[74960]:       <mac address="fa:16:3e:ba:d5:3a"/>
Nov 03 12:16:55 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:16:55 user nova-compute[74960]:       <mtu size="1442"/>
Nov 03 12:16:55 user nova-compute[74960]:       <target dev="tap8fe46c5c-90"/>
Nov 03 12:16:55 user nova-compute[74960]:     </interface>
Nov 03 12:16:55 user nova-compute[74960]:     <serial type="pty">
Nov 03 12:16:55 user nova-compute[74960]:       <log file="/opt/stack/data/nova/instances/7769e3c5-136f-4282-8e3e-224e3a80922c/console.log" append="off"/>
Nov 03 12:16:55 user nova-compute[74960]:     </serial>
Nov 03 12:16:55 user nova-compute[74960]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 12:16:55 user nova-compute[74960]:     <video>
Nov 03 12:16:55 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:16:55 user nova-compute[74960]:     </video>
Nov 03 12:16:55 user nova-compute[74960]:     <rng model="virtio">
Nov 03 12:16:55 user nova-compute[74960]:       <backend model="random">/dev/urandom</backend>
Nov 03 12:16:55 user nova-compute[74960]:     </rng>
Nov 03 12:16:55 user nova-compute[74960]:     <controller type="usb" index="0" model="none"/>
Nov 03 12:16:55 user nova-compute[74960]:     <memballoon model="virtio">
Nov 03 12:16:55 user nova-compute[74960]:       <stats period="10"/>
Nov 03 12:16:55 user nova-compute[74960]:     </memballoon>
Nov 03 12:16:55 user nova-compute[74960]:   </devices>
Nov 03 12:16:55 user nova-compute[74960]: </domain>
Nov 03 12:16:55 user nova-compute[74960]:  {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 12:16:55 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-def79da1-a3da-487e-81b2-26d1246a119f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:16:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1764770627',display_name='tempest-ServerActionsTestOtherA-server-1764770627',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1764770627',id=3,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPAz3yp3EJUzWOfLmandSosNLGmmwlB9ouRsIIfsq3JGgx5t4USdyA4JVa+9y90auzNv5yGmALwIZZVdM/LzHirlYfhZGk/2geYmtQFtCuY7KHcICqsra/ZIlPsAiI2BYw==',key_name='tempest-keypair-1847755946',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5320673ee4f0422989a3708915375cdb',ramdisk_id='',reservation_id='r-mv8ko31k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1651581249',owner_user_name='tempest-ServerActionsTestOtherA-1651581249-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:16:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60d8d224d7204ede84c09433a3d82d0f',uuid=7769e3c5-136f-4282-8e3e-224e3a80922c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8fe46c5c-9093-43c4-8b0d-baf325c2e18b", "address": "fa:16:3e:ba:d5:3a", "network": {"id": "9c5fae09-5df5-45a3-b9cd-7ac3763ba878", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1736223258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5320673ee4f0422989a3708915375cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fe46c5c-90", "ovs_interfaceid": "8fe46c5c-9093-43c4-8b0d-baf325c2e18b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 12:16:55 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-def79da1-a3da-487e-81b2-26d1246a119f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Converting VIF {"id": "8fe46c5c-9093-43c4-8b0d-baf325c2e18b", "address": "fa:16:3e:ba:d5:3a", "network": {"id": "9c5fae09-5df5-45a3-b9cd-7ac3763ba878", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1736223258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5320673ee4f0422989a3708915375cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fe46c5c-90", "ovs_interfaceid": "8fe46c5c-9093-43c4-8b0d-baf325c2e18b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:16:55 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-def79da1-a3da-487e-81b2-26d1246a119f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:d5:3a,bridge_name='br-int',has_traffic_filtering=True,id=8fe46c5c-9093-43c4-8b0d-baf325c2e18b,network=Network(9c5fae09-5df5-45a3-b9cd-7ac3763ba878),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fe46c5c-90') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:16:55 user nova-compute[74960]: DEBUG os_vif [None req-def79da1-a3da-487e-81b2-26d1246a119f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:d5:3a,bridge_name='br-int',has_traffic_filtering=True,id=8fe46c5c-9093-43c4-8b0d-baf325c2e18b,network=Network(9c5fae09-5df5-45a3-b9cd-7ac3763ba878),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fe46c5c-90') {{(pid=74960) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 12:16:55 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:16:55 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:16:55 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 12:16:55 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:16:55 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '37936212-7548-5c6d-bf34-13e05bba2674', '_type': 'linux-noop'}}, row=False) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:16:55 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:16:55 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:16:55 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:16:56 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:16:56 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8fe46c5c-90, may_exist=True, interface_attrs={}) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:16:56 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8fe46c5c-90, col_values=(('qos', UUID('e29addb4-b084-48ae-bf2f-e9663e2e240e')),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:16:56 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8fe46c5c-90, col_values=(('external_ids', {'iface-id': '8fe46c5c-9093-43c4-8b0d-baf325c2e18b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ba:d5:3a', 'vm-uuid': '7769e3c5-136f-4282-8e3e-224e3a80922c'}),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:16:56 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:16:56 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:16:56 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:16:56 user nova-compute[74960]: INFO os_vif [None req-def79da1-a3da-487e-81b2-26d1246a119f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:d5:3a,bridge_name='br-int',has_traffic_filtering=True,id=8fe46c5c-9093-43c4-8b0d-baf325c2e18b,network=Network(9c5fae09-5df5-45a3-b9cd-7ac3763ba878),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fe46c5c-90')
Nov 03 12:16:56 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-def79da1-a3da-487e-81b2-26d1246a119f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] No BDM found with device name vda, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:16:56 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-def79da1-a3da-487e-81b2-26d1246a119f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] No VIF found with MAC fa:16:3e:ba:d5:3a, not building metadata {{(pid=74960) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 12:16:56 user nova-compute[74960]: DEBUG nova.network.neutron [req-367823f8-e543-494f-99cf-74ca537ce4c9 req-3476dceb-0bd4-4e81-a2bd-0562ae9983d7 service nova] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Updated VIF entry in instance network info cache for port e91b8148-e2ff-4124-9799-ba4efae837ff. {{(pid=74960) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 12:16:56 user nova-compute[74960]: DEBUG nova.network.neutron [req-367823f8-e543-494f-99cf-74ca537ce4c9 req-3476dceb-0bd4-4e81-a2bd-0562ae9983d7 service nova] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Updating instance_info_cache with network_info: [{"id": "e91b8148-e2ff-4124-9799-ba4efae837ff", "address": "fa:16:3e:40:35:d4", "network": {"id": "c03e854d-75a3-4e81-9cdf-f1139841266c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1632999031-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c216dd7629274eafbf0a5968ff2378a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape91b8148-e2", "ovs_interfaceid": "e91b8148-e2ff-4124-9799-ba4efae837ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:16:56 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-367823f8-e543-494f-99cf-74ca537ce4c9 req-3476dceb-0bd4-4e81-a2bd-0562ae9983d7 service nova] Releasing lock "refresh_cache-7e5ec97f-80c4-4499-94bf-2584fc0eae03" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:16:56 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:16:57 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:16:57 user nova-compute[74960]: DEBUG nova.network.neutron [req-40c7387c-7cde-4bf6-a380-9016e6c24a1c req-709a7889-0e7d-4fb2-b548-1b6d185153bf service nova] [instance: 7769e3c5-136f-4282-8e3e-224e3a80922c] Updated VIF entry in instance network info cache for port 8fe46c5c-9093-43c4-8b0d-baf325c2e18b. {{(pid=74960) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 12:16:57 user nova-compute[74960]: DEBUG nova.network.neutron [req-40c7387c-7cde-4bf6-a380-9016e6c24a1c req-709a7889-0e7d-4fb2-b548-1b6d185153bf service nova] [instance: 7769e3c5-136f-4282-8e3e-224e3a80922c] Updating instance_info_cache with network_info: [{"id": "8fe46c5c-9093-43c4-8b0d-baf325c2e18b", "address": "fa:16:3e:ba:d5:3a", "network": {"id": "9c5fae09-5df5-45a3-b9cd-7ac3763ba878", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1736223258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5320673ee4f0422989a3708915375cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fe46c5c-90", "ovs_interfaceid": "8fe46c5c-9093-43c4-8b0d-baf325c2e18b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:16:57 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:16:57 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:16:57 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-40c7387c-7cde-4bf6-a380-9016e6c24a1c req-709a7889-0e7d-4fb2-b548-1b6d185153bf service nova] Releasing lock "refresh_cache-7769e3c5-136f-4282-8e3e-224e3a80922c" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:16:57 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:16:58 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:16:58 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:16:59 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:16:59 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:16:59 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:17:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:17:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:17:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:17:01 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:17:01 user nova-compute[74960]: DEBUG nova.compute.manager [None req-def79da1-a3da-487e-81b2-26d1246a119f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: 7769e3c5-136f-4282-8e3e-224e3a80922c] Instance event wait completed in 0 seconds for  {{(pid=74960) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 12:17:01 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-def79da1-a3da-487e-81b2-26d1246a119f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: 7769e3c5-136f-4282-8e3e-224e3a80922c] Guest created on hypervisor {{(pid=74960) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 12:17:01 user nova-compute[74960]: DEBUG nova.compute.manager [None req-1fcfc153-b24b-4c09-91d4-cce01b3db0b5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Instance event wait completed in 0 seconds for  {{(pid=74960) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 12:17:01 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-1fcfc153-b24b-4c09-91d4-cce01b3db0b5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Guest created on hypervisor {{(pid=74960) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 12:17:01 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: 7769e3c5-136f-4282-8e3e-224e3a80922c] Instance spawned successfully.
Nov 03 12:17:01 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-def79da1-a3da-487e-81b2-26d1246a119f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: 7769e3c5-136f-4282-8e3e-224e3a80922c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 12:17:01 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Instance spawned successfully.
Nov 03 12:17:01 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-1fcfc153-b24b-4c09-91d4-cce01b3db0b5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 12:17:01 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-def79da1-a3da-487e-81b2-26d1246a119f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: 7769e3c5-136f-4282-8e3e-224e3a80922c] Found default for hw_cdrom_bus of ide {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:17:01 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-def79da1-a3da-487e-81b2-26d1246a119f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: 7769e3c5-136f-4282-8e3e-224e3a80922c] Found default for hw_disk_bus of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:17:01 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-def79da1-a3da-487e-81b2-26d1246a119f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: 7769e3c5-136f-4282-8e3e-224e3a80922c] Found default for hw_input_bus of None {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:17:01 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-def79da1-a3da-487e-81b2-26d1246a119f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: 7769e3c5-136f-4282-8e3e-224e3a80922c] Found default for hw_pointer_model of None {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:17:01 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-def79da1-a3da-487e-81b2-26d1246a119f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: 7769e3c5-136f-4282-8e3e-224e3a80922c] Found default for hw_video_model of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:17:01 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-def79da1-a3da-487e-81b2-26d1246a119f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: 7769e3c5-136f-4282-8e3e-224e3a80922c] Found default for hw_vif_model of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:17:01 user nova-compute[74960]: DEBUG nova.compute.manager [req-1c2828cb-47b6-4758-857e-fc3d5333ee7b req-8e57d356-0204-4cd2-8fe0-2a0fd40139bc service nova] [instance: 39e6c635-4602-4ed6-abbd-80c96f056715] Received event network-vif-plugged-948c9582-33b7-486d-889a-65c37267d98d {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:17:01 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-1c2828cb-47b6-4758-857e-fc3d5333ee7b req-8e57d356-0204-4cd2-8fe0-2a0fd40139bc service nova] Acquiring lock "39e6c635-4602-4ed6-abbd-80c96f056715-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:17:01 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-1c2828cb-47b6-4758-857e-fc3d5333ee7b req-8e57d356-0204-4cd2-8fe0-2a0fd40139bc service nova] Lock "39e6c635-4602-4ed6-abbd-80c96f056715-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:17:01 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-1c2828cb-47b6-4758-857e-fc3d5333ee7b req-8e57d356-0204-4cd2-8fe0-2a0fd40139bc service nova] Lock "39e6c635-4602-4ed6-abbd-80c96f056715-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:17:01 user nova-compute[74960]: DEBUG nova.compute.manager [req-1c2828cb-47b6-4758-857e-fc3d5333ee7b req-8e57d356-0204-4cd2-8fe0-2a0fd40139bc service nova] [instance: 39e6c635-4602-4ed6-abbd-80c96f056715] No waiting events found dispatching network-vif-plugged-948c9582-33b7-486d-889a-65c37267d98d {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:17:01 user nova-compute[74960]: WARNING nova.compute.manager [req-1c2828cb-47b6-4758-857e-fc3d5333ee7b req-8e57d356-0204-4cd2-8fe0-2a0fd40139bc service nova] [instance: 39e6c635-4602-4ed6-abbd-80c96f056715] Received unexpected event network-vif-plugged-948c9582-33b7-486d-889a-65c37267d98d for instance with vm_state active and task_state None.
Nov 03 12:17:01 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-1fcfc153-b24b-4c09-91d4-cce01b3db0b5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Found default for hw_cdrom_bus of ide {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:17:01 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-1fcfc153-b24b-4c09-91d4-cce01b3db0b5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Found default for hw_disk_bus of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:17:01 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-1fcfc153-b24b-4c09-91d4-cce01b3db0b5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Found default for hw_input_bus of None {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:17:01 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-1fcfc153-b24b-4c09-91d4-cce01b3db0b5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Found default for hw_pointer_model of None {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:17:01 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-1fcfc153-b24b-4c09-91d4-cce01b3db0b5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Found default for hw_video_model of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:17:01 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-1fcfc153-b24b-4c09-91d4-cce01b3db0b5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Found default for hw_vif_model of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:17:01 user nova-compute[74960]: INFO nova.compute.manager [None req-def79da1-a3da-487e-81b2-26d1246a119f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: 7769e3c5-136f-4282-8e3e-224e3a80922c] Took 10.71 seconds to spawn the instance on the hypervisor.
Nov 03 12:17:01 user nova-compute[74960]: DEBUG nova.compute.manager [None req-def79da1-a3da-487e-81b2-26d1246a119f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: 7769e3c5-136f-4282-8e3e-224e3a80922c] Checking state {{(pid=74960) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 12:17:01 user nova-compute[74960]: INFO nova.compute.manager [None req-1fcfc153-b24b-4c09-91d4-cce01b3db0b5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Took 11.83 seconds to spawn the instance on the hypervisor.
Nov 03 12:17:01 user nova-compute[74960]: DEBUG nova.compute.manager [None req-1fcfc153-b24b-4c09-91d4-cce01b3db0b5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Checking state {{(pid=74960) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 12:17:01 user nova-compute[74960]: INFO nova.compute.manager [None req-def79da1-a3da-487e-81b2-26d1246a119f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: 7769e3c5-136f-4282-8e3e-224e3a80922c] Took 11.76 seconds to build instance.
Nov 03 12:17:01 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-def79da1-a3da-487e-81b2-26d1246a119f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Lock "7769e3c5-136f-4282-8e3e-224e3a80922c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.916s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:17:01 user nova-compute[74960]: INFO nova.compute.manager [None req-1fcfc153-b24b-4c09-91d4-cce01b3db0b5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Took 13.01 seconds to build instance.
Nov 03 12:17:01 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-1fcfc153-b24b-4c09-91d4-cce01b3db0b5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Lock "7e5ec97f-80c4-4499-94bf-2584fc0eae03" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.247s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:17:02 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-d3c22553-8ca0-49f2-8ce8-d281871e5014 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Acquiring lock "d00a0872-693c-4cdc-85cd-9806660e9d8d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:17:02 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-d3c22553-8ca0-49f2-8ce8-d281871e5014 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Lock "d00a0872-693c-4cdc-85cd-9806660e9d8d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:17:02 user nova-compute[74960]: DEBUG nova.compute.manager [None req-d3c22553-8ca0-49f2-8ce8-d281871e5014 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] [instance: d00a0872-693c-4cdc-85cd-9806660e9d8d] Starting instance... {{(pid=74960) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 12:17:02 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-d3c22553-8ca0-49f2-8ce8-d281871e5014 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:17:02 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-d3c22553-8ca0-49f2-8ce8-d281871e5014 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:17:02 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-d3c22553-8ca0-49f2-8ce8-d281871e5014 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74960) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 12:17:02 user nova-compute[74960]: INFO nova.compute.claims [None req-d3c22553-8ca0-49f2-8ce8-d281871e5014 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] [instance: d00a0872-693c-4cdc-85cd-9806660e9d8d] Claim successful on node user
Nov 03 12:17:02 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:17:02 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:17:02 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:17:02 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-d3c22553-8ca0-49f2-8ce8-d281871e5014 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:17:02 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-d3c22553-8ca0-49f2-8ce8-d281871e5014 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:17:02 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-d3c22553-8ca0-49f2-8ce8-d281871e5014 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.453s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:17:02 user nova-compute[74960]: DEBUG nova.compute.manager [None req-d3c22553-8ca0-49f2-8ce8-d281871e5014 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] [instance: d00a0872-693c-4cdc-85cd-9806660e9d8d] Start building networks asynchronously for instance. {{(pid=74960) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 12:17:02 user nova-compute[74960]: DEBUG nova.compute.manager [None req-d3c22553-8ca0-49f2-8ce8-d281871e5014 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] [instance: d00a0872-693c-4cdc-85cd-9806660e9d8d] Allocating IP information in the background. {{(pid=74960) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 12:17:02 user nova-compute[74960]: DEBUG nova.network.neutron [None req-d3c22553-8ca0-49f2-8ce8-d281871e5014 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] [instance: d00a0872-693c-4cdc-85cd-9806660e9d8d] allocate_for_instance() {{(pid=74960) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 12:17:02 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-d3c22553-8ca0-49f2-8ce8-d281871e5014 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] [instance: d00a0872-693c-4cdc-85cd-9806660e9d8d] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Nov 03 12:17:03 user nova-compute[74960]: DEBUG nova.compute.manager [None req-d3c22553-8ca0-49f2-8ce8-d281871e5014 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] [instance: d00a0872-693c-4cdc-85cd-9806660e9d8d] Start building block device mappings for instance. {{(pid=74960) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 12:17:03 user nova-compute[74960]: DEBUG nova.compute.manager [None req-d3c22553-8ca0-49f2-8ce8-d281871e5014 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] [instance: d00a0872-693c-4cdc-85cd-9806660e9d8d] Start spawning the instance on the hypervisor. {{(pid=74960) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 12:17:03 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-d3c22553-8ca0-49f2-8ce8-d281871e5014 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] [instance: d00a0872-693c-4cdc-85cd-9806660e9d8d] Creating instance directory {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 12:17:03 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-d3c22553-8ca0-49f2-8ce8-d281871e5014 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] [instance: d00a0872-693c-4cdc-85cd-9806660e9d8d] Creating image(s)
Nov 03 12:17:03 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-d3c22553-8ca0-49f2-8ce8-d281871e5014 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Acquiring lock "/opt/stack/data/nova/instances/d00a0872-693c-4cdc-85cd-9806660e9d8d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:17:03 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-d3c22553-8ca0-49f2-8ce8-d281871e5014 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Lock "/opt/stack/data/nova/instances/d00a0872-693c-4cdc-85cd-9806660e9d8d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:17:03 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-d3c22553-8ca0-49f2-8ce8-d281871e5014 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Lock "/opt/stack/data/nova/instances/d00a0872-693c-4cdc-85cd-9806660e9d8d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:17:03 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-d3c22553-8ca0-49f2-8ce8-d281871e5014 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Acquiring lock "c582bb77920948ae2db7e57ee5cc6dbc38c14a24" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:17:03 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-d3c22553-8ca0-49f2-8ce8-d281871e5014 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Lock "c582bb77920948ae2db7e57ee5cc6dbc38c14a24" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:17:03 user nova-compute[74960]: DEBUG nova.policy [None req-d3c22553-8ca0-49f2-8ce8-d281871e5014 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3f0e3bcd72b44727b52795e0d2997905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7141b1fdcbd4e3b8d8ecabdb9ed4a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74960) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 12:17:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-d3c22553-8ca0-49f2-8ce8-d281871e5014 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c582bb77920948ae2db7e57ee5cc6dbc38c14a24.part --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:17:03 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:17:03 user nova-compute[74960]: DEBUG nova.compute.manager [req-fdc6f8fa-3250-49e4-be74-274635708085 req-c855cdf0-addb-48ed-9fb5-564bc019a92f service nova] [instance: 39e6c635-4602-4ed6-abbd-80c96f056715] Received event network-vif-plugged-948c9582-33b7-486d-889a-65c37267d98d {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:17:03 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-fdc6f8fa-3250-49e4-be74-274635708085 req-c855cdf0-addb-48ed-9fb5-564bc019a92f service nova] Acquiring lock "39e6c635-4602-4ed6-abbd-80c96f056715-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:17:03 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-fdc6f8fa-3250-49e4-be74-274635708085 req-c855cdf0-addb-48ed-9fb5-564bc019a92f service nova] Lock "39e6c635-4602-4ed6-abbd-80c96f056715-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:17:03 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-fdc6f8fa-3250-49e4-be74-274635708085 req-c855cdf0-addb-48ed-9fb5-564bc019a92f service nova] Lock "39e6c635-4602-4ed6-abbd-80c96f056715-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:17:03 user nova-compute[74960]: DEBUG nova.compute.manager [req-fdc6f8fa-3250-49e4-be74-274635708085 req-c855cdf0-addb-48ed-9fb5-564bc019a92f service nova] [instance: 39e6c635-4602-4ed6-abbd-80c96f056715] No waiting events found dispatching network-vif-plugged-948c9582-33b7-486d-889a-65c37267d98d {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:17:03 user nova-compute[74960]: WARNING nova.compute.manager [req-fdc6f8fa-3250-49e4-be74-274635708085 req-c855cdf0-addb-48ed-9fb5-564bc019a92f service nova] [instance: 39e6c635-4602-4ed6-abbd-80c96f056715] Received unexpected event network-vif-plugged-948c9582-33b7-486d-889a-65c37267d98d for instance with vm_state active and task_state None.
Nov 03 12:17:03 user nova-compute[74960]: DEBUG nova.compute.manager [req-fdc6f8fa-3250-49e4-be74-274635708085 req-c855cdf0-addb-48ed-9fb5-564bc019a92f service nova] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Received event network-vif-plugged-e91b8148-e2ff-4124-9799-ba4efae837ff {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:17:03 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-fdc6f8fa-3250-49e4-be74-274635708085 req-c855cdf0-addb-48ed-9fb5-564bc019a92f service nova] Acquiring lock "7e5ec97f-80c4-4499-94bf-2584fc0eae03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:17:03 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-fdc6f8fa-3250-49e4-be74-274635708085 req-c855cdf0-addb-48ed-9fb5-564bc019a92f service nova] Lock "7e5ec97f-80c4-4499-94bf-2584fc0eae03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:17:03 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-fdc6f8fa-3250-49e4-be74-274635708085 req-c855cdf0-addb-48ed-9fb5-564bc019a92f service nova] Lock "7e5ec97f-80c4-4499-94bf-2584fc0eae03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:17:03 user nova-compute[74960]: DEBUG nova.compute.manager [req-fdc6f8fa-3250-49e4-be74-274635708085 req-c855cdf0-addb-48ed-9fb5-564bc019a92f service nova] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] No waiting events found dispatching network-vif-plugged-e91b8148-e2ff-4124-9799-ba4efae837ff {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:17:03 user nova-compute[74960]: WARNING nova.compute.manager [req-fdc6f8fa-3250-49e4-be74-274635708085 req-c855cdf0-addb-48ed-9fb5-564bc019a92f service nova] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Received unexpected event network-vif-plugged-e91b8148-e2ff-4124-9799-ba4efae837ff for instance with vm_state active and task_state None.
Nov 03 12:17:03 user nova-compute[74960]: DEBUG nova.compute.manager [req-fdc6f8fa-3250-49e4-be74-274635708085 req-c855cdf0-addb-48ed-9fb5-564bc019a92f service nova] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Received event network-vif-plugged-e91b8148-e2ff-4124-9799-ba4efae837ff {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:17:03 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-fdc6f8fa-3250-49e4-be74-274635708085 req-c855cdf0-addb-48ed-9fb5-564bc019a92f service nova] Acquiring lock "7e5ec97f-80c4-4499-94bf-2584fc0eae03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:17:03 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-fdc6f8fa-3250-49e4-be74-274635708085 req-c855cdf0-addb-48ed-9fb5-564bc019a92f service nova] Lock "7e5ec97f-80c4-4499-94bf-2584fc0eae03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:17:03 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-fdc6f8fa-3250-49e4-be74-274635708085 req-c855cdf0-addb-48ed-9fb5-564bc019a92f service nova] Lock "7e5ec97f-80c4-4499-94bf-2584fc0eae03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:17:03 user nova-compute[74960]: DEBUG nova.compute.manager [req-fdc6f8fa-3250-49e4-be74-274635708085 req-c855cdf0-addb-48ed-9fb5-564bc019a92f service nova] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] No waiting events found dispatching network-vif-plugged-e91b8148-e2ff-4124-9799-ba4efae837ff {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:17:03 user nova-compute[74960]: WARNING nova.compute.manager [req-fdc6f8fa-3250-49e4-be74-274635708085 req-c855cdf0-addb-48ed-9fb5-564bc019a92f service nova] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Received unexpected event network-vif-plugged-e91b8148-e2ff-4124-9799-ba4efae837ff for instance with vm_state active and task_state None.
Nov 03 12:17:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-d3c22553-8ca0-49f2-8ce8-d281871e5014 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c582bb77920948ae2db7e57ee5cc6dbc38c14a24.part --force-share --output=json" returned: 0 in 0.203s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:17:03 user nova-compute[74960]: DEBUG nova.virt.images [None req-d3c22553-8ca0-49f2-8ce8-d281871e5014 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] 62be30e2-c070-4a69-b7a8-3a130347754a was qcow2, converting to raw {{(pid=74960) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 03 12:17:03 user nova-compute[74960]: DEBUG nova.privsep.utils [None req-d3c22553-8ca0-49f2-8ce8-d281871e5014 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74960) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 03 12:17:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-d3c22553-8ca0-49f2-8ce8-d281871e5014 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c582bb77920948ae2db7e57ee5cc6dbc38c14a24.part /opt/stack/data/nova/instances/_base/c582bb77920948ae2db7e57ee5cc6dbc38c14a24.converted {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:17:04 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-d3c22553-8ca0-49f2-8ce8-d281871e5014 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c582bb77920948ae2db7e57ee5cc6dbc38c14a24.part /opt/stack/data/nova/instances/_base/c582bb77920948ae2db7e57ee5cc6dbc38c14a24.converted" returned: 0 in 0.274s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:17:04 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-d3c22553-8ca0-49f2-8ce8-d281871e5014 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c582bb77920948ae2db7e57ee5cc6dbc38c14a24.converted --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:17:04 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-d3c22553-8ca0-49f2-8ce8-d281871e5014 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c582bb77920948ae2db7e57ee5cc6dbc38c14a24.converted --force-share --output=json" returned: 0 in 0.259s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:17:04 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-d3c22553-8ca0-49f2-8ce8-d281871e5014 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Lock "c582bb77920948ae2db7e57ee5cc6dbc38c14a24" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.215s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:17:04 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-d3c22553-8ca0-49f2-8ce8-d281871e5014 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c582bb77920948ae2db7e57ee5cc6dbc38c14a24 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:17:04 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-d3c22553-8ca0-49f2-8ce8-d281871e5014 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c582bb77920948ae2db7e57ee5cc6dbc38c14a24 --force-share --output=json" returned: 0 in 0.205s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:17:04 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-d3c22553-8ca0-49f2-8ce8-d281871e5014 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Acquiring lock "c582bb77920948ae2db7e57ee5cc6dbc38c14a24" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:17:04 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-d3c22553-8ca0-49f2-8ce8-d281871e5014 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Lock "c582bb77920948ae2db7e57ee5cc6dbc38c14a24" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:17:04 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-d3c22553-8ca0-49f2-8ce8-d281871e5014 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c582bb77920948ae2db7e57ee5cc6dbc38c14a24 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:17:04 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-d3c22553-8ca0-49f2-8ce8-d281871e5014 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c582bb77920948ae2db7e57ee5cc6dbc38c14a24 --force-share --output=json" returned: 0 in 0.210s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:17:04 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-d3c22553-8ca0-49f2-8ce8-d281871e5014 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c582bb77920948ae2db7e57ee5cc6dbc38c14a24,backing_fmt=raw /opt/stack/data/nova/instances/d00a0872-693c-4cdc-85cd-9806660e9d8d/disk 1073741824 {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:17:04 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-d3c22553-8ca0-49f2-8ce8-d281871e5014 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c582bb77920948ae2db7e57ee5cc6dbc38c14a24,backing_fmt=raw /opt/stack/data/nova/instances/d00a0872-693c-4cdc-85cd-9806660e9d8d/disk 1073741824" returned: 0 in 0.066s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:17:04 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-d3c22553-8ca0-49f2-8ce8-d281871e5014 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Lock "c582bb77920948ae2db7e57ee5cc6dbc38c14a24" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.285s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:17:04 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-d3c22553-8ca0-49f2-8ce8-d281871e5014 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c582bb77920948ae2db7e57ee5cc6dbc38c14a24 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:17:05 user nova-compute[74960]: DEBUG nova.network.neutron [None req-d3c22553-8ca0-49f2-8ce8-d281871e5014 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] [instance: d00a0872-693c-4cdc-85cd-9806660e9d8d] Successfully created port: c2a92350-10c1-4c73-bfce-b305071289ff {{(pid=74960) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 12:17:05 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-d3c22553-8ca0-49f2-8ce8-d281871e5014 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c582bb77920948ae2db7e57ee5cc6dbc38c14a24 --force-share --output=json" returned: 0 in 0.346s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:17:05 user nova-compute[74960]: DEBUG nova.virt.disk.api [None req-d3c22553-8ca0-49f2-8ce8-d281871e5014 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d00a0872-693c-4cdc-85cd-9806660e9d8d/disk. size=1073741824 {{(pid=74960) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 12:17:05 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-d3c22553-8ca0-49f2-8ce8-d281871e5014 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d00a0872-693c-4cdc-85cd-9806660e9d8d/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:17:05 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c3780b46-0bbf-4923-b322-ac59026ae697 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Acquiring lock "e91dfcf4-caef-43d0-a56b-b1282363d4e0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:17:05 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c3780b46-0bbf-4923-b322-ac59026ae697 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Lock "e91dfcf4-caef-43d0-a56b-b1282363d4e0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:17:05 user nova-compute[74960]: DEBUG nova.compute.manager [None req-c3780b46-0bbf-4923-b322-ac59026ae697 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] [instance: e91dfcf4-caef-43d0-a56b-b1282363d4e0] Starting instance... {{(pid=74960) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 12:17:05 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-d3c22553-8ca0-49f2-8ce8-d281871e5014 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d00a0872-693c-4cdc-85cd-9806660e9d8d/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:17:05 user nova-compute[74960]: DEBUG nova.virt.disk.api [None req-d3c22553-8ca0-49f2-8ce8-d281871e5014 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Cannot resize image /opt/stack/data/nova/instances/d00a0872-693c-4cdc-85cd-9806660e9d8d/disk to a smaller size. {{(pid=74960) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 12:17:05 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-d3c22553-8ca0-49f2-8ce8-d281871e5014 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] [instance: d00a0872-693c-4cdc-85cd-9806660e9d8d] Created local disks {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 12:17:05 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-d3c22553-8ca0-49f2-8ce8-d281871e5014 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] [instance: d00a0872-693c-4cdc-85cd-9806660e9d8d] Ensure instance console log exists: /opt/stack/data/nova/instances/d00a0872-693c-4cdc-85cd-9806660e9d8d/console.log {{(pid=74960) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 12:17:05 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-d3c22553-8ca0-49f2-8ce8-d281871e5014 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:17:05 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-d3c22553-8ca0-49f2-8ce8-d281871e5014 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:17:05 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-d3c22553-8ca0-49f2-8ce8-d281871e5014 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:17:05 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c3780b46-0bbf-4923-b322-ac59026ae697 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:17:05 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c3780b46-0bbf-4923-b322-ac59026ae697 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:17:05 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-c3780b46-0bbf-4923-b322-ac59026ae697 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74960) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 12:17:05 user nova-compute[74960]: INFO nova.compute.claims [None req-c3780b46-0bbf-4923-b322-ac59026ae697 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] [instance: e91dfcf4-caef-43d0-a56b-b1282363d4e0] Claim successful on node user
Nov 03 12:17:05 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-c3780b46-0bbf-4923-b322-ac59026ae697 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:17:05 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-c3780b46-0bbf-4923-b322-ac59026ae697 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:17:05 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c3780b46-0bbf-4923-b322-ac59026ae697 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.401s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:17:05 user nova-compute[74960]: DEBUG nova.compute.manager [None req-c3780b46-0bbf-4923-b322-ac59026ae697 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] [instance: e91dfcf4-caef-43d0-a56b-b1282363d4e0] Start building networks asynchronously for instance. {{(pid=74960) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 12:17:06 user nova-compute[74960]: DEBUG nova.compute.manager [None req-c3780b46-0bbf-4923-b322-ac59026ae697 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] [instance: e91dfcf4-caef-43d0-a56b-b1282363d4e0] Allocating IP information in the background. {{(pid=74960) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 12:17:06 user nova-compute[74960]: DEBUG nova.network.neutron [None req-c3780b46-0bbf-4923-b322-ac59026ae697 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] [instance: e91dfcf4-caef-43d0-a56b-b1282363d4e0] allocate_for_instance() {{(pid=74960) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 12:17:06 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:17:06 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-c3780b46-0bbf-4923-b322-ac59026ae697 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] [instance: e91dfcf4-caef-43d0-a56b-b1282363d4e0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 12:17:06 user nova-compute[74960]: DEBUG nova.compute.manager [None req-c3780b46-0bbf-4923-b322-ac59026ae697 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] [instance: e91dfcf4-caef-43d0-a56b-b1282363d4e0] Start building block device mappings for instance. {{(pid=74960) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 12:17:06 user nova-compute[74960]: DEBUG nova.policy [None req-c3780b46-0bbf-4923-b322-ac59026ae697 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '26930c47348248f681093b8e74e8c73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58667b53361b490fa7f0236ee65934c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74960) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 12:17:06 user nova-compute[74960]: DEBUG nova.compute.manager [None req-c3780b46-0bbf-4923-b322-ac59026ae697 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] [instance: e91dfcf4-caef-43d0-a56b-b1282363d4e0] Start spawning the instance on the hypervisor. {{(pid=74960) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 12:17:06 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-c3780b46-0bbf-4923-b322-ac59026ae697 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] [instance: e91dfcf4-caef-43d0-a56b-b1282363d4e0] Creating instance directory {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 12:17:06 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-c3780b46-0bbf-4923-b322-ac59026ae697 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] [instance: e91dfcf4-caef-43d0-a56b-b1282363d4e0] Creating image(s)
Nov 03 12:17:06 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c3780b46-0bbf-4923-b322-ac59026ae697 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Acquiring lock "/opt/stack/data/nova/instances/e91dfcf4-caef-43d0-a56b-b1282363d4e0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:17:06 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c3780b46-0bbf-4923-b322-ac59026ae697 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Lock "/opt/stack/data/nova/instances/e91dfcf4-caef-43d0-a56b-b1282363d4e0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:17:06 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c3780b46-0bbf-4923-b322-ac59026ae697 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Lock "/opt/stack/data/nova/instances/e91dfcf4-caef-43d0-a56b-b1282363d4e0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:17:06 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-c3780b46-0bbf-4923-b322-ac59026ae697 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:17:06 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-c3780b46-0bbf-4923-b322-ac59026ae697 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.242s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:17:06 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c3780b46-0bbf-4923-b322-ac59026ae697 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Acquiring lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:17:06 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c3780b46-0bbf-4923-b322-ac59026ae697 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:17:06 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-c3780b46-0bbf-4923-b322-ac59026ae697 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:17:06 user nova-compute[74960]: DEBUG nova.network.neutron [None req-d3c22553-8ca0-49f2-8ce8-d281871e5014 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] [instance: d00a0872-693c-4cdc-85cd-9806660e9d8d] Successfully updated port: c2a92350-10c1-4c73-bfce-b305071289ff {{(pid=74960) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 12:17:06 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-d3c22553-8ca0-49f2-8ce8-d281871e5014 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Acquiring lock "refresh_cache-d00a0872-693c-4cdc-85cd-9806660e9d8d" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:17:06 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-d3c22553-8ca0-49f2-8ce8-d281871e5014 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Acquired lock "refresh_cache-d00a0872-693c-4cdc-85cd-9806660e9d8d" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:17:06 user nova-compute[74960]: DEBUG nova.network.neutron [None req-d3c22553-8ca0-49f2-8ce8-d281871e5014 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] [instance: d00a0872-693c-4cdc-85cd-9806660e9d8d] Building network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 12:17:06 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-c3780b46-0bbf-4923-b322-ac59026ae697 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.271s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:17:06 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-c3780b46-0bbf-4923-b322-ac59026ae697 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910,backing_fmt=raw /opt/stack/data/nova/instances/e91dfcf4-caef-43d0-a56b-b1282363d4e0/disk 1073741824 {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:17:06 user nova-compute[74960]: DEBUG nova.compute.manager [req-3db3e06c-631b-4c6c-a868-1817e9b8ceed req-57f3a8db-7b9a-4e6d-a578-d60b1ee222c1 service nova] [instance: d00a0872-693c-4cdc-85cd-9806660e9d8d] Received event network-changed-c2a92350-10c1-4c73-bfce-b305071289ff {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:17:06 user nova-compute[74960]: DEBUG nova.compute.manager [req-3db3e06c-631b-4c6c-a868-1817e9b8ceed req-57f3a8db-7b9a-4e6d-a578-d60b1ee222c1 service nova] [instance: d00a0872-693c-4cdc-85cd-9806660e9d8d] Refreshing instance network info cache due to event network-changed-c2a92350-10c1-4c73-bfce-b305071289ff. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 12:17:06 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-3db3e06c-631b-4c6c-a868-1817e9b8ceed req-57f3a8db-7b9a-4e6d-a578-d60b1ee222c1 service nova] Acquiring lock "refresh_cache-d00a0872-693c-4cdc-85cd-9806660e9d8d" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:17:06 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-c3780b46-0bbf-4923-b322-ac59026ae697 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910,backing_fmt=raw /opt/stack/data/nova/instances/e91dfcf4-caef-43d0-a56b-b1282363d4e0/disk 1073741824" returned: 0 in 0.141s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:17:06 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c3780b46-0bbf-4923-b322-ac59026ae697 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.418s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:17:06 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-c3780b46-0bbf-4923-b322-ac59026ae697 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:17:07 user nova-compute[74960]: DEBUG nova.network.neutron [None req-d3c22553-8ca0-49f2-8ce8-d281871e5014 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] [instance: d00a0872-693c-4cdc-85cd-9806660e9d8d] Instance cache missing network info. {{(pid=74960) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 12:17:07 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-c3780b46-0bbf-4923-b322-ac59026ae697 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.248s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:17:07 user nova-compute[74960]: DEBUG nova.virt.disk.api [None req-c3780b46-0bbf-4923-b322-ac59026ae697 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e91dfcf4-caef-43d0-a56b-b1282363d4e0/disk. size=1073741824 {{(pid=74960) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 12:17:07 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-c3780b46-0bbf-4923-b322-ac59026ae697 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e91dfcf4-caef-43d0-a56b-b1282363d4e0/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:17:07 user nova-compute[74960]: DEBUG nova.network.neutron [None req-d3c22553-8ca0-49f2-8ce8-d281871e5014 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] [instance: d00a0872-693c-4cdc-85cd-9806660e9d8d] Updating instance_info_cache with network_info: [{"id": "c2a92350-10c1-4c73-bfce-b305071289ff", "address": "fa:16:3e:80:8f:c1", "network": {"id": "10b59e93-b9b0-443a-8a8a-755bf2a87b0c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1169763894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7141b1fdcbd4e3b8d8ecabdb9ed4a0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2a92350-10", "ovs_interfaceid": "c2a92350-10c1-4c73-bfce-b305071289ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:17:07 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:17:07 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-c3780b46-0bbf-4923-b322-ac59026ae697 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e91dfcf4-caef-43d0-a56b-b1282363d4e0/disk --force-share --output=json" returned: 0 in 0.379s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:17:07 user nova-compute[74960]: DEBUG nova.virt.disk.api [None req-c3780b46-0bbf-4923-b322-ac59026ae697 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Cannot resize image /opt/stack/data/nova/instances/e91dfcf4-caef-43d0-a56b-b1282363d4e0/disk to a smaller size. {{(pid=74960) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 12:17:07 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-c3780b46-0bbf-4923-b322-ac59026ae697 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] [instance: e91dfcf4-caef-43d0-a56b-b1282363d4e0] Created local disks {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 12:17:07 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-c3780b46-0bbf-4923-b322-ac59026ae697 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] [instance: e91dfcf4-caef-43d0-a56b-b1282363d4e0] Ensure instance console log exists: /opt/stack/data/nova/instances/e91dfcf4-caef-43d0-a56b-b1282363d4e0/console.log {{(pid=74960) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 12:17:07 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c3780b46-0bbf-4923-b322-ac59026ae697 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:17:07 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c3780b46-0bbf-4923-b322-ac59026ae697 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:17:07 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c3780b46-0bbf-4923-b322-ac59026ae697 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:17:07 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-d3c22553-8ca0-49f2-8ce8-d281871e5014 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Releasing lock "refresh_cache-d00a0872-693c-4cdc-85cd-9806660e9d8d" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:17:07 user nova-compute[74960]: DEBUG nova.compute.manager [None req-d3c22553-8ca0-49f2-8ce8-d281871e5014 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] [instance: d00a0872-693c-4cdc-85cd-9806660e9d8d] Instance network_info: |[{"id": "c2a92350-10c1-4c73-bfce-b305071289ff", "address": "fa:16:3e:80:8f:c1", "network": {"id": "10b59e93-b9b0-443a-8a8a-755bf2a87b0c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1169763894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7141b1fdcbd4e3b8d8ecabdb9ed4a0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2a92350-10", "ovs_interfaceid": "c2a92350-10c1-4c73-bfce-b305071289ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74960) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 12:17:07 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-3db3e06c-631b-4c6c-a868-1817e9b8ceed req-57f3a8db-7b9a-4e6d-a578-d60b1ee222c1 service nova] Acquired lock "refresh_cache-d00a0872-693c-4cdc-85cd-9806660e9d8d" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:17:07 user nova-compute[74960]: DEBUG nova.network.neutron [req-3db3e06c-631b-4c6c-a868-1817e9b8ceed req-57f3a8db-7b9a-4e6d-a578-d60b1ee222c1 service nova] [instance: d00a0872-693c-4cdc-85cd-9806660e9d8d] Refreshing network info cache for port c2a92350-10c1-4c73-bfce-b305071289ff {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 12:17:07 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-d3c22553-8ca0-49f2-8ce8-d281871e5014 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] [instance: d00a0872-693c-4cdc-85cd-9806660e9d8d] Start _get_guest_xml network_info=[{"id": "c2a92350-10c1-4c73-bfce-b305071289ff", "address": "fa:16:3e:80:8f:c1", "network": {"id": "10b59e93-b9b0-443a-8a8a-755bf2a87b0c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1169763894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7141b1fdcbd4e3b8d8ecabdb9ed4a0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2a92350-10", "ovs_interfaceid": "c2a92350-10c1-4c73-bfce-b305071289ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T12:16:55Z,direct_url=<?>,disk_format='qcow2',id=62be30e2-c070-4a69-b7a8-3a130347754a,min_disk=0,min_ram=0,name='',owner='df8518d071184da1b376a01b5aae28ac',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T12:16:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'size': 0, 'disk_bus': 'scsi', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/sda', 'boot_index': 0, 'guest_format': None, 'image_id': '62be30e2-c070-4a69-b7a8-3a130347754a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 12:17:07 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-d3c22553-8ca0-49f2-8ce8-d281871e5014 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:17:07 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-d3c22553-8ca0-49f2-8ce8-d281871e5014 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:17:07 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-d3c22553-8ca0-49f2-8ce8-d281871e5014 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 12:17:07 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-d3c22553-8ca0-49f2-8ce8-d281871e5014 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] CPU controller missing on host. {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 12:17:07 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-d3c22553-8ca0-49f2-8ce8-d281871e5014 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 12:17:07 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-d3c22553-8ca0-49f2-8ce8-d281871e5014 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] CPU controller found on host. {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 12:17:07 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-d3c22553-8ca0-49f2-8ce8-d281871e5014 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74960) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 12:17:07 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-d3c22553-8ca0-49f2-8ce8-d281871e5014 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T12:16:55Z,direct_url=<?>,disk_format='qcow2',id=62be30e2-c070-4a69-b7a8-3a130347754a,min_disk=0,min_ram=0,name='',owner='df8518d071184da1b376a01b5aae28ac',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T12:16:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 12:17:07 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-d3c22553-8ca0-49f2-8ce8-d281871e5014 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Flavor limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 12:17:07 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-d3c22553-8ca0-49f2-8ce8-d281871e5014 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Image limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 12:17:07 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-d3c22553-8ca0-49f2-8ce8-d281871e5014 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Flavor pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 12:17:07 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-d3c22553-8ca0-49f2-8ce8-d281871e5014 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Image pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 12:17:07 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-d3c22553-8ca0-49f2-8ce8-d281871e5014 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 12:17:07 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-d3c22553-8ca0-49f2-8ce8-d281871e5014 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 12:17:07 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-d3c22553-8ca0-49f2-8ce8-d281871e5014 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 12:17:07 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-d3c22553-8ca0-49f2-8ce8-d281871e5014 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Got 1 possible topologies {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 12:17:07 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-d3c22553-8ca0-49f2-8ce8-d281871e5014 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 12:17:07 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-d3c22553-8ca0-49f2-8ce8-d281871e5014 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 12:17:07 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-d3c22553-8ca0-49f2-8ce8-d281871e5014 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T12:17:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-2020397840',display_name='tempest-AttachSCSIVolumeTestJSON-server-2020397840',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-2020397840',id=4,image_ref='62be30e2-c070-4a69-b7a8-3a130347754a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNuGj4AYDOHlTOet0qwY1JSfNnHzWcfTMoU2fNeqdmJ0EaQtGFk6JonMe/lX1WsxAFPVz6DiGV6Toyq90KozUyweOS7uW43e4KWbM9YRQfEfIZcrKMO5uosMQOe4n+stuA==',key_name='tempest-keypair-1224384623',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d7141b1fdcbd4e3b8d8ecabdb9ed4a0b',ramdisk_id='',reservation_id='r-4dx4ar8t',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='62be30e2-c070-4a69-b7a8-3a130347754a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-961661338',owner_user_name='tempest-AttachSCSIVolumeTestJSON-961661338-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:17:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f0e3bcd72b44727b52795e0d2997905',uuid=d00a0872-693c-4cdc-85cd-9806660e9d8d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c2a92350-10c1-4c73-bfce-b305071289ff", "address": "fa:16:3e:80:8f:c1", "network": {"id": "10b59e93-b9b0-443a-8a8a-755bf2a87b0c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1169763894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7141b1fdcbd4e3b8d8ecabdb9ed4a0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2a92350-10", "ovs_interfaceid": "c2a92350-10c1-4c73-bfce-b305071289ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74960) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 12:17:07 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-d3c22553-8ca0-49f2-8ce8-d281871e5014 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Converting VIF {"id": "c2a92350-10c1-4c73-bfce-b305071289ff", "address": "fa:16:3e:80:8f:c1", "network": {"id": "10b59e93-b9b0-443a-8a8a-755bf2a87b0c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1169763894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7141b1fdcbd4e3b8d8ecabdb9ed4a0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2a92350-10", "ovs_interfaceid": "c2a92350-10c1-4c73-bfce-b305071289ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:17:07 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-d3c22553-8ca0-49f2-8ce8-d281871e5014 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:8f:c1,bridge_name='br-int',has_traffic_filtering=True,id=c2a92350-10c1-4c73-bfce-b305071289ff,network=Network(10b59e93-b9b0-443a-8a8a-755bf2a87b0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2a92350-10') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:17:07 user nova-compute[74960]: DEBUG nova.objects.instance [None req-d3c22553-8ca0-49f2-8ce8-d281871e5014 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Lazy-loading 'pci_devices' on Instance uuid d00a0872-693c-4cdc-85cd-9806660e9d8d {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:17:07 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-d3c22553-8ca0-49f2-8ce8-d281871e5014 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] [instance: d00a0872-693c-4cdc-85cd-9806660e9d8d] End _get_guest_xml xml=<domain type="kvm">
Nov 03 12:17:07 user nova-compute[74960]:   <uuid>d00a0872-693c-4cdc-85cd-9806660e9d8d</uuid>
Nov 03 12:17:07 user nova-compute[74960]:   <name>instance-00000004</name>
Nov 03 12:17:07 user nova-compute[74960]:   <memory>524288</memory>
Nov 03 12:17:07 user nova-compute[74960]:   <vcpu>1</vcpu>
Nov 03 12:17:07 user nova-compute[74960]:   <metadata>
Nov 03 12:17:07 user nova-compute[74960]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 12:17:07 user nova-compute[74960]:       <nova:package version="0.0.0"/>
Nov 03 12:17:07 user nova-compute[74960]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-2020397840</nova:name>
Nov 03 12:17:07 user nova-compute[74960]:       <nova:creationTime>2023-11-03 12:17:07</nova:creationTime>
Nov 03 12:17:07 user nova-compute[74960]:       <nova:flavor name="m1.tiny">
Nov 03 12:17:07 user nova-compute[74960]:         <nova:memory>512</nova:memory>
Nov 03 12:17:07 user nova-compute[74960]:         <nova:disk>1</nova:disk>
Nov 03 12:17:07 user nova-compute[74960]:         <nova:swap>0</nova:swap>
Nov 03 12:17:07 user nova-compute[74960]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 12:17:07 user nova-compute[74960]:         <nova:vcpus>1</nova:vcpus>
Nov 03 12:17:07 user nova-compute[74960]:       </nova:flavor>
Nov 03 12:17:07 user nova-compute[74960]:       <nova:owner>
Nov 03 12:17:07 user nova-compute[74960]:         <nova:user uuid="3f0e3bcd72b44727b52795e0d2997905">tempest-AttachSCSIVolumeTestJSON-961661338-project-member</nova:user>
Nov 03 12:17:07 user nova-compute[74960]:         <nova:project uuid="d7141b1fdcbd4e3b8d8ecabdb9ed4a0b">tempest-AttachSCSIVolumeTestJSON-961661338</nova:project>
Nov 03 12:17:07 user nova-compute[74960]:       </nova:owner>
Nov 03 12:17:07 user nova-compute[74960]:       <nova:root type="image" uuid="62be30e2-c070-4a69-b7a8-3a130347754a"/>
Nov 03 12:17:07 user nova-compute[74960]:       <nova:ports>
Nov 03 12:17:07 user nova-compute[74960]:         <nova:port uuid="c2a92350-10c1-4c73-bfce-b305071289ff">
Nov 03 12:17:07 user nova-compute[74960]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 03 12:17:07 user nova-compute[74960]:         </nova:port>
Nov 03 12:17:07 user nova-compute[74960]:       </nova:ports>
Nov 03 12:17:07 user nova-compute[74960]:     </nova:instance>
Nov 03 12:17:07 user nova-compute[74960]:   </metadata>
Nov 03 12:17:07 user nova-compute[74960]:   <sysinfo type="smbios">
Nov 03 12:17:07 user nova-compute[74960]:     <system>
Nov 03 12:17:07 user nova-compute[74960]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 12:17:07 user nova-compute[74960]:       <entry name="product">OpenStack Nova</entry>
Nov 03 12:17:07 user nova-compute[74960]:       <entry name="version">0.0.0</entry>
Nov 03 12:17:07 user nova-compute[74960]:       <entry name="serial">d00a0872-693c-4cdc-85cd-9806660e9d8d</entry>
Nov 03 12:17:07 user nova-compute[74960]:       <entry name="uuid">d00a0872-693c-4cdc-85cd-9806660e9d8d</entry>
Nov 03 12:17:07 user nova-compute[74960]:       <entry name="family">Virtual Machine</entry>
Nov 03 12:17:07 user nova-compute[74960]:     </system>
Nov 03 12:17:07 user nova-compute[74960]:   </sysinfo>
Nov 03 12:17:07 user nova-compute[74960]:   <os>
Nov 03 12:17:07 user nova-compute[74960]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 12:17:07 user nova-compute[74960]:     <boot dev="hd"/>
Nov 03 12:17:07 user nova-compute[74960]:     <smbios mode="sysinfo"/>
Nov 03 12:17:07 user nova-compute[74960]:   </os>
Nov 03 12:17:07 user nova-compute[74960]:   <features>
Nov 03 12:17:07 user nova-compute[74960]:     <acpi/>
Nov 03 12:17:07 user nova-compute[74960]:     <apic/>
Nov 03 12:17:07 user nova-compute[74960]:     <vmcoreinfo/>
Nov 03 12:17:07 user nova-compute[74960]:   </features>
Nov 03 12:17:07 user nova-compute[74960]:   <clock offset="utc">
Nov 03 12:17:07 user nova-compute[74960]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 12:17:07 user nova-compute[74960]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 12:17:07 user nova-compute[74960]:     <timer name="hpet" present="no"/>
Nov 03 12:17:07 user nova-compute[74960]:   </clock>
Nov 03 12:17:07 user nova-compute[74960]:   <cpu mode="custom" match="exact">
Nov 03 12:17:07 user nova-compute[74960]:     <model>Nehalem</model>
Nov 03 12:17:07 user nova-compute[74960]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 12:17:07 user nova-compute[74960]:   </cpu>
Nov 03 12:17:07 user nova-compute[74960]:   <devices>
Nov 03 12:17:07 user nova-compute[74960]:     <disk type="file" device="disk">
Nov 03 12:17:07 user nova-compute[74960]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 12:17:07 user nova-compute[74960]:       <source file="/opt/stack/data/nova/instances/d00a0872-693c-4cdc-85cd-9806660e9d8d/disk"/>
Nov 03 12:17:07 user nova-compute[74960]:       <target dev="sda" bus="scsi"/>
Nov 03 12:17:07 user nova-compute[74960]:       <address type="drive" controller="0" unit="0"/>
Nov 03 12:17:07 user nova-compute[74960]:     </disk>
Nov 03 12:17:07 user nova-compute[74960]:     <disk type="file" device="cdrom">
Nov 03 12:17:07 user nova-compute[74960]:       <driver name="qemu" type="raw" cache="none"/>
Nov 03 12:17:07 user nova-compute[74960]:       <source file="/opt/stack/data/nova/instances/d00a0872-693c-4cdc-85cd-9806660e9d8d/disk.config"/>
Nov 03 12:17:07 user nova-compute[74960]:       <target dev="sdb" bus="scsi"/>
Nov 03 12:17:07 user nova-compute[74960]:       <address type="drive" controller="0" unit="1"/>
Nov 03 12:17:07 user nova-compute[74960]:     </disk>
Nov 03 12:17:07 user nova-compute[74960]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Nov 03 12:17:07 user nova-compute[74960]:     <interface type="ethernet">
Nov 03 12:17:07 user nova-compute[74960]:       <mac address="fa:16:3e:80:8f:c1"/>
Nov 03 12:17:07 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:17:07 user nova-compute[74960]:       <mtu size="1442"/>
Nov 03 12:17:07 user nova-compute[74960]:       <target dev="tapc2a92350-10"/>
Nov 03 12:17:07 user nova-compute[74960]:     </interface>
Nov 03 12:17:07 user nova-compute[74960]:     <serial type="pty">
Nov 03 12:17:07 user nova-compute[74960]:       <log file="/opt/stack/data/nova/instances/d00a0872-693c-4cdc-85cd-9806660e9d8d/console.log" append="off"/>
Nov 03 12:17:07 user nova-compute[74960]:     </serial>
Nov 03 12:17:07 user nova-compute[74960]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 12:17:07 user nova-compute[74960]:     <video>
Nov 03 12:17:07 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:17:07 user nova-compute[74960]:     </video>
Nov 03 12:17:07 user nova-compute[74960]:     <rng model="virtio">
Nov 03 12:17:07 user nova-compute[74960]:       <backend model="random">/dev/urandom</backend>
Nov 03 12:17:07 user nova-compute[74960]:     </rng>
Nov 03 12:17:07 user nova-compute[74960]:     <controller type="usb" index="0" model="none"/>
Nov 03 12:17:07 user nova-compute[74960]:     <memballoon model="virtio">
Nov 03 12:17:07 user nova-compute[74960]:       <stats period="10"/>
Nov 03 12:17:07 user nova-compute[74960]:     </memballoon>
Nov 03 12:17:07 user nova-compute[74960]:   </devices>
Nov 03 12:17:07 user nova-compute[74960]: </domain>
Nov 03 12:17:07 user nova-compute[74960]:  {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 12:17:07 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-d3c22553-8ca0-49f2-8ce8-d281871e5014 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T12:17:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-2020397840',display_name='tempest-AttachSCSIVolumeTestJSON-server-2020397840',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-2020397840',id=4,image_ref='62be30e2-c070-4a69-b7a8-3a130347754a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNuGj4AYDOHlTOet0qwY1JSfNnHzWcfTMoU2fNeqdmJ0EaQtGFk6JonMe/lX1WsxAFPVz6DiGV6Toyq90KozUyweOS7uW43e4KWbM9YRQfEfIZcrKMO5uosMQOe4n+stuA==',key_name='tempest-keypair-1224384623',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d7141b1fdcbd4e3b8d8ecabdb9ed4a0b',ramdisk_id='',reservation_id='r-4dx4ar8t',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='62be30e2-c070-4a69-b7a8-3a130347754a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-961661338',owner_user_name='tempest-AttachSCSIVolumeTestJSON-961661338-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:17:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f0e3bcd72b44727b52795e0d2997905',uuid=d00a0872-693c-4cdc-85cd-9806660e9d8d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c2a92350-10c1-4c73-bfce-b305071289ff", "address": "fa:16:3e:80:8f:c1", "network": {"id": "10b59e93-b9b0-443a-8a8a-755bf2a87b0c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1169763894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7141b1fdcbd4e3b8d8ecabdb9ed4a0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2a92350-10", "ovs_interfaceid": "c2a92350-10c1-4c73-bfce-b305071289ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 12:17:07 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-d3c22553-8ca0-49f2-8ce8-d281871e5014 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Converting VIF {"id": "c2a92350-10c1-4c73-bfce-b305071289ff", "address": "fa:16:3e:80:8f:c1", "network": {"id": "10b59e93-b9b0-443a-8a8a-755bf2a87b0c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1169763894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7141b1fdcbd4e3b8d8ecabdb9ed4a0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2a92350-10", "ovs_interfaceid": "c2a92350-10c1-4c73-bfce-b305071289ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:17:07 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-d3c22553-8ca0-49f2-8ce8-d281871e5014 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:8f:c1,bridge_name='br-int',has_traffic_filtering=True,id=c2a92350-10c1-4c73-bfce-b305071289ff,network=Network(10b59e93-b9b0-443a-8a8a-755bf2a87b0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2a92350-10') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:17:07 user nova-compute[74960]: DEBUG os_vif [None req-d3c22553-8ca0-49f2-8ce8-d281871e5014 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:8f:c1,bridge_name='br-int',has_traffic_filtering=True,id=c2a92350-10c1-4c73-bfce-b305071289ff,network=Network(10b59e93-b9b0-443a-8a8a-755bf2a87b0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2a92350-10') {{(pid=74960) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 12:17:07 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:17:07 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:17:07 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 12:17:07 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:17:07 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ca25d734-8480-5c60-8946-21d26cb9717a', '_type': 'linux-noop'}}, row=False) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:17:07 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:17:07 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:17:07 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:17:07 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc2a92350-10, may_exist=True, interface_attrs={}) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:17:07 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc2a92350-10, col_values=(('qos', UUID('6b0359ff-559e-4e86-b632-3cb5e14c6824')),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:17:07 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc2a92350-10, col_values=(('external_ids', {'iface-id': 'c2a92350-10c1-4c73-bfce-b305071289ff', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:80:8f:c1', 'vm-uuid': 'd00a0872-693c-4cdc-85cd-9806660e9d8d'}),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:17:07 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:17:07 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:17:07 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:17:07 user nova-compute[74960]: INFO os_vif [None req-d3c22553-8ca0-49f2-8ce8-d281871e5014 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:8f:c1,bridge_name='br-int',has_traffic_filtering=True,id=c2a92350-10c1-4c73-bfce-b305071289ff,network=Network(10b59e93-b9b0-443a-8a8a-755bf2a87b0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2a92350-10')
Nov 03 12:17:07 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-d3c22553-8ca0-49f2-8ce8-d281871e5014 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] No BDM found with device name sda, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:17:07 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-d3c22553-8ca0-49f2-8ce8-d281871e5014 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:17:07 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-d3c22553-8ca0-49f2-8ce8-d281871e5014 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] No VIF found with MAC fa:16:3e:80:8f:c1, not building metadata {{(pid=74960) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 12:17:07 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-d3c22553-8ca0-49f2-8ce8-d281871e5014 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] [instance: d00a0872-693c-4cdc-85cd-9806660e9d8d] Using config drive
Nov 03 12:17:08 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:17:08 user nova-compute[74960]: DEBUG nova.network.neutron [req-3db3e06c-631b-4c6c-a868-1817e9b8ceed req-57f3a8db-7b9a-4e6d-a578-d60b1ee222c1 service nova] [instance: d00a0872-693c-4cdc-85cd-9806660e9d8d] Updated VIF entry in instance network info cache for port c2a92350-10c1-4c73-bfce-b305071289ff. {{(pid=74960) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 12:17:08 user nova-compute[74960]: DEBUG nova.network.neutron [req-3db3e06c-631b-4c6c-a868-1817e9b8ceed req-57f3a8db-7b9a-4e6d-a578-d60b1ee222c1 service nova] [instance: d00a0872-693c-4cdc-85cd-9806660e9d8d] Updating instance_info_cache with network_info: [{"id": "c2a92350-10c1-4c73-bfce-b305071289ff", "address": "fa:16:3e:80:8f:c1", "network": {"id": "10b59e93-b9b0-443a-8a8a-755bf2a87b0c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1169763894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7141b1fdcbd4e3b8d8ecabdb9ed4a0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2a92350-10", "ovs_interfaceid": "c2a92350-10c1-4c73-bfce-b305071289ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:17:08 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-3db3e06c-631b-4c6c-a868-1817e9b8ceed req-57f3a8db-7b9a-4e6d-a578-d60b1ee222c1 service nova] Releasing lock "refresh_cache-d00a0872-693c-4cdc-85cd-9806660e9d8d" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:17:08 user nova-compute[74960]: DEBUG nova.network.neutron [None req-c3780b46-0bbf-4923-b322-ac59026ae697 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] [instance: e91dfcf4-caef-43d0-a56b-b1282363d4e0] Successfully created port: ce7c2b72-12cb-4251-b6ac-f2f6724a509a {{(pid=74960) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 12:17:09 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-d3c22553-8ca0-49f2-8ce8-d281871e5014 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] [instance: d00a0872-693c-4cdc-85cd-9806660e9d8d] Creating config drive at /opt/stack/data/nova/instances/d00a0872-693c-4cdc-85cd-9806660e9d8d/disk.config
Nov 03 12:17:09 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-d3c22553-8ca0-49f2-8ce8-d281871e5014 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/d00a0872-693c-4cdc-85cd-9806660e9d8d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpk2cs97s1 {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:17:09 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-d3c22553-8ca0-49f2-8ce8-d281871e5014 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/d00a0872-693c-4cdc-85cd-9806660e9d8d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpk2cs97s1" returned: 0 in 0.181s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:17:10 user nova-compute[74960]: DEBUG nova.network.neutron [None req-c3780b46-0bbf-4923-b322-ac59026ae697 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] [instance: e91dfcf4-caef-43d0-a56b-b1282363d4e0] Successfully updated port: ce7c2b72-12cb-4251-b6ac-f2f6724a509a {{(pid=74960) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 12:17:10 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c3780b46-0bbf-4923-b322-ac59026ae697 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Acquiring lock "refresh_cache-e91dfcf4-caef-43d0-a56b-b1282363d4e0" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:17:10 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c3780b46-0bbf-4923-b322-ac59026ae697 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Acquired lock "refresh_cache-e91dfcf4-caef-43d0-a56b-b1282363d4e0" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:17:10 user nova-compute[74960]: DEBUG nova.network.neutron [None req-c3780b46-0bbf-4923-b322-ac59026ae697 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] [instance: e91dfcf4-caef-43d0-a56b-b1282363d4e0] Building network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 12:17:10 user nova-compute[74960]: DEBUG nova.compute.manager [req-4183b81f-a5b6-4595-8c34-028b63661d54 req-901e433c-b287-4759-8b96-d26353511b4a service nova] [instance: e91dfcf4-caef-43d0-a56b-b1282363d4e0] Received event network-changed-ce7c2b72-12cb-4251-b6ac-f2f6724a509a {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:17:10 user nova-compute[74960]: DEBUG nova.compute.manager [req-4183b81f-a5b6-4595-8c34-028b63661d54 req-901e433c-b287-4759-8b96-d26353511b4a service nova] [instance: e91dfcf4-caef-43d0-a56b-b1282363d4e0] Refreshing instance network info cache due to event network-changed-ce7c2b72-12cb-4251-b6ac-f2f6724a509a. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 12:17:10 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-4183b81f-a5b6-4595-8c34-028b63661d54 req-901e433c-b287-4759-8b96-d26353511b4a service nova] Acquiring lock "refresh_cache-e91dfcf4-caef-43d0-a56b-b1282363d4e0" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:17:10 user nova-compute[74960]: DEBUG nova.network.neutron [None req-c3780b46-0bbf-4923-b322-ac59026ae697 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] [instance: e91dfcf4-caef-43d0-a56b-b1282363d4e0] Instance cache missing network info. {{(pid=74960) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 12:17:10 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:17:10 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:17:10 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:17:11 user nova-compute[74960]: DEBUG nova.network.neutron [None req-c3780b46-0bbf-4923-b322-ac59026ae697 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] [instance: e91dfcf4-caef-43d0-a56b-b1282363d4e0] Updating instance_info_cache with network_info: [{"id": "ce7c2b72-12cb-4251-b6ac-f2f6724a509a", "address": "fa:16:3e:ef:a8:ac", "network": {"id": "9f0b1c9c-af46-4948-aeb8-e73013159ad4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2126041996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "58667b53361b490fa7f0236ee65934c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce7c2b72-12", "ovs_interfaceid": "ce7c2b72-12cb-4251-b6ac-f2f6724a509a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:17:11 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c3780b46-0bbf-4923-b322-ac59026ae697 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Releasing lock "refresh_cache-e91dfcf4-caef-43d0-a56b-b1282363d4e0" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:17:11 user nova-compute[74960]: DEBUG nova.compute.manager [None req-c3780b46-0bbf-4923-b322-ac59026ae697 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] [instance: e91dfcf4-caef-43d0-a56b-b1282363d4e0] Instance network_info: |[{"id": "ce7c2b72-12cb-4251-b6ac-f2f6724a509a", "address": "fa:16:3e:ef:a8:ac", "network": {"id": "9f0b1c9c-af46-4948-aeb8-e73013159ad4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2126041996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "58667b53361b490fa7f0236ee65934c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce7c2b72-12", "ovs_interfaceid": "ce7c2b72-12cb-4251-b6ac-f2f6724a509a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74960) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 12:17:11 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-4183b81f-a5b6-4595-8c34-028b63661d54 req-901e433c-b287-4759-8b96-d26353511b4a service nova] Acquired lock "refresh_cache-e91dfcf4-caef-43d0-a56b-b1282363d4e0" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:17:11 user nova-compute[74960]: DEBUG nova.network.neutron [req-4183b81f-a5b6-4595-8c34-028b63661d54 req-901e433c-b287-4759-8b96-d26353511b4a service nova] [instance: e91dfcf4-caef-43d0-a56b-b1282363d4e0] Refreshing network info cache for port ce7c2b72-12cb-4251-b6ac-f2f6724a509a {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 12:17:11 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-c3780b46-0bbf-4923-b322-ac59026ae697 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] [instance: e91dfcf4-caef-43d0-a56b-b1282363d4e0] Start _get_guest_xml network_info=[{"id": "ce7c2b72-12cb-4251-b6ac-f2f6724a509a", "address": "fa:16:3e:ef:a8:ac", "network": {"id": "9f0b1c9c-af46-4948-aeb8-e73013159ad4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2126041996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "58667b53361b490fa7f0236ee65934c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce7c2b72-12", "ovs_interfaceid": "ce7c2b72-12cb-4251-b6ac-f2f6724a509a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=549f51ba-ac69-494b-8de1-34635aa2d7cf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='63ee9c80c632442fb0379f47b784bd20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T12:13:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'image_id': '549f51ba-ac69-494b-8de1-34635aa2d7cf'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 12:17:11 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:17:11 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-c3780b46-0bbf-4923-b322-ac59026ae697 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:17:11 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-c3780b46-0bbf-4923-b322-ac59026ae697 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:17:11 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-c3780b46-0bbf-4923-b322-ac59026ae697 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 12:17:11 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-c3780b46-0bbf-4923-b322-ac59026ae697 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] CPU controller missing on host. {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 12:17:11 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-c3780b46-0bbf-4923-b322-ac59026ae697 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 12:17:11 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-c3780b46-0bbf-4923-b322-ac59026ae697 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] CPU controller found on host. {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 12:17:11 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-c3780b46-0bbf-4923-b322-ac59026ae697 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74960) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 12:17:11 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-c3780b46-0bbf-4923-b322-ac59026ae697 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=549f51ba-ac69-494b-8de1-34635aa2d7cf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='63ee9c80c632442fb0379f47b784bd20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T12:13:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 12:17:11 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-c3780b46-0bbf-4923-b322-ac59026ae697 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Flavor limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 12:17:11 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-c3780b46-0bbf-4923-b322-ac59026ae697 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Image limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 12:17:11 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-c3780b46-0bbf-4923-b322-ac59026ae697 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Flavor pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 12:17:11 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-c3780b46-0bbf-4923-b322-ac59026ae697 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Image pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 12:17:11 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-c3780b46-0bbf-4923-b322-ac59026ae697 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 12:17:11 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-c3780b46-0bbf-4923-b322-ac59026ae697 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 12:17:11 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-c3780b46-0bbf-4923-b322-ac59026ae697 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 12:17:11 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-c3780b46-0bbf-4923-b322-ac59026ae697 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Got 1 possible topologies {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 12:17:11 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-c3780b46-0bbf-4923-b322-ac59026ae697 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 12:17:11 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-c3780b46-0bbf-4923-b322-ac59026ae697 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 12:17:11 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-c3780b46-0bbf-4923-b322-ac59026ae697 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:17:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1967024778',display_name='tempest-VolumesAdminNegativeTest-server-1967024778',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1967024778',id=5,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCMRp5CndTHruRz19CmFaHvxQdY1bZiINFFMbD9NEa0ZEnxlBm61dlrJ//KM/VfEo2fNFfJ7JYDkZwHnBvcTZ2XRaqB7d0FWy1TWLDCFzpXnBYvtZaRQ4NRxpdAJZZd/UQ==',key_name='tempest-keypair-58872133',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='58667b53361b490fa7f0236ee65934c5',ramdisk_id='',reservation_id='r-es0lpr0i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1697926693',owner_user_name='tempest-VolumesAdminNegativeTest-1697926693-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:17:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='26930c47348248f681093b8e74e8c73c',uuid=e91dfcf4-caef-43d0-a56b-b1282363d4e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ce7c2b72-12cb-4251-b6ac-f2f6724a509a", "address": "fa:16:3e:ef:a8:ac", "network": {"id": "9f0b1c9c-af46-4948-aeb8-e73013159ad4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2126041996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "58667b53361b490fa7f0236ee65934c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce7c2b72-12", "ovs_interfaceid": "ce7c2b72-12cb-4251-b6ac-f2f6724a509a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74960) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 12:17:11 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-c3780b46-0bbf-4923-b322-ac59026ae697 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Converting VIF {"id": "ce7c2b72-12cb-4251-b6ac-f2f6724a509a", "address": "fa:16:3e:ef:a8:ac", "network": {"id": "9f0b1c9c-af46-4948-aeb8-e73013159ad4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2126041996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "58667b53361b490fa7f0236ee65934c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce7c2b72-12", "ovs_interfaceid": "ce7c2b72-12cb-4251-b6ac-f2f6724a509a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:17:11 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-c3780b46-0bbf-4923-b322-ac59026ae697 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:a8:ac,bridge_name='br-int',has_traffic_filtering=True,id=ce7c2b72-12cb-4251-b6ac-f2f6724a509a,network=Network(9f0b1c9c-af46-4948-aeb8-e73013159ad4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce7c2b72-12') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:17:11 user nova-compute[74960]: DEBUG nova.objects.instance [None req-c3780b46-0bbf-4923-b322-ac59026ae697 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Lazy-loading 'pci_devices' on Instance uuid e91dfcf4-caef-43d0-a56b-b1282363d4e0 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:17:11 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-c3780b46-0bbf-4923-b322-ac59026ae697 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] [instance: e91dfcf4-caef-43d0-a56b-b1282363d4e0] End _get_guest_xml xml=<domain type="kvm">
Nov 03 12:17:11 user nova-compute[74960]:   <uuid>e91dfcf4-caef-43d0-a56b-b1282363d4e0</uuid>
Nov 03 12:17:11 user nova-compute[74960]:   <name>instance-00000005</name>
Nov 03 12:17:11 user nova-compute[74960]:   <memory>524288</memory>
Nov 03 12:17:11 user nova-compute[74960]:   <vcpu>1</vcpu>
Nov 03 12:17:11 user nova-compute[74960]:   <metadata>
Nov 03 12:17:11 user nova-compute[74960]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 12:17:11 user nova-compute[74960]:       <nova:package version="0.0.0"/>
Nov 03 12:17:11 user nova-compute[74960]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1967024778</nova:name>
Nov 03 12:17:11 user nova-compute[74960]:       <nova:creationTime>2023-11-03 12:17:11</nova:creationTime>
Nov 03 12:17:11 user nova-compute[74960]:       <nova:flavor name="m1.tiny">
Nov 03 12:17:11 user nova-compute[74960]:         <nova:memory>512</nova:memory>
Nov 03 12:17:11 user nova-compute[74960]:         <nova:disk>1</nova:disk>
Nov 03 12:17:11 user nova-compute[74960]:         <nova:swap>0</nova:swap>
Nov 03 12:17:11 user nova-compute[74960]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 12:17:11 user nova-compute[74960]:         <nova:vcpus>1</nova:vcpus>
Nov 03 12:17:11 user nova-compute[74960]:       </nova:flavor>
Nov 03 12:17:11 user nova-compute[74960]:       <nova:owner>
Nov 03 12:17:11 user nova-compute[74960]:         <nova:user uuid="26930c47348248f681093b8e74e8c73c">tempest-VolumesAdminNegativeTest-1697926693-project-member</nova:user>
Nov 03 12:17:11 user nova-compute[74960]:         <nova:project uuid="58667b53361b490fa7f0236ee65934c5">tempest-VolumesAdminNegativeTest-1697926693</nova:project>
Nov 03 12:17:11 user nova-compute[74960]:       </nova:owner>
Nov 03 12:17:11 user nova-compute[74960]:       <nova:root type="image" uuid="549f51ba-ac69-494b-8de1-34635aa2d7cf"/>
Nov 03 12:17:11 user nova-compute[74960]:       <nova:ports>
Nov 03 12:17:11 user nova-compute[74960]:         <nova:port uuid="ce7c2b72-12cb-4251-b6ac-f2f6724a509a">
Nov 03 12:17:11 user nova-compute[74960]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 03 12:17:11 user nova-compute[74960]:         </nova:port>
Nov 03 12:17:11 user nova-compute[74960]:       </nova:ports>
Nov 03 12:17:11 user nova-compute[74960]:     </nova:instance>
Nov 03 12:17:11 user nova-compute[74960]:   </metadata>
Nov 03 12:17:11 user nova-compute[74960]:   <sysinfo type="smbios">
Nov 03 12:17:11 user nova-compute[74960]:     <system>
Nov 03 12:17:11 user nova-compute[74960]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 12:17:11 user nova-compute[74960]:       <entry name="product">OpenStack Nova</entry>
Nov 03 12:17:11 user nova-compute[74960]:       <entry name="version">0.0.0</entry>
Nov 03 12:17:11 user nova-compute[74960]:       <entry name="serial">e91dfcf4-caef-43d0-a56b-b1282363d4e0</entry>
Nov 03 12:17:11 user nova-compute[74960]:       <entry name="uuid">e91dfcf4-caef-43d0-a56b-b1282363d4e0</entry>
Nov 03 12:17:11 user nova-compute[74960]:       <entry name="family">Virtual Machine</entry>
Nov 03 12:17:11 user nova-compute[74960]:     </system>
Nov 03 12:17:11 user nova-compute[74960]:   </sysinfo>
Nov 03 12:17:11 user nova-compute[74960]:   <os>
Nov 03 12:17:11 user nova-compute[74960]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 12:17:11 user nova-compute[74960]:     <boot dev="hd"/>
Nov 03 12:17:11 user nova-compute[74960]:     <smbios mode="sysinfo"/>
Nov 03 12:17:11 user nova-compute[74960]:   </os>
Nov 03 12:17:11 user nova-compute[74960]:   <features>
Nov 03 12:17:11 user nova-compute[74960]:     <acpi/>
Nov 03 12:17:11 user nova-compute[74960]:     <apic/>
Nov 03 12:17:11 user nova-compute[74960]:     <vmcoreinfo/>
Nov 03 12:17:11 user nova-compute[74960]:   </features>
Nov 03 12:17:11 user nova-compute[74960]:   <clock offset="utc">
Nov 03 12:17:11 user nova-compute[74960]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 12:17:11 user nova-compute[74960]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 12:17:11 user nova-compute[74960]:     <timer name="hpet" present="no"/>
Nov 03 12:17:11 user nova-compute[74960]:   </clock>
Nov 03 12:17:11 user nova-compute[74960]:   <cpu mode="custom" match="exact">
Nov 03 12:17:11 user nova-compute[74960]:     <model>Nehalem</model>
Nov 03 12:17:11 user nova-compute[74960]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 12:17:11 user nova-compute[74960]:   </cpu>
Nov 03 12:17:11 user nova-compute[74960]:   <devices>
Nov 03 12:17:11 user nova-compute[74960]:     <disk type="file" device="disk">
Nov 03 12:17:11 user nova-compute[74960]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 12:17:11 user nova-compute[74960]:       <source file="/opt/stack/data/nova/instances/e91dfcf4-caef-43d0-a56b-b1282363d4e0/disk"/>
Nov 03 12:17:11 user nova-compute[74960]:       <target dev="vda" bus="virtio"/>
Nov 03 12:17:11 user nova-compute[74960]:     </disk>
Nov 03 12:17:11 user nova-compute[74960]:     <interface type="ethernet">
Nov 03 12:17:11 user nova-compute[74960]:       <mac address="fa:16:3e:ef:a8:ac"/>
Nov 03 12:17:11 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:17:11 user nova-compute[74960]:       <mtu size="1442"/>
Nov 03 12:17:11 user nova-compute[74960]:       <target dev="tapce7c2b72-12"/>
Nov 03 12:17:11 user nova-compute[74960]:     </interface>
Nov 03 12:17:11 user nova-compute[74960]:     <serial type="pty">
Nov 03 12:17:11 user nova-compute[74960]:       <log file="/opt/stack/data/nova/instances/e91dfcf4-caef-43d0-a56b-b1282363d4e0/console.log" append="off"/>
Nov 03 12:17:11 user nova-compute[74960]:     </serial>
Nov 03 12:17:11 user nova-compute[74960]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 12:17:11 user nova-compute[74960]:     <video>
Nov 03 12:17:11 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:17:11 user nova-compute[74960]:     </video>
Nov 03 12:17:11 user nova-compute[74960]:     <rng model="virtio">
Nov 03 12:17:11 user nova-compute[74960]:       <backend model="random">/dev/urandom</backend>
Nov 03 12:17:11 user nova-compute[74960]:     </rng>
Nov 03 12:17:11 user nova-compute[74960]:     <controller type="usb" index="0" model="none"/>
Nov 03 12:17:11 user nova-compute[74960]:     <memballoon model="virtio">
Nov 03 12:17:11 user nova-compute[74960]:       <stats period="10"/>
Nov 03 12:17:11 user nova-compute[74960]:     </memballoon>
Nov 03 12:17:11 user nova-compute[74960]:   </devices>
Nov 03 12:17:11 user nova-compute[74960]: </domain>
Nov 03 12:17:11 user nova-compute[74960]:  {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 12:17:11 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-c3780b46-0bbf-4923-b322-ac59026ae697 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:17:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1967024778',display_name='tempest-VolumesAdminNegativeTest-server-1967024778',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1967024778',id=5,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCMRp5CndTHruRz19CmFaHvxQdY1bZiINFFMbD9NEa0ZEnxlBm61dlrJ//KM/VfEo2fNFfJ7JYDkZwHnBvcTZ2XRaqB7d0FWy1TWLDCFzpXnBYvtZaRQ4NRxpdAJZZd/UQ==',key_name='tempest-keypair-58872133',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='58667b53361b490fa7f0236ee65934c5',ramdisk_id='',reservation_id='r-es0lpr0i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1697926693',owner_user_name='tempest-VolumesAdminNegativeTest-1697926693-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:17:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='26930c47348248f681093b8e74e8c73c',uuid=e91dfcf4-caef-43d0-a56b-b1282363d4e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ce7c2b72-12cb-4251-b6ac-f2f6724a509a", "address": "fa:16:3e:ef:a8:ac", "network": {"id": "9f0b1c9c-af46-4948-aeb8-e73013159ad4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2126041996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "58667b53361b490fa7f0236ee65934c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce7c2b72-12", "ovs_interfaceid": "ce7c2b72-12cb-4251-b6ac-f2f6724a509a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 12:17:11 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-c3780b46-0bbf-4923-b322-ac59026ae697 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Converting VIF {"id": "ce7c2b72-12cb-4251-b6ac-f2f6724a509a", "address": "fa:16:3e:ef:a8:ac", "network": {"id": "9f0b1c9c-af46-4948-aeb8-e73013159ad4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2126041996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "58667b53361b490fa7f0236ee65934c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce7c2b72-12", "ovs_interfaceid": "ce7c2b72-12cb-4251-b6ac-f2f6724a509a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:17:11 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-c3780b46-0bbf-4923-b322-ac59026ae697 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:a8:ac,bridge_name='br-int',has_traffic_filtering=True,id=ce7c2b72-12cb-4251-b6ac-f2f6724a509a,network=Network(9f0b1c9c-af46-4948-aeb8-e73013159ad4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce7c2b72-12') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:17:11 user nova-compute[74960]: DEBUG os_vif [None req-c3780b46-0bbf-4923-b322-ac59026ae697 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:a8:ac,bridge_name='br-int',has_traffic_filtering=True,id=ce7c2b72-12cb-4251-b6ac-f2f6724a509a,network=Network(9f0b1c9c-af46-4948-aeb8-e73013159ad4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce7c2b72-12') {{(pid=74960) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 12:17:11 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:17:11 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:17:11 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 12:17:11 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:17:11 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6e331578-da86-5dfa-8395-26b319df0b36', '_type': 'linux-noop'}}, row=False) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:17:11 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:17:11 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:17:11 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:17:11 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapce7c2b72-12, may_exist=True, interface_attrs={}) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:17:11 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapce7c2b72-12, col_values=(('qos', UUID('bc25e2ca-cd96-4216-b8a8-46588e30958d')),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:17:11 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapce7c2b72-12, col_values=(('external_ids', {'iface-id': 'ce7c2b72-12cb-4251-b6ac-f2f6724a509a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ef:a8:ac', 'vm-uuid': 'e91dfcf4-caef-43d0-a56b-b1282363d4e0'}),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:17:11 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:17:11 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:17:11 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:17:11 user nova-compute[74960]: INFO os_vif [None req-c3780b46-0bbf-4923-b322-ac59026ae697 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:a8:ac,bridge_name='br-int',has_traffic_filtering=True,id=ce7c2b72-12cb-4251-b6ac-f2f6724a509a,network=Network(9f0b1c9c-af46-4948-aeb8-e73013159ad4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce7c2b72-12')
Nov 03 12:17:11 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:17:11 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:17:11 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-c3780b46-0bbf-4923-b322-ac59026ae697 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] No BDM found with device name vda, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:17:11 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-c3780b46-0bbf-4923-b322-ac59026ae697 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] No VIF found with MAC fa:16:3e:ef:a8:ac, not building metadata {{(pid=74960) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 12:17:11 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:17:11 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:17:12 user nova-compute[74960]: DEBUG nova.network.neutron [req-4183b81f-a5b6-4595-8c34-028b63661d54 req-901e433c-b287-4759-8b96-d26353511b4a service nova] [instance: e91dfcf4-caef-43d0-a56b-b1282363d4e0] Updated VIF entry in instance network info cache for port ce7c2b72-12cb-4251-b6ac-f2f6724a509a. {{(pid=74960) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 12:17:12 user nova-compute[74960]: DEBUG nova.network.neutron [req-4183b81f-a5b6-4595-8c34-028b63661d54 req-901e433c-b287-4759-8b96-d26353511b4a service nova] [instance: e91dfcf4-caef-43d0-a56b-b1282363d4e0] Updating instance_info_cache with network_info: [{"id": "ce7c2b72-12cb-4251-b6ac-f2f6724a509a", "address": "fa:16:3e:ef:a8:ac", "network": {"id": "9f0b1c9c-af46-4948-aeb8-e73013159ad4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2126041996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "58667b53361b490fa7f0236ee65934c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce7c2b72-12", "ovs_interfaceid": "ce7c2b72-12cb-4251-b6ac-f2f6724a509a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:17:12 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-4183b81f-a5b6-4595-8c34-028b63661d54 req-901e433c-b287-4759-8b96-d26353511b4a service nova] Releasing lock "refresh_cache-e91dfcf4-caef-43d0-a56b-b1282363d4e0" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:17:12 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:17:13 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:17:13 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:17:13 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:17:13 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:17:14 user nova-compute[74960]: DEBUG nova.compute.manager [None req-d3c22553-8ca0-49f2-8ce8-d281871e5014 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] [instance: d00a0872-693c-4cdc-85cd-9806660e9d8d] Instance event wait completed in 0 seconds for  {{(pid=74960) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 12:17:14 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-d3c22553-8ca0-49f2-8ce8-d281871e5014 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] [instance: d00a0872-693c-4cdc-85cd-9806660e9d8d] Guest created on hypervisor {{(pid=74960) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 12:17:14 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: d00a0872-693c-4cdc-85cd-9806660e9d8d] Instance spawned successfully.
Nov 03 12:17:14 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-d3c22553-8ca0-49f2-8ce8-d281871e5014 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] [instance: d00a0872-693c-4cdc-85cd-9806660e9d8d] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 12:17:14 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-d3c22553-8ca0-49f2-8ce8-d281871e5014 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] [instance: d00a0872-693c-4cdc-85cd-9806660e9d8d] Found default for hw_input_bus of None {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:17:14 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-d3c22553-8ca0-49f2-8ce8-d281871e5014 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] [instance: d00a0872-693c-4cdc-85cd-9806660e9d8d] Found default for hw_pointer_model of None {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:17:14 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-d3c22553-8ca0-49f2-8ce8-d281871e5014 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] [instance: d00a0872-693c-4cdc-85cd-9806660e9d8d] Found default for hw_video_model of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:17:14 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-d3c22553-8ca0-49f2-8ce8-d281871e5014 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] [instance: d00a0872-693c-4cdc-85cd-9806660e9d8d] Found default for hw_vif_model of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:17:14 user nova-compute[74960]: INFO nova.compute.manager [None req-d3c22553-8ca0-49f2-8ce8-d281871e5014 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] [instance: d00a0872-693c-4cdc-85cd-9806660e9d8d] Took 11.02 seconds to spawn the instance on the hypervisor.
Nov 03 12:17:14 user nova-compute[74960]: DEBUG nova.compute.manager [None req-d3c22553-8ca0-49f2-8ce8-d281871e5014 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] [instance: d00a0872-693c-4cdc-85cd-9806660e9d8d] Checking state {{(pid=74960) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 12:17:14 user nova-compute[74960]: INFO nova.compute.manager [None req-d3c22553-8ca0-49f2-8ce8-d281871e5014 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] [instance: d00a0872-693c-4cdc-85cd-9806660e9d8d] Took 12.18 seconds to build instance.
Nov 03 12:17:14 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:17:14 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-d3c22553-8ca0-49f2-8ce8-d281871e5014 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Lock "d00a0872-693c-4cdc-85cd-9806660e9d8d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.379s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:17:14 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:17:14 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:17:14 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:17:16 user nova-compute[74960]: DEBUG nova.compute.manager [None req-c3780b46-0bbf-4923-b322-ac59026ae697 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] [instance: e91dfcf4-caef-43d0-a56b-b1282363d4e0] Instance event wait completed in 0 seconds for  {{(pid=74960) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 12:17:16 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-c3780b46-0bbf-4923-b322-ac59026ae697 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] [instance: e91dfcf4-caef-43d0-a56b-b1282363d4e0] Guest created on hypervisor {{(pid=74960) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 12:17:16 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: e91dfcf4-caef-43d0-a56b-b1282363d4e0] Instance spawned successfully.
Nov 03 12:17:16 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-c3780b46-0bbf-4923-b322-ac59026ae697 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] [instance: e91dfcf4-caef-43d0-a56b-b1282363d4e0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 12:17:16 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-c3780b46-0bbf-4923-b322-ac59026ae697 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] [instance: e91dfcf4-caef-43d0-a56b-b1282363d4e0] Found default for hw_cdrom_bus of ide {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:17:16 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-c3780b46-0bbf-4923-b322-ac59026ae697 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] [instance: e91dfcf4-caef-43d0-a56b-b1282363d4e0] Found default for hw_disk_bus of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:17:16 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-c3780b46-0bbf-4923-b322-ac59026ae697 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] [instance: e91dfcf4-caef-43d0-a56b-b1282363d4e0] Found default for hw_input_bus of None {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:17:16 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-c3780b46-0bbf-4923-b322-ac59026ae697 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] [instance: e91dfcf4-caef-43d0-a56b-b1282363d4e0] Found default for hw_pointer_model of None {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:17:16 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-c3780b46-0bbf-4923-b322-ac59026ae697 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] [instance: e91dfcf4-caef-43d0-a56b-b1282363d4e0] Found default for hw_video_model of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:17:16 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-c3780b46-0bbf-4923-b322-ac59026ae697 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] [instance: e91dfcf4-caef-43d0-a56b-b1282363d4e0] Found default for hw_vif_model of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:17:16 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:17:16 user nova-compute[74960]: INFO nova.compute.manager [None req-c3780b46-0bbf-4923-b322-ac59026ae697 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] [instance: e91dfcf4-caef-43d0-a56b-b1282363d4e0] Took 10.42 seconds to spawn the instance on the hypervisor.
Nov 03 12:17:16 user nova-compute[74960]: DEBUG nova.compute.manager [None req-c3780b46-0bbf-4923-b322-ac59026ae697 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] [instance: e91dfcf4-caef-43d0-a56b-b1282363d4e0] Checking state {{(pid=74960) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 12:17:16 user nova-compute[74960]: INFO nova.compute.manager [None req-c3780b46-0bbf-4923-b322-ac59026ae697 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] [instance: e91dfcf4-caef-43d0-a56b-b1282363d4e0] Took 11.44 seconds to build instance.
Nov 03 12:17:16 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c3780b46-0bbf-4923-b322-ac59026ae697 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Lock "e91dfcf4-caef-43d0-a56b-b1282363d4e0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.610s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:17:17 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:17:17 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-ff586988-8547-4bd3-8329-23b093a330b9 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] Acquiring lock "8381c969-6a2d-4934-aadd-660ffa246b05" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:17:17 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-ff586988-8547-4bd3-8329-23b093a330b9 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] Lock "8381c969-6a2d-4934-aadd-660ffa246b05" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:17:17 user nova-compute[74960]: DEBUG nova.compute.manager [None req-ff586988-8547-4bd3-8329-23b093a330b9 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] [instance: 8381c969-6a2d-4934-aadd-660ffa246b05] Starting instance... {{(pid=74960) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 12:17:17 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-ff586988-8547-4bd3-8329-23b093a330b9 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:17:17 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-ff586988-8547-4bd3-8329-23b093a330b9 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:17:17 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-ff586988-8547-4bd3-8329-23b093a330b9 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74960) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 12:17:17 user nova-compute[74960]: INFO nova.compute.claims [None req-ff586988-8547-4bd3-8329-23b093a330b9 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] [instance: 8381c969-6a2d-4934-aadd-660ffa246b05] Claim successful on node user
Nov 03 12:17:18 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-50df3a37-1c20-4e71-81a3-553ace77ad46 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Acquiring lock "0a520c41-19c0-47ba-ada8-023ee9c12ca6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:17:18 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-50df3a37-1c20-4e71-81a3-553ace77ad46 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Lock "0a520c41-19c0-47ba-ada8-023ee9c12ca6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:17:18 user nova-compute[74960]: DEBUG nova.compute.manager [None req-50df3a37-1c20-4e71-81a3-553ace77ad46 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] Starting instance... {{(pid=74960) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 12:17:18 user nova-compute[74960]: DEBUG nova.compute.manager [req-5790c0c8-ce59-44bf-9a31-a1b553f3eaf9 req-41530b23-95a8-45dd-bdb7-1768f6c67358 service nova] [instance: d00a0872-693c-4cdc-85cd-9806660e9d8d] Received event network-vif-plugged-c2a92350-10c1-4c73-bfce-b305071289ff {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:17:18 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-5790c0c8-ce59-44bf-9a31-a1b553f3eaf9 req-41530b23-95a8-45dd-bdb7-1768f6c67358 service nova] Acquiring lock "d00a0872-693c-4cdc-85cd-9806660e9d8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:17:18 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-5790c0c8-ce59-44bf-9a31-a1b553f3eaf9 req-41530b23-95a8-45dd-bdb7-1768f6c67358 service nova] Lock "d00a0872-693c-4cdc-85cd-9806660e9d8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:17:18 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-5790c0c8-ce59-44bf-9a31-a1b553f3eaf9 req-41530b23-95a8-45dd-bdb7-1768f6c67358 service nova] Lock "d00a0872-693c-4cdc-85cd-9806660e9d8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:17:18 user nova-compute[74960]: DEBUG nova.compute.manager [req-5790c0c8-ce59-44bf-9a31-a1b553f3eaf9 req-41530b23-95a8-45dd-bdb7-1768f6c67358 service nova] [instance: d00a0872-693c-4cdc-85cd-9806660e9d8d] No waiting events found dispatching network-vif-plugged-c2a92350-10c1-4c73-bfce-b305071289ff {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:17:18 user nova-compute[74960]: WARNING nova.compute.manager [req-5790c0c8-ce59-44bf-9a31-a1b553f3eaf9 req-41530b23-95a8-45dd-bdb7-1768f6c67358 service nova] [instance: d00a0872-693c-4cdc-85cd-9806660e9d8d] Received unexpected event network-vif-plugged-c2a92350-10c1-4c73-bfce-b305071289ff for instance with vm_state active and task_state None.
Nov 03 12:17:18 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-50df3a37-1c20-4e71-81a3-553ace77ad46 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:17:18 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-ff586988-8547-4bd3-8329-23b093a330b9 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:17:18 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-ff586988-8547-4bd3-8329-23b093a330b9 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:17:18 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-ff586988-8547-4bd3-8329-23b093a330b9 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.691s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:17:18 user nova-compute[74960]: DEBUG nova.compute.manager [None req-ff586988-8547-4bd3-8329-23b093a330b9 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] [instance: 8381c969-6a2d-4934-aadd-660ffa246b05] Start building networks asynchronously for instance. {{(pid=74960) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 12:17:18 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-50df3a37-1c20-4e71-81a3-553ace77ad46 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.243s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:17:18 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-50df3a37-1c20-4e71-81a3-553ace77ad46 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74960) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 12:17:18 user nova-compute[74960]: INFO nova.compute.claims [None req-50df3a37-1c20-4e71-81a3-553ace77ad46 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] Claim successful on node user
Nov 03 12:17:18 user nova-compute[74960]: DEBUG nova.compute.manager [None req-ff586988-8547-4bd3-8329-23b093a330b9 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] [instance: 8381c969-6a2d-4934-aadd-660ffa246b05] Allocating IP information in the background. {{(pid=74960) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 12:17:18 user nova-compute[74960]: DEBUG nova.network.neutron [None req-ff586988-8547-4bd3-8329-23b093a330b9 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] [instance: 8381c969-6a2d-4934-aadd-660ffa246b05] allocate_for_instance() {{(pid=74960) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 12:17:18 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-ff586988-8547-4bd3-8329-23b093a330b9 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] [instance: 8381c969-6a2d-4934-aadd-660ffa246b05] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 12:17:18 user nova-compute[74960]: DEBUG nova.compute.manager [None req-ff586988-8547-4bd3-8329-23b093a330b9 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] [instance: 8381c969-6a2d-4934-aadd-660ffa246b05] Start building block device mappings for instance. {{(pid=74960) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 12:17:18 user nova-compute[74960]: DEBUG nova.policy [None req-ff586988-8547-4bd3-8329-23b093a330b9 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b0d10c1fea2544ff9b5b6edb05482607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5477a0b396d64025bfc321100dd29041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74960) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 12:17:19 user nova-compute[74960]: DEBUG nova.compute.manager [None req-ff586988-8547-4bd3-8329-23b093a330b9 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] [instance: 8381c969-6a2d-4934-aadd-660ffa246b05] Start spawning the instance on the hypervisor. {{(pid=74960) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 12:17:19 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-ff586988-8547-4bd3-8329-23b093a330b9 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] [instance: 8381c969-6a2d-4934-aadd-660ffa246b05] Creating instance directory {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 12:17:19 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-ff586988-8547-4bd3-8329-23b093a330b9 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] [instance: 8381c969-6a2d-4934-aadd-660ffa246b05] Creating image(s)
Nov 03 12:17:19 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-ff586988-8547-4bd3-8329-23b093a330b9 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] Acquiring lock "/opt/stack/data/nova/instances/8381c969-6a2d-4934-aadd-660ffa246b05/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:17:19 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-ff586988-8547-4bd3-8329-23b093a330b9 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] Lock "/opt/stack/data/nova/instances/8381c969-6a2d-4934-aadd-660ffa246b05/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:17:19 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-ff586988-8547-4bd3-8329-23b093a330b9 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] Lock "/opt/stack/data/nova/instances/8381c969-6a2d-4934-aadd-660ffa246b05/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:17:19 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-ff586988-8547-4bd3-8329-23b093a330b9 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:17:19 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-ff586988-8547-4bd3-8329-23b093a330b9 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.256s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:17:19 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-ff586988-8547-4bd3-8329-23b093a330b9 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] Acquiring lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:17:19 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-ff586988-8547-4bd3-8329-23b093a330b9 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] Lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:17:19 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-ff586988-8547-4bd3-8329-23b093a330b9 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:17:19 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-50df3a37-1c20-4e71-81a3-553ace77ad46 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:17:19 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-50df3a37-1c20-4e71-81a3-553ace77ad46 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:17:19 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-50df3a37-1c20-4e71-81a3-553ace77ad46 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.844s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:17:19 user nova-compute[74960]: DEBUG nova.compute.manager [None req-50df3a37-1c20-4e71-81a3-553ace77ad46 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] Start building networks asynchronously for instance. {{(pid=74960) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 12:17:19 user nova-compute[74960]: DEBUG nova.compute.manager [None req-50df3a37-1c20-4e71-81a3-553ace77ad46 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] Allocating IP information in the background. {{(pid=74960) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 12:17:19 user nova-compute[74960]: DEBUG nova.network.neutron [None req-50df3a37-1c20-4e71-81a3-553ace77ad46 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] allocate_for_instance() {{(pid=74960) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 12:17:19 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-50df3a37-1c20-4e71-81a3-553ace77ad46 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 12:17:19 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-ff586988-8547-4bd3-8329-23b093a330b9 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.293s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:17:19 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-ff586988-8547-4bd3-8329-23b093a330b9 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910,backing_fmt=raw /opt/stack/data/nova/instances/8381c969-6a2d-4934-aadd-660ffa246b05/disk 1073741824 {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:17:19 user nova-compute[74960]: DEBUG nova.compute.manager [None req-50df3a37-1c20-4e71-81a3-553ace77ad46 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] Start building block device mappings for instance. {{(pid=74960) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 12:17:19 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-ff586988-8547-4bd3-8329-23b093a330b9 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910,backing_fmt=raw /opt/stack/data/nova/instances/8381c969-6a2d-4934-aadd-660ffa246b05/disk 1073741824" returned: 0 in 0.060s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:17:19 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-ff586988-8547-4bd3-8329-23b093a330b9 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] Lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.358s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:17:19 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-ff586988-8547-4bd3-8329-23b093a330b9 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:17:19 user nova-compute[74960]: DEBUG nova.compute.manager [None req-50df3a37-1c20-4e71-81a3-553ace77ad46 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] Start spawning the instance on the hypervisor. {{(pid=74960) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 12:17:19 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-50df3a37-1c20-4e71-81a3-553ace77ad46 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] Creating instance directory {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 12:17:19 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-50df3a37-1c20-4e71-81a3-553ace77ad46 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] Creating image(s)
Nov 03 12:17:19 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-50df3a37-1c20-4e71-81a3-553ace77ad46 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Acquiring lock "/opt/stack/data/nova/instances/0a520c41-19c0-47ba-ada8-023ee9c12ca6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:17:19 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-50df3a37-1c20-4e71-81a3-553ace77ad46 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Lock "/opt/stack/data/nova/instances/0a520c41-19c0-47ba-ada8-023ee9c12ca6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:17:19 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-50df3a37-1c20-4e71-81a3-553ace77ad46 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Lock "/opt/stack/data/nova/instances/0a520c41-19c0-47ba-ada8-023ee9c12ca6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:17:19 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-50df3a37-1c20-4e71-81a3-553ace77ad46 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:17:19 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-ff586988-8547-4bd3-8329-23b093a330b9 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.275s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:17:19 user nova-compute[74960]: DEBUG nova.virt.disk.api [None req-ff586988-8547-4bd3-8329-23b093a330b9 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8381c969-6a2d-4934-aadd-660ffa246b05/disk. size=1073741824 {{(pid=74960) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 12:17:19 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-ff586988-8547-4bd3-8329-23b093a330b9 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8381c969-6a2d-4934-aadd-660ffa246b05/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:17:20 user nova-compute[74960]: DEBUG nova.policy [None req-50df3a37-1c20-4e71-81a3-553ace77ad46 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9da58bde19c3434f9811cb80ed39dea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3390632661124edd9894dabac0053fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74960) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 12:17:20 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-50df3a37-1c20-4e71-81a3-553ace77ad46 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.246s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:17:20 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-50df3a37-1c20-4e71-81a3-553ace77ad46 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Acquiring lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:17:20 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-50df3a37-1c20-4e71-81a3-553ace77ad46 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:17:20 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-50df3a37-1c20-4e71-81a3-553ace77ad46 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:17:20 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-ff586988-8547-4bd3-8329-23b093a330b9 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8381c969-6a2d-4934-aadd-660ffa246b05/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:17:20 user nova-compute[74960]: DEBUG nova.virt.disk.api [None req-ff586988-8547-4bd3-8329-23b093a330b9 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] Cannot resize image /opt/stack/data/nova/instances/8381c969-6a2d-4934-aadd-660ffa246b05/disk to a smaller size. {{(pid=74960) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 12:17:20 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-ff586988-8547-4bd3-8329-23b093a330b9 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] [instance: 8381c969-6a2d-4934-aadd-660ffa246b05] Created local disks {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 12:17:20 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-ff586988-8547-4bd3-8329-23b093a330b9 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] [instance: 8381c969-6a2d-4934-aadd-660ffa246b05] Ensure instance console log exists: /opt/stack/data/nova/instances/8381c969-6a2d-4934-aadd-660ffa246b05/console.log {{(pid=74960) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 12:17:20 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-ff586988-8547-4bd3-8329-23b093a330b9 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:17:20 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-ff586988-8547-4bd3-8329-23b093a330b9 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:17:20 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-ff586988-8547-4bd3-8329-23b093a330b9 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:17:20 user nova-compute[74960]: DEBUG nova.compute.manager [req-47b52f87-8bc5-4151-b484-23e92bf09adf req-639b93dc-1ceb-4d64-9c57-9ce4676f651d service nova] [instance: d00a0872-693c-4cdc-85cd-9806660e9d8d] Received event network-vif-plugged-c2a92350-10c1-4c73-bfce-b305071289ff {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:17:20 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-47b52f87-8bc5-4151-b484-23e92bf09adf req-639b93dc-1ceb-4d64-9c57-9ce4676f651d service nova] Acquiring lock "d00a0872-693c-4cdc-85cd-9806660e9d8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:17:20 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-47b52f87-8bc5-4151-b484-23e92bf09adf req-639b93dc-1ceb-4d64-9c57-9ce4676f651d service nova] Lock "d00a0872-693c-4cdc-85cd-9806660e9d8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:17:20 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-47b52f87-8bc5-4151-b484-23e92bf09adf req-639b93dc-1ceb-4d64-9c57-9ce4676f651d service nova] Lock "d00a0872-693c-4cdc-85cd-9806660e9d8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:17:20 user nova-compute[74960]: DEBUG nova.compute.manager [req-47b52f87-8bc5-4151-b484-23e92bf09adf req-639b93dc-1ceb-4d64-9c57-9ce4676f651d service nova] [instance: d00a0872-693c-4cdc-85cd-9806660e9d8d] No waiting events found dispatching network-vif-plugged-c2a92350-10c1-4c73-bfce-b305071289ff {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:17:20 user nova-compute[74960]: WARNING nova.compute.manager [req-47b52f87-8bc5-4151-b484-23e92bf09adf req-639b93dc-1ceb-4d64-9c57-9ce4676f651d service nova] [instance: d00a0872-693c-4cdc-85cd-9806660e9d8d] Received unexpected event network-vif-plugged-c2a92350-10c1-4c73-bfce-b305071289ff for instance with vm_state active and task_state None.
Nov 03 12:17:20 user nova-compute[74960]: DEBUG nova.compute.manager [req-47b52f87-8bc5-4151-b484-23e92bf09adf req-639b93dc-1ceb-4d64-9c57-9ce4676f651d service nova] [instance: e91dfcf4-caef-43d0-a56b-b1282363d4e0] Received event network-vif-plugged-ce7c2b72-12cb-4251-b6ac-f2f6724a509a {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:17:20 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-47b52f87-8bc5-4151-b484-23e92bf09adf req-639b93dc-1ceb-4d64-9c57-9ce4676f651d service nova] Acquiring lock "e91dfcf4-caef-43d0-a56b-b1282363d4e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:17:20 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-47b52f87-8bc5-4151-b484-23e92bf09adf req-639b93dc-1ceb-4d64-9c57-9ce4676f651d service nova] Lock "e91dfcf4-caef-43d0-a56b-b1282363d4e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:17:20 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-47b52f87-8bc5-4151-b484-23e92bf09adf req-639b93dc-1ceb-4d64-9c57-9ce4676f651d service nova] Lock "e91dfcf4-caef-43d0-a56b-b1282363d4e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:17:20 user nova-compute[74960]: DEBUG nova.compute.manager [req-47b52f87-8bc5-4151-b484-23e92bf09adf req-639b93dc-1ceb-4d64-9c57-9ce4676f651d service nova] [instance: e91dfcf4-caef-43d0-a56b-b1282363d4e0] No waiting events found dispatching network-vif-plugged-ce7c2b72-12cb-4251-b6ac-f2f6724a509a {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:17:20 user nova-compute[74960]: WARNING nova.compute.manager [req-47b52f87-8bc5-4151-b484-23e92bf09adf req-639b93dc-1ceb-4d64-9c57-9ce4676f651d service nova] [instance: e91dfcf4-caef-43d0-a56b-b1282363d4e0] Received unexpected event network-vif-plugged-ce7c2b72-12cb-4251-b6ac-f2f6724a509a for instance with vm_state active and task_state None.
Nov 03 12:17:20 user nova-compute[74960]: DEBUG nova.compute.manager [req-47b52f87-8bc5-4151-b484-23e92bf09adf req-639b93dc-1ceb-4d64-9c57-9ce4676f651d service nova] [instance: e91dfcf4-caef-43d0-a56b-b1282363d4e0] Received event network-vif-plugged-ce7c2b72-12cb-4251-b6ac-f2f6724a509a {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:17:20 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-47b52f87-8bc5-4151-b484-23e92bf09adf req-639b93dc-1ceb-4d64-9c57-9ce4676f651d service nova] Acquiring lock "e91dfcf4-caef-43d0-a56b-b1282363d4e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:17:20 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-47b52f87-8bc5-4151-b484-23e92bf09adf req-639b93dc-1ceb-4d64-9c57-9ce4676f651d service nova] Lock "e91dfcf4-caef-43d0-a56b-b1282363d4e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:17:20 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-47b52f87-8bc5-4151-b484-23e92bf09adf req-639b93dc-1ceb-4d64-9c57-9ce4676f651d service nova] Lock "e91dfcf4-caef-43d0-a56b-b1282363d4e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:17:20 user nova-compute[74960]: DEBUG nova.compute.manager [req-47b52f87-8bc5-4151-b484-23e92bf09adf req-639b93dc-1ceb-4d64-9c57-9ce4676f651d service nova] [instance: e91dfcf4-caef-43d0-a56b-b1282363d4e0] No waiting events found dispatching network-vif-plugged-ce7c2b72-12cb-4251-b6ac-f2f6724a509a {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:17:20 user nova-compute[74960]: WARNING nova.compute.manager [req-47b52f87-8bc5-4151-b484-23e92bf09adf req-639b93dc-1ceb-4d64-9c57-9ce4676f651d service nova] [instance: e91dfcf4-caef-43d0-a56b-b1282363d4e0] Received unexpected event network-vif-plugged-ce7c2b72-12cb-4251-b6ac-f2f6724a509a for instance with vm_state active and task_state None.
Nov 03 12:17:20 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-50df3a37-1c20-4e71-81a3-553ace77ad46 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.250s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:17:20 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-50df3a37-1c20-4e71-81a3-553ace77ad46 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910,backing_fmt=raw /opt/stack/data/nova/instances/0a520c41-19c0-47ba-ada8-023ee9c12ca6/disk 1073741824 {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:17:20 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-50df3a37-1c20-4e71-81a3-553ace77ad46 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910,backing_fmt=raw /opt/stack/data/nova/instances/0a520c41-19c0-47ba-ada8-023ee9c12ca6/disk 1073741824" returned: 0 in 0.063s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:17:20 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-50df3a37-1c20-4e71-81a3-553ace77ad46 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.320s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:17:20 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-50df3a37-1c20-4e71-81a3-553ace77ad46 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:17:20 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-50df3a37-1c20-4e71-81a3-553ace77ad46 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.228s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:17:20 user nova-compute[74960]: DEBUG nova.virt.disk.api [None req-50df3a37-1c20-4e71-81a3-553ace77ad46 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0a520c41-19c0-47ba-ada8-023ee9c12ca6/disk. size=1073741824 {{(pid=74960) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 12:17:20 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-50df3a37-1c20-4e71-81a3-553ace77ad46 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a520c41-19c0-47ba-ada8-023ee9c12ca6/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:17:20 user nova-compute[74960]: DEBUG nova.network.neutron [None req-ff586988-8547-4bd3-8329-23b093a330b9 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] [instance: 8381c969-6a2d-4934-aadd-660ffa246b05] Successfully created port: df5604b7-7f5b-4738-b218-0016b4441542 {{(pid=74960) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 12:17:20 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-50df3a37-1c20-4e71-81a3-553ace77ad46 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a520c41-19c0-47ba-ada8-023ee9c12ca6/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:17:20 user nova-compute[74960]: DEBUG nova.virt.disk.api [None req-50df3a37-1c20-4e71-81a3-553ace77ad46 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Cannot resize image /opt/stack/data/nova/instances/0a520c41-19c0-47ba-ada8-023ee9c12ca6/disk to a smaller size. {{(pid=74960) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 12:17:20 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-50df3a37-1c20-4e71-81a3-553ace77ad46 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] Created local disks {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 12:17:20 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-50df3a37-1c20-4e71-81a3-553ace77ad46 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] Ensure instance console log exists: /opt/stack/data/nova/instances/0a520c41-19c0-47ba-ada8-023ee9c12ca6/console.log {{(pid=74960) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 12:17:20 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-50df3a37-1c20-4e71-81a3-553ace77ad46 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:17:20 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-50df3a37-1c20-4e71-81a3-553ace77ad46 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:17:20 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-50df3a37-1c20-4e71-81a3-553ace77ad46 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:17:21 user nova-compute[74960]: DEBUG nova.network.neutron [None req-50df3a37-1c20-4e71-81a3-553ace77ad46 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] Successfully created port: 3e126a57-0883-4997-9c99-d25c9c6fc102 {{(pid=74960) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 12:17:21 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:17:22 user nova-compute[74960]: DEBUG nova.network.neutron [None req-ff586988-8547-4bd3-8329-23b093a330b9 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] [instance: 8381c969-6a2d-4934-aadd-660ffa246b05] Successfully updated port: df5604b7-7f5b-4738-b218-0016b4441542 {{(pid=74960) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 12:17:22 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-ff586988-8547-4bd3-8329-23b093a330b9 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] Acquiring lock "refresh_cache-8381c969-6a2d-4934-aadd-660ffa246b05" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:17:22 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-ff586988-8547-4bd3-8329-23b093a330b9 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] Acquired lock "refresh_cache-8381c969-6a2d-4934-aadd-660ffa246b05" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:17:22 user nova-compute[74960]: DEBUG nova.network.neutron [None req-ff586988-8547-4bd3-8329-23b093a330b9 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] [instance: 8381c969-6a2d-4934-aadd-660ffa246b05] Building network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 12:17:22 user nova-compute[74960]: DEBUG nova.network.neutron [None req-ff586988-8547-4bd3-8329-23b093a330b9 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] [instance: 8381c969-6a2d-4934-aadd-660ffa246b05] Instance cache missing network info. {{(pid=74960) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 12:17:22 user nova-compute[74960]: DEBUG nova.compute.manager [req-23f77133-7e47-4213-8fe7-59e934a84066 req-105eeafc-8987-4e19-b042-fb047771ba97 service nova] [instance: 8381c969-6a2d-4934-aadd-660ffa246b05] Received event network-changed-df5604b7-7f5b-4738-b218-0016b4441542 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:17:22 user nova-compute[74960]: DEBUG nova.compute.manager [req-23f77133-7e47-4213-8fe7-59e934a84066 req-105eeafc-8987-4e19-b042-fb047771ba97 service nova] [instance: 8381c969-6a2d-4934-aadd-660ffa246b05] Refreshing instance network info cache due to event network-changed-df5604b7-7f5b-4738-b218-0016b4441542. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 12:17:22 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-23f77133-7e47-4213-8fe7-59e934a84066 req-105eeafc-8987-4e19-b042-fb047771ba97 service nova] Acquiring lock "refresh_cache-8381c969-6a2d-4934-aadd-660ffa246b05" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:17:22 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:17:22 user nova-compute[74960]: DEBUG nova.network.neutron [None req-ff586988-8547-4bd3-8329-23b093a330b9 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] [instance: 8381c969-6a2d-4934-aadd-660ffa246b05] Updating instance_info_cache with network_info: [{"id": "df5604b7-7f5b-4738-b218-0016b4441542", "address": "fa:16:3e:8c:e9:c2", "network": {"id": "148a1e23-c4e0-4ea4-98e4-443552dd8f70", "bridge": "br-int", "label": "tempest-TestVolumeSwap-874596856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5477a0b396d64025bfc321100dd29041", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf5604b7-7f", "ovs_interfaceid": "df5604b7-7f5b-4738-b218-0016b4441542", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:17:22 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-ff586988-8547-4bd3-8329-23b093a330b9 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] Releasing lock "refresh_cache-8381c969-6a2d-4934-aadd-660ffa246b05" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:17:22 user nova-compute[74960]: DEBUG nova.compute.manager [None req-ff586988-8547-4bd3-8329-23b093a330b9 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] [instance: 8381c969-6a2d-4934-aadd-660ffa246b05] Instance network_info: |[{"id": "df5604b7-7f5b-4738-b218-0016b4441542", "address": "fa:16:3e:8c:e9:c2", "network": {"id": "148a1e23-c4e0-4ea4-98e4-443552dd8f70", "bridge": "br-int", "label": "tempest-TestVolumeSwap-874596856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5477a0b396d64025bfc321100dd29041", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf5604b7-7f", "ovs_interfaceid": "df5604b7-7f5b-4738-b218-0016b4441542", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74960) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 12:17:22 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-23f77133-7e47-4213-8fe7-59e934a84066 req-105eeafc-8987-4e19-b042-fb047771ba97 service nova] Acquired lock "refresh_cache-8381c969-6a2d-4934-aadd-660ffa246b05" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:17:22 user nova-compute[74960]: DEBUG nova.network.neutron [req-23f77133-7e47-4213-8fe7-59e934a84066 req-105eeafc-8987-4e19-b042-fb047771ba97 service nova] [instance: 8381c969-6a2d-4934-aadd-660ffa246b05] Refreshing network info cache for port df5604b7-7f5b-4738-b218-0016b4441542 {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 12:17:22 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-ff586988-8547-4bd3-8329-23b093a330b9 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] [instance: 8381c969-6a2d-4934-aadd-660ffa246b05] Start _get_guest_xml network_info=[{"id": "df5604b7-7f5b-4738-b218-0016b4441542", "address": "fa:16:3e:8c:e9:c2", "network": {"id": "148a1e23-c4e0-4ea4-98e4-443552dd8f70", "bridge": "br-int", "label": "tempest-TestVolumeSwap-874596856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5477a0b396d64025bfc321100dd29041", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf5604b7-7f", "ovs_interfaceid": "df5604b7-7f5b-4738-b218-0016b4441542", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=549f51ba-ac69-494b-8de1-34635aa2d7cf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='63ee9c80c632442fb0379f47b784bd20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T12:13:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'image_id': '549f51ba-ac69-494b-8de1-34635aa2d7cf'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 12:17:22 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-ff586988-8547-4bd3-8329-23b093a330b9 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:17:22 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-ff586988-8547-4bd3-8329-23b093a330b9 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:17:22 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-ff586988-8547-4bd3-8329-23b093a330b9 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 12:17:22 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-ff586988-8547-4bd3-8329-23b093a330b9 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] CPU controller missing on host. {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 12:17:22 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-ff586988-8547-4bd3-8329-23b093a330b9 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 12:17:22 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-ff586988-8547-4bd3-8329-23b093a330b9 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] CPU controller found on host. {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 12:17:22 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-ff586988-8547-4bd3-8329-23b093a330b9 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74960) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 12:17:22 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-ff586988-8547-4bd3-8329-23b093a330b9 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=549f51ba-ac69-494b-8de1-34635aa2d7cf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='63ee9c80c632442fb0379f47b784bd20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T12:13:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 12:17:22 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-ff586988-8547-4bd3-8329-23b093a330b9 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] Flavor limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 12:17:22 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-ff586988-8547-4bd3-8329-23b093a330b9 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] Image limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 12:17:22 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-ff586988-8547-4bd3-8329-23b093a330b9 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] Flavor pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 12:17:22 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-ff586988-8547-4bd3-8329-23b093a330b9 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] Image pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 12:17:22 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-ff586988-8547-4bd3-8329-23b093a330b9 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 12:17:22 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-ff586988-8547-4bd3-8329-23b093a330b9 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 12:17:22 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-ff586988-8547-4bd3-8329-23b093a330b9 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 12:17:22 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-ff586988-8547-4bd3-8329-23b093a330b9 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] Got 1 possible topologies {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 12:17:22 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-ff586988-8547-4bd3-8329-23b093a330b9 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 12:17:22 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-ff586988-8547-4bd3-8329-23b093a330b9 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 12:17:22 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-ff586988-8547-4bd3-8329-23b093a330b9 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:17:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1887246453',display_name='tempest-TestVolumeSwap-server-1887246453',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1887246453',id=6,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPijzC8lN2DSySUAgz+h17JPAKR6Do84TzAAXhx3c0TGsbnV/3XgwIiOdJM1YoFsgSmUy6MsHWQFG01KfzOmGvQ63FkQCOykBBdNS+34BhQUDmJz4zRczQ/tJdkdY5BZrA==',key_name='tempest-keypair-290186211',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5477a0b396d64025bfc321100dd29041',ramdisk_id='',reservation_id='r-n704us3p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1118632566',owner_user_name='tempest-TestVolumeSwap-1118632566-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:17:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0d10c1fea2544ff9b5b6edb05482607',uuid=8381c969-6a2d-4934-aadd-660ffa246b05,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "df5604b7-7f5b-4738-b218-0016b4441542", "address": "fa:16:3e:8c:e9:c2", "network": {"id": "148a1e23-c4e0-4ea4-98e4-443552dd8f70", "bridge": "br-int", "label": "tempest-TestVolumeSwap-874596856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5477a0b396d64025bfc321100dd29041", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf5604b7-7f", "ovs_interfaceid": "df5604b7-7f5b-4738-b218-0016b4441542", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74960) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 12:17:22 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-ff586988-8547-4bd3-8329-23b093a330b9 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] Converting VIF {"id": "df5604b7-7f5b-4738-b218-0016b4441542", "address": "fa:16:3e:8c:e9:c2", "network": {"id": "148a1e23-c4e0-4ea4-98e4-443552dd8f70", "bridge": "br-int", "label": "tempest-TestVolumeSwap-874596856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5477a0b396d64025bfc321100dd29041", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf5604b7-7f", "ovs_interfaceid": "df5604b7-7f5b-4738-b218-0016b4441542", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:17:22 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-ff586988-8547-4bd3-8329-23b093a330b9 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:e9:c2,bridge_name='br-int',has_traffic_filtering=True,id=df5604b7-7f5b-4738-b218-0016b4441542,network=Network(148a1e23-c4e0-4ea4-98e4-443552dd8f70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf5604b7-7f') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:17:22 user nova-compute[74960]: DEBUG nova.objects.instance [None req-ff586988-8547-4bd3-8329-23b093a330b9 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] Lazy-loading 'pci_devices' on Instance uuid 8381c969-6a2d-4934-aadd-660ffa246b05 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:17:22 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-ff586988-8547-4bd3-8329-23b093a330b9 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] [instance: 8381c969-6a2d-4934-aadd-660ffa246b05] End _get_guest_xml xml=<domain type="kvm">
Nov 03 12:17:22 user nova-compute[74960]:   <uuid>8381c969-6a2d-4934-aadd-660ffa246b05</uuid>
Nov 03 12:17:22 user nova-compute[74960]:   <name>instance-00000006</name>
Nov 03 12:17:22 user nova-compute[74960]:   <memory>524288</memory>
Nov 03 12:17:22 user nova-compute[74960]:   <vcpu>1</vcpu>
Nov 03 12:17:22 user nova-compute[74960]:   <metadata>
Nov 03 12:17:22 user nova-compute[74960]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 12:17:22 user nova-compute[74960]:       <nova:package version="0.0.0"/>
Nov 03 12:17:22 user nova-compute[74960]:       <nova:name>tempest-TestVolumeSwap-server-1887246453</nova:name>
Nov 03 12:17:22 user nova-compute[74960]:       <nova:creationTime>2023-11-03 12:17:22</nova:creationTime>
Nov 03 12:17:22 user nova-compute[74960]:       <nova:flavor name="m1.tiny">
Nov 03 12:17:22 user nova-compute[74960]:         <nova:memory>512</nova:memory>
Nov 03 12:17:22 user nova-compute[74960]:         <nova:disk>1</nova:disk>
Nov 03 12:17:22 user nova-compute[74960]:         <nova:swap>0</nova:swap>
Nov 03 12:17:22 user nova-compute[74960]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 12:17:22 user nova-compute[74960]:         <nova:vcpus>1</nova:vcpus>
Nov 03 12:17:22 user nova-compute[74960]:       </nova:flavor>
Nov 03 12:17:22 user nova-compute[74960]:       <nova:owner>
Nov 03 12:17:22 user nova-compute[74960]:         <nova:user uuid="b0d10c1fea2544ff9b5b6edb05482607">tempest-TestVolumeSwap-1118632566-project-member</nova:user>
Nov 03 12:17:22 user nova-compute[74960]:         <nova:project uuid="5477a0b396d64025bfc321100dd29041">tempest-TestVolumeSwap-1118632566</nova:project>
Nov 03 12:17:22 user nova-compute[74960]:       </nova:owner>
Nov 03 12:17:22 user nova-compute[74960]:       <nova:root type="image" uuid="549f51ba-ac69-494b-8de1-34635aa2d7cf"/>
Nov 03 12:17:22 user nova-compute[74960]:       <nova:ports>
Nov 03 12:17:22 user nova-compute[74960]:         <nova:port uuid="df5604b7-7f5b-4738-b218-0016b4441542">
Nov 03 12:17:22 user nova-compute[74960]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 03 12:17:22 user nova-compute[74960]:         </nova:port>
Nov 03 12:17:22 user nova-compute[74960]:       </nova:ports>
Nov 03 12:17:22 user nova-compute[74960]:     </nova:instance>
Nov 03 12:17:22 user nova-compute[74960]:   </metadata>
Nov 03 12:17:22 user nova-compute[74960]:   <sysinfo type="smbios">
Nov 03 12:17:22 user nova-compute[74960]:     <system>
Nov 03 12:17:22 user nova-compute[74960]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 12:17:22 user nova-compute[74960]:       <entry name="product">OpenStack Nova</entry>
Nov 03 12:17:22 user nova-compute[74960]:       <entry name="version">0.0.0</entry>
Nov 03 12:17:22 user nova-compute[74960]:       <entry name="serial">8381c969-6a2d-4934-aadd-660ffa246b05</entry>
Nov 03 12:17:22 user nova-compute[74960]:       <entry name="uuid">8381c969-6a2d-4934-aadd-660ffa246b05</entry>
Nov 03 12:17:22 user nova-compute[74960]:       <entry name="family">Virtual Machine</entry>
Nov 03 12:17:22 user nova-compute[74960]:     </system>
Nov 03 12:17:22 user nova-compute[74960]:   </sysinfo>
Nov 03 12:17:22 user nova-compute[74960]:   <os>
Nov 03 12:17:22 user nova-compute[74960]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 12:17:22 user nova-compute[74960]:     <boot dev="hd"/>
Nov 03 12:17:22 user nova-compute[74960]:     <smbios mode="sysinfo"/>
Nov 03 12:17:22 user nova-compute[74960]:   </os>
Nov 03 12:17:22 user nova-compute[74960]:   <features>
Nov 03 12:17:22 user nova-compute[74960]:     <acpi/>
Nov 03 12:17:22 user nova-compute[74960]:     <apic/>
Nov 03 12:17:22 user nova-compute[74960]:     <vmcoreinfo/>
Nov 03 12:17:22 user nova-compute[74960]:   </features>
Nov 03 12:17:22 user nova-compute[74960]:   <clock offset="utc">
Nov 03 12:17:22 user nova-compute[74960]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 12:17:22 user nova-compute[74960]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 12:17:22 user nova-compute[74960]:     <timer name="hpet" present="no"/>
Nov 03 12:17:22 user nova-compute[74960]:   </clock>
Nov 03 12:17:22 user nova-compute[74960]:   <cpu mode="custom" match="exact">
Nov 03 12:17:22 user nova-compute[74960]:     <model>Nehalem</model>
Nov 03 12:17:22 user nova-compute[74960]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 12:17:22 user nova-compute[74960]:   </cpu>
Nov 03 12:17:22 user nova-compute[74960]:   <devices>
Nov 03 12:17:22 user nova-compute[74960]:     <disk type="file" device="disk">
Nov 03 12:17:22 user nova-compute[74960]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 12:17:22 user nova-compute[74960]:       <source file="/opt/stack/data/nova/instances/8381c969-6a2d-4934-aadd-660ffa246b05/disk"/>
Nov 03 12:17:22 user nova-compute[74960]:       <target dev="vda" bus="virtio"/>
Nov 03 12:17:22 user nova-compute[74960]:     </disk>
Nov 03 12:17:22 user nova-compute[74960]:     <interface type="ethernet">
Nov 03 12:17:22 user nova-compute[74960]:       <mac address="fa:16:3e:8c:e9:c2"/>
Nov 03 12:17:22 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:17:22 user nova-compute[74960]:       <mtu size="1442"/>
Nov 03 12:17:22 user nova-compute[74960]:       <target dev="tapdf5604b7-7f"/>
Nov 03 12:17:22 user nova-compute[74960]:     </interface>
Nov 03 12:17:22 user nova-compute[74960]:     <serial type="pty">
Nov 03 12:17:22 user nova-compute[74960]:       <log file="/opt/stack/data/nova/instances/8381c969-6a2d-4934-aadd-660ffa246b05/console.log" append="off"/>
Nov 03 12:17:22 user nova-compute[74960]:     </serial>
Nov 03 12:17:22 user nova-compute[74960]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 12:17:22 user nova-compute[74960]:     <video>
Nov 03 12:17:22 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:17:22 user nova-compute[74960]:     </video>
Nov 03 12:17:22 user nova-compute[74960]:     <rng model="virtio">
Nov 03 12:17:22 user nova-compute[74960]:       <backend model="random">/dev/urandom</backend>
Nov 03 12:17:22 user nova-compute[74960]:     </rng>
Nov 03 12:17:22 user nova-compute[74960]:     <controller type="usb" index="0" model="none"/>
Nov 03 12:17:22 user nova-compute[74960]:     <memballoon model="virtio">
Nov 03 12:17:22 user nova-compute[74960]:       <stats period="10"/>
Nov 03 12:17:22 user nova-compute[74960]:     </memballoon>
Nov 03 12:17:22 user nova-compute[74960]:   </devices>
Nov 03 12:17:22 user nova-compute[74960]: </domain>
Nov 03 12:17:22 user nova-compute[74960]:  {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 12:17:23 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-ff586988-8547-4bd3-8329-23b093a330b9 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:17:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1887246453',display_name='tempest-TestVolumeSwap-server-1887246453',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1887246453',id=6,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPijzC8lN2DSySUAgz+h17JPAKR6Do84TzAAXhx3c0TGsbnV/3XgwIiOdJM1YoFsgSmUy6MsHWQFG01KfzOmGvQ63FkQCOykBBdNS+34BhQUDmJz4zRczQ/tJdkdY5BZrA==',key_name='tempest-keypair-290186211',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5477a0b396d64025bfc321100dd29041',ramdisk_id='',reservation_id='r-n704us3p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1118632566',owner_user_name='tempest-TestVolumeSwap-1118632566-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:17:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0d10c1fea2544ff9b5b6edb05482607',uuid=8381c969-6a2d-4934-aadd-660ffa246b05,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "df5604b7-7f5b-4738-b218-0016b4441542", "address": "fa:16:3e:8c:e9:c2", "network": {"id": "148a1e23-c4e0-4ea4-98e4-443552dd8f70", "bridge": "br-int", "label": "tempest-TestVolumeSwap-874596856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5477a0b396d64025bfc321100dd29041", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf5604b7-7f", "ovs_interfaceid": "df5604b7-7f5b-4738-b218-0016b4441542", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 12:17:23 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-ff586988-8547-4bd3-8329-23b093a330b9 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] Converting VIF {"id": "df5604b7-7f5b-4738-b218-0016b4441542", "address": "fa:16:3e:8c:e9:c2", "network": {"id": "148a1e23-c4e0-4ea4-98e4-443552dd8f70", "bridge": "br-int", "label": "tempest-TestVolumeSwap-874596856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5477a0b396d64025bfc321100dd29041", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf5604b7-7f", "ovs_interfaceid": "df5604b7-7f5b-4738-b218-0016b4441542", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:17:23 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-ff586988-8547-4bd3-8329-23b093a330b9 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:e9:c2,bridge_name='br-int',has_traffic_filtering=True,id=df5604b7-7f5b-4738-b218-0016b4441542,network=Network(148a1e23-c4e0-4ea4-98e4-443552dd8f70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf5604b7-7f') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:17:23 user nova-compute[74960]: DEBUG os_vif [None req-ff586988-8547-4bd3-8329-23b093a330b9 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:e9:c2,bridge_name='br-int',has_traffic_filtering=True,id=df5604b7-7f5b-4738-b218-0016b4441542,network=Network(148a1e23-c4e0-4ea4-98e4-443552dd8f70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf5604b7-7f') {{(pid=74960) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 12:17:23 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:17:23 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:17:23 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 12:17:23 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:17:23 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '352f29ff-0142-52e9-be21-b13ec2b748ea', '_type': 'linux-noop'}}, row=False) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:17:23 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:17:23 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:17:23 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:17:23 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdf5604b7-7f, may_exist=True, interface_attrs={}) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:17:23 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdf5604b7-7f, col_values=(('qos', UUID('f631ddc9-05ce-4c94-9773-a0d751ae27d0')),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:17:23 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdf5604b7-7f, col_values=(('external_ids', {'iface-id': 'df5604b7-7f5b-4738-b218-0016b4441542', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8c:e9:c2', 'vm-uuid': '8381c969-6a2d-4934-aadd-660ffa246b05'}),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:17:23 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:17:23 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:17:23 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:17:23 user nova-compute[74960]: INFO os_vif [None req-ff586988-8547-4bd3-8329-23b093a330b9 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:e9:c2,bridge_name='br-int',has_traffic_filtering=True,id=df5604b7-7f5b-4738-b218-0016b4441542,network=Network(148a1e23-c4e0-4ea4-98e4-443552dd8f70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf5604b7-7f')
Nov 03 12:17:23 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-ff586988-8547-4bd3-8329-23b093a330b9 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] No BDM found with device name vda, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:17:23 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-ff586988-8547-4bd3-8329-23b093a330b9 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] No VIF found with MAC fa:16:3e:8c:e9:c2, not building metadata {{(pid=74960) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 12:17:23 user nova-compute[74960]: DEBUG nova.network.neutron [None req-50df3a37-1c20-4e71-81a3-553ace77ad46 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] Successfully updated port: 3e126a57-0883-4997-9c99-d25c9c6fc102 {{(pid=74960) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 12:17:23 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-50df3a37-1c20-4e71-81a3-553ace77ad46 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Acquiring lock "refresh_cache-0a520c41-19c0-47ba-ada8-023ee9c12ca6" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:17:23 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-50df3a37-1c20-4e71-81a3-553ace77ad46 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Acquired lock "refresh_cache-0a520c41-19c0-47ba-ada8-023ee9c12ca6" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:17:23 user nova-compute[74960]: DEBUG nova.network.neutron [None req-50df3a37-1c20-4e71-81a3-553ace77ad46 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] Building network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 12:17:23 user nova-compute[74960]: DEBUG nova.network.neutron [None req-50df3a37-1c20-4e71-81a3-553ace77ad46 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] Instance cache missing network info. {{(pid=74960) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 12:17:23 user nova-compute[74960]: DEBUG nova.network.neutron [req-23f77133-7e47-4213-8fe7-59e934a84066 req-105eeafc-8987-4e19-b042-fb047771ba97 service nova] [instance: 8381c969-6a2d-4934-aadd-660ffa246b05] Updated VIF entry in instance network info cache for port df5604b7-7f5b-4738-b218-0016b4441542. {{(pid=74960) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 12:17:23 user nova-compute[74960]: DEBUG nova.network.neutron [req-23f77133-7e47-4213-8fe7-59e934a84066 req-105eeafc-8987-4e19-b042-fb047771ba97 service nova] [instance: 8381c969-6a2d-4934-aadd-660ffa246b05] Updating instance_info_cache with network_info: [{"id": "df5604b7-7f5b-4738-b218-0016b4441542", "address": "fa:16:3e:8c:e9:c2", "network": {"id": "148a1e23-c4e0-4ea4-98e4-443552dd8f70", "bridge": "br-int", "label": "tempest-TestVolumeSwap-874596856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5477a0b396d64025bfc321100dd29041", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf5604b7-7f", "ovs_interfaceid": "df5604b7-7f5b-4738-b218-0016b4441542", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:17:23 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-23f77133-7e47-4213-8fe7-59e934a84066 req-105eeafc-8987-4e19-b042-fb047771ba97 service nova] Releasing lock "refresh_cache-8381c969-6a2d-4934-aadd-660ffa246b05" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:17:23 user nova-compute[74960]: DEBUG nova.network.neutron [None req-50df3a37-1c20-4e71-81a3-553ace77ad46 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] Updating instance_info_cache with network_info: [{"id": "3e126a57-0883-4997-9c99-d25c9c6fc102", "address": "fa:16:3e:f9:07:9b", "network": {"id": "65e1589f-341c-4cc8-a8e6-5b61544daf55", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1130686752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3390632661124edd9894dabac0053fa9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e126a57-08", "ovs_interfaceid": "3e126a57-0883-4997-9c99-d25c9c6fc102", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:17:23 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-50df3a37-1c20-4e71-81a3-553ace77ad46 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Releasing lock "refresh_cache-0a520c41-19c0-47ba-ada8-023ee9c12ca6" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:17:23 user nova-compute[74960]: DEBUG nova.compute.manager [None req-50df3a37-1c20-4e71-81a3-553ace77ad46 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] Instance network_info: |[{"id": "3e126a57-0883-4997-9c99-d25c9c6fc102", "address": "fa:16:3e:f9:07:9b", "network": {"id": "65e1589f-341c-4cc8-a8e6-5b61544daf55", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1130686752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3390632661124edd9894dabac0053fa9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e126a57-08", "ovs_interfaceid": "3e126a57-0883-4997-9c99-d25c9c6fc102", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74960) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 12:17:23 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-50df3a37-1c20-4e71-81a3-553ace77ad46 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] Start _get_guest_xml network_info=[{"id": "3e126a57-0883-4997-9c99-d25c9c6fc102", "address": "fa:16:3e:f9:07:9b", "network": {"id": "65e1589f-341c-4cc8-a8e6-5b61544daf55", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1130686752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3390632661124edd9894dabac0053fa9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e126a57-08", "ovs_interfaceid": "3e126a57-0883-4997-9c99-d25c9c6fc102", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=549f51ba-ac69-494b-8de1-34635aa2d7cf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='63ee9c80c632442fb0379f47b784bd20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T12:13:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'image_id': '549f51ba-ac69-494b-8de1-34635aa2d7cf'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 12:17:23 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-50df3a37-1c20-4e71-81a3-553ace77ad46 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:17:23 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-50df3a37-1c20-4e71-81a3-553ace77ad46 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:17:23 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-50df3a37-1c20-4e71-81a3-553ace77ad46 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 12:17:23 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-50df3a37-1c20-4e71-81a3-553ace77ad46 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] CPU controller missing on host. {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 12:17:23 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-50df3a37-1c20-4e71-81a3-553ace77ad46 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 12:17:23 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-50df3a37-1c20-4e71-81a3-553ace77ad46 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] CPU controller found on host. {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 12:17:23 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-50df3a37-1c20-4e71-81a3-553ace77ad46 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74960) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 12:17:23 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-50df3a37-1c20-4e71-81a3-553ace77ad46 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=549f51ba-ac69-494b-8de1-34635aa2d7cf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='63ee9c80c632442fb0379f47b784bd20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T12:13:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 12:17:23 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-50df3a37-1c20-4e71-81a3-553ace77ad46 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Flavor limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 12:17:23 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-50df3a37-1c20-4e71-81a3-553ace77ad46 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Image limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 12:17:23 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-50df3a37-1c20-4e71-81a3-553ace77ad46 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Flavor pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 12:17:23 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-50df3a37-1c20-4e71-81a3-553ace77ad46 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Image pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 12:17:23 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-50df3a37-1c20-4e71-81a3-553ace77ad46 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 12:17:23 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-50df3a37-1c20-4e71-81a3-553ace77ad46 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 12:17:23 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-50df3a37-1c20-4e71-81a3-553ace77ad46 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 12:17:23 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-50df3a37-1c20-4e71-81a3-553ace77ad46 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Got 1 possible topologies {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 12:17:23 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-50df3a37-1c20-4e71-81a3-553ace77ad46 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 12:17:23 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-50df3a37-1c20-4e71-81a3-553ace77ad46 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 12:17:23 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-50df3a37-1c20-4e71-81a3-553ace77ad46 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T12:17:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-718860820',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-718860820',id=7,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLwaiWOkf4g+xGnCHIQ6PEXYDCQvWANu1aoEqkgH8PkfR56o+3+BPp4uxgAn5C+zZDpe3SkZ06KyunCKlhSZpIVyhUY157dTlXxkUygCex89TiMcoPvBPFCYXJkTY4on1A==',key_name='tempest-keypair-1456184094',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3390632661124edd9894dabac0053fa9',ramdisk_id='',reservation_id='r-zkhug3rc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1950029920',owner_user_name='tempest-TaggedAttachmentsTest-1950029920-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:17:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9da58bde19c3434f9811cb80ed39dea9',uuid=0a520c41-19c0-47ba-ada8-023ee9c12ca6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3e126a57-0883-4997-9c99-d25c9c6fc102", "address": "fa:16:3e:f9:07:9b", "network": {"id": "65e1589f-341c-4cc8-a8e6-5b61544daf55", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1130686752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3390632661124edd9894dabac0053fa9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e126a57-08", "ovs_interfaceid": "3e126a57-0883-4997-9c99-d25c9c6fc102", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74960) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 12:17:23 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-50df3a37-1c20-4e71-81a3-553ace77ad46 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Converting VIF {"id": "3e126a57-0883-4997-9c99-d25c9c6fc102", "address": "fa:16:3e:f9:07:9b", "network": {"id": "65e1589f-341c-4cc8-a8e6-5b61544daf55", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1130686752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3390632661124edd9894dabac0053fa9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e126a57-08", "ovs_interfaceid": "3e126a57-0883-4997-9c99-d25c9c6fc102", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:17:23 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-50df3a37-1c20-4e71-81a3-553ace77ad46 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:07:9b,bridge_name='br-int',has_traffic_filtering=True,id=3e126a57-0883-4997-9c99-d25c9c6fc102,network=Network(65e1589f-341c-4cc8-a8e6-5b61544daf55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e126a57-08') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:17:23 user nova-compute[74960]: DEBUG nova.objects.instance [None req-50df3a37-1c20-4e71-81a3-553ace77ad46 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Lazy-loading 'pci_devices' on Instance uuid 0a520c41-19c0-47ba-ada8-023ee9c12ca6 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:17:23 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-50df3a37-1c20-4e71-81a3-553ace77ad46 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] End _get_guest_xml xml=<domain type="kvm">
Nov 03 12:17:23 user nova-compute[74960]:   <uuid>0a520c41-19c0-47ba-ada8-023ee9c12ca6</uuid>
Nov 03 12:17:23 user nova-compute[74960]:   <name>instance-00000007</name>
Nov 03 12:17:23 user nova-compute[74960]:   <memory>524288</memory>
Nov 03 12:17:23 user nova-compute[74960]:   <vcpu>1</vcpu>
Nov 03 12:17:23 user nova-compute[74960]:   <metadata>
Nov 03 12:17:23 user nova-compute[74960]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 12:17:23 user nova-compute[74960]:       <nova:package version="0.0.0"/>
Nov 03 12:17:23 user nova-compute[74960]:       <nova:name>tempest-device-tagging-server-718860820</nova:name>
Nov 03 12:17:23 user nova-compute[74960]:       <nova:creationTime>2023-11-03 12:17:23</nova:creationTime>
Nov 03 12:17:23 user nova-compute[74960]:       <nova:flavor name="m1.tiny">
Nov 03 12:17:23 user nova-compute[74960]:         <nova:memory>512</nova:memory>
Nov 03 12:17:23 user nova-compute[74960]:         <nova:disk>1</nova:disk>
Nov 03 12:17:23 user nova-compute[74960]:         <nova:swap>0</nova:swap>
Nov 03 12:17:23 user nova-compute[74960]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 12:17:23 user nova-compute[74960]:         <nova:vcpus>1</nova:vcpus>
Nov 03 12:17:23 user nova-compute[74960]:       </nova:flavor>
Nov 03 12:17:23 user nova-compute[74960]:       <nova:owner>
Nov 03 12:17:23 user nova-compute[74960]:         <nova:user uuid="9da58bde19c3434f9811cb80ed39dea9">tempest-TaggedAttachmentsTest-1950029920-project-member</nova:user>
Nov 03 12:17:23 user nova-compute[74960]:         <nova:project uuid="3390632661124edd9894dabac0053fa9">tempest-TaggedAttachmentsTest-1950029920</nova:project>
Nov 03 12:17:23 user nova-compute[74960]:       </nova:owner>
Nov 03 12:17:23 user nova-compute[74960]:       <nova:root type="image" uuid="549f51ba-ac69-494b-8de1-34635aa2d7cf"/>
Nov 03 12:17:23 user nova-compute[74960]:       <nova:ports>
Nov 03 12:17:23 user nova-compute[74960]:         <nova:port uuid="3e126a57-0883-4997-9c99-d25c9c6fc102">
Nov 03 12:17:23 user nova-compute[74960]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 03 12:17:23 user nova-compute[74960]:         </nova:port>
Nov 03 12:17:23 user nova-compute[74960]:       </nova:ports>
Nov 03 12:17:23 user nova-compute[74960]:     </nova:instance>
Nov 03 12:17:23 user nova-compute[74960]:   </metadata>
Nov 03 12:17:23 user nova-compute[74960]:   <sysinfo type="smbios">
Nov 03 12:17:23 user nova-compute[74960]:     <system>
Nov 03 12:17:23 user nova-compute[74960]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 12:17:23 user nova-compute[74960]:       <entry name="product">OpenStack Nova</entry>
Nov 03 12:17:23 user nova-compute[74960]:       <entry name="version">0.0.0</entry>
Nov 03 12:17:23 user nova-compute[74960]:       <entry name="serial">0a520c41-19c0-47ba-ada8-023ee9c12ca6</entry>
Nov 03 12:17:23 user nova-compute[74960]:       <entry name="uuid">0a520c41-19c0-47ba-ada8-023ee9c12ca6</entry>
Nov 03 12:17:23 user nova-compute[74960]:       <entry name="family">Virtual Machine</entry>
Nov 03 12:17:23 user nova-compute[74960]:     </system>
Nov 03 12:17:23 user nova-compute[74960]:   </sysinfo>
Nov 03 12:17:23 user nova-compute[74960]:   <os>
Nov 03 12:17:23 user nova-compute[74960]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 12:17:23 user nova-compute[74960]:     <boot dev="hd"/>
Nov 03 12:17:23 user nova-compute[74960]:     <smbios mode="sysinfo"/>
Nov 03 12:17:23 user nova-compute[74960]:   </os>
Nov 03 12:17:23 user nova-compute[74960]:   <features>
Nov 03 12:17:23 user nova-compute[74960]:     <acpi/>
Nov 03 12:17:23 user nova-compute[74960]:     <apic/>
Nov 03 12:17:23 user nova-compute[74960]:     <vmcoreinfo/>
Nov 03 12:17:23 user nova-compute[74960]:   </features>
Nov 03 12:17:23 user nova-compute[74960]:   <clock offset="utc">
Nov 03 12:17:23 user nova-compute[74960]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 12:17:23 user nova-compute[74960]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 12:17:23 user nova-compute[74960]:     <timer name="hpet" present="no"/>
Nov 03 12:17:23 user nova-compute[74960]:   </clock>
Nov 03 12:17:23 user nova-compute[74960]:   <cpu mode="custom" match="exact">
Nov 03 12:17:23 user nova-compute[74960]:     <model>Nehalem</model>
Nov 03 12:17:23 user nova-compute[74960]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 12:17:23 user nova-compute[74960]:   </cpu>
Nov 03 12:17:23 user nova-compute[74960]:   <devices>
Nov 03 12:17:23 user nova-compute[74960]:     <disk type="file" device="disk">
Nov 03 12:17:23 user nova-compute[74960]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 12:17:23 user nova-compute[74960]:       <source file="/opt/stack/data/nova/instances/0a520c41-19c0-47ba-ada8-023ee9c12ca6/disk"/>
Nov 03 12:17:23 user nova-compute[74960]:       <target dev="vda" bus="virtio"/>
Nov 03 12:17:23 user nova-compute[74960]:     </disk>
Nov 03 12:17:23 user nova-compute[74960]:     <disk type="file" device="cdrom">
Nov 03 12:17:23 user nova-compute[74960]:       <driver name="qemu" type="raw" cache="none"/>
Nov 03 12:17:23 user nova-compute[74960]:       <source file="/opt/stack/data/nova/instances/0a520c41-19c0-47ba-ada8-023ee9c12ca6/disk.config"/>
Nov 03 12:17:23 user nova-compute[74960]:       <target dev="hda" bus="ide"/>
Nov 03 12:17:23 user nova-compute[74960]:     </disk>
Nov 03 12:17:23 user nova-compute[74960]:     <interface type="ethernet">
Nov 03 12:17:23 user nova-compute[74960]:       <mac address="fa:16:3e:f9:07:9b"/>
Nov 03 12:17:23 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:17:23 user nova-compute[74960]:       <mtu size="1442"/>
Nov 03 12:17:23 user nova-compute[74960]:       <target dev="tap3e126a57-08"/>
Nov 03 12:17:23 user nova-compute[74960]:     </interface>
Nov 03 12:17:23 user nova-compute[74960]:     <serial type="pty">
Nov 03 12:17:23 user nova-compute[74960]:       <log file="/opt/stack/data/nova/instances/0a520c41-19c0-47ba-ada8-023ee9c12ca6/console.log" append="off"/>
Nov 03 12:17:23 user nova-compute[74960]:     </serial>
Nov 03 12:17:23 user nova-compute[74960]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 12:17:23 user nova-compute[74960]:     <video>
Nov 03 12:17:23 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:17:23 user nova-compute[74960]:     </video>
Nov 03 12:17:23 user nova-compute[74960]:     <rng model="virtio">
Nov 03 12:17:23 user nova-compute[74960]:       <backend model="random">/dev/urandom</backend>
Nov 03 12:17:23 user nova-compute[74960]:     </rng>
Nov 03 12:17:23 user nova-compute[74960]:     <controller type="usb" index="0" model="none"/>
Nov 03 12:17:23 user nova-compute[74960]:     <memballoon model="virtio">
Nov 03 12:17:23 user nova-compute[74960]:       <stats period="10"/>
Nov 03 12:17:23 user nova-compute[74960]:     </memballoon>
Nov 03 12:17:23 user nova-compute[74960]:   </devices>
Nov 03 12:17:23 user nova-compute[74960]: </domain>
Nov 03 12:17:23 user nova-compute[74960]:  {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 12:17:23 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-50df3a37-1c20-4e71-81a3-553ace77ad46 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T12:17:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-718860820',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-718860820',id=7,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLwaiWOkf4g+xGnCHIQ6PEXYDCQvWANu1aoEqkgH8PkfR56o+3+BPp4uxgAn5C+zZDpe3SkZ06KyunCKlhSZpIVyhUY157dTlXxkUygCex89TiMcoPvBPFCYXJkTY4on1A==',key_name='tempest-keypair-1456184094',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3390632661124edd9894dabac0053fa9',ramdisk_id='',reservation_id='r-zkhug3rc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1950029920',owner_user_name='tempest-TaggedAttachmentsTest-1950029920-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:17:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9da58bde19c3434f9811cb80ed39dea9',uuid=0a520c41-19c0-47ba-ada8-023ee9c12ca6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3e126a57-0883-4997-9c99-d25c9c6fc102", "address": "fa:16:3e:f9:07:9b", "network": {"id": "65e1589f-341c-4cc8-a8e6-5b61544daf55", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1130686752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3390632661124edd9894dabac0053fa9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e126a57-08", "ovs_interfaceid": "3e126a57-0883-4997-9c99-d25c9c6fc102", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 12:17:23 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-50df3a37-1c20-4e71-81a3-553ace77ad46 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Converting VIF {"id": "3e126a57-0883-4997-9c99-d25c9c6fc102", "address": "fa:16:3e:f9:07:9b", "network": {"id": "65e1589f-341c-4cc8-a8e6-5b61544daf55", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1130686752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3390632661124edd9894dabac0053fa9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e126a57-08", "ovs_interfaceid": "3e126a57-0883-4997-9c99-d25c9c6fc102", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:17:23 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-50df3a37-1c20-4e71-81a3-553ace77ad46 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:07:9b,bridge_name='br-int',has_traffic_filtering=True,id=3e126a57-0883-4997-9c99-d25c9c6fc102,network=Network(65e1589f-341c-4cc8-a8e6-5b61544daf55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e126a57-08') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:17:23 user nova-compute[74960]: DEBUG os_vif [None req-50df3a37-1c20-4e71-81a3-553ace77ad46 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:07:9b,bridge_name='br-int',has_traffic_filtering=True,id=3e126a57-0883-4997-9c99-d25c9c6fc102,network=Network(65e1589f-341c-4cc8-a8e6-5b61544daf55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e126a57-08') {{(pid=74960) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 12:17:23 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:17:23 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:17:23 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 12:17:23 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:17:23 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7939c333-d556-5e66-a7d9-3f4bab06878c', '_type': 'linux-noop'}}, row=False) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:17:23 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:17:23 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:17:23 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:17:23 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:17:23 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3e126a57-08, may_exist=True, interface_attrs={}) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:17:23 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3e126a57-08, col_values=(('qos', UUID('17dcad70-cdf6-4265-9d5b-14bf165c2361')),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:17:23 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3e126a57-08, col_values=(('external_ids', {'iface-id': '3e126a57-0883-4997-9c99-d25c9c6fc102', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f9:07:9b', 'vm-uuid': '0a520c41-19c0-47ba-ada8-023ee9c12ca6'}),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:17:23 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:17:23 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:17:24 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:17:24 user nova-compute[74960]: INFO os_vif [None req-50df3a37-1c20-4e71-81a3-553ace77ad46 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:07:9b,bridge_name='br-int',has_traffic_filtering=True,id=3e126a57-0883-4997-9c99-d25c9c6fc102,network=Network(65e1589f-341c-4cc8-a8e6-5b61544daf55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e126a57-08')
Nov 03 12:17:24 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-50df3a37-1c20-4e71-81a3-553ace77ad46 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] No BDM found with device name vda, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:17:24 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-50df3a37-1c20-4e71-81a3-553ace77ad46 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] No BDM found with device name hda, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:17:24 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-50df3a37-1c20-4e71-81a3-553ace77ad46 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] No VIF found with MAC fa:16:3e:f9:07:9b, not building metadata {{(pid=74960) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 12:17:24 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-50df3a37-1c20-4e71-81a3-553ace77ad46 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] Using config drive
Nov 03 12:17:24 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-99e9ceed-e8ff-4581-99e9-6ca890a66fea tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] Acquiring lock "7f7fabc2-5e1b-441c-a693-9956470359ea" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:17:24 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-99e9ceed-e8ff-4581-99e9-6ca890a66fea tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] Lock "7f7fabc2-5e1b-441c-a693-9956470359ea" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:17:24 user nova-compute[74960]: DEBUG nova.compute.manager [None req-99e9ceed-e8ff-4581-99e9-6ca890a66fea tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea] Starting instance... {{(pid=74960) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 12:17:24 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-99e9ceed-e8ff-4581-99e9-6ca890a66fea tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:17:24 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-99e9ceed-e8ff-4581-99e9-6ca890a66fea tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:17:24 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-99e9ceed-e8ff-4581-99e9-6ca890a66fea tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74960) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 12:17:24 user nova-compute[74960]: INFO nova.compute.claims [None req-99e9ceed-e8ff-4581-99e9-6ca890a66fea tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea] Claim successful on node user
Nov 03 12:17:24 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-50df3a37-1c20-4e71-81a3-553ace77ad46 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] Creating config drive at /opt/stack/data/nova/instances/0a520c41-19c0-47ba-ada8-023ee9c12ca6/disk.config
Nov 03 12:17:24 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-50df3a37-1c20-4e71-81a3-553ace77ad46 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/0a520c41-19c0-47ba-ada8-023ee9c12ca6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpdsau8gat {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:17:24 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-50df3a37-1c20-4e71-81a3-553ace77ad46 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/0a520c41-19c0-47ba-ada8-023ee9c12ca6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpdsau8gat" returned: 0 in 0.060s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:17:24 user nova-compute[74960]: DEBUG nova.compute.manager [req-786247dd-f632-4d33-9328-d7c95214ab08 req-48d9b168-babb-4ccb-9135-1d06cab1b1cd service nova] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] Received event network-changed-3e126a57-0883-4997-9c99-d25c9c6fc102 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:17:24 user nova-compute[74960]: DEBUG nova.compute.manager [req-786247dd-f632-4d33-9328-d7c95214ab08 req-48d9b168-babb-4ccb-9135-1d06cab1b1cd service nova] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] Refreshing instance network info cache due to event network-changed-3e126a57-0883-4997-9c99-d25c9c6fc102. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 12:17:24 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-786247dd-f632-4d33-9328-d7c95214ab08 req-48d9b168-babb-4ccb-9135-1d06cab1b1cd service nova] Acquiring lock "refresh_cache-0a520c41-19c0-47ba-ada8-023ee9c12ca6" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:17:24 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-786247dd-f632-4d33-9328-d7c95214ab08 req-48d9b168-babb-4ccb-9135-1d06cab1b1cd service nova] Acquired lock "refresh_cache-0a520c41-19c0-47ba-ada8-023ee9c12ca6" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:17:24 user nova-compute[74960]: DEBUG nova.network.neutron [req-786247dd-f632-4d33-9328-d7c95214ab08 req-48d9b168-babb-4ccb-9135-1d06cab1b1cd service nova] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] Refreshing network info cache for port 3e126a57-0883-4997-9c99-d25c9c6fc102 {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 12:17:24 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-99e9ceed-e8ff-4581-99e9-6ca890a66fea tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:17:24 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-99e9ceed-e8ff-4581-99e9-6ca890a66fea tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:17:24 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-99e9ceed-e8ff-4581-99e9-6ca890a66fea tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.526s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:17:24 user nova-compute[74960]: DEBUG nova.compute.manager [None req-99e9ceed-e8ff-4581-99e9-6ca890a66fea tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea] Start building networks asynchronously for instance. {{(pid=74960) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 12:17:24 user nova-compute[74960]: DEBUG nova.compute.manager [None req-99e9ceed-e8ff-4581-99e9-6ca890a66fea tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea] Allocating IP information in the background. {{(pid=74960) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 12:17:24 user nova-compute[74960]: DEBUG nova.network.neutron [None req-99e9ceed-e8ff-4581-99e9-6ca890a66fea tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea] allocate_for_instance() {{(pid=74960) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 12:17:24 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-99e9ceed-e8ff-4581-99e9-6ca890a66fea tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 12:17:25 user nova-compute[74960]: DEBUG nova.compute.manager [None req-99e9ceed-e8ff-4581-99e9-6ca890a66fea tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea] Start building block device mappings for instance. {{(pid=74960) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 12:17:25 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:17:25 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:17:25 user nova-compute[74960]: DEBUG nova.compute.manager [None req-99e9ceed-e8ff-4581-99e9-6ca890a66fea tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea] Start spawning the instance on the hypervisor. {{(pid=74960) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 12:17:25 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-99e9ceed-e8ff-4581-99e9-6ca890a66fea tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea] Creating instance directory {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 12:17:25 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-99e9ceed-e8ff-4581-99e9-6ca890a66fea tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea] Creating image(s)
Nov 03 12:17:25 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-99e9ceed-e8ff-4581-99e9-6ca890a66fea tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] Acquiring lock "/opt/stack/data/nova/instances/7f7fabc2-5e1b-441c-a693-9956470359ea/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:17:25 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-99e9ceed-e8ff-4581-99e9-6ca890a66fea tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] Lock "/opt/stack/data/nova/instances/7f7fabc2-5e1b-441c-a693-9956470359ea/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.004s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:17:25 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-99e9ceed-e8ff-4581-99e9-6ca890a66fea tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] Lock "/opt/stack/data/nova/instances/7f7fabc2-5e1b-441c-a693-9956470359ea/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:17:25 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:17:25 user nova-compute[74960]: DEBUG nova.policy [None req-99e9ceed-e8ff-4581-99e9-6ca890a66fea tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7b8f8f5099bf4f98bef5337ea5442439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225ccae506a541b3a766b70610efba47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74960) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 12:17:25 user nova-compute[74960]: DEBUG nova.network.neutron [req-786247dd-f632-4d33-9328-d7c95214ab08 req-48d9b168-babb-4ccb-9135-1d06cab1b1cd service nova] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] Updated VIF entry in instance network info cache for port 3e126a57-0883-4997-9c99-d25c9c6fc102. {{(pid=74960) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 12:17:25 user nova-compute[74960]: DEBUG nova.network.neutron [req-786247dd-f632-4d33-9328-d7c95214ab08 req-48d9b168-babb-4ccb-9135-1d06cab1b1cd service nova] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] Updating instance_info_cache with network_info: [{"id": "3e126a57-0883-4997-9c99-d25c9c6fc102", "address": "fa:16:3e:f9:07:9b", "network": {"id": "65e1589f-341c-4cc8-a8e6-5b61544daf55", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1130686752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3390632661124edd9894dabac0053fa9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e126a57-08", "ovs_interfaceid": "3e126a57-0883-4997-9c99-d25c9c6fc102", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:17:25 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-99e9ceed-e8ff-4581-99e9-6ca890a66fea tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:17:25 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-786247dd-f632-4d33-9328-d7c95214ab08 req-48d9b168-babb-4ccb-9135-1d06cab1b1cd service nova] Releasing lock "refresh_cache-0a520c41-19c0-47ba-ada8-023ee9c12ca6" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:17:25 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-99e9ceed-e8ff-4581-99e9-6ca890a66fea tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.225s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:17:25 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-99e9ceed-e8ff-4581-99e9-6ca890a66fea tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] Acquiring lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:17:25 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-99e9ceed-e8ff-4581-99e9-6ca890a66fea tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] Lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:17:25 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-99e9ceed-e8ff-4581-99e9-6ca890a66fea tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:17:25 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-99e9ceed-e8ff-4581-99e9-6ca890a66fea tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.224s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:17:25 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-99e9ceed-e8ff-4581-99e9-6ca890a66fea tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910,backing_fmt=raw /opt/stack/data/nova/instances/7f7fabc2-5e1b-441c-a693-9956470359ea/disk 1073741824 {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:17:25 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-99e9ceed-e8ff-4581-99e9-6ca890a66fea tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910,backing_fmt=raw /opt/stack/data/nova/instances/7f7fabc2-5e1b-441c-a693-9956470359ea/disk 1073741824" returned: 0 in 0.099s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:17:25 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-99e9ceed-e8ff-4581-99e9-6ca890a66fea tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] Lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.345s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:17:25 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-99e9ceed-e8ff-4581-99e9-6ca890a66fea tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:17:25 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:17:25 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:17:25 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:17:25 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:17:26 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:17:26 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-99e9ceed-e8ff-4581-99e9-6ca890a66fea tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.257s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:17:26 user nova-compute[74960]: DEBUG nova.virt.disk.api [None req-99e9ceed-e8ff-4581-99e9-6ca890a66fea tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7f7fabc2-5e1b-441c-a693-9956470359ea/disk. size=1073741824 {{(pid=74960) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 12:17:26 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-99e9ceed-e8ff-4581-99e9-6ca890a66fea tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f7fabc2-5e1b-441c-a693-9956470359ea/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:17:26 user nova-compute[74960]: DEBUG nova.network.neutron [None req-99e9ceed-e8ff-4581-99e9-6ca890a66fea tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea] Successfully created port: ced0ad7a-92e5-4d88-8b6a-1f30efea310e {{(pid=74960) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 12:17:26 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-99e9ceed-e8ff-4581-99e9-6ca890a66fea tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f7fabc2-5e1b-441c-a693-9956470359ea/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:17:26 user nova-compute[74960]: DEBUG nova.virt.disk.api [None req-99e9ceed-e8ff-4581-99e9-6ca890a66fea tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] Cannot resize image /opt/stack/data/nova/instances/7f7fabc2-5e1b-441c-a693-9956470359ea/disk to a smaller size. {{(pid=74960) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 12:17:26 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-99e9ceed-e8ff-4581-99e9-6ca890a66fea tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea] Created local disks {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 12:17:26 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-99e9ceed-e8ff-4581-99e9-6ca890a66fea tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea] Ensure instance console log exists: /opt/stack/data/nova/instances/7f7fabc2-5e1b-441c-a693-9956470359ea/console.log {{(pid=74960) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 12:17:26 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-99e9ceed-e8ff-4581-99e9-6ca890a66fea tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:17:26 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-99e9ceed-e8ff-4581-99e9-6ca890a66fea tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:17:26 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-99e9ceed-e8ff-4581-99e9-6ca890a66fea tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:17:26 user nova-compute[74960]: DEBUG nova.compute.manager [req-43726261-06af-4501-876b-b78c9dabfe28 req-98a69ed0-ac82-458d-b0e6-846a55d33ec0 service nova] [instance: 8381c969-6a2d-4934-aadd-660ffa246b05] Received event network-vif-plugged-df5604b7-7f5b-4738-b218-0016b4441542 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:17:26 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-43726261-06af-4501-876b-b78c9dabfe28 req-98a69ed0-ac82-458d-b0e6-846a55d33ec0 service nova] Acquiring lock "8381c969-6a2d-4934-aadd-660ffa246b05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:17:26 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-43726261-06af-4501-876b-b78c9dabfe28 req-98a69ed0-ac82-458d-b0e6-846a55d33ec0 service nova] Lock "8381c969-6a2d-4934-aadd-660ffa246b05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:17:26 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-43726261-06af-4501-876b-b78c9dabfe28 req-98a69ed0-ac82-458d-b0e6-846a55d33ec0 service nova] Lock "8381c969-6a2d-4934-aadd-660ffa246b05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:17:26 user nova-compute[74960]: DEBUG nova.compute.manager [req-43726261-06af-4501-876b-b78c9dabfe28 req-98a69ed0-ac82-458d-b0e6-846a55d33ec0 service nova] [instance: 8381c969-6a2d-4934-aadd-660ffa246b05] No waiting events found dispatching network-vif-plugged-df5604b7-7f5b-4738-b218-0016b4441542 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:17:26 user nova-compute[74960]: WARNING nova.compute.manager [req-43726261-06af-4501-876b-b78c9dabfe28 req-98a69ed0-ac82-458d-b0e6-846a55d33ec0 service nova] [instance: 8381c969-6a2d-4934-aadd-660ffa246b05] Received unexpected event network-vif-plugged-df5604b7-7f5b-4738-b218-0016b4441542 for instance with vm_state building and task_state spawning.
Nov 03 12:17:26 user nova-compute[74960]: DEBUG nova.compute.manager [req-43726261-06af-4501-876b-b78c9dabfe28 req-98a69ed0-ac82-458d-b0e6-846a55d33ec0 service nova] [instance: 8381c969-6a2d-4934-aadd-660ffa246b05] Received event network-vif-plugged-df5604b7-7f5b-4738-b218-0016b4441542 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:17:26 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-43726261-06af-4501-876b-b78c9dabfe28 req-98a69ed0-ac82-458d-b0e6-846a55d33ec0 service nova] Acquiring lock "8381c969-6a2d-4934-aadd-660ffa246b05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:17:26 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-43726261-06af-4501-876b-b78c9dabfe28 req-98a69ed0-ac82-458d-b0e6-846a55d33ec0 service nova] Lock "8381c969-6a2d-4934-aadd-660ffa246b05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:17:26 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-43726261-06af-4501-876b-b78c9dabfe28 req-98a69ed0-ac82-458d-b0e6-846a55d33ec0 service nova] Lock "8381c969-6a2d-4934-aadd-660ffa246b05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:17:26 user nova-compute[74960]: DEBUG nova.compute.manager [req-43726261-06af-4501-876b-b78c9dabfe28 req-98a69ed0-ac82-458d-b0e6-846a55d33ec0 service nova] [instance: 8381c969-6a2d-4934-aadd-660ffa246b05] No waiting events found dispatching network-vif-plugged-df5604b7-7f5b-4738-b218-0016b4441542 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:17:26 user nova-compute[74960]: WARNING nova.compute.manager [req-43726261-06af-4501-876b-b78c9dabfe28 req-98a69ed0-ac82-458d-b0e6-846a55d33ec0 service nova] [instance: 8381c969-6a2d-4934-aadd-660ffa246b05] Received unexpected event network-vif-plugged-df5604b7-7f5b-4738-b218-0016b4441542 for instance with vm_state building and task_state spawning.
Nov 03 12:17:26 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:17:26 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:17:26 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:17:27 user nova-compute[74960]: DEBUG nova.network.neutron [None req-99e9ceed-e8ff-4581-99e9-6ca890a66fea tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea] Successfully updated port: ced0ad7a-92e5-4d88-8b6a-1f30efea310e {{(pid=74960) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 12:17:27 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-99e9ceed-e8ff-4581-99e9-6ca890a66fea tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] Acquiring lock "refresh_cache-7f7fabc2-5e1b-441c-a693-9956470359ea" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:17:27 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-99e9ceed-e8ff-4581-99e9-6ca890a66fea tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] Acquired lock "refresh_cache-7f7fabc2-5e1b-441c-a693-9956470359ea" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:17:27 user nova-compute[74960]: DEBUG nova.network.neutron [None req-99e9ceed-e8ff-4581-99e9-6ca890a66fea tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea] Building network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 12:17:27 user nova-compute[74960]: DEBUG nova.network.neutron [None req-99e9ceed-e8ff-4581-99e9-6ca890a66fea tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea] Instance cache missing network info. {{(pid=74960) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 12:17:27 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:17:27 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:17:27 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:17:27 user nova-compute[74960]: DEBUG nova.network.neutron [None req-99e9ceed-e8ff-4581-99e9-6ca890a66fea tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea] Updating instance_info_cache with network_info: [{"id": "ced0ad7a-92e5-4d88-8b6a-1f30efea310e", "address": "fa:16:3e:57:3d:47", "network": {"id": "c574281c-6841-42aa-9e46-d20e936c0d06", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2129338778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "225ccae506a541b3a766b70610efba47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapced0ad7a-92", "ovs_interfaceid": "ced0ad7a-92e5-4d88-8b6a-1f30efea310e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:17:27 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-99e9ceed-e8ff-4581-99e9-6ca890a66fea tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] Releasing lock "refresh_cache-7f7fabc2-5e1b-441c-a693-9956470359ea" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:17:27 user nova-compute[74960]: DEBUG nova.compute.manager [None req-99e9ceed-e8ff-4581-99e9-6ca890a66fea tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea] Instance network_info: |[{"id": "ced0ad7a-92e5-4d88-8b6a-1f30efea310e", "address": "fa:16:3e:57:3d:47", "network": {"id": "c574281c-6841-42aa-9e46-d20e936c0d06", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2129338778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "225ccae506a541b3a766b70610efba47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapced0ad7a-92", "ovs_interfaceid": "ced0ad7a-92e5-4d88-8b6a-1f30efea310e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74960) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 12:17:27 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-99e9ceed-e8ff-4581-99e9-6ca890a66fea tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea] Start _get_guest_xml network_info=[{"id": "ced0ad7a-92e5-4d88-8b6a-1f30efea310e", "address": "fa:16:3e:57:3d:47", "network": {"id": "c574281c-6841-42aa-9e46-d20e936c0d06", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2129338778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "225ccae506a541b3a766b70610efba47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapced0ad7a-92", "ovs_interfaceid": "ced0ad7a-92e5-4d88-8b6a-1f30efea310e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=549f51ba-ac69-494b-8de1-34635aa2d7cf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='63ee9c80c632442fb0379f47b784bd20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T12:13:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'image_id': '549f51ba-ac69-494b-8de1-34635aa2d7cf'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 12:17:27 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-99e9ceed-e8ff-4581-99e9-6ca890a66fea tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:17:27 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-99e9ceed-e8ff-4581-99e9-6ca890a66fea tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:17:27 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-99e9ceed-e8ff-4581-99e9-6ca890a66fea tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 12:17:27 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-99e9ceed-e8ff-4581-99e9-6ca890a66fea tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] CPU controller missing on host. {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 12:17:27 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-99e9ceed-e8ff-4581-99e9-6ca890a66fea tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 12:17:27 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-99e9ceed-e8ff-4581-99e9-6ca890a66fea tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] CPU controller found on host. {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 12:17:27 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-99e9ceed-e8ff-4581-99e9-6ca890a66fea tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74960) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 12:17:27 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-99e9ceed-e8ff-4581-99e9-6ca890a66fea tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=549f51ba-ac69-494b-8de1-34635aa2d7cf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='63ee9c80c632442fb0379f47b784bd20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T12:13:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 12:17:27 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-99e9ceed-e8ff-4581-99e9-6ca890a66fea tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] Flavor limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 12:17:27 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-99e9ceed-e8ff-4581-99e9-6ca890a66fea tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] Image limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 12:17:27 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-99e9ceed-e8ff-4581-99e9-6ca890a66fea tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] Flavor pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 12:17:27 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-99e9ceed-e8ff-4581-99e9-6ca890a66fea tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] Image pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 12:17:27 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-99e9ceed-e8ff-4581-99e9-6ca890a66fea tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 12:17:27 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-99e9ceed-e8ff-4581-99e9-6ca890a66fea tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 12:17:27 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-99e9ceed-e8ff-4581-99e9-6ca890a66fea tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 12:17:27 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-99e9ceed-e8ff-4581-99e9-6ca890a66fea tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] Got 1 possible topologies {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 12:17:27 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-99e9ceed-e8ff-4581-99e9-6ca890a66fea tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 12:17:27 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-99e9ceed-e8ff-4581-99e9-6ca890a66fea tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 12:17:27 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-99e9ceed-e8ff-4581-99e9-6ca890a66fea tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:17:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-126287268',display_name='tempest-VolumesAssistedSnapshotsTest-server-126287268',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-126287268',id=8,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB1WerQZZRZQNWH8+tKmmxlMfZLCzUY2s52yzvmIq2CHvTmBY8uTh4X2rIyq+ALd+S/QVAI/2zDxynbk0k4OuNpGSD8YiBSL6Yq8f9ezaSDgo9FB//kHnejkymHgtZ8TUQ==',key_name='tempest-keypair-1006582203',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='225ccae506a541b3a766b70610efba47',ramdisk_id='',reservation_id='r-r0ck1ub3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-552365423',owner_user_name='tempest-VolumesAssistedSnapshotsTest-552365423-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:17:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7b8f8f5099bf4f98bef5337ea5442439',uuid=7f7fabc2-5e1b-441c-a693-9956470359ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ced0ad7a-92e5-4d88-8b6a-1f30efea310e", "address": "fa:16:3e:57:3d:47", "network": {"id": "c574281c-6841-42aa-9e46-d20e936c0d06", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2129338778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "225ccae506a541b3a766b70610efba47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapced0ad7a-92", "ovs_interfaceid": "ced0ad7a-92e5-4d88-8b6a-1f30efea310e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74960) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 12:17:27 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-99e9ceed-e8ff-4581-99e9-6ca890a66fea tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] Converting VIF {"id": "ced0ad7a-92e5-4d88-8b6a-1f30efea310e", "address": "fa:16:3e:57:3d:47", "network": {"id": "c574281c-6841-42aa-9e46-d20e936c0d06", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2129338778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "225ccae506a541b3a766b70610efba47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapced0ad7a-92", "ovs_interfaceid": "ced0ad7a-92e5-4d88-8b6a-1f30efea310e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:17:27 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-99e9ceed-e8ff-4581-99e9-6ca890a66fea tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:3d:47,bridge_name='br-int',has_traffic_filtering=True,id=ced0ad7a-92e5-4d88-8b6a-1f30efea310e,network=Network(c574281c-6841-42aa-9e46-d20e936c0d06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapced0ad7a-92') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:17:27 user nova-compute[74960]: DEBUG nova.objects.instance [None req-99e9ceed-e8ff-4581-99e9-6ca890a66fea tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] Lazy-loading 'pci_devices' on Instance uuid 7f7fabc2-5e1b-441c-a693-9956470359ea {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:17:27 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-99e9ceed-e8ff-4581-99e9-6ca890a66fea tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea] End _get_guest_xml xml=<domain type="kvm">
Nov 03 12:17:27 user nova-compute[74960]:   <uuid>7f7fabc2-5e1b-441c-a693-9956470359ea</uuid>
Nov 03 12:17:27 user nova-compute[74960]:   <name>instance-00000008</name>
Nov 03 12:17:27 user nova-compute[74960]:   <memory>524288</memory>
Nov 03 12:17:27 user nova-compute[74960]:   <vcpu>1</vcpu>
Nov 03 12:17:27 user nova-compute[74960]:   <metadata>
Nov 03 12:17:27 user nova-compute[74960]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 12:17:27 user nova-compute[74960]:       <nova:package version="0.0.0"/>
Nov 03 12:17:27 user nova-compute[74960]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-126287268</nova:name>
Nov 03 12:17:27 user nova-compute[74960]:       <nova:creationTime>2023-11-03 12:17:27</nova:creationTime>
Nov 03 12:17:27 user nova-compute[74960]:       <nova:flavor name="m1.tiny">
Nov 03 12:17:27 user nova-compute[74960]:         <nova:memory>512</nova:memory>
Nov 03 12:17:27 user nova-compute[74960]:         <nova:disk>1</nova:disk>
Nov 03 12:17:27 user nova-compute[74960]:         <nova:swap>0</nova:swap>
Nov 03 12:17:27 user nova-compute[74960]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 12:17:27 user nova-compute[74960]:         <nova:vcpus>1</nova:vcpus>
Nov 03 12:17:27 user nova-compute[74960]:       </nova:flavor>
Nov 03 12:17:27 user nova-compute[74960]:       <nova:owner>
Nov 03 12:17:27 user nova-compute[74960]:         <nova:user uuid="7b8f8f5099bf4f98bef5337ea5442439">tempest-VolumesAssistedSnapshotsTest-552365423-project-member</nova:user>
Nov 03 12:17:27 user nova-compute[74960]:         <nova:project uuid="225ccae506a541b3a766b70610efba47">tempest-VolumesAssistedSnapshotsTest-552365423</nova:project>
Nov 03 12:17:27 user nova-compute[74960]:       </nova:owner>
Nov 03 12:17:27 user nova-compute[74960]:       <nova:root type="image" uuid="549f51ba-ac69-494b-8de1-34635aa2d7cf"/>
Nov 03 12:17:27 user nova-compute[74960]:       <nova:ports>
Nov 03 12:17:27 user nova-compute[74960]:         <nova:port uuid="ced0ad7a-92e5-4d88-8b6a-1f30efea310e">
Nov 03 12:17:27 user nova-compute[74960]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 03 12:17:27 user nova-compute[74960]:         </nova:port>
Nov 03 12:17:27 user nova-compute[74960]:       </nova:ports>
Nov 03 12:17:27 user nova-compute[74960]:     </nova:instance>
Nov 03 12:17:27 user nova-compute[74960]:   </metadata>
Nov 03 12:17:27 user nova-compute[74960]:   <sysinfo type="smbios">
Nov 03 12:17:27 user nova-compute[74960]:     <system>
Nov 03 12:17:27 user nova-compute[74960]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 12:17:27 user nova-compute[74960]:       <entry name="product">OpenStack Nova</entry>
Nov 03 12:17:27 user nova-compute[74960]:       <entry name="version">0.0.0</entry>
Nov 03 12:17:27 user nova-compute[74960]:       <entry name="serial">7f7fabc2-5e1b-441c-a693-9956470359ea</entry>
Nov 03 12:17:27 user nova-compute[74960]:       <entry name="uuid">7f7fabc2-5e1b-441c-a693-9956470359ea</entry>
Nov 03 12:17:27 user nova-compute[74960]:       <entry name="family">Virtual Machine</entry>
Nov 03 12:17:27 user nova-compute[74960]:     </system>
Nov 03 12:17:27 user nova-compute[74960]:   </sysinfo>
Nov 03 12:17:27 user nova-compute[74960]:   <os>
Nov 03 12:17:27 user nova-compute[74960]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 12:17:27 user nova-compute[74960]:     <boot dev="hd"/>
Nov 03 12:17:27 user nova-compute[74960]:     <smbios mode="sysinfo"/>
Nov 03 12:17:27 user nova-compute[74960]:   </os>
Nov 03 12:17:27 user nova-compute[74960]:   <features>
Nov 03 12:17:27 user nova-compute[74960]:     <acpi/>
Nov 03 12:17:27 user nova-compute[74960]:     <apic/>
Nov 03 12:17:27 user nova-compute[74960]:     <vmcoreinfo/>
Nov 03 12:17:27 user nova-compute[74960]:   </features>
Nov 03 12:17:27 user nova-compute[74960]:   <clock offset="utc">
Nov 03 12:17:27 user nova-compute[74960]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 12:17:27 user nova-compute[74960]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 12:17:27 user nova-compute[74960]:     <timer name="hpet" present="no"/>
Nov 03 12:17:27 user nova-compute[74960]:   </clock>
Nov 03 12:17:27 user nova-compute[74960]:   <cpu mode="custom" match="exact">
Nov 03 12:17:27 user nova-compute[74960]:     <model>Nehalem</model>
Nov 03 12:17:27 user nova-compute[74960]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 12:17:27 user nova-compute[74960]:   </cpu>
Nov 03 12:17:27 user nova-compute[74960]:   <devices>
Nov 03 12:17:27 user nova-compute[74960]:     <disk type="file" device="disk">
Nov 03 12:17:27 user nova-compute[74960]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 12:17:27 user nova-compute[74960]:       <source file="/opt/stack/data/nova/instances/7f7fabc2-5e1b-441c-a693-9956470359ea/disk"/>
Nov 03 12:17:27 user nova-compute[74960]:       <target dev="vda" bus="virtio"/>
Nov 03 12:17:27 user nova-compute[74960]:     </disk>
Nov 03 12:17:27 user nova-compute[74960]:     <interface type="ethernet">
Nov 03 12:17:27 user nova-compute[74960]:       <mac address="fa:16:3e:57:3d:47"/>
Nov 03 12:17:27 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:17:27 user nova-compute[74960]:       <mtu size="1442"/>
Nov 03 12:17:27 user nova-compute[74960]:       <target dev="tapced0ad7a-92"/>
Nov 03 12:17:27 user nova-compute[74960]:     </interface>
Nov 03 12:17:27 user nova-compute[74960]:     <serial type="pty">
Nov 03 12:17:27 user nova-compute[74960]:       <log file="/opt/stack/data/nova/instances/7f7fabc2-5e1b-441c-a693-9956470359ea/console.log" append="off"/>
Nov 03 12:17:27 user nova-compute[74960]:     </serial>
Nov 03 12:17:27 user nova-compute[74960]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 12:17:27 user nova-compute[74960]:     <video>
Nov 03 12:17:27 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:17:27 user nova-compute[74960]:     </video>
Nov 03 12:17:27 user nova-compute[74960]:     <rng model="virtio">
Nov 03 12:17:27 user nova-compute[74960]:       <backend model="random">/dev/urandom</backend>
Nov 03 12:17:27 user nova-compute[74960]:     </rng>
Nov 03 12:17:27 user nova-compute[74960]:     <controller type="usb" index="0" model="none"/>
Nov 03 12:17:27 user nova-compute[74960]:     <memballoon model="virtio">
Nov 03 12:17:27 user nova-compute[74960]:       <stats period="10"/>
Nov 03 12:17:27 user nova-compute[74960]:     </memballoon>
Nov 03 12:17:27 user nova-compute[74960]:   </devices>
Nov 03 12:17:27 user nova-compute[74960]: </domain>
Nov 03 12:17:27 user nova-compute[74960]:  {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 12:17:27 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-99e9ceed-e8ff-4581-99e9-6ca890a66fea tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:17:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-126287268',display_name='tempest-VolumesAssistedSnapshotsTest-server-126287268',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-126287268',id=8,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB1WerQZZRZQNWH8+tKmmxlMfZLCzUY2s52yzvmIq2CHvTmBY8uTh4X2rIyq+ALd+S/QVAI/2zDxynbk0k4OuNpGSD8YiBSL6Yq8f9ezaSDgo9FB//kHnejkymHgtZ8TUQ==',key_name='tempest-keypair-1006582203',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='225ccae506a541b3a766b70610efba47',ramdisk_id='',reservation_id='r-r0ck1ub3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-552365423',owner_user_name='tempest-VolumesAssistedSnapshotsTest-552365423-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:17:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7b8f8f5099bf4f98bef5337ea5442439',uuid=7f7fabc2-5e1b-441c-a693-9956470359ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ced0ad7a-92e5-4d88-8b6a-1f30efea310e", "address": "fa:16:3e:57:3d:47", "network": {"id": "c574281c-6841-42aa-9e46-d20e936c0d06", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2129338778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "225ccae506a541b3a766b70610efba47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapced0ad7a-92", "ovs_interfaceid": "ced0ad7a-92e5-4d88-8b6a-1f30efea310e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 12:17:27 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-99e9ceed-e8ff-4581-99e9-6ca890a66fea tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] Converting VIF {"id": "ced0ad7a-92e5-4d88-8b6a-1f30efea310e", "address": "fa:16:3e:57:3d:47", "network": {"id": "c574281c-6841-42aa-9e46-d20e936c0d06", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2129338778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "225ccae506a541b3a766b70610efba47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapced0ad7a-92", "ovs_interfaceid": "ced0ad7a-92e5-4d88-8b6a-1f30efea310e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:17:27 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-99e9ceed-e8ff-4581-99e9-6ca890a66fea tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:3d:47,bridge_name='br-int',has_traffic_filtering=True,id=ced0ad7a-92e5-4d88-8b6a-1f30efea310e,network=Network(c574281c-6841-42aa-9e46-d20e936c0d06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapced0ad7a-92') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:17:27 user nova-compute[74960]: DEBUG os_vif [None req-99e9ceed-e8ff-4581-99e9-6ca890a66fea tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:3d:47,bridge_name='br-int',has_traffic_filtering=True,id=ced0ad7a-92e5-4d88-8b6a-1f30efea310e,network=Network(c574281c-6841-42aa-9e46-d20e936c0d06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapced0ad7a-92') {{(pid=74960) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 12:17:27 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:17:27 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:17:27 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 12:17:27 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:17:27 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fd7445c4-e186-52a8-abe5-11a7a89cfba2', '_type': 'linux-noop'}}, row=False) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:17:27 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:17:27 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:17:27 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:17:27 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapced0ad7a-92, may_exist=True, interface_attrs={}) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:17:27 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapced0ad7a-92, col_values=(('qos', UUID('f78748f6-f297-4c84-869a-d26712479a73')),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:17:27 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapced0ad7a-92, col_values=(('external_ids', {'iface-id': 'ced0ad7a-92e5-4d88-8b6a-1f30efea310e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:57:3d:47', 'vm-uuid': '7f7fabc2-5e1b-441c-a693-9956470359ea'}),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:17:27 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:17:27 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:17:27 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:17:27 user nova-compute[74960]: INFO os_vif [None req-99e9ceed-e8ff-4581-99e9-6ca890a66fea tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:3d:47,bridge_name='br-int',has_traffic_filtering=True,id=ced0ad7a-92e5-4d88-8b6a-1f30efea310e,network=Network(c574281c-6841-42aa-9e46-d20e936c0d06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapced0ad7a-92')
Nov 03 12:17:28 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-99e9ceed-e8ff-4581-99e9-6ca890a66fea tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] No BDM found with device name vda, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:17:28 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-99e9ceed-e8ff-4581-99e9-6ca890a66fea tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] No VIF found with MAC fa:16:3e:57:3d:47, not building metadata {{(pid=74960) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 12:17:28 user nova-compute[74960]: DEBUG nova.compute.manager [req-43da65e8-2341-4c33-b1b0-59f2921bc5c5 req-329456b9-2012-4834-b58f-1594ce3a4821 service nova] [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea] Received event network-changed-ced0ad7a-92e5-4d88-8b6a-1f30efea310e {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:17:28 user nova-compute[74960]: DEBUG nova.compute.manager [req-43da65e8-2341-4c33-b1b0-59f2921bc5c5 req-329456b9-2012-4834-b58f-1594ce3a4821 service nova] [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea] Refreshing instance network info cache due to event network-changed-ced0ad7a-92e5-4d88-8b6a-1f30efea310e. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 12:17:28 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-43da65e8-2341-4c33-b1b0-59f2921bc5c5 req-329456b9-2012-4834-b58f-1594ce3a4821 service nova] Acquiring lock "refresh_cache-7f7fabc2-5e1b-441c-a693-9956470359ea" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:17:28 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-43da65e8-2341-4c33-b1b0-59f2921bc5c5 req-329456b9-2012-4834-b58f-1594ce3a4821 service nova] Acquired lock "refresh_cache-7f7fabc2-5e1b-441c-a693-9956470359ea" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:17:28 user nova-compute[74960]: DEBUG nova.network.neutron [req-43da65e8-2341-4c33-b1b0-59f2921bc5c5 req-329456b9-2012-4834-b58f-1594ce3a4821 service nova] [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea] Refreshing network info cache for port ced0ad7a-92e5-4d88-8b6a-1f30efea310e {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 12:17:29 user nova-compute[74960]: DEBUG nova.network.neutron [req-43da65e8-2341-4c33-b1b0-59f2921bc5c5 req-329456b9-2012-4834-b58f-1594ce3a4821 service nova] [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea] Updated VIF entry in instance network info cache for port ced0ad7a-92e5-4d88-8b6a-1f30efea310e. {{(pid=74960) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 12:17:29 user nova-compute[74960]: DEBUG nova.network.neutron [req-43da65e8-2341-4c33-b1b0-59f2921bc5c5 req-329456b9-2012-4834-b58f-1594ce3a4821 service nova] [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea] Updating instance_info_cache with network_info: [{"id": "ced0ad7a-92e5-4d88-8b6a-1f30efea310e", "address": "fa:16:3e:57:3d:47", "network": {"id": "c574281c-6841-42aa-9e46-d20e936c0d06", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2129338778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "225ccae506a541b3a766b70610efba47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapced0ad7a-92", "ovs_interfaceid": "ced0ad7a-92e5-4d88-8b6a-1f30efea310e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:17:29 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-43da65e8-2341-4c33-b1b0-59f2921bc5c5 req-329456b9-2012-4834-b58f-1594ce3a4821 service nova] Releasing lock "refresh_cache-7f7fabc2-5e1b-441c-a693-9956470359ea" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:17:29 user nova-compute[74960]: DEBUG nova.compute.manager [None req-ff586988-8547-4bd3-8329-23b093a330b9 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] [instance: 8381c969-6a2d-4934-aadd-660ffa246b05] Instance event wait completed in 0 seconds for  {{(pid=74960) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 12:17:29 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-ff586988-8547-4bd3-8329-23b093a330b9 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] [instance: 8381c969-6a2d-4934-aadd-660ffa246b05] Guest created on hypervisor {{(pid=74960) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 12:17:29 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: 8381c969-6a2d-4934-aadd-660ffa246b05] Instance spawned successfully.
Nov 03 12:17:29 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-ff586988-8547-4bd3-8329-23b093a330b9 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] [instance: 8381c969-6a2d-4934-aadd-660ffa246b05] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 12:17:29 user nova-compute[74960]: DEBUG nova.compute.manager [None req-50df3a37-1c20-4e71-81a3-553ace77ad46 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] Instance event wait completed in 0 seconds for  {{(pid=74960) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 12:17:29 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-50df3a37-1c20-4e71-81a3-553ace77ad46 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] Guest created on hypervisor {{(pid=74960) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 12:17:29 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] Instance spawned successfully.
Nov 03 12:17:29 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-50df3a37-1c20-4e71-81a3-553ace77ad46 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 12:17:29 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-ff586988-8547-4bd3-8329-23b093a330b9 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] [instance: 8381c969-6a2d-4934-aadd-660ffa246b05] Found default for hw_cdrom_bus of ide {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:17:29 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-ff586988-8547-4bd3-8329-23b093a330b9 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] [instance: 8381c969-6a2d-4934-aadd-660ffa246b05] Found default for hw_disk_bus of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:17:29 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-ff586988-8547-4bd3-8329-23b093a330b9 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] [instance: 8381c969-6a2d-4934-aadd-660ffa246b05] Found default for hw_input_bus of None {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:17:29 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-ff586988-8547-4bd3-8329-23b093a330b9 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] [instance: 8381c969-6a2d-4934-aadd-660ffa246b05] Found default for hw_pointer_model of None {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:17:29 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-ff586988-8547-4bd3-8329-23b093a330b9 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] [instance: 8381c969-6a2d-4934-aadd-660ffa246b05] Found default for hw_video_model of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:17:29 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-ff586988-8547-4bd3-8329-23b093a330b9 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] [instance: 8381c969-6a2d-4934-aadd-660ffa246b05] Found default for hw_vif_model of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:17:29 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-50df3a37-1c20-4e71-81a3-553ace77ad46 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] Found default for hw_cdrom_bus of ide {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:17:29 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-50df3a37-1c20-4e71-81a3-553ace77ad46 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] Found default for hw_disk_bus of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:17:29 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-50df3a37-1c20-4e71-81a3-553ace77ad46 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] Found default for hw_input_bus of None {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:17:29 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-50df3a37-1c20-4e71-81a3-553ace77ad46 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] Found default for hw_pointer_model of None {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:17:29 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-50df3a37-1c20-4e71-81a3-553ace77ad46 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] Found default for hw_video_model of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:17:29 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-50df3a37-1c20-4e71-81a3-553ace77ad46 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] Found default for hw_vif_model of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:17:29 user nova-compute[74960]: INFO nova.compute.manager [None req-ff586988-8547-4bd3-8329-23b093a330b9 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] [instance: 8381c969-6a2d-4934-aadd-660ffa246b05] Took 10.81 seconds to spawn the instance on the hypervisor.
Nov 03 12:17:29 user nova-compute[74960]: DEBUG nova.compute.manager [None req-ff586988-8547-4bd3-8329-23b093a330b9 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] [instance: 8381c969-6a2d-4934-aadd-660ffa246b05] Checking state {{(pid=74960) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 12:17:29 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:17:29 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:17:29 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:17:29 user nova-compute[74960]: INFO nova.compute.manager [None req-50df3a37-1c20-4e71-81a3-553ace77ad46 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] Took 10.07 seconds to spawn the instance on the hypervisor.
Nov 03 12:17:29 user nova-compute[74960]: DEBUG nova.compute.manager [None req-50df3a37-1c20-4e71-81a3-553ace77ad46 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] Checking state {{(pid=74960) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 12:17:30 user nova-compute[74960]: INFO nova.compute.manager [None req-ff586988-8547-4bd3-8329-23b093a330b9 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] [instance: 8381c969-6a2d-4934-aadd-660ffa246b05] Took 12.18 seconds to build instance.
Nov 03 12:17:30 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-ff586988-8547-4bd3-8329-23b093a330b9 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] Lock "8381c969-6a2d-4934-aadd-660ffa246b05" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.421s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:17:30 user nova-compute[74960]: INFO nova.compute.manager [None req-50df3a37-1c20-4e71-81a3-553ace77ad46 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] Took 11.80 seconds to build instance.
Nov 03 12:17:30 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-50df3a37-1c20-4e71-81a3-553ace77ad46 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Lock "0a520c41-19c0-47ba-ada8-023ee9c12ca6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.030s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:17:30 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:17:30 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:17:30 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:17:30 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:17:32 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:17:32 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:17:32 user nova-compute[74960]: DEBUG nova.compute.manager [None req-99e9ceed-e8ff-4581-99e9-6ca890a66fea tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea] Instance event wait completed in 0 seconds for  {{(pid=74960) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 12:17:32 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-99e9ceed-e8ff-4581-99e9-6ca890a66fea tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea] Guest created on hypervisor {{(pid=74960) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 12:17:32 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea] Instance spawned successfully.
Nov 03 12:17:32 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-99e9ceed-e8ff-4581-99e9-6ca890a66fea tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 12:17:32 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-99e9ceed-e8ff-4581-99e9-6ca890a66fea tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea] Found default for hw_cdrom_bus of ide {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:17:32 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-99e9ceed-e8ff-4581-99e9-6ca890a66fea tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea] Found default for hw_disk_bus of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:17:32 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-99e9ceed-e8ff-4581-99e9-6ca890a66fea tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea] Found default for hw_input_bus of None {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:17:32 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-99e9ceed-e8ff-4581-99e9-6ca890a66fea tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea] Found default for hw_pointer_model of None {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:17:32 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-99e9ceed-e8ff-4581-99e9-6ca890a66fea tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea] Found default for hw_video_model of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:17:32 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-99e9ceed-e8ff-4581-99e9-6ca890a66fea tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea] Found default for hw_vif_model of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:17:33 user nova-compute[74960]: INFO nova.compute.manager [None req-99e9ceed-e8ff-4581-99e9-6ca890a66fea tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea] Took 7.81 seconds to spawn the instance on the hypervisor.
Nov 03 12:17:33 user nova-compute[74960]: DEBUG nova.compute.manager [None req-99e9ceed-e8ff-4581-99e9-6ca890a66fea tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea] Checking state {{(pid=74960) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 12:17:33 user nova-compute[74960]: INFO nova.compute.manager [None req-99e9ceed-e8ff-4581-99e9-6ca890a66fea tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea] Took 8.90 seconds to build instance.
Nov 03 12:17:33 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-99e9ceed-e8ff-4581-99e9-6ca890a66fea tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] Lock "7f7fabc2-5e1b-441c-a693-9956470359ea" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.039s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:17:33 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:17:33 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:17:33 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Cleaning up deleted instances {{(pid=74960) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 03 12:17:33 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] There are 0 instances to clean {{(pid=74960) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 03 12:17:33 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:17:33 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Cleaning up deleted instances with incomplete migration  {{(pid=74960) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 03 12:17:33 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:17:37 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:17:37 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:17:37 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:17:37 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:17:37 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:17:38 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:17:38 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Starting heal instance info cache {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 12:17:38 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Rebuilding the list of instances to heal {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 03 12:17:38 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "refresh_cache-39e6c635-4602-4ed6-abbd-80c96f056715" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:17:38 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquired lock "refresh_cache-39e6c635-4602-4ed6-abbd-80c96f056715" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:17:38 user nova-compute[74960]: DEBUG nova.network.neutron [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: 39e6c635-4602-4ed6-abbd-80c96f056715] Forcefully refreshing network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 12:17:38 user nova-compute[74960]: DEBUG nova.objects.instance [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lazy-loading 'info_cache' on Instance uuid 39e6c635-4602-4ed6-abbd-80c96f056715 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:17:39 user nova-compute[74960]: DEBUG nova.network.neutron [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: 39e6c635-4602-4ed6-abbd-80c96f056715] Updating instance_info_cache with network_info: [{"id": "948c9582-33b7-486d-889a-65c37267d98d", "address": "fa:16:3e:7c:0d:76", "network": {"id": "accc48f4-76c2-486d-9494-27f72e339655", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1003203293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23bb45aea3d244e298d314a3c9800397", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap948c9582-33", "ovs_interfaceid": "948c9582-33b7-486d-889a-65c37267d98d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:17:39 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Releasing lock "refresh_cache-39e6c635-4602-4ed6-abbd-80c96f056715" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:17:39 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: 39e6c635-4602-4ed6-abbd-80c96f056715] Updated the network info_cache for instance {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 12:17:39 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:17:39 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:17:39 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:17:39 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:17:39 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:17:39 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Auditing locally available compute resources for user (node: user) {{(pid=74960) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 12:17:39 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d00a0872-693c-4cdc-85cd-9806660e9d8d/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:17:39 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d00a0872-693c-4cdc-85cd-9806660e9d8d/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:17:39 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d00a0872-693c-4cdc-85cd-9806660e9d8d/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:17:40 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d00a0872-693c-4cdc-85cd-9806660e9d8d/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:17:40 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e5ec97f-80c4-4499-94bf-2584fc0eae03/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:17:40 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e5ec97f-80c4-4499-94bf-2584fc0eae03/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:17:40 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e5ec97f-80c4-4499-94bf-2584fc0eae03/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:17:40 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e5ec97f-80c4-4499-94bf-2584fc0eae03/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:17:40 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39e6c635-4602-4ed6-abbd-80c96f056715/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:17:40 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39e6c635-4602-4ed6-abbd-80c96f056715/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:17:40 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39e6c635-4602-4ed6-abbd-80c96f056715/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:17:40 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39e6c635-4602-4ed6-abbd-80c96f056715/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:17:40 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7769e3c5-136f-4282-8e3e-224e3a80922c/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:17:41 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7769e3c5-136f-4282-8e3e-224e3a80922c/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:17:41 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7769e3c5-136f-4282-8e3e-224e3a80922c/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:17:41 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7769e3c5-136f-4282-8e3e-224e3a80922c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:17:41 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8381c969-6a2d-4934-aadd-660ffa246b05/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:17:41 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8381c969-6a2d-4934-aadd-660ffa246b05/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:17:41 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8381c969-6a2d-4934-aadd-660ffa246b05/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:17:41 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8381c969-6a2d-4934-aadd-660ffa246b05/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:17:41 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f7fabc2-5e1b-441c-a693-9956470359ea/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:17:42 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f7fabc2-5e1b-441c-a693-9956470359ea/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:17:42 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f7fabc2-5e1b-441c-a693-9956470359ea/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:17:42 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f7fabc2-5e1b-441c-a693-9956470359ea/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:17:42 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e91dfcf4-caef-43d0-a56b-b1282363d4e0/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:17:42 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:17:42 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e91dfcf4-caef-43d0-a56b-b1282363d4e0/disk --force-share --output=json" returned: 0 in 0.290s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:17:42 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e91dfcf4-caef-43d0-a56b-b1282363d4e0/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:17:42 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e91dfcf4-caef-43d0-a56b-b1282363d4e0/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:17:42 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a520c41-19c0-47ba-ada8-023ee9c12ca6/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:17:42 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:17:43 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a520c41-19c0-47ba-ada8-023ee9c12ca6/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:17:43 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a520c41-19c0-47ba-ada8-023ee9c12ca6/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:17:43 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a520c41-19c0-47ba-ada8-023ee9c12ca6/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:17:43 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:17:43 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:17:43 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Hypervisor/Node resource view: name=user free_ram=7699MB free_disk=25.56316375732422GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74960) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 12:17:43 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:17:43 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:17:44 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 39e6c635-4602-4ed6-abbd-80c96f056715 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:17:44 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 7e5ec97f-80c4-4499-94bf-2584fc0eae03 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:17:44 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 7769e3c5-136f-4282-8e3e-224e3a80922c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:17:44 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance d00a0872-693c-4cdc-85cd-9806660e9d8d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:17:44 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance e91dfcf4-caef-43d0-a56b-b1282363d4e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:17:44 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 8381c969-6a2d-4934-aadd-660ffa246b05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:17:44 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 0a520c41-19c0-47ba-ada8-023ee9c12ca6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:17:44 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 7f7fabc2-5e1b-441c-a693-9956470359ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:17:44 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74960) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 12:17:44 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74960) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 12:17:44 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Refreshing inventories for resource provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 03 12:17:44 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Updating ProviderTree inventory for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 03 12:17:44 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Updating inventory in ProviderTree for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 03 12:17:44 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Refreshing aggregate associations for resource provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0, aggregates: None {{(pid=74960) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 03 12:17:44 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Refreshing trait associations for resource provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0, traits: COMPUTE_NODE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE41,HW_CPU_X86_SSSE3,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_DEVICE_TAGGING,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_QXL {{(pid=74960) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 03 12:17:44 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:17:44 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:17:44 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Compute_service record updated for user:user {{(pid=74960) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 12:17:44 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.041s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:17:44 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:17:44 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:17:44 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:17:44 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74960) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 12:17:47 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:17:47 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:17:47 user nova-compute[74960]: DEBUG nova.compute.manager [req-e591dc7b-1477-41b9-b487-fe5107c85a86 req-64d29d59-7c6f-45dc-89f4-749fcda3dbe4 service nova] [instance: 7769e3c5-136f-4282-8e3e-224e3a80922c] Received event network-vif-plugged-8fe46c5c-9093-43c4-8b0d-baf325c2e18b {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:17:47 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-e591dc7b-1477-41b9-b487-fe5107c85a86 req-64d29d59-7c6f-45dc-89f4-749fcda3dbe4 service nova] Acquiring lock "7769e3c5-136f-4282-8e3e-224e3a80922c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:17:47 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-e591dc7b-1477-41b9-b487-fe5107c85a86 req-64d29d59-7c6f-45dc-89f4-749fcda3dbe4 service nova] Lock "7769e3c5-136f-4282-8e3e-224e3a80922c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:17:47 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-e591dc7b-1477-41b9-b487-fe5107c85a86 req-64d29d59-7c6f-45dc-89f4-749fcda3dbe4 service nova] Lock "7769e3c5-136f-4282-8e3e-224e3a80922c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:17:47 user nova-compute[74960]: DEBUG nova.compute.manager [req-e591dc7b-1477-41b9-b487-fe5107c85a86 req-64d29d59-7c6f-45dc-89f4-749fcda3dbe4 service nova] [instance: 7769e3c5-136f-4282-8e3e-224e3a80922c] No waiting events found dispatching network-vif-plugged-8fe46c5c-9093-43c4-8b0d-baf325c2e18b {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:17:47 user nova-compute[74960]: WARNING nova.compute.manager [req-e591dc7b-1477-41b9-b487-fe5107c85a86 req-64d29d59-7c6f-45dc-89f4-749fcda3dbe4 service nova] [instance: 7769e3c5-136f-4282-8e3e-224e3a80922c] Received unexpected event network-vif-plugged-8fe46c5c-9093-43c4-8b0d-baf325c2e18b for instance with vm_state active and task_state None.
Nov 03 12:17:49 user nova-compute[74960]: DEBUG nova.compute.manager [req-d1dca75a-8785-429c-b9aa-0e19dd0be0dd req-8962bbf0-5cdc-476a-9a51-276fd363130b service nova] [instance: 7769e3c5-136f-4282-8e3e-224e3a80922c] Received event network-vif-plugged-8fe46c5c-9093-43c4-8b0d-baf325c2e18b {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:17:49 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-d1dca75a-8785-429c-b9aa-0e19dd0be0dd req-8962bbf0-5cdc-476a-9a51-276fd363130b service nova] Acquiring lock "7769e3c5-136f-4282-8e3e-224e3a80922c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:17:49 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-d1dca75a-8785-429c-b9aa-0e19dd0be0dd req-8962bbf0-5cdc-476a-9a51-276fd363130b service nova] Lock "7769e3c5-136f-4282-8e3e-224e3a80922c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:17:49 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-d1dca75a-8785-429c-b9aa-0e19dd0be0dd req-8962bbf0-5cdc-476a-9a51-276fd363130b service nova] Lock "7769e3c5-136f-4282-8e3e-224e3a80922c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:17:49 user nova-compute[74960]: DEBUG nova.compute.manager [req-d1dca75a-8785-429c-b9aa-0e19dd0be0dd req-8962bbf0-5cdc-476a-9a51-276fd363130b service nova] [instance: 7769e3c5-136f-4282-8e3e-224e3a80922c] No waiting events found dispatching network-vif-plugged-8fe46c5c-9093-43c4-8b0d-baf325c2e18b {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:17:49 user nova-compute[74960]: WARNING nova.compute.manager [req-d1dca75a-8785-429c-b9aa-0e19dd0be0dd req-8962bbf0-5cdc-476a-9a51-276fd363130b service nova] [instance: 7769e3c5-136f-4282-8e3e-224e3a80922c] Received unexpected event network-vif-plugged-8fe46c5c-9093-43c4-8b0d-baf325c2e18b for instance with vm_state active and task_state None.
Nov 03 12:17:49 user nova-compute[74960]: DEBUG nova.compute.manager [req-d1dca75a-8785-429c-b9aa-0e19dd0be0dd req-8962bbf0-5cdc-476a-9a51-276fd363130b service nova] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] Received event network-vif-plugged-3e126a57-0883-4997-9c99-d25c9c6fc102 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:17:49 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-d1dca75a-8785-429c-b9aa-0e19dd0be0dd req-8962bbf0-5cdc-476a-9a51-276fd363130b service nova] Acquiring lock "0a520c41-19c0-47ba-ada8-023ee9c12ca6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:17:49 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-d1dca75a-8785-429c-b9aa-0e19dd0be0dd req-8962bbf0-5cdc-476a-9a51-276fd363130b service nova] Lock "0a520c41-19c0-47ba-ada8-023ee9c12ca6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:17:49 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-d1dca75a-8785-429c-b9aa-0e19dd0be0dd req-8962bbf0-5cdc-476a-9a51-276fd363130b service nova] Lock "0a520c41-19c0-47ba-ada8-023ee9c12ca6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:17:49 user nova-compute[74960]: DEBUG nova.compute.manager [req-d1dca75a-8785-429c-b9aa-0e19dd0be0dd req-8962bbf0-5cdc-476a-9a51-276fd363130b service nova] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] No waiting events found dispatching network-vif-plugged-3e126a57-0883-4997-9c99-d25c9c6fc102 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:17:49 user nova-compute[74960]: WARNING nova.compute.manager [req-d1dca75a-8785-429c-b9aa-0e19dd0be0dd req-8962bbf0-5cdc-476a-9a51-276fd363130b service nova] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] Received unexpected event network-vif-plugged-3e126a57-0883-4997-9c99-d25c9c6fc102 for instance with vm_state active and task_state None.
Nov 03 12:17:49 user nova-compute[74960]: DEBUG nova.compute.manager [req-d1dca75a-8785-429c-b9aa-0e19dd0be0dd req-8962bbf0-5cdc-476a-9a51-276fd363130b service nova] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] Received event network-vif-plugged-3e126a57-0883-4997-9c99-d25c9c6fc102 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:17:49 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-d1dca75a-8785-429c-b9aa-0e19dd0be0dd req-8962bbf0-5cdc-476a-9a51-276fd363130b service nova] Acquiring lock "0a520c41-19c0-47ba-ada8-023ee9c12ca6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:17:49 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-d1dca75a-8785-429c-b9aa-0e19dd0be0dd req-8962bbf0-5cdc-476a-9a51-276fd363130b service nova] Lock "0a520c41-19c0-47ba-ada8-023ee9c12ca6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:17:49 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-d1dca75a-8785-429c-b9aa-0e19dd0be0dd req-8962bbf0-5cdc-476a-9a51-276fd363130b service nova] Lock "0a520c41-19c0-47ba-ada8-023ee9c12ca6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:17:49 user nova-compute[74960]: DEBUG nova.compute.manager [req-d1dca75a-8785-429c-b9aa-0e19dd0be0dd req-8962bbf0-5cdc-476a-9a51-276fd363130b service nova] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] No waiting events found dispatching network-vif-plugged-3e126a57-0883-4997-9c99-d25c9c6fc102 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:17:49 user nova-compute[74960]: WARNING nova.compute.manager [req-d1dca75a-8785-429c-b9aa-0e19dd0be0dd req-8962bbf0-5cdc-476a-9a51-276fd363130b service nova] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] Received unexpected event network-vif-plugged-3e126a57-0883-4997-9c99-d25c9c6fc102 for instance with vm_state active and task_state None.
Nov 03 12:17:49 user nova-compute[74960]: DEBUG nova.compute.manager [req-d1dca75a-8785-429c-b9aa-0e19dd0be0dd req-8962bbf0-5cdc-476a-9a51-276fd363130b service nova] [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea] Received event network-vif-plugged-ced0ad7a-92e5-4d88-8b6a-1f30efea310e {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:17:49 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-d1dca75a-8785-429c-b9aa-0e19dd0be0dd req-8962bbf0-5cdc-476a-9a51-276fd363130b service nova] Acquiring lock "7f7fabc2-5e1b-441c-a693-9956470359ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:17:49 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-d1dca75a-8785-429c-b9aa-0e19dd0be0dd req-8962bbf0-5cdc-476a-9a51-276fd363130b service nova] Lock "7f7fabc2-5e1b-441c-a693-9956470359ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:17:49 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-d1dca75a-8785-429c-b9aa-0e19dd0be0dd req-8962bbf0-5cdc-476a-9a51-276fd363130b service nova] Lock "7f7fabc2-5e1b-441c-a693-9956470359ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:17:49 user nova-compute[74960]: DEBUG nova.compute.manager [req-d1dca75a-8785-429c-b9aa-0e19dd0be0dd req-8962bbf0-5cdc-476a-9a51-276fd363130b service nova] [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea] No waiting events found dispatching network-vif-plugged-ced0ad7a-92e5-4d88-8b6a-1f30efea310e {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:17:49 user nova-compute[74960]: WARNING nova.compute.manager [req-d1dca75a-8785-429c-b9aa-0e19dd0be0dd req-8962bbf0-5cdc-476a-9a51-276fd363130b service nova] [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea] Received unexpected event network-vif-plugged-ced0ad7a-92e5-4d88-8b6a-1f30efea310e for instance with vm_state active and task_state None.
Nov 03 12:17:49 user nova-compute[74960]: DEBUG nova.compute.manager [req-d1dca75a-8785-429c-b9aa-0e19dd0be0dd req-8962bbf0-5cdc-476a-9a51-276fd363130b service nova] [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea] Received event network-vif-plugged-ced0ad7a-92e5-4d88-8b6a-1f30efea310e {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:17:49 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-d1dca75a-8785-429c-b9aa-0e19dd0be0dd req-8962bbf0-5cdc-476a-9a51-276fd363130b service nova] Acquiring lock "7f7fabc2-5e1b-441c-a693-9956470359ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:17:49 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-d1dca75a-8785-429c-b9aa-0e19dd0be0dd req-8962bbf0-5cdc-476a-9a51-276fd363130b service nova] Lock "7f7fabc2-5e1b-441c-a693-9956470359ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:17:49 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-d1dca75a-8785-429c-b9aa-0e19dd0be0dd req-8962bbf0-5cdc-476a-9a51-276fd363130b service nova] Lock "7f7fabc2-5e1b-441c-a693-9956470359ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:17:49 user nova-compute[74960]: DEBUG nova.compute.manager [req-d1dca75a-8785-429c-b9aa-0e19dd0be0dd req-8962bbf0-5cdc-476a-9a51-276fd363130b service nova] [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea] No waiting events found dispatching network-vif-plugged-ced0ad7a-92e5-4d88-8b6a-1f30efea310e {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:17:49 user nova-compute[74960]: WARNING nova.compute.manager [req-d1dca75a-8785-429c-b9aa-0e19dd0be0dd req-8962bbf0-5cdc-476a-9a51-276fd363130b service nova] [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea] Received unexpected event network-vif-plugged-ced0ad7a-92e5-4d88-8b6a-1f30efea310e for instance with vm_state active and task_state None.
Nov 03 12:17:52 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:17:52 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:17:57 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:17:57 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:18:02 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:18:02 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:18:07 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:18:07 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:18:07 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74960) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 12:18:07 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74960) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 12:18:07 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74960) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 12:18:07 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:18:12 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:18:12 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:18:12 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74960) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 12:18:12 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74960) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 12:18:12 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74960) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 12:18:12 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:18:17 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:18:17 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:18:17 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74960) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 12:18:17 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74960) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 12:18:17 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74960) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 12:18:17 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:18:21 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:18:22 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:18:24 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:18:27 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:18:27 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:18:28 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:18:29 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:18:31 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:18:31 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:18:32 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:18:32 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-1f9ab7aa-0552-426f-bd1c-229b78d83e8f tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] Acquiring lock "79b85953-182f-459f-a8d4-bcb54148a850" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:18:32 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-1f9ab7aa-0552-426f-bd1c-229b78d83e8f tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] Lock "79b85953-182f-459f-a8d4-bcb54148a850" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:18:32 user nova-compute[74960]: DEBUG nova.compute.manager [None req-1f9ab7aa-0552-426f-bd1c-229b78d83e8f tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] [instance: 79b85953-182f-459f-a8d4-bcb54148a850] Starting instance... {{(pid=74960) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 12:18:32 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-1f9ab7aa-0552-426f-bd1c-229b78d83e8f tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:18:32 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-1f9ab7aa-0552-426f-bd1c-229b78d83e8f tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:18:32 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-1f9ab7aa-0552-426f-bd1c-229b78d83e8f tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74960) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 12:18:32 user nova-compute[74960]: INFO nova.compute.claims [None req-1f9ab7aa-0552-426f-bd1c-229b78d83e8f tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] [instance: 79b85953-182f-459f-a8d4-bcb54148a850] Claim successful on node user
Nov 03 12:18:32 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:18:33 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-1f9ab7aa-0552-426f-bd1c-229b78d83e8f tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:18:33 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-1f9ab7aa-0552-426f-bd1c-229b78d83e8f tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:18:33 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-1f9ab7aa-0552-426f-bd1c-229b78d83e8f tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.513s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:18:33 user nova-compute[74960]: DEBUG nova.compute.manager [None req-1f9ab7aa-0552-426f-bd1c-229b78d83e8f tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] [instance: 79b85953-182f-459f-a8d4-bcb54148a850] Start building networks asynchronously for instance. {{(pid=74960) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 12:18:33 user nova-compute[74960]: DEBUG nova.compute.manager [None req-1f9ab7aa-0552-426f-bd1c-229b78d83e8f tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] [instance: 79b85953-182f-459f-a8d4-bcb54148a850] Allocating IP information in the background. {{(pid=74960) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 12:18:33 user nova-compute[74960]: DEBUG nova.network.neutron [None req-1f9ab7aa-0552-426f-bd1c-229b78d83e8f tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] [instance: 79b85953-182f-459f-a8d4-bcb54148a850] allocate_for_instance() {{(pid=74960) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 12:18:33 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-1f9ab7aa-0552-426f-bd1c-229b78d83e8f tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] [instance: 79b85953-182f-459f-a8d4-bcb54148a850] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 12:18:33 user nova-compute[74960]: DEBUG nova.compute.manager [None req-1f9ab7aa-0552-426f-bd1c-229b78d83e8f tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] [instance: 79b85953-182f-459f-a8d4-bcb54148a850] Start building block device mappings for instance. {{(pid=74960) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 12:18:33 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:18:33 user nova-compute[74960]: DEBUG nova.compute.manager [None req-1f9ab7aa-0552-426f-bd1c-229b78d83e8f tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] [instance: 79b85953-182f-459f-a8d4-bcb54148a850] Start spawning the instance on the hypervisor. {{(pid=74960) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 12:18:33 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-1f9ab7aa-0552-426f-bd1c-229b78d83e8f tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] [instance: 79b85953-182f-459f-a8d4-bcb54148a850] Creating instance directory {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 12:18:33 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-1f9ab7aa-0552-426f-bd1c-229b78d83e8f tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] [instance: 79b85953-182f-459f-a8d4-bcb54148a850] Creating image(s)
Nov 03 12:18:33 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-1f9ab7aa-0552-426f-bd1c-229b78d83e8f tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] Acquiring lock "/opt/stack/data/nova/instances/79b85953-182f-459f-a8d4-bcb54148a850/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:18:33 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-1f9ab7aa-0552-426f-bd1c-229b78d83e8f tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] Lock "/opt/stack/data/nova/instances/79b85953-182f-459f-a8d4-bcb54148a850/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:18:33 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-1f9ab7aa-0552-426f-bd1c-229b78d83e8f tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] Lock "/opt/stack/data/nova/instances/79b85953-182f-459f-a8d4-bcb54148a850/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:18:33 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-1f9ab7aa-0552-426f-bd1c-229b78d83e8f tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:18:33 user nova-compute[74960]: DEBUG nova.policy [None req-1f9ab7aa-0552-426f-bd1c-229b78d83e8f tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ac6f783eb87d4aeaaf7de78836e8253f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be790149973a4bdc903e08ed69b9238f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74960) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 12:18:33 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-1f9ab7aa-0552-426f-bd1c-229b78d83e8f tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.189s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:18:33 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-1f9ab7aa-0552-426f-bd1c-229b78d83e8f tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] Acquiring lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:18:33 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-1f9ab7aa-0552-426f-bd1c-229b78d83e8f tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] Lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:18:33 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-1f9ab7aa-0552-426f-bd1c-229b78d83e8f tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:18:33 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-1f9ab7aa-0552-426f-bd1c-229b78d83e8f tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.200s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:18:33 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-1f9ab7aa-0552-426f-bd1c-229b78d83e8f tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910,backing_fmt=raw /opt/stack/data/nova/instances/79b85953-182f-459f-a8d4-bcb54148a850/disk 1073741824 {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:18:33 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-1f9ab7aa-0552-426f-bd1c-229b78d83e8f tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910,backing_fmt=raw /opt/stack/data/nova/instances/79b85953-182f-459f-a8d4-bcb54148a850/disk 1073741824" returned: 0 in 0.051s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:18:33 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-1f9ab7aa-0552-426f-bd1c-229b78d83e8f tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] Lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:18:33 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-1f9ab7aa-0552-426f-bd1c-229b78d83e8f tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:18:34 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-1f9ab7aa-0552-426f-bd1c-229b78d83e8f tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.192s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:18:34 user nova-compute[74960]: DEBUG nova.virt.disk.api [None req-1f9ab7aa-0552-426f-bd1c-229b78d83e8f tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] Checking if we can resize image /opt/stack/data/nova/instances/79b85953-182f-459f-a8d4-bcb54148a850/disk. size=1073741824 {{(pid=74960) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 12:18:34 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-1f9ab7aa-0552-426f-bd1c-229b78d83e8f tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79b85953-182f-459f-a8d4-bcb54148a850/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:18:34 user nova-compute[74960]: DEBUG nova.network.neutron [None req-1f9ab7aa-0552-426f-bd1c-229b78d83e8f tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] [instance: 79b85953-182f-459f-a8d4-bcb54148a850] Successfully created port: 25c374db-280b-4b5b-a803-915efb751de8 {{(pid=74960) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 12:18:34 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-1f9ab7aa-0552-426f-bd1c-229b78d83e8f tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79b85953-182f-459f-a8d4-bcb54148a850/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:18:34 user nova-compute[74960]: DEBUG nova.virt.disk.api [None req-1f9ab7aa-0552-426f-bd1c-229b78d83e8f tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] Cannot resize image /opt/stack/data/nova/instances/79b85953-182f-459f-a8d4-bcb54148a850/disk to a smaller size. {{(pid=74960) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 12:18:34 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-1f9ab7aa-0552-426f-bd1c-229b78d83e8f tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] [instance: 79b85953-182f-459f-a8d4-bcb54148a850] Created local disks {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 12:18:34 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-1f9ab7aa-0552-426f-bd1c-229b78d83e8f tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] [instance: 79b85953-182f-459f-a8d4-bcb54148a850] Ensure instance console log exists: /opt/stack/data/nova/instances/79b85953-182f-459f-a8d4-bcb54148a850/console.log {{(pid=74960) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 12:18:34 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-1f9ab7aa-0552-426f-bd1c-229b78d83e8f tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:18:34 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-1f9ab7aa-0552-426f-bd1c-229b78d83e8f tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:18:34 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-1f9ab7aa-0552-426f-bd1c-229b78d83e8f tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:18:34 user nova-compute[74960]: DEBUG nova.network.neutron [None req-1f9ab7aa-0552-426f-bd1c-229b78d83e8f tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] [instance: 79b85953-182f-459f-a8d4-bcb54148a850] Successfully updated port: 25c374db-280b-4b5b-a803-915efb751de8 {{(pid=74960) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 12:18:34 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-1f9ab7aa-0552-426f-bd1c-229b78d83e8f tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] Acquiring lock "refresh_cache-79b85953-182f-459f-a8d4-bcb54148a850" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:18:34 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-1f9ab7aa-0552-426f-bd1c-229b78d83e8f tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] Acquired lock "refresh_cache-79b85953-182f-459f-a8d4-bcb54148a850" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:18:34 user nova-compute[74960]: DEBUG nova.network.neutron [None req-1f9ab7aa-0552-426f-bd1c-229b78d83e8f tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] [instance: 79b85953-182f-459f-a8d4-bcb54148a850] Building network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 12:18:34 user nova-compute[74960]: DEBUG nova.compute.manager [req-9ef9302c-8d88-4e5a-a18e-512551bdee57 req-286697fd-6d52-4e6d-94ce-35f871869ce8 service nova] [instance: 79b85953-182f-459f-a8d4-bcb54148a850] Received event network-changed-25c374db-280b-4b5b-a803-915efb751de8 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:18:34 user nova-compute[74960]: DEBUG nova.compute.manager [req-9ef9302c-8d88-4e5a-a18e-512551bdee57 req-286697fd-6d52-4e6d-94ce-35f871869ce8 service nova] [instance: 79b85953-182f-459f-a8d4-bcb54148a850] Refreshing instance network info cache due to event network-changed-25c374db-280b-4b5b-a803-915efb751de8. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 12:18:34 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-9ef9302c-8d88-4e5a-a18e-512551bdee57 req-286697fd-6d52-4e6d-94ce-35f871869ce8 service nova] Acquiring lock "refresh_cache-79b85953-182f-459f-a8d4-bcb54148a850" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:18:34 user nova-compute[74960]: DEBUG nova.network.neutron [None req-1f9ab7aa-0552-426f-bd1c-229b78d83e8f tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] [instance: 79b85953-182f-459f-a8d4-bcb54148a850] Instance cache missing network info. {{(pid=74960) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 12:18:35 user nova-compute[74960]: DEBUG nova.network.neutron [None req-1f9ab7aa-0552-426f-bd1c-229b78d83e8f tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] [instance: 79b85953-182f-459f-a8d4-bcb54148a850] Updating instance_info_cache with network_info: [{"id": "25c374db-280b-4b5b-a803-915efb751de8", "address": "fa:16:3e:16:3e:5d", "network": {"id": "75b4c07e-f11a-41c6-9b17-525598c88bdf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-215952367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be790149973a4bdc903e08ed69b9238f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25c374db-28", "ovs_interfaceid": "25c374db-280b-4b5b-a803-915efb751de8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:18:35 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-1f9ab7aa-0552-426f-bd1c-229b78d83e8f tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] Releasing lock "refresh_cache-79b85953-182f-459f-a8d4-bcb54148a850" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:18:35 user nova-compute[74960]: DEBUG nova.compute.manager [None req-1f9ab7aa-0552-426f-bd1c-229b78d83e8f tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] [instance: 79b85953-182f-459f-a8d4-bcb54148a850] Instance network_info: |[{"id": "25c374db-280b-4b5b-a803-915efb751de8", "address": "fa:16:3e:16:3e:5d", "network": {"id": "75b4c07e-f11a-41c6-9b17-525598c88bdf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-215952367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be790149973a4bdc903e08ed69b9238f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25c374db-28", "ovs_interfaceid": "25c374db-280b-4b5b-a803-915efb751de8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74960) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 12:18:35 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-9ef9302c-8d88-4e5a-a18e-512551bdee57 req-286697fd-6d52-4e6d-94ce-35f871869ce8 service nova] Acquired lock "refresh_cache-79b85953-182f-459f-a8d4-bcb54148a850" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:18:35 user nova-compute[74960]: DEBUG nova.network.neutron [req-9ef9302c-8d88-4e5a-a18e-512551bdee57 req-286697fd-6d52-4e6d-94ce-35f871869ce8 service nova] [instance: 79b85953-182f-459f-a8d4-bcb54148a850] Refreshing network info cache for port 25c374db-280b-4b5b-a803-915efb751de8 {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 12:18:35 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-1f9ab7aa-0552-426f-bd1c-229b78d83e8f tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] [instance: 79b85953-182f-459f-a8d4-bcb54148a850] Start _get_guest_xml network_info=[{"id": "25c374db-280b-4b5b-a803-915efb751de8", "address": "fa:16:3e:16:3e:5d", "network": {"id": "75b4c07e-f11a-41c6-9b17-525598c88bdf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-215952367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be790149973a4bdc903e08ed69b9238f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25c374db-28", "ovs_interfaceid": "25c374db-280b-4b5b-a803-915efb751de8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=549f51ba-ac69-494b-8de1-34635aa2d7cf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='63ee9c80c632442fb0379f47b784bd20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T12:13:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'image_id': '549f51ba-ac69-494b-8de1-34635aa2d7cf'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 12:18:35 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-1f9ab7aa-0552-426f-bd1c-229b78d83e8f tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:18:35 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-1f9ab7aa-0552-426f-bd1c-229b78d83e8f tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:18:35 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-1f9ab7aa-0552-426f-bd1c-229b78d83e8f tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 12:18:35 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-1f9ab7aa-0552-426f-bd1c-229b78d83e8f tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] CPU controller missing on host. {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 12:18:35 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-1f9ab7aa-0552-426f-bd1c-229b78d83e8f tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 12:18:35 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-1f9ab7aa-0552-426f-bd1c-229b78d83e8f tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] CPU controller found on host. {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 12:18:35 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-1f9ab7aa-0552-426f-bd1c-229b78d83e8f tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74960) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 12:18:35 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-1f9ab7aa-0552-426f-bd1c-229b78d83e8f tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=549f51ba-ac69-494b-8de1-34635aa2d7cf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='63ee9c80c632442fb0379f47b784bd20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T12:13:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 12:18:35 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-1f9ab7aa-0552-426f-bd1c-229b78d83e8f tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] Flavor limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 12:18:35 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-1f9ab7aa-0552-426f-bd1c-229b78d83e8f tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] Image limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 12:18:35 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-1f9ab7aa-0552-426f-bd1c-229b78d83e8f tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] Flavor pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 12:18:35 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-1f9ab7aa-0552-426f-bd1c-229b78d83e8f tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] Image pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 12:18:35 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-1f9ab7aa-0552-426f-bd1c-229b78d83e8f tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 12:18:35 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-1f9ab7aa-0552-426f-bd1c-229b78d83e8f tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 12:18:35 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-1f9ab7aa-0552-426f-bd1c-229b78d83e8f tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 12:18:35 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-1f9ab7aa-0552-426f-bd1c-229b78d83e8f tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] Got 1 possible topologies {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 12:18:35 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-1f9ab7aa-0552-426f-bd1c-229b78d83e8f tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 12:18:35 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-1f9ab7aa-0552-426f-bd1c-229b78d83e8f tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 12:18:35 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-1f9ab7aa-0552-426f-bd1c-229b78d83e8f tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:18:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-341594800',display_name='tempest-VolumesActionsTest-instance-341594800',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-341594800',id=9,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='be790149973a4bdc903e08ed69b9238f',ramdisk_id='',reservation_id='r-pw7385fx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1044563007',owner_user_name='tempest-VolumesActionsTest-1044563007-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:18:33Z,user_data=None,user_id='ac6f783eb87d4aeaaf7de78836e8253f',uuid=79b85953-182f-459f-a8d4-bcb54148a850,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "25c374db-280b-4b5b-a803-915efb751de8", "address": "fa:16:3e:16:3e:5d", "network": {"id": "75b4c07e-f11a-41c6-9b17-525598c88bdf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-215952367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be790149973a4bdc903e08ed69b9238f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25c374db-28", "ovs_interfaceid": "25c374db-280b-4b5b-a803-915efb751de8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74960) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 12:18:35 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-1f9ab7aa-0552-426f-bd1c-229b78d83e8f tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] Converting VIF {"id": "25c374db-280b-4b5b-a803-915efb751de8", "address": "fa:16:3e:16:3e:5d", "network": {"id": "75b4c07e-f11a-41c6-9b17-525598c88bdf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-215952367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be790149973a4bdc903e08ed69b9238f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25c374db-28", "ovs_interfaceid": "25c374db-280b-4b5b-a803-915efb751de8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:18:35 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-1f9ab7aa-0552-426f-bd1c-229b78d83e8f tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:3e:5d,bridge_name='br-int',has_traffic_filtering=True,id=25c374db-280b-4b5b-a803-915efb751de8,network=Network(75b4c07e-f11a-41c6-9b17-525598c88bdf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25c374db-28') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:18:35 user nova-compute[74960]: DEBUG nova.objects.instance [None req-1f9ab7aa-0552-426f-bd1c-229b78d83e8f tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] Lazy-loading 'pci_devices' on Instance uuid 79b85953-182f-459f-a8d4-bcb54148a850 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:18:35 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-1f9ab7aa-0552-426f-bd1c-229b78d83e8f tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] [instance: 79b85953-182f-459f-a8d4-bcb54148a850] End _get_guest_xml xml=<domain type="kvm">
Nov 03 12:18:35 user nova-compute[74960]:   <uuid>79b85953-182f-459f-a8d4-bcb54148a850</uuid>
Nov 03 12:18:35 user nova-compute[74960]:   <name>instance-00000009</name>
Nov 03 12:18:35 user nova-compute[74960]:   <memory>524288</memory>
Nov 03 12:18:35 user nova-compute[74960]:   <vcpu>1</vcpu>
Nov 03 12:18:35 user nova-compute[74960]:   <metadata>
Nov 03 12:18:35 user nova-compute[74960]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 12:18:35 user nova-compute[74960]:       <nova:package version="0.0.0"/>
Nov 03 12:18:35 user nova-compute[74960]:       <nova:name>tempest-VolumesActionsTest-instance-341594800</nova:name>
Nov 03 12:18:35 user nova-compute[74960]:       <nova:creationTime>2023-11-03 12:18:35</nova:creationTime>
Nov 03 12:18:35 user nova-compute[74960]:       <nova:flavor name="m1.tiny">
Nov 03 12:18:35 user nova-compute[74960]:         <nova:memory>512</nova:memory>
Nov 03 12:18:35 user nova-compute[74960]:         <nova:disk>1</nova:disk>
Nov 03 12:18:35 user nova-compute[74960]:         <nova:swap>0</nova:swap>
Nov 03 12:18:35 user nova-compute[74960]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 12:18:35 user nova-compute[74960]:         <nova:vcpus>1</nova:vcpus>
Nov 03 12:18:35 user nova-compute[74960]:       </nova:flavor>
Nov 03 12:18:35 user nova-compute[74960]:       <nova:owner>
Nov 03 12:18:35 user nova-compute[74960]:         <nova:user uuid="ac6f783eb87d4aeaaf7de78836e8253f">tempest-VolumesActionsTest-1044563007-project-member</nova:user>
Nov 03 12:18:35 user nova-compute[74960]:         <nova:project uuid="be790149973a4bdc903e08ed69b9238f">tempest-VolumesActionsTest-1044563007</nova:project>
Nov 03 12:18:35 user nova-compute[74960]:       </nova:owner>
Nov 03 12:18:35 user nova-compute[74960]:       <nova:root type="image" uuid="549f51ba-ac69-494b-8de1-34635aa2d7cf"/>
Nov 03 12:18:35 user nova-compute[74960]:       <nova:ports>
Nov 03 12:18:35 user nova-compute[74960]:         <nova:port uuid="25c374db-280b-4b5b-a803-915efb751de8">
Nov 03 12:18:35 user nova-compute[74960]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 03 12:18:35 user nova-compute[74960]:         </nova:port>
Nov 03 12:18:35 user nova-compute[74960]:       </nova:ports>
Nov 03 12:18:35 user nova-compute[74960]:     </nova:instance>
Nov 03 12:18:35 user nova-compute[74960]:   </metadata>
Nov 03 12:18:35 user nova-compute[74960]:   <sysinfo type="smbios">
Nov 03 12:18:35 user nova-compute[74960]:     <system>
Nov 03 12:18:35 user nova-compute[74960]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 12:18:35 user nova-compute[74960]:       <entry name="product">OpenStack Nova</entry>
Nov 03 12:18:35 user nova-compute[74960]:       <entry name="version">0.0.0</entry>
Nov 03 12:18:35 user nova-compute[74960]:       <entry name="serial">79b85953-182f-459f-a8d4-bcb54148a850</entry>
Nov 03 12:18:35 user nova-compute[74960]:       <entry name="uuid">79b85953-182f-459f-a8d4-bcb54148a850</entry>
Nov 03 12:18:35 user nova-compute[74960]:       <entry name="family">Virtual Machine</entry>
Nov 03 12:18:35 user nova-compute[74960]:     </system>
Nov 03 12:18:35 user nova-compute[74960]:   </sysinfo>
Nov 03 12:18:35 user nova-compute[74960]:   <os>
Nov 03 12:18:35 user nova-compute[74960]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 12:18:35 user nova-compute[74960]:     <boot dev="hd"/>
Nov 03 12:18:35 user nova-compute[74960]:     <smbios mode="sysinfo"/>
Nov 03 12:18:35 user nova-compute[74960]:   </os>
Nov 03 12:18:35 user nova-compute[74960]:   <features>
Nov 03 12:18:35 user nova-compute[74960]:     <acpi/>
Nov 03 12:18:35 user nova-compute[74960]:     <apic/>
Nov 03 12:18:35 user nova-compute[74960]:     <vmcoreinfo/>
Nov 03 12:18:35 user nova-compute[74960]:   </features>
Nov 03 12:18:35 user nova-compute[74960]:   <clock offset="utc">
Nov 03 12:18:35 user nova-compute[74960]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 12:18:35 user nova-compute[74960]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 12:18:35 user nova-compute[74960]:     <timer name="hpet" present="no"/>
Nov 03 12:18:35 user nova-compute[74960]:   </clock>
Nov 03 12:18:35 user nova-compute[74960]:   <cpu mode="custom" match="exact">
Nov 03 12:18:35 user nova-compute[74960]:     <model>Nehalem</model>
Nov 03 12:18:35 user nova-compute[74960]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 12:18:35 user nova-compute[74960]:   </cpu>
Nov 03 12:18:35 user nova-compute[74960]:   <devices>
Nov 03 12:18:35 user nova-compute[74960]:     <disk type="file" device="disk">
Nov 03 12:18:35 user nova-compute[74960]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 12:18:35 user nova-compute[74960]:       <source file="/opt/stack/data/nova/instances/79b85953-182f-459f-a8d4-bcb54148a850/disk"/>
Nov 03 12:18:35 user nova-compute[74960]:       <target dev="vda" bus="virtio"/>
Nov 03 12:18:35 user nova-compute[74960]:     </disk>
Nov 03 12:18:35 user nova-compute[74960]:     <interface type="ethernet">
Nov 03 12:18:35 user nova-compute[74960]:       <mac address="fa:16:3e:16:3e:5d"/>
Nov 03 12:18:35 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:18:35 user nova-compute[74960]:       <mtu size="1442"/>
Nov 03 12:18:35 user nova-compute[74960]:       <target dev="tap25c374db-28"/>
Nov 03 12:18:35 user nova-compute[74960]:     </interface>
Nov 03 12:18:35 user nova-compute[74960]:     <serial type="pty">
Nov 03 12:18:35 user nova-compute[74960]:       <log file="/opt/stack/data/nova/instances/79b85953-182f-459f-a8d4-bcb54148a850/console.log" append="off"/>
Nov 03 12:18:35 user nova-compute[74960]:     </serial>
Nov 03 12:18:35 user nova-compute[74960]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 12:18:35 user nova-compute[74960]:     <video>
Nov 03 12:18:35 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:18:35 user nova-compute[74960]:     </video>
Nov 03 12:18:35 user nova-compute[74960]:     <rng model="virtio">
Nov 03 12:18:35 user nova-compute[74960]:       <backend model="random">/dev/urandom</backend>
Nov 03 12:18:35 user nova-compute[74960]:     </rng>
Nov 03 12:18:35 user nova-compute[74960]:     <controller type="usb" index="0" model="none"/>
Nov 03 12:18:35 user nova-compute[74960]:     <memballoon model="virtio">
Nov 03 12:18:35 user nova-compute[74960]:       <stats period="10"/>
Nov 03 12:18:35 user nova-compute[74960]:     </memballoon>
Nov 03 12:18:35 user nova-compute[74960]:   </devices>
Nov 03 12:18:35 user nova-compute[74960]: </domain>
Nov 03 12:18:35 user nova-compute[74960]:  {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 12:18:35 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-1f9ab7aa-0552-426f-bd1c-229b78d83e8f tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:18:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-341594800',display_name='tempest-VolumesActionsTest-instance-341594800',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-341594800',id=9,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='be790149973a4bdc903e08ed69b9238f',ramdisk_id='',reservation_id='r-pw7385fx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1044563007',owner_user_name='tempest-VolumesActionsTest-1044563007-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:18:33Z,user_data=None,user_id='ac6f783eb87d4aeaaf7de78836e8253f',uuid=79b85953-182f-459f-a8d4-bcb54148a850,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "25c374db-280b-4b5b-a803-915efb751de8", "address": "fa:16:3e:16:3e:5d", "network": {"id": "75b4c07e-f11a-41c6-9b17-525598c88bdf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-215952367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be790149973a4bdc903e08ed69b9238f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25c374db-28", "ovs_interfaceid": "25c374db-280b-4b5b-a803-915efb751de8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 12:18:35 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-1f9ab7aa-0552-426f-bd1c-229b78d83e8f tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] Converting VIF {"id": "25c374db-280b-4b5b-a803-915efb751de8", "address": "fa:16:3e:16:3e:5d", "network": {"id": "75b4c07e-f11a-41c6-9b17-525598c88bdf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-215952367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be790149973a4bdc903e08ed69b9238f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25c374db-28", "ovs_interfaceid": "25c374db-280b-4b5b-a803-915efb751de8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:18:35 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-1f9ab7aa-0552-426f-bd1c-229b78d83e8f tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:3e:5d,bridge_name='br-int',has_traffic_filtering=True,id=25c374db-280b-4b5b-a803-915efb751de8,network=Network(75b4c07e-f11a-41c6-9b17-525598c88bdf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25c374db-28') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:18:35 user nova-compute[74960]: DEBUG os_vif [None req-1f9ab7aa-0552-426f-bd1c-229b78d83e8f tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:3e:5d,bridge_name='br-int',has_traffic_filtering=True,id=25c374db-280b-4b5b-a803-915efb751de8,network=Network(75b4c07e-f11a-41c6-9b17-525598c88bdf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25c374db-28') {{(pid=74960) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 12:18:35 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:18:35 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:18:35 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 12:18:35 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:18:35 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '55c34b09-dab0-5afa-937b-48fa494b9915', '_type': 'linux-noop'}}, row=False) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:18:35 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:18:35 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:18:35 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:18:35 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap25c374db-28, may_exist=True, interface_attrs={}) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:18:35 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap25c374db-28, col_values=(('qos', UUID('09ee9178-c762-4484-9f7d-c86683fbc72b')),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:18:35 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap25c374db-28, col_values=(('external_ids', {'iface-id': '25c374db-280b-4b5b-a803-915efb751de8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:16:3e:5d', 'vm-uuid': '79b85953-182f-459f-a8d4-bcb54148a850'}),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:18:35 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:18:35 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:18:35 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:18:35 user nova-compute[74960]: INFO os_vif [None req-1f9ab7aa-0552-426f-bd1c-229b78d83e8f tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:3e:5d,bridge_name='br-int',has_traffic_filtering=True,id=25c374db-280b-4b5b-a803-915efb751de8,network=Network(75b4c07e-f11a-41c6-9b17-525598c88bdf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25c374db-28')
Nov 03 12:18:35 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-1f9ab7aa-0552-426f-bd1c-229b78d83e8f tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] No BDM found with device name vda, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:18:35 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-1f9ab7aa-0552-426f-bd1c-229b78d83e8f tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] No VIF found with MAC fa:16:3e:16:3e:5d, not building metadata {{(pid=74960) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 12:18:35 user nova-compute[74960]: DEBUG nova.network.neutron [req-9ef9302c-8d88-4e5a-a18e-512551bdee57 req-286697fd-6d52-4e6d-94ce-35f871869ce8 service nova] [instance: 79b85953-182f-459f-a8d4-bcb54148a850] Updated VIF entry in instance network info cache for port 25c374db-280b-4b5b-a803-915efb751de8. {{(pid=74960) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 12:18:35 user nova-compute[74960]: DEBUG nova.network.neutron [req-9ef9302c-8d88-4e5a-a18e-512551bdee57 req-286697fd-6d52-4e6d-94ce-35f871869ce8 service nova] [instance: 79b85953-182f-459f-a8d4-bcb54148a850] Updating instance_info_cache with network_info: [{"id": "25c374db-280b-4b5b-a803-915efb751de8", "address": "fa:16:3e:16:3e:5d", "network": {"id": "75b4c07e-f11a-41c6-9b17-525598c88bdf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-215952367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be790149973a4bdc903e08ed69b9238f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25c374db-28", "ovs_interfaceid": "25c374db-280b-4b5b-a803-915efb751de8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:18:35 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-9ef9302c-8d88-4e5a-a18e-512551bdee57 req-286697fd-6d52-4e6d-94ce-35f871869ce8 service nova] Releasing lock "refresh_cache-79b85953-182f-459f-a8d4-bcb54148a850" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:18:35 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:18:36 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:18:36 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:18:36 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:18:36 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:18:37 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-ab4d0c5d-bdff-4340-aad1-8d3bb3fc7356 tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Acquiring lock "39e6c635-4602-4ed6-abbd-80c96f056715" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:18:37 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-ab4d0c5d-bdff-4340-aad1-8d3bb3fc7356 tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Lock "39e6c635-4602-4ed6-abbd-80c96f056715" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:18:37 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:18:37 user nova-compute[74960]: DEBUG nova.objects.instance [None req-ab4d0c5d-bdff-4340-aad1-8d3bb3fc7356 tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Lazy-loading 'flavor' on Instance uuid 39e6c635-4602-4ed6-abbd-80c96f056715 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:18:37 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:18:37 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:18:37 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:18:37 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:18:37 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-ab4d0c5d-bdff-4340-aad1-8d3bb3fc7356 tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Lock "39e6c635-4602-4ed6-abbd-80c96f056715" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.139s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:18:37 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:18:37 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-ab4d0c5d-bdff-4340-aad1-8d3bb3fc7356 tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Acquiring lock "39e6c635-4602-4ed6-abbd-80c96f056715" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:18:37 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-ab4d0c5d-bdff-4340-aad1-8d3bb3fc7356 tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Lock "39e6c635-4602-4ed6-abbd-80c96f056715" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:18:37 user nova-compute[74960]: INFO nova.compute.manager [None req-ab4d0c5d-bdff-4340-aad1-8d3bb3fc7356 tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] [instance: 39e6c635-4602-4ed6-abbd-80c96f056715] Attaching volume 801f5055-02d8-4d35-ba25-3052149a0e1b to /dev/vdb
Nov 03 12:18:37 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:18:37 user nova-compute[74960]: DEBUG os_brick.utils [None req-ab4d0c5d-bdff-4340-aad1-8d3bb3fc7356 tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:18:37 user nova-compute[74960]: INFO oslo.privsep.daemon [None req-ab4d0c5d-bdff-4340-aad1-8d3bb3fc7356 tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmp9l4lqy21/privsep.sock']
Nov 03 12:18:37 user sudo[86164]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmp9l4lqy21/privsep.sock
Nov 03 12:18:37 user sudo[86164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 03 12:18:39 user nova-compute[74960]: DEBUG nova.compute.manager [None req-1f9ab7aa-0552-426f-bd1c-229b78d83e8f tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] [instance: 79b85953-182f-459f-a8d4-bcb54148a850] Instance event wait completed in 0 seconds for  {{(pid=74960) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 12:18:39 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-1f9ab7aa-0552-426f-bd1c-229b78d83e8f tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] [instance: 79b85953-182f-459f-a8d4-bcb54148a850] Guest created on hypervisor {{(pid=74960) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 12:18:39 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: 79b85953-182f-459f-a8d4-bcb54148a850] Instance spawned successfully.
Nov 03 12:18:39 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-1f9ab7aa-0552-426f-bd1c-229b78d83e8f tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] [instance: 79b85953-182f-459f-a8d4-bcb54148a850] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 12:18:39 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-1f9ab7aa-0552-426f-bd1c-229b78d83e8f tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] [instance: 79b85953-182f-459f-a8d4-bcb54148a850] Found default for hw_cdrom_bus of ide {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:18:39 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-1f9ab7aa-0552-426f-bd1c-229b78d83e8f tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] [instance: 79b85953-182f-459f-a8d4-bcb54148a850] Found default for hw_disk_bus of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:18:39 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-1f9ab7aa-0552-426f-bd1c-229b78d83e8f tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] [instance: 79b85953-182f-459f-a8d4-bcb54148a850] Found default for hw_input_bus of None {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:18:39 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-1f9ab7aa-0552-426f-bd1c-229b78d83e8f tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] [instance: 79b85953-182f-459f-a8d4-bcb54148a850] Found default for hw_pointer_model of None {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:18:39 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-1f9ab7aa-0552-426f-bd1c-229b78d83e8f tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] [instance: 79b85953-182f-459f-a8d4-bcb54148a850] Found default for hw_video_model of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:18:39 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-1f9ab7aa-0552-426f-bd1c-229b78d83e8f tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] [instance: 79b85953-182f-459f-a8d4-bcb54148a850] Found default for hw_vif_model of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:18:39 user nova-compute[74960]: INFO nova.compute.manager [None req-1f9ab7aa-0552-426f-bd1c-229b78d83e8f tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] [instance: 79b85953-182f-459f-a8d4-bcb54148a850] Took 5.75 seconds to spawn the instance on the hypervisor.
Nov 03 12:18:39 user nova-compute[74960]: DEBUG nova.compute.manager [None req-1f9ab7aa-0552-426f-bd1c-229b78d83e8f tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] [instance: 79b85953-182f-459f-a8d4-bcb54148a850] Checking state {{(pid=74960) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 12:18:39 user nova-compute[74960]: INFO nova.compute.manager [None req-1f9ab7aa-0552-426f-bd1c-229b78d83e8f tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] [instance: 79b85953-182f-459f-a8d4-bcb54148a850] Took 6.68 seconds to build instance.
Nov 03 12:18:39 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:18:39 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:18:39 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-1f9ab7aa-0552-426f-bd1c-229b78d83e8f tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] Lock "79b85953-182f-459f-a8d4-bcb54148a850" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.824s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:18:39 user sudo[86164]: pam_unix(sudo:session): session closed for user root
Nov 03 12:18:39 user nova-compute[74960]: INFO oslo.privsep.daemon [None req-ab4d0c5d-bdff-4340-aad1-8d3bb3fc7356 tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Spawned new privsep daemon via rootwrap
Nov 03 12:18:39 user nova-compute[74960]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 03 12:18:39 user nova-compute[74960]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 03 12:18:39 user nova-compute[74960]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Nov 03 12:18:39 user nova-compute[74960]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 86167
Nov 03 12:18:39 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd30b3d4-2682-46c0-bbcc-d9ad9dffc6c6]: (2,) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:18:39 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:18:39 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:18:39 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[a627ee96-4585-4f3f-869b-3301de921c03]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:75b8e219756\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:18:39 user nova-compute[74960]: WARNING os_brick.initiator.connectors.nvmeof [None req-ab4d0c5d-bdff-4340-aad1-8d3bb3fc7356 tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Nov 03 12:18:39 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:18:39 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:18:39 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcd8ab0b-a58a-43c2-a477-f1edd151ae48]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:18:39 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:18:39 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:18:39 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc7c08ad-a225-424a-9b82-5f6656c5bc89]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:18:39 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[999bba36-295a-4e82-bd82-f3e4ad5b632e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:18:39 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-ab4d0c5d-bdff-4340-aad1-8d3bb3fc7356 tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Running cmd (subprocess): nvme version {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:18:39 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-ab4d0c5d-bdff-4340-aad1-8d3bb3fc7356 tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] 'nvme version' failed. Not Retrying. {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 12:18:39 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ab4d0c5d-bdff-4340-aad1-8d3bb3fc7356 tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] nvme not present on system {{(pid=74960) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 12:18:39 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:18:39 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 12:18:39 user nova-compute[74960]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 12:18:39 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[6999e762-2359-4895-9f8d-425acf79ce32]: (4, '') {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:18:39 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-ab4d0c5d-bdff-4340-aad1-8d3bb3fc7356 tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74960) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 12:18:39 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-ab4d0c5d-bdff-4340-aad1-8d3bb3fc7356 tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74960) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 12:18:39 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-ab4d0c5d-bdff-4340-aad1-8d3bb3fc7356 tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] LIGHTOS: no hostnqn found. {{(pid=74960) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 12:18:39 user nova-compute[74960]: DEBUG os_brick.utils [None req-ab4d0c5d-bdff-4340-aad1-8d3bb3fc7356 tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] <== get_connector_properties: return (2055ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:75b8e219756', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:18:39 user nova-compute[74960]: DEBUG nova.virt.block_device [None req-ab4d0c5d-bdff-4340-aad1-8d3bb3fc7356 tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] [instance: 39e6c635-4602-4ed6-abbd-80c96f056715] Updating existing volume attachment record: 67aa9073-38d8-4214-8fd5-5b9bc9bbb37d {{(pid=74960) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 12:18:40 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:18:40 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:18:40 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Starting heal instance info cache {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 12:18:40 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "refresh_cache-7e5ec97f-80c4-4499-94bf-2584fc0eae03" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:18:40 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquired lock "refresh_cache-7e5ec97f-80c4-4499-94bf-2584fc0eae03" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:18:40 user nova-compute[74960]: DEBUG nova.network.neutron [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Forcefully refreshing network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 12:18:40 user nova-compute[74960]: DEBUG nova.compute.manager [req-b6f3a65d-4627-4866-8ec0-62daf9e482dd req-1efa2731-c9dc-46aa-afb4-72915581c5d8 service nova] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Received event network-changed-e91b8148-e2ff-4124-9799-ba4efae837ff {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:18:40 user nova-compute[74960]: DEBUG nova.compute.manager [req-b6f3a65d-4627-4866-8ec0-62daf9e482dd req-1efa2731-c9dc-46aa-afb4-72915581c5d8 service nova] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Refreshing instance network info cache due to event network-changed-e91b8148-e2ff-4124-9799-ba4efae837ff. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 12:18:40 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-b6f3a65d-4627-4866-8ec0-62daf9e482dd req-1efa2731-c9dc-46aa-afb4-72915581c5d8 service nova] Acquiring lock "refresh_cache-7e5ec97f-80c4-4499-94bf-2584fc0eae03" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:18:41 user nova-compute[74960]: DEBUG nova.network.neutron [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Updating instance_info_cache with network_info: [{"id": "e91b8148-e2ff-4124-9799-ba4efae837ff", "address": "fa:16:3e:40:35:d4", "network": {"id": "c03e854d-75a3-4e81-9cdf-f1139841266c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1632999031-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c216dd7629274eafbf0a5968ff2378a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape91b8148-e2", "ovs_interfaceid": "e91b8148-e2ff-4124-9799-ba4efae837ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:18:41 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Releasing lock "refresh_cache-7e5ec97f-80c4-4499-94bf-2584fc0eae03" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:18:41 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Updated the network info_cache for instance {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 12:18:41 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-b6f3a65d-4627-4866-8ec0-62daf9e482dd req-1efa2731-c9dc-46aa-afb4-72915581c5d8 service nova] Acquired lock "refresh_cache-7e5ec97f-80c4-4499-94bf-2584fc0eae03" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:18:41 user nova-compute[74960]: DEBUG nova.network.neutron [req-b6f3a65d-4627-4866-8ec0-62daf9e482dd req-1efa2731-c9dc-46aa-afb4-72915581c5d8 service nova] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Refreshing network info cache for port e91b8148-e2ff-4124-9799-ba4efae837ff {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 12:18:41 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:18:41 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74960) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 12:18:41 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:18:41 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:18:41 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:18:41 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:18:41 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Auditing locally available compute resources for user (node: user) {{(pid=74960) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 12:18:41 user nova-compute[74960]: DEBUG nova.compute.manager [req-b009af42-5037-4dbe-9e72-99dbd8f78d34 req-389b9d26-1b3b-4857-98f0-d2ed934c84ab service nova] [instance: 7769e3c5-136f-4282-8e3e-224e3a80922c] Received event network-changed-8fe46c5c-9093-43c4-8b0d-baf325c2e18b {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:18:41 user nova-compute[74960]: DEBUG nova.compute.manager [req-b009af42-5037-4dbe-9e72-99dbd8f78d34 req-389b9d26-1b3b-4857-98f0-d2ed934c84ab service nova] [instance: 7769e3c5-136f-4282-8e3e-224e3a80922c] Refreshing instance network info cache due to event network-changed-8fe46c5c-9093-43c4-8b0d-baf325c2e18b. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 12:18:41 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-b009af42-5037-4dbe-9e72-99dbd8f78d34 req-389b9d26-1b3b-4857-98f0-d2ed934c84ab service nova] Acquiring lock "refresh_cache-7769e3c5-136f-4282-8e3e-224e3a80922c" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:18:41 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-b009af42-5037-4dbe-9e72-99dbd8f78d34 req-389b9d26-1b3b-4857-98f0-d2ed934c84ab service nova] Acquired lock "refresh_cache-7769e3c5-136f-4282-8e3e-224e3a80922c" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:18:41 user nova-compute[74960]: DEBUG nova.network.neutron [req-b009af42-5037-4dbe-9e72-99dbd8f78d34 req-389b9d26-1b3b-4857-98f0-d2ed934c84ab service nova] [instance: 7769e3c5-136f-4282-8e3e-224e3a80922c] Refreshing network info cache for port 8fe46c5c-9093-43c4-8b0d-baf325c2e18b {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 12:18:41 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d00a0872-693c-4cdc-85cd-9806660e9d8d/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:18:42 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d00a0872-693c-4cdc-85cd-9806660e9d8d/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:18:42 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d00a0872-693c-4cdc-85cd-9806660e9d8d/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:18:42 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d00a0872-693c-4cdc-85cd-9806660e9d8d/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:18:42 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e5ec97f-80c4-4499-94bf-2584fc0eae03/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:18:42 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e5ec97f-80c4-4499-94bf-2584fc0eae03/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:18:42 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e5ec97f-80c4-4499-94bf-2584fc0eae03/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:18:42 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:18:42 user nova-compute[74960]: DEBUG nova.network.neutron [req-b6f3a65d-4627-4866-8ec0-62daf9e482dd req-1efa2731-c9dc-46aa-afb4-72915581c5d8 service nova] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Updated VIF entry in instance network info cache for port e91b8148-e2ff-4124-9799-ba4efae837ff. {{(pid=74960) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 12:18:42 user nova-compute[74960]: DEBUG nova.network.neutron [req-b6f3a65d-4627-4866-8ec0-62daf9e482dd req-1efa2731-c9dc-46aa-afb4-72915581c5d8 service nova] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Updating instance_info_cache with network_info: [{"id": "e91b8148-e2ff-4124-9799-ba4efae837ff", "address": "fa:16:3e:40:35:d4", "network": {"id": "c03e854d-75a3-4e81-9cdf-f1139841266c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1632999031-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c216dd7629274eafbf0a5968ff2378a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape91b8148-e2", "ovs_interfaceid": "e91b8148-e2ff-4124-9799-ba4efae837ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:18:42 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e5ec97f-80c4-4499-94bf-2584fc0eae03/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:18:42 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39e6c635-4602-4ed6-abbd-80c96f056715/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:18:42 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-b6f3a65d-4627-4866-8ec0-62daf9e482dd req-1efa2731-c9dc-46aa-afb4-72915581c5d8 service nova] Releasing lock "refresh_cache-7e5ec97f-80c4-4499-94bf-2584fc0eae03" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:18:42 user nova-compute[74960]: DEBUG nova.network.neutron [req-b009af42-5037-4dbe-9e72-99dbd8f78d34 req-389b9d26-1b3b-4857-98f0-d2ed934c84ab service nova] [instance: 7769e3c5-136f-4282-8e3e-224e3a80922c] Updated VIF entry in instance network info cache for port 8fe46c5c-9093-43c4-8b0d-baf325c2e18b. {{(pid=74960) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 12:18:42 user nova-compute[74960]: DEBUG nova.network.neutron [req-b009af42-5037-4dbe-9e72-99dbd8f78d34 req-389b9d26-1b3b-4857-98f0-d2ed934c84ab service nova] [instance: 7769e3c5-136f-4282-8e3e-224e3a80922c] Updating instance_info_cache with network_info: [{"id": "8fe46c5c-9093-43c4-8b0d-baf325c2e18b", "address": "fa:16:3e:ba:d5:3a", "network": {"id": "9c5fae09-5df5-45a3-b9cd-7ac3763ba878", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1736223258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5320673ee4f0422989a3708915375cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fe46c5c-90", "ovs_interfaceid": "8fe46c5c-9093-43c4-8b0d-baf325c2e18b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:18:42 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-b009af42-5037-4dbe-9e72-99dbd8f78d34 req-389b9d26-1b3b-4857-98f0-d2ed934c84ab service nova] Releasing lock "refresh_cache-7769e3c5-136f-4282-8e3e-224e3a80922c" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:18:42 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c7f9e2da-87c8-4f0a-b7f3-0f26807c66a3 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Acquiring lock "05956d9b-0646-43d2-a4cd-19e9090020ee" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:18:42 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c7f9e2da-87c8-4f0a-b7f3-0f26807c66a3 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Lock "05956d9b-0646-43d2-a4cd-19e9090020ee" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:18:42 user nova-compute[74960]: DEBUG nova.compute.manager [None req-c7f9e2da-87c8-4f0a-b7f3-0f26807c66a3 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] Starting instance... {{(pid=74960) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 12:18:42 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39e6c635-4602-4ed6-abbd-80c96f056715/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:18:42 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39e6c635-4602-4ed6-abbd-80c96f056715/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:18:43 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c7f9e2da-87c8-4f0a-b7f3-0f26807c66a3 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:18:43 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c7f9e2da-87c8-4f0a-b7f3-0f26807c66a3 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:18:43 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-c7f9e2da-87c8-4f0a-b7f3-0f26807c66a3 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74960) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 12:18:43 user nova-compute[74960]: INFO nova.compute.claims [None req-c7f9e2da-87c8-4f0a-b7f3-0f26807c66a3 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] Claim successful on node user
Nov 03 12:18:43 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39e6c635-4602-4ed6-abbd-80c96f056715/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:18:43 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7769e3c5-136f-4282-8e3e-224e3a80922c/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:18:43 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7769e3c5-136f-4282-8e3e-224e3a80922c/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:18:43 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7769e3c5-136f-4282-8e3e-224e3a80922c/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:18:43 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-c7f9e2da-87c8-4f0a-b7f3-0f26807c66a3 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:18:43 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-c7f9e2da-87c8-4f0a-b7f3-0f26807c66a3 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:18:43 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7769e3c5-136f-4282-8e3e-224e3a80922c/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:18:43 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8381c969-6a2d-4934-aadd-660ffa246b05/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:18:43 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c7f9e2da-87c8-4f0a-b7f3-0f26807c66a3 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.650s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:18:43 user nova-compute[74960]: DEBUG nova.compute.manager [None req-c7f9e2da-87c8-4f0a-b7f3-0f26807c66a3 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] Start building networks asynchronously for instance. {{(pid=74960) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 12:18:43 user nova-compute[74960]: DEBUG nova.compute.manager [None req-c7f9e2da-87c8-4f0a-b7f3-0f26807c66a3 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] Allocating IP information in the background. {{(pid=74960) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 12:18:43 user nova-compute[74960]: DEBUG nova.network.neutron [None req-c7f9e2da-87c8-4f0a-b7f3-0f26807c66a3 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] allocate_for_instance() {{(pid=74960) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 12:18:43 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-c7f9e2da-87c8-4f0a-b7f3-0f26807c66a3 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 12:18:43 user nova-compute[74960]: DEBUG nova.compute.manager [None req-c7f9e2da-87c8-4f0a-b7f3-0f26807c66a3 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] Start building block device mappings for instance. {{(pid=74960) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 12:18:43 user nova-compute[74960]: DEBUG nova.policy [None req-c7f9e2da-87c8-4f0a-b7f3-0f26807c66a3 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1c9880db5b784aadaeba7492523df5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4a374c1c544718887bd75b77a72a3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74960) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 12:18:43 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8381c969-6a2d-4934-aadd-660ffa246b05/disk --force-share --output=json" returned: 0 in 0.281s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:18:43 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8381c969-6a2d-4934-aadd-660ffa246b05/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:18:44 user nova-compute[74960]: DEBUG nova.compute.manager [None req-c7f9e2da-87c8-4f0a-b7f3-0f26807c66a3 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] Start spawning the instance on the hypervisor. {{(pid=74960) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 12:18:44 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-c7f9e2da-87c8-4f0a-b7f3-0f26807c66a3 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] Creating instance directory {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 12:18:44 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-c7f9e2da-87c8-4f0a-b7f3-0f26807c66a3 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] Creating image(s)
Nov 03 12:18:44 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c7f9e2da-87c8-4f0a-b7f3-0f26807c66a3 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Acquiring lock "/opt/stack/data/nova/instances/05956d9b-0646-43d2-a4cd-19e9090020ee/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:18:44 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c7f9e2da-87c8-4f0a-b7f3-0f26807c66a3 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Lock "/opt/stack/data/nova/instances/05956d9b-0646-43d2-a4cd-19e9090020ee/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:18:44 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c7f9e2da-87c8-4f0a-b7f3-0f26807c66a3 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Lock "/opt/stack/data/nova/instances/05956d9b-0646-43d2-a4cd-19e9090020ee/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:18:44 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c7f9e2da-87c8-4f0a-b7f3-0f26807c66a3 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Acquiring lock "95eaee271a42362ade595e1bcb5dde2063ccad30" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:18:44 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c7f9e2da-87c8-4f0a-b7f3-0f26807c66a3 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Lock "95eaee271a42362ade595e1bcb5dde2063ccad30" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:18:44 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8381c969-6a2d-4934-aadd-660ffa246b05/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:18:44 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79b85953-182f-459f-a8d4-bcb54148a850/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:18:44 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-c7f9e2da-87c8-4f0a-b7f3-0f26807c66a3 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95eaee271a42362ade595e1bcb5dde2063ccad30.part --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:18:44 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79b85953-182f-459f-a8d4-bcb54148a850/disk --force-share --output=json" returned: 0 in 0.380s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:18:44 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79b85953-182f-459f-a8d4-bcb54148a850/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:18:44 user nova-compute[74960]: DEBUG nova.network.neutron [None req-c7f9e2da-87c8-4f0a-b7f3-0f26807c66a3 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] Successfully created port: 4d0cd9f3-3345-43ce-b449-8a46402e6cbd {{(pid=74960) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 12:18:44 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79b85953-182f-459f-a8d4-bcb54148a850/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:18:44 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-c7f9e2da-87c8-4f0a-b7f3-0f26807c66a3 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95eaee271a42362ade595e1bcb5dde2063ccad30.part --force-share --output=json" returned: 0 in 0.317s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:18:44 user nova-compute[74960]: DEBUG nova.virt.images [None req-c7f9e2da-87c8-4f0a-b7f3-0f26807c66a3 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] 22e1e9fb-500f-48a2-9f93-47a950579b41 was qcow2, converting to raw {{(pid=74960) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 03 12:18:44 user nova-compute[74960]: DEBUG nova.privsep.utils [None req-c7f9e2da-87c8-4f0a-b7f3-0f26807c66a3 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74960) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 03 12:18:44 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-c7f9e2da-87c8-4f0a-b7f3-0f26807c66a3 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/95eaee271a42362ade595e1bcb5dde2063ccad30.part /opt/stack/data/nova/instances/_base/95eaee271a42362ade595e1bcb5dde2063ccad30.converted {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:18:44 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f7fabc2-5e1b-441c-a693-9956470359ea/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:18:44 user nova-compute[74960]: DEBUG nova.compute.manager [req-dc8cb81d-c8cd-4a54-b144-fd464dbb17da req-c70b1168-d927-472d-874e-301d0eaba082 service nova] [instance: 79b85953-182f-459f-a8d4-bcb54148a850] Received event network-vif-plugged-25c374db-280b-4b5b-a803-915efb751de8 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:18:44 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-dc8cb81d-c8cd-4a54-b144-fd464dbb17da req-c70b1168-d927-472d-874e-301d0eaba082 service nova] Acquiring lock "79b85953-182f-459f-a8d4-bcb54148a850-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:18:44 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-dc8cb81d-c8cd-4a54-b144-fd464dbb17da req-c70b1168-d927-472d-874e-301d0eaba082 service nova] Lock "79b85953-182f-459f-a8d4-bcb54148a850-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:18:44 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-dc8cb81d-c8cd-4a54-b144-fd464dbb17da req-c70b1168-d927-472d-874e-301d0eaba082 service nova] Lock "79b85953-182f-459f-a8d4-bcb54148a850-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:18:44 user nova-compute[74960]: DEBUG nova.compute.manager [req-dc8cb81d-c8cd-4a54-b144-fd464dbb17da req-c70b1168-d927-472d-874e-301d0eaba082 service nova] [instance: 79b85953-182f-459f-a8d4-bcb54148a850] No waiting events found dispatching network-vif-plugged-25c374db-280b-4b5b-a803-915efb751de8 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:18:44 user nova-compute[74960]: WARNING nova.compute.manager [req-dc8cb81d-c8cd-4a54-b144-fd464dbb17da req-c70b1168-d927-472d-874e-301d0eaba082 service nova] [instance: 79b85953-182f-459f-a8d4-bcb54148a850] Received unexpected event network-vif-plugged-25c374db-280b-4b5b-a803-915efb751de8 for instance with vm_state active and task_state None.
Nov 03 12:18:45 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-c7f9e2da-87c8-4f0a-b7f3-0f26807c66a3 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/95eaee271a42362ade595e1bcb5dde2063ccad30.part /opt/stack/data/nova/instances/_base/95eaee271a42362ade595e1bcb5dde2063ccad30.converted" returned: 0 in 0.215s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:18:45 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-c7f9e2da-87c8-4f0a-b7f3-0f26807c66a3 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95eaee271a42362ade595e1bcb5dde2063ccad30.converted --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:18:45 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f7fabc2-5e1b-441c-a693-9956470359ea/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:18:45 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f7fabc2-5e1b-441c-a693-9956470359ea/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:18:45 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:18:45 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-c7f9e2da-87c8-4f0a-b7f3-0f26807c66a3 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95eaee271a42362ade595e1bcb5dde2063ccad30.converted --force-share --output=json" returned: 0 in 0.228s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:18:45 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c7f9e2da-87c8-4f0a-b7f3-0f26807c66a3 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Lock "95eaee271a42362ade595e1bcb5dde2063ccad30" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.233s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:18:45 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-c7f9e2da-87c8-4f0a-b7f3-0f26807c66a3 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95eaee271a42362ade595e1bcb5dde2063ccad30 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:18:45 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f7fabc2-5e1b-441c-a693-9956470359ea/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:18:45 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e91dfcf4-caef-43d0-a56b-b1282363d4e0/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:18:45 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-c7f9e2da-87c8-4f0a-b7f3-0f26807c66a3 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95eaee271a42362ade595e1bcb5dde2063ccad30 --force-share --output=json" returned: 0 in 0.257s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:18:45 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c7f9e2da-87c8-4f0a-b7f3-0f26807c66a3 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Acquiring lock "95eaee271a42362ade595e1bcb5dde2063ccad30" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:18:45 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c7f9e2da-87c8-4f0a-b7f3-0f26807c66a3 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Lock "95eaee271a42362ade595e1bcb5dde2063ccad30" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:18:45 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-c7f9e2da-87c8-4f0a-b7f3-0f26807c66a3 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95eaee271a42362ade595e1bcb5dde2063ccad30 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:18:45 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e91dfcf4-caef-43d0-a56b-b1282363d4e0/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:18:45 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e91dfcf4-caef-43d0-a56b-b1282363d4e0/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:18:45 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-c7f9e2da-87c8-4f0a-b7f3-0f26807c66a3 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95eaee271a42362ade595e1bcb5dde2063ccad30 --force-share --output=json" returned: 0 in 0.192s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:18:45 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-c7f9e2da-87c8-4f0a-b7f3-0f26807c66a3 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95eaee271a42362ade595e1bcb5dde2063ccad30,backing_fmt=raw /opt/stack/data/nova/instances/05956d9b-0646-43d2-a4cd-19e9090020ee/disk 1073741824 {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:18:45 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-c7f9e2da-87c8-4f0a-b7f3-0f26807c66a3 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95eaee271a42362ade595e1bcb5dde2063ccad30,backing_fmt=raw /opt/stack/data/nova/instances/05956d9b-0646-43d2-a4cd-19e9090020ee/disk 1073741824" returned: 0 in 0.050s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:18:45 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c7f9e2da-87c8-4f0a-b7f3-0f26807c66a3 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Lock "95eaee271a42362ade595e1bcb5dde2063ccad30" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:18:45 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-c7f9e2da-87c8-4f0a-b7f3-0f26807c66a3 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95eaee271a42362ade595e1bcb5dde2063ccad30 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:18:45 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e91dfcf4-caef-43d0-a56b-b1282363d4e0/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:18:45 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a520c41-19c0-47ba-ada8-023ee9c12ca6/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:18:45 user nova-compute[74960]: DEBUG nova.network.neutron [None req-c7f9e2da-87c8-4f0a-b7f3-0f26807c66a3 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] Successfully updated port: 4d0cd9f3-3345-43ce-b449-8a46402e6cbd {{(pid=74960) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 12:18:45 user nova-compute[74960]: DEBUG nova.compute.manager [req-55129e17-cdf3-400e-a70f-dac4691f3c01 req-aaa5f20b-a97a-4986-a5ce-645ee8eb8e68 service nova] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] Received event network-changed-4d0cd9f3-3345-43ce-b449-8a46402e6cbd {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:18:45 user nova-compute[74960]: DEBUG nova.compute.manager [req-55129e17-cdf3-400e-a70f-dac4691f3c01 req-aaa5f20b-a97a-4986-a5ce-645ee8eb8e68 service nova] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] Refreshing instance network info cache due to event network-changed-4d0cd9f3-3345-43ce-b449-8a46402e6cbd. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 12:18:45 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-55129e17-cdf3-400e-a70f-dac4691f3c01 req-aaa5f20b-a97a-4986-a5ce-645ee8eb8e68 service nova] Acquiring lock "refresh_cache-05956d9b-0646-43d2-a4cd-19e9090020ee" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:18:45 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-55129e17-cdf3-400e-a70f-dac4691f3c01 req-aaa5f20b-a97a-4986-a5ce-645ee8eb8e68 service nova] Acquired lock "refresh_cache-05956d9b-0646-43d2-a4cd-19e9090020ee" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:18:45 user nova-compute[74960]: DEBUG nova.network.neutron [req-55129e17-cdf3-400e-a70f-dac4691f3c01 req-aaa5f20b-a97a-4986-a5ce-645ee8eb8e68 service nova] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] Refreshing network info cache for port 4d0cd9f3-3345-43ce-b449-8a46402e6cbd {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 12:18:45 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c7f9e2da-87c8-4f0a-b7f3-0f26807c66a3 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Acquiring lock "refresh_cache-05956d9b-0646-43d2-a4cd-19e9090020ee" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:18:46 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-c7f9e2da-87c8-4f0a-b7f3-0f26807c66a3 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95eaee271a42362ade595e1bcb5dde2063ccad30 --force-share --output=json" returned: 0 in 0.185s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:18:46 user nova-compute[74960]: DEBUG nova.virt.disk.api [None req-c7f9e2da-87c8-4f0a-b7f3-0f26807c66a3 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Checking if we can resize image /opt/stack/data/nova/instances/05956d9b-0646-43d2-a4cd-19e9090020ee/disk. size=1073741824 {{(pid=74960) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 12:18:46 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-c7f9e2da-87c8-4f0a-b7f3-0f26807c66a3 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05956d9b-0646-43d2-a4cd-19e9090020ee/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:18:46 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a520c41-19c0-47ba-ada8-023ee9c12ca6/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:18:46 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a520c41-19c0-47ba-ada8-023ee9c12ca6/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:18:46 user nova-compute[74960]: DEBUG nova.network.neutron [req-55129e17-cdf3-400e-a70f-dac4691f3c01 req-aaa5f20b-a97a-4986-a5ce-645ee8eb8e68 service nova] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] Instance cache missing network info. {{(pid=74960) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 12:18:46 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-c7f9e2da-87c8-4f0a-b7f3-0f26807c66a3 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05956d9b-0646-43d2-a4cd-19e9090020ee/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:18:46 user nova-compute[74960]: DEBUG nova.virt.disk.api [None req-c7f9e2da-87c8-4f0a-b7f3-0f26807c66a3 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Cannot resize image /opt/stack/data/nova/instances/05956d9b-0646-43d2-a4cd-19e9090020ee/disk to a smaller size. {{(pid=74960) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 12:18:46 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-c7f9e2da-87c8-4f0a-b7f3-0f26807c66a3 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] Created local disks {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 12:18:46 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-c7f9e2da-87c8-4f0a-b7f3-0f26807c66a3 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] Ensure instance console log exists: /opt/stack/data/nova/instances/05956d9b-0646-43d2-a4cd-19e9090020ee/console.log {{(pid=74960) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 12:18:46 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c7f9e2da-87c8-4f0a-b7f3-0f26807c66a3 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:18:46 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c7f9e2da-87c8-4f0a-b7f3-0f26807c66a3 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:18:46 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c7f9e2da-87c8-4f0a-b7f3-0f26807c66a3 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:18:46 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a520c41-19c0-47ba-ada8-023ee9c12ca6/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:18:46 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:18:46 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:18:46 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Hypervisor/Node resource view: name=user free_ram=7394MB free_disk=25.471454620361328GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74960) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 12:18:46 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:18:46 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:18:46 user nova-compute[74960]: DEBUG nova.network.neutron [req-55129e17-cdf3-400e-a70f-dac4691f3c01 req-aaa5f20b-a97a-4986-a5ce-645ee8eb8e68 service nova] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] Updating instance_info_cache with network_info: [] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:18:46 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 39e6c635-4602-4ed6-abbd-80c96f056715 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:18:46 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 7e5ec97f-80c4-4499-94bf-2584fc0eae03 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:18:46 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 7769e3c5-136f-4282-8e3e-224e3a80922c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:18:46 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance d00a0872-693c-4cdc-85cd-9806660e9d8d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:18:46 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance e91dfcf4-caef-43d0-a56b-b1282363d4e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:18:46 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 8381c969-6a2d-4934-aadd-660ffa246b05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:18:46 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 0a520c41-19c0-47ba-ada8-023ee9c12ca6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:18:46 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 7f7fabc2-5e1b-441c-a693-9956470359ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:18:46 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 79b85953-182f-459f-a8d4-bcb54148a850 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:18:46 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 05956d9b-0646-43d2-a4cd-19e9090020ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:18:46 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74960) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 12:18:46 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74960) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 12:18:46 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-55129e17-cdf3-400e-a70f-dac4691f3c01 req-aaa5f20b-a97a-4986-a5ce-645ee8eb8e68 service nova] Releasing lock "refresh_cache-05956d9b-0646-43d2-a4cd-19e9090020ee" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:18:46 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c7f9e2da-87c8-4f0a-b7f3-0f26807c66a3 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Acquired lock "refresh_cache-05956d9b-0646-43d2-a4cd-19e9090020ee" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:18:46 user nova-compute[74960]: DEBUG nova.network.neutron [None req-c7f9e2da-87c8-4f0a-b7f3-0f26807c66a3 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] Building network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 12:18:46 user nova-compute[74960]: DEBUG nova.compute.manager [req-2f640e4a-ec17-4cb9-bca3-c8b33b488c03 req-9d0a914a-63e0-48ca-b0cc-47381d0c6875 service nova] [instance: 79b85953-182f-459f-a8d4-bcb54148a850] Received event network-vif-plugged-25c374db-280b-4b5b-a803-915efb751de8 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:18:46 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-2f640e4a-ec17-4cb9-bca3-c8b33b488c03 req-9d0a914a-63e0-48ca-b0cc-47381d0c6875 service nova] Acquiring lock "79b85953-182f-459f-a8d4-bcb54148a850-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:18:46 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-2f640e4a-ec17-4cb9-bca3-c8b33b488c03 req-9d0a914a-63e0-48ca-b0cc-47381d0c6875 service nova] Lock "79b85953-182f-459f-a8d4-bcb54148a850-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:18:46 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-2f640e4a-ec17-4cb9-bca3-c8b33b488c03 req-9d0a914a-63e0-48ca-b0cc-47381d0c6875 service nova] Lock "79b85953-182f-459f-a8d4-bcb54148a850-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:18:46 user nova-compute[74960]: DEBUG nova.compute.manager [req-2f640e4a-ec17-4cb9-bca3-c8b33b488c03 req-9d0a914a-63e0-48ca-b0cc-47381d0c6875 service nova] [instance: 79b85953-182f-459f-a8d4-bcb54148a850] No waiting events found dispatching network-vif-plugged-25c374db-280b-4b5b-a803-915efb751de8 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:18:46 user nova-compute[74960]: WARNING nova.compute.manager [req-2f640e4a-ec17-4cb9-bca3-c8b33b488c03 req-9d0a914a-63e0-48ca-b0cc-47381d0c6875 service nova] [instance: 79b85953-182f-459f-a8d4-bcb54148a850] Received unexpected event network-vif-plugged-25c374db-280b-4b5b-a803-915efb751de8 for instance with vm_state active and task_state None.
Nov 03 12:18:47 user nova-compute[74960]: DEBUG nova.network.neutron [None req-c7f9e2da-87c8-4f0a-b7f3-0f26807c66a3 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] Instance cache missing network info. {{(pid=74960) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 12:18:47 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:18:47 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:18:47 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Compute_service record updated for user:user {{(pid=74960) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 12:18:47 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.531s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:18:47 user nova-compute[74960]: DEBUG nova.network.neutron [None req-c7f9e2da-87c8-4f0a-b7f3-0f26807c66a3 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] Updating instance_info_cache with network_info: [{"id": "4d0cd9f3-3345-43ce-b449-8a46402e6cbd", "address": "fa:16:3e:28:71:ee", "network": {"id": "b3813163-d09b-4c0b-a328-1bbb4c7e2875", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1681555035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d4a374c1c544718887bd75b77a72a3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d0cd9f3-33", "ovs_interfaceid": "4d0cd9f3-3345-43ce-b449-8a46402e6cbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:18:47 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:18:47 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c7f9e2da-87c8-4f0a-b7f3-0f26807c66a3 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Releasing lock "refresh_cache-05956d9b-0646-43d2-a4cd-19e9090020ee" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:18:47 user nova-compute[74960]: DEBUG nova.compute.manager [None req-c7f9e2da-87c8-4f0a-b7f3-0f26807c66a3 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] Instance network_info: |[{"id": "4d0cd9f3-3345-43ce-b449-8a46402e6cbd", "address": "fa:16:3e:28:71:ee", "network": {"id": "b3813163-d09b-4c0b-a328-1bbb4c7e2875", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1681555035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d4a374c1c544718887bd75b77a72a3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d0cd9f3-33", "ovs_interfaceid": "4d0cd9f3-3345-43ce-b449-8a46402e6cbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74960) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 12:18:47 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-c7f9e2da-87c8-4f0a-b7f3-0f26807c66a3 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] Start _get_guest_xml network_info=[{"id": "4d0cd9f3-3345-43ce-b449-8a46402e6cbd", "address": "fa:16:3e:28:71:ee", "network": {"id": "b3813163-d09b-4c0b-a328-1bbb4c7e2875", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1681555035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d4a374c1c544718887bd75b77a72a3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d0cd9f3-33", "ovs_interfaceid": "4d0cd9f3-3345-43ce-b449-8a46402e6cbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T12:18:39Z,direct_url=<?>,disk_format='qcow2',id=22e1e9fb-500f-48a2-9f93-47a950579b41,min_disk=0,min_ram=0,name='tempest-scenario-img--1771711633',owner='9d4a374c1c544718887bd75b77a72a3a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T12:18:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'image_id': '22e1e9fb-500f-48a2-9f93-47a950579b41'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 12:18:47 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-c7f9e2da-87c8-4f0a-b7f3-0f26807c66a3 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:18:47 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-c7f9e2da-87c8-4f0a-b7f3-0f26807c66a3 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:18:47 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-c7f9e2da-87c8-4f0a-b7f3-0f26807c66a3 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 12:18:47 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-c7f9e2da-87c8-4f0a-b7f3-0f26807c66a3 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] CPU controller missing on host. {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 12:18:47 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-c7f9e2da-87c8-4f0a-b7f3-0f26807c66a3 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 12:18:47 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-c7f9e2da-87c8-4f0a-b7f3-0f26807c66a3 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] CPU controller found on host. {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 12:18:47 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-c7f9e2da-87c8-4f0a-b7f3-0f26807c66a3 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74960) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 12:18:47 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-c7f9e2da-87c8-4f0a-b7f3-0f26807c66a3 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T12:18:39Z,direct_url=<?>,disk_format='qcow2',id=22e1e9fb-500f-48a2-9f93-47a950579b41,min_disk=0,min_ram=0,name='tempest-scenario-img--1771711633',owner='9d4a374c1c544718887bd75b77a72a3a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T12:18:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 12:18:47 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-c7f9e2da-87c8-4f0a-b7f3-0f26807c66a3 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Flavor limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 12:18:47 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-c7f9e2da-87c8-4f0a-b7f3-0f26807c66a3 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Image limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 12:18:47 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-c7f9e2da-87c8-4f0a-b7f3-0f26807c66a3 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Flavor pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 12:18:47 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-c7f9e2da-87c8-4f0a-b7f3-0f26807c66a3 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Image pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 12:18:47 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-c7f9e2da-87c8-4f0a-b7f3-0f26807c66a3 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 12:18:47 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-c7f9e2da-87c8-4f0a-b7f3-0f26807c66a3 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 12:18:47 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-c7f9e2da-87c8-4f0a-b7f3-0f26807c66a3 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 12:18:47 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-c7f9e2da-87c8-4f0a-b7f3-0f26807c66a3 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Got 1 possible topologies {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 12:18:47 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-c7f9e2da-87c8-4f0a-b7f3-0f26807c66a3 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 12:18:47 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-c7f9e2da-87c8-4f0a-b7f3-0f26807c66a3 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 12:18:47 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-c7f9e2da-87c8-4f0a-b7f3-0f26807c66a3 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:18:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2026890033',display_name='tempest-TestMinimumBasicScenario-server-2026890033',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2026890033',id=10,image_ref='22e1e9fb-500f-48a2-9f93-47a950579b41',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEmmaNRsYvlITo2mBRrQk4Ph36BrmDVaNziIg/uzay0OjgI7mZIcYRdg4M+NpnkQoh0QuRzo+cbfBEGhGGbEQaBkR5RXU9uN2kRmYlLXm8XiWRT2sIof/dwVYJht5VILJQ==',key_name='tempest-TestMinimumBasicScenario-307288959',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d4a374c1c544718887bd75b77a72a3a',ramdisk_id='',reservation_id='r-4pweyes6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='22e1e9fb-500f-48a2-9f93-47a950579b41',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-585836766',owner_user_name='tempest-TestMinimumBasicScenario-585836766-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:18:44Z,user_data=None,user_id='1c9880db5b784aadaeba7492523df5e8',uuid=05956d9b-0646-43d2-a4cd-19e9090020ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4d0cd9f3-3345-43ce-b449-8a46402e6cbd", "address": "fa:16:3e:28:71:ee", "network": {"id": "b3813163-d09b-4c0b-a328-1bbb4c7e2875", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1681555035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d4a374c1c544718887bd75b77a72a3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d0cd9f3-33", "ovs_interfaceid": "4d0cd9f3-3345-43ce-b449-8a46402e6cbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74960) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 12:18:47 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-c7f9e2da-87c8-4f0a-b7f3-0f26807c66a3 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Converting VIF {"id": "4d0cd9f3-3345-43ce-b449-8a46402e6cbd", "address": "fa:16:3e:28:71:ee", "network": {"id": "b3813163-d09b-4c0b-a328-1bbb4c7e2875", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1681555035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d4a374c1c544718887bd75b77a72a3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d0cd9f3-33", "ovs_interfaceid": "4d0cd9f3-3345-43ce-b449-8a46402e6cbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:18:47 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-c7f9e2da-87c8-4f0a-b7f3-0f26807c66a3 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:71:ee,bridge_name='br-int',has_traffic_filtering=True,id=4d0cd9f3-3345-43ce-b449-8a46402e6cbd,network=Network(b3813163-d09b-4c0b-a328-1bbb4c7e2875),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d0cd9f3-33') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:18:47 user nova-compute[74960]: DEBUG nova.objects.instance [None req-c7f9e2da-87c8-4f0a-b7f3-0f26807c66a3 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Lazy-loading 'pci_devices' on Instance uuid 05956d9b-0646-43d2-a4cd-19e9090020ee {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:18:47 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-c7f9e2da-87c8-4f0a-b7f3-0f26807c66a3 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] End _get_guest_xml xml=<domain type="kvm">
Nov 03 12:18:47 user nova-compute[74960]:   <uuid>05956d9b-0646-43d2-a4cd-19e9090020ee</uuid>
Nov 03 12:18:47 user nova-compute[74960]:   <name>instance-0000000a</name>
Nov 03 12:18:47 user nova-compute[74960]:   <memory>524288</memory>
Nov 03 12:18:47 user nova-compute[74960]:   <vcpu>1</vcpu>
Nov 03 12:18:47 user nova-compute[74960]:   <metadata>
Nov 03 12:18:47 user nova-compute[74960]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 12:18:47 user nova-compute[74960]:       <nova:package version="0.0.0"/>
Nov 03 12:18:47 user nova-compute[74960]:       <nova:name>tempest-TestMinimumBasicScenario-server-2026890033</nova:name>
Nov 03 12:18:47 user nova-compute[74960]:       <nova:creationTime>2023-11-03 12:18:47</nova:creationTime>
Nov 03 12:18:47 user nova-compute[74960]:       <nova:flavor name="m1.tiny">
Nov 03 12:18:47 user nova-compute[74960]:         <nova:memory>512</nova:memory>
Nov 03 12:18:47 user nova-compute[74960]:         <nova:disk>1</nova:disk>
Nov 03 12:18:47 user nova-compute[74960]:         <nova:swap>0</nova:swap>
Nov 03 12:18:47 user nova-compute[74960]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 12:18:47 user nova-compute[74960]:         <nova:vcpus>1</nova:vcpus>
Nov 03 12:18:47 user nova-compute[74960]:       </nova:flavor>
Nov 03 12:18:47 user nova-compute[74960]:       <nova:owner>
Nov 03 12:18:47 user nova-compute[74960]:         <nova:user uuid="1c9880db5b784aadaeba7492523df5e8">tempest-TestMinimumBasicScenario-585836766-project-member</nova:user>
Nov 03 12:18:47 user nova-compute[74960]:         <nova:project uuid="9d4a374c1c544718887bd75b77a72a3a">tempest-TestMinimumBasicScenario-585836766</nova:project>
Nov 03 12:18:47 user nova-compute[74960]:       </nova:owner>
Nov 03 12:18:47 user nova-compute[74960]:       <nova:root type="image" uuid="22e1e9fb-500f-48a2-9f93-47a950579b41"/>
Nov 03 12:18:47 user nova-compute[74960]:       <nova:ports>
Nov 03 12:18:47 user nova-compute[74960]:         <nova:port uuid="4d0cd9f3-3345-43ce-b449-8a46402e6cbd">
Nov 03 12:18:47 user nova-compute[74960]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 03 12:18:47 user nova-compute[74960]:         </nova:port>
Nov 03 12:18:47 user nova-compute[74960]:       </nova:ports>
Nov 03 12:18:47 user nova-compute[74960]:     </nova:instance>
Nov 03 12:18:47 user nova-compute[74960]:   </metadata>
Nov 03 12:18:47 user nova-compute[74960]:   <sysinfo type="smbios">
Nov 03 12:18:47 user nova-compute[74960]:     <system>
Nov 03 12:18:47 user nova-compute[74960]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 12:18:47 user nova-compute[74960]:       <entry name="product">OpenStack Nova</entry>
Nov 03 12:18:47 user nova-compute[74960]:       <entry name="version">0.0.0</entry>
Nov 03 12:18:47 user nova-compute[74960]:       <entry name="serial">05956d9b-0646-43d2-a4cd-19e9090020ee</entry>
Nov 03 12:18:47 user nova-compute[74960]:       <entry name="uuid">05956d9b-0646-43d2-a4cd-19e9090020ee</entry>
Nov 03 12:18:47 user nova-compute[74960]:       <entry name="family">Virtual Machine</entry>
Nov 03 12:18:47 user nova-compute[74960]:     </system>
Nov 03 12:18:47 user nova-compute[74960]:   </sysinfo>
Nov 03 12:18:47 user nova-compute[74960]:   <os>
Nov 03 12:18:47 user nova-compute[74960]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 12:18:47 user nova-compute[74960]:     <boot dev="hd"/>
Nov 03 12:18:47 user nova-compute[74960]:     <smbios mode="sysinfo"/>
Nov 03 12:18:47 user nova-compute[74960]:   </os>
Nov 03 12:18:47 user nova-compute[74960]:   <features>
Nov 03 12:18:47 user nova-compute[74960]:     <acpi/>
Nov 03 12:18:47 user nova-compute[74960]:     <apic/>
Nov 03 12:18:47 user nova-compute[74960]:     <vmcoreinfo/>
Nov 03 12:18:47 user nova-compute[74960]:   </features>
Nov 03 12:18:47 user nova-compute[74960]:   <clock offset="utc">
Nov 03 12:18:47 user nova-compute[74960]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 12:18:47 user nova-compute[74960]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 12:18:47 user nova-compute[74960]:     <timer name="hpet" present="no"/>
Nov 03 12:18:47 user nova-compute[74960]:   </clock>
Nov 03 12:18:47 user nova-compute[74960]:   <cpu mode="custom" match="exact">
Nov 03 12:18:47 user nova-compute[74960]:     <model>Nehalem</model>
Nov 03 12:18:47 user nova-compute[74960]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 12:18:47 user nova-compute[74960]:   </cpu>
Nov 03 12:18:47 user nova-compute[74960]:   <devices>
Nov 03 12:18:47 user nova-compute[74960]:     <disk type="file" device="disk">
Nov 03 12:18:47 user nova-compute[74960]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 12:18:47 user nova-compute[74960]:       <source file="/opt/stack/data/nova/instances/05956d9b-0646-43d2-a4cd-19e9090020ee/disk"/>
Nov 03 12:18:47 user nova-compute[74960]:       <target dev="vda" bus="virtio"/>
Nov 03 12:18:47 user nova-compute[74960]:     </disk>
Nov 03 12:18:47 user nova-compute[74960]:     <interface type="ethernet">
Nov 03 12:18:47 user nova-compute[74960]:       <mac address="fa:16:3e:28:71:ee"/>
Nov 03 12:18:47 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:18:47 user nova-compute[74960]:       <mtu size="1442"/>
Nov 03 12:18:47 user nova-compute[74960]:       <target dev="tap4d0cd9f3-33"/>
Nov 03 12:18:47 user nova-compute[74960]:     </interface>
Nov 03 12:18:47 user nova-compute[74960]:     <serial type="pty">
Nov 03 12:18:47 user nova-compute[74960]:       <log file="/opt/stack/data/nova/instances/05956d9b-0646-43d2-a4cd-19e9090020ee/console.log" append="off"/>
Nov 03 12:18:47 user nova-compute[74960]:     </serial>
Nov 03 12:18:47 user nova-compute[74960]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 12:18:47 user nova-compute[74960]:     <video>
Nov 03 12:18:47 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:18:47 user nova-compute[74960]:     </video>
Nov 03 12:18:47 user nova-compute[74960]:     <rng model="virtio">
Nov 03 12:18:47 user nova-compute[74960]:       <backend model="random">/dev/urandom</backend>
Nov 03 12:18:47 user nova-compute[74960]:     </rng>
Nov 03 12:18:47 user nova-compute[74960]:     <controller type="usb" index="0" model="none"/>
Nov 03 12:18:47 user nova-compute[74960]:     <memballoon model="virtio">
Nov 03 12:18:47 user nova-compute[74960]:       <stats period="10"/>
Nov 03 12:18:47 user nova-compute[74960]:     </memballoon>
Nov 03 12:18:47 user nova-compute[74960]:   </devices>
Nov 03 12:18:47 user nova-compute[74960]: </domain>
Nov 03 12:18:47 user nova-compute[74960]:  {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 12:18:47 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-c7f9e2da-87c8-4f0a-b7f3-0f26807c66a3 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:18:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2026890033',display_name='tempest-TestMinimumBasicScenario-server-2026890033',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2026890033',id=10,image_ref='22e1e9fb-500f-48a2-9f93-47a950579b41',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEmmaNRsYvlITo2mBRrQk4Ph36BrmDVaNziIg/uzay0OjgI7mZIcYRdg4M+NpnkQoh0QuRzo+cbfBEGhGGbEQaBkR5RXU9uN2kRmYlLXm8XiWRT2sIof/dwVYJht5VILJQ==',key_name='tempest-TestMinimumBasicScenario-307288959',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d4a374c1c544718887bd75b77a72a3a',ramdisk_id='',reservation_id='r-4pweyes6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='22e1e9fb-500f-48a2-9f93-47a950579b41',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-585836766',owner_user_name='tempest-TestMinimumBasicScenario-585836766-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:18:44Z,user_data=None,user_id='1c9880db5b784aadaeba7492523df5e8',uuid=05956d9b-0646-43d2-a4cd-19e9090020ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4d0cd9f3-3345-43ce-b449-8a46402e6cbd", "address": "fa:16:3e:28:71:ee", "network": {"id": "b3813163-d09b-4c0b-a328-1bbb4c7e2875", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1681555035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d4a374c1c544718887bd75b77a72a3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d0cd9f3-33", "ovs_interfaceid": "4d0cd9f3-3345-43ce-b449-8a46402e6cbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 12:18:47 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-c7f9e2da-87c8-4f0a-b7f3-0f26807c66a3 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Converting VIF {"id": "4d0cd9f3-3345-43ce-b449-8a46402e6cbd", "address": "fa:16:3e:28:71:ee", "network": {"id": "b3813163-d09b-4c0b-a328-1bbb4c7e2875", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1681555035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d4a374c1c544718887bd75b77a72a3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d0cd9f3-33", "ovs_interfaceid": "4d0cd9f3-3345-43ce-b449-8a46402e6cbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:18:47 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-c7f9e2da-87c8-4f0a-b7f3-0f26807c66a3 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:71:ee,bridge_name='br-int',has_traffic_filtering=True,id=4d0cd9f3-3345-43ce-b449-8a46402e6cbd,network=Network(b3813163-d09b-4c0b-a328-1bbb4c7e2875),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d0cd9f3-33') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:18:47 user nova-compute[74960]: DEBUG os_vif [None req-c7f9e2da-87c8-4f0a-b7f3-0f26807c66a3 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:71:ee,bridge_name='br-int',has_traffic_filtering=True,id=4d0cd9f3-3345-43ce-b449-8a46402e6cbd,network=Network(b3813163-d09b-4c0b-a328-1bbb4c7e2875),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d0cd9f3-33') {{(pid=74960) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 12:18:47 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:18:47 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:18:47 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 12:18:47 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:18:47 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd84b3b69-ed7e-5761-8f37-1297ea5eb05a', '_type': 'linux-noop'}}, row=False) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:18:47 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:18:47 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:18:47 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:18:47 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:18:47 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4d0cd9f3-33, may_exist=True, interface_attrs={}) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:18:47 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4d0cd9f3-33, col_values=(('qos', UUID('47c9e2ae-f6fb-47c2-9b89-40d0f7665498')),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:18:47 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4d0cd9f3-33, col_values=(('external_ids', {'iface-id': '4d0cd9f3-3345-43ce-b449-8a46402e6cbd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:28:71:ee', 'vm-uuid': '05956d9b-0646-43d2-a4cd-19e9090020ee'}),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:18:47 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:18:47 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:18:47 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:18:47 user nova-compute[74960]: INFO os_vif [None req-c7f9e2da-87c8-4f0a-b7f3-0f26807c66a3 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:71:ee,bridge_name='br-int',has_traffic_filtering=True,id=4d0cd9f3-3345-43ce-b449-8a46402e6cbd,network=Network(b3813163-d09b-4c0b-a328-1bbb4c7e2875),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d0cd9f3-33')
Nov 03 12:18:47 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-c7f9e2da-87c8-4f0a-b7f3-0f26807c66a3 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] No BDM found with device name vda, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:18:47 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-c7f9e2da-87c8-4f0a-b7f3-0f26807c66a3 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] No VIF found with MAC fa:16:3e:28:71:ee, not building metadata {{(pid=74960) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 12:18:48 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:18:48 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:18:49 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:18:49 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:18:49 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:18:49 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:18:49 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:18:49 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:18:49 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:18:49 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:18:50 user nova-compute[74960]: DEBUG nova.compute.manager [req-8eae89f0-6a75-48d7-812c-4b13d648e22a req-7b2f34e2-7d15-4305-b62c-ce2c860c5398 service nova] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] Received event network-vif-plugged-4d0cd9f3-3345-43ce-b449-8a46402e6cbd {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:18:50 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-8eae89f0-6a75-48d7-812c-4b13d648e22a req-7b2f34e2-7d15-4305-b62c-ce2c860c5398 service nova] Acquiring lock "05956d9b-0646-43d2-a4cd-19e9090020ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:18:50 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-8eae89f0-6a75-48d7-812c-4b13d648e22a req-7b2f34e2-7d15-4305-b62c-ce2c860c5398 service nova] Lock "05956d9b-0646-43d2-a4cd-19e9090020ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:18:50 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-8eae89f0-6a75-48d7-812c-4b13d648e22a req-7b2f34e2-7d15-4305-b62c-ce2c860c5398 service nova] Lock "05956d9b-0646-43d2-a4cd-19e9090020ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:18:50 user nova-compute[74960]: DEBUG nova.compute.manager [req-8eae89f0-6a75-48d7-812c-4b13d648e22a req-7b2f34e2-7d15-4305-b62c-ce2c860c5398 service nova] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] No waiting events found dispatching network-vif-plugged-4d0cd9f3-3345-43ce-b449-8a46402e6cbd {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:18:50 user nova-compute[74960]: WARNING nova.compute.manager [req-8eae89f0-6a75-48d7-812c-4b13d648e22a req-7b2f34e2-7d15-4305-b62c-ce2c860c5398 service nova] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] Received unexpected event network-vif-plugged-4d0cd9f3-3345-43ce-b449-8a46402e6cbd for instance with vm_state building and task_state spawning.
Nov 03 12:18:51 user nova-compute[74960]: DEBUG nova.compute.manager [None req-c7f9e2da-87c8-4f0a-b7f3-0f26807c66a3 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] Instance event wait completed in 0 seconds for  {{(pid=74960) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 12:18:51 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-c7f9e2da-87c8-4f0a-b7f3-0f26807c66a3 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] Guest created on hypervisor {{(pid=74960) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 12:18:51 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] Instance spawned successfully.
Nov 03 12:18:51 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-c7f9e2da-87c8-4f0a-b7f3-0f26807c66a3 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 12:18:51 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-c7f9e2da-87c8-4f0a-b7f3-0f26807c66a3 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] Found default for hw_cdrom_bus of ide {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:18:51 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-c7f9e2da-87c8-4f0a-b7f3-0f26807c66a3 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] Found default for hw_disk_bus of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:18:51 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-c7f9e2da-87c8-4f0a-b7f3-0f26807c66a3 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] Found default for hw_input_bus of None {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:18:51 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-c7f9e2da-87c8-4f0a-b7f3-0f26807c66a3 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] Found default for hw_pointer_model of None {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:18:51 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-c7f9e2da-87c8-4f0a-b7f3-0f26807c66a3 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] Found default for hw_video_model of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:18:51 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-c7f9e2da-87c8-4f0a-b7f3-0f26807c66a3 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] Found default for hw_vif_model of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:18:51 user nova-compute[74960]: INFO nova.compute.manager [None req-c7f9e2da-87c8-4f0a-b7f3-0f26807c66a3 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] Took 7.80 seconds to spawn the instance on the hypervisor.
Nov 03 12:18:51 user nova-compute[74960]: DEBUG nova.compute.manager [None req-c7f9e2da-87c8-4f0a-b7f3-0f26807c66a3 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] Checking state {{(pid=74960) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 12:18:51 user nova-compute[74960]: INFO nova.compute.manager [None req-c7f9e2da-87c8-4f0a-b7f3-0f26807c66a3 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] Took 8.96 seconds to build instance.
Nov 03 12:18:51 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c7f9e2da-87c8-4f0a-b7f3-0f26807c66a3 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Lock "05956d9b-0646-43d2-a4cd-19e9090020ee" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.103s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:18:52 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-b96ed7d2-c052-4d09-8be2-5435c212561d tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Acquiring lock "7e5ec97f-80c4-4499-94bf-2584fc0eae03" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:18:52 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-b96ed7d2-c052-4d09-8be2-5435c212561d tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Lock "7e5ec97f-80c4-4499-94bf-2584fc0eae03" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:18:52 user nova-compute[74960]: INFO nova.compute.manager [None req-b96ed7d2-c052-4d09-8be2-5435c212561d tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Shelving
Nov 03 12:18:52 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:18:52 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:18:52 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:18:52 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:18:52 user nova-compute[74960]: DEBUG nova.compute.manager [req-b7c19185-d40f-4d22-82f9-bcb4979aaf3a req-755465c8-fa43-4c23-a6aa-7b35dff30c6a service nova] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] Received event network-vif-plugged-4d0cd9f3-3345-43ce-b449-8a46402e6cbd {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:18:52 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-b7c19185-d40f-4d22-82f9-bcb4979aaf3a req-755465c8-fa43-4c23-a6aa-7b35dff30c6a service nova] Acquiring lock "05956d9b-0646-43d2-a4cd-19e9090020ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:18:52 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-b7c19185-d40f-4d22-82f9-bcb4979aaf3a req-755465c8-fa43-4c23-a6aa-7b35dff30c6a service nova] Lock "05956d9b-0646-43d2-a4cd-19e9090020ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:18:52 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-b7c19185-d40f-4d22-82f9-bcb4979aaf3a req-755465c8-fa43-4c23-a6aa-7b35dff30c6a service nova] Lock "05956d9b-0646-43d2-a4cd-19e9090020ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:18:52 user nova-compute[74960]: DEBUG nova.compute.manager [req-b7c19185-d40f-4d22-82f9-bcb4979aaf3a req-755465c8-fa43-4c23-a6aa-7b35dff30c6a service nova] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] No waiting events found dispatching network-vif-plugged-4d0cd9f3-3345-43ce-b449-8a46402e6cbd {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:18:52 user nova-compute[74960]: WARNING nova.compute.manager [req-b7c19185-d40f-4d22-82f9-bcb4979aaf3a req-755465c8-fa43-4c23-a6aa-7b35dff30c6a service nova] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] Received unexpected event network-vif-plugged-4d0cd9f3-3345-43ce-b449-8a46402e6cbd for instance with vm_state active and task_state None.
Nov 03 12:18:52 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:18:52 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:18:52 user nova-compute[74960]: DEBUG nova.compute.manager [req-bd8e1a58-89f3-4fd7-b263-8e40829f3124 req-6f2f8bea-e0f6-4ba3-8e12-ac445760ac72 service nova] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Received event network-vif-unplugged-e91b8148-e2ff-4124-9799-ba4efae837ff {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:18:52 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-bd8e1a58-89f3-4fd7-b263-8e40829f3124 req-6f2f8bea-e0f6-4ba3-8e12-ac445760ac72 service nova] Acquiring lock "7e5ec97f-80c4-4499-94bf-2584fc0eae03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:18:52 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-bd8e1a58-89f3-4fd7-b263-8e40829f3124 req-6f2f8bea-e0f6-4ba3-8e12-ac445760ac72 service nova] Lock "7e5ec97f-80c4-4499-94bf-2584fc0eae03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:18:52 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-bd8e1a58-89f3-4fd7-b263-8e40829f3124 req-6f2f8bea-e0f6-4ba3-8e12-ac445760ac72 service nova] Lock "7e5ec97f-80c4-4499-94bf-2584fc0eae03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:18:52 user nova-compute[74960]: DEBUG nova.compute.manager [req-bd8e1a58-89f3-4fd7-b263-8e40829f3124 req-6f2f8bea-e0f6-4ba3-8e12-ac445760ac72 service nova] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] No waiting events found dispatching network-vif-unplugged-e91b8148-e2ff-4124-9799-ba4efae837ff {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:18:52 user nova-compute[74960]: WARNING nova.compute.manager [req-bd8e1a58-89f3-4fd7-b263-8e40829f3124 req-6f2f8bea-e0f6-4ba3-8e12-ac445760ac72 service nova] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Received unexpected event network-vif-unplugged-e91b8148-e2ff-4124-9799-ba4efae837ff for instance with vm_state active and task_state shelving.
Nov 03 12:18:53 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Instance destroyed successfully.
Nov 03 12:18:53 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-b96ed7d2-c052-4d09-8be2-5435c212561d tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Beginning cold snapshot process
Nov 03 12:18:53 user nova-compute[74960]: DEBUG nova.privsep.utils [None req-b96ed7d2-c052-4d09-8be2-5435c212561d tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74960) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 03 12:18:53 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-b96ed7d2-c052-4d09-8be2-5435c212561d tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/7e5ec97f-80c4-4499-94bf-2584fc0eae03/disk /opt/stack/data/nova/instances/snapshots/tmprs_hsimg/384d8eebf6e2468cb63afde120960b7f {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:18:54 user nova-compute[74960]: DEBUG nova.compute.manager [req-7984ddf4-8306-4f9c-b021-2509cf32740c req-93aa1793-8edd-457b-99f3-290c985bf201 service nova] [instance: d00a0872-693c-4cdc-85cd-9806660e9d8d] Received event network-changed-c2a92350-10c1-4c73-bfce-b305071289ff {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:18:54 user nova-compute[74960]: DEBUG nova.compute.manager [req-7984ddf4-8306-4f9c-b021-2509cf32740c req-93aa1793-8edd-457b-99f3-290c985bf201 service nova] [instance: d00a0872-693c-4cdc-85cd-9806660e9d8d] Refreshing instance network info cache due to event network-changed-c2a92350-10c1-4c73-bfce-b305071289ff. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 12:18:54 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-7984ddf4-8306-4f9c-b021-2509cf32740c req-93aa1793-8edd-457b-99f3-290c985bf201 service nova] Acquiring lock "refresh_cache-d00a0872-693c-4cdc-85cd-9806660e9d8d" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:18:54 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-7984ddf4-8306-4f9c-b021-2509cf32740c req-93aa1793-8edd-457b-99f3-290c985bf201 service nova] Acquired lock "refresh_cache-d00a0872-693c-4cdc-85cd-9806660e9d8d" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:18:54 user nova-compute[74960]: DEBUG nova.network.neutron [req-7984ddf4-8306-4f9c-b021-2509cf32740c req-93aa1793-8edd-457b-99f3-290c985bf201 service nova] [instance: d00a0872-693c-4cdc-85cd-9806660e9d8d] Refreshing network info cache for port c2a92350-10c1-4c73-bfce-b305071289ff {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 12:18:54 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-b96ed7d2-c052-4d09-8be2-5435c212561d tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/7e5ec97f-80c4-4499-94bf-2584fc0eae03/disk /opt/stack/data/nova/instances/snapshots/tmprs_hsimg/384d8eebf6e2468cb63afde120960b7f" returned: 0 in 1.111s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:18:54 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-b96ed7d2-c052-4d09-8be2-5435c212561d tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Snapshot extracted, beginning image upload
Nov 03 12:18:54 user nova-compute[74960]: DEBUG nova.compute.manager [req-c10e7671-ac8a-471d-a67d-9a682e05fef7 req-5f25ef66-28f4-4d89-b9fa-973f81c68a90 service nova] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Received event network-vif-plugged-e91b8148-e2ff-4124-9799-ba4efae837ff {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:18:54 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-c10e7671-ac8a-471d-a67d-9a682e05fef7 req-5f25ef66-28f4-4d89-b9fa-973f81c68a90 service nova] Acquiring lock "7e5ec97f-80c4-4499-94bf-2584fc0eae03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:18:54 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-c10e7671-ac8a-471d-a67d-9a682e05fef7 req-5f25ef66-28f4-4d89-b9fa-973f81c68a90 service nova] Lock "7e5ec97f-80c4-4499-94bf-2584fc0eae03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:18:54 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-c10e7671-ac8a-471d-a67d-9a682e05fef7 req-5f25ef66-28f4-4d89-b9fa-973f81c68a90 service nova] Lock "7e5ec97f-80c4-4499-94bf-2584fc0eae03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:18:54 user nova-compute[74960]: DEBUG nova.compute.manager [req-c10e7671-ac8a-471d-a67d-9a682e05fef7 req-5f25ef66-28f4-4d89-b9fa-973f81c68a90 service nova] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] No waiting events found dispatching network-vif-plugged-e91b8148-e2ff-4124-9799-ba4efae837ff {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:18:54 user nova-compute[74960]: WARNING nova.compute.manager [req-c10e7671-ac8a-471d-a67d-9a682e05fef7 req-5f25ef66-28f4-4d89-b9fa-973f81c68a90 service nova] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Received unexpected event network-vif-plugged-e91b8148-e2ff-4124-9799-ba4efae837ff for instance with vm_state active and task_state shelving_image_uploading.
Nov 03 12:18:55 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] Acquiring lock "ac9e1b20-2482-4c71-b54b-5d6cb8187d04" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:18:55 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] Lock "ac9e1b20-2482-4c71-b54b-5d6cb8187d04" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:18:55 user nova-compute[74960]: DEBUG nova.compute.manager [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04] Starting instance... {{(pid=74960) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 12:18:55 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:18:55 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:18:55 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74960) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 12:18:55 user nova-compute[74960]: INFO nova.compute.claims [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04] Claim successful on node user
Nov 03 12:18:55 user nova-compute[74960]: DEBUG nova.network.neutron [req-7984ddf4-8306-4f9c-b021-2509cf32740c req-93aa1793-8edd-457b-99f3-290c985bf201 service nova] [instance: d00a0872-693c-4cdc-85cd-9806660e9d8d] Updated VIF entry in instance network info cache for port c2a92350-10c1-4c73-bfce-b305071289ff. {{(pid=74960) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 12:18:55 user nova-compute[74960]: DEBUG nova.network.neutron [req-7984ddf4-8306-4f9c-b021-2509cf32740c req-93aa1793-8edd-457b-99f3-290c985bf201 service nova] [instance: d00a0872-693c-4cdc-85cd-9806660e9d8d] Updating instance_info_cache with network_info: [{"id": "c2a92350-10c1-4c73-bfce-b305071289ff", "address": "fa:16:3e:80:8f:c1", "network": {"id": "10b59e93-b9b0-443a-8a8a-755bf2a87b0c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1169763894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7141b1fdcbd4e3b8d8ecabdb9ed4a0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2a92350-10", "ovs_interfaceid": "c2a92350-10c1-4c73-bfce-b305071289ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:18:55 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-7984ddf4-8306-4f9c-b021-2509cf32740c req-93aa1793-8edd-457b-99f3-290c985bf201 service nova] Releasing lock "refresh_cache-d00a0872-693c-4cdc-85cd-9806660e9d8d" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:18:55 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:18:55 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:18:55 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.514s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:18:55 user nova-compute[74960]: DEBUG nova.compute.manager [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04] Start building networks asynchronously for instance. {{(pid=74960) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 12:18:55 user nova-compute[74960]: DEBUG nova.compute.manager [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04] Allocating IP information in the background. {{(pid=74960) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 12:18:55 user nova-compute[74960]: DEBUG nova.network.neutron [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04] allocate_for_instance() {{(pid=74960) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 12:18:55 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 12:18:55 user nova-compute[74960]: DEBUG nova.compute.manager [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04] Start building block device mappings for instance. {{(pid=74960) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 12:18:56 user nova-compute[74960]: DEBUG nova.policy [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f88ab1bd57524047a55e8e5bb4690ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602dab4996a7422cb9bf5aff46e0fee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74960) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 12:18:56 user nova-compute[74960]: INFO nova.virt.block_device [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04] Booting with volume cea9bdd9-6e87-4397-a897-4a6387dd73a8 at /dev/vda
Nov 03 12:18:56 user nova-compute[74960]: DEBUG os_brick.utils [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:18:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:18:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:18:56 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a089c0a-58b9-4506-abd6-9d7d99be00fb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:75b8e219756\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:18:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:18:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:18:56 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[85b6b57b-7425-4823-876e-25ce67c43342]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:18:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:18:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:18:56 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec16eb49-63be-48f7-96f4-30cebceb8045]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:18:56 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e25cd55-6a9f-4aac-96c8-cc4caa658566]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:18:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] Running cmd (subprocess): nvme version {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:18:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] 'nvme version' failed. Not Retrying. {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 12:18:56 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.nvmeof [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] nvme not present on system {{(pid=74960) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 12:18:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:18:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 12:18:56 user nova-compute[74960]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 12:18:56 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[37257560-b9eb-4c23-a989-a4423b743e0a]: (4, '') {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:18:56 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74960) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 12:18:56 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74960) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 12:18:56 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] LIGHTOS: no hostnqn found. {{(pid=74960) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 12:18:56 user nova-compute[74960]: DEBUG os_brick.utils [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:75b8e219756', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:18:56 user nova-compute[74960]: DEBUG nova.virt.block_device [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04] Updating existing volume attachment record: f7af4e85-a511-4c6c-873e-b52015656b64 {{(pid=74960) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 12:18:56 user nova-compute[74960]: DEBUG nova.network.neutron [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04] Successfully created port: 2fa8f636-7161-4db6-83bf-7e4c9eff4c67 {{(pid=74960) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 12:18:56 user nova-compute[74960]: DEBUG nova.compute.manager [req-dd125215-3612-431d-9d1f-84c52424d079 req-0c4e65ce-d15c-47bf-b583-006492a6718f service nova] [instance: e91dfcf4-caef-43d0-a56b-b1282363d4e0] Received event network-changed-ce7c2b72-12cb-4251-b6ac-f2f6724a509a {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:18:56 user nova-compute[74960]: DEBUG nova.compute.manager [req-dd125215-3612-431d-9d1f-84c52424d079 req-0c4e65ce-d15c-47bf-b583-006492a6718f service nova] [instance: e91dfcf4-caef-43d0-a56b-b1282363d4e0] Refreshing instance network info cache due to event network-changed-ce7c2b72-12cb-4251-b6ac-f2f6724a509a. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 12:18:56 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-dd125215-3612-431d-9d1f-84c52424d079 req-0c4e65ce-d15c-47bf-b583-006492a6718f service nova] Acquiring lock "refresh_cache-e91dfcf4-caef-43d0-a56b-b1282363d4e0" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:18:56 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-dd125215-3612-431d-9d1f-84c52424d079 req-0c4e65ce-d15c-47bf-b583-006492a6718f service nova] Acquired lock "refresh_cache-e91dfcf4-caef-43d0-a56b-b1282363d4e0" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:18:56 user nova-compute[74960]: DEBUG nova.network.neutron [req-dd125215-3612-431d-9d1f-84c52424d079 req-0c4e65ce-d15c-47bf-b583-006492a6718f service nova] [instance: e91dfcf4-caef-43d0-a56b-b1282363d4e0] Refreshing network info cache for port ce7c2b72-12cb-4251-b6ac-f2f6724a509a {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 12:18:57 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:18:57 user nova-compute[74960]: DEBUG nova.network.neutron [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04] Successfully created port: d6c585b8-ece6-4656-b33e-14e40d9515c5 {{(pid=74960) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 12:18:57 user nova-compute[74960]: DEBUG nova.network.neutron [req-dd125215-3612-431d-9d1f-84c52424d079 req-0c4e65ce-d15c-47bf-b583-006492a6718f service nova] [instance: e91dfcf4-caef-43d0-a56b-b1282363d4e0] Updated VIF entry in instance network info cache for port ce7c2b72-12cb-4251-b6ac-f2f6724a509a. {{(pid=74960) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 12:18:57 user nova-compute[74960]: DEBUG nova.network.neutron [req-dd125215-3612-431d-9d1f-84c52424d079 req-0c4e65ce-d15c-47bf-b583-006492a6718f service nova] [instance: e91dfcf4-caef-43d0-a56b-b1282363d4e0] Updating instance_info_cache with network_info: [{"id": "ce7c2b72-12cb-4251-b6ac-f2f6724a509a", "address": "fa:16:3e:ef:a8:ac", "network": {"id": "9f0b1c9c-af46-4948-aeb8-e73013159ad4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2126041996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "58667b53361b490fa7f0236ee65934c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce7c2b72-12", "ovs_interfaceid": "ce7c2b72-12cb-4251-b6ac-f2f6724a509a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:18:57 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-dd125215-3612-431d-9d1f-84c52424d079 req-0c4e65ce-d15c-47bf-b583-006492a6718f service nova] Releasing lock "refresh_cache-e91dfcf4-caef-43d0-a56b-b1282363d4e0" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:18:57 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:18:58 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-b96ed7d2-c052-4d09-8be2-5435c212561d tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Snapshot image upload complete
Nov 03 12:18:58 user nova-compute[74960]: DEBUG nova.compute.manager [None req-b96ed7d2-c052-4d09-8be2-5435c212561d tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Checking state {{(pid=74960) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 12:18:58 user nova-compute[74960]: INFO nova.compute.manager [None req-b96ed7d2-c052-4d09-8be2-5435c212561d tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Shelve offloading
Nov 03 12:18:58 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Instance destroyed successfully.
Nov 03 12:18:58 user nova-compute[74960]: DEBUG nova.compute.manager [None req-b96ed7d2-c052-4d09-8be2-5435c212561d tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Checking state {{(pid=74960) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 12:18:58 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-b96ed7d2-c052-4d09-8be2-5435c212561d tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Acquiring lock "refresh_cache-7e5ec97f-80c4-4499-94bf-2584fc0eae03" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:18:58 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-b96ed7d2-c052-4d09-8be2-5435c212561d tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Acquired lock "refresh_cache-7e5ec97f-80c4-4499-94bf-2584fc0eae03" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:18:58 user nova-compute[74960]: DEBUG nova.network.neutron [None req-b96ed7d2-c052-4d09-8be2-5435c212561d tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Building network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 12:18:58 user nova-compute[74960]: DEBUG nova.network.neutron [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04] Successfully created port: 95a7c7bc-d60c-491f-b049-f2abd6a57647 {{(pid=74960) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 12:18:59 user nova-compute[74960]: DEBUG nova.network.neutron [None req-b96ed7d2-c052-4d09-8be2-5435c212561d tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Updating instance_info_cache with network_info: [{"id": "e91b8148-e2ff-4124-9799-ba4efae837ff", "address": "fa:16:3e:40:35:d4", "network": {"id": "c03e854d-75a3-4e81-9cdf-f1139841266c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1632999031-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c216dd7629274eafbf0a5968ff2378a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape91b8148-e2", "ovs_interfaceid": "e91b8148-e2ff-4124-9799-ba4efae837ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:18:59 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-b96ed7d2-c052-4d09-8be2-5435c212561d tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Releasing lock "refresh_cache-7e5ec97f-80c4-4499-94bf-2584fc0eae03" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:18:59 user nova-compute[74960]: DEBUG nova.network.neutron [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04] Successfully created port: e86f5236-dc27-4330-90a5-b8f8a8d669bd {{(pid=74960) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 12:19:00 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Instance destroyed successfully.
Nov 03 12:19:00 user nova-compute[74960]: DEBUG nova.objects.instance [None req-b96ed7d2-c052-4d09-8be2-5435c212561d tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Lazy-loading 'resources' on Instance uuid 7e5ec97f-80c4-4499-94bf-2584fc0eae03 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:19:00 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-b96ed7d2-c052-4d09-8be2-5435c212561d tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:16:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1395691218',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1395691218',id=2,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBORt24KiW0SvTfIC0cB1xZzGZhRsfKuon1UNTHIJ3rRPiaZtETCLFnldW9E15ZppsL+VgujOvzTcrAMfw0cF0wSfKUfWVBhncCb8D3gHhw/5cFu8NPOkNxszgCJRdkKvEg==',key_name='tempest-keypair-1234685962',keypairs=<?>,launch_index=0,launched_at=2023-11-03T12:17:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='c216dd7629274eafbf0a5968ff2378a9',ramdisk_id='',reservation_id='r-36b8brxz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-258463843',owner_user_name='tempest-AttachVolumeShelveTestJSON-258463843-project-member',shelved_at='2023-11-03T12:18:58.056502',shelved_host='user',shelved_image_id='8e8d35fe-058b-4938-9a8f-781ffb884bad'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T12:18:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fae69462930546bdb9cf6e2a11a0df2a',uuid=7e5ec97f-80c4-4499-94bf-2584fc0eae03,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "e91b8148-e2ff-4124-9799-ba4efae837ff", "address": "fa:16:3e:40:35:d4", "network": {"id": "c03e854d-75a3-4e81-9cdf-f1139841266c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1632999031-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c216dd7629274eafbf0a5968ff2378a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape91b8148-e2", "ovs_interfaceid": "e91b8148-e2ff-4124-9799-ba4efae837ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 12:19:00 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-b96ed7d2-c052-4d09-8be2-5435c212561d tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Converting VIF {"id": "e91b8148-e2ff-4124-9799-ba4efae837ff", "address": "fa:16:3e:40:35:d4", "network": {"id": "c03e854d-75a3-4e81-9cdf-f1139841266c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1632999031-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c216dd7629274eafbf0a5968ff2378a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape91b8148-e2", "ovs_interfaceid": "e91b8148-e2ff-4124-9799-ba4efae837ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:19:00 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-b96ed7d2-c052-4d09-8be2-5435c212561d tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:35:d4,bridge_name='br-int',has_traffic_filtering=True,id=e91b8148-e2ff-4124-9799-ba4efae837ff,network=Network(c03e854d-75a3-4e81-9cdf-f1139841266c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape91b8148-e2') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:19:00 user nova-compute[74960]: DEBUG os_vif [None req-b96ed7d2-c052-4d09-8be2-5435c212561d tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:35:d4,bridge_name='br-int',has_traffic_filtering=True,id=e91b8148-e2ff-4124-9799-ba4efae837ff,network=Network(c03e854d-75a3-4e81-9cdf-f1139841266c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape91b8148-e2') {{(pid=74960) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 12:19:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:19:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape91b8148-e2, bridge=br-int, if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:19:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:19:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:19:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:19:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=17457a02-8e72-4592-b7b2-9ffa553f2004) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:19:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:19:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:19:00 user nova-compute[74960]: INFO os_vif [None req-b96ed7d2-c052-4d09-8be2-5435c212561d tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:35:d4,bridge_name='br-int',has_traffic_filtering=True,id=e91b8148-e2ff-4124-9799-ba4efae837ff,network=Network(c03e854d-75a3-4e81-9cdf-f1139841266c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape91b8148-e2')
Nov 03 12:19:00 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-b96ed7d2-c052-4d09-8be2-5435c212561d tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Deleting instance files /opt/stack/data/nova/instances/7e5ec97f-80c4-4499-94bf-2584fc0eae03_del
Nov 03 12:19:00 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-b96ed7d2-c052-4d09-8be2-5435c212561d tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Deletion of /opt/stack/data/nova/instances/7e5ec97f-80c4-4499-94bf-2584fc0eae03_del complete
Nov 03 12:19:00 user nova-compute[74960]: DEBUG nova.compute.manager [req-ce53c84c-4d55-46a1-af02-fc079f371cf7 req-ac603024-9ddd-4b9d-865b-e4796c434b44 service nova] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Received event network-changed-e91b8148-e2ff-4124-9799-ba4efae837ff {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:19:00 user nova-compute[74960]: DEBUG nova.compute.manager [req-ce53c84c-4d55-46a1-af02-fc079f371cf7 req-ac603024-9ddd-4b9d-865b-e4796c434b44 service nova] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Refreshing instance network info cache due to event network-changed-e91b8148-e2ff-4124-9799-ba4efae837ff. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 12:19:00 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-ce53c84c-4d55-46a1-af02-fc079f371cf7 req-ac603024-9ddd-4b9d-865b-e4796c434b44 service nova] Acquiring lock "refresh_cache-7e5ec97f-80c4-4499-94bf-2584fc0eae03" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:19:00 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-ce53c84c-4d55-46a1-af02-fc079f371cf7 req-ac603024-9ddd-4b9d-865b-e4796c434b44 service nova] Acquired lock "refresh_cache-7e5ec97f-80c4-4499-94bf-2584fc0eae03" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:19:00 user nova-compute[74960]: DEBUG nova.network.neutron [req-ce53c84c-4d55-46a1-af02-fc079f371cf7 req-ac603024-9ddd-4b9d-865b-e4796c434b44 service nova] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Refreshing network info cache for port e91b8148-e2ff-4124-9799-ba4efae837ff {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 12:19:00 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-b96ed7d2-c052-4d09-8be2-5435c212561d tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Checking UEFI support for host arch (x86_64) {{(pid=74960) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Nov 03 12:19:00 user nova-compute[74960]: INFO nova.virt.libvirt.host [None req-b96ed7d2-c052-4d09-8be2-5435c212561d tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] UEFI support detected
Nov 03 12:19:00 user nova-compute[74960]: INFO nova.scheduler.client.report [None req-b96ed7d2-c052-4d09-8be2-5435c212561d tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Deleted allocations for instance 7e5ec97f-80c4-4499-94bf-2584fc0eae03
Nov 03 12:19:00 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-b96ed7d2-c052-4d09-8be2-5435c212561d tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:19:00 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-b96ed7d2-c052-4d09-8be2-5435c212561d tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:19:00 user nova-compute[74960]: DEBUG nova.objects.instance [None req-b96ed7d2-c052-4d09-8be2-5435c212561d tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Lazy-loading 'numa_topology' on Instance uuid 7e5ec97f-80c4-4499-94bf-2584fc0eae03 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:19:00 user nova-compute[74960]: DEBUG nova.objects.base [None req-b96ed7d2-c052-4d09-8be2-5435c212561d tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Object Instance<7e5ec97f-80c4-4499-94bf-2584fc0eae03> lazy-loaded attributes: resources,numa_topology {{(pid=74960) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 12:19:00 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-b96ed7d2-c052-4d09-8be2-5435c212561d tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:19:00 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-b96ed7d2-c052-4d09-8be2-5435c212561d tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:19:00 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-b96ed7d2-c052-4d09-8be2-5435c212561d tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.461s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:19:00 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-b96ed7d2-c052-4d09-8be2-5435c212561d tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Lock "7e5ec97f-80c4-4499-94bf-2584fc0eae03" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 8.549s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:19:00 user nova-compute[74960]: DEBUG nova.network.neutron [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04] Successfully created port: 6539aa0d-9ed3-4e04-8315-103d26c7403f {{(pid=74960) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 12:19:01 user nova-compute[74960]: DEBUG nova.network.neutron [req-ce53c84c-4d55-46a1-af02-fc079f371cf7 req-ac603024-9ddd-4b9d-865b-e4796c434b44 service nova] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Updated VIF entry in instance network info cache for port e91b8148-e2ff-4124-9799-ba4efae837ff. {{(pid=74960) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 12:19:01 user nova-compute[74960]: DEBUG nova.network.neutron [req-ce53c84c-4d55-46a1-af02-fc079f371cf7 req-ac603024-9ddd-4b9d-865b-e4796c434b44 service nova] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Updating instance_info_cache with network_info: [{"id": "e91b8148-e2ff-4124-9799-ba4efae837ff", "address": "fa:16:3e:40:35:d4", "network": {"id": "c03e854d-75a3-4e81-9cdf-f1139841266c", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1632999031-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c216dd7629274eafbf0a5968ff2378a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tape91b8148-e2", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:19:01 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-ce53c84c-4d55-46a1-af02-fc079f371cf7 req-ac603024-9ddd-4b9d-865b-e4796c434b44 service nova] Releasing lock "refresh_cache-7e5ec97f-80c4-4499-94bf-2584fc0eae03" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:19:01 user nova-compute[74960]: DEBUG nova.network.neutron [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04] Successfully updated port: 2fa8f636-7161-4db6-83bf-7e4c9eff4c67 {{(pid=74960) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 12:19:02 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-8da754b6-f6b3-430c-9b97-fd62123ab4f3 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Acquiring lock "e91dfcf4-caef-43d0-a56b-b1282363d4e0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:19:02 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-8da754b6-f6b3-430c-9b97-fd62123ab4f3 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Lock "e91dfcf4-caef-43d0-a56b-b1282363d4e0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:19:02 user nova-compute[74960]: DEBUG nova.objects.instance [None req-8da754b6-f6b3-430c-9b97-fd62123ab4f3 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Lazy-loading 'flavor' on Instance uuid e91dfcf4-caef-43d0-a56b-b1282363d4e0 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:19:02 user nova-compute[74960]: DEBUG nova.compute.manager [req-06a47334-8620-454e-94ff-65c58a040afe req-1badacc3-854c-4968-b936-d1cc6eced1d0 service nova] [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04] Received event network-changed-2fa8f636-7161-4db6-83bf-7e4c9eff4c67 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:19:02 user nova-compute[74960]: DEBUG nova.compute.manager [req-06a47334-8620-454e-94ff-65c58a040afe req-1badacc3-854c-4968-b936-d1cc6eced1d0 service nova] [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04] Refreshing instance network info cache due to event network-changed-2fa8f636-7161-4db6-83bf-7e4c9eff4c67. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 12:19:02 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-06a47334-8620-454e-94ff-65c58a040afe req-1badacc3-854c-4968-b936-d1cc6eced1d0 service nova] Acquiring lock "refresh_cache-ac9e1b20-2482-4c71-b54b-5d6cb8187d04" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:19:02 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-06a47334-8620-454e-94ff-65c58a040afe req-1badacc3-854c-4968-b936-d1cc6eced1d0 service nova] Acquired lock "refresh_cache-ac9e1b20-2482-4c71-b54b-5d6cb8187d04" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:19:02 user nova-compute[74960]: DEBUG nova.network.neutron [req-06a47334-8620-454e-94ff-65c58a040afe req-1badacc3-854c-4968-b936-d1cc6eced1d0 service nova] [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04] Refreshing network info cache for port 2fa8f636-7161-4db6-83bf-7e4c9eff4c67 {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 12:19:02 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-8da754b6-f6b3-430c-9b97-fd62123ab4f3 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Lock "e91dfcf4-caef-43d0-a56b-b1282363d4e0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.110s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:19:02 user nova-compute[74960]: DEBUG nova.network.neutron [req-06a47334-8620-454e-94ff-65c58a040afe req-1badacc3-854c-4968-b936-d1cc6eced1d0 service nova] [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04] Instance cache missing network info. {{(pid=74960) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 12:19:02 user nova-compute[74960]: DEBUG nova.network.neutron [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04] Successfully updated port: e95cf873-cdaf-4aa9-8e6d-1c2d2ad4c6a8 {{(pid=74960) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 12:19:02 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:19:02 user nova-compute[74960]: DEBUG nova.network.neutron [req-06a47334-8620-454e-94ff-65c58a040afe req-1badacc3-854c-4968-b936-d1cc6eced1d0 service nova] [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04] Updating instance_info_cache with network_info: [] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:19:02 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-06a47334-8620-454e-94ff-65c58a040afe req-1badacc3-854c-4968-b936-d1cc6eced1d0 service nova] Releasing lock "refresh_cache-ac9e1b20-2482-4c71-b54b-5d6cb8187d04" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:19:02 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-8da754b6-f6b3-430c-9b97-fd62123ab4f3 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Acquiring lock "e91dfcf4-caef-43d0-a56b-b1282363d4e0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:19:02 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-8da754b6-f6b3-430c-9b97-fd62123ab4f3 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Lock "e91dfcf4-caef-43d0-a56b-b1282363d4e0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:19:02 user nova-compute[74960]: INFO nova.compute.manager [None req-8da754b6-f6b3-430c-9b97-fd62123ab4f3 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] [instance: e91dfcf4-caef-43d0-a56b-b1282363d4e0] Attaching volume 20d9e4ca-e4a0-404c-93a8-783525cbf863 to /dev/vdb
Nov 03 12:19:02 user nova-compute[74960]: DEBUG os_brick.utils [None req-8da754b6-f6b3-430c-9b97-fd62123ab4f3 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:19:02 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:19:02 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:19:02 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[91d0f7c2-82fb-47ad-9570-4bd01cc8661e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:75b8e219756\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:19:02 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:19:02 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:19:02 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[649fb582-9352-48dd-858f-99555252e229]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:19:02 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:19:02 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:19:02 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[2970d186-6400-4d60-ab18-202c5bca1498]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:19:02 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ad00edd-f452-46be-a1bc-cb6618592cb2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:19:02 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-8da754b6-f6b3-430c-9b97-fd62123ab4f3 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Running cmd (subprocess): nvme version {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:19:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-8da754b6-f6b3-430c-9b97-fd62123ab4f3 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] 'nvme version' failed. Not Retrying. {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 12:19:03 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8da754b6-f6b3-430c-9b97-fd62123ab4f3 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] nvme not present on system {{(pid=74960) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 12:19:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:19:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 12:19:03 user nova-compute[74960]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 12:19:03 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c7108eb-0e3c-4d08-b7b2-4b5c226816f4]: (4, '') {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:19:03 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-8da754b6-f6b3-430c-9b97-fd62123ab4f3 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74960) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 12:19:03 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-8da754b6-f6b3-430c-9b97-fd62123ab4f3 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74960) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 12:19:03 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-8da754b6-f6b3-430c-9b97-fd62123ab4f3 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] LIGHTOS: no hostnqn found. {{(pid=74960) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 12:19:03 user nova-compute[74960]: DEBUG os_brick.utils [None req-8da754b6-f6b3-430c-9b97-fd62123ab4f3 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:75b8e219756', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:19:03 user nova-compute[74960]: DEBUG nova.virt.block_device [None req-8da754b6-f6b3-430c-9b97-fd62123ab4f3 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] [instance: e91dfcf4-caef-43d0-a56b-b1282363d4e0] Updating existing volume attachment record: b2003a34-f9cf-423d-b05c-8e7c7c343eed {{(pid=74960) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 12:19:03 user nova-compute[74960]: DEBUG nova.network.neutron [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04] Successfully updated port: 1d83fe31-117e-49b5-a073-1c8dec48fd1f {{(pid=74960) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 12:19:04 user nova-compute[74960]: DEBUG nova.network.neutron [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04] Successfully updated port: d6c585b8-ece6-4656-b33e-14e40d9515c5 {{(pid=74960) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 12:19:04 user nova-compute[74960]: DEBUG nova.compute.manager [req-d0e198ca-4d3e-4b02-9780-28c8acb0d95f req-e685f3c3-fe26-444e-963d-a2329ac2f46a service nova] [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04] Received event network-changed-e95cf873-cdaf-4aa9-8e6d-1c2d2ad4c6a8 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:19:04 user nova-compute[74960]: DEBUG nova.compute.manager [req-d0e198ca-4d3e-4b02-9780-28c8acb0d95f req-e685f3c3-fe26-444e-963d-a2329ac2f46a service nova] [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04] Refreshing instance network info cache due to event network-changed-e95cf873-cdaf-4aa9-8e6d-1c2d2ad4c6a8. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 12:19:04 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-d0e198ca-4d3e-4b02-9780-28c8acb0d95f req-e685f3c3-fe26-444e-963d-a2329ac2f46a service nova] Acquiring lock "refresh_cache-ac9e1b20-2482-4c71-b54b-5d6cb8187d04" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:19:04 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-d0e198ca-4d3e-4b02-9780-28c8acb0d95f req-e685f3c3-fe26-444e-963d-a2329ac2f46a service nova] Acquired lock "refresh_cache-ac9e1b20-2482-4c71-b54b-5d6cb8187d04" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:19:04 user nova-compute[74960]: DEBUG nova.network.neutron [req-d0e198ca-4d3e-4b02-9780-28c8acb0d95f req-e685f3c3-fe26-444e-963d-a2329ac2f46a service nova] [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04] Refreshing network info cache for port e95cf873-cdaf-4aa9-8e6d-1c2d2ad4c6a8 {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 12:19:04 user nova-compute[74960]: DEBUG nova.network.neutron [req-d0e198ca-4d3e-4b02-9780-28c8acb0d95f req-e685f3c3-fe26-444e-963d-a2329ac2f46a service nova] [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04] Instance cache missing network info. {{(pid=74960) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 12:19:05 user nova-compute[74960]: DEBUG nova.network.neutron [req-d0e198ca-4d3e-4b02-9780-28c8acb0d95f req-e685f3c3-fe26-444e-963d-a2329ac2f46a service nova] [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04] Updating instance_info_cache with network_info: [] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:19:05 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-d0e198ca-4d3e-4b02-9780-28c8acb0d95f req-e685f3c3-fe26-444e-963d-a2329ac2f46a service nova] Releasing lock "refresh_cache-ac9e1b20-2482-4c71-b54b-5d6cb8187d04" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:19:05 user nova-compute[74960]: DEBUG nova.compute.manager [req-d0e198ca-4d3e-4b02-9780-28c8acb0d95f req-e685f3c3-fe26-444e-963d-a2329ac2f46a service nova] [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04] Received event network-changed-1d83fe31-117e-49b5-a073-1c8dec48fd1f {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:19:05 user nova-compute[74960]: DEBUG nova.compute.manager [req-d0e198ca-4d3e-4b02-9780-28c8acb0d95f req-e685f3c3-fe26-444e-963d-a2329ac2f46a service nova] [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04] Refreshing instance network info cache due to event network-changed-1d83fe31-117e-49b5-a073-1c8dec48fd1f. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 12:19:05 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-d0e198ca-4d3e-4b02-9780-28c8acb0d95f req-e685f3c3-fe26-444e-963d-a2329ac2f46a service nova] Acquiring lock "refresh_cache-ac9e1b20-2482-4c71-b54b-5d6cb8187d04" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:19:05 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-d0e198ca-4d3e-4b02-9780-28c8acb0d95f req-e685f3c3-fe26-444e-963d-a2329ac2f46a service nova] Acquired lock "refresh_cache-ac9e1b20-2482-4c71-b54b-5d6cb8187d04" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:19:05 user nova-compute[74960]: DEBUG nova.network.neutron [req-d0e198ca-4d3e-4b02-9780-28c8acb0d95f req-e685f3c3-fe26-444e-963d-a2329ac2f46a service nova] [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04] Refreshing network info cache for port 1d83fe31-117e-49b5-a073-1c8dec48fd1f {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 12:19:05 user nova-compute[74960]: DEBUG nova.network.neutron [req-d0e198ca-4d3e-4b02-9780-28c8acb0d95f req-e685f3c3-fe26-444e-963d-a2329ac2f46a service nova] [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04] Instance cache missing network info. {{(pid=74960) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 12:19:05 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:19:05 user nova-compute[74960]: DEBUG nova.network.neutron [req-d0e198ca-4d3e-4b02-9780-28c8acb0d95f req-e685f3c3-fe26-444e-963d-a2329ac2f46a service nova] [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04] Updating instance_info_cache with network_info: [] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:19:05 user nova-compute[74960]: DEBUG nova.network.neutron [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04] Successfully updated port: 95a7c7bc-d60c-491f-b049-f2abd6a57647 {{(pid=74960) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 12:19:05 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-d0e198ca-4d3e-4b02-9780-28c8acb0d95f req-e685f3c3-fe26-444e-963d-a2329ac2f46a service nova] Releasing lock "refresh_cache-ac9e1b20-2482-4c71-b54b-5d6cb8187d04" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:19:05 user nova-compute[74960]: DEBUG nova.compute.manager [req-d0e198ca-4d3e-4b02-9780-28c8acb0d95f req-e685f3c3-fe26-444e-963d-a2329ac2f46a service nova] [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04] Received event network-changed-d6c585b8-ece6-4656-b33e-14e40d9515c5 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:19:05 user nova-compute[74960]: DEBUG nova.compute.manager [req-d0e198ca-4d3e-4b02-9780-28c8acb0d95f req-e685f3c3-fe26-444e-963d-a2329ac2f46a service nova] [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04] Refreshing instance network info cache due to event network-changed-d6c585b8-ece6-4656-b33e-14e40d9515c5. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 12:19:05 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-d0e198ca-4d3e-4b02-9780-28c8acb0d95f req-e685f3c3-fe26-444e-963d-a2329ac2f46a service nova] Acquiring lock "refresh_cache-ac9e1b20-2482-4c71-b54b-5d6cb8187d04" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:19:05 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-d0e198ca-4d3e-4b02-9780-28c8acb0d95f req-e685f3c3-fe26-444e-963d-a2329ac2f46a service nova] Acquired lock "refresh_cache-ac9e1b20-2482-4c71-b54b-5d6cb8187d04" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:19:05 user nova-compute[74960]: DEBUG nova.network.neutron [req-d0e198ca-4d3e-4b02-9780-28c8acb0d95f req-e685f3c3-fe26-444e-963d-a2329ac2f46a service nova] [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04] Refreshing network info cache for port d6c585b8-ece6-4656-b33e-14e40d9515c5 {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 12:19:05 user nova-compute[74960]: DEBUG nova.network.neutron [req-d0e198ca-4d3e-4b02-9780-28c8acb0d95f req-e685f3c3-fe26-444e-963d-a2329ac2f46a service nova] [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04] Instance cache missing network info. {{(pid=74960) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 12:19:05 user nova-compute[74960]: DEBUG nova.network.neutron [req-d0e198ca-4d3e-4b02-9780-28c8acb0d95f req-e685f3c3-fe26-444e-963d-a2329ac2f46a service nova] [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04] Updating instance_info_cache with network_info: [] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:19:05 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-d0e198ca-4d3e-4b02-9780-28c8acb0d95f req-e685f3c3-fe26-444e-963d-a2329ac2f46a service nova] Releasing lock "refresh_cache-ac9e1b20-2482-4c71-b54b-5d6cb8187d04" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:19:06 user nova-compute[74960]: DEBUG nova.network.neutron [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04] Successfully updated port: e86f5236-dc27-4330-90a5-b8f8a8d669bd {{(pid=74960) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 12:19:06 user nova-compute[74960]: DEBUG nova.compute.manager [req-977e5ebd-537d-460d-a955-14b5920150d5 req-bc378c62-d87c-47b1-8ff8-143ae63c2b1e service nova] [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04] Received event network-changed-95a7c7bc-d60c-491f-b049-f2abd6a57647 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:19:06 user nova-compute[74960]: DEBUG nova.compute.manager [req-977e5ebd-537d-460d-a955-14b5920150d5 req-bc378c62-d87c-47b1-8ff8-143ae63c2b1e service nova] [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04] Refreshing instance network info cache due to event network-changed-95a7c7bc-d60c-491f-b049-f2abd6a57647. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 12:19:06 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-977e5ebd-537d-460d-a955-14b5920150d5 req-bc378c62-d87c-47b1-8ff8-143ae63c2b1e service nova] Acquiring lock "refresh_cache-ac9e1b20-2482-4c71-b54b-5d6cb8187d04" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:19:06 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-977e5ebd-537d-460d-a955-14b5920150d5 req-bc378c62-d87c-47b1-8ff8-143ae63c2b1e service nova] Acquired lock "refresh_cache-ac9e1b20-2482-4c71-b54b-5d6cb8187d04" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:19:06 user nova-compute[74960]: DEBUG nova.network.neutron [req-977e5ebd-537d-460d-a955-14b5920150d5 req-bc378c62-d87c-47b1-8ff8-143ae63c2b1e service nova] [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04] Refreshing network info cache for port 95a7c7bc-d60c-491f-b049-f2abd6a57647 {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 12:19:06 user nova-compute[74960]: DEBUG nova.network.neutron [req-977e5ebd-537d-460d-a955-14b5920150d5 req-bc378c62-d87c-47b1-8ff8-143ae63c2b1e service nova] [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04] Instance cache missing network info. {{(pid=74960) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 12:19:06 user nova-compute[74960]: DEBUG nova.network.neutron [req-977e5ebd-537d-460d-a955-14b5920150d5 req-bc378c62-d87c-47b1-8ff8-143ae63c2b1e service nova] [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04] Updating instance_info_cache with network_info: [] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:19:06 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-977e5ebd-537d-460d-a955-14b5920150d5 req-bc378c62-d87c-47b1-8ff8-143ae63c2b1e service nova] Releasing lock "refresh_cache-ac9e1b20-2482-4c71-b54b-5d6cb8187d04" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:19:06 user nova-compute[74960]: DEBUG nova.compute.manager [req-977e5ebd-537d-460d-a955-14b5920150d5 req-bc378c62-d87c-47b1-8ff8-143ae63c2b1e service nova] [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04] Received event network-changed-e86f5236-dc27-4330-90a5-b8f8a8d669bd {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:19:06 user nova-compute[74960]: DEBUG nova.compute.manager [req-977e5ebd-537d-460d-a955-14b5920150d5 req-bc378c62-d87c-47b1-8ff8-143ae63c2b1e service nova] [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04] Refreshing instance network info cache due to event network-changed-e86f5236-dc27-4330-90a5-b8f8a8d669bd. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 12:19:06 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-977e5ebd-537d-460d-a955-14b5920150d5 req-bc378c62-d87c-47b1-8ff8-143ae63c2b1e service nova] Acquiring lock "refresh_cache-ac9e1b20-2482-4c71-b54b-5d6cb8187d04" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:19:06 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-977e5ebd-537d-460d-a955-14b5920150d5 req-bc378c62-d87c-47b1-8ff8-143ae63c2b1e service nova] Acquired lock "refresh_cache-ac9e1b20-2482-4c71-b54b-5d6cb8187d04" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:19:06 user nova-compute[74960]: DEBUG nova.network.neutron [req-977e5ebd-537d-460d-a955-14b5920150d5 req-bc378c62-d87c-47b1-8ff8-143ae63c2b1e service nova] [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04] Refreshing network info cache for port e86f5236-dc27-4330-90a5-b8f8a8d669bd {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 12:19:06 user nova-compute[74960]: DEBUG nova.network.neutron [req-977e5ebd-537d-460d-a955-14b5920150d5 req-bc378c62-d87c-47b1-8ff8-143ae63c2b1e service nova] [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04] Instance cache missing network info. {{(pid=74960) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 12:19:07 user nova-compute[74960]: DEBUG nova.network.neutron [req-977e5ebd-537d-460d-a955-14b5920150d5 req-bc378c62-d87c-47b1-8ff8-143ae63c2b1e service nova] [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04] Updating instance_info_cache with network_info: [] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:19:07 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-977e5ebd-537d-460d-a955-14b5920150d5 req-bc378c62-d87c-47b1-8ff8-143ae63c2b1e service nova] Releasing lock "refresh_cache-ac9e1b20-2482-4c71-b54b-5d6cb8187d04" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:19:07 user nova-compute[74960]: DEBUG nova.network.neutron [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04] Successfully updated port: 6539aa0d-9ed3-4e04-8315-103d26c7403f {{(pid=74960) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 12:19:07 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] Acquiring lock "refresh_cache-ac9e1b20-2482-4c71-b54b-5d6cb8187d04" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:19:07 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] Acquired lock "refresh_cache-ac9e1b20-2482-4c71-b54b-5d6cb8187d04" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:19:07 user nova-compute[74960]: DEBUG nova.network.neutron [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04] Building network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 12:19:07 user nova-compute[74960]: DEBUG nova.network.neutron [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04] Instance cache missing network info. {{(pid=74960) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 12:19:07 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:19:08 user nova-compute[74960]: DEBUG nova.compute.manager [req-0a7fe8cb-74ad-4e67-9150-c05245b68439 req-766e9ee6-24ff-4040-9c20-22e6d711a6d1 service nova] [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04] Received event network-changed-6539aa0d-9ed3-4e04-8315-103d26c7403f {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:19:08 user nova-compute[74960]: DEBUG nova.compute.manager [req-0a7fe8cb-74ad-4e67-9150-c05245b68439 req-766e9ee6-24ff-4040-9c20-22e6d711a6d1 service nova] [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04] Refreshing instance network info cache due to event network-changed-6539aa0d-9ed3-4e04-8315-103d26c7403f. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 12:19:08 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-0a7fe8cb-74ad-4e67-9150-c05245b68439 req-766e9ee6-24ff-4040-9c20-22e6d711a6d1 service nova] Acquiring lock "refresh_cache-ac9e1b20-2482-4c71-b54b-5d6cb8187d04" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:19:08 user nova-compute[74960]: DEBUG nova.compute.manager [req-ac53554c-e346-481a-9a27-bf22fdd5be6e req-f6b54a94-510a-4b4f-b04f-93ddb5bd770a service nova] [instance: 8381c969-6a2d-4934-aadd-660ffa246b05] Received event network-changed-df5604b7-7f5b-4738-b218-0016b4441542 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:19:08 user nova-compute[74960]: DEBUG nova.compute.manager [req-ac53554c-e346-481a-9a27-bf22fdd5be6e req-f6b54a94-510a-4b4f-b04f-93ddb5bd770a service nova] [instance: 8381c969-6a2d-4934-aadd-660ffa246b05] Refreshing instance network info cache due to event network-changed-df5604b7-7f5b-4738-b218-0016b4441542. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 12:19:08 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-ac53554c-e346-481a-9a27-bf22fdd5be6e req-f6b54a94-510a-4b4f-b04f-93ddb5bd770a service nova] Acquiring lock "refresh_cache-8381c969-6a2d-4934-aadd-660ffa246b05" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:19:08 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-ac53554c-e346-481a-9a27-bf22fdd5be6e req-f6b54a94-510a-4b4f-b04f-93ddb5bd770a service nova] Acquired lock "refresh_cache-8381c969-6a2d-4934-aadd-660ffa246b05" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:19:08 user nova-compute[74960]: DEBUG nova.network.neutron [req-ac53554c-e346-481a-9a27-bf22fdd5be6e req-f6b54a94-510a-4b4f-b04f-93ddb5bd770a service nova] [instance: 8381c969-6a2d-4934-aadd-660ffa246b05] Refreshing network info cache for port df5604b7-7f5b-4738-b218-0016b4441542 {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 12:19:09 user nova-compute[74960]: DEBUG nova.compute.manager [req-5b6c8755-7ff1-4854-93fa-e107d041f63c req-5558d5bf-6b66-4474-824a-9a2501a4cc87 service nova] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] Received event network-changed-3e126a57-0883-4997-9c99-d25c9c6fc102 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:19:09 user nova-compute[74960]: DEBUG nova.compute.manager [req-5b6c8755-7ff1-4854-93fa-e107d041f63c req-5558d5bf-6b66-4474-824a-9a2501a4cc87 service nova] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] Refreshing instance network info cache due to event network-changed-3e126a57-0883-4997-9c99-d25c9c6fc102. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 12:19:09 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-5b6c8755-7ff1-4854-93fa-e107d041f63c req-5558d5bf-6b66-4474-824a-9a2501a4cc87 service nova] Acquiring lock "refresh_cache-0a520c41-19c0-47ba-ada8-023ee9c12ca6" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:19:09 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-5b6c8755-7ff1-4854-93fa-e107d041f63c req-5558d5bf-6b66-4474-824a-9a2501a4cc87 service nova] Acquired lock "refresh_cache-0a520c41-19c0-47ba-ada8-023ee9c12ca6" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:19:09 user nova-compute[74960]: DEBUG nova.network.neutron [req-5b6c8755-7ff1-4854-93fa-e107d041f63c req-5558d5bf-6b66-4474-824a-9a2501a4cc87 service nova] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] Refreshing network info cache for port 3e126a57-0883-4997-9c99-d25c9c6fc102 {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 12:19:09 user nova-compute[74960]: DEBUG nova.network.neutron [req-5b6c8755-7ff1-4854-93fa-e107d041f63c req-5558d5bf-6b66-4474-824a-9a2501a4cc87 service nova] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] Updated VIF entry in instance network info cache for port 3e126a57-0883-4997-9c99-d25c9c6fc102. {{(pid=74960) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 12:19:09 user nova-compute[74960]: DEBUG nova.network.neutron [req-5b6c8755-7ff1-4854-93fa-e107d041f63c req-5558d5bf-6b66-4474-824a-9a2501a4cc87 service nova] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] Updating instance_info_cache with network_info: [{"id": "3e126a57-0883-4997-9c99-d25c9c6fc102", "address": "fa:16:3e:f9:07:9b", "network": {"id": "65e1589f-341c-4cc8-a8e6-5b61544daf55", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1130686752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3390632661124edd9894dabac0053fa9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e126a57-08", "ovs_interfaceid": "3e126a57-0883-4997-9c99-d25c9c6fc102", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:19:09 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-5b6c8755-7ff1-4854-93fa-e107d041f63c req-5558d5bf-6b66-4474-824a-9a2501a4cc87 service nova] Releasing lock "refresh_cache-0a520c41-19c0-47ba-ada8-023ee9c12ca6" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:19:09 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-8f8e7aa7-5c24-44d2-9a4d-8fae2fe3c7ab tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Acquiring lock "interface-0a520c41-19c0-47ba-ada8-023ee9c12ca6-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:19:09 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-8f8e7aa7-5c24-44d2-9a4d-8fae2fe3c7ab tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Lock "interface-0a520c41-19c0-47ba-ada8-023ee9c12ca6-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:19:09 user nova-compute[74960]: DEBUG nova.objects.instance [None req-8f8e7aa7-5c24-44d2-9a4d-8fae2fe3c7ab tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Lazy-loading 'flavor' on Instance uuid 0a520c41-19c0-47ba-ada8-023ee9c12ca6 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:19:09 user nova-compute[74960]: DEBUG nova.objects.instance [None req-8f8e7aa7-5c24-44d2-9a4d-8fae2fe3c7ab tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Lazy-loading 'pci_requests' on Instance uuid 0a520c41-19c0-47ba-ada8-023ee9c12ca6 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:19:09 user nova-compute[74960]: DEBUG nova.network.neutron [req-ac53554c-e346-481a-9a27-bf22fdd5be6e req-f6b54a94-510a-4b4f-b04f-93ddb5bd770a service nova] [instance: 8381c969-6a2d-4934-aadd-660ffa246b05] Updated VIF entry in instance network info cache for port df5604b7-7f5b-4738-b218-0016b4441542. {{(pid=74960) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 12:19:09 user nova-compute[74960]: DEBUG nova.network.neutron [req-ac53554c-e346-481a-9a27-bf22fdd5be6e req-f6b54a94-510a-4b4f-b04f-93ddb5bd770a service nova] [instance: 8381c969-6a2d-4934-aadd-660ffa246b05] Updating instance_info_cache with network_info: [{"id": "df5604b7-7f5b-4738-b218-0016b4441542", "address": "fa:16:3e:8c:e9:c2", "network": {"id": "148a1e23-c4e0-4ea4-98e4-443552dd8f70", "bridge": "br-int", "label": "tempest-TestVolumeSwap-874596856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5477a0b396d64025bfc321100dd29041", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf5604b7-7f", "ovs_interfaceid": "df5604b7-7f5b-4738-b218-0016b4441542", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:19:09 user nova-compute[74960]: DEBUG nova.objects.base [None req-8f8e7aa7-5c24-44d2-9a4d-8fae2fe3c7ab tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Object Instance<0a520c41-19c0-47ba-ada8-023ee9c12ca6> lazy-loaded attributes: flavor,pci_requests {{(pid=74960) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 12:19:09 user nova-compute[74960]: DEBUG nova.network.neutron [None req-8f8e7aa7-5c24-44d2-9a4d-8fae2fe3c7ab tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] allocate_for_instance() {{(pid=74960) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 12:19:09 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-ac53554c-e346-481a-9a27-bf22fdd5be6e req-f6b54a94-510a-4b4f-b04f-93ddb5bd770a service nova] Releasing lock "refresh_cache-8381c969-6a2d-4934-aadd-660ffa246b05" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:19:09 user nova-compute[74960]: DEBUG nova.policy [None req-8f8e7aa7-5c24-44d2-9a4d-8fae2fe3c7ab tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9da58bde19c3434f9811cb80ed39dea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3390632661124edd9894dabac0053fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74960) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 12:19:10 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:19:10 user nova-compute[74960]: DEBUG nova.network.neutron [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04] Updating instance_info_cache with network_info: [{"id": "2fa8f636-7161-4db6-83bf-7e4c9eff4c67", "address": "fa:16:3e:09:9c:5a", "network": {"id": "a22b4dee-2e5f-4184-87ba-146395c5bc2c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-820777923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "602dab4996a7422cb9bf5aff46e0fee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fa8f636-71", "ovs_interfaceid": "2fa8f636-7161-4db6-83bf-7e4c9eff4c67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e95cf873-cdaf-4aa9-8e6d-1c2d2ad4c6a8", "address": "fa:16:3e:b2:0d:16", "network": {"id": "5d680571-15f7-44de-bdac-ca3a8ab46ace", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354419557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "602dab4996a7422cb9bf5aff46e0fee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape95cf873-cd", "ovs_interfaceid": "e95cf873-cdaf-4aa9-8e6d-1c2d2ad4c6a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1d83fe31-117e-49b5-a073-1c8dec48fd1f", "address": "fa:16:3e:2e:1b:71", "network": {"id": "5d680571-15f7-44de-bdac-ca3a8ab46ace", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354419557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "602dab4996a7422cb9bf5aff46e0fee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d83fe31-11", "ovs_interfaceid": "1d83fe31-117e-49b5-a073-1c8dec48fd1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d6c585b8-ece6-4656-b33e-14e40d9515c5", "address": "fa:16:3e:ff:da:5b", "network": {"id": "5d680571-15f7-44de-bdac-ca3a8ab46ace", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354419557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "602dab4996a7422cb9bf5aff46e0fee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6c585b8-ec", "ovs_interfaceid": "d6c585b8-ece6-4656-b33e-14e40d9515c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "95a7c7bc-d60c-491f-b049-f2abd6a57647", "address": "fa:16:3e:36:14:0f", "network": {"id": "5d680571-15f7-44de-bdac-ca3a8ab46ace", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354419557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "602dab4996a7422cb9bf5aff46e0fee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95a7c7bc-d6", "ovs_interfaceid": "95a7c7bc-d60c-491f-b049-f2abd6a57647", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e86f5236-dc27-4330-90a5-b8f8a8d669bd", "address": "fa:16:3e:40:a0:dc", "network": {"id": "ea165e0d-d1d5-4541-a2c8-5f0f788c7b33", "bridge": "br-int", "label": "tempest-device-tagging-net2-2028572952", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "602dab4996a7422cb9bf5aff46e0fee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape86f5236-dc", "ovs_interfaceid": "e86f5236-dc27-4330-90a5-b8f8a8d669bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6539aa0d-9ed3-4e04-8315-103d26c7403f", "address": "fa:16:3e:04:05:d3", "network": {"id": "ea165e0d-d1d5-4541-a2c8-5f0f788c7b33", "bridge": "br-int", "label": "tempest-device-tagging-net2-2028572952", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "602dab4996a7422cb9bf5aff46e0fee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6539aa0d-9e", "ovs_interfaceid": "6539aa0d-9ed3-4e04-8315-103d26c7403f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:19:10 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] Releasing lock "refresh_cache-ac9e1b20-2482-4c71-b54b-5d6cb8187d04" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:19:10 user nova-compute[74960]: DEBUG nova.compute.manager [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04] Instance network_info: |[{"id": "2fa8f636-7161-4db6-83bf-7e4c9eff4c67", "address": "fa:16:3e:09:9c:5a", "network": {"id": "a22b4dee-2e5f-4184-87ba-146395c5bc2c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-820777923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "602dab4996a7422cb9bf5aff46e0fee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fa8f636-71", "ovs_interfaceid": "2fa8f636-7161-4db6-83bf-7e4c9eff4c67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e95cf873-cdaf-4aa9-8e6d-1c2d2ad4c6a8", "address": "fa:16:3e:b2:0d:16", "network": {"id": "5d680571-15f7-44de-bdac-ca3a8ab46ace", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354419557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "602dab4996a7422cb9bf5aff46e0fee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape95cf873-cd", "ovs_interfaceid": "e95cf873-cdaf-4aa9-8e6d-1c2d2ad4c6a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1d83fe31-117e-49b5-a073-1c8dec48fd1f", "address": "fa:16:3e:2e:1b:71", "network": {"id": "5d680571-15f7-44de-bdac-ca3a8ab46ace", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354419557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "602dab4996a7422cb9bf5aff46e0fee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d83fe31-11", "ovs_interfaceid": "1d83fe31-117e-49b5-a073-1c8dec48fd1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d6c585b8-ece6-4656-b33e-14e40d9515c5", "address": "fa:16:3e:ff:da:5b", "network": {"id": "5d680571-15f7-44de-bdac-ca3a8ab46ace", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354419557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "602dab4996a7422cb9bf5aff46e0fee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6c585b8-ec", "ovs_interfaceid": "d6c585b8-ece6-4656-b33e-14e40d9515c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "95a7c7bc-d60c-491f-b049-f2abd6a57647", "address": "fa:16:3e:36:14:0f", "network": {"id": "5d680571-15f7-44de-bdac-ca3a8ab46ace", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354419557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "602dab4996a7422cb9bf5aff46e0fee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95a7c7bc-d6", "ovs_interfaceid": "95a7c7bc-d60c-491f-b049-f2abd6a57647", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e86f5236-dc27-4330-90a5-b8f8a8d669bd", "address": "fa:16:3e:40:a0:dc", "network": {"id": "ea165e0d-d1d5-4541-a2c8-5f0f788c7b33", "bridge": "br-int", "label": "tempest-device-tagging-net2-2028572952", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "602dab4996a7422cb9bf5aff46e0fee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape86f5236-dc", "ovs_interfaceid": "e86f5236-dc27-4330-90a5-b8f8a8d669bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6539aa0d-9ed3-4e04-8315-103d26c7403f", "address": "fa:16:3e:04:05:d3", "network": {"id": "ea165e0d-d1d5-4541-a2c8-5f0f788c7b33", "bridge": "br-int", "label": "tempest-device-tagging-net2-2028572952", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "602dab4996a7422cb9bf5aff46e0fee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6539aa0d-9e", "ovs_interfaceid": "6539aa0d-9ed3-4e04-8315-103d26c7403f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74960) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 12:19:10 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-0a7fe8cb-74ad-4e67-9150-c05245b68439 req-766e9ee6-24ff-4040-9c20-22e6d711a6d1 service nova] Acquired lock "refresh_cache-ac9e1b20-2482-4c71-b54b-5d6cb8187d04" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:19:10 user nova-compute[74960]: DEBUG nova.network.neutron [req-0a7fe8cb-74ad-4e67-9150-c05245b68439 req-766e9ee6-24ff-4040-9c20-22e6d711a6d1 service nova] [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04] Refreshing network info cache for port 6539aa0d-9ed3-4e04-8315-103d26c7403f {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 12:19:10 user nova-compute[74960]: DEBUG nova.network.neutron [None req-8f8e7aa7-5c24-44d2-9a4d-8fae2fe3c7ab tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] Successfully created port: 31063379-2482-4339-9fb1-1468848af814 {{(pid=74960) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 12:19:11 user nova-compute[74960]: DEBUG nova.network.neutron [req-0a7fe8cb-74ad-4e67-9150-c05245b68439 req-766e9ee6-24ff-4040-9c20-22e6d711a6d1 service nova] [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04] Updated VIF entry in instance network info cache for port 6539aa0d-9ed3-4e04-8315-103d26c7403f. {{(pid=74960) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 12:19:11 user nova-compute[74960]: DEBUG nova.network.neutron [req-0a7fe8cb-74ad-4e67-9150-c05245b68439 req-766e9ee6-24ff-4040-9c20-22e6d711a6d1 service nova] [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04] Updating instance_info_cache with network_info: [{"id": "2fa8f636-7161-4db6-83bf-7e4c9eff4c67", "address": "fa:16:3e:09:9c:5a", "network": {"id": "a22b4dee-2e5f-4184-87ba-146395c5bc2c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-820777923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "602dab4996a7422cb9bf5aff46e0fee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fa8f636-71", "ovs_interfaceid": "2fa8f636-7161-4db6-83bf-7e4c9eff4c67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e95cf873-cdaf-4aa9-8e6d-1c2d2ad4c6a8", "address": "fa:16:3e:b2:0d:16", "network": {"id": "5d680571-15f7-44de-bdac-ca3a8ab46ace", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354419557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "602dab4996a7422cb9bf5aff46e0fee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape95cf873-cd", "ovs_interfaceid": "e95cf873-cdaf-4aa9-8e6d-1c2d2ad4c6a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1d83fe31-117e-49b5-a073-1c8dec48fd1f", "address": "fa:16:3e:2e:1b:71", "network": {"id": "5d680571-15f7-44de-bdac-ca3a8ab46ace", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354419557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "602dab4996a7422cb9bf5aff46e0fee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d83fe31-11", "ovs_interfaceid": "1d83fe31-117e-49b5-a073-1c8dec48fd1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d6c585b8-ece6-4656-b33e-14e40d9515c5", "address": "fa:16:3e:ff:da:5b", "network": {"id": "5d680571-15f7-44de-bdac-ca3a8ab46ace", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354419557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "602dab4996a7422cb9bf5aff46e0fee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6c585b8-ec", "ovs_interfaceid": "d6c585b8-ece6-4656-b33e-14e40d9515c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "95a7c7bc-d60c-491f-b049-f2abd6a57647", "address": "fa:16:3e:36:14:0f", "network": {"id": "5d680571-15f7-44de-bdac-ca3a8ab46ace", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354419557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "602dab4996a7422cb9bf5aff46e0fee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95a7c7bc-d6", "ovs_interfaceid": "95a7c7bc-d60c-491f-b049-f2abd6a57647", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e86f5236-dc27-4330-90a5-b8f8a8d669bd", "address": "fa:16:3e:40:a0:dc", "network": {"id": "ea165e0d-d1d5-4541-a2c8-5f0f788c7b33", "bridge": "br-int", "label": "tempest-device-tagging-net2-2028572952", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "602dab4996a7422cb9bf5aff46e0fee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape86f5236-dc", "ovs_interfaceid": "e86f5236-dc27-4330-90a5-b8f8a8d669bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6539aa0d-9ed3-4e04-8315-103d26c7403f", "address": "fa:16:3e:04:05:d3", "network": {"id": "ea165e0d-d1d5-4541-a2c8-5f0f788c7b33", "bridge": "br-int", "label": "tempest-device-tagging-net2-2028572952", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "602dab4996a7422cb9bf5aff46e0fee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6539aa0d-9e", "ovs_interfaceid": "6539aa0d-9ed3-4e04-8315-103d26c7403f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:19:11 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-0a7fe8cb-74ad-4e67-9150-c05245b68439 req-766e9ee6-24ff-4040-9c20-22e6d711a6d1 service nova] Releasing lock "refresh_cache-ac9e1b20-2482-4c71-b54b-5d6cb8187d04" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:19:11 user nova-compute[74960]: DEBUG nova.network.neutron [None req-8f8e7aa7-5c24-44d2-9a4d-8fae2fe3c7ab tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] Successfully updated port: 31063379-2482-4339-9fb1-1468848af814 {{(pid=74960) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 12:19:11 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-8f8e7aa7-5c24-44d2-9a4d-8fae2fe3c7ab tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Acquiring lock "refresh_cache-0a520c41-19c0-47ba-ada8-023ee9c12ca6" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:19:11 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-8f8e7aa7-5c24-44d2-9a4d-8fae2fe3c7ab tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Acquired lock "refresh_cache-0a520c41-19c0-47ba-ada8-023ee9c12ca6" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:19:11 user nova-compute[74960]: DEBUG nova.network.neutron [None req-8f8e7aa7-5c24-44d2-9a4d-8fae2fe3c7ab tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] Building network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 12:19:11 user nova-compute[74960]: DEBUG nova.compute.manager [req-4db8b20d-dee2-42e5-b8e5-88834f7a0123 req-0bd6051e-b4a0-4b7c-8fbc-08fedc401f98 service nova] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] Received event network-changed-31063379-2482-4339-9fb1-1468848af814 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:19:11 user nova-compute[74960]: DEBUG nova.compute.manager [req-4db8b20d-dee2-42e5-b8e5-88834f7a0123 req-0bd6051e-b4a0-4b7c-8fbc-08fedc401f98 service nova] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] Refreshing instance network info cache due to event network-changed-31063379-2482-4339-9fb1-1468848af814. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 12:19:11 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-4db8b20d-dee2-42e5-b8e5-88834f7a0123 req-0bd6051e-b4a0-4b7c-8fbc-08fedc401f98 service nova] Acquiring lock "refresh_cache-0a520c41-19c0-47ba-ada8-023ee9c12ca6" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:19:12 user nova-compute[74960]: DEBUG nova.network.neutron [None req-8f8e7aa7-5c24-44d2-9a4d-8fae2fe3c7ab tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] Updating instance_info_cache with network_info: [{"id": "3e126a57-0883-4997-9c99-d25c9c6fc102", "address": "fa:16:3e:f9:07:9b", "network": {"id": "65e1589f-341c-4cc8-a8e6-5b61544daf55", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1130686752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3390632661124edd9894dabac0053fa9", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e126a57-08", "ovs_interfaceid": "3e126a57-0883-4997-9c99-d25c9c6fc102", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "31063379-2482-4339-9fb1-1468848af814", "address": "fa:16:3e:e0:fa:2f", "network": {"id": "398189f9-4e24-48ff-9e1d-ac06e98e3eb1", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-610583939", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.94", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3390632661124edd9894dabac0053fa9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31063379-24", "ovs_interfaceid": "31063379-2482-4339-9fb1-1468848af814", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:19:12 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-8f8e7aa7-5c24-44d2-9a4d-8fae2fe3c7ab tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Releasing lock "refresh_cache-0a520c41-19c0-47ba-ada8-023ee9c12ca6" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:19:12 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-4db8b20d-dee2-42e5-b8e5-88834f7a0123 req-0bd6051e-b4a0-4b7c-8fbc-08fedc401f98 service nova] Acquired lock "refresh_cache-0a520c41-19c0-47ba-ada8-023ee9c12ca6" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:19:12 user nova-compute[74960]: DEBUG nova.network.neutron [req-4db8b20d-dee2-42e5-b8e5-88834f7a0123 req-0bd6051e-b4a0-4b7c-8fbc-08fedc401f98 service nova] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] Refreshing network info cache for port 31063379-2482-4339-9fb1-1468848af814 {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 12:19:12 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-8f8e7aa7-5c24-44d2-9a4d-8fae2fe3c7ab tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T12:17:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-718860820',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-718860820',id=7,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLwaiWOkf4g+xGnCHIQ6PEXYDCQvWANu1aoEqkgH8PkfR56o+3+BPp4uxgAn5C+zZDpe3SkZ06KyunCKlhSZpIVyhUY157dTlXxkUygCex89TiMcoPvBPFCYXJkTY4on1A==',key_name='tempest-keypair-1456184094',keypairs=<?>,launch_index=0,launched_at=2023-11-03T12:17:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3390632661124edd9894dabac0053fa9',ramdisk_id='',reservation_id='r-zkhug3rc',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1950029920',owner_user_name='tempest-TaggedAttachmentsTest-1950029920-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T12:17:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9da58bde19c3434f9811cb80ed39dea9',uuid=0a520c41-19c0-47ba-ada8-023ee9c12ca6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "31063379-2482-4339-9fb1-1468848af814", "address": "fa:16:3e:e0:fa:2f", "network": {"id": "398189f9-4e24-48ff-9e1d-ac06e98e3eb1", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-610583939", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.94", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3390632661124edd9894dabac0053fa9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31063379-24", "ovs_interfaceid": "31063379-2482-4339-9fb1-1468848af814", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 12:19:12 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-8f8e7aa7-5c24-44d2-9a4d-8fae2fe3c7ab tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Converting VIF {"id": "31063379-2482-4339-9fb1-1468848af814", "address": "fa:16:3e:e0:fa:2f", "network": {"id": "398189f9-4e24-48ff-9e1d-ac06e98e3eb1", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-610583939", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.94", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3390632661124edd9894dabac0053fa9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31063379-24", "ovs_interfaceid": "31063379-2482-4339-9fb1-1468848af814", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:19:12 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-8f8e7aa7-5c24-44d2-9a4d-8fae2fe3c7ab tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:fa:2f,bridge_name='br-int',has_traffic_filtering=True,id=31063379-2482-4339-9fb1-1468848af814,network=Network(398189f9-4e24-48ff-9e1d-ac06e98e3eb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31063379-24') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:19:12 user nova-compute[74960]: DEBUG os_vif [None req-8f8e7aa7-5c24-44d2-9a4d-8fae2fe3c7ab tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:fa:2f,bridge_name='br-int',has_traffic_filtering=True,id=31063379-2482-4339-9fb1-1468848af814,network=Network(398189f9-4e24-48ff-9e1d-ac06e98e3eb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31063379-24') {{(pid=74960) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 12:19:12 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:19:12 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:19:12 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 12:19:12 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:19:12 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c6b34c0d-e6c8-5162-a77b-7c611148166f', '_type': 'linux-noop'}}, row=False) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:19:12 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:19:12 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:19:12 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:19:12 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap31063379-24, may_exist=True, interface_attrs={}) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:19:12 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap31063379-24, col_values=(('qos', UUID('3039aae1-1326-4250-9fc5-8b9bccab6d3d')),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:19:12 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap31063379-24, col_values=(('external_ids', {'iface-id': '31063379-2482-4339-9fb1-1468848af814', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e0:fa:2f', 'vm-uuid': '0a520c41-19c0-47ba-ada8-023ee9c12ca6'}),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:19:12 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:19:12 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:19:12 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:19:12 user nova-compute[74960]: INFO os_vif [None req-8f8e7aa7-5c24-44d2-9a4d-8fae2fe3c7ab tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:fa:2f,bridge_name='br-int',has_traffic_filtering=True,id=31063379-2482-4339-9fb1-1468848af814,network=Network(398189f9-4e24-48ff-9e1d-ac06e98e3eb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31063379-24')
Nov 03 12:19:12 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-8f8e7aa7-5c24-44d2-9a4d-8fae2fe3c7ab tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T12:17:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-718860820',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-718860820',id=7,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLwaiWOkf4g+xGnCHIQ6PEXYDCQvWANu1aoEqkgH8PkfR56o+3+BPp4uxgAn5C+zZDpe3SkZ06KyunCKlhSZpIVyhUY157dTlXxkUygCex89TiMcoPvBPFCYXJkTY4on1A==',key_name='tempest-keypair-1456184094',keypairs=<?>,launch_index=0,launched_at=2023-11-03T12:17:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3390632661124edd9894dabac0053fa9',ramdisk_id='',reservation_id='r-zkhug3rc',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1950029920',owner_user_name='tempest-TaggedAttachmentsTest-1950029920-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T12:17:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9da58bde19c3434f9811cb80ed39dea9',uuid=0a520c41-19c0-47ba-ada8-023ee9c12ca6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "31063379-2482-4339-9fb1-1468848af814", "address": "fa:16:3e:e0:fa:2f", "network": {"id": "398189f9-4e24-48ff-9e1d-ac06e98e3eb1", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-610583939", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.94", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3390632661124edd9894dabac0053fa9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31063379-24", "ovs_interfaceid": "31063379-2482-4339-9fb1-1468848af814", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74960) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 12:19:12 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-8f8e7aa7-5c24-44d2-9a4d-8fae2fe3c7ab tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Converting VIF {"id": "31063379-2482-4339-9fb1-1468848af814", "address": "fa:16:3e:e0:fa:2f", "network": {"id": "398189f9-4e24-48ff-9e1d-ac06e98e3eb1", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-610583939", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.94", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3390632661124edd9894dabac0053fa9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31063379-24", "ovs_interfaceid": "31063379-2482-4339-9fb1-1468848af814", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:19:12 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-8f8e7aa7-5c24-44d2-9a4d-8fae2fe3c7ab tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:fa:2f,bridge_name='br-int',has_traffic_filtering=True,id=31063379-2482-4339-9fb1-1468848af814,network=Network(398189f9-4e24-48ff-9e1d-ac06e98e3eb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31063379-24') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:19:12 user nova-compute[74960]: DEBUG nova.virt.libvirt.guest [None req-8f8e7aa7-5c24-44d2-9a4d-8fae2fe3c7ab tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] attach device xml: <interface type="ethernet">
Nov 03 12:19:12 user nova-compute[74960]:   <mac address="fa:16:3e:e0:fa:2f"/>
Nov 03 12:19:12 user nova-compute[74960]:   <model type="virtio"/>
Nov 03 12:19:12 user nova-compute[74960]:   <mtu size="1442"/>
Nov 03 12:19:12 user nova-compute[74960]:   <target dev="tap31063379-24"/>
Nov 03 12:19:12 user nova-compute[74960]: </interface>
Nov 03 12:19:12 user nova-compute[74960]:  {{(pid=74960) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 03 12:19:12 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:19:12 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:19:12 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:19:12 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:19:12 user nova-compute[74960]: DEBUG nova.compute.manager [req-cae17fb8-6e6a-4bcc-ad38-a914225bbf8e req-b1ee7a84-d6bf-488a-84be-70730c4adada service nova] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] Received event network-vif-plugged-31063379-2482-4339-9fb1-1468848af814 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:19:12 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-cae17fb8-6e6a-4bcc-ad38-a914225bbf8e req-b1ee7a84-d6bf-488a-84be-70730c4adada service nova] Acquiring lock "0a520c41-19c0-47ba-ada8-023ee9c12ca6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:19:12 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-cae17fb8-6e6a-4bcc-ad38-a914225bbf8e req-b1ee7a84-d6bf-488a-84be-70730c4adada service nova] Lock "0a520c41-19c0-47ba-ada8-023ee9c12ca6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:19:12 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-cae17fb8-6e6a-4bcc-ad38-a914225bbf8e req-b1ee7a84-d6bf-488a-84be-70730c4adada service nova] Lock "0a520c41-19c0-47ba-ada8-023ee9c12ca6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:19:12 user nova-compute[74960]: DEBUG nova.compute.manager [req-cae17fb8-6e6a-4bcc-ad38-a914225bbf8e req-b1ee7a84-d6bf-488a-84be-70730c4adada service nova] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] No waiting events found dispatching network-vif-plugged-31063379-2482-4339-9fb1-1468848af814 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:19:12 user nova-compute[74960]: WARNING nova.compute.manager [req-cae17fb8-6e6a-4bcc-ad38-a914225bbf8e req-b1ee7a84-d6bf-488a-84be-70730c4adada service nova] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] Received unexpected event network-vif-plugged-31063379-2482-4339-9fb1-1468848af814 for instance with vm_state active and task_state None.
Nov 03 12:19:12 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:19:12 user nova-compute[74960]: DEBUG nova.network.neutron [req-4db8b20d-dee2-42e5-b8e5-88834f7a0123 req-0bd6051e-b4a0-4b7c-8fbc-08fedc401f98 service nova] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] Updated VIF entry in instance network info cache for port 31063379-2482-4339-9fb1-1468848af814. {{(pid=74960) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 12:19:12 user nova-compute[74960]: DEBUG nova.network.neutron [req-4db8b20d-dee2-42e5-b8e5-88834f7a0123 req-0bd6051e-b4a0-4b7c-8fbc-08fedc401f98 service nova] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] Updating instance_info_cache with network_info: [{"id": "3e126a57-0883-4997-9c99-d25c9c6fc102", "address": "fa:16:3e:f9:07:9b", "network": {"id": "65e1589f-341c-4cc8-a8e6-5b61544daf55", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1130686752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3390632661124edd9894dabac0053fa9", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e126a57-08", "ovs_interfaceid": "3e126a57-0883-4997-9c99-d25c9c6fc102", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "31063379-2482-4339-9fb1-1468848af814", "address": "fa:16:3e:e0:fa:2f", "network": {"id": "398189f9-4e24-48ff-9e1d-ac06e98e3eb1", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-610583939", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.94", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3390632661124edd9894dabac0053fa9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31063379-24", "ovs_interfaceid": "31063379-2482-4339-9fb1-1468848af814", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:19:12 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-4db8b20d-dee2-42e5-b8e5-88834f7a0123 req-0bd6051e-b4a0-4b7c-8fbc-08fedc401f98 service nova] Releasing lock "refresh_cache-0a520c41-19c0-47ba-ada8-023ee9c12ca6" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:19:12 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-8f8e7aa7-5c24-44d2-9a4d-8fae2fe3c7ab tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] No BDM found with device name vda, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:19:12 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-8f8e7aa7-5c24-44d2-9a4d-8fae2fe3c7ab tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] No BDM found with device name hda, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:19:12 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-8f8e7aa7-5c24-44d2-9a4d-8fae2fe3c7ab tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] No VIF found with MAC fa:16:3e:f9:07:9b, not building metadata {{(pid=74960) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 12:19:12 user nova-compute[74960]: DEBUG nova.virt.libvirt.guest [None req-8f8e7aa7-5c24-44d2-9a4d-8fae2fe3c7ab tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 12:19:12 user nova-compute[74960]:   <nova:package version="0.0.0"/>
Nov 03 12:19:12 user nova-compute[74960]:   <nova:name>tempest-device-tagging-server-718860820</nova:name>
Nov 03 12:19:12 user nova-compute[74960]:   <nova:creationTime>2023-11-03 12:19:12</nova:creationTime>
Nov 03 12:19:12 user nova-compute[74960]:   <nova:flavor name="m1.tiny">
Nov 03 12:19:12 user nova-compute[74960]:     <nova:memory>512</nova:memory>
Nov 03 12:19:12 user nova-compute[74960]:     <nova:disk>1</nova:disk>
Nov 03 12:19:12 user nova-compute[74960]:     <nova:swap>0</nova:swap>
Nov 03 12:19:12 user nova-compute[74960]:     <nova:ephemeral>0</nova:ephemeral>
Nov 03 12:19:12 user nova-compute[74960]:     <nova:vcpus>1</nova:vcpus>
Nov 03 12:19:12 user nova-compute[74960]:   </nova:flavor>
Nov 03 12:19:12 user nova-compute[74960]:   <nova:owner>
Nov 03 12:19:12 user nova-compute[74960]:     <nova:user uuid="9da58bde19c3434f9811cb80ed39dea9">tempest-TaggedAttachmentsTest-1950029920-project-member</nova:user>
Nov 03 12:19:12 user nova-compute[74960]:     <nova:project uuid="3390632661124edd9894dabac0053fa9">tempest-TaggedAttachmentsTest-1950029920</nova:project>
Nov 03 12:19:12 user nova-compute[74960]:   </nova:owner>
Nov 03 12:19:12 user nova-compute[74960]:   <nova:root type="image" uuid="549f51ba-ac69-494b-8de1-34635aa2d7cf"/>
Nov 03 12:19:12 user nova-compute[74960]:   <nova:ports>
Nov 03 12:19:12 user nova-compute[74960]:     <nova:port uuid="3e126a57-0883-4997-9c99-d25c9c6fc102">
Nov 03 12:19:12 user nova-compute[74960]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 03 12:19:12 user nova-compute[74960]:     </nova:port>
Nov 03 12:19:12 user nova-compute[74960]:     <nova:port uuid="31063379-2482-4339-9fb1-1468848af814">
Nov 03 12:19:12 user nova-compute[74960]:       <nova:ip type="fixed" address="10.10.10.94" ipVersion="4"/>
Nov 03 12:19:12 user nova-compute[74960]:     </nova:port>
Nov 03 12:19:12 user nova-compute[74960]:   </nova:ports>
Nov 03 12:19:12 user nova-compute[74960]: </nova:instance>
Nov 03 12:19:12 user nova-compute[74960]:  {{(pid=74960) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 03 12:19:12 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-8f8e7aa7-5c24-44d2-9a4d-8fae2fe3c7ab tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Lock "interface-0a520c41-19c0-47ba-ada8-023ee9c12ca6-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.126s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:19:12 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:19:12 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:19:12 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:19:13 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-ab4d0c5d-bdff-4340-aad1-8d3bb3fc7356 tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:19:13 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-ab4d0c5d-bdff-4340-aad1-8d3bb3fc7356 tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:19:13 user nova-compute[74960]: DEBUG os_brick.initiator.connector [None req-ab4d0c5d-bdff-4340-aad1-8d3bb3fc7356 tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Factory for ISCSI on None {{(pid=74960) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Nov 03 12:19:13 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-ab4d0c5d-bdff-4340-aad1-8d3bb3fc7356 tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.007s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:19:13 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab4d0c5d-bdff-4340-aad1-8d3bb3fc7356 tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] [instance: 39e6c635-4602-4ed6-abbd-80c96f056715] Calling os-brick to attach iSCSI Volume {{(pid=74960) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 12:19:13 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab4d0c5d-bdff-4340-aad1-8d3bb3fc7356 tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9aa420acb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:801f5055-02d8-4d35-ba25-3052149a0e1b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IdDaEuQn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:19:13 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-ab4d0c5d-bdff-4340-aad1-8d3bb3fc7356 tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:19:13 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-ab4d0c5d-bdff-4340-aad1-8d3bb3fc7356 tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:19:13 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-ab4d0c5d-bdff-4340-aad1-8d3bb3fc7356 tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:19:13 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-ab4d0c5d-bdff-4340-aad1-8d3bb3fc7356 tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:19:13 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-ab4d0c5d-bdff-4340-aad1-8d3bb3fc7356 tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:801f5055-02d8-4d35-ba25-3052149a0e1b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:19:13 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-ab4d0c5d-bdff-4340-aad1-8d3bb3fc7356 tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:801f5055-02d8-4d35-ba25-3052149a0e1b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:19:13 user nova-compute[74960]: INFO os_brick.initiator.connectors.iscsi [None req-ab4d0c5d-bdff-4340-aad1-8d3bb3fc7356 tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 12:19:13 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:801f5055-02d8-4d35-ba25-3052149a0e1b -p 172.16.0.220:3260 {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:19:13 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:801f5055-02d8-4d35-ba25-3052149a0e1b -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:19:13 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[717fe592-4a0f-4a55-b3be-7e5c6dad59cc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:19:13 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab4d0c5d-bdff-4340-aad1-8d3bb3fc7356 tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 12:19:13 user nova-compute[74960]:  {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:19:13 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:801f5055-02d8-4d35-ba25-3052149a0e1b -p 172.16.0.220:3260 --interface default --op new {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:19:13 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:801f5055-02d8-4d35-ba25-3052149a0e1b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:19:13 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[f98333c8-15eb-45db-8402-0475a00b12a2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:801f5055-02d8-4d35-ba25-3052149a0e1b] added\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:19:13 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab4d0c5d-bdff-4340-aad1-8d3bb3fc7356 tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:801f5055-02d8-4d35-ba25-3052149a0e1b] added
Nov 03 12:19:13 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:19:13 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:801f5055-02d8-4d35-ba25-3052149a0e1b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:19:13 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:801f5055-02d8-4d35-ba25-3052149a0e1b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:19:13 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a36cd59-29d2-48a8-a029-9928ae1b3540]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:19:13 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab4d0c5d-bdff-4340-aad1-8d3bb3fc7356 tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:19:13 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:801f5055-02d8-4d35-ba25-3052149a0e1b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:19:13 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:801f5055-02d8-4d35-ba25-3052149a0e1b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:19:13 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[fecf98f2-ce50-44f6-9760-85f3544702f7]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:19:13 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab4d0c5d-bdff-4340-aad1-8d3bb3fc7356 tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:19:13 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:801f5055-02d8-4d35-ba25-3052149a0e1b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IdDaEuQn {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:19:13 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:801f5055-02d8-4d35-ba25-3052149a0e1b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IdDaEuQn" returned: 0 in 0.017s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:19:13 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[f33fc94d-77e9-4025-a1e8-3a0de7651979]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:19:13 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab4d0c5d-bdff-4340-aad1-8d3bb3fc7356 tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IdDaEuQn'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:19:13 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:801f5055-02d8-4d35-ba25-3052149a0e1b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:19:13 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:801f5055-02d8-4d35-ba25-3052149a0e1b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:19:13 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7f4d322-04de-4b32-bb38-3868114853e3]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:19:13 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab4d0c5d-bdff-4340-aad1-8d3bb3fc7356 tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:19:13 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:19:13 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:19:13 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[833f8011-4f9b-4add-8123-583cb417d0cd]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:19:13 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab4d0c5d-bdff-4340-aad1-8d3bb3fc7356 tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 03 12:19:13 user nova-compute[74960]:  {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:19:13 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab4d0c5d-bdff-4340-aad1-8d3bb3fc7356 tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 03 12:19:13 user nova-compute[74960]:  {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:19:13 user nova-compute[74960]: WARNING os_brick.initiator.connectors.iscsi [None req-ab4d0c5d-bdff-4340-aad1-8d3bb3fc7356 tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 03 12:19:13 user nova-compute[74960]: 
Nov 03 12:19:13 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:801f5055-02d8-4d35-ba25-3052149a0e1b -p 172.16.0.220:3260 --login {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:19:13 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:801f5055-02d8-4d35-ba25-3052149a0e1b -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:19:13 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[217f5979-02f2-4103-9583-f8d42bac7944]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:801f5055-02d8-4d35-ba25-3052149a0e1b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:801f5055-02d8-4d35-ba25-3052149a0e1b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:19:13 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab4d0c5d-bdff-4340-aad1-8d3bb3fc7356 tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:801f5055-02d8-4d35-ba25-3052149a0e1b, portal: 172.16.0.220,3260]
Nov 03 12:19:13 user nova-compute[74960]: Login to [iface: default, target: iqn.2010-10.org.openstack:801f5055-02d8-4d35-ba25-3052149a0e1b, portal: 172.16.0.220,3260] successful.
Nov 03 12:19:13 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:19:13 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:801f5055-02d8-4d35-ba25-3052149a0e1b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:19:13 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:801f5055-02d8-4d35-ba25-3052149a0e1b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:19:13 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb815fb6-7db2-4736-bd9d-a8a27a2885d4]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:19:13 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab4d0c5d-bdff-4340-aad1-8d3bb3fc7356 tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:19:13 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:19:13 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-06cf4441-dd88-4688-b21e-c1e38d59ff63 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] Acquiring lock "8381c969-6a2d-4934-aadd-660ffa246b05" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:19:13 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-06cf4441-dd88-4688-b21e-c1e38d59ff63 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] Lock "8381c969-6a2d-4934-aadd-660ffa246b05" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:19:13 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:19:13 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f561ff0-4b6f-493f-9da2-c658ca459b6e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:801f5055-02d8-4d35-ba25-3052149a0e1b (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:19:13 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab4d0c5d-bdff-4340-aad1-8d3bb3fc7356 tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:801f5055-02d8-4d35-ba25-3052149a0e1b (non-flash)
Nov 03 12:19:13 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:19:13 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab4d0c5d-bdff-4340-aad1-8d3bb3fc7356 tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:801f5055-02d8-4d35-ba25-3052149a0e1b (non-flash)
Nov 03 12:19:13 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:19:13 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-ab4d0c5d-bdff-4340-aad1-8d3bb3fc7356 tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:801f5055-02d8-4d35-ba25-3052149a0e1b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.260s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:19:13 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab4d0c5d-bdff-4340-aad1-8d3bb3fc7356 tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Connected to 172.16.0.220:3260 {{(pid=74960) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 12:19:13 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-ab4d0c5d-bdff-4340-aad1-8d3bb3fc7356 tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=74960) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 12:19:13 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-ab4d0c5d-bdff-4340-aad1-8d3bb3fc7356 tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74960) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 12:19:13 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:19:13 user nova-compute[74960]: DEBUG nova.objects.instance [None req-06cf4441-dd88-4688-b21e-c1e38d59ff63 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] Lazy-loading 'flavor' on Instance uuid 8381c969-6a2d-4934-aadd-660ffa246b05 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:19:13 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:19:13 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[61826d68-fc57-4f52-8a00-dbf849eb1a31]: (4, ('- - 0', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:19:13 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-ab4d0c5d-bdff-4340-aad1-8d3bb3fc7356 tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74960) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 12:19:13 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab4d0c5d-bdff-4340-aad1-8d3bb3fc7356 tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:801f5055-02d8-4d35-ba25-3052149a0e1b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IdDaEuQn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74960) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 12:19:13 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-06cf4441-dd88-4688-b21e-c1e38d59ff63 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] Lock "8381c969-6a2d-4934-aadd-660ffa246b05" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:19:13 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-dcfd168c-dfe0-4911-8951-580b499e589d tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Acquiring lock "0a520c41-19c0-47ba-ada8-023ee9c12ca6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:19:13 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-dcfd168c-dfe0-4911-8951-580b499e589d tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Lock "0a520c41-19c0-47ba-ada8-023ee9c12ca6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:19:13 user nova-compute[74960]: DEBUG nova.objects.instance [None req-dcfd168c-dfe0-4911-8951-580b499e589d tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Lazy-loading 'flavor' on Instance uuid 0a520c41-19c0-47ba-ada8-023ee9c12ca6 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:19:13 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-dcfd168c-dfe0-4911-8951-580b499e589d tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Lock "0a520c41-19c0-47ba-ada8-023ee9c12ca6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:19:13 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-b1a81923-db20-4b79-a81e-e00e13e234e1 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Acquiring lock "d00a0872-693c-4cdc-85cd-9806660e9d8d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:19:13 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-b1a81923-db20-4b79-a81e-e00e13e234e1 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Lock "d00a0872-693c-4cdc-85cd-9806660e9d8d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:19:13 user nova-compute[74960]: DEBUG nova.objects.instance [None req-b1a81923-db20-4b79-a81e-e00e13e234e1 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Lazy-loading 'flavor' on Instance uuid d00a0872-693c-4cdc-85cd-9806660e9d8d {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:19:13 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-b1a81923-db20-4b79-a81e-e00e13e234e1 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Lock "d00a0872-693c-4cdc-85cd-9806660e9d8d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:19:13 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-06cf4441-dd88-4688-b21e-c1e38d59ff63 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] Acquiring lock "8381c969-6a2d-4934-aadd-660ffa246b05" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:19:13 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-06cf4441-dd88-4688-b21e-c1e38d59ff63 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] Lock "8381c969-6a2d-4934-aadd-660ffa246b05" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:19:13 user nova-compute[74960]: INFO nova.compute.manager [None req-06cf4441-dd88-4688-b21e-c1e38d59ff63 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] [instance: 8381c969-6a2d-4934-aadd-660ffa246b05] Attaching volume 4b85943b-1d18-4267-9329-4318e1923b19 to /dev/vdb
Nov 03 12:19:13 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-dcfd168c-dfe0-4911-8951-580b499e589d tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Acquiring lock "0a520c41-19c0-47ba-ada8-023ee9c12ca6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:19:13 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-dcfd168c-dfe0-4911-8951-580b499e589d tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Lock "0a520c41-19c0-47ba-ada8-023ee9c12ca6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:19:13 user nova-compute[74960]: INFO nova.compute.manager [None req-dcfd168c-dfe0-4911-8951-580b499e589d tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] Attaching volume 27e9e6ae-69f2-4849-ab0c-0b7f9fc18990 to /dev/vdb
Nov 03 12:19:14 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-b1a81923-db20-4b79-a81e-e00e13e234e1 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Acquiring lock "d00a0872-693c-4cdc-85cd-9806660e9d8d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:19:14 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-b1a81923-db20-4b79-a81e-e00e13e234e1 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Lock "d00a0872-693c-4cdc-85cd-9806660e9d8d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:19:14 user nova-compute[74960]: INFO nova.compute.manager [None req-b1a81923-db20-4b79-a81e-e00e13e234e1 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] [instance: d00a0872-693c-4cdc-85cd-9806660e9d8d] Attaching volume 967d5abf-c746-43a2-936e-e1abdc8475c3 to /dev/sdc
Nov 03 12:19:14 user nova-compute[74960]: DEBUG os_brick.utils [None req-06cf4441-dd88-4688-b21e-c1e38d59ff63 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:19:14 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:19:14 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:19:14 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0079806-39c4-438a-a37e-90289685906c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:75b8e219756\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:19:14 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:19:14 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:19:14 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[74370f75-1ca5-42b7-8efa-dd7865696b12]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:19:14 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:19:14 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:19:14 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa44d509-28db-4556-a9d1-8489ba34f0b1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:19:14 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[595832ca-eccb-4b9b-abe1-0d1839472533]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:19:14 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-06cf4441-dd88-4688-b21e-c1e38d59ff63 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] Running cmd (subprocess): nvme version {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:19:14 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-06cf4441-dd88-4688-b21e-c1e38d59ff63 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] 'nvme version' failed. Not Retrying. {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 12:19:14 user nova-compute[74960]: DEBUG os_brick.utils [None req-dcfd168c-dfe0-4911-8951-580b499e589d tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:19:14 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.nvmeof [None req-06cf4441-dd88-4688-b21e-c1e38d59ff63 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] nvme not present on system {{(pid=74960) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 12:19:14 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:19:14 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:19:14 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:19:14 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc11f2b4-e4ac-49de-ae44-45bc4377e460]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:75b8e219756\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:19:14 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 12:19:14 user nova-compute[74960]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 12:19:14 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba591b20-0141-4af0-ba0a-50e0576f33cb]: (4, '') {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:19:14 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:19:14 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-06cf4441-dd88-4688-b21e-c1e38d59ff63 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74960) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 12:19:14 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-06cf4441-dd88-4688-b21e-c1e38d59ff63 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74960) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 12:19:14 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-06cf4441-dd88-4688-b21e-c1e38d59ff63 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] LIGHTOS: no hostnqn found. {{(pid=74960) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 12:19:14 user nova-compute[74960]: DEBUG os_brick.utils [None req-06cf4441-dd88-4688-b21e-c1e38d59ff63 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:75b8e219756', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:19:14 user nova-compute[74960]: DEBUG nova.virt.block_device [None req-06cf4441-dd88-4688-b21e-c1e38d59ff63 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] [instance: 8381c969-6a2d-4934-aadd-660ffa246b05] Updating existing volume attachment record: 84351424-720a-4c09-bd33-4c3941cbef4e {{(pid=74960) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 12:19:14 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:19:14 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cf42aae-8ed8-4864-9e8c-3cb0c95f5f14]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:19:14 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:19:14 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:19:14 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[90490dd7-dfcd-45a9-9f58-15418c3c8564]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:19:14 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1a727db-f849-48b0-a841-732c3b92482a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:19:14 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-dcfd168c-dfe0-4911-8951-580b499e589d tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Running cmd (subprocess): nvme version {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:19:14 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-dcfd168c-dfe0-4911-8951-580b499e589d tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] 'nvme version' failed. Not Retrying. {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 12:19:14 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dcfd168c-dfe0-4911-8951-580b499e589d tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] nvme not present on system {{(pid=74960) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 12:19:14 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:19:14 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 12:19:14 user nova-compute[74960]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 12:19:14 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[c486cd4e-704e-4817-b7a1-053887b9f104]: (4, '') {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:19:14 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-dcfd168c-dfe0-4911-8951-580b499e589d tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74960) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 12:19:14 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-dcfd168c-dfe0-4911-8951-580b499e589d tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74960) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 12:19:14 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-dcfd168c-dfe0-4911-8951-580b499e589d tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] LIGHTOS: no hostnqn found. {{(pid=74960) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 12:19:14 user nova-compute[74960]: DEBUG os_brick.utils [None req-dcfd168c-dfe0-4911-8951-580b499e589d tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:75b8e219756', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:19:14 user nova-compute[74960]: DEBUG nova.virt.block_device [None req-dcfd168c-dfe0-4911-8951-580b499e589d tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] Updating existing volume attachment record: 20437d09-e7c2-40ef-8635-474ad616154b {{(pid=74960) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 12:19:14 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-ab4d0c5d-bdff-4340-aad1-8d3bb3fc7356 tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.295s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:19:14 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab4d0c5d-bdff-4340-aad1-8d3bb3fc7356 tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] <== connect_volume: return (1297ms) {'type': 'block', 'scsi_wwn': '23264323930333839', 'path': '/dev/sdb'} {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:19:14 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab4d0c5d-bdff-4340-aad1-8d3bb3fc7356 tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] [instance: 39e6c635-4602-4ed6-abbd-80c96f056715] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23264323930333839', 'path': '/dev/sdb'} {{(pid=74960) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 12:19:14 user nova-compute[74960]: DEBUG nova.objects.instance [None req-ab4d0c5d-bdff-4340-aad1-8d3bb3fc7356 tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Lazy-loading 'flavor' on Instance uuid 39e6c635-4602-4ed6-abbd-80c96f056715 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:19:14 user nova-compute[74960]: DEBUG nova.virt.libvirt.guest [None req-ab4d0c5d-bdff-4340-aad1-8d3bb3fc7356 tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] attach device xml: <disk type="block" device="disk">
Nov 03 12:19:14 user nova-compute[74960]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 12:19:14 user nova-compute[74960]:   <source dev="/dev/sdb"/>
Nov 03 12:19:14 user nova-compute[74960]:   <target dev="vdb" bus="virtio"/>
Nov 03 12:19:14 user nova-compute[74960]:   <serial>801f5055-02d8-4d35-ba25-3052149a0e1b</serial>
Nov 03 12:19:14 user nova-compute[74960]: </disk>
Nov 03 12:19:14 user nova-compute[74960]:  {{(pid=74960) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 03 12:19:14 user nova-compute[74960]: DEBUG nova.compute.manager [req-4b190546-0155-4aa5-b372-fa9b6729dc74 req-3ec41ce2-6140-4b6a-a1e8-89ee0ccad8c6 service nova] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] Received event network-vif-plugged-31063379-2482-4339-9fb1-1468848af814 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:19:14 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-4b190546-0155-4aa5-b372-fa9b6729dc74 req-3ec41ce2-6140-4b6a-a1e8-89ee0ccad8c6 service nova] Acquiring lock "0a520c41-19c0-47ba-ada8-023ee9c12ca6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:19:14 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-4b190546-0155-4aa5-b372-fa9b6729dc74 req-3ec41ce2-6140-4b6a-a1e8-89ee0ccad8c6 service nova] Lock "0a520c41-19c0-47ba-ada8-023ee9c12ca6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:19:14 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-4b190546-0155-4aa5-b372-fa9b6729dc74 req-3ec41ce2-6140-4b6a-a1e8-89ee0ccad8c6 service nova] Lock "0a520c41-19c0-47ba-ada8-023ee9c12ca6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:19:14 user nova-compute[74960]: DEBUG nova.compute.manager [req-4b190546-0155-4aa5-b372-fa9b6729dc74 req-3ec41ce2-6140-4b6a-a1e8-89ee0ccad8c6 service nova] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] No waiting events found dispatching network-vif-plugged-31063379-2482-4339-9fb1-1468848af814 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:19:14 user nova-compute[74960]: WARNING nova.compute.manager [req-4b190546-0155-4aa5-b372-fa9b6729dc74 req-3ec41ce2-6140-4b6a-a1e8-89ee0ccad8c6 service nova] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] Received unexpected event network-vif-plugged-31063379-2482-4339-9fb1-1468848af814 for instance with vm_state active and task_state None.
Nov 03 12:19:15 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-ab4d0c5d-bdff-4340-aad1-8d3bb3fc7356 tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] No BDM found with device name vda, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:19:15 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-ab4d0c5d-bdff-4340-aad1-8d3bb3fc7356 tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:19:15 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-ab4d0c5d-bdff-4340-aad1-8d3bb3fc7356 tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] No VIF found with MAC fa:16:3e:7c:0d:76, not building metadata {{(pid=74960) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 12:19:16 user nova-compute[74960]: DEBUG nova.compute.manager [req-7c93fb0c-5c90-452a-9ca1-9b6d0671df2a req-9367828b-7aea-492a-9100-33e63f33ca3e service nova] [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea] Received event network-changed-ced0ad7a-92e5-4d88-8b6a-1f30efea310e {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:19:16 user nova-compute[74960]: DEBUG nova.compute.manager [req-7c93fb0c-5c90-452a-9ca1-9b6d0671df2a req-9367828b-7aea-492a-9100-33e63f33ca3e service nova] [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea] Refreshing instance network info cache due to event network-changed-ced0ad7a-92e5-4d88-8b6a-1f30efea310e. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 12:19:16 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-7c93fb0c-5c90-452a-9ca1-9b6d0671df2a req-9367828b-7aea-492a-9100-33e63f33ca3e service nova] Acquiring lock "refresh_cache-7f7fabc2-5e1b-441c-a693-9956470359ea" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:19:16 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-7c93fb0c-5c90-452a-9ca1-9b6d0671df2a req-9367828b-7aea-492a-9100-33e63f33ca3e service nova] Acquired lock "refresh_cache-7f7fabc2-5e1b-441c-a693-9956470359ea" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:19:16 user nova-compute[74960]: DEBUG nova.network.neutron [req-7c93fb0c-5c90-452a-9ca1-9b6d0671df2a req-9367828b-7aea-492a-9100-33e63f33ca3e service nova] [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea] Refreshing network info cache for port ced0ad7a-92e5-4d88-8b6a-1f30efea310e {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 12:19:17 user nova-compute[74960]: DEBUG nova.network.neutron [req-7c93fb0c-5c90-452a-9ca1-9b6d0671df2a req-9367828b-7aea-492a-9100-33e63f33ca3e service nova] [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea] Updated VIF entry in instance network info cache for port ced0ad7a-92e5-4d88-8b6a-1f30efea310e. {{(pid=74960) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 12:19:17 user nova-compute[74960]: DEBUG nova.network.neutron [req-7c93fb0c-5c90-452a-9ca1-9b6d0671df2a req-9367828b-7aea-492a-9100-33e63f33ca3e service nova] [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea] Updating instance_info_cache with network_info: [{"id": "ced0ad7a-92e5-4d88-8b6a-1f30efea310e", "address": "fa:16:3e:57:3d:47", "network": {"id": "c574281c-6841-42aa-9e46-d20e936c0d06", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2129338778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "225ccae506a541b3a766b70610efba47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapced0ad7a-92", "ovs_interfaceid": "ced0ad7a-92e5-4d88-8b6a-1f30efea310e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:19:17 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:19:17 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-7c93fb0c-5c90-452a-9ca1-9b6d0671df2a req-9367828b-7aea-492a-9100-33e63f33ca3e service nova] Releasing lock "refresh_cache-7f7fabc2-5e1b-441c-a693-9956470359ea" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:19:17 user nova-compute[74960]: DEBUG os_brick.utils [None req-b1a81923-db20-4b79-a81e-e00e13e234e1 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:19:17 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:19:17 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:19:17 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[540e524e-f301-4f44-89c1-baa604d88dc6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:75b8e219756\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:19:17 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:19:17 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:19:17 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[d09736da-c28c-4228-9118-e17dfb5388be]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:19:17 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:19:17 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:19:17 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[40242da3-f1e5-4b10-a9e8-369b20691105]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:19:17 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd425380-06d1-4903-a63c-bcf40ba1323b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:19:17 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-b1a81923-db20-4b79-a81e-e00e13e234e1 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Running cmd (subprocess): nvme version {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:19:17 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-b1a81923-db20-4b79-a81e-e00e13e234e1 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] 'nvme version' failed. Not Retrying. {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 12:19:17 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b1a81923-db20-4b79-a81e-e00e13e234e1 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] nvme not present on system {{(pid=74960) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 12:19:17 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:19:17 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:19:17 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 12:19:17 user nova-compute[74960]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 12:19:17 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e8013b1-0ca8-4f22-84d0-b92aeca0860e]: (4, '') {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:19:17 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-b1a81923-db20-4b79-a81e-e00e13e234e1 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74960) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 12:19:17 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-b1a81923-db20-4b79-a81e-e00e13e234e1 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74960) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 12:19:17 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-b1a81923-db20-4b79-a81e-e00e13e234e1 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] LIGHTOS: no hostnqn found. {{(pid=74960) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 12:19:17 user nova-compute[74960]: DEBUG os_brick.utils [None req-b1a81923-db20-4b79-a81e-e00e13e234e1 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:75b8e219756', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:19:17 user nova-compute[74960]: DEBUG nova.virt.block_device [None req-b1a81923-db20-4b79-a81e-e00e13e234e1 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] [instance: d00a0872-693c-4cdc-85cd-9806660e9d8d] Updating existing volume attachment record: 44038c75-b30d-43ee-ba58-73f0b40d9a5e {{(pid=74960) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 12:19:22 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:19:22 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:19:23 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8da754b6-f6b3-430c-9b97-fd62123ab4f3 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] [instance: e91dfcf4-caef-43d0-a56b-b1282363d4e0] Calling os-brick to attach iSCSI Volume {{(pid=74960) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 12:19:23 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-8da754b6-f6b3-430c-9b97-fd62123ab4f3 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9aa420acb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:20d9e4ca-e4a0-404c-93a8-783525cbf863', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hSgODaQT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:19:23 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-8da754b6-f6b3-430c-9b97-fd62123ab4f3 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:19:23 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-8da754b6-f6b3-430c-9b97-fd62123ab4f3 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:19:23 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-8da754b6-f6b3-430c-9b97-fd62123ab4f3 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:19:23 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-8da754b6-f6b3-430c-9b97-fd62123ab4f3 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:19:23 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-8da754b6-f6b3-430c-9b97-fd62123ab4f3 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20d9e4ca-e4a0-404c-93a8-783525cbf863" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:19:23 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-8da754b6-f6b3-430c-9b97-fd62123ab4f3 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20d9e4ca-e4a0-404c-93a8-783525cbf863" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:19:23 user nova-compute[74960]: INFO os_brick.initiator.connectors.iscsi [None req-8da754b6-f6b3-430c-9b97-fd62123ab4f3 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 12:19:23 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20d9e4ca-e4a0-404c-93a8-783525cbf863 -p 172.16.0.220:3260 {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:19:23 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20d9e4ca-e4a0-404c-93a8-783525cbf863 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:19:23 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae388034-6140-4e61-b8bb-23163159015a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:19:23 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-8da754b6-f6b3-430c-9b97-fd62123ab4f3 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 12:19:23 user nova-compute[74960]:  {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:19:23 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20d9e4ca-e4a0-404c-93a8-783525cbf863 -p 172.16.0.220:3260 --interface default --op new {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:19:23 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20d9e4ca-e4a0-404c-93a8-783525cbf863 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:19:23 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e776cc3-9772-4d85-b60d-8b289f088d55]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:20d9e4ca-e4a0-404c-93a8-783525cbf863] added\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:19:23 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-8da754b6-f6b3-430c-9b97-fd62123ab4f3 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:20d9e4ca-e4a0-404c-93a8-783525cbf863] added
Nov 03 12:19:23 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:19:23 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20d9e4ca-e4a0-404c-93a8-783525cbf863 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:19:23 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20d9e4ca-e4a0-404c-93a8-783525cbf863 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:19:23 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0d36973-6d4e-4dd3-8890-6aac1d12ce76]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:19:23 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-8da754b6-f6b3-430c-9b97-fd62123ab4f3 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:19:23 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20d9e4ca-e4a0-404c-93a8-783525cbf863 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:19:23 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-343f88ba-1274-4b5e-911d-e27d7d44e2a9 tempest-VolumesAssistedSnapshotsTest-464837836 tempest-VolumesAssistedSnapshotsTest-464837836-project-admin] Acquiring lock "7f7fabc2-5e1b-441c-a693-9956470359ea" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:19:23 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-343f88ba-1274-4b5e-911d-e27d7d44e2a9 tempest-VolumesAssistedSnapshotsTest-464837836 tempest-VolumesAssistedSnapshotsTest-464837836-project-admin] Lock "7f7fabc2-5e1b-441c-a693-9956470359ea" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:19:23 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20d9e4ca-e4a0-404c-93a8-783525cbf863 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:19:23 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[206636b5-90ee-42e3-8a7f-66bab4005d5a]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:19:23 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-8da754b6-f6b3-430c-9b97-fd62123ab4f3 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:19:23 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20d9e4ca-e4a0-404c-93a8-783525cbf863 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hSgODaQT {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:19:23 user nova-compute[74960]: DEBUG nova.objects.instance [None req-343f88ba-1274-4b5e-911d-e27d7d44e2a9 tempest-VolumesAssistedSnapshotsTest-464837836 tempest-VolumesAssistedSnapshotsTest-464837836-project-admin] Lazy-loading 'flavor' on Instance uuid 7f7fabc2-5e1b-441c-a693-9956470359ea {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:19:23 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20d9e4ca-e4a0-404c-93a8-783525cbf863 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hSgODaQT" returned: 0 in 0.022s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:19:23 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[12bb498c-58b6-4d9b-acab-61cc8c11cead]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:19:23 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-8da754b6-f6b3-430c-9b97-fd62123ab4f3 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hSgODaQT'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:19:23 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20d9e4ca-e4a0-404c-93a8-783525cbf863 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:19:23 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20d9e4ca-e4a0-404c-93a8-783525cbf863 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:19:23 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[72e9a9d0-13aa-4cab-b37d-1ce48978f235]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:19:23 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-8da754b6-f6b3-430c-9b97-fd62123ab4f3 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:19:23 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:19:23 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:19:23 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[7195de40-30af-4e7b-a9dc-da70337e563e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:801f5055-02d8-4d35-ba25-3052149a0e1b (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:19:23 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-8da754b6-f6b3-430c-9b97-fd62123ab4f3 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:801f5055-02d8-4d35-ba25-3052149a0e1b (non-flash)
Nov 03 12:19:23 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:19:23 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-8da754b6-f6b3-430c-9b97-fd62123ab4f3 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:801f5055-02d8-4d35-ba25-3052149a0e1b (non-flash)
Nov 03 12:19:23 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:19:23 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20d9e4ca-e4a0-404c-93a8-783525cbf863 -p 172.16.0.220:3260 --login {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:19:23 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-343f88ba-1274-4b5e-911d-e27d7d44e2a9 tempest-VolumesAssistedSnapshotsTest-464837836 tempest-VolumesAssistedSnapshotsTest-464837836-project-admin] Lock "7f7fabc2-5e1b-441c-a693-9956470359ea" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.103s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:19:23 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20d9e4ca-e4a0-404c-93a8-783525cbf863 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:19:23 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[232865ea-6405-4294-8a40-08cdac458bf4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:20d9e4ca-e4a0-404c-93a8-783525cbf863, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:20d9e4ca-e4a0-404c-93a8-783525cbf863, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:19:23 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-8da754b6-f6b3-430c-9b97-fd62123ab4f3 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:20d9e4ca-e4a0-404c-93a8-783525cbf863, portal: 172.16.0.220,3260]
Nov 03 12:19:23 user nova-compute[74960]: Login to [iface: default, target: iqn.2010-10.org.openstack:20d9e4ca-e4a0-404c-93a8-783525cbf863, portal: 172.16.0.220,3260] successful.
Nov 03 12:19:23 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:19:23 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20d9e4ca-e4a0-404c-93a8-783525cbf863 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:19:23 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20d9e4ca-e4a0-404c-93a8-783525cbf863 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.038s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:19:23 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[5707e4d4-a54c-4587-85fe-ed2f23eb1c6c]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:19:23 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-8da754b6-f6b3-430c-9b97-fd62123ab4f3 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:19:23 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:19:23 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-ab4d0c5d-bdff-4340-aad1-8d3bb3fc7356 tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Lock "39e6c635-4602-4ed6-abbd-80c96f056715" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 45.809s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:19:23 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:19:23 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[0576529b-af4f-4bcd-a80e-e852a7063634]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:801f5055-02d8-4d35-ba25-3052149a0e1b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d9e4ca-e4a0-404c-93a8-783525cbf863 (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:19:23 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-8da754b6-f6b3-430c-9b97-fd62123ab4f3 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:801f5055-02d8-4d35-ba25-3052149a0e1b (non-flash)
Nov 03 12:19:23 user nova-compute[74960]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d9e4ca-e4a0-404c-93a8-783525cbf863 (non-flash)
Nov 03 12:19:23 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:19:23 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-8da754b6-f6b3-430c-9b97-fd62123ab4f3 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:801f5055-02d8-4d35-ba25-3052149a0e1b (non-flash)
Nov 03 12:19:23 user nova-compute[74960]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d9e4ca-e4a0-404c-93a8-783525cbf863 (non-flash)
Nov 03 12:19:23 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:19:23 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-8da754b6-f6b3-430c-9b97-fd62123ab4f3 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20d9e4ca-e4a0-404c-93a8-783525cbf863" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.312s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:19:23 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-8da754b6-f6b3-430c-9b97-fd62123ab4f3 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Connected to 172.16.0.220:3260 {{(pid=74960) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 12:19:23 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-8da754b6-f6b3-430c-9b97-fd62123ab4f3 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=74960) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 12:19:23 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-8da754b6-f6b3-430c-9b97-fd62123ab4f3 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74960) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 12:19:23 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:19:23 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:19:23 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[f37d9ab7-b3d4-4146-9447-6d03e85d28e3]: (4, ('- - 0', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:19:23 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-8da754b6-f6b3-430c-9b97-fd62123ab4f3 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74960) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 12:19:23 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-8da754b6-f6b3-430c-9b97-fd62123ab4f3 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:20d9e4ca-e4a0-404c-93a8-783525cbf863', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hSgODaQT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74960) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 12:19:23 user nova-compute[74960]: INFO nova.virt.block_device [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04] Booting with volume 99fe1d66-0918-46bd-81e1-d870ffc464b4 at /dev/vdb
Nov 03 12:19:24 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-8da754b6-f6b3-430c-9b97-fd62123ab4f3 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.347s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:19:24 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-8da754b6-f6b3-430c-9b97-fd62123ab4f3 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] <== connect_volume: return (1350ms) {'type': 'block', 'scsi_wwn': '26231633338653834', 'path': '/dev/sdc'} {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:19:24 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8da754b6-f6b3-430c-9b97-fd62123ab4f3 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] [instance: e91dfcf4-caef-43d0-a56b-b1282363d4e0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26231633338653834', 'path': '/dev/sdc'} {{(pid=74960) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 12:19:24 user nova-compute[74960]: DEBUG nova.objects.instance [None req-8da754b6-f6b3-430c-9b97-fd62123ab4f3 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Lazy-loading 'flavor' on Instance uuid e91dfcf4-caef-43d0-a56b-b1282363d4e0 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:19:24 user nova-compute[74960]: DEBUG nova.virt.libvirt.guest [None req-8da754b6-f6b3-430c-9b97-fd62123ab4f3 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] attach device xml: <disk type="block" device="disk">
Nov 03 12:19:24 user nova-compute[74960]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 12:19:24 user nova-compute[74960]:   <source dev="/dev/sdc"/>
Nov 03 12:19:24 user nova-compute[74960]:   <target dev="vdb" bus="virtio"/>
Nov 03 12:19:24 user nova-compute[74960]:   <serial>20d9e4ca-e4a0-404c-93a8-783525cbf863</serial>
Nov 03 12:19:24 user nova-compute[74960]: </disk>
Nov 03 12:19:24 user nova-compute[74960]:  {{(pid=74960) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 03 12:19:25 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-8da754b6-f6b3-430c-9b97-fd62123ab4f3 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] No BDM found with device name vda, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:19:25 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-8da754b6-f6b3-430c-9b97-fd62123ab4f3 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:19:25 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-8da754b6-f6b3-430c-9b97-fd62123ab4f3 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] No VIF found with MAC fa:16:3e:ef:a8:ac, not building metadata {{(pid=74960) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 12:19:27 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:19:27 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:19:32 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:19:32 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:19:35 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:19:37 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:19:37 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:19:38 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dcfd168c-dfe0-4911-8951-580b499e589d tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] Calling os-brick to attach iSCSI Volume {{(pid=74960) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 12:19:38 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcfd168c-dfe0-4911-8951-580b499e589d tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9aa420acb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:27e9e6ae-69f2-4849-ab0c-0b7f9fc18990', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PHLOWQjV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:19:38 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-dcfd168c-dfe0-4911-8951-580b499e589d tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:19:38 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-dcfd168c-dfe0-4911-8951-580b499e589d tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:19:38 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-dcfd168c-dfe0-4911-8951-580b499e589d tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:19:38 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-dcfd168c-dfe0-4911-8951-580b499e589d tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:19:38 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-dcfd168c-dfe0-4911-8951-580b499e589d tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27e9e6ae-69f2-4849-ab0c-0b7f9fc18990" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:19:38 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-dcfd168c-dfe0-4911-8951-580b499e589d tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27e9e6ae-69f2-4849-ab0c-0b7f9fc18990" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:19:38 user nova-compute[74960]: INFO os_brick.initiator.connectors.iscsi [None req-dcfd168c-dfe0-4911-8951-580b499e589d tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 12:19:38 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27e9e6ae-69f2-4849-ab0c-0b7f9fc18990 -p 172.16.0.220:3260 {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:19:38 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27e9e6ae-69f2-4849-ab0c-0b7f9fc18990 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:19:38 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a800e15-400a-41e4-8727-02b7ed944425]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:19:38 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcfd168c-dfe0-4911-8951-580b499e589d tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 12:19:38 user nova-compute[74960]:  {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:19:38 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27e9e6ae-69f2-4849-ab0c-0b7f9fc18990 -p 172.16.0.220:3260 --interface default --op new {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:19:38 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27e9e6ae-69f2-4849-ab0c-0b7f9fc18990 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:19:38 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[60044fe0-66ae-4406-b02b-52eb5752fba5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:27e9e6ae-69f2-4849-ab0c-0b7f9fc18990] added\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:19:38 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcfd168c-dfe0-4911-8951-580b499e589d tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:27e9e6ae-69f2-4849-ab0c-0b7f9fc18990] added
Nov 03 12:19:38 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:19:38 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27e9e6ae-69f2-4849-ab0c-0b7f9fc18990 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:19:38 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27e9e6ae-69f2-4849-ab0c-0b7f9fc18990 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:19:38 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c2591d6-4235-40d5-82b3-1dc0a13624f0]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:19:38 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcfd168c-dfe0-4911-8951-580b499e589d tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:19:38 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27e9e6ae-69f2-4849-ab0c-0b7f9fc18990 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:19:38 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27e9e6ae-69f2-4849-ab0c-0b7f9fc18990 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:19:38 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a599527-1d91-4b5c-9057-4274d3bbba4c]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:19:38 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcfd168c-dfe0-4911-8951-580b499e589d tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:19:38 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27e9e6ae-69f2-4849-ab0c-0b7f9fc18990 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PHLOWQjV {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:19:38 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:19:38 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27e9e6ae-69f2-4849-ab0c-0b7f9fc18990 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PHLOWQjV" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:19:38 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[299f99db-2392-4276-bef5-813d2e67a5df]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:19:38 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcfd168c-dfe0-4911-8951-580b499e589d tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PHLOWQjV'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:19:38 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27e9e6ae-69f2-4849-ab0c-0b7f9fc18990 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:19:38 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27e9e6ae-69f2-4849-ab0c-0b7f9fc18990 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:19:38 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[416ea2d3-6959-4fe2-9217-ab2285c946cd]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:19:38 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcfd168c-dfe0-4911-8951-580b499e589d tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:19:38 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:19:38 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:19:38 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[19084f26-5c9c-412c-93ae-ba1c7d6d9f14]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:801f5055-02d8-4d35-ba25-3052149a0e1b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d9e4ca-e4a0-404c-93a8-783525cbf863 (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:19:38 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcfd168c-dfe0-4911-8951-580b499e589d tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:801f5055-02d8-4d35-ba25-3052149a0e1b (non-flash)
Nov 03 12:19:38 user nova-compute[74960]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d9e4ca-e4a0-404c-93a8-783525cbf863 (non-flash)
Nov 03 12:19:38 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:19:38 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcfd168c-dfe0-4911-8951-580b499e589d tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:801f5055-02d8-4d35-ba25-3052149a0e1b (non-flash)
Nov 03 12:19:38 user nova-compute[74960]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d9e4ca-e4a0-404c-93a8-783525cbf863 (non-flash)
Nov 03 12:19:38 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:19:38 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27e9e6ae-69f2-4849-ab0c-0b7f9fc18990 -p 172.16.0.220:3260 --login {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:19:38 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27e9e6ae-69f2-4849-ab0c-0b7f9fc18990 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:19:38 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[516df221-996a-4f6c-9324-c8109031c8a3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:27e9e6ae-69f2-4849-ab0c-0b7f9fc18990, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:27e9e6ae-69f2-4849-ab0c-0b7f9fc18990, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:19:38 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcfd168c-dfe0-4911-8951-580b499e589d tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:27e9e6ae-69f2-4849-ab0c-0b7f9fc18990, portal: 172.16.0.220,3260]
Nov 03 12:19:38 user nova-compute[74960]: Login to [iface: default, target: iqn.2010-10.org.openstack:27e9e6ae-69f2-4849-ab0c-0b7f9fc18990, portal: 172.16.0.220,3260] successful.
Nov 03 12:19:38 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:19:38 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27e9e6ae-69f2-4849-ab0c-0b7f9fc18990 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:19:38 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27e9e6ae-69f2-4849-ab0c-0b7f9fc18990 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:19:38 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[f94676c9-3468-4143-afbc-f807508f8ea8]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:19:38 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcfd168c-dfe0-4911-8951-580b499e589d tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:19:38 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:19:38 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:19:38 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa37c82c-1aba-42bc-96b5-49044514b8ac]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:801f5055-02d8-4d35-ba25-3052149a0e1b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d9e4ca-e4a0-404c-93a8-783525cbf863 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27e9e6ae-69f2-4849-ab0c-0b7f9fc18990 (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:19:38 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcfd168c-dfe0-4911-8951-580b499e589d tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:801f5055-02d8-4d35-ba25-3052149a0e1b (non-flash)
Nov 03 12:19:38 user nova-compute[74960]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d9e4ca-e4a0-404c-93a8-783525cbf863 (non-flash)
Nov 03 12:19:38 user nova-compute[74960]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27e9e6ae-69f2-4849-ab0c-0b7f9fc18990 (non-flash)
Nov 03 12:19:38 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:19:38 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcfd168c-dfe0-4911-8951-580b499e589d tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:801f5055-02d8-4d35-ba25-3052149a0e1b (non-flash)
Nov 03 12:19:38 user nova-compute[74960]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d9e4ca-e4a0-404c-93a8-783525cbf863 (non-flash)
Nov 03 12:19:38 user nova-compute[74960]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27e9e6ae-69f2-4849-ab0c-0b7f9fc18990 (non-flash)
Nov 03 12:19:38 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:19:38 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-dcfd168c-dfe0-4911-8951-580b499e589d tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27e9e6ae-69f2-4849-ab0c-0b7f9fc18990" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:19:38 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcfd168c-dfe0-4911-8951-580b499e589d tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Connected to 172.16.0.220:3260 {{(pid=74960) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 12:19:38 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-dcfd168c-dfe0-4911-8951-580b499e589d tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=74960) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 12:19:38 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-dcfd168c-dfe0-4911-8951-580b499e589d tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74960) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 12:19:38 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:19:38 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:19:38 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[12fa7056-526b-47f9-91dc-278ec5a7a5bc]: (4, ('- - 0', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:19:38 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-dcfd168c-dfe0-4911-8951-580b499e589d tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74960) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 12:19:38 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcfd168c-dfe0-4911-8951-580b499e589d tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:27e9e6ae-69f2-4849-ab0c-0b7f9fc18990', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PHLOWQjV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74960) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 12:19:38 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-8da754b6-f6b3-430c-9b97-fd62123ab4f3 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Lock "e91dfcf4-caef-43d0-a56b-b1282363d4e0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 35.822s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:19:38 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-343f88ba-1274-4b5e-911d-e27d7d44e2a9 tempest-VolumesAssistedSnapshotsTest-464837836 tempest-VolumesAssistedSnapshotsTest-464837836-project-admin] Acquiring lock "7f7fabc2-5e1b-441c-a693-9956470359ea" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:19:38 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-343f88ba-1274-4b5e-911d-e27d7d44e2a9 tempest-VolumesAssistedSnapshotsTest-464837836 tempest-VolumesAssistedSnapshotsTest-464837836-project-admin] Lock "7f7fabc2-5e1b-441c-a693-9956470359ea" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:19:38 user nova-compute[74960]: INFO nova.compute.manager [None req-343f88ba-1274-4b5e-911d-e27d7d44e2a9 tempest-VolumesAssistedSnapshotsTest-464837836 tempest-VolumesAssistedSnapshotsTest-464837836-project-admin] [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea] Attaching volume 52a35a52-65f0-484a-9ab9-903ed049026f to /dev/vdb
Nov 03 12:19:38 user nova-compute[74960]: DEBUG os_brick.utils [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:19:38 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:19:38 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:19:38 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b90aa6a-4944-4a3f-b2a7-a6ed84fa0673]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:75b8e219756\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:19:38 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:19:38 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:19:38 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[e45fc8ec-19b2-4ffd-ace7-7b5cc8fc6245]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:19:38 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:19:38 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:19:38 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2d661aa-108a-4640-85b2-55f66da96e02]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:19:38 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc127035-fafb-47b7-a810-168b3efbc689]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:19:38 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] Running cmd (subprocess): nvme version {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:19:38 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] 'nvme version' failed. Not Retrying. {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 12:19:38 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.nvmeof [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] nvme not present on system {{(pid=74960) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 12:19:38 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:19:38 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 12:19:38 user nova-compute[74960]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 12:19:38 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae4fd95e-7b02-422e-b237-d13f8016119a]: (4, '') {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:19:38 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74960) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 12:19:38 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74960) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 12:19:38 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] LIGHTOS: no hostnqn found. {{(pid=74960) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 12:19:38 user nova-compute[74960]: DEBUG os_brick.utils [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:75b8e219756', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:19:38 user nova-compute[74960]: DEBUG nova.virt.block_device [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04] Updating existing volume attachment record: 7d376e7c-04b7-4948-b832-104cfe28a8fb {{(pid=74960) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 12:19:38 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-e78062c2-8cd5-4f2d-a91b-c432a74f699c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Acquiring lock "39e6c635-4602-4ed6-abbd-80c96f056715" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:19:38 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-e78062c2-8cd5-4f2d-a91b-c432a74f699c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Lock "39e6c635-4602-4ed6-abbd-80c96f056715" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:19:38 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-e78062c2-8cd5-4f2d-a91b-c432a74f699c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Acquiring lock "39e6c635-4602-4ed6-abbd-80c96f056715-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:19:38 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-e78062c2-8cd5-4f2d-a91b-c432a74f699c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Lock "39e6c635-4602-4ed6-abbd-80c96f056715-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:19:38 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-e78062c2-8cd5-4f2d-a91b-c432a74f699c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Lock "39e6c635-4602-4ed6-abbd-80c96f056715-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:19:38 user nova-compute[74960]: INFO nova.compute.manager [None req-e78062c2-8cd5-4f2d-a91b-c432a74f699c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] [instance: 39e6c635-4602-4ed6-abbd-80c96f056715] Terminating instance
Nov 03 12:19:38 user nova-compute[74960]: DEBUG nova.compute.manager [None req-e78062c2-8cd5-4f2d-a91b-c432a74f699c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] [instance: 39e6c635-4602-4ed6-abbd-80c96f056715] Start destroying the instance on the hypervisor. {{(pid=74960) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 12:19:39 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:19:39 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:19:39 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:19:39 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:19:39 user nova-compute[74960]: DEBUG nova.compute.manager [req-7c7f303c-e9ca-4b05-83f5-9fd81e847e6a req-12b28bae-bcd2-4ff2-aea6-01072d84c9d5 service nova] [instance: 39e6c635-4602-4ed6-abbd-80c96f056715] Received event network-vif-unplugged-948c9582-33b7-486d-889a-65c37267d98d {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:19:39 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-7c7f303c-e9ca-4b05-83f5-9fd81e847e6a req-12b28bae-bcd2-4ff2-aea6-01072d84c9d5 service nova] Acquiring lock "39e6c635-4602-4ed6-abbd-80c96f056715-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:19:39 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-7c7f303c-e9ca-4b05-83f5-9fd81e847e6a req-12b28bae-bcd2-4ff2-aea6-01072d84c9d5 service nova] Lock "39e6c635-4602-4ed6-abbd-80c96f056715-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:19:39 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-7c7f303c-e9ca-4b05-83f5-9fd81e847e6a req-12b28bae-bcd2-4ff2-aea6-01072d84c9d5 service nova] Lock "39e6c635-4602-4ed6-abbd-80c96f056715-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:19:39 user nova-compute[74960]: DEBUG nova.compute.manager [req-7c7f303c-e9ca-4b05-83f5-9fd81e847e6a req-12b28bae-bcd2-4ff2-aea6-01072d84c9d5 service nova] [instance: 39e6c635-4602-4ed6-abbd-80c96f056715] No waiting events found dispatching network-vif-unplugged-948c9582-33b7-486d-889a-65c37267d98d {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:19:39 user nova-compute[74960]: DEBUG nova.compute.manager [req-7c7f303c-e9ca-4b05-83f5-9fd81e847e6a req-12b28bae-bcd2-4ff2-aea6-01072d84c9d5 service nova] [instance: 39e6c635-4602-4ed6-abbd-80c96f056715] Received event network-vif-unplugged-948c9582-33b7-486d-889a-65c37267d98d for instance with task_state deleting. {{(pid=74960) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 12:19:39 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-dcfd168c-dfe0-4911-8951-580b499e589d tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:19:39 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcfd168c-dfe0-4911-8951-580b499e589d tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '23538373462663731', 'path': '/dev/sdd'} {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:19:39 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dcfd168c-dfe0-4911-8951-580b499e589d tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23538373462663731', 'path': '/dev/sdd'} {{(pid=74960) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 12:19:39 user nova-compute[74960]: DEBUG nova.objects.instance [None req-dcfd168c-dfe0-4911-8951-580b499e589d tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Lazy-loading 'flavor' on Instance uuid 0a520c41-19c0-47ba-ada8-023ee9c12ca6 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:19:39 user nova-compute[74960]: DEBUG nova.virt.libvirt.guest [None req-dcfd168c-dfe0-4911-8951-580b499e589d tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] attach device xml: <disk type="block" device="disk">
Nov 03 12:19:39 user nova-compute[74960]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 12:19:39 user nova-compute[74960]:   <source dev="/dev/sdd"/>
Nov 03 12:19:39 user nova-compute[74960]:   <target dev="vdb" bus="virtio"/>
Nov 03 12:19:39 user nova-compute[74960]:   <serial>27e9e6ae-69f2-4849-ab0c-0b7f9fc18990</serial>
Nov 03 12:19:39 user nova-compute[74960]: </disk>
Nov 03 12:19:39 user nova-compute[74960]:  {{(pid=74960) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 03 12:19:39 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:19:39 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:19:40 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: 39e6c635-4602-4ed6-abbd-80c96f056715] Instance destroyed successfully.
Nov 03 12:19:40 user nova-compute[74960]: DEBUG nova.objects.instance [None req-e78062c2-8cd5-4f2d-a91b-c432a74f699c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Lazy-loading 'resources' on Instance uuid 39e6c635-4602-4ed6-abbd-80c96f056715 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:19:40 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-e78062c2-8cd5-4f2d-a91b-c432a74f699c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:16:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-2037102644',display_name='tempest-DeleteServersTestJSON-server-2037102644',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-2037102644',id=1,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-03T12:16:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='23bb45aea3d244e298d314a3c9800397',ramdisk_id='',reservation_id='r-99ri8kfh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-705662120',owner_user_name='tempest-DeleteServersTestJSON-705662120-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T12:16:56Z,user_data=None,user_id='ce5640786940482c9e01e3c5139cf013',uuid=39e6c635-4602-4ed6-abbd-80c96f056715,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "948c9582-33b7-486d-889a-65c37267d98d", "address": "fa:16:3e:7c:0d:76", "network": {"id": "accc48f4-76c2-486d-9494-27f72e339655", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1003203293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23bb45aea3d244e298d314a3c9800397", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap948c9582-33", "ovs_interfaceid": "948c9582-33b7-486d-889a-65c37267d98d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 12:19:40 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-e78062c2-8cd5-4f2d-a91b-c432a74f699c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Converting VIF {"id": "948c9582-33b7-486d-889a-65c37267d98d", "address": "fa:16:3e:7c:0d:76", "network": {"id": "accc48f4-76c2-486d-9494-27f72e339655", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1003203293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23bb45aea3d244e298d314a3c9800397", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap948c9582-33", "ovs_interfaceid": "948c9582-33b7-486d-889a-65c37267d98d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:19:40 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-e78062c2-8cd5-4f2d-a91b-c432a74f699c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7c:0d:76,bridge_name='br-int',has_traffic_filtering=True,id=948c9582-33b7-486d-889a-65c37267d98d,network=Network(accc48f4-76c2-486d-9494-27f72e339655),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap948c9582-33') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:19:40 user nova-compute[74960]: DEBUG os_vif [None req-e78062c2-8cd5-4f2d-a91b-c432a74f699c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:0d:76,bridge_name='br-int',has_traffic_filtering=True,id=948c9582-33b7-486d-889a-65c37267d98d,network=Network(accc48f4-76c2-486d-9494-27f72e339655),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap948c9582-33') {{(pid=74960) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 12:19:40 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:19:40 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap948c9582-33, bridge=br-int, if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:19:40 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:19:40 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:19:40 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:19:40 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=da44b5eb-caf3-461d-be11-28f17cd58808) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:19:40 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:19:40 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:19:40 user nova-compute[74960]: INFO os_vif [None req-e78062c2-8cd5-4f2d-a91b-c432a74f699c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:0d:76,bridge_name='br-int',has_traffic_filtering=True,id=948c9582-33b7-486d-889a-65c37267d98d,network=Network(accc48f4-76c2-486d-9494-27f72e339655),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap948c9582-33')
Nov 03 12:19:40 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e78062c2-8cd5-4f2d-a91b-c432a74f699c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] [instance: 39e6c635-4602-4ed6-abbd-80c96f056715] calling os-brick to detach iSCSI Volume {{(pid=74960) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 12:19:40 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-e78062c2-8cd5-4f2d-a91b-c432a74f699c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9aa420acb0>, {'target_iqn': 'iqn.2010-10.org.openstack:801f5055-02d8-4d35-ba25-3052149a0e1b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IdDaEuQn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:19:40 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-e78062c2-8cd5-4f2d-a91b-c432a74f699c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:19:40 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-e78062c2-8cd5-4f2d-a91b-c432a74f699c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:19:40 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-e78062c2-8cd5-4f2d-a91b-c432a74f699c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:19:40 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:19:40 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:19:40 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a89c798-baae-4b20-9612-1040578584f6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:27e9e6ae-69f2-4849-ab0c-0b7f9fc18990\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:801f5055-02d8-4d35-ba25-3052149a0e1b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:20d9e4ca-e4a0-404c-93a8-783525cbf863\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:19:40 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-e78062c2-8cd5-4f2d-a91b-c432a74f699c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 12:19:40 user nova-compute[74960]: No targets found.
Nov 03 12:19:40 user nova-compute[74960]: iSNS:
Nov 03 12:19:40 user nova-compute[74960]: No targets found.
Nov 03 12:19:40 user nova-compute[74960]: STATIC:
Nov 03 12:19:40 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:27e9e6ae-69f2-4849-ab0c-0b7f9fc18990
Nov 03 12:19:40 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:19:40 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:19:40 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:801f5055-02d8-4d35-ba25-3052149a0e1b
Nov 03 12:19:40 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:19:40 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:19:40 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:20d9e4ca-e4a0-404c-93a8-783525cbf863
Nov 03 12:19:40 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:19:40 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:19:40 user nova-compute[74960]: FIRMWARE:
Nov 03 12:19:40 user nova-compute[74960]: No targets found.
Nov 03 12:19:40 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:19:40 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-e78062c2-8cd5-4f2d-a91b-c432a74f699c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 12:19:40 user nova-compute[74960]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 12:19:40 user nova-compute[74960]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74960) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 12:19:40 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-e78062c2-8cd5-4f2d-a91b-c432a74f699c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:801f5055-02d8-4d35-ba25-3052149a0e1b', 0)] {{(pid=74960) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 12:19:40 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:19:40 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-dcfd168c-dfe0-4911-8951-580b499e589d tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] No BDM found with device name vda, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:19:40 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-dcfd168c-dfe0-4911-8951-580b499e589d tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] No BDM found with device name hda, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:19:40 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-dcfd168c-dfe0-4911-8951-580b499e589d tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] No VIF found with MAC fa:16:3e:f9:07:9b, not building metadata {{(pid=74960) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 12:19:40 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:19:40 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[e68d9aa7-5651-49f6-b796-a2ca75b07399]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20d9e4ca-e4a0-404c-93a8-783525cbf863\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27e9e6ae-69f2-4849-ab0c-0b7f9fc18990\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:801f5055-02d8-4d35-ba25-3052149a0e1b\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:19:40 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:19:40 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:19:40 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b7ad5d4-deaa-4dd9-9055-f7c03687a368]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:801f5055-02d8-4d35-ba25-3052149a0e1b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d9e4ca-e4a0-404c-93a8-783525cbf863 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27e9e6ae-69f2-4849-ab0c-0b7f9fc18990 (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:19:40 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-e78062c2-8cd5-4f2d-a91b-c432a74f699c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:801f5055-02d8-4d35-ba25-3052149a0e1b (non-flash)
Nov 03 12:19:40 user nova-compute[74960]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d9e4ca-e4a0-404c-93a8-783525cbf863 (non-flash)
Nov 03 12:19:40 user nova-compute[74960]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27e9e6ae-69f2-4849-ab0c-0b7f9fc18990 (non-flash)
Nov 03 12:19:40 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:19:40 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-e78062c2-8cd5-4f2d-a91b-c432a74f699c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:801f5055-02d8-4d35-ba25-3052149a0e1b (non-flash)
Nov 03 12:19:40 user nova-compute[74960]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d9e4ca-e4a0-404c-93a8-783525cbf863 (non-flash)
Nov 03 12:19:40 user nova-compute[74960]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27e9e6ae-69f2-4849-ab0c-0b7f9fc18990 (non-flash)
Nov 03 12:19:40 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:19:40 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-e78062c2-8cd5-4f2d-a91b-c432a74f699c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9aa42e1ea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:801f5055-02d8-4d35-ba25-3052149a0e1b'): ({'sdb'}, set())}) {{(pid=74960) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 12:19:40 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-e78062c2-8cd5-4f2d-a91b-c432a74f699c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Removing single pathed devices sdb {{(pid=74960) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 12:19:40 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:19:40 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:19:40 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcf87fdf-d851-4a44-9a73-e3c1ade13363]: (4, ('path checker states:\nup                  1\npending             2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:19:40 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:19:40 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:19:40 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:19:40 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdec3aa2-4c49-46cd-a1f2-1ffbb74b00b3]: (4, ('ok\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:19:40 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-e78062c2-8cd5-4f2d-a91b-c432a74f699c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Flushing IO for device /dev/sdb {{(pid=74960) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 12:19:40 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:19:40 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:19:40 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[75b4be22-22ad-4982-bc70-c8994892b661]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:19:40 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-e78062c2-8cd5-4f2d-a91b-c432a74f699c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74960) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 12:19:40 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:19:40 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:19:40 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef66347-9d90-40a0-aafe-006cacf31f68]: (4, ('1', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:19:40 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-e78062c2-8cd5-4f2d-a91b-c432a74f699c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74960) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 12:19:40 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-e78062c2-8cd5-4f2d-a91b-c432a74f699c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] SCSI volumes sdb have been removed. {{(pid=74960) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 12:19:40 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-e78062c2-8cd5-4f2d-a91b-c432a74f699c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:801f5055-02d8-4d35-ba25-3052149a0e1b')] {{(pid=74960) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 12:19:40 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:801f5055-02d8-4d35-ba25-3052149a0e1b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:19:40 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:801f5055-02d8-4d35-ba25-3052149a0e1b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:19:40 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9b92185-55af-480a-a30f-cf2bc0a60235]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:19:40 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-e78062c2-8cd5-4f2d-a91b-c432a74f699c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:19:40 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:801f5055-02d8-4d35-ba25-3052149a0e1b -p 172.16.0.220:3260 --logout {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:19:40 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:801f5055-02d8-4d35-ba25-3052149a0e1b -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:19:40 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[0854ce5a-6cdd-42a9-b6ee-b146dccd5917]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:801f5055-02d8-4d35-ba25-3052149a0e1b, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:801f5055-02d8-4d35-ba25-3052149a0e1b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:19:40 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-e78062c2-8cd5-4f2d-a91b-c432a74f699c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:801f5055-02d8-4d35-ba25-3052149a0e1b, portal: 172.16.0.220,3260]
Nov 03 12:19:40 user nova-compute[74960]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:801f5055-02d8-4d35-ba25-3052149a0e1b, portal: 172.16.0.220,3260] successful.
Nov 03 12:19:40 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:19:40 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:801f5055-02d8-4d35-ba25-3052149a0e1b -p 172.16.0.220:3260 --op delete {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:19:40 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:801f5055-02d8-4d35-ba25-3052149a0e1b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:19:40 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ccc80c7-5fd3-4a87-b8ee-249d7093909d]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:19:40 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-e78062c2-8cd5-4f2d-a91b-c432a74f699c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:19:40 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-e78062c2-8cd5-4f2d-a91b-c432a74f699c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:19:40 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-e78062c2-8cd5-4f2d-a91b-c432a74f699c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] <== disconnect_volume: return (316ms) None {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:19:40 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e78062c2-8cd5-4f2d-a91b-c432a74f699c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] [instance: 39e6c635-4602-4ed6-abbd-80c96f056715] Disconnected iSCSI Volume {{(pid=74960) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 12:19:40 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-e78062c2-8cd5-4f2d-a91b-c432a74f699c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] [instance: 39e6c635-4602-4ed6-abbd-80c96f056715] Deleting instance files /opt/stack/data/nova/instances/39e6c635-4602-4ed6-abbd-80c96f056715_del
Nov 03 12:19:40 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-e78062c2-8cd5-4f2d-a91b-c432a74f699c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] [instance: 39e6c635-4602-4ed6-abbd-80c96f056715] Deletion of /opt/stack/data/nova/instances/39e6c635-4602-4ed6-abbd-80c96f056715_del complete
Nov 03 12:19:40 user nova-compute[74960]: INFO nova.compute.manager [None req-e78062c2-8cd5-4f2d-a91b-c432a74f699c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] [instance: 39e6c635-4602-4ed6-abbd-80c96f056715] Took 1.63 seconds to destroy the instance on the hypervisor.
Nov 03 12:19:40 user nova-compute[74960]: DEBUG oslo.service.loopingcall [None req-e78062c2-8cd5-4f2d-a91b-c432a74f699c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74960) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 12:19:40 user nova-compute[74960]: DEBUG nova.compute.manager [-] [instance: 39e6c635-4602-4ed6-abbd-80c96f056715] Deallocating network for instance {{(pid=74960) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 12:19:40 user nova-compute[74960]: DEBUG nova.network.neutron [-] [instance: 39e6c635-4602-4ed6-abbd-80c96f056715] deallocate_for_instance() {{(pid=74960) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 12:19:41 user nova-compute[74960]: DEBUG nova.compute.manager [req-0e8ec532-45c1-49c6-8597-5b7441db2b1b req-c7a084ac-07dc-407a-b210-65310840b13c service nova] [instance: 39e6c635-4602-4ed6-abbd-80c96f056715] Received event network-vif-plugged-948c9582-33b7-486d-889a-65c37267d98d {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:19:41 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-0e8ec532-45c1-49c6-8597-5b7441db2b1b req-c7a084ac-07dc-407a-b210-65310840b13c service nova] Acquiring lock "39e6c635-4602-4ed6-abbd-80c96f056715-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:19:41 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-0e8ec532-45c1-49c6-8597-5b7441db2b1b req-c7a084ac-07dc-407a-b210-65310840b13c service nova] Lock "39e6c635-4602-4ed6-abbd-80c96f056715-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:19:41 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-0e8ec532-45c1-49c6-8597-5b7441db2b1b req-c7a084ac-07dc-407a-b210-65310840b13c service nova] Lock "39e6c635-4602-4ed6-abbd-80c96f056715-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:19:41 user nova-compute[74960]: DEBUG nova.compute.manager [req-0e8ec532-45c1-49c6-8597-5b7441db2b1b req-c7a084ac-07dc-407a-b210-65310840b13c service nova] [instance: 39e6c635-4602-4ed6-abbd-80c96f056715] No waiting events found dispatching network-vif-plugged-948c9582-33b7-486d-889a-65c37267d98d {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:19:41 user nova-compute[74960]: WARNING nova.compute.manager [req-0e8ec532-45c1-49c6-8597-5b7441db2b1b req-c7a084ac-07dc-407a-b210-65310840b13c service nova] [instance: 39e6c635-4602-4ed6-abbd-80c96f056715] Received unexpected event network-vif-plugged-948c9582-33b7-486d-889a-65c37267d98d for instance with vm_state active and task_state deleting.
Nov 03 12:19:41 user nova-compute[74960]: DEBUG nova.compute.manager [req-c2cbd41f-be25-48ce-9fb9-341c58082527 req-5b1f1b1e-3323-4444-98bd-daa125622fb9 service nova] [instance: 39e6c635-4602-4ed6-abbd-80c96f056715] Received event network-vif-deleted-948c9582-33b7-486d-889a-65c37267d98d {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:19:41 user nova-compute[74960]: INFO nova.compute.manager [req-c2cbd41f-be25-48ce-9fb9-341c58082527 req-5b1f1b1e-3323-4444-98bd-daa125622fb9 service nova] [instance: 39e6c635-4602-4ed6-abbd-80c96f056715] Neutron deleted interface 948c9582-33b7-486d-889a-65c37267d98d; detaching it from the instance and deleting it from the info cache
Nov 03 12:19:41 user nova-compute[74960]: DEBUG nova.network.neutron [req-c2cbd41f-be25-48ce-9fb9-341c58082527 req-5b1f1b1e-3323-4444-98bd-daa125622fb9 service nova] [instance: 39e6c635-4602-4ed6-abbd-80c96f056715] Updating instance_info_cache with network_info: [] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:19:41 user nova-compute[74960]: DEBUG nova.network.neutron [-] [instance: 39e6c635-4602-4ed6-abbd-80c96f056715] Updating instance_info_cache with network_info: [] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:19:41 user nova-compute[74960]: INFO nova.compute.manager [-] [instance: 39e6c635-4602-4ed6-abbd-80c96f056715] Took 0.90 seconds to deallocate network for instance.
Nov 03 12:19:41 user nova-compute[74960]: DEBUG nova.compute.manager [req-c2cbd41f-be25-48ce-9fb9-341c58082527 req-5b1f1b1e-3323-4444-98bd-daa125622fb9 service nova] [instance: 39e6c635-4602-4ed6-abbd-80c96f056715] Detach interface failed, port_id=948c9582-33b7-486d-889a-65c37267d98d, reason: Instance 39e6c635-4602-4ed6-abbd-80c96f056715 could not be found. {{(pid=74960) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 03 12:19:42 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:19:42 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Starting heal instance info cache {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 12:19:42 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:19:42 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "refresh_cache-7769e3c5-136f-4282-8e3e-224e3a80922c" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:19:42 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquired lock "refresh_cache-7769e3c5-136f-4282-8e3e-224e3a80922c" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:19:42 user nova-compute[74960]: DEBUG nova.network.neutron [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: 7769e3c5-136f-4282-8e3e-224e3a80922c] Forcefully refreshing network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 12:19:43 user nova-compute[74960]: DEBUG nova.network.neutron [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: 7769e3c5-136f-4282-8e3e-224e3a80922c] Updating instance_info_cache with network_info: [{"id": "8fe46c5c-9093-43c4-8b0d-baf325c2e18b", "address": "fa:16:3e:ba:d5:3a", "network": {"id": "9c5fae09-5df5-45a3-b9cd-7ac3763ba878", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1736223258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5320673ee4f0422989a3708915375cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fe46c5c-90", "ovs_interfaceid": "8fe46c5c-9093-43c4-8b0d-baf325c2e18b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:19:43 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Releasing lock "refresh_cache-7769e3c5-136f-4282-8e3e-224e3a80922c" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:19:43 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: 7769e3c5-136f-4282-8e3e-224e3a80922c] Updated the network info_cache for instance {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 12:19:43 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:19:43 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:19:43 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74960) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 12:19:43 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:19:43 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:19:43 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:19:43 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:19:43 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Auditing locally available compute resources for user (node: user) {{(pid=74960) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 12:19:43 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d00a0872-693c-4cdc-85cd-9806660e9d8d/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:19:43 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d00a0872-693c-4cdc-85cd-9806660e9d8d/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:19:43 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d00a0872-693c-4cdc-85cd-9806660e9d8d/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:19:43 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d00a0872-693c-4cdc-85cd-9806660e9d8d/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:19:43 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05956d9b-0646-43d2-a4cd-19e9090020ee/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:19:44 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05956d9b-0646-43d2-a4cd-19e9090020ee/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:19:44 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05956d9b-0646-43d2-a4cd-19e9090020ee/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:19:44 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05956d9b-0646-43d2-a4cd-19e9090020ee/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:19:44 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7769e3c5-136f-4282-8e3e-224e3a80922c/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:19:44 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7769e3c5-136f-4282-8e3e-224e3a80922c/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:19:44 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7769e3c5-136f-4282-8e3e-224e3a80922c/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:19:44 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7769e3c5-136f-4282-8e3e-224e3a80922c/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:19:44 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8381c969-6a2d-4934-aadd-660ffa246b05/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:19:44 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1a81923-db20-4b79-a81e-e00e13e234e1 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] [instance: d00a0872-693c-4cdc-85cd-9806660e9d8d] Calling os-brick to attach iSCSI Volume {{(pid=74960) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 12:19:44 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a81923-db20-4b79-a81e-e00e13e234e1 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9aa420acb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:967d5abf-c746-43a2-936e-e1abdc8475c3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'znIrGpMY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:19:44 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-b1a81923-db20-4b79-a81e-e00e13e234e1 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:19:44 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-b1a81923-db20-4b79-a81e-e00e13e234e1 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:19:44 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-b1a81923-db20-4b79-a81e-e00e13e234e1 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:19:44 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-b1a81923-db20-4b79-a81e-e00e13e234e1 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:19:44 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-b1a81923-db20-4b79-a81e-e00e13e234e1 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:967d5abf-c746-43a2-936e-e1abdc8475c3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:19:44 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-b1a81923-db20-4b79-a81e-e00e13e234e1 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:967d5abf-c746-43a2-936e-e1abdc8475c3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:19:44 user nova-compute[74960]: INFO os_brick.initiator.connectors.iscsi [None req-b1a81923-db20-4b79-a81e-e00e13e234e1 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 12:19:44 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:967d5abf-c746-43a2-936e-e1abdc8475c3 -p 172.16.0.220:3260 {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:19:44 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:967d5abf-c746-43a2-936e-e1abdc8475c3 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:19:44 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[b607b3f5-a181-4f35-884e-d6ddf9991dc5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:19:44 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a81923-db20-4b79-a81e-e00e13e234e1 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 12:19:44 user nova-compute[74960]:  {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:19:44 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:967d5abf-c746-43a2-936e-e1abdc8475c3 -p 172.16.0.220:3260 --interface default --op new {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:19:44 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:967d5abf-c746-43a2-936e-e1abdc8475c3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:19:44 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[44aefda9-9565-48e9-9c4a-521d25113bd8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:967d5abf-c746-43a2-936e-e1abdc8475c3] added\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:19:44 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a81923-db20-4b79-a81e-e00e13e234e1 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:967d5abf-c746-43a2-936e-e1abdc8475c3] added
Nov 03 12:19:44 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:19:44 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:967d5abf-c746-43a2-936e-e1abdc8475c3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:19:44 user nova-compute[74960]: DEBUG os_brick.utils [None req-343f88ba-1274-4b5e-911d-e27d7d44e2a9 tempest-VolumesAssistedSnapshotsTest-464837836 tempest-VolumesAssistedSnapshotsTest-464837836-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:19:44 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:19:44 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:967d5abf-c746-43a2-936e-e1abdc8475c3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:19:44 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a6b1521-ae5c-4cbc-b4a3-0f69deb77a12]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:19:44 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a81923-db20-4b79-a81e-e00e13e234e1 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:19:44 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:967d5abf-c746-43a2-936e-e1abdc8475c3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:19:44 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:19:44 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bc54234-157e-47d2-9c27-8b080f83236a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:75b8e219756\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:19:44 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:19:44 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:967d5abf-c746-43a2-936e-e1abdc8475c3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:19:44 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[02a8c222-fe37-49e5-9c08-6a9ba6ce3fad]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:19:44 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a81923-db20-4b79-a81e-e00e13e234e1 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:19:44 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:967d5abf-c746-43a2-936e-e1abdc8475c3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v znIrGpMY {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:19:44 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:19:44 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1cec2c3-fa69-4da5-ad86-071bf9550a3e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:19:44 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:19:44 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8381c969-6a2d-4934-aadd-660ffa246b05/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:19:44 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8381c969-6a2d-4934-aadd-660ffa246b05/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:19:44 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:967d5abf-c746-43a2-936e-e1abdc8475c3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v znIrGpMY" returned: 0 in 0.020s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:19:44 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c5b330e-0796-4654-bebc-ba18181a1ac6]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:19:44 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:19:44 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[47c9c74e-e45a-4f9f-b988-3600ac53434d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:19:44 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a81923-db20-4b79-a81e-e00e13e234e1 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'znIrGpMY'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:19:44 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:967d5abf-c746-43a2-936e-e1abdc8475c3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:19:44 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[befe03fa-218f-4211-8f66-c92582d6d8e3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:19:44 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-343f88ba-1274-4b5e-911d-e27d7d44e2a9 tempest-VolumesAssistedSnapshotsTest-464837836 tempest-VolumesAssistedSnapshotsTest-464837836-project-admin] Running cmd (subprocess): nvme version {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:19:45 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-343f88ba-1274-4b5e-911d-e27d7d44e2a9 tempest-VolumesAssistedSnapshotsTest-464837836 tempest-VolumesAssistedSnapshotsTest-464837836-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 12:19:45 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:967d5abf-c746-43a2-936e-e1abdc8475c3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:19:45 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[c117d4f3-a2e3-4dcf-a91a-f5e2839590de]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:19:45 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.nvmeof [None req-343f88ba-1274-4b5e-911d-e27d7d44e2a9 tempest-VolumesAssistedSnapshotsTest-464837836 tempest-VolumesAssistedSnapshotsTest-464837836-project-admin] nvme not present on system {{(pid=74960) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 12:19:45 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a81923-db20-4b79-a81e-e00e13e234e1 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:19:45 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:19:45 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:19:45 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 12:19:45 user nova-compute[74960]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 12:19:45 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b9a79d0-f85c-4173-a98e-67eee286dc48]: (4, '') {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:19:45 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-343f88ba-1274-4b5e-911d-e27d7d44e2a9 tempest-VolumesAssistedSnapshotsTest-464837836 tempest-VolumesAssistedSnapshotsTest-464837836-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74960) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 12:19:45 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-343f88ba-1274-4b5e-911d-e27d7d44e2a9 tempest-VolumesAssistedSnapshotsTest-464837836 tempest-VolumesAssistedSnapshotsTest-464837836-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74960) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 12:19:45 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-343f88ba-1274-4b5e-911d-e27d7d44e2a9 tempest-VolumesAssistedSnapshotsTest-464837836 tempest-VolumesAssistedSnapshotsTest-464837836-project-admin] LIGHTOS: no hostnqn found. {{(pid=74960) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 12:19:45 user nova-compute[74960]: DEBUG os_brick.utils [None req-343f88ba-1274-4b5e-911d-e27d7d44e2a9 tempest-VolumesAssistedSnapshotsTest-464837836 tempest-VolumesAssistedSnapshotsTest-464837836-project-admin] <== get_connector_properties: return (162ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:75b8e219756', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:19:45 user nova-compute[74960]: DEBUG nova.virt.block_device [None req-343f88ba-1274-4b5e-911d-e27d7d44e2a9 tempest-VolumesAssistedSnapshotsTest-464837836 tempest-VolumesAssistedSnapshotsTest-464837836-project-admin] [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea] Updating existing volume attachment record: 4785c7d0-1ec0-4282-86d0-4773fe82b2ed {{(pid=74960) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 12:19:45 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:19:45 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2eee892-f481-4c09-ad09-ed9778546f3a]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d9e4ca-e4a0-404c-93a8-783525cbf863 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27e9e6ae-69f2-4849-ab0c-0b7f9fc18990 (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:19:45 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a81923-db20-4b79-a81e-e00e13e234e1 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d9e4ca-e4a0-404c-93a8-783525cbf863 (non-flash)
Nov 03 12:19:45 user nova-compute[74960]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27e9e6ae-69f2-4849-ab0c-0b7f9fc18990 (non-flash)
Nov 03 12:19:45 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:19:45 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a81923-db20-4b79-a81e-e00e13e234e1 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d9e4ca-e4a0-404c-93a8-783525cbf863 (non-flash)
Nov 03 12:19:45 user nova-compute[74960]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27e9e6ae-69f2-4849-ab0c-0b7f9fc18990 (non-flash)
Nov 03 12:19:45 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:19:45 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:967d5abf-c746-43a2-936e-e1abdc8475c3 -p 172.16.0.220:3260 --login {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:19:45 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:967d5abf-c746-43a2-936e-e1abdc8475c3 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:19:45 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f2ced43-815b-4320-8aa9-f857b87fbff7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:967d5abf-c746-43a2-936e-e1abdc8475c3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:967d5abf-c746-43a2-936e-e1abdc8475c3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:19:45 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a81923-db20-4b79-a81e-e00e13e234e1 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:967d5abf-c746-43a2-936e-e1abdc8475c3, portal: 172.16.0.220,3260]
Nov 03 12:19:45 user nova-compute[74960]: Login to [iface: default, target: iqn.2010-10.org.openstack:967d5abf-c746-43a2-936e-e1abdc8475c3, portal: 172.16.0.220,3260] successful.
Nov 03 12:19:45 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:19:45 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:967d5abf-c746-43a2-936e-e1abdc8475c3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:19:45 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8381c969-6a2d-4934-aadd-660ffa246b05/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:19:45 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79b85953-182f-459f-a8d4-bcb54148a850/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:19:45 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:967d5abf-c746-43a2-936e-e1abdc8475c3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:19:45 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0846493-524a-4719-9468-e7f5cc3f18bd]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:19:45 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a81923-db20-4b79-a81e-e00e13e234e1 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:19:45 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:19:45 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:19:45 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[1034cb8f-d83a-4411-80e2-0ac679922bec]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d9e4ca-e4a0-404c-93a8-783525cbf863 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27e9e6ae-69f2-4849-ab0c-0b7f9fc18990 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:967d5abf-c746-43a2-936e-e1abdc8475c3 (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:19:45 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a81923-db20-4b79-a81e-e00e13e234e1 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d9e4ca-e4a0-404c-93a8-783525cbf863 (non-flash)
Nov 03 12:19:45 user nova-compute[74960]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27e9e6ae-69f2-4849-ab0c-0b7f9fc18990 (non-flash)
Nov 03 12:19:45 user nova-compute[74960]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:967d5abf-c746-43a2-936e-e1abdc8475c3 (non-flash)
Nov 03 12:19:45 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:19:45 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a81923-db20-4b79-a81e-e00e13e234e1 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d9e4ca-e4a0-404c-93a8-783525cbf863 (non-flash)
Nov 03 12:19:45 user nova-compute[74960]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27e9e6ae-69f2-4849-ab0c-0b7f9fc18990 (non-flash)
Nov 03 12:19:45 user nova-compute[74960]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:967d5abf-c746-43a2-936e-e1abdc8475c3 (non-flash)
Nov 03 12:19:45 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:19:45 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-b1a81923-db20-4b79-a81e-e00e13e234e1 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:967d5abf-c746-43a2-936e-e1abdc8475c3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.384s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:19:45 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a81923-db20-4b79-a81e-e00e13e234e1 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Connected to 172.16.0.220:3260 {{(pid=74960) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 12:19:45 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-b1a81923-db20-4b79-a81e-e00e13e234e1 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] HCTL ('33', '-', '-', 0) found on session 5 with lun 0 {{(pid=74960) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 12:19:45 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-b1a81923-db20-4b79-a81e-e00e13e234e1 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74960) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 12:19:45 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:19:45 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:19:45 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:19:45 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[df157fff-5a4c-421b-aa9c-6633b38cdfa8]: (4, ('- - 0', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:19:45 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-b1a81923-db20-4b79-a81e-e00e13e234e1 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Searching for a device in session 5 and hctl ['33', '*', '*', 0] yield: None {{(pid=74960) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 12:19:45 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-dcfd168c-dfe0-4911-8951-580b499e589d tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Lock "0a520c41-19c0-47ba-ada8-023ee9c12ca6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 31.318s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:19:45 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79b85953-182f-459f-a8d4-bcb54148a850/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:19:45 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79b85953-182f-459f-a8d4-bcb54148a850/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:19:45 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79b85953-182f-459f-a8d4-bcb54148a850/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:19:45 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f7fabc2-5e1b-441c-a693-9956470359ea/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:19:45 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f7fabc2-5e1b-441c-a693-9956470359ea/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:19:45 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f7fabc2-5e1b-441c-a693-9956470359ea/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:19:45 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f7fabc2-5e1b-441c-a693-9956470359ea/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:19:45 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e91dfcf4-caef-43d0-a56b-b1282363d4e0/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:19:46 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06cf4441-dd88-4688-b21e-c1e38d59ff63 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] [instance: 8381c969-6a2d-4934-aadd-660ffa246b05] Calling os-brick to attach iSCSI Volume {{(pid=74960) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 12:19:46 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-06cf4441-dd88-4688-b21e-c1e38d59ff63 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9aa420acb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QPLAizpI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:19:46 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-06cf4441-dd88-4688-b21e-c1e38d59ff63 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:19:46 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-06cf4441-dd88-4688-b21e-c1e38d59ff63 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:19:46 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e91dfcf4-caef-43d0-a56b-b1282363d4e0/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:19:46 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e91dfcf4-caef-43d0-a56b-b1282363d4e0/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:19:46 user nova-compute[74960]: INFO nova.compute.manager [None req-e78062c2-8cd5-4f2d-a91b-c432a74f699c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] [instance: 39e6c635-4602-4ed6-abbd-80c96f056715] Took 4.63 seconds to detach 1 volumes for instance.
Nov 03 12:19:46 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-b1a81923-db20-4b79-a81e-e00e13e234e1 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Searching for a device in session 5 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74960) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 12:19:46 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a81923-db20-4b79-a81e-e00e13e234e1 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:967d5abf-c746-43a2-936e-e1abdc8475c3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'znIrGpMY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74960) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 12:19:46 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-b1a81923-db20-4b79-a81e-e00e13e234e1 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.420s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:19:46 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a81923-db20-4b79-a81e-e00e13e234e1 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] <== connect_volume: return (1423ms) {'type': 'block', 'scsi_wwn': '23734336630363230', 'path': '/dev/sdb'} {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:19:46 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1a81923-db20-4b79-a81e-e00e13e234e1 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] [instance: d00a0872-693c-4cdc-85cd-9806660e9d8d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23734336630363230', 'path': '/dev/sdb'} {{(pid=74960) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 12:19:46 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-06cf4441-dd88-4688-b21e-c1e38d59ff63 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.171s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:19:46 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-06cf4441-dd88-4688-b21e-c1e38d59ff63 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:19:46 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-06cf4441-dd88-4688-b21e-c1e38d59ff63 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:19:46 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-06cf4441-dd88-4688-b21e-c1e38d59ff63 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:19:46 user nova-compute[74960]: INFO os_brick.initiator.connectors.iscsi [None req-06cf4441-dd88-4688-b21e-c1e38d59ff63 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 12:19:46 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-e78062c2-8cd5-4f2d-a91b-c432a74f699c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:19:46 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-e78062c2-8cd5-4f2d-a91b-c432a74f699c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:19:46 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19 -p 172.16.0.220:3260 {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:19:46 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:19:46 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[699e6e65-9eb0-430d-b49f-2dacaa563001]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:19:46 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-06cf4441-dd88-4688-b21e-c1e38d59ff63 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 12:19:46 user nova-compute[74960]:  {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:19:46 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19 -p 172.16.0.220:3260 --interface default --op new {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:19:46 user nova-compute[74960]: DEBUG nova.objects.instance [None req-b1a81923-db20-4b79-a81e-e00e13e234e1 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Lazy-loading 'flavor' on Instance uuid d00a0872-693c-4cdc-85cd-9806660e9d8d {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:19:46 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:19:46 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8474897-81cc-437a-b83f-469bedf41f22]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19] added\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:19:46 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-06cf4441-dd88-4688-b21e-c1e38d59ff63 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19] added
Nov 03 12:19:46 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:19:46 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:19:46 user nova-compute[74960]: DEBUG nova.virt.libvirt.guest [None req-b1a81923-db20-4b79-a81e-e00e13e234e1 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] attach device xml: <disk type="block" device="disk">
Nov 03 12:19:46 user nova-compute[74960]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 12:19:46 user nova-compute[74960]:   <source dev="/dev/sdb"/>
Nov 03 12:19:46 user nova-compute[74960]:   <target dev="sdc" bus="scsi"/>
Nov 03 12:19:46 user nova-compute[74960]:   <serial>967d5abf-c746-43a2-936e-e1abdc8475c3</serial>
Nov 03 12:19:46 user nova-compute[74960]:   <address type="drive" controller="0" unit="2"/>
Nov 03 12:19:46 user nova-compute[74960]: </disk>
Nov 03 12:19:46 user nova-compute[74960]:  {{(pid=74960) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 03 12:19:46 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e91dfcf4-caef-43d0-a56b-b1282363d4e0/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:19:46 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74960) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 12:19:46 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:19:46 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[f859ad53-5299-4a9c-8f98-7d4392cc3878]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:19:46 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-06cf4441-dd88-4688-b21e-c1e38d59ff63 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:19:46 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:19:46 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a520c41-19c0-47ba-ada8-023ee9c12ca6/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:19:46 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:19:46 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[d57e37e0-2e38-4509-90a1-019ae8860c73]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:19:46 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-06cf4441-dd88-4688-b21e-c1e38d59ff63 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:19:46 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QPLAizpI {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:19:46 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QPLAizpI" returned: 0 in 0.020s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:19:46 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b5de7b1-c7ae-4077-9906-a02da3ad1b56]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:19:46 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-06cf4441-dd88-4688-b21e-c1e38d59ff63 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QPLAizpI'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:19:46 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:19:46 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:19:46 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[847d3f64-293b-47ac-8b36-7c9b14424983]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:19:46 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-06cf4441-dd88-4688-b21e-c1e38d59ff63 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:19:46 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:19:46 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:19:46 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[6046753a-a7fa-4782-af3d-8d6a51364fc3]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d9e4ca-e4a0-404c-93a8-783525cbf863 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27e9e6ae-69f2-4849-ab0c-0b7f9fc18990 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:967d5abf-c746-43a2-936e-e1abdc8475c3 (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:19:46 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-06cf4441-dd88-4688-b21e-c1e38d59ff63 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d9e4ca-e4a0-404c-93a8-783525cbf863 (non-flash)
Nov 03 12:19:46 user nova-compute[74960]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27e9e6ae-69f2-4849-ab0c-0b7f9fc18990 (non-flash)
Nov 03 12:19:46 user nova-compute[74960]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:967d5abf-c746-43a2-936e-e1abdc8475c3 (non-flash)
Nov 03 12:19:46 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:19:46 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-06cf4441-dd88-4688-b21e-c1e38d59ff63 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d9e4ca-e4a0-404c-93a8-783525cbf863 (non-flash)
Nov 03 12:19:46 user nova-compute[74960]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27e9e6ae-69f2-4849-ab0c-0b7f9fc18990 (non-flash)
Nov 03 12:19:46 user nova-compute[74960]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:967d5abf-c746-43a2-936e-e1abdc8475c3 (non-flash)
Nov 03 12:19:46 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:19:46 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19 -p 172.16.0.220:3260 --login {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:19:46 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a520c41-19c0-47ba-ada8-023ee9c12ca6/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:19:46 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a520c41-19c0-47ba-ada8-023ee9c12ca6/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:19:46 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:19:46 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[baaf0904-2be7-4fff-9285-3826cd7c2080]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:19:46 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-06cf4441-dd88-4688-b21e-c1e38d59ff63 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19, portal: 172.16.0.220,3260]
Nov 03 12:19:46 user nova-compute[74960]: Login to [iface: default, target: iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19, portal: 172.16.0.220,3260] successful.
Nov 03 12:19:46 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:19:46 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:19:46 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:19:46 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[7280e35d-9c3e-4b11-94aa-68b832225c14]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:19:46 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-06cf4441-dd88-4688-b21e-c1e38d59ff63 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:19:46 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:19:46 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:19:46 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a6e5629-fb55-4702-b0aa-c86d4e1135b9]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d9e4ca-e4a0-404c-93a8-783525cbf863 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27e9e6ae-69f2-4849-ab0c-0b7f9fc18990 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:967d5abf-c746-43a2-936e-e1abdc8475c3 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19 (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:19:46 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-06cf4441-dd88-4688-b21e-c1e38d59ff63 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d9e4ca-e4a0-404c-93a8-783525cbf863 (non-flash)
Nov 03 12:19:46 user nova-compute[74960]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27e9e6ae-69f2-4849-ab0c-0b7f9fc18990 (non-flash)
Nov 03 12:19:46 user nova-compute[74960]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:967d5abf-c746-43a2-936e-e1abdc8475c3 (non-flash)
Nov 03 12:19:46 user nova-compute[74960]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19 (non-flash)
Nov 03 12:19:46 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:19:46 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-06cf4441-dd88-4688-b21e-c1e38d59ff63 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d9e4ca-e4a0-404c-93a8-783525cbf863 (non-flash)
Nov 03 12:19:46 user nova-compute[74960]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27e9e6ae-69f2-4849-ab0c-0b7f9fc18990 (non-flash)
Nov 03 12:19:46 user nova-compute[74960]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:967d5abf-c746-43a2-936e-e1abdc8475c3 (non-flash)
Nov 03 12:19:46 user nova-compute[74960]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19 (non-flash)
Nov 03 12:19:46 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:19:46 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-06cf4441-dd88-4688-b21e-c1e38d59ff63 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.369s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:19:46 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-06cf4441-dd88-4688-b21e-c1e38d59ff63 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] Connected to 172.16.0.220:3260 {{(pid=74960) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 12:19:46 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-06cf4441-dd88-4688-b21e-c1e38d59ff63 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] HCTL ('36', '-', '-', 0) found on session 6 with lun 0 {{(pid=74960) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 12:19:46 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-06cf4441-dd88-4688-b21e-c1e38d59ff63 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74960) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 12:19:46 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:19:46 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.024s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:19:46 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[c676a0f8-6df4-466a-b3cb-619f69da6ae7]: (4, ('- - 0', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:19:46 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-06cf4441-dd88-4688-b21e-c1e38d59ff63 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] Searching for a device in session 6 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74960) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 12:19:46 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-06cf4441-dd88-4688-b21e-c1e38d59ff63 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QPLAizpI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74960) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 12:19:46 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a520c41-19c0-47ba-ada8-023ee9c12ca6/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:19:46 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74960) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 12:19:46 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-e78062c2-8cd5-4f2d-a91b-c432a74f699c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:19:47 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-e78062c2-8cd5-4f2d-a91b-c432a74f699c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:19:47 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-a31e92f9-ecb7-4e7d-ac20-1c29e59bf419 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Acquiring lock "e91dfcf4-caef-43d0-a56b-b1282363d4e0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:19:47 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-a31e92f9-ecb7-4e7d-ac20-1c29e59bf419 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Lock "e91dfcf4-caef-43d0-a56b-b1282363d4e0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:19:47 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:19:47 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:19:47 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Hypervisor/Node resource view: name=user free_ram=7750MB free_disk=25.36832046508789GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74960) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 12:19:47 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:19:47 user nova-compute[74960]: INFO nova.compute.manager [None req-a31e92f9-ecb7-4e7d-ac20-1c29e59bf419 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] [instance: e91dfcf4-caef-43d0-a56b-b1282363d4e0] Detaching volume 20d9e4ca-e4a0-404c-93a8-783525cbf863
Nov 03 12:19:47 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-b1a81923-db20-4b79-a81e-e00e13e234e1 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] No BDM found with device name sda, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:19:47 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-b1a81923-db20-4b79-a81e-e00e13e234e1 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:19:47 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-b1a81923-db20-4b79-a81e-e00e13e234e1 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] No BDM found with device name sdc, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:19:47 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-b1a81923-db20-4b79-a81e-e00e13e234e1 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] No VIF found with MAC fa:16:3e:80:8f:c1, not building metadata {{(pid=74960) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 12:19:47 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-e78062c2-8cd5-4f2d-a91b-c432a74f699c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.999s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:19:47 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.039s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:19:47 user nova-compute[74960]: INFO nova.scheduler.client.report [None req-e78062c2-8cd5-4f2d-a91b-c432a74f699c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Deleted allocations for instance 39e6c635-4602-4ed6-abbd-80c96f056715
Nov 03 12:19:47 user nova-compute[74960]: INFO nova.virt.block_device [None req-a31e92f9-ecb7-4e7d-ac20-1c29e59bf419 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] [instance: e91dfcf4-caef-43d0-a56b-b1282363d4e0] Attempting to driver detach volume 20d9e4ca-e4a0-404c-93a8-783525cbf863 from mountpoint /dev/vdb
Nov 03 12:19:47 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-a31e92f9-ecb7-4e7d-ac20-1c29e59bf419 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Attempting to detach device vdb from instance e91dfcf4-caef-43d0-a56b-b1282363d4e0 from the persistent domain config. {{(pid=74960) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 03 12:19:47 user nova-compute[74960]: DEBUG nova.virt.libvirt.guest [None req-a31e92f9-ecb7-4e7d-ac20-1c29e59bf419 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 12:19:47 user nova-compute[74960]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 12:19:47 user nova-compute[74960]:   <source dev="/dev/sdc"/>
Nov 03 12:19:47 user nova-compute[74960]:   <target dev="vdb" bus="virtio"/>
Nov 03 12:19:47 user nova-compute[74960]:   <serial>20d9e4ca-e4a0-404c-93a8-783525cbf863</serial>
Nov 03 12:19:47 user nova-compute[74960]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 12:19:47 user nova-compute[74960]: </disk>
Nov 03 12:19:47 user nova-compute[74960]:  {{(pid=74960) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 12:19:47 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-a31e92f9-ecb7-4e7d-ac20-1c29e59bf419 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Successfully detached device vdb from instance e91dfcf4-caef-43d0-a56b-b1282363d4e0 from the persistent domain config.
Nov 03 12:19:47 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-a31e92f9-ecb7-4e7d-ac20-1c29e59bf419 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e91dfcf4-caef-43d0-a56b-b1282363d4e0 from the live domain config. {{(pid=74960) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 03 12:19:47 user nova-compute[74960]: DEBUG nova.virt.libvirt.guest [None req-a31e92f9-ecb7-4e7d-ac20-1c29e59bf419 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 12:19:47 user nova-compute[74960]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 12:19:47 user nova-compute[74960]:   <source dev="/dev/sdc"/>
Nov 03 12:19:47 user nova-compute[74960]:   <target dev="vdb" bus="virtio"/>
Nov 03 12:19:47 user nova-compute[74960]:   <serial>20d9e4ca-e4a0-404c-93a8-783525cbf863</serial>
Nov 03 12:19:47 user nova-compute[74960]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 12:19:47 user nova-compute[74960]: </disk>
Nov 03 12:19:47 user nova-compute[74960]:  {{(pid=74960) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 12:19:47 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 7769e3c5-136f-4282-8e3e-224e3a80922c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:19:47 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance d00a0872-693c-4cdc-85cd-9806660e9d8d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:19:47 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance e91dfcf4-caef-43d0-a56b-b1282363d4e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:19:47 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 8381c969-6a2d-4934-aadd-660ffa246b05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:19:47 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 0a520c41-19c0-47ba-ada8-023ee9c12ca6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:19:47 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 7f7fabc2-5e1b-441c-a693-9956470359ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:19:47 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 79b85953-182f-459f-a8d4-bcb54148a850 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:19:47 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 05956d9b-0646-43d2-a4cd-19e9090020ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:19:47 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance ac9e1b20-2482-4c71-b54b-5d6cb8187d04 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:19:47 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74960) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 12:19:47 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74960) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 12:19:47 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-e78062c2-8cd5-4f2d-a91b-c432a74f699c tempest-DeleteServersTestJSON-705662120 tempest-DeleteServersTestJSON-705662120-project-member] Lock "39e6c635-4602-4ed6-abbd-80c96f056715" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.489s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:19:47 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-b1a81923-db20-4b79-a81e-e00e13e234e1 tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Lock "d00a0872-693c-4cdc-85cd-9806660e9d8d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 33.282s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:19:47 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-75be19b2-a912-4ed0-abd3-87c2be6d7d36 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Acquiring lock "0a520c41-19c0-47ba-ada8-023ee9c12ca6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:19:47 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-75be19b2-a912-4ed0-abd3-87c2be6d7d36 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Lock "0a520c41-19c0-47ba-ada8-023ee9c12ca6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:19:47 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:19:47 user nova-compute[74960]: INFO nova.compute.manager [None req-75be19b2-a912-4ed0-abd3-87c2be6d7d36 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] Detaching volume 27e9e6ae-69f2-4849-ab0c-0b7f9fc18990
Nov 03 12:19:47 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-06cf4441-dd88-4688-b21e-c1e38d59ff63 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.411s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:19:47 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-06cf4441-dd88-4688-b21e-c1e38d59ff63 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] <== connect_volume: return (1583ms) {'type': 'block', 'scsi_wwn': '23737323039356361', 'path': '/dev/sde'} {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:19:47 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06cf4441-dd88-4688-b21e-c1e38d59ff63 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] [instance: 8381c969-6a2d-4934-aadd-660ffa246b05] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23737323039356361', 'path': '/dev/sde'} {{(pid=74960) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 12:19:47 user nova-compute[74960]: DEBUG nova.objects.instance [None req-06cf4441-dd88-4688-b21e-c1e38d59ff63 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] Lazy-loading 'flavor' on Instance uuid 8381c969-6a2d-4934-aadd-660ffa246b05 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:19:47 user nova-compute[74960]: DEBUG nova.virt.libvirt.guest [None req-06cf4441-dd88-4688-b21e-c1e38d59ff63 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] attach device xml: <disk type="block" device="disk">
Nov 03 12:19:47 user nova-compute[74960]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 12:19:47 user nova-compute[74960]:   <source dev="/dev/sde"/>
Nov 03 12:19:47 user nova-compute[74960]:   <target dev="vdb" bus="virtio"/>
Nov 03 12:19:47 user nova-compute[74960]:   <serial>4b85943b-1d18-4267-9329-4318e1923b19</serial>
Nov 03 12:19:47 user nova-compute[74960]: </disk>
Nov 03 12:19:47 user nova-compute[74960]:  {{(pid=74960) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 03 12:19:47 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:19:47 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:19:47 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Compute_service record updated for user:user {{(pid=74960) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 12:19:47 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.583s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:19:47 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-a31e92f9-ecb7-4e7d-ac20-1c29e59bf419 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e91dfcf4-caef-43d0-a56b-b1282363d4e0 {{(pid=74960) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 03 12:19:47 user nova-compute[74960]: INFO nova.virt.block_device [None req-75be19b2-a912-4ed0-abd3-87c2be6d7d36 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] Attempting to driver detach volume 27e9e6ae-69f2-4849-ab0c-0b7f9fc18990 from mountpoint /dev/vdb
Nov 03 12:19:47 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-75be19b2-a912-4ed0-abd3-87c2be6d7d36 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Attempting to detach device vdb from instance 0a520c41-19c0-47ba-ada8-023ee9c12ca6 from the persistent domain config. {{(pid=74960) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 03 12:19:47 user nova-compute[74960]: DEBUG nova.virt.libvirt.guest [None req-75be19b2-a912-4ed0-abd3-87c2be6d7d36 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 12:19:47 user nova-compute[74960]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 12:19:47 user nova-compute[74960]:   <source dev="/dev/sdd"/>
Nov 03 12:19:47 user nova-compute[74960]:   <target dev="vdb" bus="virtio"/>
Nov 03 12:19:47 user nova-compute[74960]:   <serial>27e9e6ae-69f2-4849-ab0c-0b7f9fc18990</serial>
Nov 03 12:19:47 user nova-compute[74960]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 03 12:19:47 user nova-compute[74960]: </disk>
Nov 03 12:19:47 user nova-compute[74960]:  {{(pid=74960) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 12:19:47 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-75be19b2-a912-4ed0-abd3-87c2be6d7d36 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Successfully detached device vdb from instance 0a520c41-19c0-47ba-ada8-023ee9c12ca6 from the persistent domain config.
Nov 03 12:19:47 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-75be19b2-a912-4ed0-abd3-87c2be6d7d36 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0a520c41-19c0-47ba-ada8-023ee9c12ca6 from the live domain config. {{(pid=74960) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 03 12:19:47 user nova-compute[74960]: DEBUG nova.virt.libvirt.guest [None req-75be19b2-a912-4ed0-abd3-87c2be6d7d36 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 12:19:47 user nova-compute[74960]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 12:19:47 user nova-compute[74960]:   <source dev="/dev/sdd"/>
Nov 03 12:19:47 user nova-compute[74960]:   <target dev="vdb" bus="virtio"/>
Nov 03 12:19:47 user nova-compute[74960]:   <serial>27e9e6ae-69f2-4849-ab0c-0b7f9fc18990</serial>
Nov 03 12:19:47 user nova-compute[74960]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 03 12:19:47 user nova-compute[74960]: </disk>
Nov 03 12:19:47 user nova-compute[74960]:  {{(pid=74960) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 12:19:48 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-3ca77083-b3b4-40f4-8421-4d85fb57780a tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Acquiring lock "d00a0872-693c-4cdc-85cd-9806660e9d8d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:19:48 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-3ca77083-b3b4-40f4-8421-4d85fb57780a tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Lock "d00a0872-693c-4cdc-85cd-9806660e9d8d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:19:48 user nova-compute[74960]: INFO nova.compute.manager [None req-3ca77083-b3b4-40f4-8421-4d85fb57780a tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] [instance: d00a0872-693c-4cdc-85cd-9806660e9d8d] Detaching volume 967d5abf-c746-43a2-936e-e1abdc8475c3
Nov 03 12:19:48 user nova-compute[74960]: INFO nova.virt.block_device [None req-3ca77083-b3b4-40f4-8421-4d85fb57780a tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] [instance: d00a0872-693c-4cdc-85cd-9806660e9d8d] Attempting to driver detach volume 967d5abf-c746-43a2-936e-e1abdc8475c3 from mountpoint /dev/sdc
Nov 03 12:19:48 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-3ca77083-b3b4-40f4-8421-4d85fb57780a tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Attempting to detach device sdc from instance d00a0872-693c-4cdc-85cd-9806660e9d8d from the persistent domain config. {{(pid=74960) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 03 12:19:48 user nova-compute[74960]: DEBUG nova.virt.libvirt.guest [None req-3ca77083-b3b4-40f4-8421-4d85fb57780a tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 12:19:48 user nova-compute[74960]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 12:19:48 user nova-compute[74960]:   <source dev="/dev/sdb"/>
Nov 03 12:19:48 user nova-compute[74960]:   <target dev="sdc" bus="scsi"/>
Nov 03 12:19:48 user nova-compute[74960]:   <serial>967d5abf-c746-43a2-936e-e1abdc8475c3</serial>
Nov 03 12:19:48 user nova-compute[74960]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 03 12:19:48 user nova-compute[74960]: </disk>
Nov 03 12:19:48 user nova-compute[74960]:  {{(pid=74960) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 12:19:48 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-06cf4441-dd88-4688-b21e-c1e38d59ff63 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] No BDM found with device name vda, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:19:48 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-06cf4441-dd88-4688-b21e-c1e38d59ff63 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:19:48 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-06cf4441-dd88-4688-b21e-c1e38d59ff63 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] No VIF found with MAC fa:16:3e:8c:e9:c2, not building metadata {{(pid=74960) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 12:19:48 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-3ca77083-b3b4-40f4-8421-4d85fb57780a tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Successfully detached device sdc from instance d00a0872-693c-4cdc-85cd-9806660e9d8d from the persistent domain config.
Nov 03 12:19:48 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-3ca77083-b3b4-40f4-8421-4d85fb57780a tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance d00a0872-693c-4cdc-85cd-9806660e9d8d from the live domain config. {{(pid=74960) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 03 12:19:48 user nova-compute[74960]: DEBUG nova.virt.libvirt.guest [None req-3ca77083-b3b4-40f4-8421-4d85fb57780a tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 12:19:48 user nova-compute[74960]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 12:19:48 user nova-compute[74960]:   <source dev="/dev/sdb"/>
Nov 03 12:19:48 user nova-compute[74960]:   <target dev="sdc" bus="scsi"/>
Nov 03 12:19:48 user nova-compute[74960]:   <serial>967d5abf-c746-43a2-936e-e1abdc8475c3</serial>
Nov 03 12:19:48 user nova-compute[74960]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 03 12:19:48 user nova-compute[74960]: </disk>
Nov 03 12:19:48 user nova-compute[74960]:  {{(pid=74960) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 12:19:48 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-06cf4441-dd88-4688-b21e-c1e38d59ff63 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] Lock "8381c969-6a2d-4934-aadd-660ffa246b05" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 34.600s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:19:48 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-75be19b2-a912-4ed0-abd3-87c2be6d7d36 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0a520c41-19c0-47ba-ada8-023ee9c12ca6 {{(pid=74960) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 03 12:19:48 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-3ca77083-b3b4-40f4-8421-4d85fb57780a tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance d00a0872-693c-4cdc-85cd-9806660e9d8d {{(pid=74960) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 03 12:19:49 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-2bae53cb-fa77-4ed4-93fd-63c0ab3edfd8 tempest-TestVolumeSwap-1219579390 tempest-TestVolumeSwap-1219579390-project-admin] Acquiring lock "8381c969-6a2d-4934-aadd-660ffa246b05" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:19:49 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-2bae53cb-fa77-4ed4-93fd-63c0ab3edfd8 tempest-TestVolumeSwap-1219579390 tempest-TestVolumeSwap-1219579390-project-admin] Lock "8381c969-6a2d-4934-aadd-660ffa246b05" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:19:49 user nova-compute[74960]: DEBUG os_brick.utils [None req-2bae53cb-fa77-4ed4-93fd-63c0ab3edfd8 tempest-TestVolumeSwap-1219579390 tempest-TestVolumeSwap-1219579390-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:19:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:19:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:19:49 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[4707081a-a837-48e8-88a4-96f6261b5c5b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:75b8e219756\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:19:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:19:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:19:49 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e1e2511-4c69-48dd-b465-9842d3486e03]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:19:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:19:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:19:49 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[83052847-4c30-4080-a4ff-dc7c72599047]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:19:49 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[db606419-2e4b-428c-9898-9c9dbeec6c63]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:19:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-2bae53cb-fa77-4ed4-93fd-63c0ab3edfd8 tempest-TestVolumeSwap-1219579390 tempest-TestVolumeSwap-1219579390-project-admin] Running cmd (subprocess): nvme version {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:19:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-2bae53cb-fa77-4ed4-93fd-63c0ab3edfd8 tempest-TestVolumeSwap-1219579390 tempest-TestVolumeSwap-1219579390-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 12:19:49 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2bae53cb-fa77-4ed4-93fd-63c0ab3edfd8 tempest-TestVolumeSwap-1219579390 tempest-TestVolumeSwap-1219579390-project-admin] nvme not present on system {{(pid=74960) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 12:19:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:19:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 12:19:49 user nova-compute[74960]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 12:19:49 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[a16d09b7-ed8c-45af-952a-72160be08711]: (4, '') {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:19:49 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-2bae53cb-fa77-4ed4-93fd-63c0ab3edfd8 tempest-TestVolumeSwap-1219579390 tempest-TestVolumeSwap-1219579390-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74960) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 12:19:49 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-2bae53cb-fa77-4ed4-93fd-63c0ab3edfd8 tempest-TestVolumeSwap-1219579390 tempest-TestVolumeSwap-1219579390-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74960) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 12:19:49 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-2bae53cb-fa77-4ed4-93fd-63c0ab3edfd8 tempest-TestVolumeSwap-1219579390 tempest-TestVolumeSwap-1219579390-project-admin] LIGHTOS: no hostnqn found. {{(pid=74960) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 12:19:49 user nova-compute[74960]: DEBUG os_brick.utils [None req-2bae53cb-fa77-4ed4-93fd-63c0ab3edfd8 tempest-TestVolumeSwap-1219579390 tempest-TestVolumeSwap-1219579390-project-admin] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:75b8e219756', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:19:49 user nova-compute[74960]: INFO nova.compute.manager [None req-2bae53cb-fa77-4ed4-93fd-63c0ab3edfd8 tempest-TestVolumeSwap-1219579390 tempest-TestVolumeSwap-1219579390-project-admin] [instance: 8381c969-6a2d-4934-aadd-660ffa246b05] Swapping volume 4b85943b-1d18-4267-9329-4318e1923b19 for 4085c299-4eec-46d3-b50a-7f7609a1f42c
Nov 03 12:19:50 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:19:55 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:19:55 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:19:55 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74960) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 12:19:55 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74960) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 12:19:55 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74960) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 12:19:55 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:20:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:20:01 user nova-compute[74960]: INFO nova.virt.block_device [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04] Booting with volume ed753d9a-66cd-4242-9156-dff5a8170678 at /dev/vdc
Nov 03 12:20:01 user nova-compute[74960]: DEBUG os_brick.utils [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:20:01 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:20:01 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:20:01 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d8475c0-29bc-4c59-bbdf-72887882a3af]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:75b8e219756\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:20:01 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:20:01 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:20:01 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2180e89-de87-4b6e-aa23-da6a5f656664]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:20:01 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:20:01 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:20:01 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[e23cc06b-3dec-4bbb-a601-8e8bec1d3100]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:20:01 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[0966a9ba-80bd-460d-8b48-e78a519c6a57]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:20:01 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] Running cmd (subprocess): nvme version {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:20:01 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] 'nvme version' failed. Not Retrying. {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 12:20:01 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.nvmeof [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] nvme not present on system {{(pid=74960) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 12:20:01 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:20:01 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 12:20:01 user nova-compute[74960]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 12:20:01 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ca0f2d2-3e2e-4c5a-a545-a17652d168dc]: (4, '') {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:20:01 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74960) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 12:20:01 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74960) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 12:20:01 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] LIGHTOS: no hostnqn found. {{(pid=74960) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 12:20:01 user nova-compute[74960]: DEBUG os_brick.utils [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:75b8e219756', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:20:01 user nova-compute[74960]: DEBUG nova.virt.block_device [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04] Updating existing volume attachment record: 0af66f47-4a46-42ff-a7d0-fcd39b8cab9e {{(pid=74960) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 12:20:05 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:20:07 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-343f88ba-1274-4b5e-911d-e27d7d44e2a9 tempest-VolumesAssistedSnapshotsTest-464837836 tempest-VolumesAssistedSnapshotsTest-464837836-project-admin] [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea] Calling os-brick to attach iSCSI Volume {{(pid=74960) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 12:20:07 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-343f88ba-1274-4b5e-911d-e27d7d44e2a9 tempest-VolumesAssistedSnapshotsTest-464837836 tempest-VolumesAssistedSnapshotsTest-464837836-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9aa420acb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:52a35a52-65f0-484a-9ab9-903ed049026f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BRsVKCgG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:20:07 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-343f88ba-1274-4b5e-911d-e27d7d44e2a9 tempest-VolumesAssistedSnapshotsTest-464837836 tempest-VolumesAssistedSnapshotsTest-464837836-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:20:07 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-343f88ba-1274-4b5e-911d-e27d7d44e2a9 tempest-VolumesAssistedSnapshotsTest-464837836 tempest-VolumesAssistedSnapshotsTest-464837836-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:20:07 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-343f88ba-1274-4b5e-911d-e27d7d44e2a9 tempest-VolumesAssistedSnapshotsTest-464837836 tempest-VolumesAssistedSnapshotsTest-464837836-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:20:07 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-343f88ba-1274-4b5e-911d-e27d7d44e2a9 tempest-VolumesAssistedSnapshotsTest-464837836 tempest-VolumesAssistedSnapshotsTest-464837836-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:20:07 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-343f88ba-1274-4b5e-911d-e27d7d44e2a9 tempest-VolumesAssistedSnapshotsTest-464837836 tempest-VolumesAssistedSnapshotsTest-464837836-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52a35a52-65f0-484a-9ab9-903ed049026f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:20:07 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-343f88ba-1274-4b5e-911d-e27d7d44e2a9 tempest-VolumesAssistedSnapshotsTest-464837836 tempest-VolumesAssistedSnapshotsTest-464837836-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52a35a52-65f0-484a-9ab9-903ed049026f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:20:07 user nova-compute[74960]: INFO os_brick.initiator.connectors.iscsi [None req-343f88ba-1274-4b5e-911d-e27d7d44e2a9 tempest-VolumesAssistedSnapshotsTest-464837836 tempest-VolumesAssistedSnapshotsTest-464837836-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 12:20:07 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52a35a52-65f0-484a-9ab9-903ed049026f -p 172.16.0.220:3260 {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:20:07 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52a35a52-65f0-484a-9ab9-903ed049026f -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:20:07 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f78cda4-9c0d-4cb2-b433-2a22a14d24b4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:20:07 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-343f88ba-1274-4b5e-911d-e27d7d44e2a9 tempest-VolumesAssistedSnapshotsTest-464837836 tempest-VolumesAssistedSnapshotsTest-464837836-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 12:20:07 user nova-compute[74960]:  {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:20:07 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52a35a52-65f0-484a-9ab9-903ed049026f -p 172.16.0.220:3260 --interface default --op new {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:20:07 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52a35a52-65f0-484a-9ab9-903ed049026f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:20:07 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[67737757-cf5a-4a53-b6a1-58cd1c3909b8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:52a35a52-65f0-484a-9ab9-903ed049026f] added\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:20:07 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-343f88ba-1274-4b5e-911d-e27d7d44e2a9 tempest-VolumesAssistedSnapshotsTest-464837836 tempest-VolumesAssistedSnapshotsTest-464837836-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:52a35a52-65f0-484a-9ab9-903ed049026f] added
Nov 03 12:20:07 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:20:07 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52a35a52-65f0-484a-9ab9-903ed049026f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:20:07 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52a35a52-65f0-484a-9ab9-903ed049026f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:20:07 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[5104ac33-ec1f-4776-a3f4-4659d11c3299]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:20:07 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-343f88ba-1274-4b5e-911d-e27d7d44e2a9 tempest-VolumesAssistedSnapshotsTest-464837836 tempest-VolumesAssistedSnapshotsTest-464837836-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:20:07 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52a35a52-65f0-484a-9ab9-903ed049026f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:20:07 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52a35a52-65f0-484a-9ab9-903ed049026f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:20:07 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[db4ff12e-7edb-45af-9404-e1b91686fdaf]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:20:07 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-343f88ba-1274-4b5e-911d-e27d7d44e2a9 tempest-VolumesAssistedSnapshotsTest-464837836 tempest-VolumesAssistedSnapshotsTest-464837836-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:20:07 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52a35a52-65f0-484a-9ab9-903ed049026f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BRsVKCgG {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:20:07 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52a35a52-65f0-484a-9ab9-903ed049026f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BRsVKCgG" returned: 0 in 0.025s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:20:07 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b91eb57-dc1c-4f60-ba1c-49093b64a3aa]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:20:07 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-343f88ba-1274-4b5e-911d-e27d7d44e2a9 tempest-VolumesAssistedSnapshotsTest-464837836 tempest-VolumesAssistedSnapshotsTest-464837836-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BRsVKCgG'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:20:07 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52a35a52-65f0-484a-9ab9-903ed049026f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:20:07 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52a35a52-65f0-484a-9ab9-903ed049026f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:20:07 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7c49e84-bd5a-4c3d-9b9d-f59293696893]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:20:07 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-343f88ba-1274-4b5e-911d-e27d7d44e2a9 tempest-VolumesAssistedSnapshotsTest-464837836 tempest-VolumesAssistedSnapshotsTest-464837836-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:20:07 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:20:07 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:20:07 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[038ad76a-d8ef-4bd0-97cf-6875b608dc4a]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d9e4ca-e4a0-404c-93a8-783525cbf863 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27e9e6ae-69f2-4849-ab0c-0b7f9fc18990 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:967d5abf-c746-43a2-936e-e1abdc8475c3 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19 (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:20:07 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-343f88ba-1274-4b5e-911d-e27d7d44e2a9 tempest-VolumesAssistedSnapshotsTest-464837836 tempest-VolumesAssistedSnapshotsTest-464837836-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d9e4ca-e4a0-404c-93a8-783525cbf863 (non-flash)
Nov 03 12:20:07 user nova-compute[74960]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27e9e6ae-69f2-4849-ab0c-0b7f9fc18990 (non-flash)
Nov 03 12:20:07 user nova-compute[74960]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:967d5abf-c746-43a2-936e-e1abdc8475c3 (non-flash)
Nov 03 12:20:07 user nova-compute[74960]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19 (non-flash)
Nov 03 12:20:07 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:20:07 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-343f88ba-1274-4b5e-911d-e27d7d44e2a9 tempest-VolumesAssistedSnapshotsTest-464837836 tempest-VolumesAssistedSnapshotsTest-464837836-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d9e4ca-e4a0-404c-93a8-783525cbf863 (non-flash)
Nov 03 12:20:07 user nova-compute[74960]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27e9e6ae-69f2-4849-ab0c-0b7f9fc18990 (non-flash)
Nov 03 12:20:07 user nova-compute[74960]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:967d5abf-c746-43a2-936e-e1abdc8475c3 (non-flash)
Nov 03 12:20:07 user nova-compute[74960]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19 (non-flash)
Nov 03 12:20:07 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:20:07 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52a35a52-65f0-484a-9ab9-903ed049026f -p 172.16.0.220:3260 --login {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:20:07 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52a35a52-65f0-484a-9ab9-903ed049026f -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:20:07 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ce5b203-17b9-44ee-b262-2ac149760f75]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:52a35a52-65f0-484a-9ab9-903ed049026f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:52a35a52-65f0-484a-9ab9-903ed049026f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:20:07 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-343f88ba-1274-4b5e-911d-e27d7d44e2a9 tempest-VolumesAssistedSnapshotsTest-464837836 tempest-VolumesAssistedSnapshotsTest-464837836-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:52a35a52-65f0-484a-9ab9-903ed049026f, portal: 172.16.0.220,3260]
Nov 03 12:20:07 user nova-compute[74960]: Login to [iface: default, target: iqn.2010-10.org.openstack:52a35a52-65f0-484a-9ab9-903ed049026f, portal: 172.16.0.220,3260] successful.
Nov 03 12:20:07 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:20:07 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52a35a52-65f0-484a-9ab9-903ed049026f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:20:07 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52a35a52-65f0-484a-9ab9-903ed049026f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:20:07 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[f540d67a-15b1-49b4-9164-dbe3b69b60f5]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:20:07 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-343f88ba-1274-4b5e-911d-e27d7d44e2a9 tempest-VolumesAssistedSnapshotsTest-464837836 tempest-VolumesAssistedSnapshotsTest-464837836-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:20:07 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:20:07 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:20:07 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9f3bcbf-ea21-4c27-a0ec-509bcbeff392]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d9e4ca-e4a0-404c-93a8-783525cbf863 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27e9e6ae-69f2-4849-ab0c-0b7f9fc18990 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:967d5abf-c746-43a2-936e-e1abdc8475c3 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52a35a52-65f0-484a-9ab9-903ed049026f (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:20:07 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-343f88ba-1274-4b5e-911d-e27d7d44e2a9 tempest-VolumesAssistedSnapshotsTest-464837836 tempest-VolumesAssistedSnapshotsTest-464837836-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d9e4ca-e4a0-404c-93a8-783525cbf863 (non-flash)
Nov 03 12:20:07 user nova-compute[74960]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27e9e6ae-69f2-4849-ab0c-0b7f9fc18990 (non-flash)
Nov 03 12:20:07 user nova-compute[74960]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:967d5abf-c746-43a2-936e-e1abdc8475c3 (non-flash)
Nov 03 12:20:07 user nova-compute[74960]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19 (non-flash)
Nov 03 12:20:07 user nova-compute[74960]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52a35a52-65f0-484a-9ab9-903ed049026f (non-flash)
Nov 03 12:20:07 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:20:07 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-343f88ba-1274-4b5e-911d-e27d7d44e2a9 tempest-VolumesAssistedSnapshotsTest-464837836 tempest-VolumesAssistedSnapshotsTest-464837836-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d9e4ca-e4a0-404c-93a8-783525cbf863 (non-flash)
Nov 03 12:20:07 user nova-compute[74960]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27e9e6ae-69f2-4849-ab0c-0b7f9fc18990 (non-flash)
Nov 03 12:20:07 user nova-compute[74960]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:967d5abf-c746-43a2-936e-e1abdc8475c3 (non-flash)
Nov 03 12:20:07 user nova-compute[74960]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19 (non-flash)
Nov 03 12:20:07 user nova-compute[74960]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52a35a52-65f0-484a-9ab9-903ed049026f (non-flash)
Nov 03 12:20:07 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:20:07 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-343f88ba-1274-4b5e-911d-e27d7d44e2a9 tempest-VolumesAssistedSnapshotsTest-464837836 tempest-VolumesAssistedSnapshotsTest-464837836-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52a35a52-65f0-484a-9ab9-903ed049026f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.301s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:20:07 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-343f88ba-1274-4b5e-911d-e27d7d44e2a9 tempest-VolumesAssistedSnapshotsTest-464837836 tempest-VolumesAssistedSnapshotsTest-464837836-project-admin] Connected to 172.16.0.220:3260 {{(pid=74960) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 12:20:07 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-343f88ba-1274-4b5e-911d-e27d7d44e2a9 tempest-VolumesAssistedSnapshotsTest-464837836 tempest-VolumesAssistedSnapshotsTest-464837836-project-admin] HCTL ('37', '-', '-', 0) found on session 7 with lun 0 {{(pid=74960) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 12:20:07 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-343f88ba-1274-4b5e-911d-e27d7d44e2a9 tempest-VolumesAssistedSnapshotsTest-464837836 tempest-VolumesAssistedSnapshotsTest-464837836-project-admin] Scanning host 37 c: -, t: -, l: 0) {{(pid=74960) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 12:20:07 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:20:07 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.022s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:20:07 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[54ad7454-db6b-41e1-9dbf-84d140e31f17]: (4, ('- - 0', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:20:07 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-343f88ba-1274-4b5e-911d-e27d7d44e2a9 tempest-VolumesAssistedSnapshotsTest-464837836 tempest-VolumesAssistedSnapshotsTest-464837836-project-admin] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74960) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 12:20:07 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-343f88ba-1274-4b5e-911d-e27d7d44e2a9 tempest-VolumesAssistedSnapshotsTest-464837836 tempest-VolumesAssistedSnapshotsTest-464837836-project-admin] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:52a35a52-65f0-484a-9ab9-903ed049026f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BRsVKCgG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74960) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 12:20:07 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-a31e92f9-ecb7-4e7d-ac20-1c29e59bf419 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e91dfcf4-caef-43d0-a56b-b1282363d4e0 is timed out.
Nov 03 12:20:07 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-a31e92f9-ecb7-4e7d-ac20-1c29e59bf419 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Successfully detached device vdb from instance e91dfcf4-caef-43d0-a56b-b1282363d4e0 from the live domain config.
Nov 03 12:20:07 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a31e92f9-ecb7-4e7d-ac20-1c29e59bf419 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] [instance: e91dfcf4-caef-43d0-a56b-b1282363d4e0] calling os-brick to detach iSCSI Volume {{(pid=74960) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 12:20:07 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-a31e92f9-ecb7-4e7d-ac20-1c29e59bf419 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9aa420acb0>, {'target_iqn': 'iqn.2010-10.org.openstack:20d9e4ca-e4a0-404c-93a8-783525cbf863', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hSgODaQT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:20:07 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-a31e92f9-ecb7-4e7d-ac20-1c29e59bf419 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:20:07 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-a31e92f9-ecb7-4e7d-ac20-1c29e59bf419 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:20:08 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-75be19b2-a912-4ed0-abd3-87c2be6d7d36 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0a520c41-19c0-47ba-ada8-023ee9c12ca6 is timed out.
Nov 03 12:20:08 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-75be19b2-a912-4ed0-abd3-87c2be6d7d36 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Successfully detached device vdb from instance 0a520c41-19c0-47ba-ada8-023ee9c12ca6 from the live domain config.
Nov 03 12:20:08 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-75be19b2-a912-4ed0-abd3-87c2be6d7d36 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] calling os-brick to detach iSCSI Volume {{(pid=74960) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 12:20:08 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-75be19b2-a912-4ed0-abd3-87c2be6d7d36 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9aa420acb0>, {'target_iqn': 'iqn.2010-10.org.openstack:27e9e6ae-69f2-4849-ab0c-0b7f9fc18990', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PHLOWQjV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:20:08 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-75be19b2-a912-4ed0-abd3-87c2be6d7d36 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:20:08 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-75be19b2-a912-4ed0-abd3-87c2be6d7d36 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:20:08 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-343f88ba-1274-4b5e-911d-e27d7d44e2a9 tempest-VolumesAssistedSnapshotsTest-464837836 tempest-VolumesAssistedSnapshotsTest-464837836-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.344s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:20:08 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-343f88ba-1274-4b5e-911d-e27d7d44e2a9 tempest-VolumesAssistedSnapshotsTest-464837836 tempest-VolumesAssistedSnapshotsTest-464837836-project-admin] <== connect_volume: return (1345ms) {'type': 'block', 'scsi_wwn': '23739653539353963', 'path': '/dev/sdf'} {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:20:08 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-343f88ba-1274-4b5e-911d-e27d7d44e2a9 tempest-VolumesAssistedSnapshotsTest-464837836 tempest-VolumesAssistedSnapshotsTest-464837836-project-admin] [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23739653539353963', 'path': '/dev/sdf'} {{(pid=74960) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 12:20:08 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-a31e92f9-ecb7-4e7d-ac20-1c29e59bf419 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.857s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:20:08 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:20:08 user nova-compute[74960]: DEBUG nova.objects.instance [None req-343f88ba-1274-4b5e-911d-e27d7d44e2a9 tempest-VolumesAssistedSnapshotsTest-464837836 tempest-VolumesAssistedSnapshotsTest-464837836-project-admin] Lazy-loading 'flavor' on Instance uuid 7f7fabc2-5e1b-441c-a693-9956470359ea {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:20:08 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:20:08 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[da08f69c-4056-4e3a-aaf9-1de4c058dc92]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:27e9e6ae-69f2-4849-ab0c-0b7f9fc18990\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:967d5abf-c746-43a2-936e-e1abdc8475c3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:52a35a52-65f0-484a-9ab9-903ed049026f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:20d9e4ca-e4a0-404c-93a8-783525cbf863\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:20:08 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-a31e92f9-ecb7-4e7d-ac20-1c29e59bf419 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 12:20:08 user nova-compute[74960]: No targets found.
Nov 03 12:20:08 user nova-compute[74960]: iSNS:
Nov 03 12:20:08 user nova-compute[74960]: No targets found.
Nov 03 12:20:08 user nova-compute[74960]: STATIC:
Nov 03 12:20:08 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19
Nov 03 12:20:08 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:20:08 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:20:08 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:27e9e6ae-69f2-4849-ab0c-0b7f9fc18990
Nov 03 12:20:08 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:20:08 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:20:08 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:967d5abf-c746-43a2-936e-e1abdc8475c3
Nov 03 12:20:08 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:20:08 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:20:08 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:52a35a52-65f0-484a-9ab9-903ed049026f
Nov 03 12:20:08 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:20:08 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:20:08 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:20d9e4ca-e4a0-404c-93a8-783525cbf863
Nov 03 12:20:08 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:20:08 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:20:08 user nova-compute[74960]: FIRMWARE:
Nov 03 12:20:08 user nova-compute[74960]: No targets found.
Nov 03 12:20:08 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:20:08 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-a31e92f9-ecb7-4e7d-ac20-1c29e59bf419 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 12:20:08 user nova-compute[74960]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 12:20:08 user nova-compute[74960]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74960) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 12:20:08 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-a31e92f9-ecb7-4e7d-ac20-1c29e59bf419 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:20d9e4ca-e4a0-404c-93a8-783525cbf863', 0)] {{(pid=74960) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 12:20:08 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:20:08 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:20:08 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[e07a4be3-93ef-4c10-affe-ae693e76f8a6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20d9e4ca-e4a0-404c-93a8-783525cbf863\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27e9e6ae-69f2-4849-ab0c-0b7f9fc18990\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52a35a52-65f0-484a-9ab9-903ed049026f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:967d5abf-c746-43a2-936e-e1abdc8475c3\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:20:08 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:20:08 user nova-compute[74960]: DEBUG nova.virt.libvirt.guest [None req-343f88ba-1274-4b5e-911d-e27d7d44e2a9 tempest-VolumesAssistedSnapshotsTest-464837836 tempest-VolumesAssistedSnapshotsTest-464837836-project-admin] attach device xml: <disk type="block" device="disk">
Nov 03 12:20:08 user nova-compute[74960]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 12:20:08 user nova-compute[74960]:   <source dev="/dev/sdf"/>
Nov 03 12:20:08 user nova-compute[74960]:   <target dev="vdb" bus="virtio"/>
Nov 03 12:20:08 user nova-compute[74960]:   <serial>52a35a52-65f0-484a-9ab9-903ed049026f</serial>
Nov 03 12:20:08 user nova-compute[74960]: </disk>
Nov 03 12:20:08 user nova-compute[74960]:  {{(pid=74960) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 03 12:20:08 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:20:08 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d3ad852-2849-497b-8144-733591a69eea]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d9e4ca-e4a0-404c-93a8-783525cbf863 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27e9e6ae-69f2-4849-ab0c-0b7f9fc18990 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:967d5abf-c746-43a2-936e-e1abdc8475c3 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52a35a52-65f0-484a-9ab9-903ed049026f (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:20:08 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-a31e92f9-ecb7-4e7d-ac20-1c29e59bf419 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d9e4ca-e4a0-404c-93a8-783525cbf863 (non-flash)
Nov 03 12:20:08 user nova-compute[74960]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27e9e6ae-69f2-4849-ab0c-0b7f9fc18990 (non-flash)
Nov 03 12:20:08 user nova-compute[74960]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:967d5abf-c746-43a2-936e-e1abdc8475c3 (non-flash)
Nov 03 12:20:08 user nova-compute[74960]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19 (non-flash)
Nov 03 12:20:08 user nova-compute[74960]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52a35a52-65f0-484a-9ab9-903ed049026f (non-flash)
Nov 03 12:20:08 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:20:08 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-a31e92f9-ecb7-4e7d-ac20-1c29e59bf419 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d9e4ca-e4a0-404c-93a8-783525cbf863 (non-flash)
Nov 03 12:20:08 user nova-compute[74960]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27e9e6ae-69f2-4849-ab0c-0b7f9fc18990 (non-flash)
Nov 03 12:20:08 user nova-compute[74960]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:967d5abf-c746-43a2-936e-e1abdc8475c3 (non-flash)
Nov 03 12:20:08 user nova-compute[74960]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19 (non-flash)
Nov 03 12:20:08 user nova-compute[74960]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52a35a52-65f0-484a-9ab9-903ed049026f (non-flash)
Nov 03 12:20:08 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:20:08 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-a31e92f9-ecb7-4e7d-ac20-1c29e59bf419 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9aac256290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:20d9e4ca-e4a0-404c-93a8-783525cbf863'): ({'sdc'}, set())}) {{(pid=74960) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 12:20:08 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-a31e92f9-ecb7-4e7d-ac20-1c29e59bf419 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Removing single pathed devices sdc {{(pid=74960) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 12:20:08 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:20:08 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:20:08 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[32ab3aac-a3b2-4a5a-98f2-609d5ebdc68f]: (4, ('path checker states:\nup                  3\npending             2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:20:08 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:20:08 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:20:08 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[a00e45ee-76fa-4b70-a374-67dfc89abeef]: (4, ('ok\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:20:08 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-a31e92f9-ecb7-4e7d-ac20-1c29e59bf419 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Flushing IO for device /dev/sdc {{(pid=74960) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 12:20:08 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:20:08 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:20:08 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c7a8f85-27d4-4e2b-97cf-045d94d3a485]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:20:08 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-a31e92f9-ecb7-4e7d-ac20-1c29e59bf419 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74960) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 12:20:08 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:20:08 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-3ca77083-b3b4-40f4-8421-4d85fb57780a tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance d00a0872-693c-4cdc-85cd-9806660e9d8d is timed out.
Nov 03 12:20:08 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-3ca77083-b3b4-40f4-8421-4d85fb57780a tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Successfully detached device sdc from instance d00a0872-693c-4cdc-85cd-9806660e9d8d from the live domain config.
Nov 03 12:20:08 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ca77083-b3b4-40f4-8421-4d85fb57780a tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] [instance: d00a0872-693c-4cdc-85cd-9806660e9d8d] calling os-brick to detach iSCSI Volume {{(pid=74960) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 12:20:08 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ca77083-b3b4-40f4-8421-4d85fb57780a tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9aa420acb0>, {'target_iqn': 'iqn.2010-10.org.openstack:967d5abf-c746-43a2-936e-e1abdc8475c3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'znIrGpMY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:20:08 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-3ca77083-b3b4-40f4-8421-4d85fb57780a tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:20:08 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-3ca77083-b3b4-40f4-8421-4d85fb57780a tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:20:08 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:20:08 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[eee1403d-edd4-484e-a85b-0d13137bc2fa]: (4, ('1', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:20:08 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-a31e92f9-ecb7-4e7d-ac20-1c29e59bf419 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74960) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 12:20:08 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-a31e92f9-ecb7-4e7d-ac20-1c29e59bf419 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] SCSI volumes sdc have been removed. {{(pid=74960) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 12:20:08 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-a31e92f9-ecb7-4e7d-ac20-1c29e59bf419 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:20d9e4ca-e4a0-404c-93a8-783525cbf863')] {{(pid=74960) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 12:20:08 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20d9e4ca-e4a0-404c-93a8-783525cbf863 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:20:08 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20d9e4ca-e4a0-404c-93a8-783525cbf863 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:20:08 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[68a34df9-8b1b-4c94-bf5b-f87e73b97600]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:20:08 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-a31e92f9-ecb7-4e7d-ac20-1c29e59bf419 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:20:08 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20d9e4ca-e4a0-404c-93a8-783525cbf863 -p 172.16.0.220:3260 --logout {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:20:09 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20d9e4ca-e4a0-404c-93a8-783525cbf863 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:20:09 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[c52c3d85-4fbb-442f-85fd-6ec95de6732b]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:20d9e4ca-e4a0-404c-93a8-783525cbf863, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:20d9e4ca-e4a0-404c-93a8-783525cbf863, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:20:09 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-a31e92f9-ecb7-4e7d-ac20-1c29e59bf419 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:20d9e4ca-e4a0-404c-93a8-783525cbf863, portal: 172.16.0.220,3260]
Nov 03 12:20:09 user nova-compute[74960]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:20d9e4ca-e4a0-404c-93a8-783525cbf863, portal: 172.16.0.220,3260] successful.
Nov 03 12:20:09 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:20:09 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20d9e4ca-e4a0-404c-93a8-783525cbf863 -p 172.16.0.220:3260 --op delete {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:20:09 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20d9e4ca-e4a0-404c-93a8-783525cbf863 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:20:09 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d2d664-f1ed-4086-9e60-fa5080d4a6ab]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:20:09 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-a31e92f9-ecb7-4e7d-ac20-1c29e59bf419 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:20:09 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-a31e92f9-ecb7-4e7d-ac20-1c29e59bf419 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:20:09 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-a31e92f9-ecb7-4e7d-ac20-1c29e59bf419 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] <== disconnect_volume: return (1180ms) None {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:20:09 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a31e92f9-ecb7-4e7d-ac20-1c29e59bf419 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] [instance: e91dfcf4-caef-43d0-a56b-b1282363d4e0] Disconnected iSCSI Volume {{(pid=74960) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 12:20:09 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-75be19b2-a912-4ed0-abd3-87c2be6d7d36 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.513s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:20:09 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:20:09 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:20:09 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb20f43-8583-475c-894c-af85b78ef31d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:27e9e6ae-69f2-4849-ab0c-0b7f9fc18990\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:967d5abf-c746-43a2-936e-e1abdc8475c3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:52a35a52-65f0-484a-9ab9-903ed049026f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:20:09 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-75be19b2-a912-4ed0-abd3-87c2be6d7d36 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 12:20:09 user nova-compute[74960]: No targets found.
Nov 03 12:20:09 user nova-compute[74960]: iSNS:
Nov 03 12:20:09 user nova-compute[74960]: No targets found.
Nov 03 12:20:09 user nova-compute[74960]: STATIC:
Nov 03 12:20:09 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19
Nov 03 12:20:09 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:20:09 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:20:09 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:27e9e6ae-69f2-4849-ab0c-0b7f9fc18990
Nov 03 12:20:09 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:20:09 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:20:09 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:967d5abf-c746-43a2-936e-e1abdc8475c3
Nov 03 12:20:09 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:20:09 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:20:09 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:52a35a52-65f0-484a-9ab9-903ed049026f
Nov 03 12:20:09 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:20:09 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:20:09 user nova-compute[74960]: FIRMWARE:
Nov 03 12:20:09 user nova-compute[74960]: No targets found.
Nov 03 12:20:09 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:20:09 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-75be19b2-a912-4ed0-abd3-87c2be6d7d36 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 12:20:09 user nova-compute[74960]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 12:20:09 user nova-compute[74960]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74960) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 12:20:09 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-75be19b2-a912-4ed0-abd3-87c2be6d7d36 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27e9e6ae-69f2-4849-ab0c-0b7f9fc18990', 0)] {{(pid=74960) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 12:20:09 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:20:09 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:20:09 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[b677c4b0-f0b9-4738-a356-1e03ef01874d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27e9e6ae-69f2-4849-ab0c-0b7f9fc18990\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52a35a52-65f0-484a-9ab9-903ed049026f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:967d5abf-c746-43a2-936e-e1abdc8475c3\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:20:09 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:20:09 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:20:09 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a111f54-da4d-44d1-a70e-4495da5c9179]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27e9e6ae-69f2-4849-ab0c-0b7f9fc18990 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:967d5abf-c746-43a2-936e-e1abdc8475c3 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52a35a52-65f0-484a-9ab9-903ed049026f (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:20:09 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-75be19b2-a912-4ed0-abd3-87c2be6d7d36 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27e9e6ae-69f2-4849-ab0c-0b7f9fc18990 (non-flash)
Nov 03 12:20:09 user nova-compute[74960]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:967d5abf-c746-43a2-936e-e1abdc8475c3 (non-flash)
Nov 03 12:20:09 user nova-compute[74960]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19 (non-flash)
Nov 03 12:20:09 user nova-compute[74960]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52a35a52-65f0-484a-9ab9-903ed049026f (non-flash)
Nov 03 12:20:09 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:20:09 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-75be19b2-a912-4ed0-abd3-87c2be6d7d36 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27e9e6ae-69f2-4849-ab0c-0b7f9fc18990 (non-flash)
Nov 03 12:20:09 user nova-compute[74960]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:967d5abf-c746-43a2-936e-e1abdc8475c3 (non-flash)
Nov 03 12:20:09 user nova-compute[74960]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19 (non-flash)
Nov 03 12:20:09 user nova-compute[74960]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52a35a52-65f0-484a-9ab9-903ed049026f (non-flash)
Nov 03 12:20:09 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:20:09 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-75be19b2-a912-4ed0-abd3-87c2be6d7d36 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9aa4387520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27e9e6ae-69f2-4849-ab0c-0b7f9fc18990'): ({'sdd'}, set())}) {{(pid=74960) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 12:20:09 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-75be19b2-a912-4ed0-abd3-87c2be6d7d36 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Removing single pathed devices sdd {{(pid=74960) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 12:20:09 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:20:09 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:20:09 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[01beda9c-884a-4157-9c88-4a5b6f755103]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:20:09 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:20:09 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:20:09 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[c21ca4ad-12d1-4450-9246-f70e3a3ed6c0]: (4, ('ok\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:20:09 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-75be19b2-a912-4ed0-abd3-87c2be6d7d36 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Flushing IO for device /dev/sdd {{(pid=74960) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 12:20:09 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:20:09 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:20:09 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[922f8f73-e9ec-4ae9-9352-d59abcd4aecc]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:20:09 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-75be19b2-a912-4ed0-abd3-87c2be6d7d36 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74960) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 12:20:09 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:20:09 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-343f88ba-1274-4b5e-911d-e27d7d44e2a9 tempest-VolumesAssistedSnapshotsTest-464837836 tempest-VolumesAssistedSnapshotsTest-464837836-project-admin] No BDM found with device name vda, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:20:09 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-343f88ba-1274-4b5e-911d-e27d7d44e2a9 tempest-VolumesAssistedSnapshotsTest-464837836 tempest-VolumesAssistedSnapshotsTest-464837836-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:20:09 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-343f88ba-1274-4b5e-911d-e27d7d44e2a9 tempest-VolumesAssistedSnapshotsTest-464837836 tempest-VolumesAssistedSnapshotsTest-464837836-project-admin] No VIF found with MAC fa:16:3e:57:3d:47, not building metadata {{(pid=74960) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 12:20:09 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.033s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:20:09 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[9957b7c6-c8ba-48d9-9b2a-7dc5ddd456ac]: (4, ('1', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:20:09 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-75be19b2-a912-4ed0-abd3-87c2be6d7d36 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74960) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 12:20:09 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-75be19b2-a912-4ed0-abd3-87c2be6d7d36 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] SCSI volumes sdd have been removed. {{(pid=74960) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 12:20:09 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-75be19b2-a912-4ed0-abd3-87c2be6d7d36 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27e9e6ae-69f2-4849-ab0c-0b7f9fc18990')] {{(pid=74960) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 12:20:09 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27e9e6ae-69f2-4849-ab0c-0b7f9fc18990 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:20:09 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27e9e6ae-69f2-4849-ab0c-0b7f9fc18990 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:20:09 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[79171cdb-8250-402a-a971-02a5def6ffe9]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:20:09 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-75be19b2-a912-4ed0-abd3-87c2be6d7d36 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:20:09 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27e9e6ae-69f2-4849-ab0c-0b7f9fc18990 -p 172.16.0.220:3260 --logout {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:20:09 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27e9e6ae-69f2-4849-ab0c-0b7f9fc18990 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:20:09 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[531ec95f-0bc4-4554-99b2-83167380acca]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:27e9e6ae-69f2-4849-ab0c-0b7f9fc18990, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:27e9e6ae-69f2-4849-ab0c-0b7f9fc18990, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:20:09 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-75be19b2-a912-4ed0-abd3-87c2be6d7d36 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:27e9e6ae-69f2-4849-ab0c-0b7f9fc18990, portal: 172.16.0.220,3260]
Nov 03 12:20:09 user nova-compute[74960]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:27e9e6ae-69f2-4849-ab0c-0b7f9fc18990, portal: 172.16.0.220,3260] successful.
Nov 03 12:20:09 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:20:09 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27e9e6ae-69f2-4849-ab0c-0b7f9fc18990 -p 172.16.0.220:3260 --op delete {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:20:09 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27e9e6ae-69f2-4849-ab0c-0b7f9fc18990 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:20:09 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f1ae920-9cbb-4e76-8268-f6befc828c76]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:20:09 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-75be19b2-a912-4ed0-abd3-87c2be6d7d36 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:20:09 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-75be19b2-a912-4ed0-abd3-87c2be6d7d36 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:20:09 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-75be19b2-a912-4ed0-abd3-87c2be6d7d36 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] <== disconnect_volume: return (835ms) None {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:20:09 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-75be19b2-a912-4ed0-abd3-87c2be6d7d36 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] Disconnected iSCSI Volume {{(pid=74960) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 12:20:09 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-3ca77083-b3b4-40f4-8421-4d85fb57780a tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.475s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:20:09 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:20:09 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:20:09 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bfa3417-3a88-465c-a7f9-0a621d441ca7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:967d5abf-c746-43a2-936e-e1abdc8475c3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:52a35a52-65f0-484a-9ab9-903ed049026f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:20:09 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ca77083-b3b4-40f4-8421-4d85fb57780a tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 12:20:09 user nova-compute[74960]: No targets found.
Nov 03 12:20:09 user nova-compute[74960]: iSNS:
Nov 03 12:20:09 user nova-compute[74960]: No targets found.
Nov 03 12:20:09 user nova-compute[74960]: STATIC:
Nov 03 12:20:09 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19
Nov 03 12:20:09 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:20:09 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:20:09 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:967d5abf-c746-43a2-936e-e1abdc8475c3
Nov 03 12:20:09 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:20:09 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:20:09 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:52a35a52-65f0-484a-9ab9-903ed049026f
Nov 03 12:20:09 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:20:09 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:20:09 user nova-compute[74960]: FIRMWARE:
Nov 03 12:20:09 user nova-compute[74960]: No targets found.
Nov 03 12:20:09 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:20:09 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ca77083-b3b4-40f4-8421-4d85fb57780a tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 12:20:09 user nova-compute[74960]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 12:20:09 user nova-compute[74960]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74960) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 12:20:09 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ca77083-b3b4-40f4-8421-4d85fb57780a tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:967d5abf-c746-43a2-936e-e1abdc8475c3', 0)] {{(pid=74960) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 12:20:09 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:20:09 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:20:09 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b748a0f-35d2-405d-aa94-a9d2cc97cf89]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52a35a52-65f0-484a-9ab9-903ed049026f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:967d5abf-c746-43a2-936e-e1abdc8475c3\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:20:09 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:20:09 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:20:09 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6cac8cc-3faa-4463-b126-688586aa899f]: (4, ('tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:967d5abf-c746-43a2-936e-e1abdc8475c3 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52a35a52-65f0-484a-9ab9-903ed049026f (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:20:09 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ca77083-b3b4-40f4-8421-4d85fb57780a tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:967d5abf-c746-43a2-936e-e1abdc8475c3 (non-flash)
Nov 03 12:20:09 user nova-compute[74960]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19 (non-flash)
Nov 03 12:20:09 user nova-compute[74960]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52a35a52-65f0-484a-9ab9-903ed049026f (non-flash)
Nov 03 12:20:09 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:20:09 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ca77083-b3b4-40f4-8421-4d85fb57780a tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] iscsi session list stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:967d5abf-c746-43a2-936e-e1abdc8475c3 (non-flash)
Nov 03 12:20:09 user nova-compute[74960]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19 (non-flash)
Nov 03 12:20:09 user nova-compute[74960]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52a35a52-65f0-484a-9ab9-903ed049026f (non-flash)
Nov 03 12:20:09 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:20:09 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ca77083-b3b4-40f4-8421-4d85fb57780a tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9aac32f880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:967d5abf-c746-43a2-936e-e1abdc8475c3'): ({'sdb'}, set())}) {{(pid=74960) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 12:20:09 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-3ca77083-b3b4-40f4-8421-4d85fb57780a tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Removing single pathed devices sdb {{(pid=74960) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 12:20:09 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:20:09 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:20:09 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ba21939-287a-4b96-b59c-631fec420794]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:20:09 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:20:09 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:20:09 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[6360f88d-5227-4798-adbd-87591c360052]: (4, ('ok\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:20:09 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-3ca77083-b3b4-40f4-8421-4d85fb57780a tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Flushing IO for device /dev/sdb {{(pid=74960) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 12:20:09 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:20:09 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:20:09 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[feaa9b85-d680-4624-935a-f9023ca88403]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:20:09 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-3ca77083-b3b4-40f4-8421-4d85fb57780a tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74960) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 12:20:09 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:20:09 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:20:09 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6285ff9-c7b4-4a9f-855d-001b797e9133]: (4, ('1', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:20:09 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-3ca77083-b3b4-40f4-8421-4d85fb57780a tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74960) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 12:20:09 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-3ca77083-b3b4-40f4-8421-4d85fb57780a tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] SCSI volumes sdb have been removed. {{(pid=74960) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 12:20:09 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ca77083-b3b4-40f4-8421-4d85fb57780a tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:967d5abf-c746-43a2-936e-e1abdc8475c3')] {{(pid=74960) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 12:20:09 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:967d5abf-c746-43a2-936e-e1abdc8475c3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:20:09 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:967d5abf-c746-43a2-936e-e1abdc8475c3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:20:09 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[d199497f-378b-4d4a-9342-3ba3640eb27a]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:20:09 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ca77083-b3b4-40f4-8421-4d85fb57780a tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:20:09 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:967d5abf-c746-43a2-936e-e1abdc8475c3 -p 172.16.0.220:3260 --logout {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:20:09 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:967d5abf-c746-43a2-936e-e1abdc8475c3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:20:09 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[710b749c-97e3-45e2-80c2-9250c1da95d5]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:967d5abf-c746-43a2-936e-e1abdc8475c3, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:967d5abf-c746-43a2-936e-e1abdc8475c3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:20:09 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ca77083-b3b4-40f4-8421-4d85fb57780a tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:967d5abf-c746-43a2-936e-e1abdc8475c3, portal: 172.16.0.220,3260]
Nov 03 12:20:09 user nova-compute[74960]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:967d5abf-c746-43a2-936e-e1abdc8475c3, portal: 172.16.0.220,3260] successful.
Nov 03 12:20:09 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:20:09 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:967d5abf-c746-43a2-936e-e1abdc8475c3 -p 172.16.0.220:3260 --op delete {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:20:09 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:967d5abf-c746-43a2-936e-e1abdc8475c3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:20:09 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[86cb9030-aa0e-4ee2-8b44-d193b89742f3]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:20:09 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ca77083-b3b4-40f4-8421-4d85fb57780a tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:20:09 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-3ca77083-b3b4-40f4-8421-4d85fb57780a tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:20:09 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ca77083-b3b4-40f4-8421-4d85fb57780a tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] <== disconnect_volume: return (768ms) None {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:20:09 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ca77083-b3b4-40f4-8421-4d85fb57780a tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] [instance: d00a0872-693c-4cdc-85cd-9806660e9d8d] Disconnected iSCSI Volume {{(pid=74960) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 12:20:10 user nova-compute[74960]: DEBUG nova.objects.instance [None req-a31e92f9-ecb7-4e7d-ac20-1c29e59bf419 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Lazy-loading 'flavor' on Instance uuid e91dfcf4-caef-43d0-a56b-b1282363d4e0 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:20:10 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-a31e92f9-ecb7-4e7d-ac20-1c29e59bf419 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Lock "e91dfcf4-caef-43d0-a56b-b1282363d4e0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.888s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:20:10 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-343f88ba-1274-4b5e-911d-e27d7d44e2a9 tempest-VolumesAssistedSnapshotsTest-464837836 tempest-VolumesAssistedSnapshotsTest-464837836-project-admin] Lock "7f7fabc2-5e1b-441c-a693-9956470359ea" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 31.376s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:20:10 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:20:10 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:20:10 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74960) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 12:20:10 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74960) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 12:20:10 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74960) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 12:20:10 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.volume.cinder [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] Update attachment failed for attachment 0af66f47-4a46-42ff-a7d0-fcd39b8cab9e. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-d7058562-f652-4649-a3ef-30467384be2d) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-d7058562-f652-4649-a3ef-30467384be2d)
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.compute.manager [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04] Instance failed block device setup: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-d7058562-f652-4649-a3ef-30467384be2d)
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.compute.manager [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04] Traceback (most recent call last):
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.compute.manager [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04]   File "/opt/stack/nova/nova/compute/manager.py", line 2190, in _prep_block_device
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.compute.manager [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04]     driver_block_device.attach_block_devices(
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.compute.manager [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04]   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.compute.manager [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04]     _log_and_attach(device)
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.compute.manager [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04]   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.compute.manager [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04]     bdm.attach(*attach_args, **attach_kwargs)
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.compute.manager [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.compute.manager [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04]     ret_val = method(obj, context, *args, **kwargs)
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.compute.manager [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.compute.manager [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04]     self._do_attach(context, instance, volume, volume_api,
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.compute.manager [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.compute.manager [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04]     self._volume_attach(context, volume, connector, instance,
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.compute.manager [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.compute.manager [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04]     connection_info = volume_api.attachment_update(
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.compute.manager [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.compute.manager [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04]     res = method(self, ctx, *args, **kwargs)
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.compute.manager [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.compute.manager [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.compute.manager [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.compute.manager [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04]     with excutils.save_and_reraise_exception():
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.compute.manager [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.compute.manager [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04]     self.force_reraise()
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.compute.manager [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.compute.manager [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04]     raise self.value
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.compute.manager [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.compute.manager [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04]     context, '3.44', skip_version_check=True).attachments.update(
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.compute.manager [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.compute.manager [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04]     return method.func(obj, *args, **kwargs)
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.compute.manager [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.compute.manager [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04]     resp = self._update('/attachments/%s' % id, body)
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.compute.manager [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.compute.manager [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.compute.manager [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.compute.manager [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04]     return self._cs_request(url, 'PUT', **kwargs)
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.compute.manager [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.compute.manager [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04]     return self.request(url, method, **kwargs)
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.compute.manager [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.compute.manager [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04]     raise exceptions.from_response(resp, body)
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.compute.manager [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-d7058562-f652-4649-a3ef-30467384be2d)
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.compute.manager [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04] 
Nov 03 12:20:10 user nova-compute[74960]: DEBUG nova.compute.claims [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04] Aborting claim: <nova.compute.claims.Claim object at 0x7f9aa434a470> {{(pid=74960) abort /opt/stack/nova/nova/compute/claims.py:84}}
Nov 03 12:20:10 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:20:10 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.volume.cinder [None req-2bae53cb-fa77-4ed4-93fd-63c0ab3edfd8 tempest-TestVolumeSwap-1219579390 tempest-TestVolumeSwap-1219579390-project-admin] Update attachment failed for attachment 17d4b74e-8a9e-48e3-af55-afab545007db. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-2d956038-3201-484b-bca5-2869874c39c4) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-2d956038-3201-484b-bca5-2869874c39c4)
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.compute.manager [None req-2bae53cb-fa77-4ed4-93fd-63c0ab3edfd8 tempest-TestVolumeSwap-1219579390 tempest-TestVolumeSwap-1219579390-project-admin] [instance: 8381c969-6a2d-4934-aadd-660ffa246b05] Failed to connect to volume 4085c299-4eec-46d3-b50a-7f7609a1f42c with volume at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-2d956038-3201-484b-bca5-2869874c39c4)
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.compute.manager [instance: 8381c969-6a2d-4934-aadd-660ffa246b05] Traceback (most recent call last):
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.compute.manager [instance: 8381c969-6a2d-4934-aadd-660ffa246b05]   File "/opt/stack/nova/nova/compute/manager.py", line 7770, in _swap_volume
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.compute.manager [instance: 8381c969-6a2d-4934-aadd-660ffa246b05]     old_cinfo, new_cinfo = self._init_volume_connection(
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.compute.manager [instance: 8381c969-6a2d-4934-aadd-660ffa246b05]   File "/opt/stack/nova/nova/compute/manager.py", line 7743, in _init_volume_connection
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.compute.manager [instance: 8381c969-6a2d-4934-aadd-660ffa246b05]     new_cinfo = self.volume_api.attachment_update(
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.compute.manager [instance: 8381c969-6a2d-4934-aadd-660ffa246b05]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.compute.manager [instance: 8381c969-6a2d-4934-aadd-660ffa246b05]     res = method(self, ctx, *args, **kwargs)
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.compute.manager [instance: 8381c969-6a2d-4934-aadd-660ffa246b05]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.compute.manager [instance: 8381c969-6a2d-4934-aadd-660ffa246b05]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.compute.manager [instance: 8381c969-6a2d-4934-aadd-660ffa246b05]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.compute.manager [instance: 8381c969-6a2d-4934-aadd-660ffa246b05]     with excutils.save_and_reraise_exception():
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.compute.manager [instance: 8381c969-6a2d-4934-aadd-660ffa246b05]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.compute.manager [instance: 8381c969-6a2d-4934-aadd-660ffa246b05]     self.force_reraise()
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.compute.manager [instance: 8381c969-6a2d-4934-aadd-660ffa246b05]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.compute.manager [instance: 8381c969-6a2d-4934-aadd-660ffa246b05]     raise self.value
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.compute.manager [instance: 8381c969-6a2d-4934-aadd-660ffa246b05]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.compute.manager [instance: 8381c969-6a2d-4934-aadd-660ffa246b05]     context, '3.44', skip_version_check=True).attachments.update(
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.compute.manager [instance: 8381c969-6a2d-4934-aadd-660ffa246b05]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.compute.manager [instance: 8381c969-6a2d-4934-aadd-660ffa246b05]     return method.func(obj, *args, **kwargs)
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.compute.manager [instance: 8381c969-6a2d-4934-aadd-660ffa246b05]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.compute.manager [instance: 8381c969-6a2d-4934-aadd-660ffa246b05]     resp = self._update('/attachments/%s' % id, body)
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.compute.manager [instance: 8381c969-6a2d-4934-aadd-660ffa246b05]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.compute.manager [instance: 8381c969-6a2d-4934-aadd-660ffa246b05]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.compute.manager [instance: 8381c969-6a2d-4934-aadd-660ffa246b05]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.compute.manager [instance: 8381c969-6a2d-4934-aadd-660ffa246b05]     return self._cs_request(url, 'PUT', **kwargs)
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.compute.manager [instance: 8381c969-6a2d-4934-aadd-660ffa246b05]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.compute.manager [instance: 8381c969-6a2d-4934-aadd-660ffa246b05]     return self.request(url, method, **kwargs)
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.compute.manager [instance: 8381c969-6a2d-4934-aadd-660ffa246b05]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.compute.manager [instance: 8381c969-6a2d-4934-aadd-660ffa246b05]     raise exceptions.from_response(resp, body)
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.compute.manager [instance: 8381c969-6a2d-4934-aadd-660ffa246b05] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-2d956038-3201-484b-bca5-2869874c39c4)
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.compute.manager [instance: 8381c969-6a2d-4934-aadd-660ffa246b05] 
Nov 03 12:20:10 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-2bae53cb-fa77-4ed4-93fd-63c0ab3edfd8 tempest-TestVolumeSwap-1219579390 tempest-TestVolumeSwap-1219579390-project-admin] Lock "8381c969-6a2d-4934-aadd-660ffa246b05" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 21.522s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:20:10 user nova-compute[74960]: ERROR oslo_messaging.rpc.server [None req-2bae53cb-fa77-4ed4-93fd-63c0ab3edfd8 tempest-TestVolumeSwap-1219579390 tempest-TestVolumeSwap-1219579390-project-admin] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-2d956038-3201-484b-bca5-2869874c39c4)
Nov 03 12:20:10 user nova-compute[74960]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 03 12:20:10 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 03 12:20:10 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 03 12:20:10 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 03 12:20:10 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 03 12:20:10 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 03 12:20:10 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 03 12:20:10 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 03 12:20:10 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 03 12:20:10 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 03 12:20:10 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 03 12:20:10 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 03 12:20:10 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 03 12:20:10 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 03 12:20:10 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 03 12:20:10 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Nov 03 12:20:10 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 03 12:20:10 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Nov 03 12:20:10 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 03 12:20:10 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 03 12:20:10 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 03 12:20:10 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 03 12:20:10 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 03 12:20:10 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Nov 03 12:20:10 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 03 12:20:10 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7903, in swap_volume
Nov 03 12:20:10 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     _do_locked_swap_volume(context, old_volume_id, new_volume_id, instance,
Nov 03 12:20:10 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Nov 03 12:20:10 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Nov 03 12:20:10 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7901, in _do_locked_swap_volume
Nov 03 12:20:10 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     self._do_swap_volume(context, old_volume_id, new_volume_id,
Nov 03 12:20:10 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7945, in _do_swap_volume
Nov 03 12:20:10 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     comp_ret, new_cinfo = self._swap_volume(context,
Nov 03 12:20:10 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7794, in _swap_volume
Nov 03 12:20:10 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 03 12:20:10 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 03 12:20:10 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 03 12:20:10 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 03 12:20:10 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 03 12:20:10 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7770, in _swap_volume
Nov 03 12:20:10 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     old_cinfo, new_cinfo = self._init_volume_connection(
Nov 03 12:20:10 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7743, in _init_volume_connection
Nov 03 12:20:10 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     new_cinfo = self.volume_api.attachment_update(
Nov 03 12:20:10 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 03 12:20:10 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Nov 03 12:20:10 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 03 12:20:10 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 03 12:20:10 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 03 12:20:10 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 03 12:20:10 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 03 12:20:10 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 03 12:20:10 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 03 12:20:10 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 03 12:20:10 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 03 12:20:10 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Nov 03 12:20:10 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 03 12:20:10 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Nov 03 12:20:10 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 03 12:20:10 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Nov 03 12:20:10 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 03 12:20:10 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 03 12:20:10 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 03 12:20:10 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Nov 03 12:20:10 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 03 12:20:10 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Nov 03 12:20:10 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 03 12:20:10 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Nov 03 12:20:10 user nova-compute[74960]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-2d956038-3201-484b-bca5-2869874c39c4)
Nov 03 12:20:10 user nova-compute[74960]: ERROR oslo_messaging.rpc.server 
Nov 03 12:20:10 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-14415430-db85-4a34-88ef-9a8789edf838 tempest-VolumesAssistedSnapshotsTest-481806525 tempest-VolumesAssistedSnapshotsTest-481806525-project] [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea] volume_snapshot_create: create_info: {'snapshot_id': 'a4a21b5c-e34e-4766-b949-d554a05789d5', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=74960) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Nov 03 12:20:10 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-14415430-db85-4a34-88ef-9a8789edf838 tempest-VolumesAssistedSnapshotsTest-481806525 tempest-VolumesAssistedSnapshotsTest-481806525-project] [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea] snap xml: <domainsnapshot>
Nov 03 12:20:10 user nova-compute[74960]:   <disks>
Nov 03 12:20:10 user nova-compute[74960]:     <disk name="/dev/sdf" snapshot="external" type="file">
Nov 03 12:20:10 user nova-compute[74960]:       <source file="/dev/new_file"/>
Nov 03 12:20:10 user nova-compute[74960]:     </disk>
Nov 03 12:20:10 user nova-compute[74960]:     <disk name="vda" snapshot="no"/>
Nov 03 12:20:10 user nova-compute[74960]:   </disks>
Nov 03 12:20:10 user nova-compute[74960]: </domainsnapshot>
Nov 03 12:20:10 user nova-compute[74960]:  {{(pid=74960) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Nov 03 12:20:10 user nova-compute[74960]: DEBUG nova.objects.instance [None req-14415430-db85-4a34-88ef-9a8789edf838 tempest-VolumesAssistedSnapshotsTest-481806525 tempest-VolumesAssistedSnapshotsTest-481806525-project] Lazy-loading 'system_metadata' on Instance uuid 7f7fabc2-5e1b-441c-a693-9956470359ea {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:20:10 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:20:10 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:20:10 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-14415430-db85-4a34-88ef-9a8789edf838 tempest-VolumesAssistedSnapshotsTest-481806525 tempest-VolumesAssistedSnapshotsTest-481806525-project] [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 03 12:20:10 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.480s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:20:10 user nova-compute[74960]: DEBUG nova.compute.manager [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04] Build of instance ac9e1b20-2482-4c71-b54b-5d6cb8187d04 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-d7058562-f652-4649-a3ef-30467384be2d) {{(pid=74960) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2660}}
Nov 03 12:20:10 user nova-compute[74960]: DEBUG nova.compute.utils [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04] Build of instance ac9e1b20-2482-4c71-b54b-5d6cb8187d04 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: {{(pid=74960) notify_about_instance_usage /opt/stack/nova/nova/compute/utils.py:430}}
Nov 03 12:20:10 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-2c2b2b7e-1ff1-4a06-bc65-e7c08f09b48b tempest-VolumesAssistedSnapshotsTest-481806525 tempest-VolumesAssistedSnapshotsTest-481806525-project] [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea] volume_snapshot_delete: delete_info: {'volume_id': '52a35a52-65f0-484a-9ab9-903ed049026f'} {{(pid=74960) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.virt.libvirt.driver [None req-2c2b2b7e-1ff1-4a06-bc65-e7c08f09b48b tempest-VolumesAssistedSnapshotsTest-481806525 tempest-VolumesAssistedSnapshotsTest-481806525-project] [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.virt.libvirt.driver [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea] Traceback (most recent call last):
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.virt.libvirt.driver [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.virt.libvirt.driver [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea]     self._volume_snapshot_delete(context, instance, volume_id,
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.virt.libvirt.driver [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.virt.libvirt.driver [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea]     if delete_info['type'] != 'qcow2':
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.virt.libvirt.driver [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea] KeyError: 'type'
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.virt.libvirt.driver [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea] 
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.compute.manager [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04] Build of instance ac9e1b20-2482-4c71-b54b-5d6cb8187d04 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-d7058562-f652-4649-a3ef-30467384be2d): nova.exception.BuildAbortException: Build of instance ac9e1b20-2482-4c71-b54b-5d6cb8187d04 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-d7058562-f652-4649-a3ef-30467384be2d)
Nov 03 12:20:10 user nova-compute[74960]: DEBUG nova.compute.manager [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04] Unplugging VIFs for instance {{(pid=74960) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:2996}}
Nov 03 12:20:10 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T12:18:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-169343523',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-169343523',id=11,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLOC5cclZk/vQ7FVPKC/o6t/hoA9+72IHKH1jZIS8SaUpLPZFRdYwhmN2qlubEyE90YR5Dazknsm5K8JoBW51/vBrRnw6FQI7v4EHLIuiogmJoe7MdebvLmhP9HJkPVKWA==',key_name='tempest-keypair-976026532',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='602dab4996a7422cb9bf5aff46e0fee4',ramdisk_id='',reservation_id='r-ekkq0qeh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-62953878',owner_user_name='tempest-TaggedBootDevicesTest-62953878-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:18:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f88ab1bd57524047a55e8e5bb4690ac1',uuid=ac9e1b20-2482-4c71-b54b-5d6cb8187d04,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2fa8f636-7161-4db6-83bf-7e4c9eff4c67", "address": "fa:16:3e:09:9c:5a", "network": {"id": "a22b4dee-2e5f-4184-87ba-146395c5bc2c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-820777923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "602dab4996a7422cb9bf5aff46e0fee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fa8f636-71", "ovs_interfaceid": "2fa8f636-7161-4db6-83bf-7e4c9eff4c67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 12:20:10 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] Converting VIF {"id": "2fa8f636-7161-4db6-83bf-7e4c9eff4c67", "address": "fa:16:3e:09:9c:5a", "network": {"id": "a22b4dee-2e5f-4184-87ba-146395c5bc2c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-820777923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "602dab4996a7422cb9bf5aff46e0fee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fa8f636-71", "ovs_interfaceid": "2fa8f636-7161-4db6-83bf-7e4c9eff4c67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:20:10 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:9c:5a,bridge_name='br-int',has_traffic_filtering=True,id=2fa8f636-7161-4db6-83bf-7e4c9eff4c67,network=Network(a22b4dee-2e5f-4184-87ba-146395c5bc2c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fa8f636-71') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:20:10 user nova-compute[74960]: DEBUG os_vif [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:9c:5a,bridge_name='br-int',has_traffic_filtering=True,id=2fa8f636-7161-4db6-83bf-7e4c9eff4c67,network=Network(a22b4dee-2e5f-4184-87ba-146395c5bc2c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fa8f636-71') {{(pid=74960) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.virt.libvirt.driver [None req-14415430-db85-4a34-88ef-9a8789edf838 tempest-VolumesAssistedSnapshotsTest-481806525 tempest-VolumesAssistedSnapshotsTest-481806525-project] [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.virt.libvirt.driver [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea] Traceback (most recent call last):
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.virt.libvirt.driver [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.virt.libvirt.driver [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.virt.libvirt.driver [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.virt.libvirt.driver [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.virt.libvirt.driver [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.virt.libvirt.driver [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.virt.libvirt.driver [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.virt.libvirt.driver [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea]     rv = execute(f, *args, **kwargs)
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.virt.libvirt.driver [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.virt.libvirt.driver [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea]     six.reraise(c, e, tb)
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.virt.libvirt.driver [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.virt.libvirt.driver [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea]     raise value
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.virt.libvirt.driver [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.virt.libvirt.driver [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea]     rv = meth(*args, **kwargs)
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.virt.libvirt.driver [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.virt.libvirt.driver [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.virt.libvirt.driver [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.virt.libvirt.driver [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea] 
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.virt.libvirt.driver [None req-14415430-db85-4a34-88ef-9a8789edf838 tempest-VolumesAssistedSnapshotsTest-481806525 tempest-VolumesAssistedSnapshotsTest-481806525-project] [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.virt.libvirt.driver [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea] Traceback (most recent call last):
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.virt.libvirt.driver [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.virt.libvirt.driver [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea]     self._volume_snapshot_create(context, instance, guest,
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.virt.libvirt.driver [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.virt.libvirt.driver [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.virt.libvirt.driver [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.virt.libvirt.driver [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.virt.libvirt.driver [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.virt.libvirt.driver [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.virt.libvirt.driver [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.virt.libvirt.driver [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea]     rv = execute(f, *args, **kwargs)
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.virt.libvirt.driver [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.virt.libvirt.driver [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea]     six.reraise(c, e, tb)
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.virt.libvirt.driver [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.virt.libvirt.driver [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea]     raise value
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.virt.libvirt.driver [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.virt.libvirt.driver [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea]     rv = meth(*args, **kwargs)
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.virt.libvirt.driver [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.virt.libvirt.driver [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.virt.libvirt.driver [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.virt.libvirt.driver [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea] 
Nov 03 12:20:10 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:20:10 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2fa8f636-71, bridge=br-int, if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:20:10 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 12:20:10 user nova-compute[74960]: INFO os_vif [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:9c:5a,bridge_name='br-int',has_traffic_filtering=True,id=2fa8f636-7161-4db6-83bf-7e4c9eff4c67,network=Network(a22b4dee-2e5f-4184-87ba-146395c5bc2c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fa8f636-71')
Nov 03 12:20:10 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T12:18:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-169343523',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-169343523',id=11,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLOC5cclZk/vQ7FVPKC/o6t/hoA9+72IHKH1jZIS8SaUpLPZFRdYwhmN2qlubEyE90YR5Dazknsm5K8JoBW51/vBrRnw6FQI7v4EHLIuiogmJoe7MdebvLmhP9HJkPVKWA==',key_name='tempest-keypair-976026532',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='602dab4996a7422cb9bf5aff46e0fee4',ramdisk_id='',reservation_id='r-ekkq0qeh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-62953878',owner_user_name='tempest-TaggedBootDevicesTest-62953878-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:18:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f88ab1bd57524047a55e8e5bb4690ac1',uuid=ac9e1b20-2482-4c71-b54b-5d6cb8187d04,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e95cf873-cdaf-4aa9-8e6d-1c2d2ad4c6a8", "address": "fa:16:3e:b2:0d:16", "network": {"id": "5d680571-15f7-44de-bdac-ca3a8ab46ace", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354419557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "602dab4996a7422cb9bf5aff46e0fee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape95cf873-cd", "ovs_interfaceid": "e95cf873-cdaf-4aa9-8e6d-1c2d2ad4c6a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74960) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 12:20:10 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] Converting VIF {"id": "e95cf873-cdaf-4aa9-8e6d-1c2d2ad4c6a8", "address": "fa:16:3e:b2:0d:16", "network": {"id": "5d680571-15f7-44de-bdac-ca3a8ab46ace", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354419557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "602dab4996a7422cb9bf5aff46e0fee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape95cf873-cd", "ovs_interfaceid": "e95cf873-cdaf-4aa9-8e6d-1c2d2ad4c6a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:20:10 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:0d:16,bridge_name='br-int',has_traffic_filtering=True,id=e95cf873-cdaf-4aa9-8e6d-1c2d2ad4c6a8,network=Network(5d680571-15f7-44de-bdac-ca3a8ab46ace),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape95cf873-cd') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:20:10 user nova-compute[74960]: DEBUG os_vif [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:0d:16,bridge_name='br-int',has_traffic_filtering=True,id=e95cf873-cdaf-4aa9-8e6d-1c2d2ad4c6a8,network=Network(5d680571-15f7-44de-bdac-ca3a8ab46ace),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape95cf873-cd') {{(pid=74960) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 12:20:10 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:20:10 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape95cf873-cd, bridge=br-int, if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:20:10 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.virt.libvirt.driver [None req-2c2b2b7e-1ff1-4a06-bc65-e7c08f09b48b tempest-VolumesAssistedSnapshotsTest-481806525 tempest-VolumesAssistedSnapshotsTest-481806525-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.virt.libvirt.driver 
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.virt.libvirt.driver 
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-4ffce818-dd87-4537-b63d-53f9f4b4febe)
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.virt.libvirt.driver 
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.virt.libvirt.driver 
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 03 12:20:10 user nova-compute[74960]: ERROR nova.virt.libvirt.driver 
Nov 03 12:20:10 user nova-compute[74960]: ERROR oslo_messaging.rpc.server [None req-2c2b2b7e-1ff1-4a06-bc65-e7c08f09b48b tempest-VolumesAssistedSnapshotsTest-481806525 tempest-VolumesAssistedSnapshotsTest-481806525-project] Exception during message handling: KeyError: 'type'
Nov 03 12:20:10 user nova-compute[74960]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 03 12:20:10 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 03 12:20:10 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 03 12:20:10 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 03 12:20:10 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 03 12:20:10 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 03 12:20:10 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 03 12:20:10 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 03 12:20:10 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 03 12:20:10 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 03 12:20:10 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 03 12:20:10 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 03 12:20:10 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 03 12:20:10 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 03 12:20:10 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 03 12:20:10 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 03 12:20:10 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 03 12:20:10 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Nov 03 12:20:10 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Nov 03 12:20:10 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Nov 03 12:20:10 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 03 12:20:10 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 03 12:20:10 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 03 12:20:10 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 03 12:20:10 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 03 12:20:10 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 03 12:20:10 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Nov 03 12:20:10 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 03 12:20:10 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Nov 03 12:20:10 user nova-compute[74960]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Nov 03 12:20:10 user nova-compute[74960]: ERROR oslo_messaging.rpc.server 
Nov 03 12:20:10 user nova-compute[74960]: INFO os_vif [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:0d:16,bridge_name='br-int',has_traffic_filtering=True,id=e95cf873-cdaf-4aa9-8e6d-1c2d2ad4c6a8,network=Network(5d680571-15f7-44de-bdac-ca3a8ab46ace),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape95cf873-cd')
Nov 03 12:20:10 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T12:18:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-169343523',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-169343523',id=11,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLOC5cclZk/vQ7FVPKC/o6t/hoA9+72IHKH1jZIS8SaUpLPZFRdYwhmN2qlubEyE90YR5Dazknsm5K8JoBW51/vBrRnw6FQI7v4EHLIuiogmJoe7MdebvLmhP9HJkPVKWA==',key_name='tempest-keypair-976026532',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='602dab4996a7422cb9bf5aff46e0fee4',ramdisk_id='',reservation_id='r-ekkq0qeh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-62953878',owner_user_name='tempest-TaggedBootDevicesTest-62953878-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:18:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f88ab1bd57524047a55e8e5bb4690ac1',uuid=ac9e1b20-2482-4c71-b54b-5d6cb8187d04,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1d83fe31-117e-49b5-a073-1c8dec48fd1f", "address": "fa:16:3e:2e:1b:71", "network": {"id": "5d680571-15f7-44de-bdac-ca3a8ab46ace", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354419557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "602dab4996a7422cb9bf5aff46e0fee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d83fe31-11", "ovs_interfaceid": "1d83fe31-117e-49b5-a073-1c8dec48fd1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74960) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 12:20:10 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] Converting VIF {"id": "1d83fe31-117e-49b5-a073-1c8dec48fd1f", "address": "fa:16:3e:2e:1b:71", "network": {"id": "5d680571-15f7-44de-bdac-ca3a8ab46ace", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354419557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "602dab4996a7422cb9bf5aff46e0fee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d83fe31-11", "ovs_interfaceid": "1d83fe31-117e-49b5-a073-1c8dec48fd1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:20:10 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:1b:71,bridge_name='br-int',has_traffic_filtering=True,id=1d83fe31-117e-49b5-a073-1c8dec48fd1f,network=Network(5d680571-15f7-44de-bdac-ca3a8ab46ace),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1d83fe31-11') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:20:10 user nova-compute[74960]: DEBUG os_vif [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:1b:71,bridge_name='br-int',has_traffic_filtering=True,id=1d83fe31-117e-49b5-a073-1c8dec48fd1f,network=Network(5d680571-15f7-44de-bdac-ca3a8ab46ace),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1d83fe31-11') {{(pid=74960) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 12:20:11 user nova-compute[74960]: ERROR nova.virt.libvirt.driver [None req-14415430-db85-4a34-88ef-9a8789edf838 tempest-VolumesAssistedSnapshotsTest-481806525 tempest-VolumesAssistedSnapshotsTest-481806525-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot a4a21b5c-e34e-4766-b949-d554a05789d5 could not be found.
Nov 03 12:20:11 user nova-compute[74960]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 03 12:20:11 user nova-compute[74960]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 03 12:20:11 user nova-compute[74960]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Nov 03 12:20:11 user nova-compute[74960]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 03 12:20:11 user nova-compute[74960]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 03 12:20:11 user nova-compute[74960]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 03 12:20:11 user nova-compute[74960]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 03 12:20:11 user nova-compute[74960]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 03 12:20:11 user nova-compute[74960]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 03 12:20:11 user nova-compute[74960]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 03 12:20:11 user nova-compute[74960]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Nov 03 12:20:11 user nova-compute[74960]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 03 12:20:11 user nova-compute[74960]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Nov 03 12:20:11 user nova-compute[74960]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 03 12:20:11 user nova-compute[74960]: ERROR nova.virt.libvirt.driver     raise value
Nov 03 12:20:11 user nova-compute[74960]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 03 12:20:11 user nova-compute[74960]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Nov 03 12:20:11 user nova-compute[74960]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 03 12:20:11 user nova-compute[74960]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 03 12:20:11 user nova-compute[74960]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 03 12:20:11 user nova-compute[74960]: ERROR nova.virt.libvirt.driver 
Nov 03 12:20:11 user nova-compute[74960]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 03 12:20:11 user nova-compute[74960]: ERROR nova.virt.libvirt.driver 
Nov 03 12:20:11 user nova-compute[74960]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 03 12:20:11 user nova-compute[74960]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 03 12:20:11 user nova-compute[74960]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 03 12:20:11 user nova-compute[74960]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 03 12:20:11 user nova-compute[74960]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 03 12:20:11 user nova-compute[74960]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 03 12:20:11 user nova-compute[74960]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 03 12:20:11 user nova-compute[74960]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 03 12:20:11 user nova-compute[74960]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 03 12:20:11 user nova-compute[74960]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 03 12:20:11 user nova-compute[74960]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 03 12:20:11 user nova-compute[74960]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 03 12:20:11 user nova-compute[74960]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 03 12:20:11 user nova-compute[74960]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 03 12:20:11 user nova-compute[74960]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 03 12:20:11 user nova-compute[74960]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot a4a21b5c-e34e-4766-b949-d554a05789d5 could not be found. (HTTP 404) (Request-ID: req-d1218be3-1add-49be-854e-fb316cb2054f)
Nov 03 12:20:11 user nova-compute[74960]: ERROR nova.virt.libvirt.driver 
Nov 03 12:20:11 user nova-compute[74960]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 03 12:20:11 user nova-compute[74960]: ERROR nova.virt.libvirt.driver 
Nov 03 12:20:11 user nova-compute[74960]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 03 12:20:11 user nova-compute[74960]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 03 12:20:11 user nova-compute[74960]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 03 12:20:11 user nova-compute[74960]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 03 12:20:11 user nova-compute[74960]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 03 12:20:11 user nova-compute[74960]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 03 12:20:11 user nova-compute[74960]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 03 12:20:11 user nova-compute[74960]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 03 12:20:11 user nova-compute[74960]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 03 12:20:11 user nova-compute[74960]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 03 12:20:11 user nova-compute[74960]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 03 12:20:11 user nova-compute[74960]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 03 12:20:11 user nova-compute[74960]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 03 12:20:11 user nova-compute[74960]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 03 12:20:11 user nova-compute[74960]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 03 12:20:11 user nova-compute[74960]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 03 12:20:11 user nova-compute[74960]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 03 12:20:11 user nova-compute[74960]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 03 12:20:11 user nova-compute[74960]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 03 12:20:11 user nova-compute[74960]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 03 12:20:11 user nova-compute[74960]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 03 12:20:11 user nova-compute[74960]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 03 12:20:11 user nova-compute[74960]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 03 12:20:11 user nova-compute[74960]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot a4a21b5c-e34e-4766-b949-d554a05789d5 could not be found.
Nov 03 12:20:11 user nova-compute[74960]: ERROR nova.virt.libvirt.driver 
Nov 03 12:20:11 user nova-compute[74960]: ERROR oslo_messaging.rpc.server [None req-14415430-db85-4a34-88ef-9a8789edf838 tempest-VolumesAssistedSnapshotsTest-481806525 tempest-VolumesAssistedSnapshotsTest-481806525-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 03 12:20:11 user nova-compute[74960]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 03 12:20:11 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 03 12:20:11 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 03 12:20:11 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 03 12:20:11 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 03 12:20:11 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 03 12:20:11 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 03 12:20:11 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 03 12:20:11 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 03 12:20:11 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 03 12:20:11 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 03 12:20:11 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 03 12:20:11 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 03 12:20:11 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 03 12:20:11 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 03 12:20:11 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 03 12:20:11 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 03 12:20:11 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Nov 03 12:20:11 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Nov 03 12:20:11 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Nov 03 12:20:11 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 03 12:20:11 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 03 12:20:11 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 03 12:20:11 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 03 12:20:11 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 03 12:20:11 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 03 12:20:11 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Nov 03 12:20:11 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 03 12:20:11 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 03 12:20:11 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 03 12:20:11 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 03 12:20:11 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 03 12:20:11 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 03 12:20:11 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 03 12:20:11 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Nov 03 12:20:11 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 03 12:20:11 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Nov 03 12:20:11 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 03 12:20:11 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     raise value
Nov 03 12:20:11 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 03 12:20:11 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Nov 03 12:20:11 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 03 12:20:11 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 03 12:20:11 user nova-compute[74960]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 03 12:20:11 user nova-compute[74960]: ERROR oslo_messaging.rpc.server 
Nov 03 12:20:11 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:20:11 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1d83fe31-11, bridge=br-int, if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:20:11 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 12:20:11 user nova-compute[74960]: INFO os_vif [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:1b:71,bridge_name='br-int',has_traffic_filtering=True,id=1d83fe31-117e-49b5-a073-1c8dec48fd1f,network=Network(5d680571-15f7-44de-bdac-ca3a8ab46ace),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1d83fe31-11')
Nov 03 12:20:11 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T12:18:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-169343523',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-169343523',id=11,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLOC5cclZk/vQ7FVPKC/o6t/hoA9+72IHKH1jZIS8SaUpLPZFRdYwhmN2qlubEyE90YR5Dazknsm5K8JoBW51/vBrRnw6FQI7v4EHLIuiogmJoe7MdebvLmhP9HJkPVKWA==',key_name='tempest-keypair-976026532',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='602dab4996a7422cb9bf5aff46e0fee4',ramdisk_id='',reservation_id='r-ekkq0qeh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-62953878',owner_user_name='tempest-TaggedBootDevicesTest-62953878-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:18:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f88ab1bd57524047a55e8e5bb4690ac1',uuid=ac9e1b20-2482-4c71-b54b-5d6cb8187d04,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d6c585b8-ece6-4656-b33e-14e40d9515c5", "address": "fa:16:3e:ff:da:5b", "network": {"id": "5d680571-15f7-44de-bdac-ca3a8ab46ace", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354419557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "602dab4996a7422cb9bf5aff46e0fee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6c585b8-ec", "ovs_interfaceid": "d6c585b8-ece6-4656-b33e-14e40d9515c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 12:20:11 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] Converting VIF {"id": "d6c585b8-ece6-4656-b33e-14e40d9515c5", "address": "fa:16:3e:ff:da:5b", "network": {"id": "5d680571-15f7-44de-bdac-ca3a8ab46ace", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354419557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "602dab4996a7422cb9bf5aff46e0fee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6c585b8-ec", "ovs_interfaceid": "d6c585b8-ece6-4656-b33e-14e40d9515c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:20:11 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:da:5b,bridge_name='br-int',has_traffic_filtering=True,id=d6c585b8-ece6-4656-b33e-14e40d9515c5,network=Network(5d680571-15f7-44de-bdac-ca3a8ab46ace),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6c585b8-ec') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:20:11 user nova-compute[74960]: DEBUG os_vif [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:da:5b,bridge_name='br-int',has_traffic_filtering=True,id=d6c585b8-ece6-4656-b33e-14e40d9515c5,network=Network(5d680571-15f7-44de-bdac-ca3a8ab46ace),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6c585b8-ec') {{(pid=74960) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 12:20:11 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:20:11 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd6c585b8-ec, bridge=br-int, if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:20:11 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 12:20:11 user nova-compute[74960]: INFO os_vif [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:da:5b,bridge_name='br-int',has_traffic_filtering=True,id=d6c585b8-ece6-4656-b33e-14e40d9515c5,network=Network(5d680571-15f7-44de-bdac-ca3a8ab46ace),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6c585b8-ec')
Nov 03 12:20:11 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T12:18:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-169343523',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-169343523',id=11,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLOC5cclZk/vQ7FVPKC/o6t/hoA9+72IHKH1jZIS8SaUpLPZFRdYwhmN2qlubEyE90YR5Dazknsm5K8JoBW51/vBrRnw6FQI7v4EHLIuiogmJoe7MdebvLmhP9HJkPVKWA==',key_name='tempest-keypair-976026532',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='602dab4996a7422cb9bf5aff46e0fee4',ramdisk_id='',reservation_id='r-ekkq0qeh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-62953878',owner_user_name='tempest-TaggedBootDevicesTest-62953878-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:18:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f88ab1bd57524047a55e8e5bb4690ac1',uuid=ac9e1b20-2482-4c71-b54b-5d6cb8187d04,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "95a7c7bc-d60c-491f-b049-f2abd6a57647", "address": "fa:16:3e:36:14:0f", "network": {"id": "5d680571-15f7-44de-bdac-ca3a8ab46ace", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354419557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "602dab4996a7422cb9bf5aff46e0fee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95a7c7bc-d6", "ovs_interfaceid": "95a7c7bc-d60c-491f-b049-f2abd6a57647", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 12:20:11 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] Converting VIF {"id": "95a7c7bc-d60c-491f-b049-f2abd6a57647", "address": "fa:16:3e:36:14:0f", "network": {"id": "5d680571-15f7-44de-bdac-ca3a8ab46ace", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354419557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "602dab4996a7422cb9bf5aff46e0fee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95a7c7bc-d6", "ovs_interfaceid": "95a7c7bc-d60c-491f-b049-f2abd6a57647", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:20:11 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:14:0f,bridge_name='br-int',has_traffic_filtering=True,id=95a7c7bc-d60c-491f-b049-f2abd6a57647,network=Network(5d680571-15f7-44de-bdac-ca3a8ab46ace),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95a7c7bc-d6') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:20:11 user nova-compute[74960]: DEBUG os_vif [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:14:0f,bridge_name='br-int',has_traffic_filtering=True,id=95a7c7bc-d60c-491f-b049-f2abd6a57647,network=Network(5d680571-15f7-44de-bdac-ca3a8ab46ace),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95a7c7bc-d6') {{(pid=74960) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 12:20:11 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:20:11 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap95a7c7bc-d6, bridge=br-int, if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:20:11 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 12:20:11 user nova-compute[74960]: INFO os_vif [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:14:0f,bridge_name='br-int',has_traffic_filtering=True,id=95a7c7bc-d60c-491f-b049-f2abd6a57647,network=Network(5d680571-15f7-44de-bdac-ca3a8ab46ace),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95a7c7bc-d6')
Nov 03 12:20:11 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T12:18:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-169343523',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-169343523',id=11,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLOC5cclZk/vQ7FVPKC/o6t/hoA9+72IHKH1jZIS8SaUpLPZFRdYwhmN2qlubEyE90YR5Dazknsm5K8JoBW51/vBrRnw6FQI7v4EHLIuiogmJoe7MdebvLmhP9HJkPVKWA==',key_name='tempest-keypair-976026532',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='602dab4996a7422cb9bf5aff46e0fee4',ramdisk_id='',reservation_id='r-ekkq0qeh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-62953878',owner_user_name='tempest-TaggedBootDevicesTest-62953878-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:18:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f88ab1bd57524047a55e8e5bb4690ac1',uuid=ac9e1b20-2482-4c71-b54b-5d6cb8187d04,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e86f5236-dc27-4330-90a5-b8f8a8d669bd", "address": "fa:16:3e:40:a0:dc", "network": {"id": "ea165e0d-d1d5-4541-a2c8-5f0f788c7b33", "bridge": "br-int", "label": "tempest-device-tagging-net2-2028572952", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "602dab4996a7422cb9bf5aff46e0fee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape86f5236-dc", "ovs_interfaceid": "e86f5236-dc27-4330-90a5-b8f8a8d669bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 12:20:11 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] Converting VIF {"id": "e86f5236-dc27-4330-90a5-b8f8a8d669bd", "address": "fa:16:3e:40:a0:dc", "network": {"id": "ea165e0d-d1d5-4541-a2c8-5f0f788c7b33", "bridge": "br-int", "label": "tempest-device-tagging-net2-2028572952", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "602dab4996a7422cb9bf5aff46e0fee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape86f5236-dc", "ovs_interfaceid": "e86f5236-dc27-4330-90a5-b8f8a8d669bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:20:11 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:a0:dc,bridge_name='br-int',has_traffic_filtering=True,id=e86f5236-dc27-4330-90a5-b8f8a8d669bd,network=Network(ea165e0d-d1d5-4541-a2c8-5f0f788c7b33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape86f5236-dc') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:20:11 user nova-compute[74960]: DEBUG os_vif [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:a0:dc,bridge_name='br-int',has_traffic_filtering=True,id=e86f5236-dc27-4330-90a5-b8f8a8d669bd,network=Network(ea165e0d-d1d5-4541-a2c8-5f0f788c7b33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape86f5236-dc') {{(pid=74960) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 12:20:11 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:20:11 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape86f5236-dc, bridge=br-int, if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:20:11 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 12:20:11 user nova-compute[74960]: INFO os_vif [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:a0:dc,bridge_name='br-int',has_traffic_filtering=True,id=e86f5236-dc27-4330-90a5-b8f8a8d669bd,network=Network(ea165e0d-d1d5-4541-a2c8-5f0f788c7b33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape86f5236-dc')
Nov 03 12:20:11 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T12:18:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-169343523',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-169343523',id=11,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLOC5cclZk/vQ7FVPKC/o6t/hoA9+72IHKH1jZIS8SaUpLPZFRdYwhmN2qlubEyE90YR5Dazknsm5K8JoBW51/vBrRnw6FQI7v4EHLIuiogmJoe7MdebvLmhP9HJkPVKWA==',key_name='tempest-keypair-976026532',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='602dab4996a7422cb9bf5aff46e0fee4',ramdisk_id='',reservation_id='r-ekkq0qeh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-62953878',owner_user_name='tempest-TaggedBootDevicesTest-62953878-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:18:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f88ab1bd57524047a55e8e5bb4690ac1',uuid=ac9e1b20-2482-4c71-b54b-5d6cb8187d04,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6539aa0d-9ed3-4e04-8315-103d26c7403f", "address": "fa:16:3e:04:05:d3", "network": {"id": "ea165e0d-d1d5-4541-a2c8-5f0f788c7b33", "bridge": "br-int", "label": "tempest-device-tagging-net2-2028572952", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "602dab4996a7422cb9bf5aff46e0fee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6539aa0d-9e", "ovs_interfaceid": "6539aa0d-9ed3-4e04-8315-103d26c7403f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 12:20:11 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] Converting VIF {"id": "6539aa0d-9ed3-4e04-8315-103d26c7403f", "address": "fa:16:3e:04:05:d3", "network": {"id": "ea165e0d-d1d5-4541-a2c8-5f0f788c7b33", "bridge": "br-int", "label": "tempest-device-tagging-net2-2028572952", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "602dab4996a7422cb9bf5aff46e0fee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6539aa0d-9e", "ovs_interfaceid": "6539aa0d-9ed3-4e04-8315-103d26c7403f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:20:11 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:05:d3,bridge_name='br-int',has_traffic_filtering=True,id=6539aa0d-9ed3-4e04-8315-103d26c7403f,network=Network(ea165e0d-d1d5-4541-a2c8-5f0f788c7b33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6539aa0d-9e') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:20:11 user nova-compute[74960]: DEBUG os_vif [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:05:d3,bridge_name='br-int',has_traffic_filtering=True,id=6539aa0d-9ed3-4e04-8315-103d26c7403f,network=Network(ea165e0d-d1d5-4541-a2c8-5f0f788c7b33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6539aa0d-9e') {{(pid=74960) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 12:20:11 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:20:11 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6539aa0d-9e, bridge=br-int, if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:20:11 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 12:20:11 user nova-compute[74960]: INFO os_vif [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:05:d3,bridge_name='br-int',has_traffic_filtering=True,id=6539aa0d-9ed3-4e04-8315-103d26c7403f,network=Network(ea165e0d-d1d5-4541-a2c8-5f0f788c7b33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6539aa0d-9e')
Nov 03 12:20:11 user nova-compute[74960]: DEBUG nova.compute.manager [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04] Unplugged VIFs for instance {{(pid=74960) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:3032}}
Nov 03 12:20:11 user nova-compute[74960]: DEBUG nova.compute.manager [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04] Deallocating network for instance {{(pid=74960) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 12:20:11 user nova-compute[74960]: DEBUG nova.network.neutron [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04] deallocate_for_instance() {{(pid=74960) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 12:20:11 user nova-compute[74960]: DEBUG nova.objects.instance [None req-75be19b2-a912-4ed0-abd3-87c2be6d7d36 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Lazy-loading 'flavor' on Instance uuid 0a520c41-19c0-47ba-ada8-023ee9c12ca6 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:20:11 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-75be19b2-a912-4ed0-abd3-87c2be6d7d36 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Lock "0a520c41-19c0-47ba-ada8-023ee9c12ca6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.604s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:20:11 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-adeda1d7-dcb2-4377-ba9b-5cf88f111375 tempest-VolumesAssistedSnapshotsTest-464837836 tempest-VolumesAssistedSnapshotsTest-464837836-project-admin] Acquiring lock "7f7fabc2-5e1b-441c-a693-9956470359ea" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:20:11 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-adeda1d7-dcb2-4377-ba9b-5cf88f111375 tempest-VolumesAssistedSnapshotsTest-464837836 tempest-VolumesAssistedSnapshotsTest-464837836-project-admin] Lock "7f7fabc2-5e1b-441c-a693-9956470359ea" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:20:11 user nova-compute[74960]: INFO nova.compute.manager [None req-adeda1d7-dcb2-4377-ba9b-5cf88f111375 tempest-VolumesAssistedSnapshotsTest-464837836 tempest-VolumesAssistedSnapshotsTest-464837836-project-admin] [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea] Detaching volume 52a35a52-65f0-484a-9ab9-903ed049026f
Nov 03 12:20:11 user nova-compute[74960]: INFO nova.virt.block_device [None req-adeda1d7-dcb2-4377-ba9b-5cf88f111375 tempest-VolumesAssistedSnapshotsTest-464837836 tempest-VolumesAssistedSnapshotsTest-464837836-project-admin] [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea] Attempting to driver detach volume 52a35a52-65f0-484a-9ab9-903ed049026f from mountpoint /dev/vdb
Nov 03 12:20:11 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-adeda1d7-dcb2-4377-ba9b-5cf88f111375 tempest-VolumesAssistedSnapshotsTest-464837836 tempest-VolumesAssistedSnapshotsTest-464837836-project-admin] Attempting to detach device vdb from instance 7f7fabc2-5e1b-441c-a693-9956470359ea from the persistent domain config. {{(pid=74960) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 03 12:20:11 user nova-compute[74960]: DEBUG nova.virt.libvirt.guest [None req-adeda1d7-dcb2-4377-ba9b-5cf88f111375 tempest-VolumesAssistedSnapshotsTest-464837836 tempest-VolumesAssistedSnapshotsTest-464837836-project-admin] detach device xml: <disk type="block" device="disk">
Nov 03 12:20:11 user nova-compute[74960]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 12:20:11 user nova-compute[74960]:   <source dev="/dev/sdf"/>
Nov 03 12:20:11 user nova-compute[74960]:   <target dev="vdb" bus="virtio"/>
Nov 03 12:20:11 user nova-compute[74960]:   <serial>52a35a52-65f0-484a-9ab9-903ed049026f</serial>
Nov 03 12:20:11 user nova-compute[74960]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 12:20:11 user nova-compute[74960]: </disk>
Nov 03 12:20:11 user nova-compute[74960]:  {{(pid=74960) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 12:20:11 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-adeda1d7-dcb2-4377-ba9b-5cf88f111375 tempest-VolumesAssistedSnapshotsTest-464837836 tempest-VolumesAssistedSnapshotsTest-464837836-project-admin] Successfully detached device vdb from instance 7f7fabc2-5e1b-441c-a693-9956470359ea from the persistent domain config.
Nov 03 12:20:11 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-adeda1d7-dcb2-4377-ba9b-5cf88f111375 tempest-VolumesAssistedSnapshotsTest-464837836 tempest-VolumesAssistedSnapshotsTest-464837836-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7f7fabc2-5e1b-441c-a693-9956470359ea from the live domain config. {{(pid=74960) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 03 12:20:11 user nova-compute[74960]: DEBUG nova.virt.libvirt.guest [None req-adeda1d7-dcb2-4377-ba9b-5cf88f111375 tempest-VolumesAssistedSnapshotsTest-464837836 tempest-VolumesAssistedSnapshotsTest-464837836-project-admin] detach device xml: <disk type="block" device="disk">
Nov 03 12:20:11 user nova-compute[74960]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 12:20:11 user nova-compute[74960]:   <source dev="/dev/sdf"/>
Nov 03 12:20:11 user nova-compute[74960]:   <target dev="vdb" bus="virtio"/>
Nov 03 12:20:11 user nova-compute[74960]:   <serial>52a35a52-65f0-484a-9ab9-903ed049026f</serial>
Nov 03 12:20:11 user nova-compute[74960]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 12:20:11 user nova-compute[74960]: </disk>
Nov 03 12:20:11 user nova-compute[74960]:  {{(pid=74960) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 12:20:11 user nova-compute[74960]: DEBUG nova.objects.instance [None req-3ca77083-b3b4-40f4-8421-4d85fb57780a tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Lazy-loading 'flavor' on Instance uuid d00a0872-693c-4cdc-85cd-9806660e9d8d {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:20:11 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-3ca77083-b3b4-40f4-8421-4d85fb57780a tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Lock "d00a0872-693c-4cdc-85cd-9806660e9d8d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.318s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:20:11 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-10a67d6e-956d-4071-bacc-2e2320100690 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Acquiring lock "interface-0a520c41-19c0-47ba-ada8-023ee9c12ca6-31063379-2482-4339-9fb1-1468848af814" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:20:11 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-10a67d6e-956d-4071-bacc-2e2320100690 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Lock "interface-0a520c41-19c0-47ba-ada8-023ee9c12ca6-31063379-2482-4339-9fb1-1468848af814" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:20:11 user nova-compute[74960]: DEBUG nova.objects.instance [None req-10a67d6e-956d-4071-bacc-2e2320100690 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Lazy-loading 'flavor' on Instance uuid 0a520c41-19c0-47ba-ada8-023ee9c12ca6 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:20:11 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-10a67d6e-956d-4071-bacc-2e2320100690 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T12:17:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-718860820',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-718860820',id=7,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLwaiWOkf4g+xGnCHIQ6PEXYDCQvWANu1aoEqkgH8PkfR56o+3+BPp4uxgAn5C+zZDpe3SkZ06KyunCKlhSZpIVyhUY157dTlXxkUygCex89TiMcoPvBPFCYXJkTY4on1A==',key_name='tempest-keypair-1456184094',keypairs=<?>,launch_index=0,launched_at=2023-11-03T12:17:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3390632661124edd9894dabac0053fa9',ramdisk_id='',reservation_id='r-zkhug3rc',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1950029920',owner_user_name='tempest-TaggedAttachmentsTest-1950029920-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T12:17:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9da58bde19c3434f9811cb80ed39dea9',uuid=0a520c41-19c0-47ba-ada8-023ee9c12ca6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "31063379-2482-4339-9fb1-1468848af814", "address": "fa:16:3e:e0:fa:2f", "network": {"id": "398189f9-4e24-48ff-9e1d-ac06e98e3eb1", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-610583939", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.94", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3390632661124edd9894dabac0053fa9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31063379-24", "ovs_interfaceid": "31063379-2482-4339-9fb1-1468848af814", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74960) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 12:20:11 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-10a67d6e-956d-4071-bacc-2e2320100690 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Converting VIF {"id": "31063379-2482-4339-9fb1-1468848af814", "address": "fa:16:3e:e0:fa:2f", "network": {"id": "398189f9-4e24-48ff-9e1d-ac06e98e3eb1", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-610583939", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.94", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3390632661124edd9894dabac0053fa9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31063379-24", "ovs_interfaceid": "31063379-2482-4339-9fb1-1468848af814", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:20:11 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-10a67d6e-956d-4071-bacc-2e2320100690 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:fa:2f,bridge_name='br-int',has_traffic_filtering=True,id=31063379-2482-4339-9fb1-1468848af814,network=Network(398189f9-4e24-48ff-9e1d-ac06e98e3eb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31063379-24') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:20:11 user nova-compute[74960]: DEBUG nova.virt.libvirt.guest [None req-10a67d6e-956d-4071-bacc-2e2320100690 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:e0:fa:2f"/><model type="virtio"/><mtu size="1442"/><target dev="tap31063379-24"/></interface> {{(pid=74960) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 03 12:20:11 user nova-compute[74960]: DEBUG nova.virt.libvirt.guest [None req-10a67d6e-956d-4071-bacc-2e2320100690 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:e0:fa:2f"/><model type="virtio"/><mtu size="1442"/><target dev="tap31063379-24"/></interface> {{(pid=74960) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 03 12:20:11 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-10a67d6e-956d-4071-bacc-2e2320100690 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Attempting to detach device tap31063379-24 from instance 0a520c41-19c0-47ba-ada8-023ee9c12ca6 from the persistent domain config. {{(pid=74960) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 03 12:20:11 user nova-compute[74960]: DEBUG nova.virt.libvirt.guest [None req-10a67d6e-956d-4071-bacc-2e2320100690 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] detach device xml: <interface type="ethernet">
Nov 03 12:20:11 user nova-compute[74960]:   <mac address="fa:16:3e:e0:fa:2f"/>
Nov 03 12:20:11 user nova-compute[74960]:   <model type="virtio"/>
Nov 03 12:20:11 user nova-compute[74960]:   <mtu size="1442"/>
Nov 03 12:20:11 user nova-compute[74960]:   <target dev="tap31063379-24"/>
Nov 03 12:20:11 user nova-compute[74960]: </interface>
Nov 03 12:20:11 user nova-compute[74960]:  {{(pid=74960) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 12:20:11 user nova-compute[74960]: DEBUG nova.virt.libvirt.guest [None req-10a67d6e-956d-4071-bacc-2e2320100690 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:e0:fa:2f"/><model type="virtio"/><mtu size="1442"/><target dev="tap31063379-24"/></interface> {{(pid=74960) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 03 12:20:11 user nova-compute[74960]: DEBUG nova.virt.libvirt.guest [None req-10a67d6e-956d-4071-bacc-2e2320100690 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:e0:fa:2f"/><model type="virtio"/><mtu size="1442"/><target dev="tap31063379-24"/></interface>not found in domain: <domain type='kvm' id='7'>
Nov 03 12:20:11 user nova-compute[74960]:   <name>instance-00000007</name>
Nov 03 12:20:11 user nova-compute[74960]:   <uuid>0a520c41-19c0-47ba-ada8-023ee9c12ca6</uuid>
Nov 03 12:20:11 user nova-compute[74960]:   <metadata>
Nov 03 12:20:11 user nova-compute[74960]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 12:20:11 user nova-compute[74960]:   <nova:package version="0.0.0"/>
Nov 03 12:20:11 user nova-compute[74960]:   <nova:name>tempest-device-tagging-server-718860820</nova:name>
Nov 03 12:20:11 user nova-compute[74960]:   <nova:creationTime>2023-11-03 12:19:12</nova:creationTime>
Nov 03 12:20:11 user nova-compute[74960]:   <nova:flavor name="m1.tiny">
Nov 03 12:20:11 user nova-compute[74960]:     <nova:memory>512</nova:memory>
Nov 03 12:20:11 user nova-compute[74960]:     <nova:disk>1</nova:disk>
Nov 03 12:20:11 user nova-compute[74960]:     <nova:swap>0</nova:swap>
Nov 03 12:20:11 user nova-compute[74960]:     <nova:ephemeral>0</nova:ephemeral>
Nov 03 12:20:11 user nova-compute[74960]:     <nova:vcpus>1</nova:vcpus>
Nov 03 12:20:11 user nova-compute[74960]:   </nova:flavor>
Nov 03 12:20:11 user nova-compute[74960]:   <nova:owner>
Nov 03 12:20:11 user nova-compute[74960]:     <nova:user uuid="9da58bde19c3434f9811cb80ed39dea9">tempest-TaggedAttachmentsTest-1950029920-project-member</nova:user>
Nov 03 12:20:11 user nova-compute[74960]:     <nova:project uuid="3390632661124edd9894dabac0053fa9">tempest-TaggedAttachmentsTest-1950029920</nova:project>
Nov 03 12:20:11 user nova-compute[74960]:   </nova:owner>
Nov 03 12:20:11 user nova-compute[74960]:   <nova:root type="image" uuid="549f51ba-ac69-494b-8de1-34635aa2d7cf"/>
Nov 03 12:20:11 user nova-compute[74960]:   <nova:ports>
Nov 03 12:20:11 user nova-compute[74960]:     <nova:port uuid="3e126a57-0883-4997-9c99-d25c9c6fc102">
Nov 03 12:20:11 user nova-compute[74960]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 03 12:20:11 user nova-compute[74960]:     </nova:port>
Nov 03 12:20:11 user nova-compute[74960]:     <nova:port uuid="31063379-2482-4339-9fb1-1468848af814">
Nov 03 12:20:11 user nova-compute[74960]:       <nova:ip type="fixed" address="10.10.10.94" ipVersion="4"/>
Nov 03 12:20:11 user nova-compute[74960]:     </nova:port>
Nov 03 12:20:11 user nova-compute[74960]:   </nova:ports>
Nov 03 12:20:11 user nova-compute[74960]: </nova:instance>
Nov 03 12:20:11 user nova-compute[74960]:   </metadata>
Nov 03 12:20:11 user nova-compute[74960]:   <memory unit='KiB'>524288</memory>
Nov 03 12:20:11 user nova-compute[74960]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 03 12:20:11 user nova-compute[74960]:   <vcpu placement='static'>1</vcpu>
Nov 03 12:20:11 user nova-compute[74960]:   <resource>
Nov 03 12:20:11 user nova-compute[74960]:     <partition>/machine</partition>
Nov 03 12:20:11 user nova-compute[74960]:   </resource>
Nov 03 12:20:11 user nova-compute[74960]:   <sysinfo type='smbios'>
Nov 03 12:20:11 user nova-compute[74960]:     <system>
Nov 03 12:20:11 user nova-compute[74960]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 03 12:20:11 user nova-compute[74960]:       <entry name='product'>OpenStack Nova</entry>
Nov 03 12:20:11 user nova-compute[74960]:       <entry name='version'>0.0.0</entry>
Nov 03 12:20:11 user nova-compute[74960]:       <entry name='serial'>0a520c41-19c0-47ba-ada8-023ee9c12ca6</entry>
Nov 03 12:20:11 user nova-compute[74960]:       <entry name='uuid'>0a520c41-19c0-47ba-ada8-023ee9c12ca6</entry>
Nov 03 12:20:11 user nova-compute[74960]:       <entry name='family'>Virtual Machine</entry>
Nov 03 12:20:11 user nova-compute[74960]:     </system>
Nov 03 12:20:11 user nova-compute[74960]:   </sysinfo>
Nov 03 12:20:11 user nova-compute[74960]:   <os>
Nov 03 12:20:11 user nova-compute[74960]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 03 12:20:11 user nova-compute[74960]:     <boot dev='hd'/>
Nov 03 12:20:11 user nova-compute[74960]:     <smbios mode='sysinfo'/>
Nov 03 12:20:11 user nova-compute[74960]:   </os>
Nov 03 12:20:11 user nova-compute[74960]:   <features>
Nov 03 12:20:11 user nova-compute[74960]:     <acpi/>
Nov 03 12:20:11 user nova-compute[74960]:     <apic/>
Nov 03 12:20:11 user nova-compute[74960]:     <vmcoreinfo state='on'/>
Nov 03 12:20:11 user nova-compute[74960]:   </features>
Nov 03 12:20:11 user nova-compute[74960]:   <cpu mode='custom' match='exact' check='full'>
Nov 03 12:20:11 user nova-compute[74960]:     <model fallback='forbid'>Nehalem</model>
Nov 03 12:20:11 user nova-compute[74960]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 03 12:20:11 user nova-compute[74960]:     <feature policy='require' name='vme'/>
Nov 03 12:20:11 user nova-compute[74960]:     <feature policy='require' name='x2apic'/>
Nov 03 12:20:11 user nova-compute[74960]:     <feature policy='require' name='hypervisor'/>
Nov 03 12:20:11 user nova-compute[74960]:   </cpu>
Nov 03 12:20:11 user nova-compute[74960]:   <clock offset='utc'>
Nov 03 12:20:11 user nova-compute[74960]:     <timer name='pit' tickpolicy='delay'/>
Nov 03 12:20:11 user nova-compute[74960]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 03 12:20:11 user nova-compute[74960]:     <timer name='hpet' present='no'/>
Nov 03 12:20:11 user nova-compute[74960]:   </clock>
Nov 03 12:20:11 user nova-compute[74960]:   <on_poweroff>destroy</on_poweroff>
Nov 03 12:20:11 user nova-compute[74960]:   <on_reboot>restart</on_reboot>
Nov 03 12:20:11 user nova-compute[74960]:   <on_crash>destroy</on_crash>
Nov 03 12:20:11 user nova-compute[74960]:   <devices>
Nov 03 12:20:11 user nova-compute[74960]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 03 12:20:11 user nova-compute[74960]:     <disk type='file' device='disk'>
Nov 03 12:20:11 user nova-compute[74960]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 03 12:20:11 user nova-compute[74960]:       <source file='/opt/stack/data/nova/instances/0a520c41-19c0-47ba-ada8-023ee9c12ca6/disk' index='2'/>
Nov 03 12:20:11 user nova-compute[74960]:       <backingStore type='file' index='3'>
Nov 03 12:20:11 user nova-compute[74960]:         <format type='raw'/>
Nov 03 12:20:11 user nova-compute[74960]:         <source file='/opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910'/>
Nov 03 12:20:11 user nova-compute[74960]:         <backingStore/>
Nov 03 12:20:11 user nova-compute[74960]:       </backingStore>
Nov 03 12:20:11 user nova-compute[74960]:       <target dev='vda' bus='virtio'/>
Nov 03 12:20:11 user nova-compute[74960]:       <alias name='virtio-disk0'/>
Nov 03 12:20:11 user nova-compute[74960]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 03 12:20:11 user nova-compute[74960]:     </disk>
Nov 03 12:20:11 user nova-compute[74960]:     <disk type='file' device='cdrom'>
Nov 03 12:20:11 user nova-compute[74960]:       <driver name='qemu' type='raw' cache='none'/>
Nov 03 12:20:11 user nova-compute[74960]:       <source file='/opt/stack/data/nova/instances/0a520c41-19c0-47ba-ada8-023ee9c12ca6/disk.config' index='1'/>
Nov 03 12:20:11 user nova-compute[74960]:       <backingStore/>
Nov 03 12:20:11 user nova-compute[74960]:       <target dev='hda' bus='ide'/>
Nov 03 12:20:11 user nova-compute[74960]:       <readonly/>
Nov 03 12:20:11 user nova-compute[74960]:       <alias name='ide0-0-0'/>
Nov 03 12:20:11 user nova-compute[74960]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 03 12:20:11 user nova-compute[74960]:     </disk>
Nov 03 12:20:11 user nova-compute[74960]:     <controller type='usb' index='0' model='none'>
Nov 03 12:20:11 user nova-compute[74960]:       <alias name='usb'/>
Nov 03 12:20:11 user nova-compute[74960]:     </controller>
Nov 03 12:20:11 user nova-compute[74960]:     <controller type='pci' index='0' model='pci-root'>
Nov 03 12:20:11 user nova-compute[74960]:       <alias name='pci.0'/>
Nov 03 12:20:11 user nova-compute[74960]:     </controller>
Nov 03 12:20:11 user nova-compute[74960]:     <controller type='ide' index='0'>
Nov 03 12:20:11 user nova-compute[74960]:       <alias name='ide'/>
Nov 03 12:20:11 user nova-compute[74960]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 03 12:20:11 user nova-compute[74960]:     </controller>
Nov 03 12:20:11 user nova-compute[74960]:     <interface type='ethernet'>
Nov 03 12:20:11 user nova-compute[74960]:       <mac address='fa:16:3e:f9:07:9b'/>
Nov 03 12:20:11 user nova-compute[74960]:       <target dev='tap3e126a57-08'/>
Nov 03 12:20:11 user nova-compute[74960]:       <model type='virtio'/>
Nov 03 12:20:11 user nova-compute[74960]:       <mtu size='1442'/>
Nov 03 12:20:11 user nova-compute[74960]:       <alias name='net0'/>
Nov 03 12:20:11 user nova-compute[74960]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 03 12:20:11 user nova-compute[74960]:     </interface>
Nov 03 12:20:11 user nova-compute[74960]:     <interface type='ethernet'>
Nov 03 12:20:11 user nova-compute[74960]:       <mac address='fa:16:3e:e0:fa:2f'/>
Nov 03 12:20:11 user nova-compute[74960]:       <target dev='tap31063379-24'/>
Nov 03 12:20:11 user nova-compute[74960]:       <model type='virtio'/>
Nov 03 12:20:11 user nova-compute[74960]:       <mtu size='1442'/>
Nov 03 12:20:11 user nova-compute[74960]:       <alias name='net1'/>
Nov 03 12:20:11 user nova-compute[74960]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Nov 03 12:20:11 user nova-compute[74960]:     </interface>
Nov 03 12:20:11 user nova-compute[74960]:     <serial type='pty'>
Nov 03 12:20:11 user nova-compute[74960]:       <source path='/dev/pts/6'/>
Nov 03 12:20:11 user nova-compute[74960]:       <log file='/opt/stack/data/nova/instances/0a520c41-19c0-47ba-ada8-023ee9c12ca6/console.log' append='off'/>
Nov 03 12:20:11 user nova-compute[74960]:       <target type='isa-serial' port='0'>
Nov 03 12:20:11 user nova-compute[74960]:         <model name='isa-serial'/>
Nov 03 12:20:11 user nova-compute[74960]:       </target>
Nov 03 12:20:11 user nova-compute[74960]:       <alias name='serial0'/>
Nov 03 12:20:11 user nova-compute[74960]:     </serial>
Nov 03 12:20:11 user nova-compute[74960]:     <console type='pty' tty='/dev/pts/6'>
Nov 03 12:20:11 user nova-compute[74960]:       <source path='/dev/pts/6'/>
Nov 03 12:20:11 user nova-compute[74960]:       <log file='/opt/stack/data/nova/instances/0a520c41-19c0-47ba-ada8-023ee9c12ca6/console.log' append='off'/>
Nov 03 12:20:11 user nova-compute[74960]:       <target type='serial' port='0'/>
Nov 03 12:20:11 user nova-compute[74960]:       <alias name='serial0'/>
Nov 03 12:20:11 user nova-compute[74960]:     </console>
Nov 03 12:20:11 user nova-compute[74960]:     <input type='mouse' bus='ps2'>
Nov 03 12:20:11 user nova-compute[74960]:       <alias name='input0'/>
Nov 03 12:20:11 user nova-compute[74960]:     </input>
Nov 03 12:20:11 user nova-compute[74960]:     <input type='keyboard' bus='ps2'>
Nov 03 12:20:11 user nova-compute[74960]:       <alias name='input1'/>
Nov 03 12:20:11 user nova-compute[74960]:     </input>
Nov 03 12:20:11 user nova-compute[74960]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Nov 03 12:20:11 user nova-compute[74960]:       <listen type='address' address='0.0.0.0'/>
Nov 03 12:20:11 user nova-compute[74960]:     </graphics>
Nov 03 12:20:11 user nova-compute[74960]:     <audio id='1' type='none'/>
Nov 03 12:20:11 user nova-compute[74960]:     <video>
Nov 03 12:20:11 user nova-compute[74960]:       <model type='virtio' heads='1' primary='yes'/>
Nov 03 12:20:11 user nova-compute[74960]:       <alias name='video0'/>
Nov 03 12:20:11 user nova-compute[74960]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 03 12:20:11 user nova-compute[74960]:     </video>
Nov 03 12:20:11 user nova-compute[74960]:     <memballoon model='virtio'>
Nov 03 12:20:11 user nova-compute[74960]:       <stats period='10'/>
Nov 03 12:20:11 user nova-compute[74960]:       <alias name='balloon0'/>
Nov 03 12:20:11 user nova-compute[74960]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 03 12:20:11 user nova-compute[74960]:     </memballoon>
Nov 03 12:20:11 user nova-compute[74960]:     <rng model='virtio'>
Nov 03 12:20:11 user nova-compute[74960]:       <backend model='random'>/dev/urandom</backend>
Nov 03 12:20:11 user nova-compute[74960]:       <alias name='rng0'/>
Nov 03 12:20:11 user nova-compute[74960]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 03 12:20:11 user nova-compute[74960]:     </rng>
Nov 03 12:20:11 user nova-compute[74960]:   </devices>
Nov 03 12:20:11 user nova-compute[74960]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 03 12:20:11 user nova-compute[74960]:     <label>libvirt-0a520c41-19c0-47ba-ada8-023ee9c12ca6</label>
Nov 03 12:20:11 user nova-compute[74960]:     <imagelabel>libvirt-0a520c41-19c0-47ba-ada8-023ee9c12ca6</imagelabel>
Nov 03 12:20:11 user nova-compute[74960]:   </seclabel>
Nov 03 12:20:11 user nova-compute[74960]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 03 12:20:11 user nova-compute[74960]:     <label>+64055:+108</label>
Nov 03 12:20:11 user nova-compute[74960]:     <imagelabel>+64055:+108</imagelabel>
Nov 03 12:20:11 user nova-compute[74960]:   </seclabel>
Nov 03 12:20:11 user nova-compute[74960]: </domain>
Nov 03 12:20:11 user nova-compute[74960]:  {{(pid=74960) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 03 12:20:11 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-10a67d6e-956d-4071-bacc-2e2320100690 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Successfully detached device tap31063379-24 from instance 0a520c41-19c0-47ba-ada8-023ee9c12ca6 from the persistent domain config.
Nov 03 12:20:11 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-10a67d6e-956d-4071-bacc-2e2320100690 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] (1/8): Attempting to detach device tap31063379-24 with device alias net1 from instance 0a520c41-19c0-47ba-ada8-023ee9c12ca6 from the live domain config. {{(pid=74960) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 03 12:20:11 user nova-compute[74960]: DEBUG nova.virt.libvirt.guest [None req-10a67d6e-956d-4071-bacc-2e2320100690 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] detach device xml: <interface type="ethernet">
Nov 03 12:20:11 user nova-compute[74960]:   <mac address="fa:16:3e:e0:fa:2f"/>
Nov 03 12:20:11 user nova-compute[74960]:   <model type="virtio"/>
Nov 03 12:20:11 user nova-compute[74960]:   <mtu size="1442"/>
Nov 03 12:20:11 user nova-compute[74960]:   <target dev="tap31063379-24"/>
Nov 03 12:20:11 user nova-compute[74960]: </interface>
Nov 03 12:20:11 user nova-compute[74960]:  {{(pid=74960) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 12:20:11 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-adeda1d7-dcb2-4377-ba9b-5cf88f111375 tempest-VolumesAssistedSnapshotsTest-464837836 tempest-VolumesAssistedSnapshotsTest-464837836-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7f7fabc2-5e1b-441c-a693-9956470359ea {{(pid=74960) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 03 12:20:11 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:20:11 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-55f36cc8-213f-4527-885f-564650c871bb tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Acquiring lock "d00a0872-693c-4cdc-85cd-9806660e9d8d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:20:11 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-55f36cc8-213f-4527-885f-564650c871bb tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Lock "d00a0872-693c-4cdc-85cd-9806660e9d8d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:20:11 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-55f36cc8-213f-4527-885f-564650c871bb tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Acquiring lock "d00a0872-693c-4cdc-85cd-9806660e9d8d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:20:11 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-55f36cc8-213f-4527-885f-564650c871bb tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Lock "d00a0872-693c-4cdc-85cd-9806660e9d8d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:20:11 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-55f36cc8-213f-4527-885f-564650c871bb tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Lock "d00a0872-693c-4cdc-85cd-9806660e9d8d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:20:12 user nova-compute[74960]: INFO nova.compute.manager [None req-55f36cc8-213f-4527-885f-564650c871bb tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] [instance: d00a0872-693c-4cdc-85cd-9806660e9d8d] Terminating instance
Nov 03 12:20:12 user nova-compute[74960]: DEBUG nova.compute.manager [None req-55f36cc8-213f-4527-885f-564650c871bb tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] [instance: d00a0872-693c-4cdc-85cd-9806660e9d8d] Start destroying the instance on the hypervisor. {{(pid=74960) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 12:20:12 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:20:12 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:20:12 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:20:12 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-10a67d6e-956d-4071-bacc-2e2320100690 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Start waiting for the detach event from libvirt for device tap31063379-24 with device alias net1 for instance 0a520c41-19c0-47ba-ada8-023ee9c12ca6 {{(pid=74960) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 03 12:20:12 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:20:12 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:20:12 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:20:12 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:20:12 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:20:12 user nova-compute[74960]: DEBUG nova.compute.manager [req-1e3a9a43-b9a6-458b-af90-ed30ee8451ae req-4fd08e5a-e010-4ec1-af49-f7568b4c7406 service nova] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] Received event network-vif-unplugged-31063379-2482-4339-9fb1-1468848af814 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:20:12 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-1e3a9a43-b9a6-458b-af90-ed30ee8451ae req-4fd08e5a-e010-4ec1-af49-f7568b4c7406 service nova] Acquiring lock "0a520c41-19c0-47ba-ada8-023ee9c12ca6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:20:12 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-1e3a9a43-b9a6-458b-af90-ed30ee8451ae req-4fd08e5a-e010-4ec1-af49-f7568b4c7406 service nova] Lock "0a520c41-19c0-47ba-ada8-023ee9c12ca6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:20:12 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-1e3a9a43-b9a6-458b-af90-ed30ee8451ae req-4fd08e5a-e010-4ec1-af49-f7568b4c7406 service nova] Lock "0a520c41-19c0-47ba-ada8-023ee9c12ca6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:20:12 user nova-compute[74960]: DEBUG nova.compute.manager [req-1e3a9a43-b9a6-458b-af90-ed30ee8451ae req-4fd08e5a-e010-4ec1-af49-f7568b4c7406 service nova] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] No waiting events found dispatching network-vif-unplugged-31063379-2482-4339-9fb1-1468848af814 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:20:12 user nova-compute[74960]: WARNING nova.compute.manager [req-1e3a9a43-b9a6-458b-af90-ed30ee8451ae req-4fd08e5a-e010-4ec1-af49-f7568b4c7406 service nova] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] Received unexpected event network-vif-unplugged-31063379-2482-4339-9fb1-1468848af814 for instance with vm_state active and task_state None.
Nov 03 12:20:12 user nova-compute[74960]: DEBUG nova.compute.manager [req-8530ef13-9382-4532-8567-fd030f1d02eb req-ca208922-f2c4-47e3-9afc-64a067f137f1 service nova] [instance: d00a0872-693c-4cdc-85cd-9806660e9d8d] Received event network-vif-unplugged-c2a92350-10c1-4c73-bfce-b305071289ff {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:20:12 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-8530ef13-9382-4532-8567-fd030f1d02eb req-ca208922-f2c4-47e3-9afc-64a067f137f1 service nova] Acquiring lock "d00a0872-693c-4cdc-85cd-9806660e9d8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:20:12 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-8530ef13-9382-4532-8567-fd030f1d02eb req-ca208922-f2c4-47e3-9afc-64a067f137f1 service nova] Lock "d00a0872-693c-4cdc-85cd-9806660e9d8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:20:12 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-8530ef13-9382-4532-8567-fd030f1d02eb req-ca208922-f2c4-47e3-9afc-64a067f137f1 service nova] Lock "d00a0872-693c-4cdc-85cd-9806660e9d8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:20:12 user nova-compute[74960]: DEBUG nova.compute.manager [req-8530ef13-9382-4532-8567-fd030f1d02eb req-ca208922-f2c4-47e3-9afc-64a067f137f1 service nova] [instance: d00a0872-693c-4cdc-85cd-9806660e9d8d] No waiting events found dispatching network-vif-unplugged-c2a92350-10c1-4c73-bfce-b305071289ff {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:20:12 user nova-compute[74960]: DEBUG nova.compute.manager [req-8530ef13-9382-4532-8567-fd030f1d02eb req-ca208922-f2c4-47e3-9afc-64a067f137f1 service nova] [instance: d00a0872-693c-4cdc-85cd-9806660e9d8d] Received event network-vif-unplugged-c2a92350-10c1-4c73-bfce-b305071289ff for instance with task_state deleting. {{(pid=74960) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 12:20:12 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: d00a0872-693c-4cdc-85cd-9806660e9d8d] Instance destroyed successfully.
Nov 03 12:20:12 user nova-compute[74960]: DEBUG nova.objects.instance [None req-55f36cc8-213f-4527-885f-564650c871bb tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Lazy-loading 'resources' on Instance uuid d00a0872-693c-4cdc-85cd-9806660e9d8d {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:20:12 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-55f36cc8-213f-4527-885f-564650c871bb tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T12:17:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-2020397840',display_name='tempest-AttachSCSIVolumeTestJSON-server-2020397840',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-2020397840',id=4,image_ref='62be30e2-c070-4a69-b7a8-3a130347754a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNuGj4AYDOHlTOet0qwY1JSfNnHzWcfTMoU2fNeqdmJ0EaQtGFk6JonMe/lX1WsxAFPVz6DiGV6Toyq90KozUyweOS7uW43e4KWbM9YRQfEfIZcrKMO5uosMQOe4n+stuA==',key_name='tempest-keypair-1224384623',keypairs=<?>,launch_index=0,launched_at=2023-11-03T12:17:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d7141b1fdcbd4e3b8d8ecabdb9ed4a0b',ramdisk_id='',reservation_id='r-4dx4ar8t',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='62be30e2-c070-4a69-b7a8-3a130347754a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-961661338',owner_user_name='tempest-AttachSCSIVolumeTestJSON-961661338-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T12:17:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f0e3bcd72b44727b52795e0d2997905',uuid=d00a0872-693c-4cdc-85cd-9806660e9d8d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c2a92350-10c1-4c73-bfce-b305071289ff", "address": "fa:16:3e:80:8f:c1", "network": {"id": "10b59e93-b9b0-443a-8a8a-755bf2a87b0c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1169763894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7141b1fdcbd4e3b8d8ecabdb9ed4a0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2a92350-10", "ovs_interfaceid": "c2a92350-10c1-4c73-bfce-b305071289ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 12:20:12 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-55f36cc8-213f-4527-885f-564650c871bb tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Converting VIF {"id": "c2a92350-10c1-4c73-bfce-b305071289ff", "address": "fa:16:3e:80:8f:c1", "network": {"id": "10b59e93-b9b0-443a-8a8a-755bf2a87b0c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1169763894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7141b1fdcbd4e3b8d8ecabdb9ed4a0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2a92350-10", "ovs_interfaceid": "c2a92350-10c1-4c73-bfce-b305071289ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:20:12 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-55f36cc8-213f-4527-885f-564650c871bb tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:80:8f:c1,bridge_name='br-int',has_traffic_filtering=True,id=c2a92350-10c1-4c73-bfce-b305071289ff,network=Network(10b59e93-b9b0-443a-8a8a-755bf2a87b0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2a92350-10') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:20:12 user nova-compute[74960]: DEBUG os_vif [None req-55f36cc8-213f-4527-885f-564650c871bb tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:8f:c1,bridge_name='br-int',has_traffic_filtering=True,id=c2a92350-10c1-4c73-bfce-b305071289ff,network=Network(10b59e93-b9b0-443a-8a8a-755bf2a87b0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2a92350-10') {{(pid=74960) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 12:20:12 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:20:12 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc2a92350-10, bridge=br-int, if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:20:12 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:20:12 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:20:12 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:20:12 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6b0359ff-559e-4e86-b632-3cb5e14c6824) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:20:12 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:20:12 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:20:12 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:20:12 user nova-compute[74960]: INFO os_vif [None req-55f36cc8-213f-4527-885f-564650c871bb tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:8f:c1,bridge_name='br-int',has_traffic_filtering=True,id=c2a92350-10c1-4c73-bfce-b305071289ff,network=Network(10b59e93-b9b0-443a-8a8a-755bf2a87b0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2a92350-10')
Nov 03 12:20:12 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-55f36cc8-213f-4527-885f-564650c871bb tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] [instance: d00a0872-693c-4cdc-85cd-9806660e9d8d] Deleting instance files /opt/stack/data/nova/instances/d00a0872-693c-4cdc-85cd-9806660e9d8d_del
Nov 03 12:20:12 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-55f36cc8-213f-4527-885f-564650c871bb tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] [instance: d00a0872-693c-4cdc-85cd-9806660e9d8d] Deletion of /opt/stack/data/nova/instances/d00a0872-693c-4cdc-85cd-9806660e9d8d_del complete
Nov 03 12:20:12 user nova-compute[74960]: INFO nova.compute.manager [None req-55f36cc8-213f-4527-885f-564650c871bb tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] [instance: d00a0872-693c-4cdc-85cd-9806660e9d8d] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 03 12:20:12 user nova-compute[74960]: DEBUG oslo.service.loopingcall [None req-55f36cc8-213f-4527-885f-564650c871bb tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74960) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 12:20:12 user nova-compute[74960]: DEBUG nova.compute.manager [-] [instance: d00a0872-693c-4cdc-85cd-9806660e9d8d] Deallocating network for instance {{(pid=74960) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 12:20:12 user nova-compute[74960]: DEBUG nova.network.neutron [-] [instance: d00a0872-693c-4cdc-85cd-9806660e9d8d] deallocate_for_instance() {{(pid=74960) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 12:20:14 user nova-compute[74960]: DEBUG nova.compute.manager [req-22158a97-0d03-49fa-bf34-18a1c2cd4da7 req-bbe1e005-de33-4e39-b4b8-20d994131c2d service nova] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] Received event network-vif-plugged-31063379-2482-4339-9fb1-1468848af814 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:20:14 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-22158a97-0d03-49fa-bf34-18a1c2cd4da7 req-bbe1e005-de33-4e39-b4b8-20d994131c2d service nova] Acquiring lock "0a520c41-19c0-47ba-ada8-023ee9c12ca6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:20:14 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-22158a97-0d03-49fa-bf34-18a1c2cd4da7 req-bbe1e005-de33-4e39-b4b8-20d994131c2d service nova] Lock "0a520c41-19c0-47ba-ada8-023ee9c12ca6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:20:14 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-22158a97-0d03-49fa-bf34-18a1c2cd4da7 req-bbe1e005-de33-4e39-b4b8-20d994131c2d service nova] Lock "0a520c41-19c0-47ba-ada8-023ee9c12ca6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:20:14 user nova-compute[74960]: DEBUG nova.compute.manager [req-22158a97-0d03-49fa-bf34-18a1c2cd4da7 req-bbe1e005-de33-4e39-b4b8-20d994131c2d service nova] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] No waiting events found dispatching network-vif-plugged-31063379-2482-4339-9fb1-1468848af814 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:20:14 user nova-compute[74960]: WARNING nova.compute.manager [req-22158a97-0d03-49fa-bf34-18a1c2cd4da7 req-bbe1e005-de33-4e39-b4b8-20d994131c2d service nova] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] Received unexpected event network-vif-plugged-31063379-2482-4339-9fb1-1468848af814 for instance with vm_state active and task_state None.
Nov 03 12:20:14 user nova-compute[74960]: DEBUG nova.network.neutron [-] [instance: d00a0872-693c-4cdc-85cd-9806660e9d8d] Updating instance_info_cache with network_info: [] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:20:14 user nova-compute[74960]: INFO nova.compute.manager [-] [instance: d00a0872-693c-4cdc-85cd-9806660e9d8d] Took 1.57 seconds to deallocate network for instance.
Nov 03 12:20:14 user nova-compute[74960]: DEBUG nova.compute.manager [req-02cb2d16-46f0-413c-9a94-2d9199c762e1 req-7c9375da-e58a-45ef-8d90-e03a3e12f412 service nova] [instance: d00a0872-693c-4cdc-85cd-9806660e9d8d] Received event network-vif-plugged-c2a92350-10c1-4c73-bfce-b305071289ff {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:20:14 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-02cb2d16-46f0-413c-9a94-2d9199c762e1 req-7c9375da-e58a-45ef-8d90-e03a3e12f412 service nova] Acquiring lock "d00a0872-693c-4cdc-85cd-9806660e9d8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:20:14 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-02cb2d16-46f0-413c-9a94-2d9199c762e1 req-7c9375da-e58a-45ef-8d90-e03a3e12f412 service nova] Lock "d00a0872-693c-4cdc-85cd-9806660e9d8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:20:14 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-02cb2d16-46f0-413c-9a94-2d9199c762e1 req-7c9375da-e58a-45ef-8d90-e03a3e12f412 service nova] Lock "d00a0872-693c-4cdc-85cd-9806660e9d8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:20:14 user nova-compute[74960]: DEBUG nova.compute.manager [req-02cb2d16-46f0-413c-9a94-2d9199c762e1 req-7c9375da-e58a-45ef-8d90-e03a3e12f412 service nova] [instance: d00a0872-693c-4cdc-85cd-9806660e9d8d] No waiting events found dispatching network-vif-plugged-c2a92350-10c1-4c73-bfce-b305071289ff {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:20:14 user nova-compute[74960]: WARNING nova.compute.manager [req-02cb2d16-46f0-413c-9a94-2d9199c762e1 req-7c9375da-e58a-45ef-8d90-e03a3e12f412 service nova] [instance: d00a0872-693c-4cdc-85cd-9806660e9d8d] Received unexpected event network-vif-plugged-c2a92350-10c1-4c73-bfce-b305071289ff for instance with vm_state active and task_state deleting.
Nov 03 12:20:14 user nova-compute[74960]: DEBUG nova.compute.manager [req-02cb2d16-46f0-413c-9a94-2d9199c762e1 req-7c9375da-e58a-45ef-8d90-e03a3e12f412 service nova] [instance: d00a0872-693c-4cdc-85cd-9806660e9d8d] Received event network-vif-deleted-c2a92350-10c1-4c73-bfce-b305071289ff {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:20:14 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-55f36cc8-213f-4527-885f-564650c871bb tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:20:14 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-55f36cc8-213f-4527-885f-564650c871bb tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:20:14 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-55f36cc8-213f-4527-885f-564650c871bb tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:20:14 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-55f36cc8-213f-4527-885f-564650c871bb tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:20:14 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-55f36cc8-213f-4527-885f-564650c871bb tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.300s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:20:14 user nova-compute[74960]: INFO nova.scheduler.client.report [None req-55f36cc8-213f-4527-885f-564650c871bb tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Deleted allocations for instance d00a0872-693c-4cdc-85cd-9806660e9d8d
Nov 03 12:20:14 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-55f36cc8-213f-4527-885f-564650c871bb tempest-AttachSCSIVolumeTestJSON-961661338 tempest-AttachSCSIVolumeTestJSON-961661338-project-member] Lock "d00a0872-693c-4cdc-85cd-9806660e9d8d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.953s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:20:15 user nova-compute[74960]: DEBUG nova.network.neutron [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04] Updating instance_info_cache with network_info: [] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:20:15 user nova-compute[74960]: INFO nova.compute.manager [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04] Took 4.02 seconds to deallocate network for instance.
Nov 03 12:20:15 user nova-compute[74960]: DEBUG nova.compute.manager [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04] Detaching volume: cea9bdd9-6e87-4397-a897-4a6387dd73a8 {{(pid=74960) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3224}}
Nov 03 12:20:15 user nova-compute[74960]: INFO nova.compute.manager [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04] Detaching volume cea9bdd9-6e87-4397-a897-4a6387dd73a8
Nov 03 12:20:15 user nova-compute[74960]: DEBUG nova.virt.block_device [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04] Skipping driver_detach during remote rebuild. {{(pid=74960) _do_detach /opt/stack/nova/nova/virt/block_device.py:461}}
Nov 03 12:20:16 user nova-compute[74960]: WARNING nova.compute.manager [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] Failed to detach volume: cea9bdd9-6e87-4397-a897-4a6387dd73a8 due to 'NoneType' object has no attribute 'devices'
Nov 03 12:20:16 user nova-compute[74960]: DEBUG nova.compute.manager [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04] Detaching volume: 99fe1d66-0918-46bd-81e1-d870ffc464b4 {{(pid=74960) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3224}}
Nov 03 12:20:16 user nova-compute[74960]: INFO nova.compute.manager [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04] Detaching volume 99fe1d66-0918-46bd-81e1-d870ffc464b4
Nov 03 12:20:16 user nova-compute[74960]: DEBUG nova.virt.block_device [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04] Skipping driver_detach during remote rebuild. {{(pid=74960) _do_detach /opt/stack/nova/nova/virt/block_device.py:461}}
Nov 03 12:20:16 user nova-compute[74960]: WARNING nova.compute.manager [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] Failed to detach volume: 99fe1d66-0918-46bd-81e1-d870ffc464b4 due to 'NoneType' object has no attribute 'devices'
Nov 03 12:20:16 user nova-compute[74960]: DEBUG nova.compute.manager [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04] Detaching volume: ed753d9a-66cd-4242-9156-dff5a8170678 {{(pid=74960) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3224}}
Nov 03 12:20:16 user nova-compute[74960]: INFO nova.compute.manager [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04] Detaching volume ed753d9a-66cd-4242-9156-dff5a8170678
Nov 03 12:20:17 user nova-compute[74960]: DEBUG nova.virt.block_device [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] [instance: ac9e1b20-2482-4c71-b54b-5d6cb8187d04] Skipping driver_detach during remote rebuild. {{(pid=74960) _do_detach /opt/stack/nova/nova/virt/block_device.py:461}}
Nov 03 12:20:17 user nova-compute[74960]: INFO nova.scheduler.client.report [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] Deleted allocations for instance ac9e1b20-2482-4c71-b54b-5d6cb8187d04
Nov 03 12:20:17 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-96bf9bbe-ee46-4f8e-8365-dc2fcdd1f887 tempest-TaggedBootDevicesTest-62953878 tempest-TaggedBootDevicesTest-62953878-project-member] Lock "ac9e1b20-2482-4c71-b54b-5d6cb8187d04" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 82.221s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:20:17 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:20:22 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:20:27 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:20:31 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-adeda1d7-dcb2-4377-ba9b-5cf88f111375 tempest-VolumesAssistedSnapshotsTest-464837836 tempest-VolumesAssistedSnapshotsTest-464837836-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7f7fabc2-5e1b-441c-a693-9956470359ea is timed out.
Nov 03 12:20:31 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-adeda1d7-dcb2-4377-ba9b-5cf88f111375 tempest-VolumesAssistedSnapshotsTest-464837836 tempest-VolumesAssistedSnapshotsTest-464837836-project-admin] Successfully detached device vdb from instance 7f7fabc2-5e1b-441c-a693-9956470359ea from the live domain config.
Nov 03 12:20:31 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-adeda1d7-dcb2-4377-ba9b-5cf88f111375 tempest-VolumesAssistedSnapshotsTest-464837836 tempest-VolumesAssistedSnapshotsTest-464837836-project-admin] [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea] calling os-brick to detach iSCSI Volume {{(pid=74960) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 12:20:31 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-adeda1d7-dcb2-4377-ba9b-5cf88f111375 tempest-VolumesAssistedSnapshotsTest-464837836 tempest-VolumesAssistedSnapshotsTest-464837836-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9aa420acb0>, {'target_iqn': 'iqn.2010-10.org.openstack:52a35a52-65f0-484a-9ab9-903ed049026f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BRsVKCgG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:20:31 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-adeda1d7-dcb2-4377-ba9b-5cf88f111375 tempest-VolumesAssistedSnapshotsTest-464837836 tempest-VolumesAssistedSnapshotsTest-464837836-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:20:31 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-adeda1d7-dcb2-4377-ba9b-5cf88f111375 tempest-VolumesAssistedSnapshotsTest-464837836 tempest-VolumesAssistedSnapshotsTest-464837836-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:20:31 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-adeda1d7-dcb2-4377-ba9b-5cf88f111375 tempest-VolumesAssistedSnapshotsTest-464837836 tempest-VolumesAssistedSnapshotsTest-464837836-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:20:31 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:20:31 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:20:31 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4a298a3-d45f-480a-bd73-fea6bcdb9030]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:52a35a52-65f0-484a-9ab9-903ed049026f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:20:31 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-adeda1d7-dcb2-4377-ba9b-5cf88f111375 tempest-VolumesAssistedSnapshotsTest-464837836 tempest-VolumesAssistedSnapshotsTest-464837836-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 12:20:31 user nova-compute[74960]: No targets found.
Nov 03 12:20:31 user nova-compute[74960]: iSNS:
Nov 03 12:20:31 user nova-compute[74960]: No targets found.
Nov 03 12:20:31 user nova-compute[74960]: STATIC:
Nov 03 12:20:31 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19
Nov 03 12:20:31 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:20:31 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:20:31 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:52a35a52-65f0-484a-9ab9-903ed049026f
Nov 03 12:20:31 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:20:31 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:20:31 user nova-compute[74960]: FIRMWARE:
Nov 03 12:20:31 user nova-compute[74960]: No targets found.
Nov 03 12:20:31 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:20:31 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-adeda1d7-dcb2-4377-ba9b-5cf88f111375 tempest-VolumesAssistedSnapshotsTest-464837836 tempest-VolumesAssistedSnapshotsTest-464837836-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 12:20:31 user nova-compute[74960]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 12:20:31 user nova-compute[74960]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74960) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 12:20:31 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-adeda1d7-dcb2-4377-ba9b-5cf88f111375 tempest-VolumesAssistedSnapshotsTest-464837836 tempest-VolumesAssistedSnapshotsTest-464837836-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52a35a52-65f0-484a-9ab9-903ed049026f', 0)] {{(pid=74960) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 12:20:31 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:20:31 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:20:31 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[c05de19b-9336-4047-a1e4-f597d7209d9a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52a35a52-65f0-484a-9ab9-903ed049026f\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:20:31 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:20:31 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:20:31 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[87086232-15b7-4ca1-aba3-5477477b592a]: (4, ('tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52a35a52-65f0-484a-9ab9-903ed049026f (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:20:31 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-adeda1d7-dcb2-4377-ba9b-5cf88f111375 tempest-VolumesAssistedSnapshotsTest-464837836 tempest-VolumesAssistedSnapshotsTest-464837836-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19 (non-flash)
Nov 03 12:20:31 user nova-compute[74960]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52a35a52-65f0-484a-9ab9-903ed049026f (non-flash)
Nov 03 12:20:31 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:20:31 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-adeda1d7-dcb2-4377-ba9b-5cf88f111375 tempest-VolumesAssistedSnapshotsTest-464837836 tempest-VolumesAssistedSnapshotsTest-464837836-project-admin] iscsi session list stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19 (non-flash)
Nov 03 12:20:31 user nova-compute[74960]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52a35a52-65f0-484a-9ab9-903ed049026f (non-flash)
Nov 03 12:20:31 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:20:31 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-adeda1d7-dcb2-4377-ba9b-5cf88f111375 tempest-VolumesAssistedSnapshotsTest-464837836 tempest-VolumesAssistedSnapshotsTest-464837836-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9aac4ca3b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52a35a52-65f0-484a-9ab9-903ed049026f'): ({'sdf'}, set())}) {{(pid=74960) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 12:20:31 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-adeda1d7-dcb2-4377-ba9b-5cf88f111375 tempest-VolumesAssistedSnapshotsTest-464837836 tempest-VolumesAssistedSnapshotsTest-464837836-project-admin] Removing single pathed devices sdf {{(pid=74960) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 12:20:31 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:20:31 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:20:31 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebe8327c-6207-41b5-8d62-dc6ebf0f6f29]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:20:31 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:20:31 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:20:31 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[e675d19a-edd0-4344-b11f-6448a52f8448]: (4, ('ok\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:20:31 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-adeda1d7-dcb2-4377-ba9b-5cf88f111375 tempest-VolumesAssistedSnapshotsTest-464837836 tempest-VolumesAssistedSnapshotsTest-464837836-project-admin] Flushing IO for device /dev/sdf {{(pid=74960) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 12:20:31 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:20:31 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:20:31 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[9493f29a-7c07-4395-b7b3-61d90fa5cb97]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:20:31 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-adeda1d7-dcb2-4377-ba9b-5cf88f111375 tempest-VolumesAssistedSnapshotsTest-464837836 tempest-VolumesAssistedSnapshotsTest-464837836-project-admin] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74960) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 12:20:31 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:20:31 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.049s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:20:31 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ad83f89-b68a-4d2c-be3d-ea9b19fca234]: (4, ('1', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:20:31 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-adeda1d7-dcb2-4377-ba9b-5cf88f111375 tempest-VolumesAssistedSnapshotsTest-464837836 tempest-VolumesAssistedSnapshotsTest-464837836-project-admin] Checking to see if SCSI volumes sdf have been removed. {{(pid=74960) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 12:20:31 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-adeda1d7-dcb2-4377-ba9b-5cf88f111375 tempest-VolumesAssistedSnapshotsTest-464837836 tempest-VolumesAssistedSnapshotsTest-464837836-project-admin] SCSI volumes sdf have been removed. {{(pid=74960) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 12:20:31 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-adeda1d7-dcb2-4377-ba9b-5cf88f111375 tempest-VolumesAssistedSnapshotsTest-464837836 tempest-VolumesAssistedSnapshotsTest-464837836-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52a35a52-65f0-484a-9ab9-903ed049026f')] {{(pid=74960) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 12:20:31 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52a35a52-65f0-484a-9ab9-903ed049026f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:20:31 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52a35a52-65f0-484a-9ab9-903ed049026f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:20:31 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[558d1cd0-d75a-4bb0-96c7-971f731db174]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:20:31 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-adeda1d7-dcb2-4377-ba9b-5cf88f111375 tempest-VolumesAssistedSnapshotsTest-464837836 tempest-VolumesAssistedSnapshotsTest-464837836-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:20:31 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52a35a52-65f0-484a-9ab9-903ed049026f -p 172.16.0.220:3260 --logout {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:20:32 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52a35a52-65f0-484a-9ab9-903ed049026f -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:20:32 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a9015b-9b6a-4f69-976e-d90935903824]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:52a35a52-65f0-484a-9ab9-903ed049026f, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:52a35a52-65f0-484a-9ab9-903ed049026f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:20:32 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-adeda1d7-dcb2-4377-ba9b-5cf88f111375 tempest-VolumesAssistedSnapshotsTest-464837836 tempest-VolumesAssistedSnapshotsTest-464837836-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:52a35a52-65f0-484a-9ab9-903ed049026f, portal: 172.16.0.220,3260]
Nov 03 12:20:32 user nova-compute[74960]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:52a35a52-65f0-484a-9ab9-903ed049026f, portal: 172.16.0.220,3260] successful.
Nov 03 12:20:32 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:20:32 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52a35a52-65f0-484a-9ab9-903ed049026f -p 172.16.0.220:3260 --op delete {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:20:32 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-10a67d6e-956d-4071-bacc-2e2320100690 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Waiting for libvirt event about the detach of device tap31063379-24 with device alias net1 from instance 0a520c41-19c0-47ba-ada8-023ee9c12ca6 is timed out.
Nov 03 12:20:32 user nova-compute[74960]: DEBUG nova.virt.libvirt.guest [None req-10a67d6e-956d-4071-bacc-2e2320100690 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:e0:fa:2f"/><model type="virtio"/><mtu size="1442"/><target dev="tap31063379-24"/></interface> {{(pid=74960) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 03 12:20:32 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52a35a52-65f0-484a-9ab9-903ed049026f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:20:32 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[36af8b93-3825-4ba4-bc79-57f6411eaf60]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:20:32 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-adeda1d7-dcb2-4377-ba9b-5cf88f111375 tempest-VolumesAssistedSnapshotsTest-464837836 tempest-VolumesAssistedSnapshotsTest-464837836-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:20:32 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-adeda1d7-dcb2-4377-ba9b-5cf88f111375 tempest-VolumesAssistedSnapshotsTest-464837836 tempest-VolumesAssistedSnapshotsTest-464837836-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:20:32 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-adeda1d7-dcb2-4377-ba9b-5cf88f111375 tempest-VolumesAssistedSnapshotsTest-464837836 tempest-VolumesAssistedSnapshotsTest-464837836-project-admin] <== disconnect_volume: return (312ms) None {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:20:32 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-adeda1d7-dcb2-4377-ba9b-5cf88f111375 tempest-VolumesAssistedSnapshotsTest-464837836 tempest-VolumesAssistedSnapshotsTest-464837836-project-admin] [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea] Disconnected iSCSI Volume {{(pid=74960) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 12:20:32 user nova-compute[74960]: DEBUG nova.virt.libvirt.guest [None req-10a67d6e-956d-4071-bacc-2e2320100690 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:e0:fa:2f"/><model type="virtio"/><mtu size="1442"/><target dev="tap31063379-24"/></interface>not found in domain: <domain type='kvm' id='7'>
Nov 03 12:20:32 user nova-compute[74960]:   <name>instance-00000007</name>
Nov 03 12:20:32 user nova-compute[74960]:   <uuid>0a520c41-19c0-47ba-ada8-023ee9c12ca6</uuid>
Nov 03 12:20:32 user nova-compute[74960]:   <metadata>
Nov 03 12:20:32 user nova-compute[74960]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 12:20:32 user nova-compute[74960]:   <nova:package version="0.0.0"/>
Nov 03 12:20:32 user nova-compute[74960]:   <nova:name>tempest-device-tagging-server-718860820</nova:name>
Nov 03 12:20:32 user nova-compute[74960]:   <nova:creationTime>2023-11-03 12:19:12</nova:creationTime>
Nov 03 12:20:32 user nova-compute[74960]:   <nova:flavor name="m1.tiny">
Nov 03 12:20:32 user nova-compute[74960]:     <nova:memory>512</nova:memory>
Nov 03 12:20:32 user nova-compute[74960]:     <nova:disk>1</nova:disk>
Nov 03 12:20:32 user nova-compute[74960]:     <nova:swap>0</nova:swap>
Nov 03 12:20:32 user nova-compute[74960]:     <nova:ephemeral>0</nova:ephemeral>
Nov 03 12:20:32 user nova-compute[74960]:     <nova:vcpus>1</nova:vcpus>
Nov 03 12:20:32 user nova-compute[74960]:   </nova:flavor>
Nov 03 12:20:32 user nova-compute[74960]:   <nova:owner>
Nov 03 12:20:32 user nova-compute[74960]:     <nova:user uuid="9da58bde19c3434f9811cb80ed39dea9">tempest-TaggedAttachmentsTest-1950029920-project-member</nova:user>
Nov 03 12:20:32 user nova-compute[74960]:     <nova:project uuid="3390632661124edd9894dabac0053fa9">tempest-TaggedAttachmentsTest-1950029920</nova:project>
Nov 03 12:20:32 user nova-compute[74960]:   </nova:owner>
Nov 03 12:20:32 user nova-compute[74960]:   <nova:root type="image" uuid="549f51ba-ac69-494b-8de1-34635aa2d7cf"/>
Nov 03 12:20:32 user nova-compute[74960]:   <nova:ports>
Nov 03 12:20:32 user nova-compute[74960]:     <nova:port uuid="3e126a57-0883-4997-9c99-d25c9c6fc102">
Nov 03 12:20:32 user nova-compute[74960]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 03 12:20:32 user nova-compute[74960]:     </nova:port>
Nov 03 12:20:32 user nova-compute[74960]:     <nova:port uuid="31063379-2482-4339-9fb1-1468848af814">
Nov 03 12:20:32 user nova-compute[74960]:       <nova:ip type="fixed" address="10.10.10.94" ipVersion="4"/>
Nov 03 12:20:32 user nova-compute[74960]:     </nova:port>
Nov 03 12:20:32 user nova-compute[74960]:   </nova:ports>
Nov 03 12:20:32 user nova-compute[74960]: </nova:instance>
Nov 03 12:20:32 user nova-compute[74960]:   </metadata>
Nov 03 12:20:32 user nova-compute[74960]:   <memory unit='KiB'>524288</memory>
Nov 03 12:20:32 user nova-compute[74960]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 03 12:20:32 user nova-compute[74960]:   <vcpu placement='static'>1</vcpu>
Nov 03 12:20:32 user nova-compute[74960]:   <resource>
Nov 03 12:20:32 user nova-compute[74960]:     <partition>/machine</partition>
Nov 03 12:20:32 user nova-compute[74960]:   </resource>
Nov 03 12:20:32 user nova-compute[74960]:   <sysinfo type='smbios'>
Nov 03 12:20:32 user nova-compute[74960]:     <system>
Nov 03 12:20:32 user nova-compute[74960]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 03 12:20:32 user nova-compute[74960]:       <entry name='product'>OpenStack Nova</entry>
Nov 03 12:20:32 user nova-compute[74960]:       <entry name='version'>0.0.0</entry>
Nov 03 12:20:32 user nova-compute[74960]:       <entry name='serial'>0a520c41-19c0-47ba-ada8-023ee9c12ca6</entry>
Nov 03 12:20:32 user nova-compute[74960]:       <entry name='uuid'>0a520c41-19c0-47ba-ada8-023ee9c12ca6</entry>
Nov 03 12:20:32 user nova-compute[74960]:       <entry name='family'>Virtual Machine</entry>
Nov 03 12:20:32 user nova-compute[74960]:     </system>
Nov 03 12:20:32 user nova-compute[74960]:   </sysinfo>
Nov 03 12:20:32 user nova-compute[74960]:   <os>
Nov 03 12:20:32 user nova-compute[74960]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 03 12:20:32 user nova-compute[74960]:     <boot dev='hd'/>
Nov 03 12:20:32 user nova-compute[74960]:     <smbios mode='sysinfo'/>
Nov 03 12:20:32 user nova-compute[74960]:   </os>
Nov 03 12:20:32 user nova-compute[74960]:   <features>
Nov 03 12:20:32 user nova-compute[74960]:     <acpi/>
Nov 03 12:20:32 user nova-compute[74960]:     <apic/>
Nov 03 12:20:32 user nova-compute[74960]:     <vmcoreinfo state='on'/>
Nov 03 12:20:32 user nova-compute[74960]:   </features>
Nov 03 12:20:32 user nova-compute[74960]:   <cpu mode='custom' match='exact' check='full'>
Nov 03 12:20:32 user nova-compute[74960]:     <model fallback='forbid'>Nehalem</model>
Nov 03 12:20:32 user nova-compute[74960]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 03 12:20:32 user nova-compute[74960]:     <feature policy='require' name='vme'/>
Nov 03 12:20:32 user nova-compute[74960]:     <feature policy='require' name='x2apic'/>
Nov 03 12:20:32 user nova-compute[74960]:     <feature policy='require' name='hypervisor'/>
Nov 03 12:20:32 user nova-compute[74960]:   </cpu>
Nov 03 12:20:32 user nova-compute[74960]:   <clock offset='utc'>
Nov 03 12:20:32 user nova-compute[74960]:     <timer name='pit' tickpolicy='delay'/>
Nov 03 12:20:32 user nova-compute[74960]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 03 12:20:32 user nova-compute[74960]:     <timer name='hpet' present='no'/>
Nov 03 12:20:32 user nova-compute[74960]:   </clock>
Nov 03 12:20:32 user nova-compute[74960]:   <on_poweroff>destroy</on_poweroff>
Nov 03 12:20:32 user nova-compute[74960]:   <on_reboot>restart</on_reboot>
Nov 03 12:20:32 user nova-compute[74960]:   <on_crash>destroy</on_crash>
Nov 03 12:20:32 user nova-compute[74960]:   <devices>
Nov 03 12:20:32 user nova-compute[74960]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 03 12:20:32 user nova-compute[74960]:     <disk type='file' device='disk'>
Nov 03 12:20:32 user nova-compute[74960]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 03 12:20:32 user nova-compute[74960]:       <source file='/opt/stack/data/nova/instances/0a520c41-19c0-47ba-ada8-023ee9c12ca6/disk' index='2'/>
Nov 03 12:20:32 user nova-compute[74960]:       <backingStore type='file' index='3'>
Nov 03 12:20:32 user nova-compute[74960]:         <format type='raw'/>
Nov 03 12:20:32 user nova-compute[74960]:         <source file='/opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910'/>
Nov 03 12:20:32 user nova-compute[74960]:         <backingStore/>
Nov 03 12:20:32 user nova-compute[74960]:       </backingStore>
Nov 03 12:20:32 user nova-compute[74960]:       <target dev='vda' bus='virtio'/>
Nov 03 12:20:32 user nova-compute[74960]:       <alias name='virtio-disk0'/>
Nov 03 12:20:32 user nova-compute[74960]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 03 12:20:32 user nova-compute[74960]:     </disk>
Nov 03 12:20:32 user nova-compute[74960]:     <disk type='file' device='cdrom'>
Nov 03 12:20:32 user nova-compute[74960]:       <driver name='qemu' type='raw' cache='none'/>
Nov 03 12:20:32 user nova-compute[74960]:       <source file='/opt/stack/data/nova/instances/0a520c41-19c0-47ba-ada8-023ee9c12ca6/disk.config' index='1'/>
Nov 03 12:20:32 user nova-compute[74960]:       <backingStore/>
Nov 03 12:20:32 user nova-compute[74960]:       <target dev='hda' bus='ide'/>
Nov 03 12:20:32 user nova-compute[74960]:       <readonly/>
Nov 03 12:20:32 user nova-compute[74960]:       <alias name='ide0-0-0'/>
Nov 03 12:20:32 user nova-compute[74960]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 03 12:20:32 user nova-compute[74960]:     </disk>
Nov 03 12:20:32 user nova-compute[74960]:     <controller type='usb' index='0' model='none'>
Nov 03 12:20:32 user nova-compute[74960]:       <alias name='usb'/>
Nov 03 12:20:32 user nova-compute[74960]:     </controller>
Nov 03 12:20:32 user nova-compute[74960]:     <controller type='pci' index='0' model='pci-root'>
Nov 03 12:20:32 user nova-compute[74960]:       <alias name='pci.0'/>
Nov 03 12:20:32 user nova-compute[74960]:     </controller>
Nov 03 12:20:32 user nova-compute[74960]:     <controller type='ide' index='0'>
Nov 03 12:20:32 user nova-compute[74960]:       <alias name='ide'/>
Nov 03 12:20:32 user nova-compute[74960]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 03 12:20:32 user nova-compute[74960]:     </controller>
Nov 03 12:20:32 user nova-compute[74960]:     <interface type='ethernet'>
Nov 03 12:20:32 user nova-compute[74960]:       <mac address='fa:16:3e:f9:07:9b'/>
Nov 03 12:20:32 user nova-compute[74960]:       <target dev='tap3e126a57-08'/>
Nov 03 12:20:32 user nova-compute[74960]:       <model type='virtio'/>
Nov 03 12:20:32 user nova-compute[74960]:       <mtu size='1442'/>
Nov 03 12:20:32 user nova-compute[74960]:       <alias name='net0'/>
Nov 03 12:20:32 user nova-compute[74960]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 03 12:20:32 user nova-compute[74960]:     </interface>
Nov 03 12:20:32 user nova-compute[74960]:     <serial type='pty'>
Nov 03 12:20:32 user nova-compute[74960]:       <source path='/dev/pts/6'/>
Nov 03 12:20:32 user nova-compute[74960]:       <log file='/opt/stack/data/nova/instances/0a520c41-19c0-47ba-ada8-023ee9c12ca6/console.log' append='off'/>
Nov 03 12:20:32 user nova-compute[74960]:       <target type='isa-serial' port='0'>
Nov 03 12:20:32 user nova-compute[74960]:         <model name='isa-serial'/>
Nov 03 12:20:32 user nova-compute[74960]:       </target>
Nov 03 12:20:32 user nova-compute[74960]:       <alias name='serial0'/>
Nov 03 12:20:32 user nova-compute[74960]:     </serial>
Nov 03 12:20:32 user nova-compute[74960]:     <console type='pty' tty='/dev/pts/6'>
Nov 03 12:20:32 user nova-compute[74960]:       <source path='/dev/pts/6'/>
Nov 03 12:20:32 user nova-compute[74960]:       <log file='/opt/stack/data/nova/instances/0a520c41-19c0-47ba-ada8-023ee9c12ca6/console.log' append='off'/>
Nov 03 12:20:32 user nova-compute[74960]:       <target type='serial' port='0'/>
Nov 03 12:20:32 user nova-compute[74960]:       <alias name='serial0'/>
Nov 03 12:20:32 user nova-compute[74960]:     </console>
Nov 03 12:20:32 user nova-compute[74960]:     <input type='mouse' bus='ps2'>
Nov 03 12:20:32 user nova-compute[74960]:       <alias name='input0'/>
Nov 03 12:20:32 user nova-compute[74960]:     </input>
Nov 03 12:20:32 user nova-compute[74960]:     <input type='keyboard' bus='ps2'>
Nov 03 12:20:32 user nova-compute[74960]:       <alias name='input1'/>
Nov 03 12:20:32 user nova-compute[74960]:     </input>
Nov 03 12:20:32 user nova-compute[74960]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Nov 03 12:20:32 user nova-compute[74960]:       <listen type='address' address='0.0.0.0'/>
Nov 03 12:20:32 user nova-compute[74960]:     </graphics>
Nov 03 12:20:32 user nova-compute[74960]:     <audio id='1' type='none'/>
Nov 03 12:20:32 user nova-compute[74960]:     <video>
Nov 03 12:20:32 user nova-compute[74960]:       <model type='virtio' heads='1' primary='yes'/>
Nov 03 12:20:32 user nova-compute[74960]:       <alias name='video0'/>
Nov 03 12:20:32 user nova-compute[74960]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 03 12:20:32 user nova-compute[74960]:     </video>
Nov 03 12:20:32 user nova-compute[74960]:     <memballoon model='virtio'>
Nov 03 12:20:32 user nova-compute[74960]:       <stats period='10'/>
Nov 03 12:20:32 user nova-compute[74960]:       <alias name='balloon0'/>
Nov 03 12:20:32 user nova-compute[74960]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 03 12:20:32 user nova-compute[74960]:     </memballoon>
Nov 03 12:20:32 user nova-compute[74960]:     <rng model='virtio'>
Nov 03 12:20:32 user nova-compute[74960]:       <backend model='random'>/dev/urandom</backend>
Nov 03 12:20:32 user nova-compute[74960]:       <alias name='rng0'/>
Nov 03 12:20:32 user nova-compute[74960]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 03 12:20:32 user nova-compute[74960]:     </rng>
Nov 03 12:20:32 user nova-compute[74960]:   </devices>
Nov 03 12:20:32 user nova-compute[74960]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 03 12:20:32 user nova-compute[74960]:     <label>libvirt-0a520c41-19c0-47ba-ada8-023ee9c12ca6</label>
Nov 03 12:20:32 user nova-compute[74960]:     <imagelabel>libvirt-0a520c41-19c0-47ba-ada8-023ee9c12ca6</imagelabel>
Nov 03 12:20:32 user nova-compute[74960]:   </seclabel>
Nov 03 12:20:32 user nova-compute[74960]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 03 12:20:32 user nova-compute[74960]:     <label>+64055:+108</label>
Nov 03 12:20:32 user nova-compute[74960]:     <imagelabel>+64055:+108</imagelabel>
Nov 03 12:20:32 user nova-compute[74960]:   </seclabel>
Nov 03 12:20:32 user nova-compute[74960]: </domain>
Nov 03 12:20:32 user nova-compute[74960]:  {{(pid=74960) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 03 12:20:32 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-10a67d6e-956d-4071-bacc-2e2320100690 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Successfully detached device tap31063379-24 from instance 0a520c41-19c0-47ba-ada8-023ee9c12ca6 from the live domain config.
Nov 03 12:20:32 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-10a67d6e-956d-4071-bacc-2e2320100690 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T12:17:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-718860820',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-718860820',id=7,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLwaiWOkf4g+xGnCHIQ6PEXYDCQvWANu1aoEqkgH8PkfR56o+3+BPp4uxgAn5C+zZDpe3SkZ06KyunCKlhSZpIVyhUY157dTlXxkUygCex89TiMcoPvBPFCYXJkTY4on1A==',key_name='tempest-keypair-1456184094',keypairs=<?>,launch_index=0,launched_at=2023-11-03T12:17:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3390632661124edd9894dabac0053fa9',ramdisk_id='',reservation_id='r-zkhug3rc',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1950029920',owner_user_name='tempest-TaggedAttachmentsTest-1950029920-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T12:17:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9da58bde19c3434f9811cb80ed39dea9',uuid=0a520c41-19c0-47ba-ada8-023ee9c12ca6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "31063379-2482-4339-9fb1-1468848af814", "address": "fa:16:3e:e0:fa:2f", "network": {"id": "398189f9-4e24-48ff-9e1d-ac06e98e3eb1", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-610583939", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.94", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3390632661124edd9894dabac0053fa9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31063379-24", "ovs_interfaceid": "31063379-2482-4339-9fb1-1468848af814", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 12:20:32 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-10a67d6e-956d-4071-bacc-2e2320100690 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Converting VIF {"id": "31063379-2482-4339-9fb1-1468848af814", "address": "fa:16:3e:e0:fa:2f", "network": {"id": "398189f9-4e24-48ff-9e1d-ac06e98e3eb1", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-610583939", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.94", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3390632661124edd9894dabac0053fa9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31063379-24", "ovs_interfaceid": "31063379-2482-4339-9fb1-1468848af814", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:20:32 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-10a67d6e-956d-4071-bacc-2e2320100690 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:fa:2f,bridge_name='br-int',has_traffic_filtering=True,id=31063379-2482-4339-9fb1-1468848af814,network=Network(398189f9-4e24-48ff-9e1d-ac06e98e3eb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31063379-24') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:20:32 user nova-compute[74960]: DEBUG os_vif [None req-10a67d6e-956d-4071-bacc-2e2320100690 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:fa:2f,bridge_name='br-int',has_traffic_filtering=True,id=31063379-2482-4339-9fb1-1468848af814,network=Network(398189f9-4e24-48ff-9e1d-ac06e98e3eb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31063379-24') {{(pid=74960) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 12:20:32 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:20:32 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap31063379-24, bridge=br-int, if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:20:32 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:20:32 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:20:32 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:20:32 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3039aae1-1326-4250-9fc5-8b9bccab6d3d) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:20:32 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:20:32 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:20:32 user nova-compute[74960]: INFO os_vif [None req-10a67d6e-956d-4071-bacc-2e2320100690 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:fa:2f,bridge_name='br-int',has_traffic_filtering=True,id=31063379-2482-4339-9fb1-1468848af814,network=Network(398189f9-4e24-48ff-9e1d-ac06e98e3eb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31063379-24')
Nov 03 12:20:32 user nova-compute[74960]: DEBUG nova.virt.libvirt.guest [None req-10a67d6e-956d-4071-bacc-2e2320100690 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 12:20:32 user nova-compute[74960]:   <nova:package version="0.0.0"/>
Nov 03 12:20:32 user nova-compute[74960]:   <nova:name>tempest-device-tagging-server-718860820</nova:name>
Nov 03 12:20:32 user nova-compute[74960]:   <nova:creationTime>2023-11-03 12:20:32</nova:creationTime>
Nov 03 12:20:32 user nova-compute[74960]:   <nova:flavor name="m1.tiny">
Nov 03 12:20:32 user nova-compute[74960]:     <nova:memory>512</nova:memory>
Nov 03 12:20:32 user nova-compute[74960]:     <nova:disk>1</nova:disk>
Nov 03 12:20:32 user nova-compute[74960]:     <nova:swap>0</nova:swap>
Nov 03 12:20:32 user nova-compute[74960]:     <nova:ephemeral>0</nova:ephemeral>
Nov 03 12:20:32 user nova-compute[74960]:     <nova:vcpus>1</nova:vcpus>
Nov 03 12:20:32 user nova-compute[74960]:   </nova:flavor>
Nov 03 12:20:32 user nova-compute[74960]:   <nova:owner>
Nov 03 12:20:32 user nova-compute[74960]:     <nova:user uuid="9da58bde19c3434f9811cb80ed39dea9">tempest-TaggedAttachmentsTest-1950029920-project-member</nova:user>
Nov 03 12:20:32 user nova-compute[74960]:     <nova:project uuid="3390632661124edd9894dabac0053fa9">tempest-TaggedAttachmentsTest-1950029920</nova:project>
Nov 03 12:20:32 user nova-compute[74960]:   </nova:owner>
Nov 03 12:20:32 user nova-compute[74960]:   <nova:root type="image" uuid="549f51ba-ac69-494b-8de1-34635aa2d7cf"/>
Nov 03 12:20:32 user nova-compute[74960]:   <nova:ports>
Nov 03 12:20:32 user nova-compute[74960]:     <nova:port uuid="3e126a57-0883-4997-9c99-d25c9c6fc102">
Nov 03 12:20:32 user nova-compute[74960]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 03 12:20:32 user nova-compute[74960]:     </nova:port>
Nov 03 12:20:32 user nova-compute[74960]:   </nova:ports>
Nov 03 12:20:32 user nova-compute[74960]: </nova:instance>
Nov 03 12:20:32 user nova-compute[74960]:  {{(pid=74960) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 03 12:20:32 user nova-compute[74960]: DEBUG nova.compute.manager [req-30115907-a409-42b1-a902-0f636b157a99 req-83c39533-d265-4ce1-8137-19cf5cef3494 service nova] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] Received event network-vif-deleted-31063379-2482-4339-9fb1-1468848af814 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:20:32 user nova-compute[74960]: INFO nova.compute.manager [req-30115907-a409-42b1-a902-0f636b157a99 req-83c39533-d265-4ce1-8137-19cf5cef3494 service nova] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] Neutron deleted interface 31063379-2482-4339-9fb1-1468848af814; detaching it from the instance and deleting it from the info cache
Nov 03 12:20:32 user nova-compute[74960]: DEBUG nova.network.neutron [req-30115907-a409-42b1-a902-0f636b157a99 req-83c39533-d265-4ce1-8137-19cf5cef3494 service nova] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] Updating instance_info_cache with network_info: [{"id": "3e126a57-0883-4997-9c99-d25c9c6fc102", "address": "fa:16:3e:f9:07:9b", "network": {"id": "65e1589f-341c-4cc8-a8e6-5b61544daf55", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1130686752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3390632661124edd9894dabac0053fa9", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e126a57-08", "ovs_interfaceid": "3e126a57-0883-4997-9c99-d25c9c6fc102", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:20:32 user nova-compute[74960]: DEBUG nova.objects.instance [req-30115907-a409-42b1-a902-0f636b157a99 req-83c39533-d265-4ce1-8137-19cf5cef3494 service nova] Lazy-loading 'system_metadata' on Instance uuid 0a520c41-19c0-47ba-ada8-023ee9c12ca6 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:20:32 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-10a67d6e-956d-4071-bacc-2e2320100690 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Acquiring lock "refresh_cache-0a520c41-19c0-47ba-ada8-023ee9c12ca6" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:20:32 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-10a67d6e-956d-4071-bacc-2e2320100690 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Acquired lock "refresh_cache-0a520c41-19c0-47ba-ada8-023ee9c12ca6" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:20:32 user nova-compute[74960]: DEBUG nova.network.neutron [None req-10a67d6e-956d-4071-bacc-2e2320100690 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] Building network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 12:20:32 user nova-compute[74960]: DEBUG nova.objects.instance [req-30115907-a409-42b1-a902-0f636b157a99 req-83c39533-d265-4ce1-8137-19cf5cef3494 service nova] Lazy-loading 'flavor' on Instance uuid 0a520c41-19c0-47ba-ada8-023ee9c12ca6 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:20:32 user nova-compute[74960]: DEBUG nova.objects.base [req-30115907-a409-42b1-a902-0f636b157a99 req-83c39533-d265-4ce1-8137-19cf5cef3494 service nova] Object Instance<0a520c41-19c0-47ba-ada8-023ee9c12ca6> lazy-loaded attributes: system_metadata,flavor {{(pid=74960) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 12:20:32 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [req-30115907-a409-42b1-a902-0f636b157a99 req-83c39533-d265-4ce1-8137-19cf5cef3494 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T12:17:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-718860820',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-718860820',id=7,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLwaiWOkf4g+xGnCHIQ6PEXYDCQvWANu1aoEqkgH8PkfR56o+3+BPp4uxgAn5C+zZDpe3SkZ06KyunCKlhSZpIVyhUY157dTlXxkUygCex89TiMcoPvBPFCYXJkTY4on1A==',key_name='tempest-keypair-1456184094',keypairs=<?>,launch_index=0,launched_at=2023-11-03T12:17:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3390632661124edd9894dabac0053fa9',ramdisk_id='',reservation_id='r-zkhug3rc',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1950029920',owner_user_name='tempest-TaggedAttachmentsTest-1950029920-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T12:17:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9da58bde19c3434f9811cb80ed39dea9',uuid=0a520c41-19c0-47ba-ada8-023ee9c12ca6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "31063379-2482-4339-9fb1-1468848af814", "address": "fa:16:3e:e0:fa:2f", "network": {"id": "398189f9-4e24-48ff-9e1d-ac06e98e3eb1", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-610583939", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.94", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3390632661124edd9894dabac0053fa9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31063379-24", "ovs_interfaceid": "31063379-2482-4339-9fb1-1468848af814", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74960) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 12:20:32 user nova-compute[74960]: DEBUG nova.network.os_vif_util [req-30115907-a409-42b1-a902-0f636b157a99 req-83c39533-d265-4ce1-8137-19cf5cef3494 service nova] Converting VIF {"id": "31063379-2482-4339-9fb1-1468848af814", "address": "fa:16:3e:e0:fa:2f", "network": {"id": "398189f9-4e24-48ff-9e1d-ac06e98e3eb1", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-610583939", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.94", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3390632661124edd9894dabac0053fa9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31063379-24", "ovs_interfaceid": "31063379-2482-4339-9fb1-1468848af814", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:20:32 user nova-compute[74960]: DEBUG nova.network.os_vif_util [req-30115907-a409-42b1-a902-0f636b157a99 req-83c39533-d265-4ce1-8137-19cf5cef3494 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:fa:2f,bridge_name='br-int',has_traffic_filtering=True,id=31063379-2482-4339-9fb1-1468848af814,network=Network(398189f9-4e24-48ff-9e1d-ac06e98e3eb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31063379-24') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:20:32 user nova-compute[74960]: DEBUG nova.virt.libvirt.guest [req-30115907-a409-42b1-a902-0f636b157a99 req-83c39533-d265-4ce1-8137-19cf5cef3494 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:e0:fa:2f"/><model type="virtio"/><mtu size="1442"/><target dev="tap31063379-24"/></interface> {{(pid=74960) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 03 12:20:32 user nova-compute[74960]: DEBUG nova.virt.libvirt.guest [req-30115907-a409-42b1-a902-0f636b157a99 req-83c39533-d265-4ce1-8137-19cf5cef3494 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:e0:fa:2f"/><model type="virtio"/><mtu size="1442"/><target dev="tap31063379-24"/></interface>not found in domain: <domain type='kvm' id='7'>
Nov 03 12:20:32 user nova-compute[74960]:   <name>instance-00000007</name>
Nov 03 12:20:32 user nova-compute[74960]:   <uuid>0a520c41-19c0-47ba-ada8-023ee9c12ca6</uuid>
Nov 03 12:20:32 user nova-compute[74960]:   <metadata>
Nov 03 12:20:32 user nova-compute[74960]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 12:20:32 user nova-compute[74960]:   <nova:package version="0.0.0"/>
Nov 03 12:20:32 user nova-compute[74960]:   <nova:name>tempest-device-tagging-server-718860820</nova:name>
Nov 03 12:20:32 user nova-compute[74960]:   <nova:creationTime>2023-11-03 12:20:32</nova:creationTime>
Nov 03 12:20:32 user nova-compute[74960]:   <nova:flavor name="m1.tiny">
Nov 03 12:20:32 user nova-compute[74960]:     <nova:memory>512</nova:memory>
Nov 03 12:20:32 user nova-compute[74960]:     <nova:disk>1</nova:disk>
Nov 03 12:20:32 user nova-compute[74960]:     <nova:swap>0</nova:swap>
Nov 03 12:20:32 user nova-compute[74960]:     <nova:ephemeral>0</nova:ephemeral>
Nov 03 12:20:32 user nova-compute[74960]:     <nova:vcpus>1</nova:vcpus>
Nov 03 12:20:32 user nova-compute[74960]:   </nova:flavor>
Nov 03 12:20:32 user nova-compute[74960]:   <nova:owner>
Nov 03 12:20:32 user nova-compute[74960]:     <nova:user uuid="9da58bde19c3434f9811cb80ed39dea9">tempest-TaggedAttachmentsTest-1950029920-project-member</nova:user>
Nov 03 12:20:32 user nova-compute[74960]:     <nova:project uuid="3390632661124edd9894dabac0053fa9">tempest-TaggedAttachmentsTest-1950029920</nova:project>
Nov 03 12:20:32 user nova-compute[74960]:   </nova:owner>
Nov 03 12:20:32 user nova-compute[74960]:   <nova:root type="image" uuid="549f51ba-ac69-494b-8de1-34635aa2d7cf"/>
Nov 03 12:20:32 user nova-compute[74960]:   <nova:ports>
Nov 03 12:20:32 user nova-compute[74960]:     <nova:port uuid="3e126a57-0883-4997-9c99-d25c9c6fc102">
Nov 03 12:20:32 user nova-compute[74960]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 03 12:20:32 user nova-compute[74960]:     </nova:port>
Nov 03 12:20:32 user nova-compute[74960]:   </nova:ports>
Nov 03 12:20:32 user nova-compute[74960]: </nova:instance>
Nov 03 12:20:32 user nova-compute[74960]:   </metadata>
Nov 03 12:20:32 user nova-compute[74960]:   <memory unit='KiB'>524288</memory>
Nov 03 12:20:32 user nova-compute[74960]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 03 12:20:32 user nova-compute[74960]:   <vcpu placement='static'>1</vcpu>
Nov 03 12:20:32 user nova-compute[74960]:   <resource>
Nov 03 12:20:32 user nova-compute[74960]:     <partition>/machine</partition>
Nov 03 12:20:32 user nova-compute[74960]:   </resource>
Nov 03 12:20:32 user nova-compute[74960]:   <sysinfo type='smbios'>
Nov 03 12:20:32 user nova-compute[74960]:     <system>
Nov 03 12:20:32 user nova-compute[74960]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 03 12:20:32 user nova-compute[74960]:       <entry name='product'>OpenStack Nova</entry>
Nov 03 12:20:32 user nova-compute[74960]:       <entry name='version'>0.0.0</entry>
Nov 03 12:20:32 user nova-compute[74960]:       <entry name='serial'>0a520c41-19c0-47ba-ada8-023ee9c12ca6</entry>
Nov 03 12:20:32 user nova-compute[74960]:       <entry name='uuid'>0a520c41-19c0-47ba-ada8-023ee9c12ca6</entry>
Nov 03 12:20:32 user nova-compute[74960]:       <entry name='family'>Virtual Machine</entry>
Nov 03 12:20:32 user nova-compute[74960]:     </system>
Nov 03 12:20:32 user nova-compute[74960]:   </sysinfo>
Nov 03 12:20:32 user nova-compute[74960]:   <os>
Nov 03 12:20:32 user nova-compute[74960]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 03 12:20:32 user nova-compute[74960]:     <boot dev='hd'/>
Nov 03 12:20:32 user nova-compute[74960]:     <smbios mode='sysinfo'/>
Nov 03 12:20:32 user nova-compute[74960]:   </os>
Nov 03 12:20:32 user nova-compute[74960]:   <features>
Nov 03 12:20:32 user nova-compute[74960]:     <acpi/>
Nov 03 12:20:32 user nova-compute[74960]:     <apic/>
Nov 03 12:20:32 user nova-compute[74960]:     <vmcoreinfo state='on'/>
Nov 03 12:20:32 user nova-compute[74960]:   </features>
Nov 03 12:20:32 user nova-compute[74960]:   <cpu mode='custom' match='exact' check='full'>
Nov 03 12:20:32 user nova-compute[74960]:     <model fallback='forbid'>Nehalem</model>
Nov 03 12:20:32 user nova-compute[74960]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 03 12:20:32 user nova-compute[74960]:     <feature policy='require' name='vme'/>
Nov 03 12:20:32 user nova-compute[74960]:     <feature policy='require' name='x2apic'/>
Nov 03 12:20:32 user nova-compute[74960]:     <feature policy='require' name='hypervisor'/>
Nov 03 12:20:32 user nova-compute[74960]:   </cpu>
Nov 03 12:20:32 user nova-compute[74960]:   <clock offset='utc'>
Nov 03 12:20:32 user nova-compute[74960]:     <timer name='pit' tickpolicy='delay'/>
Nov 03 12:20:32 user nova-compute[74960]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 03 12:20:32 user nova-compute[74960]:     <timer name='hpet' present='no'/>
Nov 03 12:20:32 user nova-compute[74960]:   </clock>
Nov 03 12:20:32 user nova-compute[74960]:   <on_poweroff>destroy</on_poweroff>
Nov 03 12:20:32 user nova-compute[74960]:   <on_reboot>restart</on_reboot>
Nov 03 12:20:32 user nova-compute[74960]:   <on_crash>destroy</on_crash>
Nov 03 12:20:32 user nova-compute[74960]:   <devices>
Nov 03 12:20:32 user nova-compute[74960]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 03 12:20:32 user nova-compute[74960]:     <disk type='file' device='disk'>
Nov 03 12:20:32 user nova-compute[74960]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 03 12:20:32 user nova-compute[74960]:       <source file='/opt/stack/data/nova/instances/0a520c41-19c0-47ba-ada8-023ee9c12ca6/disk' index='2'/>
Nov 03 12:20:32 user nova-compute[74960]:       <backingStore type='file' index='3'>
Nov 03 12:20:32 user nova-compute[74960]:         <format type='raw'/>
Nov 03 12:20:32 user nova-compute[74960]:         <source file='/opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910'/>
Nov 03 12:20:32 user nova-compute[74960]:         <backingStore/>
Nov 03 12:20:32 user nova-compute[74960]:       </backingStore>
Nov 03 12:20:32 user nova-compute[74960]:       <target dev='vda' bus='virtio'/>
Nov 03 12:20:32 user nova-compute[74960]:       <alias name='virtio-disk0'/>
Nov 03 12:20:32 user nova-compute[74960]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 03 12:20:32 user nova-compute[74960]:     </disk>
Nov 03 12:20:32 user nova-compute[74960]:     <disk type='file' device='cdrom'>
Nov 03 12:20:32 user nova-compute[74960]:       <driver name='qemu' type='raw' cache='none'/>
Nov 03 12:20:32 user nova-compute[74960]:       <source file='/opt/stack/data/nova/instances/0a520c41-19c0-47ba-ada8-023ee9c12ca6/disk.config' index='1'/>
Nov 03 12:20:32 user nova-compute[74960]:       <backingStore/>
Nov 03 12:20:32 user nova-compute[74960]:       <target dev='hda' bus='ide'/>
Nov 03 12:20:32 user nova-compute[74960]:       <readonly/>
Nov 03 12:20:32 user nova-compute[74960]:       <alias name='ide0-0-0'/>
Nov 03 12:20:32 user nova-compute[74960]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 03 12:20:32 user nova-compute[74960]:     </disk>
Nov 03 12:20:32 user nova-compute[74960]:     <controller type='usb' index='0' model='none'>
Nov 03 12:20:32 user nova-compute[74960]:       <alias name='usb'/>
Nov 03 12:20:32 user nova-compute[74960]:     </controller>
Nov 03 12:20:32 user nova-compute[74960]:     <controller type='pci' index='0' model='pci-root'>
Nov 03 12:20:32 user nova-compute[74960]:       <alias name='pci.0'/>
Nov 03 12:20:32 user nova-compute[74960]:     </controller>
Nov 03 12:20:32 user nova-compute[74960]:     <controller type='ide' index='0'>
Nov 03 12:20:32 user nova-compute[74960]:       <alias name='ide'/>
Nov 03 12:20:32 user nova-compute[74960]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 03 12:20:32 user nova-compute[74960]:     </controller>
Nov 03 12:20:32 user nova-compute[74960]:     <interface type='ethernet'>
Nov 03 12:20:32 user nova-compute[74960]:       <mac address='fa:16:3e:f9:07:9b'/>
Nov 03 12:20:32 user nova-compute[74960]:       <target dev='tap3e126a57-08'/>
Nov 03 12:20:32 user nova-compute[74960]:       <model type='virtio'/>
Nov 03 12:20:32 user nova-compute[74960]:       <mtu size='1442'/>
Nov 03 12:20:32 user nova-compute[74960]:       <alias name='net0'/>
Nov 03 12:20:32 user nova-compute[74960]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 03 12:20:32 user nova-compute[74960]:     </interface>
Nov 03 12:20:32 user nova-compute[74960]:     <serial type='pty'>
Nov 03 12:20:32 user nova-compute[74960]:       <source path='/dev/pts/6'/>
Nov 03 12:20:32 user nova-compute[74960]:       <log file='/opt/stack/data/nova/instances/0a520c41-19c0-47ba-ada8-023ee9c12ca6/console.log' append='off'/>
Nov 03 12:20:32 user nova-compute[74960]:       <target type='isa-serial' port='0'>
Nov 03 12:20:32 user nova-compute[74960]:         <model name='isa-serial'/>
Nov 03 12:20:32 user nova-compute[74960]:       </target>
Nov 03 12:20:32 user nova-compute[74960]:       <alias name='serial0'/>
Nov 03 12:20:32 user nova-compute[74960]:     </serial>
Nov 03 12:20:32 user nova-compute[74960]:     <console type='pty' tty='/dev/pts/6'>
Nov 03 12:20:32 user nova-compute[74960]:       <source path='/dev/pts/6'/>
Nov 03 12:20:32 user nova-compute[74960]:       <log file='/opt/stack/data/nova/instances/0a520c41-19c0-47ba-ada8-023ee9c12ca6/console.log' append='off'/>
Nov 03 12:20:32 user nova-compute[74960]:       <target type='serial' port='0'/>
Nov 03 12:20:32 user nova-compute[74960]:       <alias name='serial0'/>
Nov 03 12:20:32 user nova-compute[74960]:     </console>
Nov 03 12:20:32 user nova-compute[74960]:     <input type='mouse' bus='ps2'>
Nov 03 12:20:32 user nova-compute[74960]:       <alias name='input0'/>
Nov 03 12:20:32 user nova-compute[74960]:     </input>
Nov 03 12:20:32 user nova-compute[74960]:     <input type='keyboard' bus='ps2'>
Nov 03 12:20:32 user nova-compute[74960]:       <alias name='input1'/>
Nov 03 12:20:32 user nova-compute[74960]:     </input>
Nov 03 12:20:32 user nova-compute[74960]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Nov 03 12:20:32 user nova-compute[74960]:       <listen type='address' address='0.0.0.0'/>
Nov 03 12:20:32 user nova-compute[74960]:     </graphics>
Nov 03 12:20:32 user nova-compute[74960]:     <audio id='1' type='none'/>
Nov 03 12:20:32 user nova-compute[74960]:     <video>
Nov 03 12:20:32 user nova-compute[74960]:       <model type='virtio' heads='1' primary='yes'/>
Nov 03 12:20:32 user nova-compute[74960]:       <alias name='video0'/>
Nov 03 12:20:32 user nova-compute[74960]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 03 12:20:32 user nova-compute[74960]:     </video>
Nov 03 12:20:32 user nova-compute[74960]:     <memballoon model='virtio'>
Nov 03 12:20:32 user nova-compute[74960]:       <stats period='10'/>
Nov 03 12:20:32 user nova-compute[74960]:       <alias name='balloon0'/>
Nov 03 12:20:32 user nova-compute[74960]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 03 12:20:32 user nova-compute[74960]:     </memballoon>
Nov 03 12:20:32 user nova-compute[74960]:     <rng model='virtio'>
Nov 03 12:20:32 user nova-compute[74960]:       <backend model='random'>/dev/urandom</backend>
Nov 03 12:20:32 user nova-compute[74960]:       <alias name='rng0'/>
Nov 03 12:20:32 user nova-compute[74960]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 03 12:20:32 user nova-compute[74960]:     </rng>
Nov 03 12:20:32 user nova-compute[74960]:   </devices>
Nov 03 12:20:32 user nova-compute[74960]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 03 12:20:32 user nova-compute[74960]:     <label>libvirt-0a520c41-19c0-47ba-ada8-023ee9c12ca6</label>
Nov 03 12:20:32 user nova-compute[74960]:     <imagelabel>libvirt-0a520c41-19c0-47ba-ada8-023ee9c12ca6</imagelabel>
Nov 03 12:20:32 user nova-compute[74960]:   </seclabel>
Nov 03 12:20:32 user nova-compute[74960]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 03 12:20:32 user nova-compute[74960]:     <label>+64055:+108</label>
Nov 03 12:20:32 user nova-compute[74960]:     <imagelabel>+64055:+108</imagelabel>
Nov 03 12:20:32 user nova-compute[74960]:   </seclabel>
Nov 03 12:20:32 user nova-compute[74960]: </domain>
Nov 03 12:20:32 user nova-compute[74960]:  {{(pid=74960) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 03 12:20:32 user nova-compute[74960]: DEBUG nova.virt.libvirt.guest [req-30115907-a409-42b1-a902-0f636b157a99 req-83c39533-d265-4ce1-8137-19cf5cef3494 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:e0:fa:2f"/><model type="virtio"/><mtu size="1442"/><target dev="tap31063379-24"/></interface> {{(pid=74960) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 03 12:20:32 user nova-compute[74960]: DEBUG nova.virt.libvirt.guest [req-30115907-a409-42b1-a902-0f636b157a99 req-83c39533-d265-4ce1-8137-19cf5cef3494 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:e0:fa:2f"/><model type="virtio"/><mtu size="1442"/><target dev="tap31063379-24"/></interface>not found in domain: <domain type='kvm' id='7'>
Nov 03 12:20:32 user nova-compute[74960]:   <name>instance-00000007</name>
Nov 03 12:20:32 user nova-compute[74960]:   <uuid>0a520c41-19c0-47ba-ada8-023ee9c12ca6</uuid>
Nov 03 12:20:32 user nova-compute[74960]:   <metadata>
Nov 03 12:20:32 user nova-compute[74960]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 12:20:32 user nova-compute[74960]:   <nova:package version="0.0.0"/>
Nov 03 12:20:32 user nova-compute[74960]:   <nova:name>tempest-device-tagging-server-718860820</nova:name>
Nov 03 12:20:32 user nova-compute[74960]:   <nova:creationTime>2023-11-03 12:20:32</nova:creationTime>
Nov 03 12:20:32 user nova-compute[74960]:   <nova:flavor name="m1.tiny">
Nov 03 12:20:32 user nova-compute[74960]:     <nova:memory>512</nova:memory>
Nov 03 12:20:32 user nova-compute[74960]:     <nova:disk>1</nova:disk>
Nov 03 12:20:32 user nova-compute[74960]:     <nova:swap>0</nova:swap>
Nov 03 12:20:32 user nova-compute[74960]:     <nova:ephemeral>0</nova:ephemeral>
Nov 03 12:20:32 user nova-compute[74960]:     <nova:vcpus>1</nova:vcpus>
Nov 03 12:20:32 user nova-compute[74960]:   </nova:flavor>
Nov 03 12:20:32 user nova-compute[74960]:   <nova:owner>
Nov 03 12:20:32 user nova-compute[74960]:     <nova:user uuid="9da58bde19c3434f9811cb80ed39dea9">tempest-TaggedAttachmentsTest-1950029920-project-member</nova:user>
Nov 03 12:20:32 user nova-compute[74960]:     <nova:project uuid="3390632661124edd9894dabac0053fa9">tempest-TaggedAttachmentsTest-1950029920</nova:project>
Nov 03 12:20:32 user nova-compute[74960]:   </nova:owner>
Nov 03 12:20:32 user nova-compute[74960]:   <nova:root type="image" uuid="549f51ba-ac69-494b-8de1-34635aa2d7cf"/>
Nov 03 12:20:32 user nova-compute[74960]:   <nova:ports>
Nov 03 12:20:32 user nova-compute[74960]:     <nova:port uuid="3e126a57-0883-4997-9c99-d25c9c6fc102">
Nov 03 12:20:32 user nova-compute[74960]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 03 12:20:32 user nova-compute[74960]:     </nova:port>
Nov 03 12:20:32 user nova-compute[74960]:   </nova:ports>
Nov 03 12:20:32 user nova-compute[74960]: </nova:instance>
Nov 03 12:20:32 user nova-compute[74960]:   </metadata>
Nov 03 12:20:32 user nova-compute[74960]:   <memory unit='KiB'>524288</memory>
Nov 03 12:20:32 user nova-compute[74960]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 03 12:20:32 user nova-compute[74960]:   <vcpu placement='static'>1</vcpu>
Nov 03 12:20:32 user nova-compute[74960]:   <resource>
Nov 03 12:20:32 user nova-compute[74960]:     <partition>/machine</partition>
Nov 03 12:20:32 user nova-compute[74960]:   </resource>
Nov 03 12:20:32 user nova-compute[74960]:   <sysinfo type='smbios'>
Nov 03 12:20:32 user nova-compute[74960]:     <system>
Nov 03 12:20:32 user nova-compute[74960]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 03 12:20:32 user nova-compute[74960]:       <entry name='product'>OpenStack Nova</entry>
Nov 03 12:20:32 user nova-compute[74960]:       <entry name='version'>0.0.0</entry>
Nov 03 12:20:32 user nova-compute[74960]:       <entry name='serial'>0a520c41-19c0-47ba-ada8-023ee9c12ca6</entry>
Nov 03 12:20:32 user nova-compute[74960]:       <entry name='uuid'>0a520c41-19c0-47ba-ada8-023ee9c12ca6</entry>
Nov 03 12:20:32 user nova-compute[74960]:       <entry name='family'>Virtual Machine</entry>
Nov 03 12:20:32 user nova-compute[74960]:     </system>
Nov 03 12:20:32 user nova-compute[74960]:   </sysinfo>
Nov 03 12:20:32 user nova-compute[74960]:   <os>
Nov 03 12:20:32 user nova-compute[74960]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 03 12:20:32 user nova-compute[74960]:     <boot dev='hd'/>
Nov 03 12:20:32 user nova-compute[74960]:     <smbios mode='sysinfo'/>
Nov 03 12:20:32 user nova-compute[74960]:   </os>
Nov 03 12:20:32 user nova-compute[74960]:   <features>
Nov 03 12:20:32 user nova-compute[74960]:     <acpi/>
Nov 03 12:20:32 user nova-compute[74960]:     <apic/>
Nov 03 12:20:32 user nova-compute[74960]:     <vmcoreinfo state='on'/>
Nov 03 12:20:32 user nova-compute[74960]:   </features>
Nov 03 12:20:32 user nova-compute[74960]:   <cpu mode='custom' match='exact' check='full'>
Nov 03 12:20:32 user nova-compute[74960]:     <model fallback='forbid'>Nehalem</model>
Nov 03 12:20:32 user nova-compute[74960]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 03 12:20:32 user nova-compute[74960]:     <feature policy='require' name='vme'/>
Nov 03 12:20:32 user nova-compute[74960]:     <feature policy='require' name='x2apic'/>
Nov 03 12:20:32 user nova-compute[74960]:     <feature policy='require' name='hypervisor'/>
Nov 03 12:20:32 user nova-compute[74960]:   </cpu>
Nov 03 12:20:32 user nova-compute[74960]:   <clock offset='utc'>
Nov 03 12:20:32 user nova-compute[74960]:     <timer name='pit' tickpolicy='delay'/>
Nov 03 12:20:32 user nova-compute[74960]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 03 12:20:32 user nova-compute[74960]:     <timer name='hpet' present='no'/>
Nov 03 12:20:32 user nova-compute[74960]:   </clock>
Nov 03 12:20:32 user nova-compute[74960]:   <on_poweroff>destroy</on_poweroff>
Nov 03 12:20:32 user nova-compute[74960]:   <on_reboot>restart</on_reboot>
Nov 03 12:20:32 user nova-compute[74960]:   <on_crash>destroy</on_crash>
Nov 03 12:20:32 user nova-compute[74960]:   <devices>
Nov 03 12:20:32 user nova-compute[74960]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 03 12:20:32 user nova-compute[74960]:     <disk type='file' device='disk'>
Nov 03 12:20:32 user nova-compute[74960]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 03 12:20:32 user nova-compute[74960]:       <source file='/opt/stack/data/nova/instances/0a520c41-19c0-47ba-ada8-023ee9c12ca6/disk' index='2'/>
Nov 03 12:20:32 user nova-compute[74960]:       <backingStore type='file' index='3'>
Nov 03 12:20:32 user nova-compute[74960]:         <format type='raw'/>
Nov 03 12:20:32 user nova-compute[74960]:         <source file='/opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910'/>
Nov 03 12:20:32 user nova-compute[74960]:         <backingStore/>
Nov 03 12:20:32 user nova-compute[74960]:       </backingStore>
Nov 03 12:20:32 user nova-compute[74960]:       <target dev='vda' bus='virtio'/>
Nov 03 12:20:32 user nova-compute[74960]:       <alias name='virtio-disk0'/>
Nov 03 12:20:32 user nova-compute[74960]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 03 12:20:32 user nova-compute[74960]:     </disk>
Nov 03 12:20:32 user nova-compute[74960]:     <disk type='file' device='cdrom'>
Nov 03 12:20:32 user nova-compute[74960]:       <driver name='qemu' type='raw' cache='none'/>
Nov 03 12:20:32 user nova-compute[74960]:       <source file='/opt/stack/data/nova/instances/0a520c41-19c0-47ba-ada8-023ee9c12ca6/disk.config' index='1'/>
Nov 03 12:20:32 user nova-compute[74960]:       <backingStore/>
Nov 03 12:20:32 user nova-compute[74960]:       <target dev='hda' bus='ide'/>
Nov 03 12:20:32 user nova-compute[74960]:       <readonly/>
Nov 03 12:20:32 user nova-compute[74960]:       <alias name='ide0-0-0'/>
Nov 03 12:20:32 user nova-compute[74960]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 03 12:20:32 user nova-compute[74960]:     </disk>
Nov 03 12:20:32 user nova-compute[74960]:     <controller type='usb' index='0' model='none'>
Nov 03 12:20:32 user nova-compute[74960]:       <alias name='usb'/>
Nov 03 12:20:32 user nova-compute[74960]:     </controller>
Nov 03 12:20:32 user nova-compute[74960]:     <controller type='pci' index='0' model='pci-root'>
Nov 03 12:20:32 user nova-compute[74960]:       <alias name='pci.0'/>
Nov 03 12:20:32 user nova-compute[74960]:     </controller>
Nov 03 12:20:32 user nova-compute[74960]:     <controller type='ide' index='0'>
Nov 03 12:20:32 user nova-compute[74960]:       <alias name='ide'/>
Nov 03 12:20:32 user nova-compute[74960]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 03 12:20:32 user nova-compute[74960]:     </controller>
Nov 03 12:20:32 user nova-compute[74960]:     <interface type='ethernet'>
Nov 03 12:20:32 user nova-compute[74960]:       <mac address='fa:16:3e:f9:07:9b'/>
Nov 03 12:20:32 user nova-compute[74960]:       <target dev='tap3e126a57-08'/>
Nov 03 12:20:32 user nova-compute[74960]:       <model type='virtio'/>
Nov 03 12:20:32 user nova-compute[74960]:       <mtu size='1442'/>
Nov 03 12:20:32 user nova-compute[74960]:       <alias name='net0'/>
Nov 03 12:20:32 user nova-compute[74960]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 03 12:20:32 user nova-compute[74960]:     </interface>
Nov 03 12:20:32 user nova-compute[74960]:     <serial type='pty'>
Nov 03 12:20:32 user nova-compute[74960]:       <source path='/dev/pts/6'/>
Nov 03 12:20:32 user nova-compute[74960]:       <log file='/opt/stack/data/nova/instances/0a520c41-19c0-47ba-ada8-023ee9c12ca6/console.log' append='off'/>
Nov 03 12:20:32 user nova-compute[74960]:       <target type='isa-serial' port='0'>
Nov 03 12:20:32 user nova-compute[74960]:         <model name='isa-serial'/>
Nov 03 12:20:32 user nova-compute[74960]:       </target>
Nov 03 12:20:32 user nova-compute[74960]:       <alias name='serial0'/>
Nov 03 12:20:32 user nova-compute[74960]:     </serial>
Nov 03 12:20:32 user nova-compute[74960]:     <console type='pty' tty='/dev/pts/6'>
Nov 03 12:20:32 user nova-compute[74960]:       <source path='/dev/pts/6'/>
Nov 03 12:20:32 user nova-compute[74960]:       <log file='/opt/stack/data/nova/instances/0a520c41-19c0-47ba-ada8-023ee9c12ca6/console.log' append='off'/>
Nov 03 12:20:32 user nova-compute[74960]:       <target type='serial' port='0'/>
Nov 03 12:20:32 user nova-compute[74960]:       <alias name='serial0'/>
Nov 03 12:20:32 user nova-compute[74960]:     </console>
Nov 03 12:20:32 user nova-compute[74960]:     <input type='mouse' bus='ps2'>
Nov 03 12:20:32 user nova-compute[74960]:       <alias name='input0'/>
Nov 03 12:20:32 user nova-compute[74960]:     </input>
Nov 03 12:20:32 user nova-compute[74960]:     <input type='keyboard' bus='ps2'>
Nov 03 12:20:32 user nova-compute[74960]:       <alias name='input1'/>
Nov 03 12:20:32 user nova-compute[74960]:     </input>
Nov 03 12:20:32 user nova-compute[74960]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Nov 03 12:20:32 user nova-compute[74960]:       <listen type='address' address='0.0.0.0'/>
Nov 03 12:20:32 user nova-compute[74960]:     </graphics>
Nov 03 12:20:32 user nova-compute[74960]:     <audio id='1' type='none'/>
Nov 03 12:20:32 user nova-compute[74960]:     <video>
Nov 03 12:20:32 user nova-compute[74960]:       <model type='virtio' heads='1' primary='yes'/>
Nov 03 12:20:32 user nova-compute[74960]:       <alias name='video0'/>
Nov 03 12:20:32 user nova-compute[74960]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 03 12:20:32 user nova-compute[74960]:     </video>
Nov 03 12:20:32 user nova-compute[74960]:     <memballoon model='virtio'>
Nov 03 12:20:32 user nova-compute[74960]:       <stats period='10'/>
Nov 03 12:20:32 user nova-compute[74960]:       <alias name='balloon0'/>
Nov 03 12:20:32 user nova-compute[74960]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 03 12:20:32 user nova-compute[74960]:     </memballoon>
Nov 03 12:20:32 user nova-compute[74960]:     <rng model='virtio'>
Nov 03 12:20:32 user nova-compute[74960]:       <backend model='random'>/dev/urandom</backend>
Nov 03 12:20:32 user nova-compute[74960]:       <alias name='rng0'/>
Nov 03 12:20:32 user nova-compute[74960]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 03 12:20:32 user nova-compute[74960]:     </rng>
Nov 03 12:20:32 user nova-compute[74960]:   </devices>
Nov 03 12:20:32 user nova-compute[74960]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 03 12:20:32 user nova-compute[74960]:     <label>libvirt-0a520c41-19c0-47ba-ada8-023ee9c12ca6</label>
Nov 03 12:20:32 user nova-compute[74960]:     <imagelabel>libvirt-0a520c41-19c0-47ba-ada8-023ee9c12ca6</imagelabel>
Nov 03 12:20:32 user nova-compute[74960]:   </seclabel>
Nov 03 12:20:32 user nova-compute[74960]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 03 12:20:32 user nova-compute[74960]:     <label>+64055:+108</label>
Nov 03 12:20:32 user nova-compute[74960]:     <imagelabel>+64055:+108</imagelabel>
Nov 03 12:20:32 user nova-compute[74960]:   </seclabel>
Nov 03 12:20:32 user nova-compute[74960]: </domain>
Nov 03 12:20:32 user nova-compute[74960]:  {{(pid=74960) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 03 12:20:32 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [req-30115907-a409-42b1-a902-0f636b157a99 req-83c39533-d265-4ce1-8137-19cf5cef3494 service nova] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] Detaching interface fa:16:3e:e0:fa:2f failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap31063379-24' not found.
Nov 03 12:20:32 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [req-30115907-a409-42b1-a902-0f636b157a99 req-83c39533-d265-4ce1-8137-19cf5cef3494 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T12:17:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-718860820',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-718860820',id=7,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLwaiWOkf4g+xGnCHIQ6PEXYDCQvWANu1aoEqkgH8PkfR56o+3+BPp4uxgAn5C+zZDpe3SkZ06KyunCKlhSZpIVyhUY157dTlXxkUygCex89TiMcoPvBPFCYXJkTY4on1A==',key_name='tempest-keypair-1456184094',keypairs=<?>,launch_index=0,launched_at=2023-11-03T12:17:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3390632661124edd9894dabac0053fa9',ramdisk_id='',reservation_id='r-zkhug3rc',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1950029920',owner_user_name='tempest-TaggedAttachmentsTest-1950029920-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T12:17:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9da58bde19c3434f9811cb80ed39dea9',uuid=0a520c41-19c0-47ba-ada8-023ee9c12ca6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "31063379-2482-4339-9fb1-1468848af814", "address": "fa:16:3e:e0:fa:2f", "network": {"id": "398189f9-4e24-48ff-9e1d-ac06e98e3eb1", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-610583939", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.94", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3390632661124edd9894dabac0053fa9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31063379-24", "ovs_interfaceid": "31063379-2482-4339-9fb1-1468848af814", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 12:20:32 user nova-compute[74960]: DEBUG nova.network.os_vif_util [req-30115907-a409-42b1-a902-0f636b157a99 req-83c39533-d265-4ce1-8137-19cf5cef3494 service nova] Converting VIF {"id": "31063379-2482-4339-9fb1-1468848af814", "address": "fa:16:3e:e0:fa:2f", "network": {"id": "398189f9-4e24-48ff-9e1d-ac06e98e3eb1", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-610583939", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.94", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3390632661124edd9894dabac0053fa9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31063379-24", "ovs_interfaceid": "31063379-2482-4339-9fb1-1468848af814", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:20:32 user nova-compute[74960]: DEBUG nova.network.os_vif_util [req-30115907-a409-42b1-a902-0f636b157a99 req-83c39533-d265-4ce1-8137-19cf5cef3494 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:fa:2f,bridge_name='br-int',has_traffic_filtering=True,id=31063379-2482-4339-9fb1-1468848af814,network=Network(398189f9-4e24-48ff-9e1d-ac06e98e3eb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31063379-24') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:20:32 user nova-compute[74960]: DEBUG os_vif [req-30115907-a409-42b1-a902-0f636b157a99 req-83c39533-d265-4ce1-8137-19cf5cef3494 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:fa:2f,bridge_name='br-int',has_traffic_filtering=True,id=31063379-2482-4339-9fb1-1468848af814,network=Network(398189f9-4e24-48ff-9e1d-ac06e98e3eb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31063379-24') {{(pid=74960) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 12:20:32 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:20:32 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap31063379-24, bridge=br-int, if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:20:32 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 12:20:32 user nova-compute[74960]: INFO os_vif [req-30115907-a409-42b1-a902-0f636b157a99 req-83c39533-d265-4ce1-8137-19cf5cef3494 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:fa:2f,bridge_name='br-int',has_traffic_filtering=True,id=31063379-2482-4339-9fb1-1468848af814,network=Network(398189f9-4e24-48ff-9e1d-ac06e98e3eb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31063379-24')
Nov 03 12:20:32 user nova-compute[74960]: DEBUG nova.virt.libvirt.guest [req-30115907-a409-42b1-a902-0f636b157a99 req-83c39533-d265-4ce1-8137-19cf5cef3494 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 12:20:32 user nova-compute[74960]:   <nova:package version="0.0.0"/>
Nov 03 12:20:32 user nova-compute[74960]:   <nova:name>tempest-device-tagging-server-718860820</nova:name>
Nov 03 12:20:32 user nova-compute[74960]:   <nova:creationTime>2023-11-03 12:20:32</nova:creationTime>
Nov 03 12:20:32 user nova-compute[74960]:   <nova:flavor name="m1.tiny">
Nov 03 12:20:32 user nova-compute[74960]:     <nova:memory>512</nova:memory>
Nov 03 12:20:32 user nova-compute[74960]:     <nova:disk>1</nova:disk>
Nov 03 12:20:32 user nova-compute[74960]:     <nova:swap>0</nova:swap>
Nov 03 12:20:32 user nova-compute[74960]:     <nova:ephemeral>0</nova:ephemeral>
Nov 03 12:20:32 user nova-compute[74960]:     <nova:vcpus>1</nova:vcpus>
Nov 03 12:20:32 user nova-compute[74960]:   </nova:flavor>
Nov 03 12:20:32 user nova-compute[74960]:   <nova:owner>
Nov 03 12:20:32 user nova-compute[74960]:     <nova:user uuid="9da58bde19c3434f9811cb80ed39dea9">tempest-TaggedAttachmentsTest-1950029920-project-member</nova:user>
Nov 03 12:20:32 user nova-compute[74960]:     <nova:project uuid="3390632661124edd9894dabac0053fa9">tempest-TaggedAttachmentsTest-1950029920</nova:project>
Nov 03 12:20:32 user nova-compute[74960]:   </nova:owner>
Nov 03 12:20:32 user nova-compute[74960]:   <nova:root type="image" uuid="549f51ba-ac69-494b-8de1-34635aa2d7cf"/>
Nov 03 12:20:32 user nova-compute[74960]:   <nova:ports>
Nov 03 12:20:32 user nova-compute[74960]:     <nova:port uuid="3e126a57-0883-4997-9c99-d25c9c6fc102">
Nov 03 12:20:32 user nova-compute[74960]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 03 12:20:32 user nova-compute[74960]:     </nova:port>
Nov 03 12:20:32 user nova-compute[74960]:   </nova:ports>
Nov 03 12:20:32 user nova-compute[74960]: </nova:instance>
Nov 03 12:20:32 user nova-compute[74960]:  {{(pid=74960) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 03 12:20:33 user nova-compute[74960]: DEBUG nova.objects.instance [None req-adeda1d7-dcb2-4377-ba9b-5cf88f111375 tempest-VolumesAssistedSnapshotsTest-464837836 tempest-VolumesAssistedSnapshotsTest-464837836-project-admin] Lazy-loading 'flavor' on Instance uuid 7f7fabc2-5e1b-441c-a693-9956470359ea {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:20:33 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-adeda1d7-dcb2-4377-ba9b-5cf88f111375 tempest-VolumesAssistedSnapshotsTest-464837836 tempest-VolumesAssistedSnapshotsTest-464837836-project-admin] Lock "7f7fabc2-5e1b-441c-a693-9956470359ea" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.061s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:20:33 user nova-compute[74960]: DEBUG nova.network.neutron [None req-10a67d6e-956d-4071-bacc-2e2320100690 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] Updating instance_info_cache with network_info: [{"id": "3e126a57-0883-4997-9c99-d25c9c6fc102", "address": "fa:16:3e:f9:07:9b", "network": {"id": "65e1589f-341c-4cc8-a8e6-5b61544daf55", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1130686752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3390632661124edd9894dabac0053fa9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e126a57-08", "ovs_interfaceid": "3e126a57-0883-4997-9c99-d25c9c6fc102", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:20:33 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-10a67d6e-956d-4071-bacc-2e2320100690 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Releasing lock "refresh_cache-0a520c41-19c0-47ba-ada8-023ee9c12ca6" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:20:33 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-10a67d6e-956d-4071-bacc-2e2320100690 tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Lock "interface-0a520c41-19c0-47ba-ada8-023ee9c12ca6-31063379-2482-4339-9fb1-1468848af814" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 21.943s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:20:36 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-0cd35881-646f-4206-a492-7b31d9a36392 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Acquiring lock "6145a30b-809c-4bc5-a45f-c3ff3b170a22" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:20:36 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-0cd35881-646f-4206-a492-7b31d9a36392 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Lock "6145a30b-809c-4bc5-a45f-c3ff3b170a22" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:20:36 user nova-compute[74960]: DEBUG nova.compute.manager [None req-0cd35881-646f-4206-a492-7b31d9a36392 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] Starting instance... {{(pid=74960) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 12:20:37 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-0cd35881-646f-4206-a492-7b31d9a36392 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:20:37 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-0cd35881-646f-4206-a492-7b31d9a36392 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:20:37 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-0cd35881-646f-4206-a492-7b31d9a36392 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74960) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 12:20:37 user nova-compute[74960]: INFO nova.compute.claims [None req-0cd35881-646f-4206-a492-7b31d9a36392 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] Claim successful on node user
Nov 03 12:20:37 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:20:37 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-0cd35881-646f-4206-a492-7b31d9a36392 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:20:37 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-0cd35881-646f-4206-a492-7b31d9a36392 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:20:37 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-0cd35881-646f-4206-a492-7b31d9a36392 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.508s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:20:37 user nova-compute[74960]: DEBUG nova.compute.manager [None req-0cd35881-646f-4206-a492-7b31d9a36392 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] Start building networks asynchronously for instance. {{(pid=74960) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 12:20:37 user nova-compute[74960]: DEBUG nova.compute.manager [None req-0cd35881-646f-4206-a492-7b31d9a36392 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] Allocating IP information in the background. {{(pid=74960) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 12:20:37 user nova-compute[74960]: DEBUG nova.network.neutron [None req-0cd35881-646f-4206-a492-7b31d9a36392 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] allocate_for_instance() {{(pid=74960) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 12:20:37 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-0cd35881-646f-4206-a492-7b31d9a36392 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 12:20:37 user nova-compute[74960]: DEBUG nova.compute.manager [None req-0cd35881-646f-4206-a492-7b31d9a36392 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] Start building block device mappings for instance. {{(pid=74960) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 12:20:37 user nova-compute[74960]: DEBUG nova.policy [None req-0cd35881-646f-4206-a492-7b31d9a36392 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '60d8d224d7204ede84c09433a3d82d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5320673ee4f0422989a3708915375cdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74960) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 12:20:37 user nova-compute[74960]: DEBUG nova.compute.manager [None req-0cd35881-646f-4206-a492-7b31d9a36392 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] Start spawning the instance on the hypervisor. {{(pid=74960) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 12:20:37 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-0cd35881-646f-4206-a492-7b31d9a36392 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] Creating instance directory {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 12:20:37 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-0cd35881-646f-4206-a492-7b31d9a36392 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] Creating image(s)
Nov 03 12:20:37 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-0cd35881-646f-4206-a492-7b31d9a36392 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Acquiring lock "/opt/stack/data/nova/instances/6145a30b-809c-4bc5-a45f-c3ff3b170a22/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:20:37 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-0cd35881-646f-4206-a492-7b31d9a36392 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Lock "/opt/stack/data/nova/instances/6145a30b-809c-4bc5-a45f-c3ff3b170a22/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:20:37 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-0cd35881-646f-4206-a492-7b31d9a36392 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Lock "/opt/stack/data/nova/instances/6145a30b-809c-4bc5-a45f-c3ff3b170a22/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.020s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:20:37 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-0cd35881-646f-4206-a492-7b31d9a36392 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:20:38 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-0cd35881-646f-4206-a492-7b31d9a36392 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.202s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:20:38 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-0cd35881-646f-4206-a492-7b31d9a36392 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Acquiring lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:20:38 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-0cd35881-646f-4206-a492-7b31d9a36392 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:20:38 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-0cd35881-646f-4206-a492-7b31d9a36392 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:20:38 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-0cd35881-646f-4206-a492-7b31d9a36392 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.235s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:20:38 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-0cd35881-646f-4206-a492-7b31d9a36392 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910,backing_fmt=raw /opt/stack/data/nova/instances/6145a30b-809c-4bc5-a45f-c3ff3b170a22/disk 1073741824 {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:20:38 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-0cd35881-646f-4206-a492-7b31d9a36392 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910,backing_fmt=raw /opt/stack/data/nova/instances/6145a30b-809c-4bc5-a45f-c3ff3b170a22/disk 1073741824" returned: 0 in 0.052s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:20:38 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-0cd35881-646f-4206-a492-7b31d9a36392 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.296s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:20:38 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-0cd35881-646f-4206-a492-7b31d9a36392 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:20:38 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-0cd35881-646f-4206-a492-7b31d9a36392 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.212s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:20:38 user nova-compute[74960]: DEBUG nova.virt.disk.api [None req-0cd35881-646f-4206-a492-7b31d9a36392 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6145a30b-809c-4bc5-a45f-c3ff3b170a22/disk. size=1073741824 {{(pid=74960) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 12:20:38 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-0cd35881-646f-4206-a492-7b31d9a36392 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6145a30b-809c-4bc5-a45f-c3ff3b170a22/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:20:38 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-0cd35881-646f-4206-a492-7b31d9a36392 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6145a30b-809c-4bc5-a45f-c3ff3b170a22/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:20:38 user nova-compute[74960]: DEBUG nova.virt.disk.api [None req-0cd35881-646f-4206-a492-7b31d9a36392 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Cannot resize image /opt/stack/data/nova/instances/6145a30b-809c-4bc5-a45f-c3ff3b170a22/disk to a smaller size. {{(pid=74960) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 12:20:38 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-0cd35881-646f-4206-a492-7b31d9a36392 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] Created local disks {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 12:20:38 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-0cd35881-646f-4206-a492-7b31d9a36392 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] Ensure instance console log exists: /opt/stack/data/nova/instances/6145a30b-809c-4bc5-a45f-c3ff3b170a22/console.log {{(pid=74960) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 12:20:38 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-0cd35881-646f-4206-a492-7b31d9a36392 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:20:38 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-0cd35881-646f-4206-a492-7b31d9a36392 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:20:38 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-0cd35881-646f-4206-a492-7b31d9a36392 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:20:39 user nova-compute[74960]: DEBUG nova.network.neutron [None req-0cd35881-646f-4206-a492-7b31d9a36392 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] Successfully created port: c54167dd-e416-43bd-8271-dd55e9e71119 {{(pid=74960) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 12:20:39 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-e001d581-4e41-4e12-bf55-38cacdcc4983 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Acquiring lock "0a198493-7329-43ff-bceb-56b50529be29" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:20:39 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-e001d581-4e41-4e12-bf55-38cacdcc4983 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Lock "0a198493-7329-43ff-bceb-56b50529be29" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:20:39 user nova-compute[74960]: DEBUG nova.compute.manager [None req-e001d581-4e41-4e12-bf55-38cacdcc4983 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] [instance: 0a198493-7329-43ff-bceb-56b50529be29] Starting instance... {{(pid=74960) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 12:20:39 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-e001d581-4e41-4e12-bf55-38cacdcc4983 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:20:39 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-e001d581-4e41-4e12-bf55-38cacdcc4983 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:20:39 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-e001d581-4e41-4e12-bf55-38cacdcc4983 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74960) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 12:20:39 user nova-compute[74960]: INFO nova.compute.claims [None req-e001d581-4e41-4e12-bf55-38cacdcc4983 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] [instance: 0a198493-7329-43ff-bceb-56b50529be29] Claim successful on node user
Nov 03 12:20:40 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-e001d581-4e41-4e12-bf55-38cacdcc4983 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:20:40 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-e001d581-4e41-4e12-bf55-38cacdcc4983 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:20:40 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-e001d581-4e41-4e12-bf55-38cacdcc4983 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.499s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:20:40 user nova-compute[74960]: DEBUG nova.compute.manager [None req-e001d581-4e41-4e12-bf55-38cacdcc4983 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] [instance: 0a198493-7329-43ff-bceb-56b50529be29] Start building networks asynchronously for instance. {{(pid=74960) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 12:20:40 user nova-compute[74960]: DEBUG nova.network.neutron [None req-0cd35881-646f-4206-a492-7b31d9a36392 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] Successfully updated port: c54167dd-e416-43bd-8271-dd55e9e71119 {{(pid=74960) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 12:20:40 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-0cd35881-646f-4206-a492-7b31d9a36392 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Acquiring lock "refresh_cache-6145a30b-809c-4bc5-a45f-c3ff3b170a22" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:20:40 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-0cd35881-646f-4206-a492-7b31d9a36392 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Acquired lock "refresh_cache-6145a30b-809c-4bc5-a45f-c3ff3b170a22" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:20:40 user nova-compute[74960]: DEBUG nova.network.neutron [None req-0cd35881-646f-4206-a492-7b31d9a36392 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] Building network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 12:20:40 user nova-compute[74960]: DEBUG nova.compute.manager [req-929a4752-9704-4285-8bb2-445e48615628 req-5b3b575e-8788-4094-848f-0c6dc1673d02 service nova] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] Received event network-changed-c54167dd-e416-43bd-8271-dd55e9e71119 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:20:40 user nova-compute[74960]: DEBUG nova.compute.manager [req-929a4752-9704-4285-8bb2-445e48615628 req-5b3b575e-8788-4094-848f-0c6dc1673d02 service nova] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] Refreshing instance network info cache due to event network-changed-c54167dd-e416-43bd-8271-dd55e9e71119. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 12:20:40 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-929a4752-9704-4285-8bb2-445e48615628 req-5b3b575e-8788-4094-848f-0c6dc1673d02 service nova] Acquiring lock "refresh_cache-6145a30b-809c-4bc5-a45f-c3ff3b170a22" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:20:40 user nova-compute[74960]: DEBUG nova.compute.manager [None req-e001d581-4e41-4e12-bf55-38cacdcc4983 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] [instance: 0a198493-7329-43ff-bceb-56b50529be29] Allocating IP information in the background. {{(pid=74960) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 12:20:40 user nova-compute[74960]: DEBUG nova.network.neutron [None req-e001d581-4e41-4e12-bf55-38cacdcc4983 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] [instance: 0a198493-7329-43ff-bceb-56b50529be29] allocate_for_instance() {{(pid=74960) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 12:20:40 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-e001d581-4e41-4e12-bf55-38cacdcc4983 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] [instance: 0a198493-7329-43ff-bceb-56b50529be29] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 12:20:40 user nova-compute[74960]: DEBUG nova.compute.manager [None req-e001d581-4e41-4e12-bf55-38cacdcc4983 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] [instance: 0a198493-7329-43ff-bceb-56b50529be29] Start building block device mappings for instance. {{(pid=74960) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 12:20:40 user nova-compute[74960]: DEBUG nova.network.neutron [None req-0cd35881-646f-4206-a492-7b31d9a36392 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] Instance cache missing network info. {{(pid=74960) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 12:20:40 user nova-compute[74960]: DEBUG nova.policy [None req-e001d581-4e41-4e12-bf55-38cacdcc4983 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '26930c47348248f681093b8e74e8c73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58667b53361b490fa7f0236ee65934c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74960) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 12:20:40 user nova-compute[74960]: DEBUG nova.compute.manager [None req-e001d581-4e41-4e12-bf55-38cacdcc4983 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] [instance: 0a198493-7329-43ff-bceb-56b50529be29] Start spawning the instance on the hypervisor. {{(pid=74960) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 12:20:40 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-e001d581-4e41-4e12-bf55-38cacdcc4983 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] [instance: 0a198493-7329-43ff-bceb-56b50529be29] Creating instance directory {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 12:20:40 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-e001d581-4e41-4e12-bf55-38cacdcc4983 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] [instance: 0a198493-7329-43ff-bceb-56b50529be29] Creating image(s)
Nov 03 12:20:40 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-e001d581-4e41-4e12-bf55-38cacdcc4983 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Acquiring lock "/opt/stack/data/nova/instances/0a198493-7329-43ff-bceb-56b50529be29/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:20:40 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-e001d581-4e41-4e12-bf55-38cacdcc4983 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Lock "/opt/stack/data/nova/instances/0a198493-7329-43ff-bceb-56b50529be29/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:20:40 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-e001d581-4e41-4e12-bf55-38cacdcc4983 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Lock "/opt/stack/data/nova/instances/0a198493-7329-43ff-bceb-56b50529be29/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:20:40 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-e001d581-4e41-4e12-bf55-38cacdcc4983 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:20:40 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-e001d581-4e41-4e12-bf55-38cacdcc4983 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.214s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:20:40 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-e001d581-4e41-4e12-bf55-38cacdcc4983 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Acquiring lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:20:40 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-e001d581-4e41-4e12-bf55-38cacdcc4983 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:20:40 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-e001d581-4e41-4e12-bf55-38cacdcc4983 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:20:40 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-e001d581-4e41-4e12-bf55-38cacdcc4983 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.203s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:20:40 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-e001d581-4e41-4e12-bf55-38cacdcc4983 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910,backing_fmt=raw /opt/stack/data/nova/instances/0a198493-7329-43ff-bceb-56b50529be29/disk 1073741824 {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:20:40 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-e001d581-4e41-4e12-bf55-38cacdcc4983 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910,backing_fmt=raw /opt/stack/data/nova/instances/0a198493-7329-43ff-bceb-56b50529be29/disk 1073741824" returned: 0 in 0.061s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:20:40 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-e001d581-4e41-4e12-bf55-38cacdcc4983 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.273s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:20:40 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-e001d581-4e41-4e12-bf55-38cacdcc4983 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:20:41 user nova-compute[74960]: DEBUG nova.network.neutron [None req-0cd35881-646f-4206-a492-7b31d9a36392 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] Updating instance_info_cache with network_info: [{"id": "c54167dd-e416-43bd-8271-dd55e9e71119", "address": "fa:16:3e:33:a0:07", "network": {"id": "9c5fae09-5df5-45a3-b9cd-7ac3763ba878", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1736223258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5320673ee4f0422989a3708915375cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc54167dd-e4", "ovs_interfaceid": "c54167dd-e416-43bd-8271-dd55e9e71119", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:20:41 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-e001d581-4e41-4e12-bf55-38cacdcc4983 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.169s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:20:41 user nova-compute[74960]: DEBUG nova.virt.disk.api [None req-e001d581-4e41-4e12-bf55-38cacdcc4983 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0a198493-7329-43ff-bceb-56b50529be29/disk. size=1073741824 {{(pid=74960) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 12:20:41 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-e001d581-4e41-4e12-bf55-38cacdcc4983 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a198493-7329-43ff-bceb-56b50529be29/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:20:41 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-0cd35881-646f-4206-a492-7b31d9a36392 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Releasing lock "refresh_cache-6145a30b-809c-4bc5-a45f-c3ff3b170a22" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:20:41 user nova-compute[74960]: DEBUG nova.compute.manager [None req-0cd35881-646f-4206-a492-7b31d9a36392 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] Instance network_info: |[{"id": "c54167dd-e416-43bd-8271-dd55e9e71119", "address": "fa:16:3e:33:a0:07", "network": {"id": "9c5fae09-5df5-45a3-b9cd-7ac3763ba878", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1736223258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5320673ee4f0422989a3708915375cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc54167dd-e4", "ovs_interfaceid": "c54167dd-e416-43bd-8271-dd55e9e71119", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74960) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 12:20:41 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-929a4752-9704-4285-8bb2-445e48615628 req-5b3b575e-8788-4094-848f-0c6dc1673d02 service nova] Acquired lock "refresh_cache-6145a30b-809c-4bc5-a45f-c3ff3b170a22" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:20:41 user nova-compute[74960]: DEBUG nova.network.neutron [req-929a4752-9704-4285-8bb2-445e48615628 req-5b3b575e-8788-4094-848f-0c6dc1673d02 service nova] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] Refreshing network info cache for port c54167dd-e416-43bd-8271-dd55e9e71119 {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 12:20:41 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-0cd35881-646f-4206-a492-7b31d9a36392 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] Start _get_guest_xml network_info=[{"id": "c54167dd-e416-43bd-8271-dd55e9e71119", "address": "fa:16:3e:33:a0:07", "network": {"id": "9c5fae09-5df5-45a3-b9cd-7ac3763ba878", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1736223258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5320673ee4f0422989a3708915375cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc54167dd-e4", "ovs_interfaceid": "c54167dd-e416-43bd-8271-dd55e9e71119", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=549f51ba-ac69-494b-8de1-34635aa2d7cf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='63ee9c80c632442fb0379f47b784bd20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T12:13:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'image_id': '549f51ba-ac69-494b-8de1-34635aa2d7cf'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 12:20:41 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-0cd35881-646f-4206-a492-7b31d9a36392 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:20:41 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-0cd35881-646f-4206-a492-7b31d9a36392 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:20:41 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-82dd5adb-9601-470f-873b-a28f3af0b0ef tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Acquiring lock "05956d9b-0646-43d2-a4cd-19e9090020ee" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:20:41 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-82dd5adb-9601-470f-873b-a28f3af0b0ef tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Lock "05956d9b-0646-43d2-a4cd-19e9090020ee" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:20:41 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-0cd35881-646f-4206-a492-7b31d9a36392 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 12:20:41 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-0cd35881-646f-4206-a492-7b31d9a36392 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] CPU controller missing on host. {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 12:20:41 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-0cd35881-646f-4206-a492-7b31d9a36392 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 12:20:41 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-0cd35881-646f-4206-a492-7b31d9a36392 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] CPU controller found on host. {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 12:20:41 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-0cd35881-646f-4206-a492-7b31d9a36392 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74960) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 12:20:41 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-0cd35881-646f-4206-a492-7b31d9a36392 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=549f51ba-ac69-494b-8de1-34635aa2d7cf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='63ee9c80c632442fb0379f47b784bd20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T12:13:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 12:20:41 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-0cd35881-646f-4206-a492-7b31d9a36392 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Flavor limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 12:20:41 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-0cd35881-646f-4206-a492-7b31d9a36392 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Image limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 12:20:41 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-0cd35881-646f-4206-a492-7b31d9a36392 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Flavor pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 12:20:41 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-0cd35881-646f-4206-a492-7b31d9a36392 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Image pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 12:20:41 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-0cd35881-646f-4206-a492-7b31d9a36392 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 12:20:41 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-0cd35881-646f-4206-a492-7b31d9a36392 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 12:20:41 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-0cd35881-646f-4206-a492-7b31d9a36392 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 12:20:41 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-0cd35881-646f-4206-a492-7b31d9a36392 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Got 1 possible topologies {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 12:20:41 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-0cd35881-646f-4206-a492-7b31d9a36392 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 12:20:41 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-0cd35881-646f-4206-a492-7b31d9a36392 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 12:20:41 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-0cd35881-646f-4206-a492-7b31d9a36392 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:20:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-526247537',display_name='tempest-tempest.common.compute-instance-526247537',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-526247537',id=12,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDW7yXqa7k+YlhNoUvM+ny045GZm/Yl6hgASx9MMjKwBHiETYCiHL5EomYdUyz7ar/PJwyKpWPD39wbyG7SmL8Cwl0e8vcQuc7g6iuGDa+Ent75sR68D8/uWXXpX0MFRBg==',key_name='tempest-keypair-1690418913',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5320673ee4f0422989a3708915375cdb',ramdisk_id='',reservation_id='r-0h3abybt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1651581249',owner_user_name='tempest-ServerActionsTestOtherA-1651581249-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:20:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60d8d224d7204ede84c09433a3d82d0f',uuid=6145a30b-809c-4bc5-a45f-c3ff3b170a22,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c54167dd-e416-43bd-8271-dd55e9e71119", "address": "fa:16:3e:33:a0:07", "network": {"id": "9c5fae09-5df5-45a3-b9cd-7ac3763ba878", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1736223258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5320673ee4f0422989a3708915375cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc54167dd-e4", "ovs_interfaceid": "c54167dd-e416-43bd-8271-dd55e9e71119", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74960) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 12:20:41 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-0cd35881-646f-4206-a492-7b31d9a36392 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Converting VIF {"id": "c54167dd-e416-43bd-8271-dd55e9e71119", "address": "fa:16:3e:33:a0:07", "network": {"id": "9c5fae09-5df5-45a3-b9cd-7ac3763ba878", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1736223258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5320673ee4f0422989a3708915375cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc54167dd-e4", "ovs_interfaceid": "c54167dd-e416-43bd-8271-dd55e9e71119", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:20:41 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-0cd35881-646f-4206-a492-7b31d9a36392 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:a0:07,bridge_name='br-int',has_traffic_filtering=True,id=c54167dd-e416-43bd-8271-dd55e9e71119,network=Network(9c5fae09-5df5-45a3-b9cd-7ac3763ba878),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc54167dd-e4') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:20:41 user nova-compute[74960]: DEBUG nova.objects.instance [None req-0cd35881-646f-4206-a492-7b31d9a36392 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Lazy-loading 'pci_devices' on Instance uuid 6145a30b-809c-4bc5-a45f-c3ff3b170a22 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:20:41 user nova-compute[74960]: DEBUG nova.objects.instance [None req-82dd5adb-9601-470f-873b-a28f3af0b0ef tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Lazy-loading 'flavor' on Instance uuid 05956d9b-0646-43d2-a4cd-19e9090020ee {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:20:41 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-0cd35881-646f-4206-a492-7b31d9a36392 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] End _get_guest_xml xml=<domain type="kvm">
Nov 03 12:20:41 user nova-compute[74960]:   <uuid>6145a30b-809c-4bc5-a45f-c3ff3b170a22</uuid>
Nov 03 12:20:41 user nova-compute[74960]:   <name>instance-0000000c</name>
Nov 03 12:20:41 user nova-compute[74960]:   <memory>524288</memory>
Nov 03 12:20:41 user nova-compute[74960]:   <vcpu>1</vcpu>
Nov 03 12:20:41 user nova-compute[74960]:   <metadata>
Nov 03 12:20:41 user nova-compute[74960]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 12:20:41 user nova-compute[74960]:       <nova:package version="0.0.0"/>
Nov 03 12:20:41 user nova-compute[74960]:       <nova:name>tempest-tempest.common.compute-instance-526247537</nova:name>
Nov 03 12:20:41 user nova-compute[74960]:       <nova:creationTime>2023-11-03 12:20:41</nova:creationTime>
Nov 03 12:20:41 user nova-compute[74960]:       <nova:flavor name="m1.tiny">
Nov 03 12:20:41 user nova-compute[74960]:         <nova:memory>512</nova:memory>
Nov 03 12:20:41 user nova-compute[74960]:         <nova:disk>1</nova:disk>
Nov 03 12:20:41 user nova-compute[74960]:         <nova:swap>0</nova:swap>
Nov 03 12:20:41 user nova-compute[74960]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 12:20:41 user nova-compute[74960]:         <nova:vcpus>1</nova:vcpus>
Nov 03 12:20:41 user nova-compute[74960]:       </nova:flavor>
Nov 03 12:20:41 user nova-compute[74960]:       <nova:owner>
Nov 03 12:20:41 user nova-compute[74960]:         <nova:user uuid="60d8d224d7204ede84c09433a3d82d0f">tempest-ServerActionsTestOtherA-1651581249-project-member</nova:user>
Nov 03 12:20:41 user nova-compute[74960]:         <nova:project uuid="5320673ee4f0422989a3708915375cdb">tempest-ServerActionsTestOtherA-1651581249</nova:project>
Nov 03 12:20:41 user nova-compute[74960]:       </nova:owner>
Nov 03 12:20:41 user nova-compute[74960]:       <nova:root type="image" uuid="549f51ba-ac69-494b-8de1-34635aa2d7cf"/>
Nov 03 12:20:41 user nova-compute[74960]:       <nova:ports>
Nov 03 12:20:41 user nova-compute[74960]:         <nova:port uuid="c54167dd-e416-43bd-8271-dd55e9e71119">
Nov 03 12:20:41 user nova-compute[74960]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 03 12:20:41 user nova-compute[74960]:         </nova:port>
Nov 03 12:20:41 user nova-compute[74960]:       </nova:ports>
Nov 03 12:20:41 user nova-compute[74960]:     </nova:instance>
Nov 03 12:20:41 user nova-compute[74960]:   </metadata>
Nov 03 12:20:41 user nova-compute[74960]:   <sysinfo type="smbios">
Nov 03 12:20:41 user nova-compute[74960]:     <system>
Nov 03 12:20:41 user nova-compute[74960]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 12:20:41 user nova-compute[74960]:       <entry name="product">OpenStack Nova</entry>
Nov 03 12:20:41 user nova-compute[74960]:       <entry name="version">0.0.0</entry>
Nov 03 12:20:41 user nova-compute[74960]:       <entry name="serial">6145a30b-809c-4bc5-a45f-c3ff3b170a22</entry>
Nov 03 12:20:41 user nova-compute[74960]:       <entry name="uuid">6145a30b-809c-4bc5-a45f-c3ff3b170a22</entry>
Nov 03 12:20:41 user nova-compute[74960]:       <entry name="family">Virtual Machine</entry>
Nov 03 12:20:41 user nova-compute[74960]:     </system>
Nov 03 12:20:41 user nova-compute[74960]:   </sysinfo>
Nov 03 12:20:41 user nova-compute[74960]:   <os>
Nov 03 12:20:41 user nova-compute[74960]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 12:20:41 user nova-compute[74960]:     <boot dev="hd"/>
Nov 03 12:20:41 user nova-compute[74960]:     <smbios mode="sysinfo"/>
Nov 03 12:20:41 user nova-compute[74960]:   </os>
Nov 03 12:20:41 user nova-compute[74960]:   <features>
Nov 03 12:20:41 user nova-compute[74960]:     <acpi/>
Nov 03 12:20:41 user nova-compute[74960]:     <apic/>
Nov 03 12:20:41 user nova-compute[74960]:     <vmcoreinfo/>
Nov 03 12:20:41 user nova-compute[74960]:   </features>
Nov 03 12:20:41 user nova-compute[74960]:   <clock offset="utc">
Nov 03 12:20:41 user nova-compute[74960]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 12:20:41 user nova-compute[74960]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 12:20:41 user nova-compute[74960]:     <timer name="hpet" present="no"/>
Nov 03 12:20:41 user nova-compute[74960]:   </clock>
Nov 03 12:20:41 user nova-compute[74960]:   <cpu mode="custom" match="exact">
Nov 03 12:20:41 user nova-compute[74960]:     <model>Nehalem</model>
Nov 03 12:20:41 user nova-compute[74960]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 12:20:41 user nova-compute[74960]:   </cpu>
Nov 03 12:20:41 user nova-compute[74960]:   <devices>
Nov 03 12:20:41 user nova-compute[74960]:     <disk type="file" device="disk">
Nov 03 12:20:41 user nova-compute[74960]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 12:20:41 user nova-compute[74960]:       <source file="/opt/stack/data/nova/instances/6145a30b-809c-4bc5-a45f-c3ff3b170a22/disk"/>
Nov 03 12:20:41 user nova-compute[74960]:       <target dev="vda" bus="virtio"/>
Nov 03 12:20:41 user nova-compute[74960]:     </disk>
Nov 03 12:20:41 user nova-compute[74960]:     <interface type="ethernet">
Nov 03 12:20:41 user nova-compute[74960]:       <mac address="fa:16:3e:33:a0:07"/>
Nov 03 12:20:41 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:20:41 user nova-compute[74960]:       <mtu size="1442"/>
Nov 03 12:20:41 user nova-compute[74960]:       <target dev="tapc54167dd-e4"/>
Nov 03 12:20:41 user nova-compute[74960]:     </interface>
Nov 03 12:20:41 user nova-compute[74960]:     <serial type="pty">
Nov 03 12:20:41 user nova-compute[74960]:       <log file="/opt/stack/data/nova/instances/6145a30b-809c-4bc5-a45f-c3ff3b170a22/console.log" append="off"/>
Nov 03 12:20:41 user nova-compute[74960]:     </serial>
Nov 03 12:20:41 user nova-compute[74960]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 12:20:41 user nova-compute[74960]:     <video>
Nov 03 12:20:41 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:20:41 user nova-compute[74960]:     </video>
Nov 03 12:20:41 user nova-compute[74960]:     <rng model="virtio">
Nov 03 12:20:41 user nova-compute[74960]:       <backend model="random">/dev/urandom</backend>
Nov 03 12:20:41 user nova-compute[74960]:     </rng>
Nov 03 12:20:41 user nova-compute[74960]:     <controller type="usb" index="0" model="none"/>
Nov 03 12:20:41 user nova-compute[74960]:     <memballoon model="virtio">
Nov 03 12:20:41 user nova-compute[74960]:       <stats period="10"/>
Nov 03 12:20:41 user nova-compute[74960]:     </memballoon>
Nov 03 12:20:41 user nova-compute[74960]:   </devices>
Nov 03 12:20:41 user nova-compute[74960]: </domain>
Nov 03 12:20:41 user nova-compute[74960]:  {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 12:20:41 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-0cd35881-646f-4206-a492-7b31d9a36392 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:20:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-526247537',display_name='tempest-tempest.common.compute-instance-526247537',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-526247537',id=12,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDW7yXqa7k+YlhNoUvM+ny045GZm/Yl6hgASx9MMjKwBHiETYCiHL5EomYdUyz7ar/PJwyKpWPD39wbyG7SmL8Cwl0e8vcQuc7g6iuGDa+Ent75sR68D8/uWXXpX0MFRBg==',key_name='tempest-keypair-1690418913',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5320673ee4f0422989a3708915375cdb',ramdisk_id='',reservation_id='r-0h3abybt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1651581249',owner_user_name='tempest-ServerActionsTestOtherA-1651581249-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:20:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60d8d224d7204ede84c09433a3d82d0f',uuid=6145a30b-809c-4bc5-a45f-c3ff3b170a22,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c54167dd-e416-43bd-8271-dd55e9e71119", "address": "fa:16:3e:33:a0:07", "network": {"id": "9c5fae09-5df5-45a3-b9cd-7ac3763ba878", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1736223258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5320673ee4f0422989a3708915375cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc54167dd-e4", "ovs_interfaceid": "c54167dd-e416-43bd-8271-dd55e9e71119", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 12:20:41 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-0cd35881-646f-4206-a492-7b31d9a36392 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Converting VIF {"id": "c54167dd-e416-43bd-8271-dd55e9e71119", "address": "fa:16:3e:33:a0:07", "network": {"id": "9c5fae09-5df5-45a3-b9cd-7ac3763ba878", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1736223258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5320673ee4f0422989a3708915375cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc54167dd-e4", "ovs_interfaceid": "c54167dd-e416-43bd-8271-dd55e9e71119", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:20:41 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-0cd35881-646f-4206-a492-7b31d9a36392 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:a0:07,bridge_name='br-int',has_traffic_filtering=True,id=c54167dd-e416-43bd-8271-dd55e9e71119,network=Network(9c5fae09-5df5-45a3-b9cd-7ac3763ba878),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc54167dd-e4') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:20:41 user nova-compute[74960]: DEBUG os_vif [None req-0cd35881-646f-4206-a492-7b31d9a36392 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:a0:07,bridge_name='br-int',has_traffic_filtering=True,id=c54167dd-e416-43bd-8271-dd55e9e71119,network=Network(9c5fae09-5df5-45a3-b9cd-7ac3763ba878),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc54167dd-e4') {{(pid=74960) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 12:20:41 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:20:41 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:20:41 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 12:20:41 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:20:41 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'aea1f4a3-cabe-5720-8e23-f6b3231c4f8c', '_type': 'linux-noop'}}, row=False) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:20:41 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:20:41 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:20:41 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:20:41 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc54167dd-e4, may_exist=True, interface_attrs={}) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:20:41 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc54167dd-e4, col_values=(('qos', UUID('31dc3f13-0216-4526-ad39-4ade113c9248')),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:20:41 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc54167dd-e4, col_values=(('external_ids', {'iface-id': 'c54167dd-e416-43bd-8271-dd55e9e71119', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:33:a0:07', 'vm-uuid': '6145a30b-809c-4bc5-a45f-c3ff3b170a22'}),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:20:41 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:20:41 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-82dd5adb-9601-470f-873b-a28f3af0b0ef tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Lock "05956d9b-0646-43d2-a4cd-19e9090020ee" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.110s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:20:41 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-e001d581-4e41-4e12-bf55-38cacdcc4983 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a198493-7329-43ff-bceb-56b50529be29/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:20:41 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:20:41 user nova-compute[74960]: DEBUG nova.virt.disk.api [None req-e001d581-4e41-4e12-bf55-38cacdcc4983 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Cannot resize image /opt/stack/data/nova/instances/0a198493-7329-43ff-bceb-56b50529be29/disk to a smaller size. {{(pid=74960) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 12:20:41 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-e001d581-4e41-4e12-bf55-38cacdcc4983 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] [instance: 0a198493-7329-43ff-bceb-56b50529be29] Created local disks {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 12:20:41 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-e001d581-4e41-4e12-bf55-38cacdcc4983 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] [instance: 0a198493-7329-43ff-bceb-56b50529be29] Ensure instance console log exists: /opt/stack/data/nova/instances/0a198493-7329-43ff-bceb-56b50529be29/console.log {{(pid=74960) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 12:20:41 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-e001d581-4e41-4e12-bf55-38cacdcc4983 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:20:41 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-e001d581-4e41-4e12-bf55-38cacdcc4983 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:20:41 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-e001d581-4e41-4e12-bf55-38cacdcc4983 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:20:41 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:20:41 user nova-compute[74960]: INFO os_vif [None req-0cd35881-646f-4206-a492-7b31d9a36392 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:a0:07,bridge_name='br-int',has_traffic_filtering=True,id=c54167dd-e416-43bd-8271-dd55e9e71119,network=Network(9c5fae09-5df5-45a3-b9cd-7ac3763ba878),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc54167dd-e4')
Nov 03 12:20:41 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-0cd35881-646f-4206-a492-7b31d9a36392 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] No BDM found with device name vda, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:20:41 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-0cd35881-646f-4206-a492-7b31d9a36392 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] No VIF found with MAC fa:16:3e:33:a0:07, not building metadata {{(pid=74960) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 12:20:41 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-82dd5adb-9601-470f-873b-a28f3af0b0ef tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Acquiring lock "05956d9b-0646-43d2-a4cd-19e9090020ee" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:20:41 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-82dd5adb-9601-470f-873b-a28f3af0b0ef tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Lock "05956d9b-0646-43d2-a4cd-19e9090020ee" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:20:41 user nova-compute[74960]: INFO nova.compute.manager [None req-82dd5adb-9601-470f-873b-a28f3af0b0ef tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] Attaching volume 1bcf17d9-fd5c-4707-9091-a767c871bc02 to /dev/vdb
Nov 03 12:20:41 user nova-compute[74960]: DEBUG nova.network.neutron [None req-e001d581-4e41-4e12-bf55-38cacdcc4983 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] [instance: 0a198493-7329-43ff-bceb-56b50529be29] Successfully created port: e6755218-8c73-4191-a259-8f1f936838e8 {{(pid=74960) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 12:20:41 user nova-compute[74960]: DEBUG os_brick.utils [None req-82dd5adb-9601-470f-873b-a28f3af0b0ef tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:20:41 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:20:41 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:20:41 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[026ce563-1855-49b4-aa2f-daf9a1e0b3d6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:75b8e219756\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:20:41 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:20:41 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:20:41 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[b46d864f-863b-4d21-8998-51b781bfe667]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:20:41 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:20:41 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:20:41 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c963e63-7207-4a95-88e3-f4b1c8d5a2f4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:20:41 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[13149c00-5350-41fc-85e7-91715ab98980]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:20:41 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-82dd5adb-9601-470f-873b-a28f3af0b0ef tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Running cmd (subprocess): nvme version {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:20:41 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-82dd5adb-9601-470f-873b-a28f3af0b0ef tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] 'nvme version' failed. Not Retrying. {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 12:20:41 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.nvmeof [None req-82dd5adb-9601-470f-873b-a28f3af0b0ef tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] nvme not present on system {{(pid=74960) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 12:20:41 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:20:41 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 12:20:41 user nova-compute[74960]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 12:20:41 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[055ae6f3-8fc2-4921-ac2c-771235919b63]: (4, '') {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:20:41 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-82dd5adb-9601-470f-873b-a28f3af0b0ef tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74960) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 12:20:41 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-82dd5adb-9601-470f-873b-a28f3af0b0ef tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74960) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 12:20:41 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-82dd5adb-9601-470f-873b-a28f3af0b0ef tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] LIGHTOS: no hostnqn found. {{(pid=74960) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 12:20:41 user nova-compute[74960]: DEBUG os_brick.utils [None req-82dd5adb-9601-470f-873b-a28f3af0b0ef tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:75b8e219756', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:20:41 user nova-compute[74960]: DEBUG nova.virt.block_device [None req-82dd5adb-9601-470f-873b-a28f3af0b0ef tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] Updating existing volume attachment record: 42f43925-61b8-44f2-93f6-31969ac2a314 {{(pid=74960) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 12:20:41 user nova-compute[74960]: DEBUG nova.network.neutron [req-929a4752-9704-4285-8bb2-445e48615628 req-5b3b575e-8788-4094-848f-0c6dc1673d02 service nova] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] Updated VIF entry in instance network info cache for port c54167dd-e416-43bd-8271-dd55e9e71119. {{(pid=74960) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 12:20:41 user nova-compute[74960]: DEBUG nova.network.neutron [req-929a4752-9704-4285-8bb2-445e48615628 req-5b3b575e-8788-4094-848f-0c6dc1673d02 service nova] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] Updating instance_info_cache with network_info: [{"id": "c54167dd-e416-43bd-8271-dd55e9e71119", "address": "fa:16:3e:33:a0:07", "network": {"id": "9c5fae09-5df5-45a3-b9cd-7ac3763ba878", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1736223258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5320673ee4f0422989a3708915375cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc54167dd-e4", "ovs_interfaceid": "c54167dd-e416-43bd-8271-dd55e9e71119", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:20:41 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-929a4752-9704-4285-8bb2-445e48615628 req-5b3b575e-8788-4094-848f-0c6dc1673d02 service nova] Releasing lock "refresh_cache-6145a30b-809c-4bc5-a45f-c3ff3b170a22" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:20:41 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:20:41 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:20:41 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:20:41 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:20:41 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:20:42 user nova-compute[74960]: DEBUG nova.network.neutron [None req-e001d581-4e41-4e12-bf55-38cacdcc4983 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] [instance: 0a198493-7329-43ff-bceb-56b50529be29] Successfully updated port: e6755218-8c73-4191-a259-8f1f936838e8 {{(pid=74960) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 12:20:42 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-e001d581-4e41-4e12-bf55-38cacdcc4983 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Acquiring lock "refresh_cache-0a198493-7329-43ff-bceb-56b50529be29" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:20:42 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-e001d581-4e41-4e12-bf55-38cacdcc4983 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Acquired lock "refresh_cache-0a198493-7329-43ff-bceb-56b50529be29" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:20:42 user nova-compute[74960]: DEBUG nova.network.neutron [None req-e001d581-4e41-4e12-bf55-38cacdcc4983 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] [instance: 0a198493-7329-43ff-bceb-56b50529be29] Building network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 12:20:42 user nova-compute[74960]: DEBUG nova.compute.manager [req-754ba31a-400f-414a-8c8c-8c92440885a4 req-f5359264-5ecd-40b4-947e-ac5626c7bae7 service nova] [instance: 0a198493-7329-43ff-bceb-56b50529be29] Received event network-changed-e6755218-8c73-4191-a259-8f1f936838e8 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:20:42 user nova-compute[74960]: DEBUG nova.compute.manager [req-754ba31a-400f-414a-8c8c-8c92440885a4 req-f5359264-5ecd-40b4-947e-ac5626c7bae7 service nova] [instance: 0a198493-7329-43ff-bceb-56b50529be29] Refreshing instance network info cache due to event network-changed-e6755218-8c73-4191-a259-8f1f936838e8. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 12:20:42 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-754ba31a-400f-414a-8c8c-8c92440885a4 req-f5359264-5ecd-40b4-947e-ac5626c7bae7 service nova] Acquiring lock "refresh_cache-0a198493-7329-43ff-bceb-56b50529be29" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:20:42 user nova-compute[74960]: DEBUG nova.network.neutron [None req-e001d581-4e41-4e12-bf55-38cacdcc4983 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] [instance: 0a198493-7329-43ff-bceb-56b50529be29] Instance cache missing network info. {{(pid=74960) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 12:20:42 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:20:42 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:20:42 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:20:42 user nova-compute[74960]: DEBUG nova.network.neutron [None req-e001d581-4e41-4e12-bf55-38cacdcc4983 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] [instance: 0a198493-7329-43ff-bceb-56b50529be29] Updating instance_info_cache with network_info: [{"id": "e6755218-8c73-4191-a259-8f1f936838e8", "address": "fa:16:3e:44:8d:5e", "network": {"id": "9f0b1c9c-af46-4948-aeb8-e73013159ad4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2126041996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "58667b53361b490fa7f0236ee65934c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6755218-8c", "ovs_interfaceid": "e6755218-8c73-4191-a259-8f1f936838e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:20:42 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-e001d581-4e41-4e12-bf55-38cacdcc4983 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Releasing lock "refresh_cache-0a198493-7329-43ff-bceb-56b50529be29" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:20:42 user nova-compute[74960]: DEBUG nova.compute.manager [None req-e001d581-4e41-4e12-bf55-38cacdcc4983 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] [instance: 0a198493-7329-43ff-bceb-56b50529be29] Instance network_info: |[{"id": "e6755218-8c73-4191-a259-8f1f936838e8", "address": "fa:16:3e:44:8d:5e", "network": {"id": "9f0b1c9c-af46-4948-aeb8-e73013159ad4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2126041996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "58667b53361b490fa7f0236ee65934c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6755218-8c", "ovs_interfaceid": "e6755218-8c73-4191-a259-8f1f936838e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74960) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 12:20:42 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-754ba31a-400f-414a-8c8c-8c92440885a4 req-f5359264-5ecd-40b4-947e-ac5626c7bae7 service nova] Acquired lock "refresh_cache-0a198493-7329-43ff-bceb-56b50529be29" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:20:42 user nova-compute[74960]: DEBUG nova.network.neutron [req-754ba31a-400f-414a-8c8c-8c92440885a4 req-f5359264-5ecd-40b4-947e-ac5626c7bae7 service nova] [instance: 0a198493-7329-43ff-bceb-56b50529be29] Refreshing network info cache for port e6755218-8c73-4191-a259-8f1f936838e8 {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 12:20:42 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-e001d581-4e41-4e12-bf55-38cacdcc4983 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] [instance: 0a198493-7329-43ff-bceb-56b50529be29] Start _get_guest_xml network_info=[{"id": "e6755218-8c73-4191-a259-8f1f936838e8", "address": "fa:16:3e:44:8d:5e", "network": {"id": "9f0b1c9c-af46-4948-aeb8-e73013159ad4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2126041996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "58667b53361b490fa7f0236ee65934c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6755218-8c", "ovs_interfaceid": "e6755218-8c73-4191-a259-8f1f936838e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=549f51ba-ac69-494b-8de1-34635aa2d7cf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='63ee9c80c632442fb0379f47b784bd20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T12:13:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'image_id': '549f51ba-ac69-494b-8de1-34635aa2d7cf'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 12:20:42 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-e001d581-4e41-4e12-bf55-38cacdcc4983 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:20:42 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-e001d581-4e41-4e12-bf55-38cacdcc4983 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:20:42 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-e001d581-4e41-4e12-bf55-38cacdcc4983 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 12:20:42 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-e001d581-4e41-4e12-bf55-38cacdcc4983 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] CPU controller missing on host. {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 12:20:42 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-e001d581-4e41-4e12-bf55-38cacdcc4983 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 12:20:42 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-e001d581-4e41-4e12-bf55-38cacdcc4983 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] CPU controller found on host. {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 12:20:42 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-e001d581-4e41-4e12-bf55-38cacdcc4983 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74960) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 12:20:42 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-e001d581-4e41-4e12-bf55-38cacdcc4983 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=549f51ba-ac69-494b-8de1-34635aa2d7cf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='63ee9c80c632442fb0379f47b784bd20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T12:13:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 12:20:42 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-e001d581-4e41-4e12-bf55-38cacdcc4983 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Flavor limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 12:20:42 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-e001d581-4e41-4e12-bf55-38cacdcc4983 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Image limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 12:20:42 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-e001d581-4e41-4e12-bf55-38cacdcc4983 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Flavor pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 12:20:42 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-e001d581-4e41-4e12-bf55-38cacdcc4983 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Image pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 12:20:42 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-e001d581-4e41-4e12-bf55-38cacdcc4983 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 12:20:42 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-e001d581-4e41-4e12-bf55-38cacdcc4983 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 12:20:42 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-e001d581-4e41-4e12-bf55-38cacdcc4983 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 12:20:42 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-e001d581-4e41-4e12-bf55-38cacdcc4983 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Got 1 possible topologies {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 12:20:42 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-e001d581-4e41-4e12-bf55-38cacdcc4983 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 12:20:42 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-e001d581-4e41-4e12-bf55-38cacdcc4983 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 12:20:42 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-e001d581-4e41-4e12-bf55-38cacdcc4983 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:20:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-378321332',display_name='tempest-VolumesAdminNegativeTest-server-378321332',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-378321332',id=13,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='58667b53361b490fa7f0236ee65934c5',ramdisk_id='',reservation_id='r-tabk0ijq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1697926693',owner_user_name='tempest-VolumesAdminNegativeTest-1697926693-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:20:40Z,user_data=None,user_id='26930c47348248f681093b8e74e8c73c',uuid=0a198493-7329-43ff-bceb-56b50529be29,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e6755218-8c73-4191-a259-8f1f936838e8", "address": "fa:16:3e:44:8d:5e", "network": {"id": "9f0b1c9c-af46-4948-aeb8-e73013159ad4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2126041996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "58667b53361b490fa7f0236ee65934c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6755218-8c", "ovs_interfaceid": "e6755218-8c73-4191-a259-8f1f936838e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74960) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 12:20:42 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-e001d581-4e41-4e12-bf55-38cacdcc4983 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Converting VIF {"id": "e6755218-8c73-4191-a259-8f1f936838e8", "address": "fa:16:3e:44:8d:5e", "network": {"id": "9f0b1c9c-af46-4948-aeb8-e73013159ad4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2126041996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "58667b53361b490fa7f0236ee65934c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6755218-8c", "ovs_interfaceid": "e6755218-8c73-4191-a259-8f1f936838e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:20:42 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-e001d581-4e41-4e12-bf55-38cacdcc4983 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:8d:5e,bridge_name='br-int',has_traffic_filtering=True,id=e6755218-8c73-4191-a259-8f1f936838e8,network=Network(9f0b1c9c-af46-4948-aeb8-e73013159ad4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6755218-8c') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:20:42 user nova-compute[74960]: DEBUG nova.objects.instance [None req-e001d581-4e41-4e12-bf55-38cacdcc4983 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Lazy-loading 'pci_devices' on Instance uuid 0a198493-7329-43ff-bceb-56b50529be29 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:20:42 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:20:42 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-e001d581-4e41-4e12-bf55-38cacdcc4983 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] [instance: 0a198493-7329-43ff-bceb-56b50529be29] End _get_guest_xml xml=<domain type="kvm">
Nov 03 12:20:42 user nova-compute[74960]:   <uuid>0a198493-7329-43ff-bceb-56b50529be29</uuid>
Nov 03 12:20:42 user nova-compute[74960]:   <name>instance-0000000d</name>
Nov 03 12:20:42 user nova-compute[74960]:   <memory>524288</memory>
Nov 03 12:20:42 user nova-compute[74960]:   <vcpu>1</vcpu>
Nov 03 12:20:42 user nova-compute[74960]:   <metadata>
Nov 03 12:20:42 user nova-compute[74960]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 12:20:42 user nova-compute[74960]:       <nova:package version="0.0.0"/>
Nov 03 12:20:42 user nova-compute[74960]:       <nova:name>tempest-VolumesAdminNegativeTest-server-378321332</nova:name>
Nov 03 12:20:42 user nova-compute[74960]:       <nova:creationTime>2023-11-03 12:20:42</nova:creationTime>
Nov 03 12:20:42 user nova-compute[74960]:       <nova:flavor name="m1.tiny">
Nov 03 12:20:42 user nova-compute[74960]:         <nova:memory>512</nova:memory>
Nov 03 12:20:42 user nova-compute[74960]:         <nova:disk>1</nova:disk>
Nov 03 12:20:42 user nova-compute[74960]:         <nova:swap>0</nova:swap>
Nov 03 12:20:42 user nova-compute[74960]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 12:20:42 user nova-compute[74960]:         <nova:vcpus>1</nova:vcpus>
Nov 03 12:20:42 user nova-compute[74960]:       </nova:flavor>
Nov 03 12:20:42 user nova-compute[74960]:       <nova:owner>
Nov 03 12:20:42 user nova-compute[74960]:         <nova:user uuid="26930c47348248f681093b8e74e8c73c">tempest-VolumesAdminNegativeTest-1697926693-project-member</nova:user>
Nov 03 12:20:42 user nova-compute[74960]:         <nova:project uuid="58667b53361b490fa7f0236ee65934c5">tempest-VolumesAdminNegativeTest-1697926693</nova:project>
Nov 03 12:20:42 user nova-compute[74960]:       </nova:owner>
Nov 03 12:20:42 user nova-compute[74960]:       <nova:root type="image" uuid="549f51ba-ac69-494b-8de1-34635aa2d7cf"/>
Nov 03 12:20:42 user nova-compute[74960]:       <nova:ports>
Nov 03 12:20:42 user nova-compute[74960]:         <nova:port uuid="e6755218-8c73-4191-a259-8f1f936838e8">
Nov 03 12:20:42 user nova-compute[74960]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 03 12:20:42 user nova-compute[74960]:         </nova:port>
Nov 03 12:20:42 user nova-compute[74960]:       </nova:ports>
Nov 03 12:20:42 user nova-compute[74960]:     </nova:instance>
Nov 03 12:20:42 user nova-compute[74960]:   </metadata>
Nov 03 12:20:42 user nova-compute[74960]:   <sysinfo type="smbios">
Nov 03 12:20:42 user nova-compute[74960]:     <system>
Nov 03 12:20:42 user nova-compute[74960]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 12:20:42 user nova-compute[74960]:       <entry name="product">OpenStack Nova</entry>
Nov 03 12:20:42 user nova-compute[74960]:       <entry name="version">0.0.0</entry>
Nov 03 12:20:42 user nova-compute[74960]:       <entry name="serial">0a198493-7329-43ff-bceb-56b50529be29</entry>
Nov 03 12:20:42 user nova-compute[74960]:       <entry name="uuid">0a198493-7329-43ff-bceb-56b50529be29</entry>
Nov 03 12:20:42 user nova-compute[74960]:       <entry name="family">Virtual Machine</entry>
Nov 03 12:20:42 user nova-compute[74960]:     </system>
Nov 03 12:20:42 user nova-compute[74960]:   </sysinfo>
Nov 03 12:20:42 user nova-compute[74960]:   <os>
Nov 03 12:20:42 user nova-compute[74960]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 12:20:42 user nova-compute[74960]:     <boot dev="hd"/>
Nov 03 12:20:42 user nova-compute[74960]:     <smbios mode="sysinfo"/>
Nov 03 12:20:42 user nova-compute[74960]:   </os>
Nov 03 12:20:42 user nova-compute[74960]:   <features>
Nov 03 12:20:42 user nova-compute[74960]:     <acpi/>
Nov 03 12:20:42 user nova-compute[74960]:     <apic/>
Nov 03 12:20:42 user nova-compute[74960]:     <vmcoreinfo/>
Nov 03 12:20:42 user nova-compute[74960]:   </features>
Nov 03 12:20:42 user nova-compute[74960]:   <clock offset="utc">
Nov 03 12:20:42 user nova-compute[74960]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 12:20:42 user nova-compute[74960]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 12:20:42 user nova-compute[74960]:     <timer name="hpet" present="no"/>
Nov 03 12:20:42 user nova-compute[74960]:   </clock>
Nov 03 12:20:42 user nova-compute[74960]:   <cpu mode="custom" match="exact">
Nov 03 12:20:42 user nova-compute[74960]:     <model>Nehalem</model>
Nov 03 12:20:42 user nova-compute[74960]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 12:20:42 user nova-compute[74960]:   </cpu>
Nov 03 12:20:42 user nova-compute[74960]:   <devices>
Nov 03 12:20:42 user nova-compute[74960]:     <disk type="file" device="disk">
Nov 03 12:20:42 user nova-compute[74960]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 12:20:42 user nova-compute[74960]:       <source file="/opt/stack/data/nova/instances/0a198493-7329-43ff-bceb-56b50529be29/disk"/>
Nov 03 12:20:42 user nova-compute[74960]:       <target dev="vda" bus="virtio"/>
Nov 03 12:20:42 user nova-compute[74960]:     </disk>
Nov 03 12:20:42 user nova-compute[74960]:     <interface type="ethernet">
Nov 03 12:20:42 user nova-compute[74960]:       <mac address="fa:16:3e:44:8d:5e"/>
Nov 03 12:20:42 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:20:42 user nova-compute[74960]:       <mtu size="1442"/>
Nov 03 12:20:42 user nova-compute[74960]:       <target dev="tape6755218-8c"/>
Nov 03 12:20:42 user nova-compute[74960]:     </interface>
Nov 03 12:20:42 user nova-compute[74960]:     <serial type="pty">
Nov 03 12:20:42 user nova-compute[74960]:       <log file="/opt/stack/data/nova/instances/0a198493-7329-43ff-bceb-56b50529be29/console.log" append="off"/>
Nov 03 12:20:42 user nova-compute[74960]:     </serial>
Nov 03 12:20:42 user nova-compute[74960]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 12:20:42 user nova-compute[74960]:     <video>
Nov 03 12:20:42 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:20:42 user nova-compute[74960]:     </video>
Nov 03 12:20:42 user nova-compute[74960]:     <rng model="virtio">
Nov 03 12:20:42 user nova-compute[74960]:       <backend model="random">/dev/urandom</backend>
Nov 03 12:20:42 user nova-compute[74960]:     </rng>
Nov 03 12:20:42 user nova-compute[74960]:     <controller type="usb" index="0" model="none"/>
Nov 03 12:20:42 user nova-compute[74960]:     <memballoon model="virtio">
Nov 03 12:20:42 user nova-compute[74960]:       <stats period="10"/>
Nov 03 12:20:42 user nova-compute[74960]:     </memballoon>
Nov 03 12:20:42 user nova-compute[74960]:   </devices>
Nov 03 12:20:42 user nova-compute[74960]: </domain>
Nov 03 12:20:42 user nova-compute[74960]:  {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 12:20:42 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-e001d581-4e41-4e12-bf55-38cacdcc4983 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:20:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-378321332',display_name='tempest-VolumesAdminNegativeTest-server-378321332',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-378321332',id=13,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='58667b53361b490fa7f0236ee65934c5',ramdisk_id='',reservation_id='r-tabk0ijq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1697926693',owner_user_name='tempest-VolumesAdminNegativeTest-1697926693-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:20:40Z,user_data=None,user_id='26930c47348248f681093b8e74e8c73c',uuid=0a198493-7329-43ff-bceb-56b50529be29,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e6755218-8c73-4191-a259-8f1f936838e8", "address": "fa:16:3e:44:8d:5e", "network": {"id": "9f0b1c9c-af46-4948-aeb8-e73013159ad4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2126041996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "58667b53361b490fa7f0236ee65934c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6755218-8c", "ovs_interfaceid": "e6755218-8c73-4191-a259-8f1f936838e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 12:20:42 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-e001d581-4e41-4e12-bf55-38cacdcc4983 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Converting VIF {"id": "e6755218-8c73-4191-a259-8f1f936838e8", "address": "fa:16:3e:44:8d:5e", "network": {"id": "9f0b1c9c-af46-4948-aeb8-e73013159ad4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2126041996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "58667b53361b490fa7f0236ee65934c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6755218-8c", "ovs_interfaceid": "e6755218-8c73-4191-a259-8f1f936838e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:20:42 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-e001d581-4e41-4e12-bf55-38cacdcc4983 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:8d:5e,bridge_name='br-int',has_traffic_filtering=True,id=e6755218-8c73-4191-a259-8f1f936838e8,network=Network(9f0b1c9c-af46-4948-aeb8-e73013159ad4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6755218-8c') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:20:42 user nova-compute[74960]: DEBUG os_vif [None req-e001d581-4e41-4e12-bf55-38cacdcc4983 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:8d:5e,bridge_name='br-int',has_traffic_filtering=True,id=e6755218-8c73-4191-a259-8f1f936838e8,network=Network(9f0b1c9c-af46-4948-aeb8-e73013159ad4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6755218-8c') {{(pid=74960) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 12:20:42 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:20:42 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:20:42 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 12:20:42 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:20:42 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '29966ee7-e8c5-5b14-8555-6216d1ad18bc', '_type': 'linux-noop'}}, row=False) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:20:42 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:20:42 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:20:43 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:20:43 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape6755218-8c, may_exist=True, interface_attrs={}) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:20:43 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape6755218-8c, col_values=(('qos', UUID('dbade2eb-1028-4d50-a2e8-bf28f3da2fb9')),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:20:43 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape6755218-8c, col_values=(('external_ids', {'iface-id': 'e6755218-8c73-4191-a259-8f1f936838e8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:44:8d:5e', 'vm-uuid': '0a198493-7329-43ff-bceb-56b50529be29'}),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:20:43 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:20:43 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:20:43 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:20:43 user nova-compute[74960]: INFO os_vif [None req-e001d581-4e41-4e12-bf55-38cacdcc4983 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:8d:5e,bridge_name='br-int',has_traffic_filtering=True,id=e6755218-8c73-4191-a259-8f1f936838e8,network=Network(9f0b1c9c-af46-4948-aeb8-e73013159ad4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6755218-8c')
Nov 03 12:20:43 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-e001d581-4e41-4e12-bf55-38cacdcc4983 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] No BDM found with device name vda, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:20:43 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-e001d581-4e41-4e12-bf55-38cacdcc4983 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] No VIF found with MAC fa:16:3e:44:8d:5e, not building metadata {{(pid=74960) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 12:20:43 user nova-compute[74960]: DEBUG nova.compute.manager [req-444afbe7-522a-4e26-aed9-dbd6ae4d7361 req-9b7c61c5-1abf-48c0-9b8a-bba1f6f7caff service nova] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] Received event network-vif-plugged-c54167dd-e416-43bd-8271-dd55e9e71119 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:20:43 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-444afbe7-522a-4e26-aed9-dbd6ae4d7361 req-9b7c61c5-1abf-48c0-9b8a-bba1f6f7caff service nova] Acquiring lock "6145a30b-809c-4bc5-a45f-c3ff3b170a22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:20:43 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-444afbe7-522a-4e26-aed9-dbd6ae4d7361 req-9b7c61c5-1abf-48c0-9b8a-bba1f6f7caff service nova] Lock "6145a30b-809c-4bc5-a45f-c3ff3b170a22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:20:43 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-444afbe7-522a-4e26-aed9-dbd6ae4d7361 req-9b7c61c5-1abf-48c0-9b8a-bba1f6f7caff service nova] Lock "6145a30b-809c-4bc5-a45f-c3ff3b170a22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:20:43 user nova-compute[74960]: DEBUG nova.compute.manager [req-444afbe7-522a-4e26-aed9-dbd6ae4d7361 req-9b7c61c5-1abf-48c0-9b8a-bba1f6f7caff service nova] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] No waiting events found dispatching network-vif-plugged-c54167dd-e416-43bd-8271-dd55e9e71119 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:20:43 user nova-compute[74960]: WARNING nova.compute.manager [req-444afbe7-522a-4e26-aed9-dbd6ae4d7361 req-9b7c61c5-1abf-48c0-9b8a-bba1f6f7caff service nova] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] Received unexpected event network-vif-plugged-c54167dd-e416-43bd-8271-dd55e9e71119 for instance with vm_state building and task_state spawning.
Nov 03 12:20:43 user nova-compute[74960]: DEBUG nova.network.neutron [req-754ba31a-400f-414a-8c8c-8c92440885a4 req-f5359264-5ecd-40b4-947e-ac5626c7bae7 service nova] [instance: 0a198493-7329-43ff-bceb-56b50529be29] Updated VIF entry in instance network info cache for port e6755218-8c73-4191-a259-8f1f936838e8. {{(pid=74960) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 12:20:43 user nova-compute[74960]: DEBUG nova.network.neutron [req-754ba31a-400f-414a-8c8c-8c92440885a4 req-f5359264-5ecd-40b4-947e-ac5626c7bae7 service nova] [instance: 0a198493-7329-43ff-bceb-56b50529be29] Updating instance_info_cache with network_info: [{"id": "e6755218-8c73-4191-a259-8f1f936838e8", "address": "fa:16:3e:44:8d:5e", "network": {"id": "9f0b1c9c-af46-4948-aeb8-e73013159ad4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2126041996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "58667b53361b490fa7f0236ee65934c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6755218-8c", "ovs_interfaceid": "e6755218-8c73-4191-a259-8f1f936838e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:20:43 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:20:43 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Starting heal instance info cache {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 12:20:43 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-754ba31a-400f-414a-8c8c-8c92440885a4 req-f5359264-5ecd-40b4-947e-ac5626c7bae7 service nova] Releasing lock "refresh_cache-0a198493-7329-43ff-bceb-56b50529be29" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:20:43 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "refresh_cache-e91dfcf4-caef-43d0-a56b-b1282363d4e0" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:20:43 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquired lock "refresh_cache-e91dfcf4-caef-43d0-a56b-b1282363d4e0" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:20:43 user nova-compute[74960]: DEBUG nova.network.neutron [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: e91dfcf4-caef-43d0-a56b-b1282363d4e0] Forcefully refreshing network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 12:20:44 user nova-compute[74960]: DEBUG nova.network.neutron [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: e91dfcf4-caef-43d0-a56b-b1282363d4e0] Updating instance_info_cache with network_info: [{"id": "ce7c2b72-12cb-4251-b6ac-f2f6724a509a", "address": "fa:16:3e:ef:a8:ac", "network": {"id": "9f0b1c9c-af46-4948-aeb8-e73013159ad4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2126041996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "58667b53361b490fa7f0236ee65934c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce7c2b72-12", "ovs_interfaceid": "ce7c2b72-12cb-4251-b6ac-f2f6724a509a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:20:44 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Releasing lock "refresh_cache-e91dfcf4-caef-43d0-a56b-b1282363d4e0" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:20:44 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: e91dfcf4-caef-43d0-a56b-b1282363d4e0] Updated the network info_cache for instance {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 12:20:44 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:20:44 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:20:44 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:20:44 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:20:44 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Auditing locally available compute resources for user (node: user) {{(pid=74960) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 12:20:44 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:20:44 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:20:44 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:20:45 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:20:45 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:20:45 user nova-compute[74960]: DEBUG nova.compute.manager [req-9e4e741a-2b22-4c15-b3fb-7bf8ae1ecc03 req-2f16be06-5682-4550-98d0-5db08738712c service nova] [instance: 0a198493-7329-43ff-bceb-56b50529be29] Received event network-vif-plugged-e6755218-8c73-4191-a259-8f1f936838e8 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:20:45 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-9e4e741a-2b22-4c15-b3fb-7bf8ae1ecc03 req-2f16be06-5682-4550-98d0-5db08738712c service nova] Acquiring lock "0a198493-7329-43ff-bceb-56b50529be29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:20:45 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-9e4e741a-2b22-4c15-b3fb-7bf8ae1ecc03 req-2f16be06-5682-4550-98d0-5db08738712c service nova] Lock "0a198493-7329-43ff-bceb-56b50529be29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:20:45 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-9e4e741a-2b22-4c15-b3fb-7bf8ae1ecc03 req-2f16be06-5682-4550-98d0-5db08738712c service nova] Lock "0a198493-7329-43ff-bceb-56b50529be29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:20:45 user nova-compute[74960]: DEBUG nova.compute.manager [req-9e4e741a-2b22-4c15-b3fb-7bf8ae1ecc03 req-2f16be06-5682-4550-98d0-5db08738712c service nova] [instance: 0a198493-7329-43ff-bceb-56b50529be29] No waiting events found dispatching network-vif-plugged-e6755218-8c73-4191-a259-8f1f936838e8 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:20:45 user nova-compute[74960]: WARNING nova.compute.manager [req-9e4e741a-2b22-4c15-b3fb-7bf8ae1ecc03 req-2f16be06-5682-4550-98d0-5db08738712c service nova] [instance: 0a198493-7329-43ff-bceb-56b50529be29] Received unexpected event network-vif-plugged-e6755218-8c73-4191-a259-8f1f936838e8 for instance with vm_state building and task_state spawning.
Nov 03 12:20:45 user nova-compute[74960]: DEBUG nova.compute.manager [req-e1efca59-dc63-49a0-994c-fbcb9a4d5ac9 req-39fd0254-500f-4992-83a0-5da47d1692a3 service nova] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] Received event network-vif-plugged-c54167dd-e416-43bd-8271-dd55e9e71119 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:20:45 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-e1efca59-dc63-49a0-994c-fbcb9a4d5ac9 req-39fd0254-500f-4992-83a0-5da47d1692a3 service nova] Acquiring lock "6145a30b-809c-4bc5-a45f-c3ff3b170a22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:20:45 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-e1efca59-dc63-49a0-994c-fbcb9a4d5ac9 req-39fd0254-500f-4992-83a0-5da47d1692a3 service nova] Lock "6145a30b-809c-4bc5-a45f-c3ff3b170a22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:20:45 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-e1efca59-dc63-49a0-994c-fbcb9a4d5ac9 req-39fd0254-500f-4992-83a0-5da47d1692a3 service nova] Lock "6145a30b-809c-4bc5-a45f-c3ff3b170a22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:20:45 user nova-compute[74960]: DEBUG nova.compute.manager [req-e1efca59-dc63-49a0-994c-fbcb9a4d5ac9 req-39fd0254-500f-4992-83a0-5da47d1692a3 service nova] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] No waiting events found dispatching network-vif-plugged-c54167dd-e416-43bd-8271-dd55e9e71119 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:20:45 user nova-compute[74960]: WARNING nova.compute.manager [req-e1efca59-dc63-49a0-994c-fbcb9a4d5ac9 req-39fd0254-500f-4992-83a0-5da47d1692a3 service nova] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] Received unexpected event network-vif-plugged-c54167dd-e416-43bd-8271-dd55e9e71119 for instance with vm_state building and task_state spawning.
Nov 03 12:20:45 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:20:45 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Acquiring lock "7e5ec97f-80c4-4499-94bf-2584fc0eae03" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:20:45 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Lock "7e5ec97f-80c4-4499-94bf-2584fc0eae03" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:20:45 user nova-compute[74960]: INFO nova.compute.manager [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Unshelving
Nov 03 12:20:45 user nova-compute[74960]: INFO nova.virt.block_device [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Booting with volume 8b06fb29-6288-4cca-aabd-39d9c089c045 at /dev/vdc
Nov 03 12:20:46 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-52220da4-b2c8-4920-acc5-321f03405890 tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] Acquiring lock "79b85953-182f-459f-a8d4-bcb54148a850" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:20:46 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-52220da4-b2c8-4920-acc5-321f03405890 tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] Lock "79b85953-182f-459f-a8d4-bcb54148a850" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:20:46 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-52220da4-b2c8-4920-acc5-321f03405890 tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] Acquiring lock "79b85953-182f-459f-a8d4-bcb54148a850-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:20:46 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-52220da4-b2c8-4920-acc5-321f03405890 tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] Lock "79b85953-182f-459f-a8d4-bcb54148a850-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:20:46 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-52220da4-b2c8-4920-acc5-321f03405890 tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] Lock "79b85953-182f-459f-a8d4-bcb54148a850-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:20:46 user nova-compute[74960]: INFO nova.compute.manager [None req-52220da4-b2c8-4920-acc5-321f03405890 tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] [instance: 79b85953-182f-459f-a8d4-bcb54148a850] Terminating instance
Nov 03 12:20:46 user nova-compute[74960]: DEBUG nova.compute.manager [None req-52220da4-b2c8-4920-acc5-321f03405890 tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] [instance: 79b85953-182f-459f-a8d4-bcb54148a850] Start destroying the instance on the hypervisor. {{(pid=74960) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 12:20:46 user nova-compute[74960]: DEBUG os_brick.utils [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:20:46 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:20:46 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:20:46 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:20:46 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[897066e2-407c-4ecd-a674-a133cc5c93c8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:75b8e219756\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:20:46 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:20:46 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:20:46 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[7233a73c-5b9c-40b7-b910-c438cecf828b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:20:46 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:20:46 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:20:46 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:20:46 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dbf6523-63f8-4299-9d10-91498982952b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:20:46 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e7e2583-f727-4d34-8532-60d68eacda34]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:20:46 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Running cmd (subprocess): nvme version {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:20:46 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] 'nvme version' failed. Not Retrying. {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 12:20:46 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:20:46 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] nvme not present on system {{(pid=74960) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 12:20:46 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:20:46 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 12:20:46 user nova-compute[74960]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 12:20:46 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[40a8b1fa-e081-40b9-906a-89bc8c2823dd]: (4, '') {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:20:46 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74960) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 12:20:46 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74960) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 12:20:46 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] LIGHTOS: no hostnqn found. {{(pid=74960) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 12:20:46 user nova-compute[74960]: DEBUG os_brick.utils [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] <== get_connector_properties: return (170ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:75b8e219756', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:20:46 user nova-compute[74960]: DEBUG nova.virt.block_device [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Updating existing volume attachment record: 1db20b41-8126-4b85-ba60-bd0809a6f1a8 {{(pid=74960) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 12:20:46 user nova-compute[74960]: DEBUG nova.compute.manager [None req-0cd35881-646f-4206-a492-7b31d9a36392 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] Instance event wait completed in 0 seconds for  {{(pid=74960) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 12:20:46 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-0cd35881-646f-4206-a492-7b31d9a36392 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] Guest created on hypervisor {{(pid=74960) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 12:20:46 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] Instance spawned successfully.
Nov 03 12:20:46 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-0cd35881-646f-4206-a492-7b31d9a36392 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 12:20:46 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-0cd35881-646f-4206-a492-7b31d9a36392 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] Found default for hw_cdrom_bus of ide {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:20:46 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-0cd35881-646f-4206-a492-7b31d9a36392 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] Found default for hw_disk_bus of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:20:46 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-0cd35881-646f-4206-a492-7b31d9a36392 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] Found default for hw_input_bus of None {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:20:46 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-0cd35881-646f-4206-a492-7b31d9a36392 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] Found default for hw_pointer_model of None {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:20:46 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-0cd35881-646f-4206-a492-7b31d9a36392 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] Found default for hw_video_model of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:20:46 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-0cd35881-646f-4206-a492-7b31d9a36392 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] Found default for hw_vif_model of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:20:46 user nova-compute[74960]: INFO nova.compute.manager [None req-0cd35881-646f-4206-a492-7b31d9a36392 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] Took 8.55 seconds to spawn the instance on the hypervisor.
Nov 03 12:20:46 user nova-compute[74960]: DEBUG nova.compute.manager [None req-0cd35881-646f-4206-a492-7b31d9a36392 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] Checking state {{(pid=74960) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 12:20:46 user nova-compute[74960]: DEBUG nova.compute.manager [req-8f1f5f59-b7aa-4b6e-b760-2b5f9d8c167e req-65a576f0-dd9f-449d-bc34-67e9bea325b0 service nova] [instance: 79b85953-182f-459f-a8d4-bcb54148a850] Received event network-vif-unplugged-25c374db-280b-4b5b-a803-915efb751de8 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:20:46 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-8f1f5f59-b7aa-4b6e-b760-2b5f9d8c167e req-65a576f0-dd9f-449d-bc34-67e9bea325b0 service nova] Acquiring lock "79b85953-182f-459f-a8d4-bcb54148a850-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:20:46 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-8f1f5f59-b7aa-4b6e-b760-2b5f9d8c167e req-65a576f0-dd9f-449d-bc34-67e9bea325b0 service nova] Lock "79b85953-182f-459f-a8d4-bcb54148a850-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:20:46 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-8f1f5f59-b7aa-4b6e-b760-2b5f9d8c167e req-65a576f0-dd9f-449d-bc34-67e9bea325b0 service nova] Lock "79b85953-182f-459f-a8d4-bcb54148a850-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:20:46 user nova-compute[74960]: DEBUG nova.compute.manager [req-8f1f5f59-b7aa-4b6e-b760-2b5f9d8c167e req-65a576f0-dd9f-449d-bc34-67e9bea325b0 service nova] [instance: 79b85953-182f-459f-a8d4-bcb54148a850] No waiting events found dispatching network-vif-unplugged-25c374db-280b-4b5b-a803-915efb751de8 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:20:46 user nova-compute[74960]: DEBUG nova.compute.manager [req-8f1f5f59-b7aa-4b6e-b760-2b5f9d8c167e req-65a576f0-dd9f-449d-bc34-67e9bea325b0 service nova] [instance: 79b85953-182f-459f-a8d4-bcb54148a850] Received event network-vif-unplugged-25c374db-280b-4b5b-a803-915efb751de8 for instance with task_state deleting. {{(pid=74960) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 12:20:46 user nova-compute[74960]: INFO nova.compute.manager [None req-0cd35881-646f-4206-a492-7b31d9a36392 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] Took 9.62 seconds to build instance.
Nov 03 12:20:46 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a198493-7329-43ff-bceb-56b50529be29/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:20:46 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-0cd35881-646f-4206-a492-7b31d9a36392 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Lock "6145a30b-809c-4bc5-a45f-c3ff3b170a22" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.765s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:20:46 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a198493-7329-43ff-bceb-56b50529be29/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:20:46 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a198493-7329-43ff-bceb-56b50529be29/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:20:47 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: 79b85953-182f-459f-a8d4-bcb54148a850] Instance destroyed successfully.
Nov 03 12:20:47 user nova-compute[74960]: DEBUG nova.objects.instance [None req-52220da4-b2c8-4920-acc5-321f03405890 tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] Lazy-loading 'resources' on Instance uuid 79b85953-182f-459f-a8d4-bcb54148a850 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:20:47 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-52220da4-b2c8-4920-acc5-321f03405890 tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:18:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-341594800',display_name='tempest-VolumesActionsTest-instance-341594800',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-341594800',id=9,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-03T12:18:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='be790149973a4bdc903e08ed69b9238f',ramdisk_id='',reservation_id='r-pw7385fx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1044563007',owner_user_name='tempest-VolumesActionsTest-1044563007-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T12:18:39Z,user_data=None,user_id='ac6f783eb87d4aeaaf7de78836e8253f',uuid=79b85953-182f-459f-a8d4-bcb54148a850,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "25c374db-280b-4b5b-a803-915efb751de8", "address": "fa:16:3e:16:3e:5d", "network": {"id": "75b4c07e-f11a-41c6-9b17-525598c88bdf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-215952367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be790149973a4bdc903e08ed69b9238f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25c374db-28", "ovs_interfaceid": "25c374db-280b-4b5b-a803-915efb751de8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 12:20:47 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-52220da4-b2c8-4920-acc5-321f03405890 tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] Converting VIF {"id": "25c374db-280b-4b5b-a803-915efb751de8", "address": "fa:16:3e:16:3e:5d", "network": {"id": "75b4c07e-f11a-41c6-9b17-525598c88bdf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-215952367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be790149973a4bdc903e08ed69b9238f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25c374db-28", "ovs_interfaceid": "25c374db-280b-4b5b-a803-915efb751de8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:20:47 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-52220da4-b2c8-4920-acc5-321f03405890 tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:3e:5d,bridge_name='br-int',has_traffic_filtering=True,id=25c374db-280b-4b5b-a803-915efb751de8,network=Network(75b4c07e-f11a-41c6-9b17-525598c88bdf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25c374db-28') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:20:47 user nova-compute[74960]: DEBUG os_vif [None req-52220da4-b2c8-4920-acc5-321f03405890 tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:3e:5d,bridge_name='br-int',has_traffic_filtering=True,id=25c374db-280b-4b5b-a803-915efb751de8,network=Network(75b4c07e-f11a-41c6-9b17-525598c88bdf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25c374db-28') {{(pid=74960) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 12:20:47 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:20:47 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap25c374db-28, bridge=br-int, if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:20:47 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:20:47 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:20:47 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:20:47 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=09ee9178-c762-4484-9f7d-c86683fbc72b) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:20:47 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:20:47 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:20:47 user nova-compute[74960]: INFO os_vif [None req-52220da4-b2c8-4920-acc5-321f03405890 tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:3e:5d,bridge_name='br-int',has_traffic_filtering=True,id=25c374db-280b-4b5b-a803-915efb751de8,network=Network(75b4c07e-f11a-41c6-9b17-525598c88bdf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25c374db-28')
Nov 03 12:20:47 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-52220da4-b2c8-4920-acc5-321f03405890 tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] [instance: 79b85953-182f-459f-a8d4-bcb54148a850] Deleting instance files /opt/stack/data/nova/instances/79b85953-182f-459f-a8d4-bcb54148a850_del
Nov 03 12:20:47 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-52220da4-b2c8-4920-acc5-321f03405890 tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] [instance: 79b85953-182f-459f-a8d4-bcb54148a850] Deletion of /opt/stack/data/nova/instances/79b85953-182f-459f-a8d4-bcb54148a850_del complete
Nov 03 12:20:47 user nova-compute[74960]: DEBUG nova.compute.manager [req-edaa1df9-5f3a-4952-aacb-02700cc5f500 req-d506d920-5aa3-4add-b828-5530218fcb83 service nova] [instance: 0a198493-7329-43ff-bceb-56b50529be29] Received event network-vif-plugged-e6755218-8c73-4191-a259-8f1f936838e8 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:20:47 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-edaa1df9-5f3a-4952-aacb-02700cc5f500 req-d506d920-5aa3-4add-b828-5530218fcb83 service nova] Acquiring lock "0a198493-7329-43ff-bceb-56b50529be29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:20:47 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-edaa1df9-5f3a-4952-aacb-02700cc5f500 req-d506d920-5aa3-4add-b828-5530218fcb83 service nova] Lock "0a198493-7329-43ff-bceb-56b50529be29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:20:47 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-edaa1df9-5f3a-4952-aacb-02700cc5f500 req-d506d920-5aa3-4add-b828-5530218fcb83 service nova] Lock "0a198493-7329-43ff-bceb-56b50529be29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:20:47 user nova-compute[74960]: DEBUG nova.compute.manager [req-edaa1df9-5f3a-4952-aacb-02700cc5f500 req-d506d920-5aa3-4add-b828-5530218fcb83 service nova] [instance: 0a198493-7329-43ff-bceb-56b50529be29] No waiting events found dispatching network-vif-plugged-e6755218-8c73-4191-a259-8f1f936838e8 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:20:47 user nova-compute[74960]: WARNING nova.compute.manager [req-edaa1df9-5f3a-4952-aacb-02700cc5f500 req-d506d920-5aa3-4add-b828-5530218fcb83 service nova] [instance: 0a198493-7329-43ff-bceb-56b50529be29] Received unexpected event network-vif-plugged-e6755218-8c73-4191-a259-8f1f936838e8 for instance with vm_state building and task_state spawning.
Nov 03 12:20:47 user nova-compute[74960]: INFO nova.compute.manager [None req-52220da4-b2c8-4920-acc5-321f03405890 tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] [instance: 79b85953-182f-459f-a8d4-bcb54148a850] Took 1.14 seconds to destroy the instance on the hypervisor.
Nov 03 12:20:47 user nova-compute[74960]: DEBUG oslo.service.loopingcall [None req-52220da4-b2c8-4920-acc5-321f03405890 tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74960) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 12:20:47 user nova-compute[74960]: DEBUG nova.compute.manager [-] [instance: 79b85953-182f-459f-a8d4-bcb54148a850] Deallocating network for instance {{(pid=74960) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 12:20:47 user nova-compute[74960]: DEBUG nova.network.neutron [-] [instance: 79b85953-182f-459f-a8d4-bcb54148a850] deallocate_for_instance() {{(pid=74960) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 12:20:47 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a198493-7329-43ff-bceb-56b50529be29/disk --force-share --output=json" returned: 0 in 0.328s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:20:47 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05956d9b-0646-43d2-a4cd-19e9090020ee/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:20:47 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05956d9b-0646-43d2-a4cd-19e9090020ee/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:20:47 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05956d9b-0646-43d2-a4cd-19e9090020ee/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:20:47 user nova-compute[74960]: DEBUG nova.compute.manager [None req-e001d581-4e41-4e12-bf55-38cacdcc4983 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] [instance: 0a198493-7329-43ff-bceb-56b50529be29] Instance event wait completed in 0 seconds for  {{(pid=74960) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 12:20:47 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-e001d581-4e41-4e12-bf55-38cacdcc4983 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] [instance: 0a198493-7329-43ff-bceb-56b50529be29] Guest created on hypervisor {{(pid=74960) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 12:20:47 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: 0a198493-7329-43ff-bceb-56b50529be29] Instance spawned successfully.
Nov 03 12:20:47 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-e001d581-4e41-4e12-bf55-38cacdcc4983 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] [instance: 0a198493-7329-43ff-bceb-56b50529be29] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 12:20:47 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-e001d581-4e41-4e12-bf55-38cacdcc4983 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] [instance: 0a198493-7329-43ff-bceb-56b50529be29] Found default for hw_cdrom_bus of ide {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:20:47 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-e001d581-4e41-4e12-bf55-38cacdcc4983 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] [instance: 0a198493-7329-43ff-bceb-56b50529be29] Found default for hw_disk_bus of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:20:47 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-e001d581-4e41-4e12-bf55-38cacdcc4983 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] [instance: 0a198493-7329-43ff-bceb-56b50529be29] Found default for hw_input_bus of None {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:20:47 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-e001d581-4e41-4e12-bf55-38cacdcc4983 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] [instance: 0a198493-7329-43ff-bceb-56b50529be29] Found default for hw_pointer_model of None {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:20:47 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-e001d581-4e41-4e12-bf55-38cacdcc4983 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] [instance: 0a198493-7329-43ff-bceb-56b50529be29] Found default for hw_video_model of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:20:47 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-e001d581-4e41-4e12-bf55-38cacdcc4983 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] [instance: 0a198493-7329-43ff-bceb-56b50529be29] Found default for hw_vif_model of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:20:47 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:20:47 user nova-compute[74960]: INFO nova.compute.manager [None req-e001d581-4e41-4e12-bf55-38cacdcc4983 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] [instance: 0a198493-7329-43ff-bceb-56b50529be29] Took 7.39 seconds to spawn the instance on the hypervisor.
Nov 03 12:20:47 user nova-compute[74960]: DEBUG nova.compute.manager [None req-e001d581-4e41-4e12-bf55-38cacdcc4983 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] [instance: 0a198493-7329-43ff-bceb-56b50529be29] Checking state {{(pid=74960) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 12:20:47 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05956d9b-0646-43d2-a4cd-19e9090020ee/disk --force-share --output=json" returned: 0 in 0.283s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:20:47 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7769e3c5-136f-4282-8e3e-224e3a80922c/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:20:47 user nova-compute[74960]: DEBUG nova.network.neutron [-] [instance: 79b85953-182f-459f-a8d4-bcb54148a850] Updating instance_info_cache with network_info: [] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:20:47 user nova-compute[74960]: INFO nova.compute.manager [-] [instance: 79b85953-182f-459f-a8d4-bcb54148a850] Took 0.75 seconds to deallocate network for instance.
Nov 03 12:20:48 user nova-compute[74960]: INFO nova.compute.manager [None req-e001d581-4e41-4e12-bf55-38cacdcc4983 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] [instance: 0a198493-7329-43ff-bceb-56b50529be29] Took 8.47 seconds to build instance.
Nov 03 12:20:48 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7769e3c5-136f-4282-8e3e-224e3a80922c/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:20:48 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7769e3c5-136f-4282-8e3e-224e3a80922c/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:20:48 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-e001d581-4e41-4e12-bf55-38cacdcc4983 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Lock "0a198493-7329-43ff-bceb-56b50529be29" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.671s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:20:48 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-52220da4-b2c8-4920-acc5-321f03405890 tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:20:48 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-52220da4-b2c8-4920-acc5-321f03405890 tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:20:48 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7769e3c5-136f-4282-8e3e-224e3a80922c/disk --force-share --output=json" returned: 0 in 0.282s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:20:48 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8381c969-6a2d-4934-aadd-660ffa246b05/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:20:48 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8381c969-6a2d-4934-aadd-660ffa246b05/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:20:48 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8381c969-6a2d-4934-aadd-660ffa246b05/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:20:48 user nova-compute[74960]: DEBUG nova.compute.manager [req-086ee840-8432-42bb-acdb-c06bbd5f7aeb req-846c6b59-78eb-4f95-b940-a87889f158d1 service nova] [instance: 79b85953-182f-459f-a8d4-bcb54148a850] Received event network-vif-plugged-25c374db-280b-4b5b-a803-915efb751de8 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:20:48 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-086ee840-8432-42bb-acdb-c06bbd5f7aeb req-846c6b59-78eb-4f95-b940-a87889f158d1 service nova] Acquiring lock "79b85953-182f-459f-a8d4-bcb54148a850-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:20:48 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-086ee840-8432-42bb-acdb-c06bbd5f7aeb req-846c6b59-78eb-4f95-b940-a87889f158d1 service nova] Lock "79b85953-182f-459f-a8d4-bcb54148a850-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:20:48 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-086ee840-8432-42bb-acdb-c06bbd5f7aeb req-846c6b59-78eb-4f95-b940-a87889f158d1 service nova] Lock "79b85953-182f-459f-a8d4-bcb54148a850-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:20:48 user nova-compute[74960]: DEBUG nova.compute.manager [req-086ee840-8432-42bb-acdb-c06bbd5f7aeb req-846c6b59-78eb-4f95-b940-a87889f158d1 service nova] [instance: 79b85953-182f-459f-a8d4-bcb54148a850] No waiting events found dispatching network-vif-plugged-25c374db-280b-4b5b-a803-915efb751de8 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:20:48 user nova-compute[74960]: WARNING nova.compute.manager [req-086ee840-8432-42bb-acdb-c06bbd5f7aeb req-846c6b59-78eb-4f95-b940-a87889f158d1 service nova] [instance: 79b85953-182f-459f-a8d4-bcb54148a850] Received unexpected event network-vif-plugged-25c374db-280b-4b5b-a803-915efb751de8 for instance with vm_state deleted and task_state None.
Nov 03 12:20:48 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-52220da4-b2c8-4920-acc5-321f03405890 tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:20:48 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-52220da4-b2c8-4920-acc5-321f03405890 tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:20:48 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-52220da4-b2c8-4920-acc5-321f03405890 tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.664s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:20:48 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8381c969-6a2d-4934-aadd-660ffa246b05/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:20:48 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74960) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 12:20:48 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Error from libvirt while getting description of instance-00000009: [Error Code 42] Domain not found: no domain with matching uuid '79b85953-182f-459f-a8d4-bcb54148a850' (instance-00000009): libvirt.libvirtError: Domain not found: no domain with matching uuid '79b85953-182f-459f-a8d4-bcb54148a850' (instance-00000009)
Nov 03 12:20:48 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f7fabc2-5e1b-441c-a693-9956470359ea/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:20:48 user nova-compute[74960]: INFO nova.scheduler.client.report [None req-52220da4-b2c8-4920-acc5-321f03405890 tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] Deleted allocations for instance 79b85953-182f-459f-a8d4-bcb54148a850
Nov 03 12:20:49 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-52220da4-b2c8-4920-acc5-321f03405890 tempest-VolumesActionsTest-1044563007 tempest-VolumesActionsTest-1044563007-project-member] Lock "79b85953-182f-459f-a8d4-bcb54148a850" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.986s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:20:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f7fabc2-5e1b-441c-a693-9956470359ea/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:20:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f7fabc2-5e1b-441c-a693-9956470359ea/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:20:49 user nova-compute[74960]: DEBUG nova.compute.manager [req-d4af2bc9-055c-4ac7-aa8f-7e0c869d7f93 req-dbd0facf-28e6-4530-998b-8742404a6820 service nova] [instance: 79b85953-182f-459f-a8d4-bcb54148a850] Received event network-vif-deleted-25c374db-280b-4b5b-a803-915efb751de8 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:20:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f7fabc2-5e1b-441c-a693-9956470359ea/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:20:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6145a30b-809c-4bc5-a45f-c3ff3b170a22/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:20:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6145a30b-809c-4bc5-a45f-c3ff3b170a22/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:20:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6145a30b-809c-4bc5-a45f-c3ff3b170a22/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:20:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6145a30b-809c-4bc5-a45f-c3ff3b170a22/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:20:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e91dfcf4-caef-43d0-a56b-b1282363d4e0/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:20:50 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e91dfcf4-caef-43d0-a56b-b1282363d4e0/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:20:50 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e91dfcf4-caef-43d0-a56b-b1282363d4e0/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:20:50 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e91dfcf4-caef-43d0-a56b-b1282363d4e0/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:20:50 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a520c41-19c0-47ba-ada8-023ee9c12ca6/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:20:50 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a520c41-19c0-47ba-ada8-023ee9c12ca6/disk --force-share --output=json" returned: 0 in 0.281s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:20:50 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a520c41-19c0-47ba-ada8-023ee9c12ca6/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:20:50 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a520c41-19c0-47ba-ada8-023ee9c12ca6/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:20:51 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:20:51 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:20:51 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Hypervisor/Node resource view: name=user free_ram=8023MB free_disk=25.366302490234375GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74960) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 12:20:51 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:20:51 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:20:51 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 7769e3c5-136f-4282-8e3e-224e3a80922c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:20:51 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance e91dfcf4-caef-43d0-a56b-b1282363d4e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:20:51 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 8381c969-6a2d-4934-aadd-660ffa246b05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:20:51 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 0a520c41-19c0-47ba-ada8-023ee9c12ca6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:20:51 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 7f7fabc2-5e1b-441c-a693-9956470359ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:20:51 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 05956d9b-0646-43d2-a4cd-19e9090020ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:20:51 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 6145a30b-809c-4bc5-a45f-c3ff3b170a22 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:20:51 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 0a198493-7329-43ff-bceb-56b50529be29 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:20:51 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 7e5ec97f-80c4-4499-94bf-2584fc0eae03 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 03 12:20:51 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74960) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 12:20:51 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74960) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 12:20:51 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:20:51 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:20:51 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Compute_service record updated for user:user {{(pid=74960) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 12:20:51 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.586s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:20:52 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:20:52 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:20:52 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:20:52 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:20:52 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74960) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 12:20:52 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:20:54 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:20:56 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-8ae9d488-5a3b-4bd4-8964-87a920750321 tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Acquiring lock "fffd1dd7-b8e8-435c-bdfe-6c5001b21daf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:20:56 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-8ae9d488-5a3b-4bd4-8964-87a920750321 tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Lock "fffd1dd7-b8e8-435c-bdfe-6c5001b21daf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:20:56 user nova-compute[74960]: DEBUG nova.compute.manager [None req-8ae9d488-5a3b-4bd4-8964-87a920750321 tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] [instance: fffd1dd7-b8e8-435c-bdfe-6c5001b21daf] Starting instance... {{(pid=74960) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 12:20:56 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-8ae9d488-5a3b-4bd4-8964-87a920750321 tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:20:56 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-8ae9d488-5a3b-4bd4-8964-87a920750321 tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:20:56 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-8ae9d488-5a3b-4bd4-8964-87a920750321 tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74960) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 12:20:56 user nova-compute[74960]: INFO nova.compute.claims [None req-8ae9d488-5a3b-4bd4-8964-87a920750321 tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] [instance: fffd1dd7-b8e8-435c-bdfe-6c5001b21daf] Claim successful on node user
Nov 03 12:20:57 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-8ae9d488-5a3b-4bd4-8964-87a920750321 tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:20:57 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:20:57 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-8ae9d488-5a3b-4bd4-8964-87a920750321 tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:20:57 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-8ae9d488-5a3b-4bd4-8964-87a920750321 tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.665s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:20:57 user nova-compute[74960]: DEBUG nova.compute.manager [None req-8ae9d488-5a3b-4bd4-8964-87a920750321 tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] [instance: fffd1dd7-b8e8-435c-bdfe-6c5001b21daf] Start building networks asynchronously for instance. {{(pid=74960) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 12:20:57 user nova-compute[74960]: DEBUG nova.compute.manager [None req-8ae9d488-5a3b-4bd4-8964-87a920750321 tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] [instance: fffd1dd7-b8e8-435c-bdfe-6c5001b21daf] Allocating IP information in the background. {{(pid=74960) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 12:20:57 user nova-compute[74960]: DEBUG nova.network.neutron [None req-8ae9d488-5a3b-4bd4-8964-87a920750321 tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] [instance: fffd1dd7-b8e8-435c-bdfe-6c5001b21daf] allocate_for_instance() {{(pid=74960) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 12:20:57 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-8ae9d488-5a3b-4bd4-8964-87a920750321 tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] [instance: fffd1dd7-b8e8-435c-bdfe-6c5001b21daf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 12:20:57 user nova-compute[74960]: DEBUG nova.compute.manager [None req-8ae9d488-5a3b-4bd4-8964-87a920750321 tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] [instance: fffd1dd7-b8e8-435c-bdfe-6c5001b21daf] Start building block device mappings for instance. {{(pid=74960) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 12:20:57 user nova-compute[74960]: DEBUG nova.policy [None req-8ae9d488-5a3b-4bd4-8964-87a920750321 tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7a13ec06392c4ce5a81491a35a8d50d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e379e295cf984ca6bf5d84a60e56382d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74960) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 12:20:57 user nova-compute[74960]: DEBUG nova.compute.manager [None req-8ae9d488-5a3b-4bd4-8964-87a920750321 tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] [instance: fffd1dd7-b8e8-435c-bdfe-6c5001b21daf] Start spawning the instance on the hypervisor. {{(pid=74960) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 12:20:57 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-8ae9d488-5a3b-4bd4-8964-87a920750321 tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] [instance: fffd1dd7-b8e8-435c-bdfe-6c5001b21daf] Creating instance directory {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 12:20:57 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-8ae9d488-5a3b-4bd4-8964-87a920750321 tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] [instance: fffd1dd7-b8e8-435c-bdfe-6c5001b21daf] Creating image(s)
Nov 03 12:20:57 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-8ae9d488-5a3b-4bd4-8964-87a920750321 tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Acquiring lock "/opt/stack/data/nova/instances/fffd1dd7-b8e8-435c-bdfe-6c5001b21daf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:20:57 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-8ae9d488-5a3b-4bd4-8964-87a920750321 tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Lock "/opt/stack/data/nova/instances/fffd1dd7-b8e8-435c-bdfe-6c5001b21daf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:20:57 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-8ae9d488-5a3b-4bd4-8964-87a920750321 tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Lock "/opt/stack/data/nova/instances/fffd1dd7-b8e8-435c-bdfe-6c5001b21daf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:20:57 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-8ae9d488-5a3b-4bd4-8964-87a920750321 tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:20:57 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-8ae9d488-5a3b-4bd4-8964-87a920750321 tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.202s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:20:57 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-8ae9d488-5a3b-4bd4-8964-87a920750321 tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Acquiring lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:20:57 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-8ae9d488-5a3b-4bd4-8964-87a920750321 tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:20:57 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-8ae9d488-5a3b-4bd4-8964-87a920750321 tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:20:57 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:20:57 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-8ae9d488-5a3b-4bd4-8964-87a920750321 tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.181s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:20:57 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-8ae9d488-5a3b-4bd4-8964-87a920750321 tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910,backing_fmt=raw /opt/stack/data/nova/instances/fffd1dd7-b8e8-435c-bdfe-6c5001b21daf/disk 1073741824 {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:20:57 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-8ae9d488-5a3b-4bd4-8964-87a920750321 tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910,backing_fmt=raw /opt/stack/data/nova/instances/fffd1dd7-b8e8-435c-bdfe-6c5001b21daf/disk 1073741824" returned: 0 in 0.048s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:20:57 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-8ae9d488-5a3b-4bd4-8964-87a920750321 tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:20:57 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-8ae9d488-5a3b-4bd4-8964-87a920750321 tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:20:57 user nova-compute[74960]: DEBUG nova.network.neutron [None req-8ae9d488-5a3b-4bd4-8964-87a920750321 tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] [instance: fffd1dd7-b8e8-435c-bdfe-6c5001b21daf] Successfully created port: 51edd11b-19e3-40e1-a3a8-56485553eebb {{(pid=74960) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 12:20:58 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-8ae9d488-5a3b-4bd4-8964-87a920750321 tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.197s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:20:58 user nova-compute[74960]: DEBUG nova.virt.disk.api [None req-8ae9d488-5a3b-4bd4-8964-87a920750321 tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fffd1dd7-b8e8-435c-bdfe-6c5001b21daf/disk. size=1073741824 {{(pid=74960) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 12:20:58 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-8ae9d488-5a3b-4bd4-8964-87a920750321 tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fffd1dd7-b8e8-435c-bdfe-6c5001b21daf/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:20:58 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-8ae9d488-5a3b-4bd4-8964-87a920750321 tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fffd1dd7-b8e8-435c-bdfe-6c5001b21daf/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:20:58 user nova-compute[74960]: DEBUG nova.virt.disk.api [None req-8ae9d488-5a3b-4bd4-8964-87a920750321 tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Cannot resize image /opt/stack/data/nova/instances/fffd1dd7-b8e8-435c-bdfe-6c5001b21daf/disk to a smaller size. {{(pid=74960) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 12:20:58 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-8ae9d488-5a3b-4bd4-8964-87a920750321 tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] [instance: fffd1dd7-b8e8-435c-bdfe-6c5001b21daf] Created local disks {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 12:20:58 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-8ae9d488-5a3b-4bd4-8964-87a920750321 tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] [instance: fffd1dd7-b8e8-435c-bdfe-6c5001b21daf] Ensure instance console log exists: /opt/stack/data/nova/instances/fffd1dd7-b8e8-435c-bdfe-6c5001b21daf/console.log {{(pid=74960) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 12:20:58 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-8ae9d488-5a3b-4bd4-8964-87a920750321 tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:20:58 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-8ae9d488-5a3b-4bd4-8964-87a920750321 tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:20:58 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-8ae9d488-5a3b-4bd4-8964-87a920750321 tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:20:58 user nova-compute[74960]: DEBUG nova.network.neutron [None req-8ae9d488-5a3b-4bd4-8964-87a920750321 tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] [instance: fffd1dd7-b8e8-435c-bdfe-6c5001b21daf] Successfully updated port: 51edd11b-19e3-40e1-a3a8-56485553eebb {{(pid=74960) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 12:20:58 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-8ae9d488-5a3b-4bd4-8964-87a920750321 tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Acquiring lock "refresh_cache-fffd1dd7-b8e8-435c-bdfe-6c5001b21daf" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:20:58 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-8ae9d488-5a3b-4bd4-8964-87a920750321 tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Acquired lock "refresh_cache-fffd1dd7-b8e8-435c-bdfe-6c5001b21daf" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:20:58 user nova-compute[74960]: DEBUG nova.network.neutron [None req-8ae9d488-5a3b-4bd4-8964-87a920750321 tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] [instance: fffd1dd7-b8e8-435c-bdfe-6c5001b21daf] Building network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 12:20:58 user nova-compute[74960]: DEBUG nova.compute.manager [req-6748f6ae-ff42-47c1-8061-36b2442c828a req-fd7a5199-8b7d-4394-a44b-ad2e54c1a62f service nova] [instance: fffd1dd7-b8e8-435c-bdfe-6c5001b21daf] Received event network-changed-51edd11b-19e3-40e1-a3a8-56485553eebb {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:20:58 user nova-compute[74960]: DEBUG nova.compute.manager [req-6748f6ae-ff42-47c1-8061-36b2442c828a req-fd7a5199-8b7d-4394-a44b-ad2e54c1a62f service nova] [instance: fffd1dd7-b8e8-435c-bdfe-6c5001b21daf] Refreshing instance network info cache due to event network-changed-51edd11b-19e3-40e1-a3a8-56485553eebb. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 12:20:58 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-6748f6ae-ff42-47c1-8061-36b2442c828a req-fd7a5199-8b7d-4394-a44b-ad2e54c1a62f service nova] Acquiring lock "refresh_cache-fffd1dd7-b8e8-435c-bdfe-6c5001b21daf" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:20:58 user nova-compute[74960]: DEBUG nova.network.neutron [None req-8ae9d488-5a3b-4bd4-8964-87a920750321 tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] [instance: fffd1dd7-b8e8-435c-bdfe-6c5001b21daf] Instance cache missing network info. {{(pid=74960) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 12:20:59 user nova-compute[74960]: DEBUG nova.network.neutron [None req-8ae9d488-5a3b-4bd4-8964-87a920750321 tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] [instance: fffd1dd7-b8e8-435c-bdfe-6c5001b21daf] Updating instance_info_cache with network_info: [{"id": "51edd11b-19e3-40e1-a3a8-56485553eebb", "address": "fa:16:3e:f5:df:89", "network": {"id": "3a8a59cd-8076-41af-b566-9fc45a07a1df", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1235385625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e379e295cf984ca6bf5d84a60e56382d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51edd11b-19", "ovs_interfaceid": "51edd11b-19e3-40e1-a3a8-56485553eebb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:20:59 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-8ae9d488-5a3b-4bd4-8964-87a920750321 tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Releasing lock "refresh_cache-fffd1dd7-b8e8-435c-bdfe-6c5001b21daf" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:20:59 user nova-compute[74960]: DEBUG nova.compute.manager [None req-8ae9d488-5a3b-4bd4-8964-87a920750321 tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] [instance: fffd1dd7-b8e8-435c-bdfe-6c5001b21daf] Instance network_info: |[{"id": "51edd11b-19e3-40e1-a3a8-56485553eebb", "address": "fa:16:3e:f5:df:89", "network": {"id": "3a8a59cd-8076-41af-b566-9fc45a07a1df", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1235385625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e379e295cf984ca6bf5d84a60e56382d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51edd11b-19", "ovs_interfaceid": "51edd11b-19e3-40e1-a3a8-56485553eebb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74960) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 12:20:59 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-6748f6ae-ff42-47c1-8061-36b2442c828a req-fd7a5199-8b7d-4394-a44b-ad2e54c1a62f service nova] Acquired lock "refresh_cache-fffd1dd7-b8e8-435c-bdfe-6c5001b21daf" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:20:59 user nova-compute[74960]: DEBUG nova.network.neutron [req-6748f6ae-ff42-47c1-8061-36b2442c828a req-fd7a5199-8b7d-4394-a44b-ad2e54c1a62f service nova] [instance: fffd1dd7-b8e8-435c-bdfe-6c5001b21daf] Refreshing network info cache for port 51edd11b-19e3-40e1-a3a8-56485553eebb {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 12:20:59 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-8ae9d488-5a3b-4bd4-8964-87a920750321 tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] [instance: fffd1dd7-b8e8-435c-bdfe-6c5001b21daf] Start _get_guest_xml network_info=[{"id": "51edd11b-19e3-40e1-a3a8-56485553eebb", "address": "fa:16:3e:f5:df:89", "network": {"id": "3a8a59cd-8076-41af-b566-9fc45a07a1df", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1235385625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e379e295cf984ca6bf5d84a60e56382d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51edd11b-19", "ovs_interfaceid": "51edd11b-19e3-40e1-a3a8-56485553eebb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=549f51ba-ac69-494b-8de1-34635aa2d7cf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='63ee9c80c632442fb0379f47b784bd20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T12:13:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'image_id': '549f51ba-ac69-494b-8de1-34635aa2d7cf'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 12:20:59 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-8ae9d488-5a3b-4bd4-8964-87a920750321 tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:20:59 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-8ae9d488-5a3b-4bd4-8964-87a920750321 tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:20:59 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-8ae9d488-5a3b-4bd4-8964-87a920750321 tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 12:20:59 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-8ae9d488-5a3b-4bd4-8964-87a920750321 tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] CPU controller missing on host. {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 12:20:59 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-8ae9d488-5a3b-4bd4-8964-87a920750321 tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 12:20:59 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-8ae9d488-5a3b-4bd4-8964-87a920750321 tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] CPU controller found on host. {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 12:20:59 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-8ae9d488-5a3b-4bd4-8964-87a920750321 tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74960) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 12:20:59 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-8ae9d488-5a3b-4bd4-8964-87a920750321 tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=549f51ba-ac69-494b-8de1-34635aa2d7cf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='63ee9c80c632442fb0379f47b784bd20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T12:13:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 12:20:59 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-8ae9d488-5a3b-4bd4-8964-87a920750321 tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Flavor limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 12:20:59 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-8ae9d488-5a3b-4bd4-8964-87a920750321 tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Image limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 12:20:59 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-8ae9d488-5a3b-4bd4-8964-87a920750321 tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Flavor pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 12:20:59 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-8ae9d488-5a3b-4bd4-8964-87a920750321 tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Image pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 12:20:59 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-8ae9d488-5a3b-4bd4-8964-87a920750321 tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 12:20:59 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-8ae9d488-5a3b-4bd4-8964-87a920750321 tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 12:20:59 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-8ae9d488-5a3b-4bd4-8964-87a920750321 tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 12:20:59 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-8ae9d488-5a3b-4bd4-8964-87a920750321 tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Got 1 possible topologies {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 12:20:59 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-8ae9d488-5a3b-4bd4-8964-87a920750321 tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 12:20:59 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-8ae9d488-5a3b-4bd4-8964-87a920750321 tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 12:20:59 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-8ae9d488-5a3b-4bd4-8964-87a920750321 tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:20:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-930355115',display_name='tempest-ServersNegativeTestJSON-server-930355115',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-930355115',id=14,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e379e295cf984ca6bf5d84a60e56382d',ramdisk_id='',reservation_id='r-w0xth1rj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-802200730',owner_user_name='tempest-ServersNegativeTestJSON-802200730-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:20:57Z,user_data=None,user_id='7a13ec06392c4ce5a81491a35a8d50d8',uuid=fffd1dd7-b8e8-435c-bdfe-6c5001b21daf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "51edd11b-19e3-40e1-a3a8-56485553eebb", "address": "fa:16:3e:f5:df:89", "network": {"id": "3a8a59cd-8076-41af-b566-9fc45a07a1df", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1235385625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e379e295cf984ca6bf5d84a60e56382d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51edd11b-19", "ovs_interfaceid": "51edd11b-19e3-40e1-a3a8-56485553eebb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74960) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 12:20:59 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-8ae9d488-5a3b-4bd4-8964-87a920750321 tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Converting VIF {"id": "51edd11b-19e3-40e1-a3a8-56485553eebb", "address": "fa:16:3e:f5:df:89", "network": {"id": "3a8a59cd-8076-41af-b566-9fc45a07a1df", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1235385625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e379e295cf984ca6bf5d84a60e56382d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51edd11b-19", "ovs_interfaceid": "51edd11b-19e3-40e1-a3a8-56485553eebb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:20:59 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-8ae9d488-5a3b-4bd4-8964-87a920750321 tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:df:89,bridge_name='br-int',has_traffic_filtering=True,id=51edd11b-19e3-40e1-a3a8-56485553eebb,network=Network(3a8a59cd-8076-41af-b566-9fc45a07a1df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51edd11b-19') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:20:59 user nova-compute[74960]: DEBUG nova.objects.instance [None req-8ae9d488-5a3b-4bd4-8964-87a920750321 tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Lazy-loading 'pci_devices' on Instance uuid fffd1dd7-b8e8-435c-bdfe-6c5001b21daf {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:20:59 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-8ae9d488-5a3b-4bd4-8964-87a920750321 tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] [instance: fffd1dd7-b8e8-435c-bdfe-6c5001b21daf] End _get_guest_xml xml=<domain type="kvm">
Nov 03 12:20:59 user nova-compute[74960]:   <uuid>fffd1dd7-b8e8-435c-bdfe-6c5001b21daf</uuid>
Nov 03 12:20:59 user nova-compute[74960]:   <name>instance-0000000e</name>
Nov 03 12:20:59 user nova-compute[74960]:   <memory>524288</memory>
Nov 03 12:20:59 user nova-compute[74960]:   <vcpu>1</vcpu>
Nov 03 12:20:59 user nova-compute[74960]:   <metadata>
Nov 03 12:20:59 user nova-compute[74960]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 12:20:59 user nova-compute[74960]:       <nova:package version="0.0.0"/>
Nov 03 12:20:59 user nova-compute[74960]:       <nova:name>tempest-ServersNegativeTestJSON-server-930355115</nova:name>
Nov 03 12:20:59 user nova-compute[74960]:       <nova:creationTime>2023-11-03 12:20:59</nova:creationTime>
Nov 03 12:20:59 user nova-compute[74960]:       <nova:flavor name="m1.tiny">
Nov 03 12:20:59 user nova-compute[74960]:         <nova:memory>512</nova:memory>
Nov 03 12:20:59 user nova-compute[74960]:         <nova:disk>1</nova:disk>
Nov 03 12:20:59 user nova-compute[74960]:         <nova:swap>0</nova:swap>
Nov 03 12:20:59 user nova-compute[74960]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 12:20:59 user nova-compute[74960]:         <nova:vcpus>1</nova:vcpus>
Nov 03 12:20:59 user nova-compute[74960]:       </nova:flavor>
Nov 03 12:20:59 user nova-compute[74960]:       <nova:owner>
Nov 03 12:20:59 user nova-compute[74960]:         <nova:user uuid="7a13ec06392c4ce5a81491a35a8d50d8">tempest-ServersNegativeTestJSON-802200730-project-member</nova:user>
Nov 03 12:20:59 user nova-compute[74960]:         <nova:project uuid="e379e295cf984ca6bf5d84a60e56382d">tempest-ServersNegativeTestJSON-802200730</nova:project>
Nov 03 12:20:59 user nova-compute[74960]:       </nova:owner>
Nov 03 12:20:59 user nova-compute[74960]:       <nova:root type="image" uuid="549f51ba-ac69-494b-8de1-34635aa2d7cf"/>
Nov 03 12:20:59 user nova-compute[74960]:       <nova:ports>
Nov 03 12:20:59 user nova-compute[74960]:         <nova:port uuid="51edd11b-19e3-40e1-a3a8-56485553eebb">
Nov 03 12:20:59 user nova-compute[74960]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 03 12:20:59 user nova-compute[74960]:         </nova:port>
Nov 03 12:20:59 user nova-compute[74960]:       </nova:ports>
Nov 03 12:20:59 user nova-compute[74960]:     </nova:instance>
Nov 03 12:20:59 user nova-compute[74960]:   </metadata>
Nov 03 12:20:59 user nova-compute[74960]:   <sysinfo type="smbios">
Nov 03 12:20:59 user nova-compute[74960]:     <system>
Nov 03 12:20:59 user nova-compute[74960]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 12:20:59 user nova-compute[74960]:       <entry name="product">OpenStack Nova</entry>
Nov 03 12:20:59 user nova-compute[74960]:       <entry name="version">0.0.0</entry>
Nov 03 12:20:59 user nova-compute[74960]:       <entry name="serial">fffd1dd7-b8e8-435c-bdfe-6c5001b21daf</entry>
Nov 03 12:20:59 user nova-compute[74960]:       <entry name="uuid">fffd1dd7-b8e8-435c-bdfe-6c5001b21daf</entry>
Nov 03 12:20:59 user nova-compute[74960]:       <entry name="family">Virtual Machine</entry>
Nov 03 12:20:59 user nova-compute[74960]:     </system>
Nov 03 12:20:59 user nova-compute[74960]:   </sysinfo>
Nov 03 12:20:59 user nova-compute[74960]:   <os>
Nov 03 12:20:59 user nova-compute[74960]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 12:20:59 user nova-compute[74960]:     <boot dev="hd"/>
Nov 03 12:20:59 user nova-compute[74960]:     <smbios mode="sysinfo"/>
Nov 03 12:20:59 user nova-compute[74960]:   </os>
Nov 03 12:20:59 user nova-compute[74960]:   <features>
Nov 03 12:20:59 user nova-compute[74960]:     <acpi/>
Nov 03 12:20:59 user nova-compute[74960]:     <apic/>
Nov 03 12:20:59 user nova-compute[74960]:     <vmcoreinfo/>
Nov 03 12:20:59 user nova-compute[74960]:   </features>
Nov 03 12:20:59 user nova-compute[74960]:   <clock offset="utc">
Nov 03 12:20:59 user nova-compute[74960]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 12:20:59 user nova-compute[74960]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 12:20:59 user nova-compute[74960]:     <timer name="hpet" present="no"/>
Nov 03 12:20:59 user nova-compute[74960]:   </clock>
Nov 03 12:20:59 user nova-compute[74960]:   <cpu mode="custom" match="exact">
Nov 03 12:20:59 user nova-compute[74960]:     <model>Nehalem</model>
Nov 03 12:20:59 user nova-compute[74960]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 12:20:59 user nova-compute[74960]:   </cpu>
Nov 03 12:20:59 user nova-compute[74960]:   <devices>
Nov 03 12:20:59 user nova-compute[74960]:     <disk type="file" device="disk">
Nov 03 12:20:59 user nova-compute[74960]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 12:20:59 user nova-compute[74960]:       <source file="/opt/stack/data/nova/instances/fffd1dd7-b8e8-435c-bdfe-6c5001b21daf/disk"/>
Nov 03 12:20:59 user nova-compute[74960]:       <target dev="vda" bus="virtio"/>
Nov 03 12:20:59 user nova-compute[74960]:     </disk>
Nov 03 12:20:59 user nova-compute[74960]:     <interface type="ethernet">
Nov 03 12:20:59 user nova-compute[74960]:       <mac address="fa:16:3e:f5:df:89"/>
Nov 03 12:20:59 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:20:59 user nova-compute[74960]:       <mtu size="1442"/>
Nov 03 12:20:59 user nova-compute[74960]:       <target dev="tap51edd11b-19"/>
Nov 03 12:20:59 user nova-compute[74960]:     </interface>
Nov 03 12:20:59 user nova-compute[74960]:     <serial type="pty">
Nov 03 12:20:59 user nova-compute[74960]:       <log file="/opt/stack/data/nova/instances/fffd1dd7-b8e8-435c-bdfe-6c5001b21daf/console.log" append="off"/>
Nov 03 12:20:59 user nova-compute[74960]:     </serial>
Nov 03 12:20:59 user nova-compute[74960]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 12:20:59 user nova-compute[74960]:     <video>
Nov 03 12:20:59 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:20:59 user nova-compute[74960]:     </video>
Nov 03 12:20:59 user nova-compute[74960]:     <rng model="virtio">
Nov 03 12:20:59 user nova-compute[74960]:       <backend model="random">/dev/urandom</backend>
Nov 03 12:20:59 user nova-compute[74960]:     </rng>
Nov 03 12:20:59 user nova-compute[74960]:     <controller type="usb" index="0" model="none"/>
Nov 03 12:20:59 user nova-compute[74960]:     <memballoon model="virtio">
Nov 03 12:20:59 user nova-compute[74960]:       <stats period="10"/>
Nov 03 12:20:59 user nova-compute[74960]:     </memballoon>
Nov 03 12:20:59 user nova-compute[74960]:   </devices>
Nov 03 12:20:59 user nova-compute[74960]: </domain>
Nov 03 12:20:59 user nova-compute[74960]:  {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 12:20:59 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-8ae9d488-5a3b-4bd4-8964-87a920750321 tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:20:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-930355115',display_name='tempest-ServersNegativeTestJSON-server-930355115',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-930355115',id=14,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e379e295cf984ca6bf5d84a60e56382d',ramdisk_id='',reservation_id='r-w0xth1rj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-802200730',owner_user_name='tempest-ServersNegativeTestJSON-802200730-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:20:57Z,user_data=None,user_id='7a13ec06392c4ce5a81491a35a8d50d8',uuid=fffd1dd7-b8e8-435c-bdfe-6c5001b21daf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "51edd11b-19e3-40e1-a3a8-56485553eebb", "address": "fa:16:3e:f5:df:89", "network": {"id": "3a8a59cd-8076-41af-b566-9fc45a07a1df", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1235385625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e379e295cf984ca6bf5d84a60e56382d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51edd11b-19", "ovs_interfaceid": "51edd11b-19e3-40e1-a3a8-56485553eebb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 12:20:59 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-8ae9d488-5a3b-4bd4-8964-87a920750321 tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Converting VIF {"id": "51edd11b-19e3-40e1-a3a8-56485553eebb", "address": "fa:16:3e:f5:df:89", "network": {"id": "3a8a59cd-8076-41af-b566-9fc45a07a1df", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1235385625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e379e295cf984ca6bf5d84a60e56382d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51edd11b-19", "ovs_interfaceid": "51edd11b-19e3-40e1-a3a8-56485553eebb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:20:59 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-8ae9d488-5a3b-4bd4-8964-87a920750321 tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:df:89,bridge_name='br-int',has_traffic_filtering=True,id=51edd11b-19e3-40e1-a3a8-56485553eebb,network=Network(3a8a59cd-8076-41af-b566-9fc45a07a1df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51edd11b-19') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:20:59 user nova-compute[74960]: DEBUG os_vif [None req-8ae9d488-5a3b-4bd4-8964-87a920750321 tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:df:89,bridge_name='br-int',has_traffic_filtering=True,id=51edd11b-19e3-40e1-a3a8-56485553eebb,network=Network(3a8a59cd-8076-41af-b566-9fc45a07a1df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51edd11b-19') {{(pid=74960) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 12:20:59 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:20:59 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:20:59 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 12:20:59 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:20:59 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9b922a93-cdde-5ba4-9467-1f344dbde555', '_type': 'linux-noop'}}, row=False) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:20:59 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:20:59 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:20:59 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:20:59 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap51edd11b-19, may_exist=True, interface_attrs={}) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:20:59 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap51edd11b-19, col_values=(('qos', UUID('eda5f976-1fc4-48bb-9894-fefe52ab9baa')),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:20:59 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap51edd11b-19, col_values=(('external_ids', {'iface-id': '51edd11b-19e3-40e1-a3a8-56485553eebb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f5:df:89', 'vm-uuid': 'fffd1dd7-b8e8-435c-bdfe-6c5001b21daf'}),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:20:59 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:20:59 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:20:59 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:20:59 user nova-compute[74960]: INFO os_vif [None req-8ae9d488-5a3b-4bd4-8964-87a920750321 tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:df:89,bridge_name='br-int',has_traffic_filtering=True,id=51edd11b-19e3-40e1-a3a8-56485553eebb,network=Network(3a8a59cd-8076-41af-b566-9fc45a07a1df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51edd11b-19')
Nov 03 12:20:59 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-8ae9d488-5a3b-4bd4-8964-87a920750321 tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] No BDM found with device name vda, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:20:59 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-8ae9d488-5a3b-4bd4-8964-87a920750321 tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] No VIF found with MAC fa:16:3e:f5:df:89, not building metadata {{(pid=74960) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 12:20:59 user nova-compute[74960]: DEBUG nova.network.neutron [req-6748f6ae-ff42-47c1-8061-36b2442c828a req-fd7a5199-8b7d-4394-a44b-ad2e54c1a62f service nova] [instance: fffd1dd7-b8e8-435c-bdfe-6c5001b21daf] Updated VIF entry in instance network info cache for port 51edd11b-19e3-40e1-a3a8-56485553eebb. {{(pid=74960) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 12:20:59 user nova-compute[74960]: DEBUG nova.network.neutron [req-6748f6ae-ff42-47c1-8061-36b2442c828a req-fd7a5199-8b7d-4394-a44b-ad2e54c1a62f service nova] [instance: fffd1dd7-b8e8-435c-bdfe-6c5001b21daf] Updating instance_info_cache with network_info: [{"id": "51edd11b-19e3-40e1-a3a8-56485553eebb", "address": "fa:16:3e:f5:df:89", "network": {"id": "3a8a59cd-8076-41af-b566-9fc45a07a1df", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1235385625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e379e295cf984ca6bf5d84a60e56382d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51edd11b-19", "ovs_interfaceid": "51edd11b-19e3-40e1-a3a8-56485553eebb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:20:59 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-6748f6ae-ff42-47c1-8061-36b2442c828a req-fd7a5199-8b7d-4394-a44b-ad2e54c1a62f service nova] Releasing lock "refresh_cache-fffd1dd7-b8e8-435c-bdfe-6c5001b21daf" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:21:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:21:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:21:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:21:01 user nova-compute[74960]: DEBUG nova.compute.manager [req-7a71d8b0-3f32-4f66-8aac-bd09aacfad7c req-510c4b17-2ac3-4e40-81bd-a89252103328 service nova] [instance: fffd1dd7-b8e8-435c-bdfe-6c5001b21daf] Received event network-vif-plugged-51edd11b-19e3-40e1-a3a8-56485553eebb {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:21:01 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-7a71d8b0-3f32-4f66-8aac-bd09aacfad7c req-510c4b17-2ac3-4e40-81bd-a89252103328 service nova] Acquiring lock "fffd1dd7-b8e8-435c-bdfe-6c5001b21daf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:21:01 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-7a71d8b0-3f32-4f66-8aac-bd09aacfad7c req-510c4b17-2ac3-4e40-81bd-a89252103328 service nova] Lock "fffd1dd7-b8e8-435c-bdfe-6c5001b21daf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:21:01 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-7a71d8b0-3f32-4f66-8aac-bd09aacfad7c req-510c4b17-2ac3-4e40-81bd-a89252103328 service nova] Lock "fffd1dd7-b8e8-435c-bdfe-6c5001b21daf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:21:01 user nova-compute[74960]: DEBUG nova.compute.manager [req-7a71d8b0-3f32-4f66-8aac-bd09aacfad7c req-510c4b17-2ac3-4e40-81bd-a89252103328 service nova] [instance: fffd1dd7-b8e8-435c-bdfe-6c5001b21daf] No waiting events found dispatching network-vif-plugged-51edd11b-19e3-40e1-a3a8-56485553eebb {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:21:01 user nova-compute[74960]: WARNING nova.compute.manager [req-7a71d8b0-3f32-4f66-8aac-bd09aacfad7c req-510c4b17-2ac3-4e40-81bd-a89252103328 service nova] [instance: fffd1dd7-b8e8-435c-bdfe-6c5001b21daf] Received unexpected event network-vif-plugged-51edd11b-19e3-40e1-a3a8-56485553eebb for instance with vm_state building and task_state spawning.
Nov 03 12:21:01 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:21:01 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:21:01 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:21:02 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c0300ecf-4380-4fbd-9ba7-7d9dc6d79b0a tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Acquiring lock "0a520c41-19c0-47ba-ada8-023ee9c12ca6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:21:02 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c0300ecf-4380-4fbd-9ba7-7d9dc6d79b0a tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Lock "0a520c41-19c0-47ba-ada8-023ee9c12ca6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:21:02 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c0300ecf-4380-4fbd-9ba7-7d9dc6d79b0a tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Acquiring lock "0a520c41-19c0-47ba-ada8-023ee9c12ca6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:21:02 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c0300ecf-4380-4fbd-9ba7-7d9dc6d79b0a tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Lock "0a520c41-19c0-47ba-ada8-023ee9c12ca6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:21:02 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c0300ecf-4380-4fbd-9ba7-7d9dc6d79b0a tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Lock "0a520c41-19c0-47ba-ada8-023ee9c12ca6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:21:02 user nova-compute[74960]: INFO nova.compute.manager [None req-c0300ecf-4380-4fbd-9ba7-7d9dc6d79b0a tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] Terminating instance
Nov 03 12:21:02 user nova-compute[74960]: DEBUG nova.compute.manager [None req-c0300ecf-4380-4fbd-9ba7-7d9dc6d79b0a tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] Start destroying the instance on the hypervisor. {{(pid=74960) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 12:21:02 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:21:02 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:21:02 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:21:02 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:21:02 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:21:02 user nova-compute[74960]: DEBUG nova.compute.manager [req-3d66dd7c-e7ed-49ee-8bb1-ce96ab49fe22 req-f4587bfd-1744-499e-b1c2-4d2a6cc349ed service nova] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] Received event network-vif-unplugged-3e126a57-0883-4997-9c99-d25c9c6fc102 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:21:02 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-3d66dd7c-e7ed-49ee-8bb1-ce96ab49fe22 req-f4587bfd-1744-499e-b1c2-4d2a6cc349ed service nova] Acquiring lock "0a520c41-19c0-47ba-ada8-023ee9c12ca6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:21:02 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-3d66dd7c-e7ed-49ee-8bb1-ce96ab49fe22 req-f4587bfd-1744-499e-b1c2-4d2a6cc349ed service nova] Lock "0a520c41-19c0-47ba-ada8-023ee9c12ca6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:21:02 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-3d66dd7c-e7ed-49ee-8bb1-ce96ab49fe22 req-f4587bfd-1744-499e-b1c2-4d2a6cc349ed service nova] Lock "0a520c41-19c0-47ba-ada8-023ee9c12ca6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:21:02 user nova-compute[74960]: DEBUG nova.compute.manager [req-3d66dd7c-e7ed-49ee-8bb1-ce96ab49fe22 req-f4587bfd-1744-499e-b1c2-4d2a6cc349ed service nova] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] No waiting events found dispatching network-vif-unplugged-3e126a57-0883-4997-9c99-d25c9c6fc102 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:21:02 user nova-compute[74960]: DEBUG nova.compute.manager [req-3d66dd7c-e7ed-49ee-8bb1-ce96ab49fe22 req-f4587bfd-1744-499e-b1c2-4d2a6cc349ed service nova] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] Received event network-vif-unplugged-3e126a57-0883-4997-9c99-d25c9c6fc102 for instance with task_state deleting. {{(pid=74960) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 12:21:03 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:21:03 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:21:03 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:21:03 user nova-compute[74960]: DEBUG nova.compute.manager [req-36d78739-964f-4a2c-9751-9f37b001a42d req-7e7d79a9-35be-4854-ae28-aabf80773658 service nova] [instance: fffd1dd7-b8e8-435c-bdfe-6c5001b21daf] Received event network-vif-plugged-51edd11b-19e3-40e1-a3a8-56485553eebb {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:21:03 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-36d78739-964f-4a2c-9751-9f37b001a42d req-7e7d79a9-35be-4854-ae28-aabf80773658 service nova] Acquiring lock "fffd1dd7-b8e8-435c-bdfe-6c5001b21daf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:21:03 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-36d78739-964f-4a2c-9751-9f37b001a42d req-7e7d79a9-35be-4854-ae28-aabf80773658 service nova] Lock "fffd1dd7-b8e8-435c-bdfe-6c5001b21daf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:21:03 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-36d78739-964f-4a2c-9751-9f37b001a42d req-7e7d79a9-35be-4854-ae28-aabf80773658 service nova] Lock "fffd1dd7-b8e8-435c-bdfe-6c5001b21daf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:21:03 user nova-compute[74960]: DEBUG nova.compute.manager [req-36d78739-964f-4a2c-9751-9f37b001a42d req-7e7d79a9-35be-4854-ae28-aabf80773658 service nova] [instance: fffd1dd7-b8e8-435c-bdfe-6c5001b21daf] No waiting events found dispatching network-vif-plugged-51edd11b-19e3-40e1-a3a8-56485553eebb {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:21:03 user nova-compute[74960]: WARNING nova.compute.manager [req-36d78739-964f-4a2c-9751-9f37b001a42d req-7e7d79a9-35be-4854-ae28-aabf80773658 service nova] [instance: fffd1dd7-b8e8-435c-bdfe-6c5001b21daf] Received unexpected event network-vif-plugged-51edd11b-19e3-40e1-a3a8-56485553eebb for instance with vm_state building and task_state spawning.
Nov 03 12:21:03 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:21:03 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] Instance destroyed successfully.
Nov 03 12:21:03 user nova-compute[74960]: DEBUG nova.objects.instance [None req-c0300ecf-4380-4fbd-9ba7-7d9dc6d79b0a tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Lazy-loading 'resources' on Instance uuid 0a520c41-19c0-47ba-ada8-023ee9c12ca6 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:21:03 user nova-compute[74960]: DEBUG nova.compute.manager [None req-8ae9d488-5a3b-4bd4-8964-87a920750321 tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] [instance: fffd1dd7-b8e8-435c-bdfe-6c5001b21daf] Instance event wait completed in 0 seconds for  {{(pid=74960) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 12:21:03 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-8ae9d488-5a3b-4bd4-8964-87a920750321 tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] [instance: fffd1dd7-b8e8-435c-bdfe-6c5001b21daf] Guest created on hypervisor {{(pid=74960) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 12:21:03 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-c0300ecf-4380-4fbd-9ba7-7d9dc6d79b0a tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T12:17:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-718860820',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-718860820',id=7,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLwaiWOkf4g+xGnCHIQ6PEXYDCQvWANu1aoEqkgH8PkfR56o+3+BPp4uxgAn5C+zZDpe3SkZ06KyunCKlhSZpIVyhUY157dTlXxkUygCex89TiMcoPvBPFCYXJkTY4on1A==',key_name='tempest-keypair-1456184094',keypairs=<?>,launch_index=0,launched_at=2023-11-03T12:17:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3390632661124edd9894dabac0053fa9',ramdisk_id='',reservation_id='r-zkhug3rc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1950029920',owner_user_name='tempest-TaggedAttachmentsTest-1950029920-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T12:17:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9da58bde19c3434f9811cb80ed39dea9',uuid=0a520c41-19c0-47ba-ada8-023ee9c12ca6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3e126a57-0883-4997-9c99-d25c9c6fc102", "address": "fa:16:3e:f9:07:9b", "network": {"id": "65e1589f-341c-4cc8-a8e6-5b61544daf55", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1130686752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3390632661124edd9894dabac0053fa9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e126a57-08", "ovs_interfaceid": "3e126a57-0883-4997-9c99-d25c9c6fc102", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 12:21:03 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-c0300ecf-4380-4fbd-9ba7-7d9dc6d79b0a tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Converting VIF {"id": "3e126a57-0883-4997-9c99-d25c9c6fc102", "address": "fa:16:3e:f9:07:9b", "network": {"id": "65e1589f-341c-4cc8-a8e6-5b61544daf55", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1130686752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3390632661124edd9894dabac0053fa9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e126a57-08", "ovs_interfaceid": "3e126a57-0883-4997-9c99-d25c9c6fc102", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:21:03 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-c0300ecf-4380-4fbd-9ba7-7d9dc6d79b0a tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f9:07:9b,bridge_name='br-int',has_traffic_filtering=True,id=3e126a57-0883-4997-9c99-d25c9c6fc102,network=Network(65e1589f-341c-4cc8-a8e6-5b61544daf55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e126a57-08') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:21:03 user nova-compute[74960]: DEBUG os_vif [None req-c0300ecf-4380-4fbd-9ba7-7d9dc6d79b0a tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:07:9b,bridge_name='br-int',has_traffic_filtering=True,id=3e126a57-0883-4997-9c99-d25c9c6fc102,network=Network(65e1589f-341c-4cc8-a8e6-5b61544daf55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e126a57-08') {{(pid=74960) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 12:21:03 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:21:03 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3e126a57-08, bridge=br-int, if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:21:03 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:21:03 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:21:03 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:21:03 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=17dcad70-cdf6-4265-9d5b-14bf165c2361) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:21:03 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:21:03 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: fffd1dd7-b8e8-435c-bdfe-6c5001b21daf] Instance spawned successfully.
Nov 03 12:21:03 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-8ae9d488-5a3b-4bd4-8964-87a920750321 tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] [instance: fffd1dd7-b8e8-435c-bdfe-6c5001b21daf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 12:21:03 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:21:03 user nova-compute[74960]: INFO os_vif [None req-c0300ecf-4380-4fbd-9ba7-7d9dc6d79b0a tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:07:9b,bridge_name='br-int',has_traffic_filtering=True,id=3e126a57-0883-4997-9c99-d25c9c6fc102,network=Network(65e1589f-341c-4cc8-a8e6-5b61544daf55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e126a57-08')
Nov 03 12:21:03 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-c0300ecf-4380-4fbd-9ba7-7d9dc6d79b0a tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] Deleting instance files /opt/stack/data/nova/instances/0a520c41-19c0-47ba-ada8-023ee9c12ca6_del
Nov 03 12:21:03 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-c0300ecf-4380-4fbd-9ba7-7d9dc6d79b0a tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] Deletion of /opt/stack/data/nova/instances/0a520c41-19c0-47ba-ada8-023ee9c12ca6_del complete
Nov 03 12:21:03 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-8ae9d488-5a3b-4bd4-8964-87a920750321 tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] [instance: fffd1dd7-b8e8-435c-bdfe-6c5001b21daf] Found default for hw_cdrom_bus of ide {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:21:03 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-8ae9d488-5a3b-4bd4-8964-87a920750321 tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] [instance: fffd1dd7-b8e8-435c-bdfe-6c5001b21daf] Found default for hw_disk_bus of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:21:03 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-8ae9d488-5a3b-4bd4-8964-87a920750321 tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] [instance: fffd1dd7-b8e8-435c-bdfe-6c5001b21daf] Found default for hw_input_bus of None {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:21:03 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-8ae9d488-5a3b-4bd4-8964-87a920750321 tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] [instance: fffd1dd7-b8e8-435c-bdfe-6c5001b21daf] Found default for hw_pointer_model of None {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:21:03 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-8ae9d488-5a3b-4bd4-8964-87a920750321 tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] [instance: fffd1dd7-b8e8-435c-bdfe-6c5001b21daf] Found default for hw_video_model of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:21:03 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-8ae9d488-5a3b-4bd4-8964-87a920750321 tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] [instance: fffd1dd7-b8e8-435c-bdfe-6c5001b21daf] Found default for hw_vif_model of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:21:03 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:21:03 user nova-compute[74960]: INFO nova.compute.manager [None req-c0300ecf-4380-4fbd-9ba7-7d9dc6d79b0a tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] Took 1.04 seconds to destroy the instance on the hypervisor.
Nov 03 12:21:03 user nova-compute[74960]: DEBUG oslo.service.loopingcall [None req-c0300ecf-4380-4fbd-9ba7-7d9dc6d79b0a tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74960) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 12:21:03 user nova-compute[74960]: DEBUG nova.compute.manager [-] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] Deallocating network for instance {{(pid=74960) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 12:21:03 user nova-compute[74960]: DEBUG nova.network.neutron [-] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] deallocate_for_instance() {{(pid=74960) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 12:21:03 user nova-compute[74960]: INFO nova.compute.manager [None req-8ae9d488-5a3b-4bd4-8964-87a920750321 tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] [instance: fffd1dd7-b8e8-435c-bdfe-6c5001b21daf] Took 6.18 seconds to spawn the instance on the hypervisor.
Nov 03 12:21:03 user nova-compute[74960]: DEBUG nova.compute.manager [None req-8ae9d488-5a3b-4bd4-8964-87a920750321 tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] [instance: fffd1dd7-b8e8-435c-bdfe-6c5001b21daf] Checking state {{(pid=74960) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 12:21:03 user nova-compute[74960]: INFO nova.compute.manager [None req-8ae9d488-5a3b-4bd4-8964-87a920750321 tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] [instance: fffd1dd7-b8e8-435c-bdfe-6c5001b21daf] Took 7.23 seconds to build instance.
Nov 03 12:21:03 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-8ae9d488-5a3b-4bd4-8964-87a920750321 tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Lock "fffd1dd7-b8e8-435c-bdfe-6c5001b21daf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.354s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:21:03 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:21:03 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:21:04 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:21:04 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:21:04 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:21:04 user nova-compute[74960]: DEBUG nova.network.neutron [-] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] Updating instance_info_cache with network_info: [] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:21:04 user nova-compute[74960]: DEBUG nova.compute.manager [req-d0a46eaa-4ec6-4df2-bc1a-b777c1883d4d req-dce3457e-8d9e-407b-8d1d-ba8370e18e80 service nova] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] Received event network-vif-deleted-3e126a57-0883-4997-9c99-d25c9c6fc102 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:21:04 user nova-compute[74960]: INFO nova.compute.manager [req-d0a46eaa-4ec6-4df2-bc1a-b777c1883d4d req-dce3457e-8d9e-407b-8d1d-ba8370e18e80 service nova] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] Neutron deleted interface 3e126a57-0883-4997-9c99-d25c9c6fc102; detaching it from the instance and deleting it from the info cache
Nov 03 12:21:04 user nova-compute[74960]: DEBUG nova.network.neutron [req-d0a46eaa-4ec6-4df2-bc1a-b777c1883d4d req-dce3457e-8d9e-407b-8d1d-ba8370e18e80 service nova] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] Updating instance_info_cache with network_info: [] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:21:04 user nova-compute[74960]: DEBUG nova.compute.manager [req-ff92205c-4498-449b-8228-7e7f65162438 req-3c9de351-ebbb-4ff1-895c-f1ced1c400ed service nova] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] Received event network-vif-plugged-3e126a57-0883-4997-9c99-d25c9c6fc102 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:21:04 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-ff92205c-4498-449b-8228-7e7f65162438 req-3c9de351-ebbb-4ff1-895c-f1ced1c400ed service nova] Acquiring lock "0a520c41-19c0-47ba-ada8-023ee9c12ca6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:21:04 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-ff92205c-4498-449b-8228-7e7f65162438 req-3c9de351-ebbb-4ff1-895c-f1ced1c400ed service nova] Lock "0a520c41-19c0-47ba-ada8-023ee9c12ca6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:21:04 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-ff92205c-4498-449b-8228-7e7f65162438 req-3c9de351-ebbb-4ff1-895c-f1ced1c400ed service nova] Lock "0a520c41-19c0-47ba-ada8-023ee9c12ca6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:21:04 user nova-compute[74960]: DEBUG nova.compute.manager [req-ff92205c-4498-449b-8228-7e7f65162438 req-3c9de351-ebbb-4ff1-895c-f1ced1c400ed service nova] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] No waiting events found dispatching network-vif-plugged-3e126a57-0883-4997-9c99-d25c9c6fc102 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:21:04 user nova-compute[74960]: WARNING nova.compute.manager [req-ff92205c-4498-449b-8228-7e7f65162438 req-3c9de351-ebbb-4ff1-895c-f1ced1c400ed service nova] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] Received unexpected event network-vif-plugged-3e126a57-0883-4997-9c99-d25c9c6fc102 for instance with vm_state active and task_state deleting.
Nov 03 12:21:04 user nova-compute[74960]: DEBUG nova.compute.manager [req-ff92205c-4498-449b-8228-7e7f65162438 req-3c9de351-ebbb-4ff1-895c-f1ced1c400ed service nova] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] Received event network-vif-plugged-3e126a57-0883-4997-9c99-d25c9c6fc102 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:21:04 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-ff92205c-4498-449b-8228-7e7f65162438 req-3c9de351-ebbb-4ff1-895c-f1ced1c400ed service nova] Acquiring lock "0a520c41-19c0-47ba-ada8-023ee9c12ca6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:21:04 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-ff92205c-4498-449b-8228-7e7f65162438 req-3c9de351-ebbb-4ff1-895c-f1ced1c400ed service nova] Lock "0a520c41-19c0-47ba-ada8-023ee9c12ca6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:21:04 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-ff92205c-4498-449b-8228-7e7f65162438 req-3c9de351-ebbb-4ff1-895c-f1ced1c400ed service nova] Lock "0a520c41-19c0-47ba-ada8-023ee9c12ca6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:21:04 user nova-compute[74960]: DEBUG nova.compute.manager [req-ff92205c-4498-449b-8228-7e7f65162438 req-3c9de351-ebbb-4ff1-895c-f1ced1c400ed service nova] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] No waiting events found dispatching network-vif-plugged-3e126a57-0883-4997-9c99-d25c9c6fc102 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:21:04 user nova-compute[74960]: WARNING nova.compute.manager [req-ff92205c-4498-449b-8228-7e7f65162438 req-3c9de351-ebbb-4ff1-895c-f1ced1c400ed service nova] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] Received unexpected event network-vif-plugged-3e126a57-0883-4997-9c99-d25c9c6fc102 for instance with vm_state active and task_state deleting.
Nov 03 12:21:04 user nova-compute[74960]: DEBUG nova.compute.manager [req-ff92205c-4498-449b-8228-7e7f65162438 req-3c9de351-ebbb-4ff1-895c-f1ced1c400ed service nova] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] Received event network-vif-plugged-3e126a57-0883-4997-9c99-d25c9c6fc102 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:21:04 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-ff92205c-4498-449b-8228-7e7f65162438 req-3c9de351-ebbb-4ff1-895c-f1ced1c400ed service nova] Acquiring lock "0a520c41-19c0-47ba-ada8-023ee9c12ca6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:21:04 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-ff92205c-4498-449b-8228-7e7f65162438 req-3c9de351-ebbb-4ff1-895c-f1ced1c400ed service nova] Lock "0a520c41-19c0-47ba-ada8-023ee9c12ca6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:21:04 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-ff92205c-4498-449b-8228-7e7f65162438 req-3c9de351-ebbb-4ff1-895c-f1ced1c400ed service nova] Lock "0a520c41-19c0-47ba-ada8-023ee9c12ca6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:21:04 user nova-compute[74960]: DEBUG nova.compute.manager [req-ff92205c-4498-449b-8228-7e7f65162438 req-3c9de351-ebbb-4ff1-895c-f1ced1c400ed service nova] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] No waiting events found dispatching network-vif-plugged-3e126a57-0883-4997-9c99-d25c9c6fc102 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:21:04 user nova-compute[74960]: WARNING nova.compute.manager [req-ff92205c-4498-449b-8228-7e7f65162438 req-3c9de351-ebbb-4ff1-895c-f1ced1c400ed service nova] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] Received unexpected event network-vif-plugged-3e126a57-0883-4997-9c99-d25c9c6fc102 for instance with vm_state active and task_state deleting.
Nov 03 12:21:04 user nova-compute[74960]: DEBUG nova.compute.manager [req-ff92205c-4498-449b-8228-7e7f65162438 req-3c9de351-ebbb-4ff1-895c-f1ced1c400ed service nova] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] Received event network-vif-unplugged-3e126a57-0883-4997-9c99-d25c9c6fc102 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:21:04 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-ff92205c-4498-449b-8228-7e7f65162438 req-3c9de351-ebbb-4ff1-895c-f1ced1c400ed service nova] Acquiring lock "0a520c41-19c0-47ba-ada8-023ee9c12ca6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:21:04 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-ff92205c-4498-449b-8228-7e7f65162438 req-3c9de351-ebbb-4ff1-895c-f1ced1c400ed service nova] Lock "0a520c41-19c0-47ba-ada8-023ee9c12ca6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:21:04 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-ff92205c-4498-449b-8228-7e7f65162438 req-3c9de351-ebbb-4ff1-895c-f1ced1c400ed service nova] Lock "0a520c41-19c0-47ba-ada8-023ee9c12ca6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:21:04 user nova-compute[74960]: DEBUG nova.compute.manager [req-ff92205c-4498-449b-8228-7e7f65162438 req-3c9de351-ebbb-4ff1-895c-f1ced1c400ed service nova] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] No waiting events found dispatching network-vif-unplugged-3e126a57-0883-4997-9c99-d25c9c6fc102 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:21:04 user nova-compute[74960]: DEBUG nova.compute.manager [req-ff92205c-4498-449b-8228-7e7f65162438 req-3c9de351-ebbb-4ff1-895c-f1ced1c400ed service nova] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] Received event network-vif-unplugged-3e126a57-0883-4997-9c99-d25c9c6fc102 for instance with task_state deleting. {{(pid=74960) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 12:21:04 user nova-compute[74960]: DEBUG nova.compute.manager [req-ff92205c-4498-449b-8228-7e7f65162438 req-3c9de351-ebbb-4ff1-895c-f1ced1c400ed service nova] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] Received event network-vif-plugged-3e126a57-0883-4997-9c99-d25c9c6fc102 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:21:04 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-ff92205c-4498-449b-8228-7e7f65162438 req-3c9de351-ebbb-4ff1-895c-f1ced1c400ed service nova] Acquiring lock "0a520c41-19c0-47ba-ada8-023ee9c12ca6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:21:04 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-ff92205c-4498-449b-8228-7e7f65162438 req-3c9de351-ebbb-4ff1-895c-f1ced1c400ed service nova] Lock "0a520c41-19c0-47ba-ada8-023ee9c12ca6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:21:04 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-ff92205c-4498-449b-8228-7e7f65162438 req-3c9de351-ebbb-4ff1-895c-f1ced1c400ed service nova] Lock "0a520c41-19c0-47ba-ada8-023ee9c12ca6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:21:04 user nova-compute[74960]: DEBUG nova.compute.manager [req-ff92205c-4498-449b-8228-7e7f65162438 req-3c9de351-ebbb-4ff1-895c-f1ced1c400ed service nova] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] No waiting events found dispatching network-vif-plugged-3e126a57-0883-4997-9c99-d25c9c6fc102 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:21:04 user nova-compute[74960]: WARNING nova.compute.manager [req-ff92205c-4498-449b-8228-7e7f65162438 req-3c9de351-ebbb-4ff1-895c-f1ced1c400ed service nova] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] Received unexpected event network-vif-plugged-3e126a57-0883-4997-9c99-d25c9c6fc102 for instance with vm_state active and task_state deleting.
Nov 03 12:21:04 user nova-compute[74960]: INFO nova.compute.manager [-] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] Took 1.36 seconds to deallocate network for instance.
Nov 03 12:21:04 user nova-compute[74960]: DEBUG nova.compute.manager [req-d0a46eaa-4ec6-4df2-bc1a-b777c1883d4d req-dce3457e-8d9e-407b-8d1d-ba8370e18e80 service nova] [instance: 0a520c41-19c0-47ba-ada8-023ee9c12ca6] Detach interface failed, port_id=3e126a57-0883-4997-9c99-d25c9c6fc102, reason: Instance 0a520c41-19c0-47ba-ada8-023ee9c12ca6 could not be found. {{(pid=74960) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 03 12:21:04 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c0300ecf-4380-4fbd-9ba7-7d9dc6d79b0a tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:21:04 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c0300ecf-4380-4fbd-9ba7-7d9dc6d79b0a tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:21:05 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-c0300ecf-4380-4fbd-9ba7-7d9dc6d79b0a tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:21:05 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-c0300ecf-4380-4fbd-9ba7-7d9dc6d79b0a tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:21:05 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c0300ecf-4380-4fbd-9ba7-7d9dc6d79b0a tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.452s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:21:05 user nova-compute[74960]: INFO nova.scheduler.client.report [None req-c0300ecf-4380-4fbd-9ba7-7d9dc6d79b0a tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Deleted allocations for instance 0a520c41-19c0-47ba-ada8-023ee9c12ca6
Nov 03 12:21:05 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c0300ecf-4380-4fbd-9ba7-7d9dc6d79b0a tempest-TaggedAttachmentsTest-1950029920 tempest-TaggedAttachmentsTest-1950029920-project-member] Lock "0a520c41-19c0-47ba-ada8-023ee9c12ca6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.160s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:21:07 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:21:08 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:21:09 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:21:09 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:21:09 user nova-compute[74960]: DEBUG nova.objects.instance [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Lazy-loading 'pci_requests' on Instance uuid 7e5ec97f-80c4-4499-94bf-2584fc0eae03 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:21:09 user nova-compute[74960]: DEBUG nova.objects.instance [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Lazy-loading 'numa_topology' on Instance uuid 7e5ec97f-80c4-4499-94bf-2584fc0eae03 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:21:09 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74960) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 12:21:09 user nova-compute[74960]: INFO nova.compute.claims [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Claim successful on node user
Nov 03 12:21:10 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:21:10 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:21:10 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.558s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:21:10 user nova-compute[74960]: INFO nova.network.neutron [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Updating port e91b8148-e2ff-4124-9799-ba4efae837ff with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 03 12:21:11 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Acquiring lock "refresh_cache-7e5ec97f-80c4-4499-94bf-2584fc0eae03" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:21:11 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Acquired lock "refresh_cache-7e5ec97f-80c4-4499-94bf-2584fc0eae03" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:21:11 user nova-compute[74960]: DEBUG nova.network.neutron [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Building network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 12:21:11 user nova-compute[74960]: DEBUG nova.compute.manager [req-64bd86c7-be55-4232-8770-0d31fce8321d req-c6586d48-ace2-446c-b26a-1c700e82afc8 service nova] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Received event network-changed-e91b8148-e2ff-4124-9799-ba4efae837ff {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:21:11 user nova-compute[74960]: DEBUG nova.compute.manager [req-64bd86c7-be55-4232-8770-0d31fce8321d req-c6586d48-ace2-446c-b26a-1c700e82afc8 service nova] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Refreshing instance network info cache due to event network-changed-e91b8148-e2ff-4124-9799-ba4efae837ff. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 12:21:11 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-64bd86c7-be55-4232-8770-0d31fce8321d req-c6586d48-ace2-446c-b26a-1c700e82afc8 service nova] Acquiring lock "refresh_cache-7e5ec97f-80c4-4499-94bf-2584fc0eae03" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:21:11 user nova-compute[74960]: DEBUG nova.network.neutron [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Updating instance_info_cache with network_info: [{"id": "e91b8148-e2ff-4124-9799-ba4efae837ff", "address": "fa:16:3e:40:35:d4", "network": {"id": "c03e854d-75a3-4e81-9cdf-f1139841266c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1632999031-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c216dd7629274eafbf0a5968ff2378a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape91b8148-e2", "ovs_interfaceid": "e91b8148-e2ff-4124-9799-ba4efae837ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:21:11 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Releasing lock "refresh_cache-7e5ec97f-80c4-4499-94bf-2584fc0eae03" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:21:11 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Creating instance directory {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 12:21:11 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Creating image(s)
Nov 03 12:21:11 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Acquiring lock "/opt/stack/data/nova/instances/7e5ec97f-80c4-4499-94bf-2584fc0eae03/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:21:11 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Lock "/opt/stack/data/nova/instances/7e5ec97f-80c4-4499-94bf-2584fc0eae03/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:21:11 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Lock "/opt/stack/data/nova/instances/7e5ec97f-80c4-4499-94bf-2584fc0eae03/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:21:11 user nova-compute[74960]: DEBUG nova.objects.instance [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Lazy-loading 'trusted_certs' on Instance uuid 7e5ec97f-80c4-4499-94bf-2584fc0eae03 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:21:11 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-64bd86c7-be55-4232-8770-0d31fce8321d req-c6586d48-ace2-446c-b26a-1c700e82afc8 service nova] Acquired lock "refresh_cache-7e5ec97f-80c4-4499-94bf-2584fc0eae03" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:21:11 user nova-compute[74960]: DEBUG nova.network.neutron [req-64bd86c7-be55-4232-8770-0d31fce8321d req-c6586d48-ace2-446c-b26a-1c700e82afc8 service nova] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Refreshing network info cache for port e91b8148-e2ff-4124-9799-ba4efae837ff {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 12:21:11 user nova-compute[74960]: DEBUG nova.objects.base [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Object Instance<7e5ec97f-80c4-4499-94bf-2584fc0eae03> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74960) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 12:21:11 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Acquiring lock "900987749872ba3cca2aaec0ad1ec322ab474b04" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:21:11 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Lock "900987749872ba3cca2aaec0ad1ec322ab474b04" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:21:12 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/900987749872ba3cca2aaec0ad1ec322ab474b04.part --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:21:13 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:21:13 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/900987749872ba3cca2aaec0ad1ec322ab474b04.part --force-share --output=json" returned: 0 in 0.183s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:21:13 user nova-compute[74960]: DEBUG nova.virt.images [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] 8e8d35fe-058b-4938-9a8f-781ffb884bad was qcow2, converting to raw {{(pid=74960) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 03 12:21:13 user nova-compute[74960]: DEBUG nova.privsep.utils [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74960) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 03 12:21:13 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/900987749872ba3cca2aaec0ad1ec322ab474b04.part /opt/stack/data/nova/instances/_base/900987749872ba3cca2aaec0ad1ec322ab474b04.converted {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:21:13 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:21:13 user nova-compute[74960]: DEBUG nova.network.neutron [req-64bd86c7-be55-4232-8770-0d31fce8321d req-c6586d48-ace2-446c-b26a-1c700e82afc8 service nova] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Updated VIF entry in instance network info cache for port e91b8148-e2ff-4124-9799-ba4efae837ff. {{(pid=74960) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 12:21:13 user nova-compute[74960]: DEBUG nova.network.neutron [req-64bd86c7-be55-4232-8770-0d31fce8321d req-c6586d48-ace2-446c-b26a-1c700e82afc8 service nova] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Updating instance_info_cache with network_info: [{"id": "e91b8148-e2ff-4124-9799-ba4efae837ff", "address": "fa:16:3e:40:35:d4", "network": {"id": "c03e854d-75a3-4e81-9cdf-f1139841266c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1632999031-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c216dd7629274eafbf0a5968ff2378a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape91b8148-e2", "ovs_interfaceid": "e91b8148-e2ff-4124-9799-ba4efae837ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:21:13 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/900987749872ba3cca2aaec0ad1ec322ab474b04.part /opt/stack/data/nova/instances/_base/900987749872ba3cca2aaec0ad1ec322ab474b04.converted" returned: 0 in 0.294s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:21:13 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/900987749872ba3cca2aaec0ad1ec322ab474b04.converted --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:21:13 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-64bd86c7-be55-4232-8770-0d31fce8321d req-c6586d48-ace2-446c-b26a-1c700e82afc8 service nova] Releasing lock "refresh_cache-7e5ec97f-80c4-4499-94bf-2584fc0eae03" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:21:13 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/900987749872ba3cca2aaec0ad1ec322ab474b04.converted --force-share --output=json" returned: 0 in 0.274s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:21:13 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Lock "900987749872ba3cca2aaec0ad1ec322ab474b04" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.065s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:21:13 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/900987749872ba3cca2aaec0ad1ec322ab474b04 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:21:13 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/900987749872ba3cca2aaec0ad1ec322ab474b04 --force-share --output=json" returned: 0 in 0.194s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:21:13 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Acquiring lock "900987749872ba3cca2aaec0ad1ec322ab474b04" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:21:13 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Lock "900987749872ba3cca2aaec0ad1ec322ab474b04" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:21:13 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/900987749872ba3cca2aaec0ad1ec322ab474b04 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:21:14 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/900987749872ba3cca2aaec0ad1ec322ab474b04 --force-share --output=json" returned: 0 in 0.206s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:21:14 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/900987749872ba3cca2aaec0ad1ec322ab474b04,backing_fmt=raw /opt/stack/data/nova/instances/7e5ec97f-80c4-4499-94bf-2584fc0eae03/disk 1073741824 {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:21:14 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/900987749872ba3cca2aaec0ad1ec322ab474b04,backing_fmt=raw /opt/stack/data/nova/instances/7e5ec97f-80c4-4499-94bf-2584fc0eae03/disk 1073741824" returned: 0 in 0.049s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:21:14 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Lock "900987749872ba3cca2aaec0ad1ec322ab474b04" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:21:14 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/900987749872ba3cca2aaec0ad1ec322ab474b04 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:21:14 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/900987749872ba3cca2aaec0ad1ec322ab474b04 --force-share --output=json" returned: 0 in 0.188s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:21:14 user nova-compute[74960]: DEBUG nova.objects.instance [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Lazy-loading 'migration_context' on Instance uuid 7e5ec97f-80c4-4499-94bf-2584fc0eae03 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:21:14 user nova-compute[74960]: DEBUG nova.objects.base [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Object Instance<7e5ec97f-80c4-4499-94bf-2584fc0eae03> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74960) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 12:21:14 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Rebasing disk image.
Nov 03 12:21:14 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:21:14 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.181s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:21:14 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 -F raw /opt/stack/data/nova/instances/7e5ec97f-80c4-4499-94bf-2584fc0eae03/disk {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:21:14 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c879f9e7-ed22-4c77-a4d6-b094ed239517 tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] Acquiring lock "7f7fabc2-5e1b-441c-a693-9956470359ea" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:21:14 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c879f9e7-ed22-4c77-a4d6-b094ed239517 tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] Lock "7f7fabc2-5e1b-441c-a693-9956470359ea" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:21:14 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c879f9e7-ed22-4c77-a4d6-b094ed239517 tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] Acquiring lock "7f7fabc2-5e1b-441c-a693-9956470359ea-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:21:14 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c879f9e7-ed22-4c77-a4d6-b094ed239517 tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] Lock "7f7fabc2-5e1b-441c-a693-9956470359ea-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:21:14 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c879f9e7-ed22-4c77-a4d6-b094ed239517 tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] Lock "7f7fabc2-5e1b-441c-a693-9956470359ea-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:21:14 user nova-compute[74960]: INFO nova.compute.manager [None req-c879f9e7-ed22-4c77-a4d6-b094ed239517 tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea] Terminating instance
Nov 03 12:21:15 user nova-compute[74960]: DEBUG nova.compute.manager [None req-c879f9e7-ed22-4c77-a4d6-b094ed239517 tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea] Start destroying the instance on the hypervisor. {{(pid=74960) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 12:21:15 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:21:15 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:21:15 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:21:15 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:21:15 user nova-compute[74960]: DEBUG nova.compute.manager [req-6699507e-50fa-4dc8-acd5-39cb9e512d3f req-d680fd86-53c2-4abc-84e0-8e84e99d918d service nova] [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea] Received event network-vif-unplugged-ced0ad7a-92e5-4d88-8b6a-1f30efea310e {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:21:15 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-6699507e-50fa-4dc8-acd5-39cb9e512d3f req-d680fd86-53c2-4abc-84e0-8e84e99d918d service nova] Acquiring lock "7f7fabc2-5e1b-441c-a693-9956470359ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:21:15 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-6699507e-50fa-4dc8-acd5-39cb9e512d3f req-d680fd86-53c2-4abc-84e0-8e84e99d918d service nova] Lock "7f7fabc2-5e1b-441c-a693-9956470359ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:21:15 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-6699507e-50fa-4dc8-acd5-39cb9e512d3f req-d680fd86-53c2-4abc-84e0-8e84e99d918d service nova] Lock "7f7fabc2-5e1b-441c-a693-9956470359ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:21:15 user nova-compute[74960]: DEBUG nova.compute.manager [req-6699507e-50fa-4dc8-acd5-39cb9e512d3f req-d680fd86-53c2-4abc-84e0-8e84e99d918d service nova] [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea] No waiting events found dispatching network-vif-unplugged-ced0ad7a-92e5-4d88-8b6a-1f30efea310e {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:21:15 user nova-compute[74960]: DEBUG nova.compute.manager [req-6699507e-50fa-4dc8-acd5-39cb9e512d3f req-d680fd86-53c2-4abc-84e0-8e84e99d918d service nova] [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea] Received event network-vif-unplugged-ced0ad7a-92e5-4d88-8b6a-1f30efea310e for instance with task_state deleting. {{(pid=74960) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 12:21:15 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea] Instance destroyed successfully.
Nov 03 12:21:15 user nova-compute[74960]: DEBUG nova.objects.instance [None req-c879f9e7-ed22-4c77-a4d6-b094ed239517 tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] Lazy-loading 'resources' on Instance uuid 7f7fabc2-5e1b-441c-a693-9956470359ea {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:21:15 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-c879f9e7-ed22-4c77-a4d6-b094ed239517 tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:17:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-126287268',display_name='tempest-VolumesAssistedSnapshotsTest-server-126287268',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-126287268',id=8,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB1WerQZZRZQNWH8+tKmmxlMfZLCzUY2s52yzvmIq2CHvTmBY8uTh4X2rIyq+ALd+S/QVAI/2zDxynbk0k4OuNpGSD8YiBSL6Yq8f9ezaSDgo9FB//kHnejkymHgtZ8TUQ==',key_name='tempest-keypair-1006582203',keypairs=<?>,launch_index=0,launched_at=2023-11-03T12:17:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='225ccae506a541b3a766b70610efba47',ramdisk_id='',reservation_id='r-r0ck1ub3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-552365423',owner_user_name='tempest-VolumesAssistedSnapshotsTest-552365423-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T12:17:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7b8f8f5099bf4f98bef5337ea5442439',uuid=7f7fabc2-5e1b-441c-a693-9956470359ea,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ced0ad7a-92e5-4d88-8b6a-1f30efea310e", "address": "fa:16:3e:57:3d:47", "network": {"id": "c574281c-6841-42aa-9e46-d20e936c0d06", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2129338778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "225ccae506a541b3a766b70610efba47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapced0ad7a-92", "ovs_interfaceid": "ced0ad7a-92e5-4d88-8b6a-1f30efea310e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 12:21:15 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-c879f9e7-ed22-4c77-a4d6-b094ed239517 tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] Converting VIF {"id": "ced0ad7a-92e5-4d88-8b6a-1f30efea310e", "address": "fa:16:3e:57:3d:47", "network": {"id": "c574281c-6841-42aa-9e46-d20e936c0d06", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2129338778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "225ccae506a541b3a766b70610efba47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapced0ad7a-92", "ovs_interfaceid": "ced0ad7a-92e5-4d88-8b6a-1f30efea310e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:21:15 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-c879f9e7-ed22-4c77-a4d6-b094ed239517 tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:57:3d:47,bridge_name='br-int',has_traffic_filtering=True,id=ced0ad7a-92e5-4d88-8b6a-1f30efea310e,network=Network(c574281c-6841-42aa-9e46-d20e936c0d06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapced0ad7a-92') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:21:15 user nova-compute[74960]: DEBUG os_vif [None req-c879f9e7-ed22-4c77-a4d6-b094ed239517 tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:3d:47,bridge_name='br-int',has_traffic_filtering=True,id=ced0ad7a-92e5-4d88-8b6a-1f30efea310e,network=Network(c574281c-6841-42aa-9e46-d20e936c0d06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapced0ad7a-92') {{(pid=74960) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 12:21:15 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:21:15 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapced0ad7a-92, bridge=br-int, if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:21:15 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:21:15 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:21:15 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:21:15 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f78748f6-f297-4c84-869a-d26712479a73) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:21:15 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:21:15 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:21:15 user nova-compute[74960]: INFO os_vif [None req-c879f9e7-ed22-4c77-a4d6-b094ed239517 tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:3d:47,bridge_name='br-int',has_traffic_filtering=True,id=ced0ad7a-92e5-4d88-8b6a-1f30efea310e,network=Network(c574281c-6841-42aa-9e46-d20e936c0d06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapced0ad7a-92')
Nov 03 12:21:15 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-c879f9e7-ed22-4c77-a4d6-b094ed239517 tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea] Deleting instance files /opt/stack/data/nova/instances/7f7fabc2-5e1b-441c-a693-9956470359ea_del
Nov 03 12:21:15 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-c879f9e7-ed22-4c77-a4d6-b094ed239517 tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea] Deletion of /opt/stack/data/nova/instances/7f7fabc2-5e1b-441c-a693-9956470359ea_del complete
Nov 03 12:21:16 user nova-compute[74960]: INFO nova.compute.manager [None req-c879f9e7-ed22-4c77-a4d6-b094ed239517 tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea] Took 1.05 seconds to destroy the instance on the hypervisor.
Nov 03 12:21:16 user nova-compute[74960]: DEBUG oslo.service.loopingcall [None req-c879f9e7-ed22-4c77-a4d6-b094ed239517 tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74960) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 12:21:16 user nova-compute[74960]: DEBUG nova.compute.manager [-] [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea] Deallocating network for instance {{(pid=74960) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 12:21:16 user nova-compute[74960]: DEBUG nova.network.neutron [-] [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea] deallocate_for_instance() {{(pid=74960) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 12:21:17 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:21:17 user nova-compute[74960]: DEBUG nova.network.neutron [-] [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea] Updating instance_info_cache with network_info: [] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:21:17 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 -F raw /opt/stack/data/nova/instances/7e5ec97f-80c4-4499-94bf-2584fc0eae03/disk" returned: 0 in 2.515s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:21:17 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Created local disks {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 12:21:17 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Ensure instance console log exists: /opt/stack/data/nova/instances/7e5ec97f-80c4-4499-94bf-2584fc0eae03/console.log {{(pid=74960) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 12:21:17 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:21:17 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:21:17 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:21:17 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Start _get_guest_xml network_info=[{"id": "e91b8148-e2ff-4124-9799-ba4efae837ff", "address": "fa:16:3e:40:35:d4", "network": {"id": "c03e854d-75a3-4e81-9cdf-f1139841266c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1632999031-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c216dd7629274eafbf0a5968ff2378a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape91b8148-e2", "ovs_interfaceid": "e91b8148-e2ff-4124-9799-ba4efae837ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='4d3937f85c1cec12ee353939f674f42b',container_format='bare',created_at=2023-11-03T12:18:52Z,direct_url=<?>,disk_format='qcow2',id=8e8d35fe-058b-4938-9a8f-781ffb884bad,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1395691218-shelved',owner='c216dd7629274eafbf0a5968ff2378a9',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-03T12:18:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'image_id': '549f51ba-ac69-494b-8de1-34635aa2d7cf'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8b06fb29-6288-4cca-aabd-39d9c089c045', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zhvlQkKU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '7e5ec97f-80c4-4499-94bf-2584fc0eae03', 'attached_at': '', 'detached_at': '', 'volume_id': '8b06fb29-6288-4cca-aabd-39d9c089c045', 'serial': '8b06fb29-6288-4cca-aabd-39d9c089c045'}, 'delete_on_termination': False, 'mount_device': '/dev/vdc', 'device_type': 'disk', 'attachment_id': '1db20b41-8126-4b85-ba60-bd0809a6f1a8', 'boot_index': None, 'guest_format': None, 'volume_type': None} {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 12:21:17 user nova-compute[74960]: INFO nova.compute.manager [-] [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea] Took 1.09 seconds to deallocate network for instance.
Nov 03 12:21:17 user nova-compute[74960]: DEBUG nova.compute.manager [req-2647fc59-ff3b-464a-9965-dacd69e8f848 req-247c131e-63ea-40c6-8216-f4fc0eb0c488 service nova] [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea] Received event network-vif-deleted-ced0ad7a-92e5-4d88-8b6a-1f30efea310e {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:21:17 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:21:17 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:21:17 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 12:21:17 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] CPU controller missing on host. {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 12:21:17 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 12:21:17 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] CPU controller found on host. {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 12:21:17 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74960) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 12:21:17 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='4d3937f85c1cec12ee353939f674f42b',container_format='bare',created_at=2023-11-03T12:18:52Z,direct_url=<?>,disk_format='qcow2',id=8e8d35fe-058b-4938-9a8f-781ffb884bad,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1395691218-shelved',owner='c216dd7629274eafbf0a5968ff2378a9',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-03T12:18:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 12:21:17 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Flavor limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 12:21:17 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Image limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 12:21:17 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Flavor pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 12:21:17 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Image pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 12:21:17 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 12:21:17 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 12:21:17 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 12:21:17 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Got 1 possible topologies {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 12:21:17 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 12:21:17 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 12:21:17 user nova-compute[74960]: DEBUG nova.objects.instance [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7e5ec97f-80c4-4499-94bf-2584fc0eae03 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:21:17 user nova-compute[74960]: DEBUG nova.objects.base [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Object Instance<7e5ec97f-80c4-4499-94bf-2584fc0eae03> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74960) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 12:21:17 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Calling os-brick to attach iSCSI Volume {{(pid=74960) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 12:21:17 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9aa420acb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8b06fb29-6288-4cca-aabd-39d9c089c045', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zhvlQkKU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:21:17 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:21:17 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:21:17 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:21:17 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:21:17 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8b06fb29-6288-4cca-aabd-39d9c089c045" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:21:17 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8b06fb29-6288-4cca-aabd-39d9c089c045" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:21:17 user nova-compute[74960]: INFO os_brick.initiator.connectors.iscsi [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 12:21:17 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c879f9e7-ed22-4c77-a4d6-b094ed239517 tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:21:17 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c879f9e7-ed22-4c77-a4d6-b094ed239517 tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:21:17 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b06fb29-6288-4cca-aabd-39d9c089c045 -p 172.16.0.220:3260 {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:21:17 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b06fb29-6288-4cca-aabd-39d9c089c045 -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:21:17 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb91116b-fec4-409f-90db-6d7cd9f3aa45]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:21:17 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 12:21:17 user nova-compute[74960]:  {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:21:17 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b06fb29-6288-4cca-aabd-39d9c089c045 -p 172.16.0.220:3260 --interface default --op new {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:21:17 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b06fb29-6288-4cca-aabd-39d9c089c045 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:21:17 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[42e96fa8-d035-4621-9559-d828e0d7fcd6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8b06fb29-6288-4cca-aabd-39d9c089c045] added\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:21:17 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8b06fb29-6288-4cca-aabd-39d9c089c045] added
Nov 03 12:21:17 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:21:17 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b06fb29-6288-4cca-aabd-39d9c089c045 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:21:17 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b06fb29-6288-4cca-aabd-39d9c089c045 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:21:17 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e6421d5-42ff-42d5-9ee4-27132e6ace4d]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:21:17 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:21:17 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b06fb29-6288-4cca-aabd-39d9c089c045 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:21:17 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b06fb29-6288-4cca-aabd-39d9c089c045 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:21:17 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[f48aab7f-25a0-48dc-9df1-ad523647bdfd]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:21:17 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:21:17 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b06fb29-6288-4cca-aabd-39d9c089c045 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zhvlQkKU {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:21:17 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b06fb29-6288-4cca-aabd-39d9c089c045 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zhvlQkKU" returned: 0 in 0.017s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:21:17 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[2670204b-40c1-450d-b1b8-c07b5126ec83]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:21:17 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zhvlQkKU'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:21:17 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b06fb29-6288-4cca-aabd-39d9c089c045 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:21:17 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b06fb29-6288-4cca-aabd-39d9c089c045 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.032s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:21:17 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[b891c16d-0d0c-4769-9321-48c8e50a0fac]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:21:17 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:21:17 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:21:17 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:21:17 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[29a3dd22-3c7b-4604-9520-3b5a2a91db20]: (4, ('tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19 (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:21:17 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19 (non-flash)
Nov 03 12:21:17 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:21:17 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] iscsi session list stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19 (non-flash)
Nov 03 12:21:17 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:21:17 user nova-compute[74960]: DEBUG nova.compute.manager [req-9cb6f7a7-7160-4820-8e05-61db1b7b0982 req-d6165c02-3aef-4d2e-a54f-9cfa26e8c5ed service nova] [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea] Received event network-vif-plugged-ced0ad7a-92e5-4d88-8b6a-1f30efea310e {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:21:17 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-9cb6f7a7-7160-4820-8e05-61db1b7b0982 req-d6165c02-3aef-4d2e-a54f-9cfa26e8c5ed service nova] Acquiring lock "7f7fabc2-5e1b-441c-a693-9956470359ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:21:17 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-9cb6f7a7-7160-4820-8e05-61db1b7b0982 req-d6165c02-3aef-4d2e-a54f-9cfa26e8c5ed service nova] Lock "7f7fabc2-5e1b-441c-a693-9956470359ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:21:17 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-9cb6f7a7-7160-4820-8e05-61db1b7b0982 req-d6165c02-3aef-4d2e-a54f-9cfa26e8c5ed service nova] Lock "7f7fabc2-5e1b-441c-a693-9956470359ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:21:17 user nova-compute[74960]: DEBUG nova.compute.manager [req-9cb6f7a7-7160-4820-8e05-61db1b7b0982 req-d6165c02-3aef-4d2e-a54f-9cfa26e8c5ed service nova] [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea] No waiting events found dispatching network-vif-plugged-ced0ad7a-92e5-4d88-8b6a-1f30efea310e {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:21:17 user nova-compute[74960]: WARNING nova.compute.manager [req-9cb6f7a7-7160-4820-8e05-61db1b7b0982 req-d6165c02-3aef-4d2e-a54f-9cfa26e8c5ed service nova] [instance: 7f7fabc2-5e1b-441c-a693-9956470359ea] Received unexpected event network-vif-plugged-ced0ad7a-92e5-4d88-8b6a-1f30efea310e for instance with vm_state deleted and task_state None.
Nov 03 12:21:17 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b06fb29-6288-4cca-aabd-39d9c089c045 -p 172.16.0.220:3260 --login {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:21:17 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b06fb29-6288-4cca-aabd-39d9c089c045 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:21:17 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[de62243f-dd21-4c03-a0ee-0852290f6366]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8b06fb29-6288-4cca-aabd-39d9c089c045, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8b06fb29-6288-4cca-aabd-39d9c089c045, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:21:17 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8b06fb29-6288-4cca-aabd-39d9c089c045, portal: 172.16.0.220,3260]
Nov 03 12:21:17 user nova-compute[74960]: Login to [iface: default, target: iqn.2010-10.org.openstack:8b06fb29-6288-4cca-aabd-39d9c089c045, portal: 172.16.0.220,3260] successful.
Nov 03 12:21:17 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:21:17 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b06fb29-6288-4cca-aabd-39d9c089c045 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:21:17 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b06fb29-6288-4cca-aabd-39d9c089c045 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:21:17 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb3e135d-eb2e-4afb-bd3f-9c0dc1d5eb44]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:21:17 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:21:17 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:21:17 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:21:17 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[c19ee4dd-c50c-4dce-83b0-0c8d7e707524]: (4, ('tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b06fb29-6288-4cca-aabd-39d9c089c045 (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:21:17 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19 (non-flash)
Nov 03 12:21:17 user nova-compute[74960]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b06fb29-6288-4cca-aabd-39d9c089c045 (non-flash)
Nov 03 12:21:17 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:21:17 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] iscsi session list stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19 (non-flash)
Nov 03 12:21:17 user nova-compute[74960]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b06fb29-6288-4cca-aabd-39d9c089c045 (non-flash)
Nov 03 12:21:17 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:21:17 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8b06fb29-6288-4cca-aabd-39d9c089c045" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.323s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:21:17 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Connected to 172.16.0.220:3260 {{(pid=74960) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 12:21:17 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] HCTL ('33', '-', '-', 0) found on session 8 with lun 0 {{(pid=74960) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 12:21:17 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74960) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 12:21:17 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:21:17 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-c879f9e7-ed22-4c77-a4d6-b094ed239517 tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:21:17 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-c879f9e7-ed22-4c77-a4d6-b094ed239517 tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:21:17 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.042s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:21:17 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[e985e936-677c-44b9-876c-de26c98153e1]: (4, ('- - 0', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:21:17 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Searching for a device in session 8 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74960) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 12:21:17 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:8b06fb29-6288-4cca-aabd-39d9c089c045', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zhvlQkKU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74960) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 12:21:17 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c879f9e7-ed22-4c77-a4d6-b094ed239517 tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.384s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:21:17 user nova-compute[74960]: INFO nova.scheduler.client.report [None req-c879f9e7-ed22-4c77-a4d6-b094ed239517 tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] Deleted allocations for instance 7f7fabc2-5e1b-441c-a693-9956470359ea
Nov 03 12:21:17 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:21:17 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c879f9e7-ed22-4c77-a4d6-b094ed239517 tempest-VolumesAssistedSnapshotsTest-552365423 tempest-VolumesAssistedSnapshotsTest-552365423-project-member] Lock "7f7fabc2-5e1b-441c-a693-9956470359ea" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.790s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:21:18 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.383s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:21:18 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] <== connect_volume: return (1384ms) {'type': 'block', 'scsi_wwn': '26663336336643332', 'path': '/dev/sdb'} {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:21:18 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26663336336643332', 'path': '/dev/sdb'} {{(pid=74960) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 12:21:18 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-03T12:16:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1395691218',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1395691218',id=2,image_ref='8e8d35fe-058b-4938-9a8f-781ffb884bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1234685962',keypairs=<?>,launch_index=0,launched_at=2023-11-03T12:17:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='c216dd7629274eafbf0a5968ff2378a9',ramdisk_id='',reservation_id='r-36b8brxz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-258463843',owner_user_name='tempest-AttachVolumeShelveTestJSON-258463843-project-member',shelved_at='2023-11-03T12:18:58.056502',shelved_host='user',shelved_image_id='8e8d35fe-058b-4938-9a8f-781ffb884bad'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:20:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fae69462930546bdb9cf6e2a11a0df2a',uuid=7e5ec97f-80c4-4499-94bf-2584fc0eae03,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "e91b8148-e2ff-4124-9799-ba4efae837ff", "address": "fa:16:3e:40:35:d4", "network": {"id": "c03e854d-75a3-4e81-9cdf-f1139841266c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1632999031-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c216dd7629274eafbf0a5968ff2378a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape91b8148-e2", "ovs_interfaceid": "e91b8148-e2ff-4124-9799-ba4efae837ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74960) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 12:21:18 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Converting VIF {"id": "e91b8148-e2ff-4124-9799-ba4efae837ff", "address": "fa:16:3e:40:35:d4", "network": {"id": "c03e854d-75a3-4e81-9cdf-f1139841266c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1632999031-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c216dd7629274eafbf0a5968ff2378a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape91b8148-e2", "ovs_interfaceid": "e91b8148-e2ff-4124-9799-ba4efae837ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:21:18 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:35:d4,bridge_name='br-int',has_traffic_filtering=True,id=e91b8148-e2ff-4124-9799-ba4efae837ff,network=Network(c03e854d-75a3-4e81-9cdf-f1139841266c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape91b8148-e2') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:21:18 user nova-compute[74960]: DEBUG nova.objects.instance [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Lazy-loading 'pci_devices' on Instance uuid 7e5ec97f-80c4-4499-94bf-2584fc0eae03 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:21:18 user nova-compute[74960]: DEBUG nova.objects.base [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Object Instance<7e5ec97f-80c4-4499-94bf-2584fc0eae03> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74960) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 12:21:18 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] End _get_guest_xml xml=<domain type="kvm">
Nov 03 12:21:18 user nova-compute[74960]:   <uuid>7e5ec97f-80c4-4499-94bf-2584fc0eae03</uuid>
Nov 03 12:21:18 user nova-compute[74960]:   <name>instance-00000002</name>
Nov 03 12:21:18 user nova-compute[74960]:   <memory>524288</memory>
Nov 03 12:21:18 user nova-compute[74960]:   <vcpu>1</vcpu>
Nov 03 12:21:18 user nova-compute[74960]:   <metadata>
Nov 03 12:21:18 user nova-compute[74960]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 12:21:18 user nova-compute[74960]:       <nova:package version="0.0.0"/>
Nov 03 12:21:18 user nova-compute[74960]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1395691218</nova:name>
Nov 03 12:21:18 user nova-compute[74960]:       <nova:creationTime>2023-11-03 12:21:17</nova:creationTime>
Nov 03 12:21:18 user nova-compute[74960]:       <nova:flavor name="m1.tiny">
Nov 03 12:21:18 user nova-compute[74960]:         <nova:memory>512</nova:memory>
Nov 03 12:21:18 user nova-compute[74960]:         <nova:disk>1</nova:disk>
Nov 03 12:21:18 user nova-compute[74960]:         <nova:swap>0</nova:swap>
Nov 03 12:21:18 user nova-compute[74960]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 12:21:18 user nova-compute[74960]:         <nova:vcpus>1</nova:vcpus>
Nov 03 12:21:18 user nova-compute[74960]:       </nova:flavor>
Nov 03 12:21:18 user nova-compute[74960]:       <nova:owner>
Nov 03 12:21:18 user nova-compute[74960]:         <nova:user uuid="fae69462930546bdb9cf6e2a11a0df2a">tempest-AttachVolumeShelveTestJSON-258463843-project-member</nova:user>
Nov 03 12:21:18 user nova-compute[74960]:         <nova:project uuid="c216dd7629274eafbf0a5968ff2378a9">tempest-AttachVolumeShelveTestJSON-258463843</nova:project>
Nov 03 12:21:18 user nova-compute[74960]:       </nova:owner>
Nov 03 12:21:18 user nova-compute[74960]:       <nova:root type="image" uuid="8e8d35fe-058b-4938-9a8f-781ffb884bad"/>
Nov 03 12:21:18 user nova-compute[74960]:       <nova:ports>
Nov 03 12:21:18 user nova-compute[74960]:         <nova:port uuid="e91b8148-e2ff-4124-9799-ba4efae837ff">
Nov 03 12:21:18 user nova-compute[74960]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 03 12:21:18 user nova-compute[74960]:         </nova:port>
Nov 03 12:21:18 user nova-compute[74960]:       </nova:ports>
Nov 03 12:21:18 user nova-compute[74960]:     </nova:instance>
Nov 03 12:21:18 user nova-compute[74960]:   </metadata>
Nov 03 12:21:18 user nova-compute[74960]:   <sysinfo type="smbios">
Nov 03 12:21:18 user nova-compute[74960]:     <system>
Nov 03 12:21:18 user nova-compute[74960]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 12:21:18 user nova-compute[74960]:       <entry name="product">OpenStack Nova</entry>
Nov 03 12:21:18 user nova-compute[74960]:       <entry name="version">0.0.0</entry>
Nov 03 12:21:18 user nova-compute[74960]:       <entry name="serial">7e5ec97f-80c4-4499-94bf-2584fc0eae03</entry>
Nov 03 12:21:18 user nova-compute[74960]:       <entry name="uuid">7e5ec97f-80c4-4499-94bf-2584fc0eae03</entry>
Nov 03 12:21:18 user nova-compute[74960]:       <entry name="family">Virtual Machine</entry>
Nov 03 12:21:18 user nova-compute[74960]:     </system>
Nov 03 12:21:18 user nova-compute[74960]:   </sysinfo>
Nov 03 12:21:18 user nova-compute[74960]:   <os>
Nov 03 12:21:18 user nova-compute[74960]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 12:21:18 user nova-compute[74960]:     <boot dev="hd"/>
Nov 03 12:21:18 user nova-compute[74960]:     <smbios mode="sysinfo"/>
Nov 03 12:21:18 user nova-compute[74960]:   </os>
Nov 03 12:21:18 user nova-compute[74960]:   <features>
Nov 03 12:21:18 user nova-compute[74960]:     <acpi/>
Nov 03 12:21:18 user nova-compute[74960]:     <apic/>
Nov 03 12:21:18 user nova-compute[74960]:     <vmcoreinfo/>
Nov 03 12:21:18 user nova-compute[74960]:   </features>
Nov 03 12:21:18 user nova-compute[74960]:   <clock offset="utc">
Nov 03 12:21:18 user nova-compute[74960]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 12:21:18 user nova-compute[74960]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 12:21:18 user nova-compute[74960]:     <timer name="hpet" present="no"/>
Nov 03 12:21:18 user nova-compute[74960]:   </clock>
Nov 03 12:21:18 user nova-compute[74960]:   <cpu mode="custom" match="exact">
Nov 03 12:21:18 user nova-compute[74960]:     <model>Nehalem</model>
Nov 03 12:21:18 user nova-compute[74960]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 12:21:18 user nova-compute[74960]:   </cpu>
Nov 03 12:21:18 user nova-compute[74960]:   <devices>
Nov 03 12:21:18 user nova-compute[74960]:     <disk type="file" device="disk">
Nov 03 12:21:18 user nova-compute[74960]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 12:21:18 user nova-compute[74960]:       <source file="/opt/stack/data/nova/instances/7e5ec97f-80c4-4499-94bf-2584fc0eae03/disk"/>
Nov 03 12:21:18 user nova-compute[74960]:       <target dev="vda" bus="virtio"/>
Nov 03 12:21:18 user nova-compute[74960]:     </disk>
Nov 03 12:21:18 user nova-compute[74960]:     <disk type="block" device="disk">
Nov 03 12:21:18 user nova-compute[74960]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 12:21:18 user nova-compute[74960]:       <source dev="/dev/sdb"/>
Nov 03 12:21:18 user nova-compute[74960]:       <target dev="vdc" bus="virtio"/>
Nov 03 12:21:18 user nova-compute[74960]:       <serial>8b06fb29-6288-4cca-aabd-39d9c089c045</serial>
Nov 03 12:21:18 user nova-compute[74960]:     </disk>
Nov 03 12:21:18 user nova-compute[74960]:     <interface type="ethernet">
Nov 03 12:21:18 user nova-compute[74960]:       <mac address="fa:16:3e:40:35:d4"/>
Nov 03 12:21:18 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:21:18 user nova-compute[74960]:       <mtu size="1442"/>
Nov 03 12:21:18 user nova-compute[74960]:       <target dev="tape91b8148-e2"/>
Nov 03 12:21:18 user nova-compute[74960]:     </interface>
Nov 03 12:21:18 user nova-compute[74960]:     <serial type="pty">
Nov 03 12:21:18 user nova-compute[74960]:       <log file="/opt/stack/data/nova/instances/7e5ec97f-80c4-4499-94bf-2584fc0eae03/console.log" append="off"/>
Nov 03 12:21:18 user nova-compute[74960]:     </serial>
Nov 03 12:21:18 user nova-compute[74960]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 12:21:18 user nova-compute[74960]:     <video>
Nov 03 12:21:18 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:21:18 user nova-compute[74960]:     </video>
Nov 03 12:21:18 user nova-compute[74960]:     <rng model="virtio">
Nov 03 12:21:18 user nova-compute[74960]:       <backend model="random">/dev/urandom</backend>
Nov 03 12:21:18 user nova-compute[74960]:     </rng>
Nov 03 12:21:18 user nova-compute[74960]:     <controller type="usb" index="0" model="none"/>
Nov 03 12:21:18 user nova-compute[74960]:     <memballoon model="virtio">
Nov 03 12:21:18 user nova-compute[74960]:       <stats period="10"/>
Nov 03 12:21:18 user nova-compute[74960]:     </memballoon>
Nov 03 12:21:18 user nova-compute[74960]:   </devices>
Nov 03 12:21:18 user nova-compute[74960]: </domain>
Nov 03 12:21:18 user nova-compute[74960]:  {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 12:21:18 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-03T12:16:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1395691218',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1395691218',id=2,image_ref='8e8d35fe-058b-4938-9a8f-781ffb884bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1234685962',keypairs=<?>,launch_index=0,launched_at=2023-11-03T12:17:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='c216dd7629274eafbf0a5968ff2378a9',ramdisk_id='',reservation_id='r-36b8brxz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-258463843',owner_user_name='tempest-AttachVolumeShelveTestJSON-258463843-project-member',shelved_at='2023-11-03T12:18:58.056502',shelved_host='user',shelved_image_id='8e8d35fe-058b-4938-9a8f-781ffb884bad'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:20:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fae69462930546bdb9cf6e2a11a0df2a',uuid=7e5ec97f-80c4-4499-94bf-2584fc0eae03,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "e91b8148-e2ff-4124-9799-ba4efae837ff", "address": "fa:16:3e:40:35:d4", "network": {"id": "c03e854d-75a3-4e81-9cdf-f1139841266c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1632999031-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c216dd7629274eafbf0a5968ff2378a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape91b8148-e2", "ovs_interfaceid": "e91b8148-e2ff-4124-9799-ba4efae837ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 12:21:18 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Converting VIF {"id": "e91b8148-e2ff-4124-9799-ba4efae837ff", "address": "fa:16:3e:40:35:d4", "network": {"id": "c03e854d-75a3-4e81-9cdf-f1139841266c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1632999031-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c216dd7629274eafbf0a5968ff2378a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape91b8148-e2", "ovs_interfaceid": "e91b8148-e2ff-4124-9799-ba4efae837ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:21:18 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:35:d4,bridge_name='br-int',has_traffic_filtering=True,id=e91b8148-e2ff-4124-9799-ba4efae837ff,network=Network(c03e854d-75a3-4e81-9cdf-f1139841266c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape91b8148-e2') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:21:18 user nova-compute[74960]: DEBUG os_vif [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:35:d4,bridge_name='br-int',has_traffic_filtering=True,id=e91b8148-e2ff-4124-9799-ba4efae837ff,network=Network(c03e854d-75a3-4e81-9cdf-f1139841266c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape91b8148-e2') {{(pid=74960) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 12:21:18 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:21:18 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:21:18 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 12:21:18 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:21:18 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'df4a411b-2343-57e4-88d3-068c1c8814a2', '_type': 'linux-noop'}}, row=False) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:21:18 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:21:18 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:21:18 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:21:18 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape91b8148-e2, may_exist=True, interface_attrs={}) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:21:18 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape91b8148-e2, col_values=(('qos', UUID('eca94b45-08bf-4a77-a55b-2ad0b19c90ba')),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:21:18 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape91b8148-e2, col_values=(('external_ids', {'iface-id': 'e91b8148-e2ff-4124-9799-ba4efae837ff', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:40:35:d4', 'vm-uuid': '7e5ec97f-80c4-4499-94bf-2584fc0eae03'}),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:21:18 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:21:18 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:21:18 user nova-compute[74960]: INFO os_vif [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:35:d4,bridge_name='br-int',has_traffic_filtering=True,id=e91b8148-e2ff-4124-9799-ba4efae837ff,network=Network(c03e854d-75a3-4e81-9cdf-f1139841266c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape91b8148-e2')
Nov 03 12:21:18 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] No BDM found with device name vda, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:21:18 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:21:18 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] No VIF found with MAC fa:16:3e:40:35:d4, not building metadata {{(pid=74960) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 12:21:20 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:21:20 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:21:20 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:21:20 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:21:20 user nova-compute[74960]: DEBUG nova.compute.manager [req-b0bce82b-f022-4f6e-8a7f-ff1dbfd5c82f req-cb7eec8c-8d1e-4ec5-9210-a3b430240261 service nova] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Received event network-vif-plugged-e91b8148-e2ff-4124-9799-ba4efae837ff {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:21:20 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-b0bce82b-f022-4f6e-8a7f-ff1dbfd5c82f req-cb7eec8c-8d1e-4ec5-9210-a3b430240261 service nova] Acquiring lock "7e5ec97f-80c4-4499-94bf-2584fc0eae03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:21:20 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-b0bce82b-f022-4f6e-8a7f-ff1dbfd5c82f req-cb7eec8c-8d1e-4ec5-9210-a3b430240261 service nova] Lock "7e5ec97f-80c4-4499-94bf-2584fc0eae03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:21:20 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-b0bce82b-f022-4f6e-8a7f-ff1dbfd5c82f req-cb7eec8c-8d1e-4ec5-9210-a3b430240261 service nova] Lock "7e5ec97f-80c4-4499-94bf-2584fc0eae03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:21:20 user nova-compute[74960]: DEBUG nova.compute.manager [req-b0bce82b-f022-4f6e-8a7f-ff1dbfd5c82f req-cb7eec8c-8d1e-4ec5-9210-a3b430240261 service nova] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] No waiting events found dispatching network-vif-plugged-e91b8148-e2ff-4124-9799-ba4efae837ff {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:21:20 user nova-compute[74960]: WARNING nova.compute.manager [req-b0bce82b-f022-4f6e-8a7f-ff1dbfd5c82f req-cb7eec8c-8d1e-4ec5-9210-a3b430240261 service nova] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Received unexpected event network-vif-plugged-e91b8148-e2ff-4124-9799-ba4efae837ff for instance with vm_state shelved_offloaded and task_state spawning.
Nov 03 12:21:21 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:21:21 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:21:21 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:21:22 user nova-compute[74960]: DEBUG nova.compute.manager [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Instance event wait completed in 0 seconds for  {{(pid=74960) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 12:21:22 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Guest created on hypervisor {{(pid=74960) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 12:21:22 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Instance spawned successfully.
Nov 03 12:21:22 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:21:22 user nova-compute[74960]: DEBUG nova.compute.manager [req-60a7563a-33d1-46e4-a1e5-539be693b1f6 req-7cb18812-056b-4856-abdd-204f9b2cacbf service nova] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Received event network-vif-plugged-e91b8148-e2ff-4124-9799-ba4efae837ff {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:21:22 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-60a7563a-33d1-46e4-a1e5-539be693b1f6 req-7cb18812-056b-4856-abdd-204f9b2cacbf service nova] Acquiring lock "7e5ec97f-80c4-4499-94bf-2584fc0eae03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:21:22 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-60a7563a-33d1-46e4-a1e5-539be693b1f6 req-7cb18812-056b-4856-abdd-204f9b2cacbf service nova] Lock "7e5ec97f-80c4-4499-94bf-2584fc0eae03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:21:22 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-60a7563a-33d1-46e4-a1e5-539be693b1f6 req-7cb18812-056b-4856-abdd-204f9b2cacbf service nova] Lock "7e5ec97f-80c4-4499-94bf-2584fc0eae03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:21:22 user nova-compute[74960]: DEBUG nova.compute.manager [req-60a7563a-33d1-46e4-a1e5-539be693b1f6 req-7cb18812-056b-4856-abdd-204f9b2cacbf service nova] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] No waiting events found dispatching network-vif-plugged-e91b8148-e2ff-4124-9799-ba4efae837ff {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:21:22 user nova-compute[74960]: WARNING nova.compute.manager [req-60a7563a-33d1-46e4-a1e5-539be693b1f6 req-7cb18812-056b-4856-abdd-204f9b2cacbf service nova] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Received unexpected event network-vif-plugged-e91b8148-e2ff-4124-9799-ba4efae837ff for instance with vm_state shelved_offloaded and task_state spawning.
Nov 03 12:21:22 user nova-compute[74960]: DEBUG nova.compute.manager [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Checking state {{(pid=74960) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 12:21:23 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-cb7165f5-be62-4cfc-9097-064acc0554c3 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Lock "7e5ec97f-80c4-4499-94bf-2584fc0eae03" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 37.251s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:21:23 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:21:27 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:21:28 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:21:32 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:21:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:21:36 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:21:36 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82dd5adb-9601-470f-873b-a28f3af0b0ef tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] Calling os-brick to attach iSCSI Volume {{(pid=74960) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 12:21:36 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-82dd5adb-9601-470f-873b-a28f3af0b0ef tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9aa420acb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OLuClVhy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:21:36 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-82dd5adb-9601-470f-873b-a28f3af0b0ef tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:21:36 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-82dd5adb-9601-470f-873b-a28f3af0b0ef tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:21:36 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-82dd5adb-9601-470f-873b-a28f3af0b0ef tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:21:36 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-82dd5adb-9601-470f-873b-a28f3af0b0ef tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:21:36 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-82dd5adb-9601-470f-873b-a28f3af0b0ef tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:21:36 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-82dd5adb-9601-470f-873b-a28f3af0b0ef tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:21:36 user nova-compute[74960]: INFO os_brick.initiator.connectors.iscsi [None req-82dd5adb-9601-470f-873b-a28f3af0b0ef tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 12:21:36 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02 -p 172.16.0.220:3260 {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:21:36 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:21:36 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[587b2a8a-3eed-4d37-86a8-c442f2e4b604]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:21:36 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-82dd5adb-9601-470f-873b-a28f3af0b0ef tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 12:21:36 user nova-compute[74960]:  {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:21:36 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02 -p 172.16.0.220:3260 --interface default --op new {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:21:36 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:21:36 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[738160b8-8262-418b-8ec8-c1696ca18e92]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02] added\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:21:36 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-82dd5adb-9601-470f-873b-a28f3af0b0ef tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02] added
Nov 03 12:21:36 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:21:36 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:21:36 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:21:36 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[11250b0d-e16c-4270-95d0-fdecaac5579b]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:21:36 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-82dd5adb-9601-470f-873b-a28f3af0b0ef tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:21:36 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:21:36 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:21:36 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdc0434f-75ff-4bbe-89fd-3c1a3f4525a7]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:21:36 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-82dd5adb-9601-470f-873b-a28f3af0b0ef tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:21:36 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OLuClVhy {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:21:36 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OLuClVhy" returned: 0 in 0.021s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:21:36 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e5b28a4-a732-4c78-9120-b7aab425f87a]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:21:36 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-82dd5adb-9601-470f-873b-a28f3af0b0ef tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OLuClVhy'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:21:36 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:21:36 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:21:36 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[a53aa868-d2d3-4c3b-912d-8a38fa421488]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:21:36 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-82dd5adb-9601-470f-873b-a28f3af0b0ef tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:21:36 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:21:36 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:21:36 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[f151c618-f41d-42ec-988d-1ebeb9a618fa]: (4, ('tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b06fb29-6288-4cca-aabd-39d9c089c045 (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:21:36 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-82dd5adb-9601-470f-873b-a28f3af0b0ef tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19 (non-flash)
Nov 03 12:21:36 user nova-compute[74960]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b06fb29-6288-4cca-aabd-39d9c089c045 (non-flash)
Nov 03 12:21:36 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:21:36 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-82dd5adb-9601-470f-873b-a28f3af0b0ef tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] iscsi session list stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19 (non-flash)
Nov 03 12:21:36 user nova-compute[74960]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b06fb29-6288-4cca-aabd-39d9c089c045 (non-flash)
Nov 03 12:21:36 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:21:36 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02 -p 172.16.0.220:3260 --login {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:21:36 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:21:36 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[47349168-4725-4424-851c-15bf6a9f230c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:21:36 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-82dd5adb-9601-470f-873b-a28f3af0b0ef tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02, portal: 172.16.0.220,3260]
Nov 03 12:21:36 user nova-compute[74960]: Login to [iface: default, target: iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02, portal: 172.16.0.220,3260] successful.
Nov 03 12:21:36 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:21:36 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:21:36 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:21:36 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[2435a1f1-3cfb-42e4-bef4-cc4c594ccdb7]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:21:36 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-82dd5adb-9601-470f-873b-a28f3af0b0ef tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:21:36 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:21:36 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:21:36 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f5cd7f4-62da-42a7-ae8c-513ea85d4d4c]: (4, ('tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b06fb29-6288-4cca-aabd-39d9c089c045 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02 (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:21:36 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-82dd5adb-9601-470f-873b-a28f3af0b0ef tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19 (non-flash)
Nov 03 12:21:36 user nova-compute[74960]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b06fb29-6288-4cca-aabd-39d9c089c045 (non-flash)
Nov 03 12:21:36 user nova-compute[74960]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02 (non-flash)
Nov 03 12:21:36 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:21:36 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-82dd5adb-9601-470f-873b-a28f3af0b0ef tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] iscsi session list stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19 (non-flash)
Nov 03 12:21:36 user nova-compute[74960]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b06fb29-6288-4cca-aabd-39d9c089c045 (non-flash)
Nov 03 12:21:36 user nova-compute[74960]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02 (non-flash)
Nov 03 12:21:36 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:21:36 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-82dd5adb-9601-470f-873b-a28f3af0b0ef tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.322s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:21:36 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-82dd5adb-9601-470f-873b-a28f3af0b0ef tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Connected to 172.16.0.220:3260 {{(pid=74960) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 12:21:36 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-82dd5adb-9601-470f-873b-a28f3af0b0ef tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] HCTL ('34', '-', '-', 0) found on session 9 with lun 0 {{(pid=74960) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 12:21:36 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-82dd5adb-9601-470f-873b-a28f3af0b0ef tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74960) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 12:21:36 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:21:36 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:21:36 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ff9a10d-5b9c-4cf2-9c61-251b57d44e8f]: (4, ('- - 0', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:21:36 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-82dd5adb-9601-470f-873b-a28f3af0b0ef tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Searching for a device in session 9 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74960) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 12:21:36 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-82dd5adb-9601-470f-873b-a28f3af0b0ef tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OLuClVhy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74960) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 12:21:37 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:21:37 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-82dd5adb-9601-470f-873b-a28f3af0b0ef tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.356s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:21:37 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-82dd5adb-9601-470f-873b-a28f3af0b0ef tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] <== connect_volume: return (1357ms) {'type': 'block', 'scsi_wwn': '23464636638663363', 'path': '/dev/sdc'} {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:21:37 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82dd5adb-9601-470f-873b-a28f3af0b0ef tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23464636638663363', 'path': '/dev/sdc'} {{(pid=74960) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 12:21:37 user nova-compute[74960]: DEBUG nova.objects.instance [None req-82dd5adb-9601-470f-873b-a28f3af0b0ef tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Lazy-loading 'flavor' on Instance uuid 05956d9b-0646-43d2-a4cd-19e9090020ee {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:21:37 user nova-compute[74960]: DEBUG nova.virt.libvirt.guest [None req-82dd5adb-9601-470f-873b-a28f3af0b0ef tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] attach device xml: <disk type="block" device="disk">
Nov 03 12:21:37 user nova-compute[74960]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 12:21:37 user nova-compute[74960]:   <source dev="/dev/sdc"/>
Nov 03 12:21:37 user nova-compute[74960]:   <target dev="vdb" bus="virtio"/>
Nov 03 12:21:37 user nova-compute[74960]:   <serial>1bcf17d9-fd5c-4707-9091-a767c871bc02</serial>
Nov 03 12:21:37 user nova-compute[74960]: </disk>
Nov 03 12:21:37 user nova-compute[74960]:  {{(pid=74960) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 03 12:21:38 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:21:38 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-82dd5adb-9601-470f-873b-a28f3af0b0ef tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] No BDM found with device name vda, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:21:38 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-82dd5adb-9601-470f-873b-a28f3af0b0ef tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:21:38 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-82dd5adb-9601-470f-873b-a28f3af0b0ef tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] No VIF found with MAC fa:16:3e:28:71:ee, not building metadata {{(pid=74960) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 12:21:38 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-82dd5adb-9601-470f-873b-a28f3af0b0ef tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Lock "05956d9b-0646-43d2-a4cd-19e9090020ee" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 57.243s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:21:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:21:39 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:21:39 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:21:40 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:21:42 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:21:42 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:21:43 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:21:43 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:21:44 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:21:44 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Starting heal instance info cache {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 12:21:44 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "refresh_cache-8381c969-6a2d-4934-aadd-660ffa246b05" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:21:44 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquired lock "refresh_cache-8381c969-6a2d-4934-aadd-660ffa246b05" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:21:44 user nova-compute[74960]: DEBUG nova.network.neutron [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: 8381c969-6a2d-4934-aadd-660ffa246b05] Forcefully refreshing network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 12:21:45 user nova-compute[74960]: DEBUG nova.network.neutron [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: 8381c969-6a2d-4934-aadd-660ffa246b05] Updating instance_info_cache with network_info: [{"id": "df5604b7-7f5b-4738-b218-0016b4441542", "address": "fa:16:3e:8c:e9:c2", "network": {"id": "148a1e23-c4e0-4ea4-98e4-443552dd8f70", "bridge": "br-int", "label": "tempest-TestVolumeSwap-874596856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5477a0b396d64025bfc321100dd29041", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf5604b7-7f", "ovs_interfaceid": "df5604b7-7f5b-4738-b218-0016b4441542", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:21:45 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Releasing lock "refresh_cache-8381c969-6a2d-4934-aadd-660ffa246b05" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:21:45 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: 8381c969-6a2d-4934-aadd-660ffa246b05] Updated the network info_cache for instance {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 12:21:45 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:21:45 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:21:45 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:21:45 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:21:45 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:21:45 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Auditing locally available compute resources for user (node: user) {{(pid=74960) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 12:21:45 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a198493-7329-43ff-bceb-56b50529be29/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:21:45 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a198493-7329-43ff-bceb-56b50529be29/disk --force-share --output=json" returned: 0 in 0.270s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:21:45 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a198493-7329-43ff-bceb-56b50529be29/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:21:45 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:21:46 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a198493-7329-43ff-bceb-56b50529be29/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:21:46 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e5ec97f-80c4-4499-94bf-2584fc0eae03/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:21:46 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e5ec97f-80c4-4499-94bf-2584fc0eae03/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:21:46 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e5ec97f-80c4-4499-94bf-2584fc0eae03/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:21:46 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e5ec97f-80c4-4499-94bf-2584fc0eae03/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:21:46 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] skipping disk /dev/sdb (vdc) as it is a volume {{(pid=74960) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 12:21:46 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05956d9b-0646-43d2-a4cd-19e9090020ee/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:21:46 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05956d9b-0646-43d2-a4cd-19e9090020ee/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:21:46 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05956d9b-0646-43d2-a4cd-19e9090020ee/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:21:46 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05956d9b-0646-43d2-a4cd-19e9090020ee/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:21:46 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74960) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 12:21:46 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7769e3c5-136f-4282-8e3e-224e3a80922c/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:21:47 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7769e3c5-136f-4282-8e3e-224e3a80922c/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:21:47 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7769e3c5-136f-4282-8e3e-224e3a80922c/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:21:47 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7769e3c5-136f-4282-8e3e-224e3a80922c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:21:47 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8381c969-6a2d-4934-aadd-660ffa246b05/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:21:47 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8381c969-6a2d-4934-aadd-660ffa246b05/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:21:47 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8381c969-6a2d-4934-aadd-660ffa246b05/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:21:47 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8381c969-6a2d-4934-aadd-660ffa246b05/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:21:47 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74960) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 12:21:47 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fffd1dd7-b8e8-435c-bdfe-6c5001b21daf/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:21:47 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:21:47 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fffd1dd7-b8e8-435c-bdfe-6c5001b21daf/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:21:47 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fffd1dd7-b8e8-435c-bdfe-6c5001b21daf/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:21:48 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fffd1dd7-b8e8-435c-bdfe-6c5001b21daf/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:21:48 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6145a30b-809c-4bc5-a45f-c3ff3b170a22/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:21:48 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6145a30b-809c-4bc5-a45f-c3ff3b170a22/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:21:48 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6145a30b-809c-4bc5-a45f-c3ff3b170a22/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:21:48 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6145a30b-809c-4bc5-a45f-c3ff3b170a22/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:21:48 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e91dfcf4-caef-43d0-a56b-b1282363d4e0/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:21:48 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e91dfcf4-caef-43d0-a56b-b1282363d4e0/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:21:48 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e91dfcf4-caef-43d0-a56b-b1282363d4e0/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:21:48 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:21:48 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:21:48 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e91dfcf4-caef-43d0-a56b-b1282363d4e0/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:21:48 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:21:49 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:21:49 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:21:49 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Hypervisor/Node resource view: name=user free_ram=7754MB free_disk=25.366851806640625GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74960) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 12:21:49 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:21:49 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:21:49 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 7769e3c5-136f-4282-8e3e-224e3a80922c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:21:49 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance e91dfcf4-caef-43d0-a56b-b1282363d4e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:21:49 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 8381c969-6a2d-4934-aadd-660ffa246b05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:21:49 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 05956d9b-0646-43d2-a4cd-19e9090020ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:21:49 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 6145a30b-809c-4bc5-a45f-c3ff3b170a22 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:21:49 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 0a198493-7329-43ff-bceb-56b50529be29 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:21:49 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 7e5ec97f-80c4-4499-94bf-2584fc0eae03 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:21:49 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance fffd1dd7-b8e8-435c-bdfe-6c5001b21daf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:21:49 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74960) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 12:21:49 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74960) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 12:21:49 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:21:49 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:21:49 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Compute_service record updated for user:user {{(pid=74960) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 12:21:49 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.551s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:21:49 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:21:49 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74960) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 12:21:51 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:21:52 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:21:53 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:21:55 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-2d52df23-ac5c-4810-9301-1e3de76ba0e0 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Acquiring lock "f009a400-0576-48a9-82e0-60de8935c498" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:21:55 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-2d52df23-ac5c-4810-9301-1e3de76ba0e0 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Lock "f009a400-0576-48a9-82e0-60de8935c498" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:21:55 user nova-compute[74960]: DEBUG nova.compute.manager [None req-2d52df23-ac5c-4810-9301-1e3de76ba0e0 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] [instance: f009a400-0576-48a9-82e0-60de8935c498] Starting instance... {{(pid=74960) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 12:21:55 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-2d52df23-ac5c-4810-9301-1e3de76ba0e0 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:21:55 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-2d52df23-ac5c-4810-9301-1e3de76ba0e0 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:21:55 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-2d52df23-ac5c-4810-9301-1e3de76ba0e0 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74960) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 12:21:55 user nova-compute[74960]: INFO nova.compute.claims [None req-2d52df23-ac5c-4810-9301-1e3de76ba0e0 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] [instance: f009a400-0576-48a9-82e0-60de8935c498] Claim successful on node user
Nov 03 12:21:55 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-2d52df23-ac5c-4810-9301-1e3de76ba0e0 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:21:55 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-2d52df23-ac5c-4810-9301-1e3de76ba0e0 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:21:55 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-2d52df23-ac5c-4810-9301-1e3de76ba0e0 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.460s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:21:55 user nova-compute[74960]: DEBUG nova.compute.manager [None req-2d52df23-ac5c-4810-9301-1e3de76ba0e0 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] [instance: f009a400-0576-48a9-82e0-60de8935c498] Start building networks asynchronously for instance. {{(pid=74960) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 12:21:55 user nova-compute[74960]: DEBUG nova.compute.manager [None req-2d52df23-ac5c-4810-9301-1e3de76ba0e0 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] [instance: f009a400-0576-48a9-82e0-60de8935c498] Allocating IP information in the background. {{(pid=74960) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 12:21:55 user nova-compute[74960]: DEBUG nova.network.neutron [None req-2d52df23-ac5c-4810-9301-1e3de76ba0e0 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] [instance: f009a400-0576-48a9-82e0-60de8935c498] allocate_for_instance() {{(pid=74960) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 12:21:55 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-2d52df23-ac5c-4810-9301-1e3de76ba0e0 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] [instance: f009a400-0576-48a9-82e0-60de8935c498] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 12:21:55 user nova-compute[74960]: DEBUG nova.compute.manager [None req-2d52df23-ac5c-4810-9301-1e3de76ba0e0 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] [instance: f009a400-0576-48a9-82e0-60de8935c498] Start building block device mappings for instance. {{(pid=74960) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 12:21:56 user nova-compute[74960]: DEBUG nova.policy [None req-2d52df23-ac5c-4810-9301-1e3de76ba0e0 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b7080314bc6e400d97bdb4b9bd4071c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039968e1b97457b8fc21b593af4e1ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74960) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 12:21:56 user nova-compute[74960]: DEBUG nova.compute.manager [None req-2d52df23-ac5c-4810-9301-1e3de76ba0e0 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] [instance: f009a400-0576-48a9-82e0-60de8935c498] Start spawning the instance on the hypervisor. {{(pid=74960) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 12:21:56 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-2d52df23-ac5c-4810-9301-1e3de76ba0e0 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] [instance: f009a400-0576-48a9-82e0-60de8935c498] Creating instance directory {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 12:21:56 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-2d52df23-ac5c-4810-9301-1e3de76ba0e0 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] [instance: f009a400-0576-48a9-82e0-60de8935c498] Creating image(s)
Nov 03 12:21:56 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-2d52df23-ac5c-4810-9301-1e3de76ba0e0 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Acquiring lock "/opt/stack/data/nova/instances/f009a400-0576-48a9-82e0-60de8935c498/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:21:56 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-2d52df23-ac5c-4810-9301-1e3de76ba0e0 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Lock "/opt/stack/data/nova/instances/f009a400-0576-48a9-82e0-60de8935c498/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:21:56 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-2d52df23-ac5c-4810-9301-1e3de76ba0e0 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Lock "/opt/stack/data/nova/instances/f009a400-0576-48a9-82e0-60de8935c498/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:21:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-2d52df23-ac5c-4810-9301-1e3de76ba0e0 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:21:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-2d52df23-ac5c-4810-9301-1e3de76ba0e0 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.187s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:21:56 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-2d52df23-ac5c-4810-9301-1e3de76ba0e0 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Acquiring lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:21:56 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-2d52df23-ac5c-4810-9301-1e3de76ba0e0 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:21:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-2d52df23-ac5c-4810-9301-1e3de76ba0e0 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:21:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-2d52df23-ac5c-4810-9301-1e3de76ba0e0 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.187s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:21:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-2d52df23-ac5c-4810-9301-1e3de76ba0e0 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910,backing_fmt=raw /opt/stack/data/nova/instances/f009a400-0576-48a9-82e0-60de8935c498/disk 1073741824 {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:21:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-2d52df23-ac5c-4810-9301-1e3de76ba0e0 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910,backing_fmt=raw /opt/stack/data/nova/instances/f009a400-0576-48a9-82e0-60de8935c498/disk 1073741824" returned: 0 in 0.054s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:21:56 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-2d52df23-ac5c-4810-9301-1e3de76ba0e0 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:21:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-2d52df23-ac5c-4810-9301-1e3de76ba0e0 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:21:56 user nova-compute[74960]: DEBUG nova.network.neutron [None req-2d52df23-ac5c-4810-9301-1e3de76ba0e0 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] [instance: f009a400-0576-48a9-82e0-60de8935c498] Successfully created port: 4b72249c-3aea-415f-83a8-d0498d55674e {{(pid=74960) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 12:21:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-2d52df23-ac5c-4810-9301-1e3de76ba0e0 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.254s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:21:56 user nova-compute[74960]: DEBUG nova.virt.disk.api [None req-2d52df23-ac5c-4810-9301-1e3de76ba0e0 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f009a400-0576-48a9-82e0-60de8935c498/disk. size=1073741824 {{(pid=74960) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 12:21:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-2d52df23-ac5c-4810-9301-1e3de76ba0e0 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f009a400-0576-48a9-82e0-60de8935c498/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:21:57 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-2d52df23-ac5c-4810-9301-1e3de76ba0e0 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f009a400-0576-48a9-82e0-60de8935c498/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:21:57 user nova-compute[74960]: DEBUG nova.virt.disk.api [None req-2d52df23-ac5c-4810-9301-1e3de76ba0e0 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Cannot resize image /opt/stack/data/nova/instances/f009a400-0576-48a9-82e0-60de8935c498/disk to a smaller size. {{(pid=74960) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 12:21:57 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-2d52df23-ac5c-4810-9301-1e3de76ba0e0 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] [instance: f009a400-0576-48a9-82e0-60de8935c498] Created local disks {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 12:21:57 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-2d52df23-ac5c-4810-9301-1e3de76ba0e0 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] [instance: f009a400-0576-48a9-82e0-60de8935c498] Ensure instance console log exists: /opt/stack/data/nova/instances/f009a400-0576-48a9-82e0-60de8935c498/console.log {{(pid=74960) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 12:21:57 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-2d52df23-ac5c-4810-9301-1e3de76ba0e0 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:21:57 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-2d52df23-ac5c-4810-9301-1e3de76ba0e0 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:21:57 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-2d52df23-ac5c-4810-9301-1e3de76ba0e0 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:21:57 user nova-compute[74960]: DEBUG nova.network.neutron [None req-2d52df23-ac5c-4810-9301-1e3de76ba0e0 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] [instance: f009a400-0576-48a9-82e0-60de8935c498] Successfully updated port: 4b72249c-3aea-415f-83a8-d0498d55674e {{(pid=74960) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 12:21:57 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-2d52df23-ac5c-4810-9301-1e3de76ba0e0 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Acquiring lock "refresh_cache-f009a400-0576-48a9-82e0-60de8935c498" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:21:57 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-2d52df23-ac5c-4810-9301-1e3de76ba0e0 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Acquired lock "refresh_cache-f009a400-0576-48a9-82e0-60de8935c498" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:21:57 user nova-compute[74960]: DEBUG nova.network.neutron [None req-2d52df23-ac5c-4810-9301-1e3de76ba0e0 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] [instance: f009a400-0576-48a9-82e0-60de8935c498] Building network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 12:21:57 user nova-compute[74960]: DEBUG nova.network.neutron [None req-2d52df23-ac5c-4810-9301-1e3de76ba0e0 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] [instance: f009a400-0576-48a9-82e0-60de8935c498] Instance cache missing network info. {{(pid=74960) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 12:21:57 user nova-compute[74960]: DEBUG nova.compute.manager [req-6a3ff531-7584-469b-9445-c20a46c4a624 req-cea50631-0b89-4340-b681-0e539d3f974a service nova] [instance: f009a400-0576-48a9-82e0-60de8935c498] Received event network-changed-4b72249c-3aea-415f-83a8-d0498d55674e {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:21:57 user nova-compute[74960]: DEBUG nova.compute.manager [req-6a3ff531-7584-469b-9445-c20a46c4a624 req-cea50631-0b89-4340-b681-0e539d3f974a service nova] [instance: f009a400-0576-48a9-82e0-60de8935c498] Refreshing instance network info cache due to event network-changed-4b72249c-3aea-415f-83a8-d0498d55674e. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 12:21:57 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-6a3ff531-7584-469b-9445-c20a46c4a624 req-cea50631-0b89-4340-b681-0e539d3f974a service nova] Acquiring lock "refresh_cache-f009a400-0576-48a9-82e0-60de8935c498" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:21:57 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:21:57 user nova-compute[74960]: DEBUG nova.network.neutron [None req-2d52df23-ac5c-4810-9301-1e3de76ba0e0 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] [instance: f009a400-0576-48a9-82e0-60de8935c498] Updating instance_info_cache with network_info: [{"id": "4b72249c-3aea-415f-83a8-d0498d55674e", "address": "fa:16:3e:81:8a:f6", "network": {"id": "b92f11b0-994f-48b7-be64-02cb782a1f8f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-997339008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d039968e1b97457b8fc21b593af4e1ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b72249c-3a", "ovs_interfaceid": "4b72249c-3aea-415f-83a8-d0498d55674e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:21:57 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-2d52df23-ac5c-4810-9301-1e3de76ba0e0 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Releasing lock "refresh_cache-f009a400-0576-48a9-82e0-60de8935c498" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:21:57 user nova-compute[74960]: DEBUG nova.compute.manager [None req-2d52df23-ac5c-4810-9301-1e3de76ba0e0 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] [instance: f009a400-0576-48a9-82e0-60de8935c498] Instance network_info: |[{"id": "4b72249c-3aea-415f-83a8-d0498d55674e", "address": "fa:16:3e:81:8a:f6", "network": {"id": "b92f11b0-994f-48b7-be64-02cb782a1f8f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-997339008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d039968e1b97457b8fc21b593af4e1ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b72249c-3a", "ovs_interfaceid": "4b72249c-3aea-415f-83a8-d0498d55674e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74960) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 12:21:57 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-6a3ff531-7584-469b-9445-c20a46c4a624 req-cea50631-0b89-4340-b681-0e539d3f974a service nova] Acquired lock "refresh_cache-f009a400-0576-48a9-82e0-60de8935c498" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:21:57 user nova-compute[74960]: DEBUG nova.network.neutron [req-6a3ff531-7584-469b-9445-c20a46c4a624 req-cea50631-0b89-4340-b681-0e539d3f974a service nova] [instance: f009a400-0576-48a9-82e0-60de8935c498] Refreshing network info cache for port 4b72249c-3aea-415f-83a8-d0498d55674e {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 12:21:57 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-2d52df23-ac5c-4810-9301-1e3de76ba0e0 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] [instance: f009a400-0576-48a9-82e0-60de8935c498] Start _get_guest_xml network_info=[{"id": "4b72249c-3aea-415f-83a8-d0498d55674e", "address": "fa:16:3e:81:8a:f6", "network": {"id": "b92f11b0-994f-48b7-be64-02cb782a1f8f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-997339008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d039968e1b97457b8fc21b593af4e1ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b72249c-3a", "ovs_interfaceid": "4b72249c-3aea-415f-83a8-d0498d55674e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=549f51ba-ac69-494b-8de1-34635aa2d7cf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='63ee9c80c632442fb0379f47b784bd20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T12:13:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'image_id': '549f51ba-ac69-494b-8de1-34635aa2d7cf'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 12:21:57 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-2d52df23-ac5c-4810-9301-1e3de76ba0e0 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:21:57 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-2d52df23-ac5c-4810-9301-1e3de76ba0e0 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:21:57 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-2d52df23-ac5c-4810-9301-1e3de76ba0e0 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 12:21:57 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-2d52df23-ac5c-4810-9301-1e3de76ba0e0 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] CPU controller missing on host. {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 12:21:58 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-2d52df23-ac5c-4810-9301-1e3de76ba0e0 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 12:21:58 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-2d52df23-ac5c-4810-9301-1e3de76ba0e0 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] CPU controller found on host. {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 12:21:58 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-2d52df23-ac5c-4810-9301-1e3de76ba0e0 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74960) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 12:21:58 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-2d52df23-ac5c-4810-9301-1e3de76ba0e0 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=549f51ba-ac69-494b-8de1-34635aa2d7cf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='63ee9c80c632442fb0379f47b784bd20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T12:13:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 12:21:58 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-2d52df23-ac5c-4810-9301-1e3de76ba0e0 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Flavor limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 12:21:58 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-2d52df23-ac5c-4810-9301-1e3de76ba0e0 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Image limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 12:21:58 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-2d52df23-ac5c-4810-9301-1e3de76ba0e0 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Flavor pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 12:21:58 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-2d52df23-ac5c-4810-9301-1e3de76ba0e0 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Image pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 12:21:58 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-2d52df23-ac5c-4810-9301-1e3de76ba0e0 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 12:21:58 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-2d52df23-ac5c-4810-9301-1e3de76ba0e0 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 12:21:58 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-2d52df23-ac5c-4810-9301-1e3de76ba0e0 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 12:21:58 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-2d52df23-ac5c-4810-9301-1e3de76ba0e0 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Got 1 possible topologies {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 12:21:58 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-2d52df23-ac5c-4810-9301-1e3de76ba0e0 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 12:21:58 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-2d52df23-ac5c-4810-9301-1e3de76ba0e0 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 12:21:58 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-2d52df23-ac5c-4810-9301-1e3de76ba0e0 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:21:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-302715128',display_name='tempest-ServerStableDeviceRescueTest-server-302715128',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-302715128',id=15,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKEJiNHk1MpJMHtnc9xz6UlLngjMhp2MEBhRlDPcSKLcrBwK03cPu7BEeyeirBfTHeIalig4pFBXX2rcKQNvvtYx9QYR4XrIrZ4ChHFhaM/FICjNG5IWTOJ5TxEEBwPkoQ==',key_name='tempest-keypair-1624034761',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d039968e1b97457b8fc21b593af4e1ff',ramdisk_id='',reservation_id='r-2awyc6mw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1015453085',owner_user_name='tempest-ServerStableDeviceRescueTest-1015453085-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:21:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7080314bc6e400d97bdb4b9bd4071c3',uuid=f009a400-0576-48a9-82e0-60de8935c498,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4b72249c-3aea-415f-83a8-d0498d55674e", "address": "fa:16:3e:81:8a:f6", "network": {"id": "b92f11b0-994f-48b7-be64-02cb782a1f8f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-997339008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d039968e1b97457b8fc21b593af4e1ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b72249c-3a", "ovs_interfaceid": "4b72249c-3aea-415f-83a8-d0498d55674e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74960) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 12:21:58 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-2d52df23-ac5c-4810-9301-1e3de76ba0e0 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Converting VIF {"id": "4b72249c-3aea-415f-83a8-d0498d55674e", "address": "fa:16:3e:81:8a:f6", "network": {"id": "b92f11b0-994f-48b7-be64-02cb782a1f8f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-997339008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d039968e1b97457b8fc21b593af4e1ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b72249c-3a", "ovs_interfaceid": "4b72249c-3aea-415f-83a8-d0498d55674e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:21:58 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-2d52df23-ac5c-4810-9301-1e3de76ba0e0 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:8a:f6,bridge_name='br-int',has_traffic_filtering=True,id=4b72249c-3aea-415f-83a8-d0498d55674e,network=Network(b92f11b0-994f-48b7-be64-02cb782a1f8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b72249c-3a') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:21:58 user nova-compute[74960]: DEBUG nova.objects.instance [None req-2d52df23-ac5c-4810-9301-1e3de76ba0e0 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Lazy-loading 'pci_devices' on Instance uuid f009a400-0576-48a9-82e0-60de8935c498 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:21:58 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-2d52df23-ac5c-4810-9301-1e3de76ba0e0 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] [instance: f009a400-0576-48a9-82e0-60de8935c498] End _get_guest_xml xml=<domain type="kvm">
Nov 03 12:21:58 user nova-compute[74960]:   <uuid>f009a400-0576-48a9-82e0-60de8935c498</uuid>
Nov 03 12:21:58 user nova-compute[74960]:   <name>instance-0000000f</name>
Nov 03 12:21:58 user nova-compute[74960]:   <memory>524288</memory>
Nov 03 12:21:58 user nova-compute[74960]:   <vcpu>1</vcpu>
Nov 03 12:21:58 user nova-compute[74960]:   <metadata>
Nov 03 12:21:58 user nova-compute[74960]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 12:21:58 user nova-compute[74960]:       <nova:package version="0.0.0"/>
Nov 03 12:21:58 user nova-compute[74960]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-302715128</nova:name>
Nov 03 12:21:58 user nova-compute[74960]:       <nova:creationTime>2023-11-03 12:21:57</nova:creationTime>
Nov 03 12:21:58 user nova-compute[74960]:       <nova:flavor name="m1.tiny">
Nov 03 12:21:58 user nova-compute[74960]:         <nova:memory>512</nova:memory>
Nov 03 12:21:58 user nova-compute[74960]:         <nova:disk>1</nova:disk>
Nov 03 12:21:58 user nova-compute[74960]:         <nova:swap>0</nova:swap>
Nov 03 12:21:58 user nova-compute[74960]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 12:21:58 user nova-compute[74960]:         <nova:vcpus>1</nova:vcpus>
Nov 03 12:21:58 user nova-compute[74960]:       </nova:flavor>
Nov 03 12:21:58 user nova-compute[74960]:       <nova:owner>
Nov 03 12:21:58 user nova-compute[74960]:         <nova:user uuid="b7080314bc6e400d97bdb4b9bd4071c3">tempest-ServerStableDeviceRescueTest-1015453085-project-member</nova:user>
Nov 03 12:21:58 user nova-compute[74960]:         <nova:project uuid="d039968e1b97457b8fc21b593af4e1ff">tempest-ServerStableDeviceRescueTest-1015453085</nova:project>
Nov 03 12:21:58 user nova-compute[74960]:       </nova:owner>
Nov 03 12:21:58 user nova-compute[74960]:       <nova:root type="image" uuid="549f51ba-ac69-494b-8de1-34635aa2d7cf"/>
Nov 03 12:21:58 user nova-compute[74960]:       <nova:ports>
Nov 03 12:21:58 user nova-compute[74960]:         <nova:port uuid="4b72249c-3aea-415f-83a8-d0498d55674e">
Nov 03 12:21:58 user nova-compute[74960]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 03 12:21:58 user nova-compute[74960]:         </nova:port>
Nov 03 12:21:58 user nova-compute[74960]:       </nova:ports>
Nov 03 12:21:58 user nova-compute[74960]:     </nova:instance>
Nov 03 12:21:58 user nova-compute[74960]:   </metadata>
Nov 03 12:21:58 user nova-compute[74960]:   <sysinfo type="smbios">
Nov 03 12:21:58 user nova-compute[74960]:     <system>
Nov 03 12:21:58 user nova-compute[74960]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 12:21:58 user nova-compute[74960]:       <entry name="product">OpenStack Nova</entry>
Nov 03 12:21:58 user nova-compute[74960]:       <entry name="version">0.0.0</entry>
Nov 03 12:21:58 user nova-compute[74960]:       <entry name="serial">f009a400-0576-48a9-82e0-60de8935c498</entry>
Nov 03 12:21:58 user nova-compute[74960]:       <entry name="uuid">f009a400-0576-48a9-82e0-60de8935c498</entry>
Nov 03 12:21:58 user nova-compute[74960]:       <entry name="family">Virtual Machine</entry>
Nov 03 12:21:58 user nova-compute[74960]:     </system>
Nov 03 12:21:58 user nova-compute[74960]:   </sysinfo>
Nov 03 12:21:58 user nova-compute[74960]:   <os>
Nov 03 12:21:58 user nova-compute[74960]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 12:21:58 user nova-compute[74960]:     <boot dev="hd"/>
Nov 03 12:21:58 user nova-compute[74960]:     <smbios mode="sysinfo"/>
Nov 03 12:21:58 user nova-compute[74960]:   </os>
Nov 03 12:21:58 user nova-compute[74960]:   <features>
Nov 03 12:21:58 user nova-compute[74960]:     <acpi/>
Nov 03 12:21:58 user nova-compute[74960]:     <apic/>
Nov 03 12:21:58 user nova-compute[74960]:     <vmcoreinfo/>
Nov 03 12:21:58 user nova-compute[74960]:   </features>
Nov 03 12:21:58 user nova-compute[74960]:   <clock offset="utc">
Nov 03 12:21:58 user nova-compute[74960]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 12:21:58 user nova-compute[74960]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 12:21:58 user nova-compute[74960]:     <timer name="hpet" present="no"/>
Nov 03 12:21:58 user nova-compute[74960]:   </clock>
Nov 03 12:21:58 user nova-compute[74960]:   <cpu mode="custom" match="exact">
Nov 03 12:21:58 user nova-compute[74960]:     <model>Nehalem</model>
Nov 03 12:21:58 user nova-compute[74960]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 12:21:58 user nova-compute[74960]:   </cpu>
Nov 03 12:21:58 user nova-compute[74960]:   <devices>
Nov 03 12:21:58 user nova-compute[74960]:     <disk type="file" device="disk">
Nov 03 12:21:58 user nova-compute[74960]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 12:21:58 user nova-compute[74960]:       <source file="/opt/stack/data/nova/instances/f009a400-0576-48a9-82e0-60de8935c498/disk"/>
Nov 03 12:21:58 user nova-compute[74960]:       <target dev="vda" bus="virtio"/>
Nov 03 12:21:58 user nova-compute[74960]:     </disk>
Nov 03 12:21:58 user nova-compute[74960]:     <interface type="ethernet">
Nov 03 12:21:58 user nova-compute[74960]:       <mac address="fa:16:3e:81:8a:f6"/>
Nov 03 12:21:58 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:21:58 user nova-compute[74960]:       <mtu size="1442"/>
Nov 03 12:21:58 user nova-compute[74960]:       <target dev="tap4b72249c-3a"/>
Nov 03 12:21:58 user nova-compute[74960]:     </interface>
Nov 03 12:21:58 user nova-compute[74960]:     <serial type="pty">
Nov 03 12:21:58 user nova-compute[74960]:       <log file="/opt/stack/data/nova/instances/f009a400-0576-48a9-82e0-60de8935c498/console.log" append="off"/>
Nov 03 12:21:58 user nova-compute[74960]:     </serial>
Nov 03 12:21:58 user nova-compute[74960]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 12:21:58 user nova-compute[74960]:     <video>
Nov 03 12:21:58 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:21:58 user nova-compute[74960]:     </video>
Nov 03 12:21:58 user nova-compute[74960]:     <rng model="virtio">
Nov 03 12:21:58 user nova-compute[74960]:       <backend model="random">/dev/urandom</backend>
Nov 03 12:21:58 user nova-compute[74960]:     </rng>
Nov 03 12:21:58 user nova-compute[74960]:     <controller type="usb" index="0" model="none"/>
Nov 03 12:21:58 user nova-compute[74960]:     <memballoon model="virtio">
Nov 03 12:21:58 user nova-compute[74960]:       <stats period="10"/>
Nov 03 12:21:58 user nova-compute[74960]:     </memballoon>
Nov 03 12:21:58 user nova-compute[74960]:   </devices>
Nov 03 12:21:58 user nova-compute[74960]: </domain>
Nov 03 12:21:58 user nova-compute[74960]:  {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 12:21:58 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-2d52df23-ac5c-4810-9301-1e3de76ba0e0 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:21:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-302715128',display_name='tempest-ServerStableDeviceRescueTest-server-302715128',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-302715128',id=15,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKEJiNHk1MpJMHtnc9xz6UlLngjMhp2MEBhRlDPcSKLcrBwK03cPu7BEeyeirBfTHeIalig4pFBXX2rcKQNvvtYx9QYR4XrIrZ4ChHFhaM/FICjNG5IWTOJ5TxEEBwPkoQ==',key_name='tempest-keypair-1624034761',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d039968e1b97457b8fc21b593af4e1ff',ramdisk_id='',reservation_id='r-2awyc6mw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1015453085',owner_user_name='tempest-ServerStableDeviceRescueTest-1015453085-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:21:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7080314bc6e400d97bdb4b9bd4071c3',uuid=f009a400-0576-48a9-82e0-60de8935c498,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4b72249c-3aea-415f-83a8-d0498d55674e", "address": "fa:16:3e:81:8a:f6", "network": {"id": "b92f11b0-994f-48b7-be64-02cb782a1f8f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-997339008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d039968e1b97457b8fc21b593af4e1ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b72249c-3a", "ovs_interfaceid": "4b72249c-3aea-415f-83a8-d0498d55674e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 12:21:58 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-2d52df23-ac5c-4810-9301-1e3de76ba0e0 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Converting VIF {"id": "4b72249c-3aea-415f-83a8-d0498d55674e", "address": "fa:16:3e:81:8a:f6", "network": {"id": "b92f11b0-994f-48b7-be64-02cb782a1f8f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-997339008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d039968e1b97457b8fc21b593af4e1ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b72249c-3a", "ovs_interfaceid": "4b72249c-3aea-415f-83a8-d0498d55674e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:21:58 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-2d52df23-ac5c-4810-9301-1e3de76ba0e0 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:8a:f6,bridge_name='br-int',has_traffic_filtering=True,id=4b72249c-3aea-415f-83a8-d0498d55674e,network=Network(b92f11b0-994f-48b7-be64-02cb782a1f8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b72249c-3a') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:21:58 user nova-compute[74960]: DEBUG os_vif [None req-2d52df23-ac5c-4810-9301-1e3de76ba0e0 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:8a:f6,bridge_name='br-int',has_traffic_filtering=True,id=4b72249c-3aea-415f-83a8-d0498d55674e,network=Network(b92f11b0-994f-48b7-be64-02cb782a1f8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b72249c-3a') {{(pid=74960) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 12:21:58 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:21:58 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:21:58 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 12:21:58 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:21:58 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '27b97aa4-54a9-5aa4-821a-d8f31c5f0f15', '_type': 'linux-noop'}}, row=False) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:21:58 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:21:58 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:21:58 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:21:58 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4b72249c-3a, may_exist=True, interface_attrs={}) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:21:58 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4b72249c-3a, col_values=(('qos', UUID('e7e37123-b2c1-45ba-b9b1-12414338fc38')),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:21:58 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4b72249c-3a, col_values=(('external_ids', {'iface-id': '4b72249c-3aea-415f-83a8-d0498d55674e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:81:8a:f6', 'vm-uuid': 'f009a400-0576-48a9-82e0-60de8935c498'}),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:21:58 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:21:58 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:21:58 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:21:58 user nova-compute[74960]: INFO os_vif [None req-2d52df23-ac5c-4810-9301-1e3de76ba0e0 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:8a:f6,bridge_name='br-int',has_traffic_filtering=True,id=4b72249c-3aea-415f-83a8-d0498d55674e,network=Network(b92f11b0-994f-48b7-be64-02cb782a1f8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b72249c-3a')
Nov 03 12:21:58 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-2d52df23-ac5c-4810-9301-1e3de76ba0e0 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] No BDM found with device name vda, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:21:58 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-2d52df23-ac5c-4810-9301-1e3de76ba0e0 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] No VIF found with MAC fa:16:3e:81:8a:f6, not building metadata {{(pid=74960) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 12:21:58 user nova-compute[74960]: DEBUG nova.network.neutron [req-6a3ff531-7584-469b-9445-c20a46c4a624 req-cea50631-0b89-4340-b681-0e539d3f974a service nova] [instance: f009a400-0576-48a9-82e0-60de8935c498] Updated VIF entry in instance network info cache for port 4b72249c-3aea-415f-83a8-d0498d55674e. {{(pid=74960) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 12:21:58 user nova-compute[74960]: DEBUG nova.network.neutron [req-6a3ff531-7584-469b-9445-c20a46c4a624 req-cea50631-0b89-4340-b681-0e539d3f974a service nova] [instance: f009a400-0576-48a9-82e0-60de8935c498] Updating instance_info_cache with network_info: [{"id": "4b72249c-3aea-415f-83a8-d0498d55674e", "address": "fa:16:3e:81:8a:f6", "network": {"id": "b92f11b0-994f-48b7-be64-02cb782a1f8f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-997339008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d039968e1b97457b8fc21b593af4e1ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b72249c-3a", "ovs_interfaceid": "4b72249c-3aea-415f-83a8-d0498d55674e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:21:58 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-6a3ff531-7584-469b-9445-c20a46c4a624 req-cea50631-0b89-4340-b681-0e539d3f974a service nova] Releasing lock "refresh_cache-f009a400-0576-48a9-82e0-60de8935c498" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:21:59 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:21:59 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:21:59 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:21:59 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:21:59 user nova-compute[74960]: DEBUG nova.compute.manager [req-afae3f7c-e2bd-48ee-b854-d5dab5808087 req-f7c6ce7c-bd04-4ec9-8fc2-b24dcf1d1640 service nova] [instance: f009a400-0576-48a9-82e0-60de8935c498] Received event network-vif-plugged-4b72249c-3aea-415f-83a8-d0498d55674e {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:21:59 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-afae3f7c-e2bd-48ee-b854-d5dab5808087 req-f7c6ce7c-bd04-4ec9-8fc2-b24dcf1d1640 service nova] Acquiring lock "f009a400-0576-48a9-82e0-60de8935c498-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:21:59 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-afae3f7c-e2bd-48ee-b854-d5dab5808087 req-f7c6ce7c-bd04-4ec9-8fc2-b24dcf1d1640 service nova] Lock "f009a400-0576-48a9-82e0-60de8935c498-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:21:59 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-afae3f7c-e2bd-48ee-b854-d5dab5808087 req-f7c6ce7c-bd04-4ec9-8fc2-b24dcf1d1640 service nova] Lock "f009a400-0576-48a9-82e0-60de8935c498-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:21:59 user nova-compute[74960]: DEBUG nova.compute.manager [req-afae3f7c-e2bd-48ee-b854-d5dab5808087 req-f7c6ce7c-bd04-4ec9-8fc2-b24dcf1d1640 service nova] [instance: f009a400-0576-48a9-82e0-60de8935c498] No waiting events found dispatching network-vif-plugged-4b72249c-3aea-415f-83a8-d0498d55674e {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:21:59 user nova-compute[74960]: WARNING nova.compute.manager [req-afae3f7c-e2bd-48ee-b854-d5dab5808087 req-f7c6ce7c-bd04-4ec9-8fc2-b24dcf1d1640 service nova] [instance: f009a400-0576-48a9-82e0-60de8935c498] Received unexpected event network-vif-plugged-4b72249c-3aea-415f-83a8-d0498d55674e for instance with vm_state building and task_state spawning.
Nov 03 12:22:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:22:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:22:01 user nova-compute[74960]: DEBUG nova.compute.manager [None req-2d52df23-ac5c-4810-9301-1e3de76ba0e0 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] [instance: f009a400-0576-48a9-82e0-60de8935c498] Instance event wait completed in 0 seconds for  {{(pid=74960) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 12:22:01 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-2d52df23-ac5c-4810-9301-1e3de76ba0e0 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] [instance: f009a400-0576-48a9-82e0-60de8935c498] Guest created on hypervisor {{(pid=74960) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 12:22:01 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: f009a400-0576-48a9-82e0-60de8935c498] Instance spawned successfully.
Nov 03 12:22:01 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-2d52df23-ac5c-4810-9301-1e3de76ba0e0 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] [instance: f009a400-0576-48a9-82e0-60de8935c498] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 12:22:01 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-2d52df23-ac5c-4810-9301-1e3de76ba0e0 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] [instance: f009a400-0576-48a9-82e0-60de8935c498] Found default for hw_cdrom_bus of ide {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:22:01 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-2d52df23-ac5c-4810-9301-1e3de76ba0e0 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] [instance: f009a400-0576-48a9-82e0-60de8935c498] Found default for hw_disk_bus of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:22:01 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-2d52df23-ac5c-4810-9301-1e3de76ba0e0 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] [instance: f009a400-0576-48a9-82e0-60de8935c498] Found default for hw_input_bus of None {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:22:01 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-2d52df23-ac5c-4810-9301-1e3de76ba0e0 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] [instance: f009a400-0576-48a9-82e0-60de8935c498] Found default for hw_pointer_model of None {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:22:01 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-2d52df23-ac5c-4810-9301-1e3de76ba0e0 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] [instance: f009a400-0576-48a9-82e0-60de8935c498] Found default for hw_video_model of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:22:01 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-2d52df23-ac5c-4810-9301-1e3de76ba0e0 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] [instance: f009a400-0576-48a9-82e0-60de8935c498] Found default for hw_vif_model of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:22:01 user nova-compute[74960]: DEBUG nova.compute.manager [req-1bf12bef-32b7-4549-9792-c61e6479659c req-d3a67f2d-686c-4d1c-bcdd-f5e0c2088c46 service nova] [instance: f009a400-0576-48a9-82e0-60de8935c498] Received event network-vif-plugged-4b72249c-3aea-415f-83a8-d0498d55674e {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:22:01 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-1bf12bef-32b7-4549-9792-c61e6479659c req-d3a67f2d-686c-4d1c-bcdd-f5e0c2088c46 service nova] Acquiring lock "f009a400-0576-48a9-82e0-60de8935c498-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:22:01 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-1bf12bef-32b7-4549-9792-c61e6479659c req-d3a67f2d-686c-4d1c-bcdd-f5e0c2088c46 service nova] Lock "f009a400-0576-48a9-82e0-60de8935c498-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:22:01 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-1bf12bef-32b7-4549-9792-c61e6479659c req-d3a67f2d-686c-4d1c-bcdd-f5e0c2088c46 service nova] Lock "f009a400-0576-48a9-82e0-60de8935c498-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:22:01 user nova-compute[74960]: DEBUG nova.compute.manager [req-1bf12bef-32b7-4549-9792-c61e6479659c req-d3a67f2d-686c-4d1c-bcdd-f5e0c2088c46 service nova] [instance: f009a400-0576-48a9-82e0-60de8935c498] No waiting events found dispatching network-vif-plugged-4b72249c-3aea-415f-83a8-d0498d55674e {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:22:01 user nova-compute[74960]: WARNING nova.compute.manager [req-1bf12bef-32b7-4549-9792-c61e6479659c req-d3a67f2d-686c-4d1c-bcdd-f5e0c2088c46 service nova] [instance: f009a400-0576-48a9-82e0-60de8935c498] Received unexpected event network-vif-plugged-4b72249c-3aea-415f-83a8-d0498d55674e for instance with vm_state building and task_state spawning.
Nov 03 12:22:02 user nova-compute[74960]: INFO nova.compute.manager [None req-2d52df23-ac5c-4810-9301-1e3de76ba0e0 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] [instance: f009a400-0576-48a9-82e0-60de8935c498] Took 5.93 seconds to spawn the instance on the hypervisor.
Nov 03 12:22:02 user nova-compute[74960]: DEBUG nova.compute.manager [None req-2d52df23-ac5c-4810-9301-1e3de76ba0e0 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] [instance: f009a400-0576-48a9-82e0-60de8935c498] Checking state {{(pid=74960) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 12:22:02 user nova-compute[74960]: INFO nova.compute.manager [None req-2d52df23-ac5c-4810-9301-1e3de76ba0e0 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] [instance: f009a400-0576-48a9-82e0-60de8935c498] Took 6.79 seconds to build instance.
Nov 03 12:22:02 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-2d52df23-ac5c-4810-9301-1e3de76ba0e0 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Lock "f009a400-0576-48a9-82e0-60de8935c498" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.887s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:22:02 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:22:03 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:22:06 user nova-compute[74960]: DEBUG nova.compute.manager [req-9e30a1eb-45db-431e-a055-60d6734de21b req-d30d4067-c866-4567-a486-f20bb48e8df4 service nova] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] Received event network-changed-4d0cd9f3-3345-43ce-b449-8a46402e6cbd {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:22:06 user nova-compute[74960]: DEBUG nova.compute.manager [req-9e30a1eb-45db-431e-a055-60d6734de21b req-d30d4067-c866-4567-a486-f20bb48e8df4 service nova] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] Refreshing instance network info cache due to event network-changed-4d0cd9f3-3345-43ce-b449-8a46402e6cbd. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 12:22:06 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-9e30a1eb-45db-431e-a055-60d6734de21b req-d30d4067-c866-4567-a486-f20bb48e8df4 service nova] Acquiring lock "refresh_cache-05956d9b-0646-43d2-a4cd-19e9090020ee" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:22:06 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-9e30a1eb-45db-431e-a055-60d6734de21b req-d30d4067-c866-4567-a486-f20bb48e8df4 service nova] Acquired lock "refresh_cache-05956d9b-0646-43d2-a4cd-19e9090020ee" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:22:06 user nova-compute[74960]: DEBUG nova.network.neutron [req-9e30a1eb-45db-431e-a055-60d6734de21b req-d30d4067-c866-4567-a486-f20bb48e8df4 service nova] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] Refreshing network info cache for port 4d0cd9f3-3345-43ce-b449-8a46402e6cbd {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 12:22:07 user nova-compute[74960]: DEBUG nova.network.neutron [req-9e30a1eb-45db-431e-a055-60d6734de21b req-d30d4067-c866-4567-a486-f20bb48e8df4 service nova] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] Updated VIF entry in instance network info cache for port 4d0cd9f3-3345-43ce-b449-8a46402e6cbd. {{(pid=74960) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 12:22:07 user nova-compute[74960]: DEBUG nova.network.neutron [req-9e30a1eb-45db-431e-a055-60d6734de21b req-d30d4067-c866-4567-a486-f20bb48e8df4 service nova] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] Updating instance_info_cache with network_info: [{"id": "4d0cd9f3-3345-43ce-b449-8a46402e6cbd", "address": "fa:16:3e:28:71:ee", "network": {"id": "b3813163-d09b-4c0b-a328-1bbb4c7e2875", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1681555035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d4a374c1c544718887bd75b77a72a3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d0cd9f3-33", "ovs_interfaceid": "4d0cd9f3-3345-43ce-b449-8a46402e6cbd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:22:07 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-9e30a1eb-45db-431e-a055-60d6734de21b req-d30d4067-c866-4567-a486-f20bb48e8df4 service nova] Releasing lock "refresh_cache-05956d9b-0646-43d2-a4cd-19e9090020ee" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:22:07 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:22:08 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:22:09 user nova-compute[74960]: DEBUG nova.compute.manager [req-8059a6b3-7529-4eff-90ed-8b7e4982b05b req-2807a09f-d7d6-4668-b827-7df4e874bb57 service nova] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] Received event network-changed-4d0cd9f3-3345-43ce-b449-8a46402e6cbd {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:22:09 user nova-compute[74960]: DEBUG nova.compute.manager [req-8059a6b3-7529-4eff-90ed-8b7e4982b05b req-2807a09f-d7d6-4668-b827-7df4e874bb57 service nova] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] Refreshing instance network info cache due to event network-changed-4d0cd9f3-3345-43ce-b449-8a46402e6cbd. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 12:22:09 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-8059a6b3-7529-4eff-90ed-8b7e4982b05b req-2807a09f-d7d6-4668-b827-7df4e874bb57 service nova] Acquiring lock "refresh_cache-05956d9b-0646-43d2-a4cd-19e9090020ee" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:22:09 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-8059a6b3-7529-4eff-90ed-8b7e4982b05b req-2807a09f-d7d6-4668-b827-7df4e874bb57 service nova] Acquired lock "refresh_cache-05956d9b-0646-43d2-a4cd-19e9090020ee" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:22:09 user nova-compute[74960]: DEBUG nova.network.neutron [req-8059a6b3-7529-4eff-90ed-8b7e4982b05b req-2807a09f-d7d6-4668-b827-7df4e874bb57 service nova] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] Refreshing network info cache for port 4d0cd9f3-3345-43ce-b449-8a46402e6cbd {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 12:22:10 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:22:10 user nova-compute[74960]: DEBUG nova.network.neutron [req-8059a6b3-7529-4eff-90ed-8b7e4982b05b req-2807a09f-d7d6-4668-b827-7df4e874bb57 service nova] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] Updated VIF entry in instance network info cache for port 4d0cd9f3-3345-43ce-b449-8a46402e6cbd. {{(pid=74960) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 12:22:10 user nova-compute[74960]: DEBUG nova.network.neutron [req-8059a6b3-7529-4eff-90ed-8b7e4982b05b req-2807a09f-d7d6-4668-b827-7df4e874bb57 service nova] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] Updating instance_info_cache with network_info: [{"id": "4d0cd9f3-3345-43ce-b449-8a46402e6cbd", "address": "fa:16:3e:28:71:ee", "network": {"id": "b3813163-d09b-4c0b-a328-1bbb4c7e2875", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1681555035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d4a374c1c544718887bd75b77a72a3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d0cd9f3-33", "ovs_interfaceid": "4d0cd9f3-3345-43ce-b449-8a46402e6cbd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:22:10 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-8059a6b3-7529-4eff-90ed-8b7e4982b05b req-2807a09f-d7d6-4668-b827-7df4e874bb57 service nova] Releasing lock "refresh_cache-05956d9b-0646-43d2-a4cd-19e9090020ee" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:22:12 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:22:12 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:22:13 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:22:13 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:22:16 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:22:17 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:22:17 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:22:18 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:22:18 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:22:22 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Acquiring lock "05956d9b-0646-43d2-a4cd-19e9090020ee" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:22:22 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Lock "05956d9b-0646-43d2-a4cd-19e9090020ee" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:22:22 user nova-compute[74960]: INFO nova.compute.manager [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] Rebooting instance
Nov 03 12:22:22 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:22:22 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:22:22 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Acquiring lock "refresh_cache-05956d9b-0646-43d2-a4cd-19e9090020ee" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:22:22 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Acquired lock "refresh_cache-05956d9b-0646-43d2-a4cd-19e9090020ee" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:22:22 user nova-compute[74960]: DEBUG nova.network.neutron [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] Building network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 12:22:23 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:22:23 user nova-compute[74960]: DEBUG nova.network.neutron [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] Updating instance_info_cache with network_info: [{"id": "4d0cd9f3-3345-43ce-b449-8a46402e6cbd", "address": "fa:16:3e:28:71:ee", "network": {"id": "b3813163-d09b-4c0b-a328-1bbb4c7e2875", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1681555035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d4a374c1c544718887bd75b77a72a3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d0cd9f3-33", "ovs_interfaceid": "4d0cd9f3-3345-43ce-b449-8a46402e6cbd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:22:23 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Releasing lock "refresh_cache-05956d9b-0646-43d2-a4cd-19e9090020ee" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:22:23 user nova-compute[74960]: DEBUG nova.compute.manager [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] Checking state {{(pid=74960) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 12:22:23 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:22:23 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:22:23 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:22:23 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:22:24 user nova-compute[74960]: DEBUG nova.compute.manager [req-b4c31cc3-acb9-4b76-85e5-28f15dbdf9c7 req-7902b43e-1471-40f0-b9df-e5d27c971996 service nova] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] Received event network-vif-unplugged-4d0cd9f3-3345-43ce-b449-8a46402e6cbd {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:22:24 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-b4c31cc3-acb9-4b76-85e5-28f15dbdf9c7 req-7902b43e-1471-40f0-b9df-e5d27c971996 service nova] Acquiring lock "05956d9b-0646-43d2-a4cd-19e9090020ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:22:24 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-b4c31cc3-acb9-4b76-85e5-28f15dbdf9c7 req-7902b43e-1471-40f0-b9df-e5d27c971996 service nova] Lock "05956d9b-0646-43d2-a4cd-19e9090020ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:22:24 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-b4c31cc3-acb9-4b76-85e5-28f15dbdf9c7 req-7902b43e-1471-40f0-b9df-e5d27c971996 service nova] Lock "05956d9b-0646-43d2-a4cd-19e9090020ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:22:24 user nova-compute[74960]: DEBUG nova.compute.manager [req-b4c31cc3-acb9-4b76-85e5-28f15dbdf9c7 req-7902b43e-1471-40f0-b9df-e5d27c971996 service nova] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] No waiting events found dispatching network-vif-unplugged-4d0cd9f3-3345-43ce-b449-8a46402e6cbd {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:22:24 user nova-compute[74960]: WARNING nova.compute.manager [req-b4c31cc3-acb9-4b76-85e5-28f15dbdf9c7 req-7902b43e-1471-40f0-b9df-e5d27c971996 service nova] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] Received unexpected event network-vif-unplugged-4d0cd9f3-3345-43ce-b449-8a46402e6cbd for instance with vm_state active and task_state reboot_started_hard.
Nov 03 12:22:24 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] Instance destroyed successfully.
Nov 03 12:22:24 user nova-compute[74960]: DEBUG nova.objects.instance [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Lazy-loading 'resources' on Instance uuid 05956d9b-0646-43d2-a4cd-19e9090020ee {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:22:24 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:18:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2026890033',display_name='tempest-TestMinimumBasicScenario-server-2026890033',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2026890033',id=10,image_ref='22e1e9fb-500f-48a2-9f93-47a950579b41',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEmmaNRsYvlITo2mBRrQk4Ph36BrmDVaNziIg/uzay0OjgI7mZIcYRdg4M+NpnkQoh0QuRzo+cbfBEGhGGbEQaBkR5RXU9uN2kRmYlLXm8XiWRT2sIof/dwVYJht5VILJQ==',key_name='tempest-TestMinimumBasicScenario-307288959',keypairs=<?>,launch_index=0,launched_at=2023-11-03T12:18:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9d4a374c1c544718887bd75b77a72a3a',ramdisk_id='',reservation_id='r-4pweyes6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='22e1e9fb-500f-48a2-9f93-47a950579b41',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-585836766',owner_user_name='tempest-TestMinimumBasicScenario-585836766-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T12:22:23Z,user_data=None,user_id='1c9880db5b784aadaeba7492523df5e8',uuid=05956d9b-0646-43d2-a4cd-19e9090020ee,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4d0cd9f3-3345-43ce-b449-8a46402e6cbd", "address": "fa:16:3e:28:71:ee", "network": {"id": "b3813163-d09b-4c0b-a328-1bbb4c7e2875", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1681555035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d4a374c1c544718887bd75b77a72a3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d0cd9f3-33", "ovs_interfaceid": "4d0cd9f3-3345-43ce-b449-8a46402e6cbd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 12:22:24 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Converting VIF {"id": "4d0cd9f3-3345-43ce-b449-8a46402e6cbd", "address": "fa:16:3e:28:71:ee", "network": {"id": "b3813163-d09b-4c0b-a328-1bbb4c7e2875", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1681555035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d4a374c1c544718887bd75b77a72a3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d0cd9f3-33", "ovs_interfaceid": "4d0cd9f3-3345-43ce-b449-8a46402e6cbd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:22:24 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:28:71:ee,bridge_name='br-int',has_traffic_filtering=True,id=4d0cd9f3-3345-43ce-b449-8a46402e6cbd,network=Network(b3813163-d09b-4c0b-a328-1bbb4c7e2875),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d0cd9f3-33') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:22:24 user nova-compute[74960]: DEBUG os_vif [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:71:ee,bridge_name='br-int',has_traffic_filtering=True,id=4d0cd9f3-3345-43ce-b449-8a46402e6cbd,network=Network(b3813163-d09b-4c0b-a328-1bbb4c7e2875),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d0cd9f3-33') {{(pid=74960) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 12:22:24 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:22:24 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4d0cd9f3-33, bridge=br-int, if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:22:24 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:22:24 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:22:24 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:22:24 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=47c9e2ae-f6fb-47c2-9b89-40d0f7665498) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:22:24 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:22:24 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:22:24 user nova-compute[74960]: INFO os_vif [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:71:ee,bridge_name='br-int',has_traffic_filtering=True,id=4d0cd9f3-3345-43ce-b449-8a46402e6cbd,network=Network(b3813163-d09b-4c0b-a328-1bbb4c7e2875),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d0cd9f3-33')
Nov 03 12:22:24 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] calling os-brick to detach iSCSI Volume {{(pid=74960) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 12:22:24 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9aa420acb0>, {'target_iqn': 'iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OLuClVhy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:22:24 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:22:24 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:22:24 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:22:24 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:22:24 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:22:24 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[162512ec-7aa6-4a4a-b206-996a064dbdea]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8b06fb29-6288-4cca-aabd-39d9c089c045\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:22:24 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 12:22:24 user nova-compute[74960]: No targets found.
Nov 03 12:22:24 user nova-compute[74960]: iSNS:
Nov 03 12:22:24 user nova-compute[74960]: No targets found.
Nov 03 12:22:24 user nova-compute[74960]: STATIC:
Nov 03 12:22:24 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:8b06fb29-6288-4cca-aabd-39d9c089c045
Nov 03 12:22:24 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:22:24 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:22:24 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19
Nov 03 12:22:24 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:22:24 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:22:24 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02
Nov 03 12:22:24 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:22:24 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:22:24 user nova-compute[74960]: FIRMWARE:
Nov 03 12:22:24 user nova-compute[74960]: No targets found.
Nov 03 12:22:24 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:22:24 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 12:22:24 user nova-compute[74960]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 12:22:24 user nova-compute[74960]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74960) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 12:22:24 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02', 0)] {{(pid=74960) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 12:22:24 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:22:24 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:22:24 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[e511da61-7bfa-44b4-9d7a-96d7eaca627b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8b06fb29-6288-4cca-aabd-39d9c089c045\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:22:24 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:22:24 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:22:24 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[e01f30ae-beb2-4283-b3cf-a8f75c31c434]: (4, ('tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b06fb29-6288-4cca-aabd-39d9c089c045 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02 (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:22:24 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19 (non-flash)
Nov 03 12:22:24 user nova-compute[74960]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b06fb29-6288-4cca-aabd-39d9c089c045 (non-flash)
Nov 03 12:22:24 user nova-compute[74960]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02 (non-flash)
Nov 03 12:22:24 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:22:24 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] iscsi session list stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19 (non-flash)
Nov 03 12:22:24 user nova-compute[74960]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b06fb29-6288-4cca-aabd-39d9c089c045 (non-flash)
Nov 03 12:22:24 user nova-compute[74960]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02 (non-flash)
Nov 03 12:22:24 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:22:24 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9a8c5dac20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02'): ({'sdc'}, set())}) {{(pid=74960) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 12:22:24 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Removing single pathed devices sdc {{(pid=74960) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 12:22:24 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:22:24 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:22:24 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[74043f69-adcc-4947-8dde-e208e13d160a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:22:24 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:22:24 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:22:24 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7f24779-ffbe-403f-b271-5630caff95be]: (4, ('ok\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:22:24 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Flushing IO for device /dev/sdc {{(pid=74960) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 12:22:24 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:22:24 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:22:24 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[82bfccff-a239-44e5-8423-574a95257579]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:22:24 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74960) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 12:22:24 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:22:24 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:22:24 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6d1d922-124f-4d10-abd1-d0a3ef067a02]: (4, ('1', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:22:24 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74960) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 12:22:24 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] SCSI volumes sdc have been removed. {{(pid=74960) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 12:22:24 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02')] {{(pid=74960) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 12:22:24 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:22:24 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.074s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:22:24 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[3821a7be-75f1-4c1b-a42c-cab2d7c7546f]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:22:24 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:22:24 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02 -p 172.16.0.220:3260 --logout {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:22:24 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:22:24 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[79e1f01d-6394-4d46-9ea0-3eb9f96e19b6]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:22:24 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02, portal: 172.16.0.220,3260]
Nov 03 12:22:24 user nova-compute[74960]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02, portal: 172.16.0.220,3260] successful.
Nov 03 12:22:24 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:22:24 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02 -p 172.16.0.220:3260 --op delete {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:22:24 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:22:24 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[23dc5b7c-de82-46e5-9673-4aece461f652]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:22:24 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:22:24 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.376s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:22:24 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] <== disconnect_volume: return (377ms) None {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:22:24 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] Disconnected iSCSI Volume {{(pid=74960) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 12:22:24 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] Start _get_guest_xml network_info=[{"id": "4d0cd9f3-3345-43ce-b449-8a46402e6cbd", "address": "fa:16:3e:28:71:ee", "network": {"id": "b3813163-d09b-4c0b-a328-1bbb4c7e2875", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1681555035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d4a374c1c544718887bd75b77a72a3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d0cd9f3-33", "ovs_interfaceid": "4d0cd9f3-3345-43ce-b449-8a46402e6cbd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=22e1e9fb-500f-48a2-9f93-47a950579b41,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'image_id': '22e1e9fb-500f-48a2-9f93-47a950579b41'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OLuClVhy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '05956d9b-0646-43d2-a4cd-19e9090020ee', 'attached_at': '', 'detached_at': '', 'volume_id': '1bcf17d9-fd5c-4707-9091-a767c871bc02', 'serial': '1bcf17d9-fd5c-4707-9091-a767c871bc02'}, 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'attachment_id': '42f43925-61b8-44f2-93f6-31969ac2a314', 'boot_index': None, 'guest_format': None, 'volume_type': None} {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 12:22:24 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:22:24 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:22:24 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 12:22:24 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] CPU controller missing on host. {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 12:22:24 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 12:22:24 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] CPU controller found on host. {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 12:22:24 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74960) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 12:22:24 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=22e1e9fb-500f-48a2-9f93-47a950579b41,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 12:22:24 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Flavor limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 12:22:24 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Image limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 12:22:24 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Flavor pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 12:22:24 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Image pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 12:22:24 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 12:22:24 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 12:22:24 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 12:22:24 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Got 1 possible topologies {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 12:22:24 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 12:22:24 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 12:22:24 user nova-compute[74960]: DEBUG nova.objects.instance [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Lazy-loading 'vcpu_model' on Instance uuid 05956d9b-0646-43d2-a4cd-19e9090020ee {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:22:25 user nova-compute[74960]: DEBUG nova.objects.base [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Object Instance<05956d9b-0646-43d2-a4cd-19e9090020ee> lazy-loaded attributes: resources,vcpu_model {{(pid=74960) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 12:22:25 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] Calling os-brick to attach iSCSI Volume {{(pid=74960) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 12:22:25 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9aa420acb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OLuClVhy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:22:25 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:22:25 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:22:25 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:22:25 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:22:25 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:22:25 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:22:25 user nova-compute[74960]: INFO os_brick.initiator.connectors.iscsi [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 12:22:25 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02 -p 172.16.0.220:3260 {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:22:25 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:22:25 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[41d60a8a-2a9e-4cbb-abe4-9b332171c644]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:22:25 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 12:22:25 user nova-compute[74960]:  {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:22:25 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02 -p 172.16.0.220:3260 --interface default --op new {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:22:25 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:22:25 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[670fc607-a8c8-4003-afee-2a4f1edcdd00]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02] added\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:22:25 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02] added
Nov 03 12:22:25 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:22:25 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:22:25 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:22:25 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2b9ec13-7df9-43d2-8b85-707f74c0c786]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:22:25 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:22:25 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:22:25 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:22:25 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2314985-bff9-4b7c-bf61-6a40d0986615]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:22:25 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:22:25 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OLuClVhy {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:22:25 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OLuClVhy" returned: 0 in 0.023s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:22:25 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[52447767-126f-477b-bb68-721f89d4ee75]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:22:25 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OLuClVhy'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:22:25 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:22:25 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:22:25 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab4308dd-0454-4025-a047-4acb61d1c54a]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:22:25 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:22:25 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:22:25 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:22:25 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[5afd255f-7e41-4a02-a4f6-0e3785e6e782]: (4, ('tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b06fb29-6288-4cca-aabd-39d9c089c045 (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:22:25 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19 (non-flash)
Nov 03 12:22:25 user nova-compute[74960]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b06fb29-6288-4cca-aabd-39d9c089c045 (non-flash)
Nov 03 12:22:25 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:22:25 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] iscsi session list stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19 (non-flash)
Nov 03 12:22:25 user nova-compute[74960]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b06fb29-6288-4cca-aabd-39d9c089c045 (non-flash)
Nov 03 12:22:25 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:22:25 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02 -p 172.16.0.220:3260 --login {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:22:25 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02 -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:22:25 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[94be8ba5-94ff-4e39-9338-11d21b3fba3e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:22:25 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02, portal: 172.16.0.220,3260]
Nov 03 12:22:25 user nova-compute[74960]: Login to [iface: default, target: iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02, portal: 172.16.0.220,3260] successful.
Nov 03 12:22:25 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:22:25 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:22:25 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:22:25 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[4de76f10-1309-4714-ba34-84ed221cded8]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:22:25 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:22:25 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:22:25 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:22:25 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[a00f7e34-60ea-4ffe-b208-6a6fe67bc467]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b06fb29-6288-4cca-aabd-39d9c089c045 (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:22:25 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02 (non-flash)
Nov 03 12:22:25 user nova-compute[74960]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19 (non-flash)
Nov 03 12:22:25 user nova-compute[74960]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b06fb29-6288-4cca-aabd-39d9c089c045 (non-flash)
Nov 03 12:22:25 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:22:25 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02 (non-flash)
Nov 03 12:22:25 user nova-compute[74960]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19 (non-flash)
Nov 03 12:22:25 user nova-compute[74960]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b06fb29-6288-4cca-aabd-39d9c089c045 (non-flash)
Nov 03 12:22:25 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:22:25 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.340s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:22:25 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Connected to 172.16.0.220:3260 {{(pid=74960) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 12:22:25 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] HCTL ('34', '-', '-', 0) found on session 10 with lun 0 {{(pid=74960) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 12:22:25 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74960) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 12:22:25 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:22:25 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:22:25 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[668e43ea-f93e-413d-ba97-d9e9467bcd04]: (4, ('- - 0', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:22:25 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Searching for a device in session 10 and hctl ['34', '*', '*', 0] yield: None {{(pid=74960) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 12:22:26 user nova-compute[74960]: DEBUG nova.compute.manager [req-579a5eae-8cee-425f-a608-7910b9422585 req-e799783a-b455-4216-99bb-d96ac8337a98 service nova] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] Received event network-vif-plugged-4d0cd9f3-3345-43ce-b449-8a46402e6cbd {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:22:26 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-579a5eae-8cee-425f-a608-7910b9422585 req-e799783a-b455-4216-99bb-d96ac8337a98 service nova] Acquiring lock "05956d9b-0646-43d2-a4cd-19e9090020ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:22:26 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-579a5eae-8cee-425f-a608-7910b9422585 req-e799783a-b455-4216-99bb-d96ac8337a98 service nova] Lock "05956d9b-0646-43d2-a4cd-19e9090020ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:22:26 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-579a5eae-8cee-425f-a608-7910b9422585 req-e799783a-b455-4216-99bb-d96ac8337a98 service nova] Lock "05956d9b-0646-43d2-a4cd-19e9090020ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:22:26 user nova-compute[74960]: DEBUG nova.compute.manager [req-579a5eae-8cee-425f-a608-7910b9422585 req-e799783a-b455-4216-99bb-d96ac8337a98 service nova] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] No waiting events found dispatching network-vif-plugged-4d0cd9f3-3345-43ce-b449-8a46402e6cbd {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:22:26 user nova-compute[74960]: WARNING nova.compute.manager [req-579a5eae-8cee-425f-a608-7910b9422585 req-e799783a-b455-4216-99bb-d96ac8337a98 service nova] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] Received unexpected event network-vif-plugged-4d0cd9f3-3345-43ce-b449-8a46402e6cbd for instance with vm_state active and task_state reboot_started_hard.
Nov 03 12:22:26 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Searching for a device in session 10 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74960) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 12:22:26 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OLuClVhy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74960) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 12:22:26 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.374s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:22:26 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] <== connect_volume: return (1376ms) {'type': 'block', 'scsi_wwn': '23464636638663363', 'path': '/dev/sdc'} {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:22:26 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23464636638663363', 'path': '/dev/sdc'} {{(pid=74960) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 12:22:26 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:18:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2026890033',display_name='tempest-TestMinimumBasicScenario-server-2026890033',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2026890033',id=10,image_ref='22e1e9fb-500f-48a2-9f93-47a950579b41',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEmmaNRsYvlITo2mBRrQk4Ph36BrmDVaNziIg/uzay0OjgI7mZIcYRdg4M+NpnkQoh0QuRzo+cbfBEGhGGbEQaBkR5RXU9uN2kRmYlLXm8XiWRT2sIof/dwVYJht5VILJQ==',key_name='tempest-TestMinimumBasicScenario-307288959',keypairs=<?>,launch_index=0,launched_at=2023-11-03T12:18:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9d4a374c1c544718887bd75b77a72a3a',ramdisk_id='',reservation_id='r-4pweyes6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='22e1e9fb-500f-48a2-9f93-47a950579b41',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-585836766',owner_user_name='tempest-TestMinimumBasicScenario-585836766-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T12:22:23Z,user_data=None,user_id='1c9880db5b784aadaeba7492523df5e8',uuid=05956d9b-0646-43d2-a4cd-19e9090020ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4d0cd9f3-3345-43ce-b449-8a46402e6cbd", "address": "fa:16:3e:28:71:ee", "network": {"id": "b3813163-d09b-4c0b-a328-1bbb4c7e2875", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1681555035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d4a374c1c544718887bd75b77a72a3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d0cd9f3-33", "ovs_interfaceid": "4d0cd9f3-3345-43ce-b449-8a46402e6cbd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74960) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 12:22:26 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Converting VIF {"id": "4d0cd9f3-3345-43ce-b449-8a46402e6cbd", "address": "fa:16:3e:28:71:ee", "network": {"id": "b3813163-d09b-4c0b-a328-1bbb4c7e2875", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1681555035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d4a374c1c544718887bd75b77a72a3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d0cd9f3-33", "ovs_interfaceid": "4d0cd9f3-3345-43ce-b449-8a46402e6cbd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:22:26 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:28:71:ee,bridge_name='br-int',has_traffic_filtering=True,id=4d0cd9f3-3345-43ce-b449-8a46402e6cbd,network=Network(b3813163-d09b-4c0b-a328-1bbb4c7e2875),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d0cd9f3-33') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:22:26 user nova-compute[74960]: DEBUG nova.objects.instance [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Lazy-loading 'pci_devices' on Instance uuid 05956d9b-0646-43d2-a4cd-19e9090020ee {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:22:26 user nova-compute[74960]: DEBUG nova.objects.base [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Object Instance<05956d9b-0646-43d2-a4cd-19e9090020ee> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=74960) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 12:22:26 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] End _get_guest_xml xml=<domain type="kvm">
Nov 03 12:22:26 user nova-compute[74960]:   <uuid>05956d9b-0646-43d2-a4cd-19e9090020ee</uuid>
Nov 03 12:22:26 user nova-compute[74960]:   <name>instance-0000000a</name>
Nov 03 12:22:26 user nova-compute[74960]:   <memory>524288</memory>
Nov 03 12:22:26 user nova-compute[74960]:   <vcpu>1</vcpu>
Nov 03 12:22:26 user nova-compute[74960]:   <metadata>
Nov 03 12:22:26 user nova-compute[74960]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 12:22:26 user nova-compute[74960]:       <nova:package version="0.0.0"/>
Nov 03 12:22:26 user nova-compute[74960]:       <nova:name>tempest-TestMinimumBasicScenario-server-2026890033</nova:name>
Nov 03 12:22:26 user nova-compute[74960]:       <nova:creationTime>2023-11-03 12:22:24</nova:creationTime>
Nov 03 12:22:26 user nova-compute[74960]:       <nova:flavor name="m1.tiny">
Nov 03 12:22:26 user nova-compute[74960]:         <nova:memory>512</nova:memory>
Nov 03 12:22:26 user nova-compute[74960]:         <nova:disk>1</nova:disk>
Nov 03 12:22:26 user nova-compute[74960]:         <nova:swap>0</nova:swap>
Nov 03 12:22:26 user nova-compute[74960]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 12:22:26 user nova-compute[74960]:         <nova:vcpus>1</nova:vcpus>
Nov 03 12:22:26 user nova-compute[74960]:       </nova:flavor>
Nov 03 12:22:26 user nova-compute[74960]:       <nova:owner>
Nov 03 12:22:26 user nova-compute[74960]:         <nova:user uuid="1c9880db5b784aadaeba7492523df5e8">tempest-TestMinimumBasicScenario-585836766-project-member</nova:user>
Nov 03 12:22:26 user nova-compute[74960]:         <nova:project uuid="9d4a374c1c544718887bd75b77a72a3a">tempest-TestMinimumBasicScenario-585836766</nova:project>
Nov 03 12:22:26 user nova-compute[74960]:       </nova:owner>
Nov 03 12:22:26 user nova-compute[74960]:       <nova:root type="image" uuid="22e1e9fb-500f-48a2-9f93-47a950579b41"/>
Nov 03 12:22:26 user nova-compute[74960]:       <nova:ports>
Nov 03 12:22:26 user nova-compute[74960]:         <nova:port uuid="4d0cd9f3-3345-43ce-b449-8a46402e6cbd">
Nov 03 12:22:26 user nova-compute[74960]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 03 12:22:26 user nova-compute[74960]:         </nova:port>
Nov 03 12:22:26 user nova-compute[74960]:       </nova:ports>
Nov 03 12:22:26 user nova-compute[74960]:     </nova:instance>
Nov 03 12:22:26 user nova-compute[74960]:   </metadata>
Nov 03 12:22:26 user nova-compute[74960]:   <sysinfo type="smbios">
Nov 03 12:22:26 user nova-compute[74960]:     <system>
Nov 03 12:22:26 user nova-compute[74960]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 12:22:26 user nova-compute[74960]:       <entry name="product">OpenStack Nova</entry>
Nov 03 12:22:26 user nova-compute[74960]:       <entry name="version">0.0.0</entry>
Nov 03 12:22:26 user nova-compute[74960]:       <entry name="serial">05956d9b-0646-43d2-a4cd-19e9090020ee</entry>
Nov 03 12:22:26 user nova-compute[74960]:       <entry name="uuid">05956d9b-0646-43d2-a4cd-19e9090020ee</entry>
Nov 03 12:22:26 user nova-compute[74960]:       <entry name="family">Virtual Machine</entry>
Nov 03 12:22:26 user nova-compute[74960]:     </system>
Nov 03 12:22:26 user nova-compute[74960]:   </sysinfo>
Nov 03 12:22:26 user nova-compute[74960]:   <os>
Nov 03 12:22:26 user nova-compute[74960]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 12:22:26 user nova-compute[74960]:     <boot dev="hd"/>
Nov 03 12:22:26 user nova-compute[74960]:     <smbios mode="sysinfo"/>
Nov 03 12:22:26 user nova-compute[74960]:   </os>
Nov 03 12:22:26 user nova-compute[74960]:   <features>
Nov 03 12:22:26 user nova-compute[74960]:     <acpi/>
Nov 03 12:22:26 user nova-compute[74960]:     <apic/>
Nov 03 12:22:26 user nova-compute[74960]:     <vmcoreinfo/>
Nov 03 12:22:26 user nova-compute[74960]:   </features>
Nov 03 12:22:26 user nova-compute[74960]:   <clock offset="utc">
Nov 03 12:22:26 user nova-compute[74960]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 12:22:26 user nova-compute[74960]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 12:22:26 user nova-compute[74960]:     <timer name="hpet" present="no"/>
Nov 03 12:22:26 user nova-compute[74960]:   </clock>
Nov 03 12:22:26 user nova-compute[74960]:   <cpu mode="custom" match="exact">
Nov 03 12:22:26 user nova-compute[74960]:     <model>Nehalem</model>
Nov 03 12:22:26 user nova-compute[74960]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 12:22:26 user nova-compute[74960]:   </cpu>
Nov 03 12:22:26 user nova-compute[74960]:   <devices>
Nov 03 12:22:26 user nova-compute[74960]:     <disk type="file" device="disk">
Nov 03 12:22:26 user nova-compute[74960]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 12:22:26 user nova-compute[74960]:       <source file="/opt/stack/data/nova/instances/05956d9b-0646-43d2-a4cd-19e9090020ee/disk"/>
Nov 03 12:22:26 user nova-compute[74960]:       <target dev="vda" bus="virtio"/>
Nov 03 12:22:26 user nova-compute[74960]:     </disk>
Nov 03 12:22:26 user nova-compute[74960]:     <disk type="block" device="disk">
Nov 03 12:22:26 user nova-compute[74960]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 12:22:26 user nova-compute[74960]:       <source dev="/dev/sdc"/>
Nov 03 12:22:26 user nova-compute[74960]:       <target dev="vdb" bus="virtio"/>
Nov 03 12:22:26 user nova-compute[74960]:       <serial>1bcf17d9-fd5c-4707-9091-a767c871bc02</serial>
Nov 03 12:22:26 user nova-compute[74960]:     </disk>
Nov 03 12:22:26 user nova-compute[74960]:     <interface type="ethernet">
Nov 03 12:22:26 user nova-compute[74960]:       <mac address="fa:16:3e:28:71:ee"/>
Nov 03 12:22:26 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:22:26 user nova-compute[74960]:       <mtu size="1442"/>
Nov 03 12:22:26 user nova-compute[74960]:       <target dev="tap4d0cd9f3-33"/>
Nov 03 12:22:26 user nova-compute[74960]:     </interface>
Nov 03 12:22:26 user nova-compute[74960]:     <serial type="pty">
Nov 03 12:22:26 user nova-compute[74960]:       <log file="/opt/stack/data/nova/instances/05956d9b-0646-43d2-a4cd-19e9090020ee/console.log" append="off"/>
Nov 03 12:22:26 user nova-compute[74960]:     </serial>
Nov 03 12:22:26 user nova-compute[74960]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 12:22:26 user nova-compute[74960]:     <video>
Nov 03 12:22:26 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:22:26 user nova-compute[74960]:     </video>
Nov 03 12:22:26 user nova-compute[74960]:     <rng model="virtio">
Nov 03 12:22:26 user nova-compute[74960]:       <backend model="random">/dev/urandom</backend>
Nov 03 12:22:26 user nova-compute[74960]:     </rng>
Nov 03 12:22:26 user nova-compute[74960]:     <controller type="usb" index="0" model="none"/>
Nov 03 12:22:26 user nova-compute[74960]:     <memballoon model="virtio">
Nov 03 12:22:26 user nova-compute[74960]:       <stats period="10"/>
Nov 03 12:22:26 user nova-compute[74960]:     </memballoon>
Nov 03 12:22:26 user nova-compute[74960]:   </devices>
Nov 03 12:22:26 user nova-compute[74960]: </domain>
Nov 03 12:22:26 user nova-compute[74960]:  {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 12:22:26 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05956d9b-0646-43d2-a4cd-19e9090020ee/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:22:26 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05956d9b-0646-43d2-a4cd-19e9090020ee/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:22:26 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05956d9b-0646-43d2-a4cd-19e9090020ee/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:22:26 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:22:26 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05956d9b-0646-43d2-a4cd-19e9090020ee/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:22:26 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74960) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 12:22:26 user nova-compute[74960]: DEBUG nova.objects.instance [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Lazy-loading 'trusted_certs' on Instance uuid 05956d9b-0646-43d2-a4cd-19e9090020ee {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:22:26 user nova-compute[74960]: DEBUG nova.objects.base [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Object Instance<05956d9b-0646-43d2-a4cd-19e9090020ee> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=74960) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 12:22:26 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95eaee271a42362ade595e1bcb5dde2063ccad30 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:22:27 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:22:27 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95eaee271a42362ade595e1bcb5dde2063ccad30 --force-share --output=json" returned: 0 in 0.231s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:22:27 user nova-compute[74960]: DEBUG nova.virt.disk.api [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Checking if we can resize image /opt/stack/data/nova/instances/05956d9b-0646-43d2-a4cd-19e9090020ee/disk. size=1073741824 {{(pid=74960) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 12:22:27 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05956d9b-0646-43d2-a4cd-19e9090020ee/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:22:27 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05956d9b-0646-43d2-a4cd-19e9090020ee/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:22:27 user nova-compute[74960]: DEBUG nova.virt.disk.api [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Cannot resize image /opt/stack/data/nova/instances/05956d9b-0646-43d2-a4cd-19e9090020ee/disk to a smaller size. {{(pid=74960) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 12:22:27 user nova-compute[74960]: DEBUG nova.objects.instance [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Lazy-loading 'migration_context' on Instance uuid 05956d9b-0646-43d2-a4cd-19e9090020ee {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:22:27 user nova-compute[74960]: DEBUG nova.objects.base [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Object Instance<05956d9b-0646-43d2-a4cd-19e9090020ee> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74960) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 12:22:27 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:18:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2026890033',display_name='tempest-TestMinimumBasicScenario-server-2026890033',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2026890033',id=10,image_ref='22e1e9fb-500f-48a2-9f93-47a950579b41',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEmmaNRsYvlITo2mBRrQk4Ph36BrmDVaNziIg/uzay0OjgI7mZIcYRdg4M+NpnkQoh0QuRzo+cbfBEGhGGbEQaBkR5RXU9uN2kRmYlLXm8XiWRT2sIof/dwVYJht5VILJQ==',key_name='tempest-TestMinimumBasicScenario-307288959',keypairs=<?>,launch_index=0,launched_at=2023-11-03T12:18:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='9d4a374c1c544718887bd75b77a72a3a',ramdisk_id='',reservation_id='r-4pweyes6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='22e1e9fb-500f-48a2-9f93-47a950579b41',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-585836766',owner_user_name='tempest-TestMinimumBasicScenario-585836766-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:22:23Z,user_data=None,user_id='1c9880db5b784aadaeba7492523df5e8',uuid=05956d9b-0646-43d2-a4cd-19e9090020ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4d0cd9f3-3345-43ce-b449-8a46402e6cbd", "address": "fa:16:3e:28:71:ee", "network": {"id": "b3813163-d09b-4c0b-a328-1bbb4c7e2875", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1681555035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d4a374c1c544718887bd75b77a72a3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d0cd9f3-33", "ovs_interfaceid": "4d0cd9f3-3345-43ce-b449-8a46402e6cbd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 12:22:27 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Converting VIF {"id": "4d0cd9f3-3345-43ce-b449-8a46402e6cbd", "address": "fa:16:3e:28:71:ee", "network": {"id": "b3813163-d09b-4c0b-a328-1bbb4c7e2875", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1681555035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d4a374c1c544718887bd75b77a72a3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d0cd9f3-33", "ovs_interfaceid": "4d0cd9f3-3345-43ce-b449-8a46402e6cbd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:22:27 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:28:71:ee,bridge_name='br-int',has_traffic_filtering=True,id=4d0cd9f3-3345-43ce-b449-8a46402e6cbd,network=Network(b3813163-d09b-4c0b-a328-1bbb4c7e2875),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d0cd9f3-33') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:22:27 user nova-compute[74960]: DEBUG os_vif [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:71:ee,bridge_name='br-int',has_traffic_filtering=True,id=4d0cd9f3-3345-43ce-b449-8a46402e6cbd,network=Network(b3813163-d09b-4c0b-a328-1bbb4c7e2875),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d0cd9f3-33') {{(pid=74960) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 12:22:27 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:22:27 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:22:27 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 12:22:27 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:22:27 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd84b3b69-ed7e-5761-8f37-1297ea5eb05a', '_type': 'linux-noop'}}, row=False) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:22:27 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:22:27 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:22:27 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:22:27 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4d0cd9f3-33, may_exist=True, interface_attrs={}) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:22:27 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4d0cd9f3-33, col_values=(('qos', UUID('fceee3d3-a0df-40a0-ba18-e8cbe7b37838')),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:22:27 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4d0cd9f3-33, col_values=(('external_ids', {'iface-id': '4d0cd9f3-3345-43ce-b449-8a46402e6cbd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:28:71:ee', 'vm-uuid': '05956d9b-0646-43d2-a4cd-19e9090020ee'}),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:22:27 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:22:27 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:22:27 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:22:27 user nova-compute[74960]: INFO os_vif [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:71:ee,bridge_name='br-int',has_traffic_filtering=True,id=4d0cd9f3-3345-43ce-b449-8a46402e6cbd,network=Network(b3813163-d09b-4c0b-a328-1bbb4c7e2875),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d0cd9f3-33')
Nov 03 12:22:27 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:22:28 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:22:28 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:22:28 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:22:29 user nova-compute[74960]: DEBUG nova.compute.manager [req-09e75232-950a-4eed-b26b-d161fbb93bd7 req-1ce59d30-3db5-45a9-a61b-0d62364f6937 service nova] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] Received event network-changed-c54167dd-e416-43bd-8271-dd55e9e71119 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:22:29 user nova-compute[74960]: DEBUG nova.compute.manager [req-09e75232-950a-4eed-b26b-d161fbb93bd7 req-1ce59d30-3db5-45a9-a61b-0d62364f6937 service nova] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] Refreshing instance network info cache due to event network-changed-c54167dd-e416-43bd-8271-dd55e9e71119. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 12:22:29 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-09e75232-950a-4eed-b26b-d161fbb93bd7 req-1ce59d30-3db5-45a9-a61b-0d62364f6937 service nova] Acquiring lock "refresh_cache-6145a30b-809c-4bc5-a45f-c3ff3b170a22" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:22:29 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-09e75232-950a-4eed-b26b-d161fbb93bd7 req-1ce59d30-3db5-45a9-a61b-0d62364f6937 service nova] Acquired lock "refresh_cache-6145a30b-809c-4bc5-a45f-c3ff3b170a22" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:22:29 user nova-compute[74960]: DEBUG nova.network.neutron [req-09e75232-950a-4eed-b26b-d161fbb93bd7 req-1ce59d30-3db5-45a9-a61b-0d62364f6937 service nova] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] Refreshing network info cache for port c54167dd-e416-43bd-8271-dd55e9e71119 {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 12:22:29 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:22:29 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:22:30 user nova-compute[74960]: DEBUG nova.network.neutron [req-09e75232-950a-4eed-b26b-d161fbb93bd7 req-1ce59d30-3db5-45a9-a61b-0d62364f6937 service nova] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] Updated VIF entry in instance network info cache for port c54167dd-e416-43bd-8271-dd55e9e71119. {{(pid=74960) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 12:22:30 user nova-compute[74960]: DEBUG nova.network.neutron [req-09e75232-950a-4eed-b26b-d161fbb93bd7 req-1ce59d30-3db5-45a9-a61b-0d62364f6937 service nova] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] Updating instance_info_cache with network_info: [{"id": "c54167dd-e416-43bd-8271-dd55e9e71119", "address": "fa:16:3e:33:a0:07", "network": {"id": "9c5fae09-5df5-45a3-b9cd-7ac3763ba878", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1736223258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5320673ee4f0422989a3708915375cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc54167dd-e4", "ovs_interfaceid": "c54167dd-e416-43bd-8271-dd55e9e71119", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:22:30 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-09e75232-950a-4eed-b26b-d161fbb93bd7 req-1ce59d30-3db5-45a9-a61b-0d62364f6937 service nova] Releasing lock "refresh_cache-6145a30b-809c-4bc5-a45f-c3ff3b170a22" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:22:30 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-0f90c731-df2b-4ba4-b8b1-a43fe9f84a39 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Acquiring lock "6145a30b-809c-4bc5-a45f-c3ff3b170a22" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:22:30 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-0f90c731-df2b-4ba4-b8b1-a43fe9f84a39 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Lock "6145a30b-809c-4bc5-a45f-c3ff3b170a22" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.004s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:22:30 user nova-compute[74960]: DEBUG nova.objects.instance [None req-0f90c731-df2b-4ba4-b8b1-a43fe9f84a39 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Lazy-loading 'flavor' on Instance uuid 6145a30b-809c-4bc5-a45f-c3ff3b170a22 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:22:30 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-0f90c731-df2b-4ba4-b8b1-a43fe9f84a39 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Lock "6145a30b-809c-4bc5-a45f-c3ff3b170a22" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.099s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:22:30 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:22:30 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-0f90c731-df2b-4ba4-b8b1-a43fe9f84a39 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Acquiring lock "6145a30b-809c-4bc5-a45f-c3ff3b170a22" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:22:30 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-0f90c731-df2b-4ba4-b8b1-a43fe9f84a39 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Lock "6145a30b-809c-4bc5-a45f-c3ff3b170a22" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:22:30 user nova-compute[74960]: INFO nova.compute.manager [None req-0f90c731-df2b-4ba4-b8b1-a43fe9f84a39 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] Attaching volume 91f59f2a-fb49-4bb7-8249-7c895b43aa01 to /dev/vdb
Nov 03 12:22:31 user nova-compute[74960]: DEBUG os_brick.utils [None req-0f90c731-df2b-4ba4-b8b1-a43fe9f84a39 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:22:31 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:22:31 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:22:31 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[602e851e-2909-4afd-adb0-e1b939593793]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:75b8e219756\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:22:31 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:22:31 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.025s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:22:31 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[f54f3adf-c4f0-4da8-bab1-2907e1d4ffe1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:22:31 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:22:31 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.027s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:22:31 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff2182fa-52b7-4d16-9336-e35fa092e7cf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:22:31 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e2dedd3-b9f1-4df0-b62e-972d6a404e8e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:22:31 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-0f90c731-df2b-4ba4-b8b1-a43fe9f84a39 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Running cmd (subprocess): nvme version {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:22:31 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-0f90c731-df2b-4ba4-b8b1-a43fe9f84a39 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] 'nvme version' failed. Not Retrying. {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 12:22:31 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0f90c731-df2b-4ba4-b8b1-a43fe9f84a39 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] nvme not present on system {{(pid=74960) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 12:22:31 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:22:31 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 12:22:31 user nova-compute[74960]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 12:22:31 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ae62fb-9494-4f1a-82ad-41211927f65c]: (4, '') {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:22:31 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-0f90c731-df2b-4ba4-b8b1-a43fe9f84a39 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74960) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 12:22:31 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-0f90c731-df2b-4ba4-b8b1-a43fe9f84a39 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74960) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 12:22:31 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-0f90c731-df2b-4ba4-b8b1-a43fe9f84a39 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] LIGHTOS: no hostnqn found. {{(pid=74960) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 12:22:31 user nova-compute[74960]: DEBUG os_brick.utils [None req-0f90c731-df2b-4ba4-b8b1-a43fe9f84a39 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] <== get_connector_properties: return (174ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:75b8e219756', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:22:31 user nova-compute[74960]: DEBUG nova.virt.block_device [None req-0f90c731-df2b-4ba4-b8b1-a43fe9f84a39 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] Updating existing volume attachment record: 6397fdfc-be10-46d6-a37c-136f0d7cd233 {{(pid=74960) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 12:22:31 user nova-compute[74960]: DEBUG nova.compute.manager [req-cae5c379-d306-4e95-b77b-832f75df92aa req-f2ec0dfd-42fa-42fb-9f63-c3fc2f2b46f0 service nova] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] Received event network-vif-plugged-4d0cd9f3-3345-43ce-b449-8a46402e6cbd {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:22:31 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-cae5c379-d306-4e95-b77b-832f75df92aa req-f2ec0dfd-42fa-42fb-9f63-c3fc2f2b46f0 service nova] Acquiring lock "05956d9b-0646-43d2-a4cd-19e9090020ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:22:31 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-cae5c379-d306-4e95-b77b-832f75df92aa req-f2ec0dfd-42fa-42fb-9f63-c3fc2f2b46f0 service nova] Lock "05956d9b-0646-43d2-a4cd-19e9090020ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:22:31 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-cae5c379-d306-4e95-b77b-832f75df92aa req-f2ec0dfd-42fa-42fb-9f63-c3fc2f2b46f0 service nova] Lock "05956d9b-0646-43d2-a4cd-19e9090020ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:22:31 user nova-compute[74960]: DEBUG nova.compute.manager [req-cae5c379-d306-4e95-b77b-832f75df92aa req-f2ec0dfd-42fa-42fb-9f63-c3fc2f2b46f0 service nova] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] No waiting events found dispatching network-vif-plugged-4d0cd9f3-3345-43ce-b449-8a46402e6cbd {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:22:31 user nova-compute[74960]: WARNING nova.compute.manager [req-cae5c379-d306-4e95-b77b-832f75df92aa req-f2ec0dfd-42fa-42fb-9f63-c3fc2f2b46f0 service nova] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] Received unexpected event network-vif-plugged-4d0cd9f3-3345-43ce-b449-8a46402e6cbd for instance with vm_state active and task_state reboot_started_hard.
Nov 03 12:22:31 user nova-compute[74960]: DEBUG nova.compute.manager [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] Instance event wait completed in 0 seconds for  {{(pid=74960) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 12:22:31 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] Instance rebooted successfully.
Nov 03 12:22:31 user nova-compute[74960]: DEBUG nova.compute.manager [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] Checking state {{(pid=74960) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 12:22:32 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-a26fe33b-8468-45eb-aff9-66ebeb879bad tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Lock "05956d9b-0646-43d2-a4cd-19e9090020ee" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 9.524s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:22:32 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:22:32 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:22:32 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:22:33 user nova-compute[74960]: DEBUG nova.compute.manager [req-3fb82282-0c0a-4d77-9912-cb48d05c60ed req-734f558c-8275-4e3f-a49c-af4cb872acf8 service nova] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] Received event network-vif-plugged-4d0cd9f3-3345-43ce-b449-8a46402e6cbd {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:22:33 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-3fb82282-0c0a-4d77-9912-cb48d05c60ed req-734f558c-8275-4e3f-a49c-af4cb872acf8 service nova] Acquiring lock "05956d9b-0646-43d2-a4cd-19e9090020ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:22:33 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-3fb82282-0c0a-4d77-9912-cb48d05c60ed req-734f558c-8275-4e3f-a49c-af4cb872acf8 service nova] Lock "05956d9b-0646-43d2-a4cd-19e9090020ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:22:33 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-3fb82282-0c0a-4d77-9912-cb48d05c60ed req-734f558c-8275-4e3f-a49c-af4cb872acf8 service nova] Lock "05956d9b-0646-43d2-a4cd-19e9090020ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:22:33 user nova-compute[74960]: DEBUG nova.compute.manager [req-3fb82282-0c0a-4d77-9912-cb48d05c60ed req-734f558c-8275-4e3f-a49c-af4cb872acf8 service nova] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] No waiting events found dispatching network-vif-plugged-4d0cd9f3-3345-43ce-b449-8a46402e6cbd {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:22:33 user nova-compute[74960]: WARNING nova.compute.manager [req-3fb82282-0c0a-4d77-9912-cb48d05c60ed req-734f558c-8275-4e3f-a49c-af4cb872acf8 service nova] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] Received unexpected event network-vif-plugged-4d0cd9f3-3345-43ce-b449-8a46402e6cbd for instance with vm_state active and task_state None.
Nov 03 12:22:35 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:22:35 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:22:35 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Cleaning up deleted instances {{(pid=74960) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 03 12:22:35 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] There are 0 instances to clean {{(pid=74960) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 03 12:22:35 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:22:35 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Cleaning up deleted instances with incomplete migration  {{(pid=74960) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 03 12:22:35 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-7ff4a14b-8aae-4aa4-9657-f4113b7f3bc5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Acquiring lock "7e5ec97f-80c4-4499-94bf-2584fc0eae03" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:22:35 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-7ff4a14b-8aae-4aa4-9657-f4113b7f3bc5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Lock "7e5ec97f-80c4-4499-94bf-2584fc0eae03" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:22:35 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-81436afa-2015-41ad-a5d1-b56ec94a599c tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] Acquiring lock "9951fab7-4984-408e-94ca-11eab615ff25" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:22:35 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-81436afa-2015-41ad-a5d1-b56ec94a599c tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] Lock "9951fab7-4984-408e-94ca-11eab615ff25" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:22:35 user nova-compute[74960]: INFO nova.compute.manager [None req-7ff4a14b-8aae-4aa4-9657-f4113b7f3bc5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Detaching volume 8b06fb29-6288-4cca-aabd-39d9c089c045
Nov 03 12:22:35 user nova-compute[74960]: DEBUG nova.compute.manager [None req-81436afa-2015-41ad-a5d1-b56ec94a599c tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] [instance: 9951fab7-4984-408e-94ca-11eab615ff25] Starting instance... {{(pid=74960) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 12:22:35 user nova-compute[74960]: INFO nova.virt.block_device [None req-7ff4a14b-8aae-4aa4-9657-f4113b7f3bc5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Attempting to driver detach volume 8b06fb29-6288-4cca-aabd-39d9c089c045 from mountpoint /dev/vdc
Nov 03 12:22:35 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-7ff4a14b-8aae-4aa4-9657-f4113b7f3bc5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Attempting to detach device vdc from instance 7e5ec97f-80c4-4499-94bf-2584fc0eae03 from the persistent domain config. {{(pid=74960) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 03 12:22:35 user nova-compute[74960]: DEBUG nova.virt.libvirt.guest [None req-7ff4a14b-8aae-4aa4-9657-f4113b7f3bc5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 12:22:35 user nova-compute[74960]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 12:22:35 user nova-compute[74960]:   <source dev="/dev/sdb"/>
Nov 03 12:22:35 user nova-compute[74960]:   <target dev="vdc" bus="virtio"/>
Nov 03 12:22:35 user nova-compute[74960]:   <serial>8b06fb29-6288-4cca-aabd-39d9c089c045</serial>
Nov 03 12:22:35 user nova-compute[74960]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 03 12:22:35 user nova-compute[74960]: </disk>
Nov 03 12:22:35 user nova-compute[74960]:  {{(pid=74960) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 12:22:35 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-81436afa-2015-41ad-a5d1-b56ec94a599c tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:22:35 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-81436afa-2015-41ad-a5d1-b56ec94a599c tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:22:35 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-7ff4a14b-8aae-4aa4-9657-f4113b7f3bc5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Successfully detached device vdc from instance 7e5ec97f-80c4-4499-94bf-2584fc0eae03 from the persistent domain config.
Nov 03 12:22:35 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-7ff4a14b-8aae-4aa4-9657-f4113b7f3bc5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 7e5ec97f-80c4-4499-94bf-2584fc0eae03 from the live domain config. {{(pid=74960) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 03 12:22:35 user nova-compute[74960]: DEBUG nova.virt.libvirt.guest [None req-7ff4a14b-8aae-4aa4-9657-f4113b7f3bc5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 12:22:35 user nova-compute[74960]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 12:22:35 user nova-compute[74960]:   <source dev="/dev/sdb"/>
Nov 03 12:22:35 user nova-compute[74960]:   <target dev="vdc" bus="virtio"/>
Nov 03 12:22:35 user nova-compute[74960]:   <serial>8b06fb29-6288-4cca-aabd-39d9c089c045</serial>
Nov 03 12:22:35 user nova-compute[74960]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 03 12:22:35 user nova-compute[74960]: </disk>
Nov 03 12:22:35 user nova-compute[74960]:  {{(pid=74960) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 12:22:35 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-81436afa-2015-41ad-a5d1-b56ec94a599c tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74960) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 12:22:35 user nova-compute[74960]: INFO nova.compute.claims [None req-81436afa-2015-41ad-a5d1-b56ec94a599c tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] [instance: 9951fab7-4984-408e-94ca-11eab615ff25] Claim successful on node user
Nov 03 12:22:36 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-81436afa-2015-41ad-a5d1-b56ec94a599c tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:22:36 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-81436afa-2015-41ad-a5d1-b56ec94a599c tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:22:36 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-7ff4a14b-8aae-4aa4-9657-f4113b7f3bc5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 7e5ec97f-80c4-4499-94bf-2584fc0eae03 {{(pid=74960) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 03 12:22:36 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-81436afa-2015-41ad-a5d1-b56ec94a599c tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.523s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:22:36 user nova-compute[74960]: DEBUG nova.compute.manager [None req-81436afa-2015-41ad-a5d1-b56ec94a599c tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] [instance: 9951fab7-4984-408e-94ca-11eab615ff25] Start building networks asynchronously for instance. {{(pid=74960) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 12:22:36 user nova-compute[74960]: DEBUG nova.compute.manager [None req-81436afa-2015-41ad-a5d1-b56ec94a599c tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] [instance: 9951fab7-4984-408e-94ca-11eab615ff25] Allocating IP information in the background. {{(pid=74960) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 12:22:36 user nova-compute[74960]: DEBUG nova.network.neutron [None req-81436afa-2015-41ad-a5d1-b56ec94a599c tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] [instance: 9951fab7-4984-408e-94ca-11eab615ff25] allocate_for_instance() {{(pid=74960) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 12:22:36 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-81436afa-2015-41ad-a5d1-b56ec94a599c tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] [instance: 9951fab7-4984-408e-94ca-11eab615ff25] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 12:22:36 user nova-compute[74960]: DEBUG nova.compute.manager [None req-81436afa-2015-41ad-a5d1-b56ec94a599c tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] [instance: 9951fab7-4984-408e-94ca-11eab615ff25] Start building block device mappings for instance. {{(pid=74960) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 12:22:36 user nova-compute[74960]: DEBUG nova.policy [None req-81436afa-2015-41ad-a5d1-b56ec94a599c tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8eba5211db3d4634ac9e265997343895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6fbb72509e44ef8003aa2c58a7cf88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74960) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 12:22:36 user nova-compute[74960]: DEBUG nova.compute.manager [None req-81436afa-2015-41ad-a5d1-b56ec94a599c tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] [instance: 9951fab7-4984-408e-94ca-11eab615ff25] Start spawning the instance on the hypervisor. {{(pid=74960) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 12:22:36 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-81436afa-2015-41ad-a5d1-b56ec94a599c tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] [instance: 9951fab7-4984-408e-94ca-11eab615ff25] Creating instance directory {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 12:22:36 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-81436afa-2015-41ad-a5d1-b56ec94a599c tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] [instance: 9951fab7-4984-408e-94ca-11eab615ff25] Creating image(s)
Nov 03 12:22:36 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-81436afa-2015-41ad-a5d1-b56ec94a599c tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] Acquiring lock "/opt/stack/data/nova/instances/9951fab7-4984-408e-94ca-11eab615ff25/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:22:36 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-81436afa-2015-41ad-a5d1-b56ec94a599c tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] Lock "/opt/stack/data/nova/instances/9951fab7-4984-408e-94ca-11eab615ff25/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:22:36 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-81436afa-2015-41ad-a5d1-b56ec94a599c tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] Lock "/opt/stack/data/nova/instances/9951fab7-4984-408e-94ca-11eab615ff25/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:22:36 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-81436afa-2015-41ad-a5d1-b56ec94a599c tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:22:37 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-81436afa-2015-41ad-a5d1-b56ec94a599c tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.269s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:22:37 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-81436afa-2015-41ad-a5d1-b56ec94a599c tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] Acquiring lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:22:37 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-81436afa-2015-41ad-a5d1-b56ec94a599c tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] Lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:22:37 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-81436afa-2015-41ad-a5d1-b56ec94a599c tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:22:37 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-81436afa-2015-41ad-a5d1-b56ec94a599c tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.205s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:22:37 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-81436afa-2015-41ad-a5d1-b56ec94a599c tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910,backing_fmt=raw /opt/stack/data/nova/instances/9951fab7-4984-408e-94ca-11eab615ff25/disk 1073741824 {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:22:37 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-81436afa-2015-41ad-a5d1-b56ec94a599c tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910,backing_fmt=raw /opt/stack/data/nova/instances/9951fab7-4984-408e-94ca-11eab615ff25/disk 1073741824" returned: 0 in 0.068s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:22:37 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-81436afa-2015-41ad-a5d1-b56ec94a599c tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] Lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.282s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:22:37 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-81436afa-2015-41ad-a5d1-b56ec94a599c tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:22:37 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:22:37 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:22:37 user nova-compute[74960]: DEBUG nova.network.neutron [None req-81436afa-2015-41ad-a5d1-b56ec94a599c tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] [instance: 9951fab7-4984-408e-94ca-11eab615ff25] Successfully created port: 5782b039-1492-4364-b1b2-6b27ee06c5ce {{(pid=74960) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 12:22:37 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-81436afa-2015-41ad-a5d1-b56ec94a599c tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.235s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:22:37 user nova-compute[74960]: DEBUG nova.virt.disk.api [None req-81436afa-2015-41ad-a5d1-b56ec94a599c tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9951fab7-4984-408e-94ca-11eab615ff25/disk. size=1073741824 {{(pid=74960) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 12:22:37 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-81436afa-2015-41ad-a5d1-b56ec94a599c tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9951fab7-4984-408e-94ca-11eab615ff25/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:22:37 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:22:37 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-81436afa-2015-41ad-a5d1-b56ec94a599c tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9951fab7-4984-408e-94ca-11eab615ff25/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:22:37 user nova-compute[74960]: DEBUG nova.virt.disk.api [None req-81436afa-2015-41ad-a5d1-b56ec94a599c tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] Cannot resize image /opt/stack/data/nova/instances/9951fab7-4984-408e-94ca-11eab615ff25/disk to a smaller size. {{(pid=74960) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 12:22:37 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-81436afa-2015-41ad-a5d1-b56ec94a599c tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] [instance: 9951fab7-4984-408e-94ca-11eab615ff25] Created local disks {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 12:22:37 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-81436afa-2015-41ad-a5d1-b56ec94a599c tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] [instance: 9951fab7-4984-408e-94ca-11eab615ff25] Ensure instance console log exists: /opt/stack/data/nova/instances/9951fab7-4984-408e-94ca-11eab615ff25/console.log {{(pid=74960) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 12:22:37 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-81436afa-2015-41ad-a5d1-b56ec94a599c tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:22:37 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-81436afa-2015-41ad-a5d1-b56ec94a599c tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:22:37 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-81436afa-2015-41ad-a5d1-b56ec94a599c tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:22:38 user nova-compute[74960]: DEBUG nova.network.neutron [None req-81436afa-2015-41ad-a5d1-b56ec94a599c tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] [instance: 9951fab7-4984-408e-94ca-11eab615ff25] Successfully updated port: 5782b039-1492-4364-b1b2-6b27ee06c5ce {{(pid=74960) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 12:22:38 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-81436afa-2015-41ad-a5d1-b56ec94a599c tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] Acquiring lock "refresh_cache-9951fab7-4984-408e-94ca-11eab615ff25" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:22:38 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-81436afa-2015-41ad-a5d1-b56ec94a599c tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] Acquired lock "refresh_cache-9951fab7-4984-408e-94ca-11eab615ff25" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:22:38 user nova-compute[74960]: DEBUG nova.network.neutron [None req-81436afa-2015-41ad-a5d1-b56ec94a599c tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] [instance: 9951fab7-4984-408e-94ca-11eab615ff25] Building network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 12:22:38 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:22:38 user nova-compute[74960]: DEBUG nova.compute.manager [req-39e95568-d388-48bf-867e-05102363c4e8 req-bd4c3955-cb02-4ab6-a749-cccc0de41208 service nova] [instance: 9951fab7-4984-408e-94ca-11eab615ff25] Received event network-changed-5782b039-1492-4364-b1b2-6b27ee06c5ce {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:22:38 user nova-compute[74960]: DEBUG nova.compute.manager [req-39e95568-d388-48bf-867e-05102363c4e8 req-bd4c3955-cb02-4ab6-a749-cccc0de41208 service nova] [instance: 9951fab7-4984-408e-94ca-11eab615ff25] Refreshing instance network info cache due to event network-changed-5782b039-1492-4364-b1b2-6b27ee06c5ce. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 12:22:38 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-39e95568-d388-48bf-867e-05102363c4e8 req-bd4c3955-cb02-4ab6-a749-cccc0de41208 service nova] Acquiring lock "refresh_cache-9951fab7-4984-408e-94ca-11eab615ff25" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:22:38 user nova-compute[74960]: DEBUG nova.network.neutron [None req-81436afa-2015-41ad-a5d1-b56ec94a599c tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] [instance: 9951fab7-4984-408e-94ca-11eab615ff25] Instance cache missing network info. {{(pid=74960) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 12:22:38 user nova-compute[74960]: DEBUG nova.network.neutron [None req-81436afa-2015-41ad-a5d1-b56ec94a599c tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] [instance: 9951fab7-4984-408e-94ca-11eab615ff25] Updating instance_info_cache with network_info: [{"id": "5782b039-1492-4364-b1b2-6b27ee06c5ce", "address": "fa:16:3e:55:0b:75", "network": {"id": "d6261390-d9b7-447c-be8e-ff6dd1a367ef", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1772643385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d6fbb72509e44ef8003aa2c58a7cf88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5782b039-14", "ovs_interfaceid": "5782b039-1492-4364-b1b2-6b27ee06c5ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:22:38 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-81436afa-2015-41ad-a5d1-b56ec94a599c tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] Releasing lock "refresh_cache-9951fab7-4984-408e-94ca-11eab615ff25" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:22:38 user nova-compute[74960]: DEBUG nova.compute.manager [None req-81436afa-2015-41ad-a5d1-b56ec94a599c tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] [instance: 9951fab7-4984-408e-94ca-11eab615ff25] Instance network_info: |[{"id": "5782b039-1492-4364-b1b2-6b27ee06c5ce", "address": "fa:16:3e:55:0b:75", "network": {"id": "d6261390-d9b7-447c-be8e-ff6dd1a367ef", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1772643385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d6fbb72509e44ef8003aa2c58a7cf88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5782b039-14", "ovs_interfaceid": "5782b039-1492-4364-b1b2-6b27ee06c5ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74960) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 12:22:38 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-39e95568-d388-48bf-867e-05102363c4e8 req-bd4c3955-cb02-4ab6-a749-cccc0de41208 service nova] Acquired lock "refresh_cache-9951fab7-4984-408e-94ca-11eab615ff25" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:22:38 user nova-compute[74960]: DEBUG nova.network.neutron [req-39e95568-d388-48bf-867e-05102363c4e8 req-bd4c3955-cb02-4ab6-a749-cccc0de41208 service nova] [instance: 9951fab7-4984-408e-94ca-11eab615ff25] Refreshing network info cache for port 5782b039-1492-4364-b1b2-6b27ee06c5ce {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 12:22:38 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-81436afa-2015-41ad-a5d1-b56ec94a599c tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] [instance: 9951fab7-4984-408e-94ca-11eab615ff25] Start _get_guest_xml network_info=[{"id": "5782b039-1492-4364-b1b2-6b27ee06c5ce", "address": "fa:16:3e:55:0b:75", "network": {"id": "d6261390-d9b7-447c-be8e-ff6dd1a367ef", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1772643385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d6fbb72509e44ef8003aa2c58a7cf88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5782b039-14", "ovs_interfaceid": "5782b039-1492-4364-b1b2-6b27ee06c5ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=549f51ba-ac69-494b-8de1-34635aa2d7cf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='63ee9c80c632442fb0379f47b784bd20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T12:13:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'image_id': '549f51ba-ac69-494b-8de1-34635aa2d7cf'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 12:22:38 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-81436afa-2015-41ad-a5d1-b56ec94a599c tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:22:38 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-81436afa-2015-41ad-a5d1-b56ec94a599c tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:22:38 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-81436afa-2015-41ad-a5d1-b56ec94a599c tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 12:22:38 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-81436afa-2015-41ad-a5d1-b56ec94a599c tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] CPU controller missing on host. {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 12:22:38 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-81436afa-2015-41ad-a5d1-b56ec94a599c tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 12:22:38 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-81436afa-2015-41ad-a5d1-b56ec94a599c tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] CPU controller found on host. {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 12:22:38 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-81436afa-2015-41ad-a5d1-b56ec94a599c tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74960) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 12:22:38 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-81436afa-2015-41ad-a5d1-b56ec94a599c tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=549f51ba-ac69-494b-8de1-34635aa2d7cf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='63ee9c80c632442fb0379f47b784bd20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T12:13:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 12:22:38 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-81436afa-2015-41ad-a5d1-b56ec94a599c tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] Flavor limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 12:22:38 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-81436afa-2015-41ad-a5d1-b56ec94a599c tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] Image limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 12:22:38 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-81436afa-2015-41ad-a5d1-b56ec94a599c tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] Flavor pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 12:22:38 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-81436afa-2015-41ad-a5d1-b56ec94a599c tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] Image pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 12:22:38 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-81436afa-2015-41ad-a5d1-b56ec94a599c tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 12:22:38 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-81436afa-2015-41ad-a5d1-b56ec94a599c tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 12:22:38 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-81436afa-2015-41ad-a5d1-b56ec94a599c tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 12:22:38 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-81436afa-2015-41ad-a5d1-b56ec94a599c tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] Got 1 possible topologies {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 12:22:38 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-81436afa-2015-41ad-a5d1-b56ec94a599c tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 12:22:38 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-81436afa-2015-41ad-a5d1-b56ec94a599c tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 12:22:38 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-81436afa-2015-41ad-a5d1-b56ec94a599c tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:22:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1411680818',display_name='tempest-ServerActionsTestOtherB-server-1411680818',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1411680818',id=16,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAK9ohWIt15s7ldudGsT8XlofULtoWzMK5SA+58BffvylMEp5GxogzaE69P+WSGeZ5KRHEilG/VwxeQ6fbT98lYIbTEwG2MJa8koMYFjXVA2bTTbOJr39ehW4vit7EZ+IA==',key_name='tempest-keypair-355656543',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6d6fbb72509e44ef8003aa2c58a7cf88',ramdisk_id='',reservation_id='r-6npj51bk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-2007370068',owner_user_name='tempest-ServerActionsTestOtherB-2007370068-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:22:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8eba5211db3d4634ac9e265997343895',uuid=9951fab7-4984-408e-94ca-11eab615ff25,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5782b039-1492-4364-b1b2-6b27ee06c5ce", "address": "fa:16:3e:55:0b:75", "network": {"id": "d6261390-d9b7-447c-be8e-ff6dd1a367ef", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1772643385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d6fbb72509e44ef8003aa2c58a7cf88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5782b039-14", "ovs_interfaceid": "5782b039-1492-4364-b1b2-6b27ee06c5ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74960) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 12:22:38 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-81436afa-2015-41ad-a5d1-b56ec94a599c tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] Converting VIF {"id": "5782b039-1492-4364-b1b2-6b27ee06c5ce", "address": "fa:16:3e:55:0b:75", "network": {"id": "d6261390-d9b7-447c-be8e-ff6dd1a367ef", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1772643385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d6fbb72509e44ef8003aa2c58a7cf88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5782b039-14", "ovs_interfaceid": "5782b039-1492-4364-b1b2-6b27ee06c5ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:22:38 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-81436afa-2015-41ad-a5d1-b56ec94a599c tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:0b:75,bridge_name='br-int',has_traffic_filtering=True,id=5782b039-1492-4364-b1b2-6b27ee06c5ce,network=Network(d6261390-d9b7-447c-be8e-ff6dd1a367ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5782b039-14') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:22:38 user nova-compute[74960]: DEBUG nova.objects.instance [None req-81436afa-2015-41ad-a5d1-b56ec94a599c tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] Lazy-loading 'pci_devices' on Instance uuid 9951fab7-4984-408e-94ca-11eab615ff25 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:22:38 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-81436afa-2015-41ad-a5d1-b56ec94a599c tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] [instance: 9951fab7-4984-408e-94ca-11eab615ff25] End _get_guest_xml xml=<domain type="kvm">
Nov 03 12:22:38 user nova-compute[74960]:   <uuid>9951fab7-4984-408e-94ca-11eab615ff25</uuid>
Nov 03 12:22:38 user nova-compute[74960]:   <name>instance-00000010</name>
Nov 03 12:22:38 user nova-compute[74960]:   <memory>524288</memory>
Nov 03 12:22:38 user nova-compute[74960]:   <vcpu>1</vcpu>
Nov 03 12:22:38 user nova-compute[74960]:   <metadata>
Nov 03 12:22:38 user nova-compute[74960]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 12:22:38 user nova-compute[74960]:       <nova:package version="0.0.0"/>
Nov 03 12:22:38 user nova-compute[74960]:       <nova:name>tempest-ServerActionsTestOtherB-server-1411680818</nova:name>
Nov 03 12:22:38 user nova-compute[74960]:       <nova:creationTime>2023-11-03 12:22:38</nova:creationTime>
Nov 03 12:22:38 user nova-compute[74960]:       <nova:flavor name="m1.tiny">
Nov 03 12:22:38 user nova-compute[74960]:         <nova:memory>512</nova:memory>
Nov 03 12:22:38 user nova-compute[74960]:         <nova:disk>1</nova:disk>
Nov 03 12:22:38 user nova-compute[74960]:         <nova:swap>0</nova:swap>
Nov 03 12:22:38 user nova-compute[74960]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 12:22:38 user nova-compute[74960]:         <nova:vcpus>1</nova:vcpus>
Nov 03 12:22:38 user nova-compute[74960]:       </nova:flavor>
Nov 03 12:22:38 user nova-compute[74960]:       <nova:owner>
Nov 03 12:22:38 user nova-compute[74960]:         <nova:user uuid="8eba5211db3d4634ac9e265997343895">tempest-ServerActionsTestOtherB-2007370068-project-member</nova:user>
Nov 03 12:22:38 user nova-compute[74960]:         <nova:project uuid="6d6fbb72509e44ef8003aa2c58a7cf88">tempest-ServerActionsTestOtherB-2007370068</nova:project>
Nov 03 12:22:38 user nova-compute[74960]:       </nova:owner>
Nov 03 12:22:38 user nova-compute[74960]:       <nova:root type="image" uuid="549f51ba-ac69-494b-8de1-34635aa2d7cf"/>
Nov 03 12:22:38 user nova-compute[74960]:       <nova:ports>
Nov 03 12:22:38 user nova-compute[74960]:         <nova:port uuid="5782b039-1492-4364-b1b2-6b27ee06c5ce">
Nov 03 12:22:38 user nova-compute[74960]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 03 12:22:38 user nova-compute[74960]:         </nova:port>
Nov 03 12:22:38 user nova-compute[74960]:       </nova:ports>
Nov 03 12:22:38 user nova-compute[74960]:     </nova:instance>
Nov 03 12:22:38 user nova-compute[74960]:   </metadata>
Nov 03 12:22:38 user nova-compute[74960]:   <sysinfo type="smbios">
Nov 03 12:22:38 user nova-compute[74960]:     <system>
Nov 03 12:22:38 user nova-compute[74960]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 12:22:38 user nova-compute[74960]:       <entry name="product">OpenStack Nova</entry>
Nov 03 12:22:38 user nova-compute[74960]:       <entry name="version">0.0.0</entry>
Nov 03 12:22:38 user nova-compute[74960]:       <entry name="serial">9951fab7-4984-408e-94ca-11eab615ff25</entry>
Nov 03 12:22:38 user nova-compute[74960]:       <entry name="uuid">9951fab7-4984-408e-94ca-11eab615ff25</entry>
Nov 03 12:22:38 user nova-compute[74960]:       <entry name="family">Virtual Machine</entry>
Nov 03 12:22:38 user nova-compute[74960]:     </system>
Nov 03 12:22:38 user nova-compute[74960]:   </sysinfo>
Nov 03 12:22:38 user nova-compute[74960]:   <os>
Nov 03 12:22:38 user nova-compute[74960]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 12:22:38 user nova-compute[74960]:     <boot dev="hd"/>
Nov 03 12:22:38 user nova-compute[74960]:     <smbios mode="sysinfo"/>
Nov 03 12:22:38 user nova-compute[74960]:   </os>
Nov 03 12:22:38 user nova-compute[74960]:   <features>
Nov 03 12:22:38 user nova-compute[74960]:     <acpi/>
Nov 03 12:22:38 user nova-compute[74960]:     <apic/>
Nov 03 12:22:38 user nova-compute[74960]:     <vmcoreinfo/>
Nov 03 12:22:38 user nova-compute[74960]:   </features>
Nov 03 12:22:38 user nova-compute[74960]:   <clock offset="utc">
Nov 03 12:22:38 user nova-compute[74960]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 12:22:38 user nova-compute[74960]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 12:22:38 user nova-compute[74960]:     <timer name="hpet" present="no"/>
Nov 03 12:22:38 user nova-compute[74960]:   </clock>
Nov 03 12:22:38 user nova-compute[74960]:   <cpu mode="custom" match="exact">
Nov 03 12:22:38 user nova-compute[74960]:     <model>Nehalem</model>
Nov 03 12:22:38 user nova-compute[74960]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 12:22:38 user nova-compute[74960]:   </cpu>
Nov 03 12:22:38 user nova-compute[74960]:   <devices>
Nov 03 12:22:38 user nova-compute[74960]:     <disk type="file" device="disk">
Nov 03 12:22:38 user nova-compute[74960]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 12:22:38 user nova-compute[74960]:       <source file="/opt/stack/data/nova/instances/9951fab7-4984-408e-94ca-11eab615ff25/disk"/>
Nov 03 12:22:38 user nova-compute[74960]:       <target dev="vda" bus="virtio"/>
Nov 03 12:22:38 user nova-compute[74960]:     </disk>
Nov 03 12:22:38 user nova-compute[74960]:     <interface type="ethernet">
Nov 03 12:22:38 user nova-compute[74960]:       <mac address="fa:16:3e:55:0b:75"/>
Nov 03 12:22:38 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:22:38 user nova-compute[74960]:       <mtu size="1442"/>
Nov 03 12:22:38 user nova-compute[74960]:       <target dev="tap5782b039-14"/>
Nov 03 12:22:38 user nova-compute[74960]:     </interface>
Nov 03 12:22:38 user nova-compute[74960]:     <serial type="pty">
Nov 03 12:22:38 user nova-compute[74960]:       <log file="/opt/stack/data/nova/instances/9951fab7-4984-408e-94ca-11eab615ff25/console.log" append="off"/>
Nov 03 12:22:38 user nova-compute[74960]:     </serial>
Nov 03 12:22:38 user nova-compute[74960]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 12:22:38 user nova-compute[74960]:     <video>
Nov 03 12:22:38 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:22:38 user nova-compute[74960]:     </video>
Nov 03 12:22:38 user nova-compute[74960]:     <rng model="virtio">
Nov 03 12:22:38 user nova-compute[74960]:       <backend model="random">/dev/urandom</backend>
Nov 03 12:22:38 user nova-compute[74960]:     </rng>
Nov 03 12:22:38 user nova-compute[74960]:     <controller type="usb" index="0" model="none"/>
Nov 03 12:22:38 user nova-compute[74960]:     <memballoon model="virtio">
Nov 03 12:22:38 user nova-compute[74960]:       <stats period="10"/>
Nov 03 12:22:38 user nova-compute[74960]:     </memballoon>
Nov 03 12:22:38 user nova-compute[74960]:   </devices>
Nov 03 12:22:38 user nova-compute[74960]: </domain>
Nov 03 12:22:38 user nova-compute[74960]:  {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 12:22:38 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-81436afa-2015-41ad-a5d1-b56ec94a599c tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:22:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1411680818',display_name='tempest-ServerActionsTestOtherB-server-1411680818',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1411680818',id=16,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAK9ohWIt15s7ldudGsT8XlofULtoWzMK5SA+58BffvylMEp5GxogzaE69P+WSGeZ5KRHEilG/VwxeQ6fbT98lYIbTEwG2MJa8koMYFjXVA2bTTbOJr39ehW4vit7EZ+IA==',key_name='tempest-keypair-355656543',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6d6fbb72509e44ef8003aa2c58a7cf88',ramdisk_id='',reservation_id='r-6npj51bk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-2007370068',owner_user_name='tempest-ServerActionsTestOtherB-2007370068-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:22:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8eba5211db3d4634ac9e265997343895',uuid=9951fab7-4984-408e-94ca-11eab615ff25,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5782b039-1492-4364-b1b2-6b27ee06c5ce", "address": "fa:16:3e:55:0b:75", "network": {"id": "d6261390-d9b7-447c-be8e-ff6dd1a367ef", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1772643385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d6fbb72509e44ef8003aa2c58a7cf88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5782b039-14", "ovs_interfaceid": "5782b039-1492-4364-b1b2-6b27ee06c5ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 12:22:38 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-81436afa-2015-41ad-a5d1-b56ec94a599c tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] Converting VIF {"id": "5782b039-1492-4364-b1b2-6b27ee06c5ce", "address": "fa:16:3e:55:0b:75", "network": {"id": "d6261390-d9b7-447c-be8e-ff6dd1a367ef", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1772643385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d6fbb72509e44ef8003aa2c58a7cf88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5782b039-14", "ovs_interfaceid": "5782b039-1492-4364-b1b2-6b27ee06c5ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:22:38 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-81436afa-2015-41ad-a5d1-b56ec94a599c tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:0b:75,bridge_name='br-int',has_traffic_filtering=True,id=5782b039-1492-4364-b1b2-6b27ee06c5ce,network=Network(d6261390-d9b7-447c-be8e-ff6dd1a367ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5782b039-14') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:22:38 user nova-compute[74960]: DEBUG os_vif [None req-81436afa-2015-41ad-a5d1-b56ec94a599c tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:0b:75,bridge_name='br-int',has_traffic_filtering=True,id=5782b039-1492-4364-b1b2-6b27ee06c5ce,network=Network(d6261390-d9b7-447c-be8e-ff6dd1a367ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5782b039-14') {{(pid=74960) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 12:22:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:22:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:22:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 12:22:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:22:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1acb2ee7-5a31-5075-b51d-f9fb96f4e3bd', '_type': 'linux-noop'}}, row=False) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:22:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:22:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:22:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:22:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5782b039-14, may_exist=True, interface_attrs={}) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:22:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5782b039-14, col_values=(('qos', UUID('a9e1cd6d-1079-4d8c-bb44-2fb01cb8b673')),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:22:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5782b039-14, col_values=(('external_ids', {'iface-id': '5782b039-1492-4364-b1b2-6b27ee06c5ce', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:55:0b:75', 'vm-uuid': '9951fab7-4984-408e-94ca-11eab615ff25'}),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:22:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:22:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:22:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:22:38 user nova-compute[74960]: INFO os_vif [None req-81436afa-2015-41ad-a5d1-b56ec94a599c tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:0b:75,bridge_name='br-int',has_traffic_filtering=True,id=5782b039-1492-4364-b1b2-6b27ee06c5ce,network=Network(d6261390-d9b7-447c-be8e-ff6dd1a367ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5782b039-14')
Nov 03 12:22:39 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-81436afa-2015-41ad-a5d1-b56ec94a599c tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] No BDM found with device name vda, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:22:39 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-81436afa-2015-41ad-a5d1-b56ec94a599c tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] No VIF found with MAC fa:16:3e:55:0b:75, not building metadata {{(pid=74960) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 12:22:39 user nova-compute[74960]: DEBUG nova.network.neutron [req-39e95568-d388-48bf-867e-05102363c4e8 req-bd4c3955-cb02-4ab6-a749-cccc0de41208 service nova] [instance: 9951fab7-4984-408e-94ca-11eab615ff25] Updated VIF entry in instance network info cache for port 5782b039-1492-4364-b1b2-6b27ee06c5ce. {{(pid=74960) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 12:22:39 user nova-compute[74960]: DEBUG nova.network.neutron [req-39e95568-d388-48bf-867e-05102363c4e8 req-bd4c3955-cb02-4ab6-a749-cccc0de41208 service nova] [instance: 9951fab7-4984-408e-94ca-11eab615ff25] Updating instance_info_cache with network_info: [{"id": "5782b039-1492-4364-b1b2-6b27ee06c5ce", "address": "fa:16:3e:55:0b:75", "network": {"id": "d6261390-d9b7-447c-be8e-ff6dd1a367ef", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1772643385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d6fbb72509e44ef8003aa2c58a7cf88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5782b039-14", "ovs_interfaceid": "5782b039-1492-4364-b1b2-6b27ee06c5ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:22:39 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-39e95568-d388-48bf-867e-05102363c4e8 req-bd4c3955-cb02-4ab6-a749-cccc0de41208 service nova] Releasing lock "refresh_cache-9951fab7-4984-408e-94ca-11eab615ff25" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:22:39 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:22:40 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:22:40 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:22:40 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:22:40 user nova-compute[74960]: DEBUG nova.compute.manager [req-fa89fad0-2068-4612-ab9b-15c3be556a29 req-c4e027a4-aaef-428e-a669-b235d80e8530 service nova] [instance: 9951fab7-4984-408e-94ca-11eab615ff25] Received event network-vif-plugged-5782b039-1492-4364-b1b2-6b27ee06c5ce {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:22:40 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-fa89fad0-2068-4612-ab9b-15c3be556a29 req-c4e027a4-aaef-428e-a669-b235d80e8530 service nova] Acquiring lock "9951fab7-4984-408e-94ca-11eab615ff25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:22:40 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-fa89fad0-2068-4612-ab9b-15c3be556a29 req-c4e027a4-aaef-428e-a669-b235d80e8530 service nova] Lock "9951fab7-4984-408e-94ca-11eab615ff25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:22:40 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-fa89fad0-2068-4612-ab9b-15c3be556a29 req-c4e027a4-aaef-428e-a669-b235d80e8530 service nova] Lock "9951fab7-4984-408e-94ca-11eab615ff25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:22:40 user nova-compute[74960]: DEBUG nova.compute.manager [req-fa89fad0-2068-4612-ab9b-15c3be556a29 req-c4e027a4-aaef-428e-a669-b235d80e8530 service nova] [instance: 9951fab7-4984-408e-94ca-11eab615ff25] No waiting events found dispatching network-vif-plugged-5782b039-1492-4364-b1b2-6b27ee06c5ce {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:22:40 user nova-compute[74960]: WARNING nova.compute.manager [req-fa89fad0-2068-4612-ab9b-15c3be556a29 req-c4e027a4-aaef-428e-a669-b235d80e8530 service nova] [instance: 9951fab7-4984-408e-94ca-11eab615ff25] Received unexpected event network-vif-plugged-5782b039-1492-4364-b1b2-6b27ee06c5ce for instance with vm_state building and task_state spawning.
Nov 03 12:22:41 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:22:41 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:22:41 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:22:42 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:22:42 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:22:43 user nova-compute[74960]: DEBUG nova.compute.manager [req-edbee9e8-1ba3-45e6-92ed-345ab5299879 req-4266e73e-4e43-493c-af70-1e7de8ab8c22 service nova] [instance: 9951fab7-4984-408e-94ca-11eab615ff25] Received event network-vif-plugged-5782b039-1492-4364-b1b2-6b27ee06c5ce {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:22:43 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-edbee9e8-1ba3-45e6-92ed-345ab5299879 req-4266e73e-4e43-493c-af70-1e7de8ab8c22 service nova] Acquiring lock "9951fab7-4984-408e-94ca-11eab615ff25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:22:43 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-edbee9e8-1ba3-45e6-92ed-345ab5299879 req-4266e73e-4e43-493c-af70-1e7de8ab8c22 service nova] Lock "9951fab7-4984-408e-94ca-11eab615ff25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.010s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:22:43 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-edbee9e8-1ba3-45e6-92ed-345ab5299879 req-4266e73e-4e43-493c-af70-1e7de8ab8c22 service nova] Lock "9951fab7-4984-408e-94ca-11eab615ff25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:22:43 user nova-compute[74960]: DEBUG nova.compute.manager [req-edbee9e8-1ba3-45e6-92ed-345ab5299879 req-4266e73e-4e43-493c-af70-1e7de8ab8c22 service nova] [instance: 9951fab7-4984-408e-94ca-11eab615ff25] No waiting events found dispatching network-vif-plugged-5782b039-1492-4364-b1b2-6b27ee06c5ce {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:22:43 user nova-compute[74960]: WARNING nova.compute.manager [req-edbee9e8-1ba3-45e6-92ed-345ab5299879 req-4266e73e-4e43-493c-af70-1e7de8ab8c22 service nova] [instance: 9951fab7-4984-408e-94ca-11eab615ff25] Received unexpected event network-vif-plugged-5782b039-1492-4364-b1b2-6b27ee06c5ce for instance with vm_state building and task_state spawning.
Nov 03 12:22:43 user nova-compute[74960]: DEBUG nova.compute.manager [None req-81436afa-2015-41ad-a5d1-b56ec94a599c tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] [instance: 9951fab7-4984-408e-94ca-11eab615ff25] Instance event wait completed in 0 seconds for  {{(pid=74960) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 12:22:43 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-81436afa-2015-41ad-a5d1-b56ec94a599c tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] [instance: 9951fab7-4984-408e-94ca-11eab615ff25] Guest created on hypervisor {{(pid=74960) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 12:22:43 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: 9951fab7-4984-408e-94ca-11eab615ff25] Instance spawned successfully.
Nov 03 12:22:43 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-81436afa-2015-41ad-a5d1-b56ec94a599c tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] [instance: 9951fab7-4984-408e-94ca-11eab615ff25] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 12:22:43 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-81436afa-2015-41ad-a5d1-b56ec94a599c tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] [instance: 9951fab7-4984-408e-94ca-11eab615ff25] Found default for hw_cdrom_bus of ide {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:22:43 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-81436afa-2015-41ad-a5d1-b56ec94a599c tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] [instance: 9951fab7-4984-408e-94ca-11eab615ff25] Found default for hw_disk_bus of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:22:43 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-81436afa-2015-41ad-a5d1-b56ec94a599c tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] [instance: 9951fab7-4984-408e-94ca-11eab615ff25] Found default for hw_input_bus of None {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:22:43 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-81436afa-2015-41ad-a5d1-b56ec94a599c tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] [instance: 9951fab7-4984-408e-94ca-11eab615ff25] Found default for hw_pointer_model of None {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:22:43 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-81436afa-2015-41ad-a5d1-b56ec94a599c tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] [instance: 9951fab7-4984-408e-94ca-11eab615ff25] Found default for hw_video_model of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:22:43 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-81436afa-2015-41ad-a5d1-b56ec94a599c tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] [instance: 9951fab7-4984-408e-94ca-11eab615ff25] Found default for hw_vif_model of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:22:43 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:22:43 user nova-compute[74960]: INFO nova.compute.manager [None req-81436afa-2015-41ad-a5d1-b56ec94a599c tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] [instance: 9951fab7-4984-408e-94ca-11eab615ff25] Took 6.63 seconds to spawn the instance on the hypervisor.
Nov 03 12:22:43 user nova-compute[74960]: DEBUG nova.compute.manager [None req-81436afa-2015-41ad-a5d1-b56ec94a599c tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] [instance: 9951fab7-4984-408e-94ca-11eab615ff25] Checking state {{(pid=74960) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 12:22:43 user nova-compute[74960]: INFO nova.compute.manager [None req-81436afa-2015-41ad-a5d1-b56ec94a599c tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] [instance: 9951fab7-4984-408e-94ca-11eab615ff25] Took 7.59 seconds to build instance.
Nov 03 12:22:43 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-81436afa-2015-41ad-a5d1-b56ec94a599c tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] Lock "9951fab7-4984-408e-94ca-11eab615ff25" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.757s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:22:43 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:22:44 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:22:44 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Starting heal instance info cache {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 12:22:44 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Didn't find any instances for network info cache update. {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 03 12:22:44 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:22:45 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:22:45 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:22:45 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:22:45 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:22:45 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:22:45 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Auditing locally available compute resources for user (node: user) {{(pid=74960) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 12:22:45 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a198493-7329-43ff-bceb-56b50529be29/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:22:45 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a198493-7329-43ff-bceb-56b50529be29/disk --force-share --output=json" returned: 0 in 0.302s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:22:45 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a198493-7329-43ff-bceb-56b50529be29/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:22:46 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a198493-7329-43ff-bceb-56b50529be29/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:22:46 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e5ec97f-80c4-4499-94bf-2584fc0eae03/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:22:46 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e5ec97f-80c4-4499-94bf-2584fc0eae03/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:22:46 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e5ec97f-80c4-4499-94bf-2584fc0eae03/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:22:46 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e5ec97f-80c4-4499-94bf-2584fc0eae03/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:22:46 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9951fab7-4984-408e-94ca-11eab615ff25/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:22:46 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9951fab7-4984-408e-94ca-11eab615ff25/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:22:46 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9951fab7-4984-408e-94ca-11eab615ff25/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:22:47 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9951fab7-4984-408e-94ca-11eab615ff25/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:22:47 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05956d9b-0646-43d2-a4cd-19e9090020ee/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:22:47 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05956d9b-0646-43d2-a4cd-19e9090020ee/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:22:47 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05956d9b-0646-43d2-a4cd-19e9090020ee/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:22:47 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05956d9b-0646-43d2-a4cd-19e9090020ee/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:22:47 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74960) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 12:22:47 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7769e3c5-136f-4282-8e3e-224e3a80922c/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:22:47 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:22:47 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7769e3c5-136f-4282-8e3e-224e3a80922c/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:22:47 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7769e3c5-136f-4282-8e3e-224e3a80922c/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:22:47 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-fa8b34c6-accd-4cdf-a679-3dcb5e536def tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Acquiring lock "d5c87482-1883-43dc-8872-6a5dff128c94" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:22:47 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-fa8b34c6-accd-4cdf-a679-3dcb5e536def tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Lock "d5c87482-1883-43dc-8872-6a5dff128c94" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:22:48 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7769e3c5-136f-4282-8e3e-224e3a80922c/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:22:48 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8381c969-6a2d-4934-aadd-660ffa246b05/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:22:48 user nova-compute[74960]: DEBUG nova.compute.manager [None req-fa8b34c6-accd-4cdf-a679-3dcb5e536def tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] [instance: d5c87482-1883-43dc-8872-6a5dff128c94] Starting instance... {{(pid=74960) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 12:22:48 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8381c969-6a2d-4934-aadd-660ffa246b05/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:22:48 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8381c969-6a2d-4934-aadd-660ffa246b05/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:22:48 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-fa8b34c6-accd-4cdf-a679-3dcb5e536def tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:22:48 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-fa8b34c6-accd-4cdf-a679-3dcb5e536def tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.004s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:22:48 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8381c969-6a2d-4934-aadd-660ffa246b05/disk --force-share --output=json" returned: 0 in 0.434s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:22:48 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74960) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 12:22:48 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-fa8b34c6-accd-4cdf-a679-3dcb5e536def tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74960) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 12:22:48 user nova-compute[74960]: INFO nova.compute.claims [None req-fa8b34c6-accd-4cdf-a679-3dcb5e536def tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] [instance: d5c87482-1883-43dc-8872-6a5dff128c94] Claim successful on node user
Nov 03 12:22:48 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fffd1dd7-b8e8-435c-bdfe-6c5001b21daf/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:22:48 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-fa8b34c6-accd-4cdf-a679-3dcb5e536def tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Refreshing inventories for resource provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 03 12:22:48 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fffd1dd7-b8e8-435c-bdfe-6c5001b21daf/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:22:48 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fffd1dd7-b8e8-435c-bdfe-6c5001b21daf/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:22:48 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-fa8b34c6-accd-4cdf-a679-3dcb5e536def tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Updating ProviderTree inventory for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 03 12:22:48 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-fa8b34c6-accd-4cdf-a679-3dcb5e536def tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Updating inventory in ProviderTree for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 03 12:22:48 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:22:48 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-fa8b34c6-accd-4cdf-a679-3dcb5e536def tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Refreshing aggregate associations for resource provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0, aggregates: None {{(pid=74960) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 03 12:22:49 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-fa8b34c6-accd-4cdf-a679-3dcb5e536def tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Refreshing trait associations for resource provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0, traits: COMPUTE_NODE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE41,HW_CPU_X86_SSSE3,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_DEVICE_TAGGING,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_QXL {{(pid=74960) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 03 12:22:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fffd1dd7-b8e8-435c-bdfe-6c5001b21daf/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:22:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6145a30b-809c-4bc5-a45f-c3ff3b170a22/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:22:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6145a30b-809c-4bc5-a45f-c3ff3b170a22/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:22:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6145a30b-809c-4bc5-a45f-c3ff3b170a22/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:22:49 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-9e07ff24-ea67-4caa-9cda-ec5ef0e1dda6 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Acquiring lock "0a198493-7329-43ff-bceb-56b50529be29" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:22:49 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-9e07ff24-ea67-4caa-9cda-ec5ef0e1dda6 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Lock "0a198493-7329-43ff-bceb-56b50529be29" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:22:49 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-9e07ff24-ea67-4caa-9cda-ec5ef0e1dda6 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Acquiring lock "0a198493-7329-43ff-bceb-56b50529be29-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:22:49 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-9e07ff24-ea67-4caa-9cda-ec5ef0e1dda6 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Lock "0a198493-7329-43ff-bceb-56b50529be29-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:22:49 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-9e07ff24-ea67-4caa-9cda-ec5ef0e1dda6 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Lock "0a198493-7329-43ff-bceb-56b50529be29-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:22:49 user nova-compute[74960]: INFO nova.compute.manager [None req-9e07ff24-ea67-4caa-9cda-ec5ef0e1dda6 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] [instance: 0a198493-7329-43ff-bceb-56b50529be29] Terminating instance
Nov 03 12:22:49 user nova-compute[74960]: DEBUG nova.compute.manager [None req-9e07ff24-ea67-4caa-9cda-ec5ef0e1dda6 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] [instance: 0a198493-7329-43ff-bceb-56b50529be29] Start destroying the instance on the hypervisor. {{(pid=74960) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 12:22:49 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:22:49 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:22:49 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-fa8b34c6-accd-4cdf-a679-3dcb5e536def tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:22:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6145a30b-809c-4bc5-a45f-c3ff3b170a22/disk --force-share --output=json" returned: 0 in 0.273s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:22:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f009a400-0576-48a9-82e0-60de8935c498/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:22:49 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-fa8b34c6-accd-4cdf-a679-3dcb5e536def tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:22:49 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-fa8b34c6-accd-4cdf-a679-3dcb5e536def tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.168s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:22:49 user nova-compute[74960]: DEBUG nova.compute.manager [None req-fa8b34c6-accd-4cdf-a679-3dcb5e536def tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] [instance: d5c87482-1883-43dc-8872-6a5dff128c94] Start building networks asynchronously for instance. {{(pid=74960) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 12:22:49 user nova-compute[74960]: DEBUG nova.compute.manager [req-a4856807-e085-4538-a619-6a57701b723b req-d077c571-5771-4259-82ea-fd891b8ce165 service nova] [instance: 0a198493-7329-43ff-bceb-56b50529be29] Received event network-vif-unplugged-e6755218-8c73-4191-a259-8f1f936838e8 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:22:49 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-a4856807-e085-4538-a619-6a57701b723b req-d077c571-5771-4259-82ea-fd891b8ce165 service nova] Acquiring lock "0a198493-7329-43ff-bceb-56b50529be29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:22:49 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-a4856807-e085-4538-a619-6a57701b723b req-d077c571-5771-4259-82ea-fd891b8ce165 service nova] Lock "0a198493-7329-43ff-bceb-56b50529be29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:22:49 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-a4856807-e085-4538-a619-6a57701b723b req-d077c571-5771-4259-82ea-fd891b8ce165 service nova] Lock "0a198493-7329-43ff-bceb-56b50529be29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:22:49 user nova-compute[74960]: DEBUG nova.compute.manager [req-a4856807-e085-4538-a619-6a57701b723b req-d077c571-5771-4259-82ea-fd891b8ce165 service nova] [instance: 0a198493-7329-43ff-bceb-56b50529be29] No waiting events found dispatching network-vif-unplugged-e6755218-8c73-4191-a259-8f1f936838e8 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:22:49 user nova-compute[74960]: DEBUG nova.compute.manager [req-a4856807-e085-4538-a619-6a57701b723b req-d077c571-5771-4259-82ea-fd891b8ce165 service nova] [instance: 0a198493-7329-43ff-bceb-56b50529be29] Received event network-vif-unplugged-e6755218-8c73-4191-a259-8f1f936838e8 for instance with task_state deleting. {{(pid=74960) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 12:22:49 user nova-compute[74960]: DEBUG nova.compute.manager [None req-fa8b34c6-accd-4cdf-a679-3dcb5e536def tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] [instance: d5c87482-1883-43dc-8872-6a5dff128c94] Allocating IP information in the background. {{(pid=74960) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 12:22:49 user nova-compute[74960]: DEBUG nova.network.neutron [None req-fa8b34c6-accd-4cdf-a679-3dcb5e536def tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] [instance: d5c87482-1883-43dc-8872-6a5dff128c94] allocate_for_instance() {{(pid=74960) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 12:22:49 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-fa8b34c6-accd-4cdf-a679-3dcb5e536def tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] [instance: d5c87482-1883-43dc-8872-6a5dff128c94] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 12:22:49 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:22:49 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:22:49 user nova-compute[74960]: DEBUG nova.compute.manager [None req-fa8b34c6-accd-4cdf-a679-3dcb5e536def tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] [instance: d5c87482-1883-43dc-8872-6a5dff128c94] Start building block device mappings for instance. {{(pid=74960) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 12:22:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f009a400-0576-48a9-82e0-60de8935c498/disk --force-share --output=json" returned: 0 in 0.289s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:22:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f009a400-0576-48a9-82e0-60de8935c498/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:22:50 user nova-compute[74960]: DEBUG nova.policy [None req-fa8b34c6-accd-4cdf-a679-3dcb5e536def tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7a13ec06392c4ce5a81491a35a8d50d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e379e295cf984ca6bf5d84a60e56382d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74960) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 12:22:50 user nova-compute[74960]: DEBUG nova.compute.manager [None req-fa8b34c6-accd-4cdf-a679-3dcb5e536def tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] [instance: d5c87482-1883-43dc-8872-6a5dff128c94] Start spawning the instance on the hypervisor. {{(pid=74960) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 12:22:50 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-fa8b34c6-accd-4cdf-a679-3dcb5e536def tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] [instance: d5c87482-1883-43dc-8872-6a5dff128c94] Creating instance directory {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 12:22:50 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-fa8b34c6-accd-4cdf-a679-3dcb5e536def tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] [instance: d5c87482-1883-43dc-8872-6a5dff128c94] Creating image(s)
Nov 03 12:22:50 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-fa8b34c6-accd-4cdf-a679-3dcb5e536def tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Acquiring lock "/opt/stack/data/nova/instances/d5c87482-1883-43dc-8872-6a5dff128c94/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:22:50 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-fa8b34c6-accd-4cdf-a679-3dcb5e536def tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Lock "/opt/stack/data/nova/instances/d5c87482-1883-43dc-8872-6a5dff128c94/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:22:50 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-fa8b34c6-accd-4cdf-a679-3dcb5e536def tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Lock "/opt/stack/data/nova/instances/d5c87482-1883-43dc-8872-6a5dff128c94/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:22:50 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-fa8b34c6-accd-4cdf-a679-3dcb5e536def tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:22:50 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f009a400-0576-48a9-82e0-60de8935c498/disk --force-share --output=json" returned: 0 in 0.272s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:22:50 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e91dfcf4-caef-43d0-a56b-b1282363d4e0/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:22:50 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: 0a198493-7329-43ff-bceb-56b50529be29] Instance destroyed successfully.
Nov 03 12:22:50 user nova-compute[74960]: DEBUG nova.objects.instance [None req-9e07ff24-ea67-4caa-9cda-ec5ef0e1dda6 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Lazy-loading 'resources' on Instance uuid 0a198493-7329-43ff-bceb-56b50529be29 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:22:50 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-9e07ff24-ea67-4caa-9cda-ec5ef0e1dda6 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:20:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-378321332',display_name='tempest-VolumesAdminNegativeTest-server-378321332',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-378321332',id=13,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-03T12:20:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='58667b53361b490fa7f0236ee65934c5',ramdisk_id='',reservation_id='r-tabk0ijq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1697926693',owner_user_name='tempest-VolumesAdminNegativeTest-1697926693-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T12:20:48Z,user_data=None,user_id='26930c47348248f681093b8e74e8c73c',uuid=0a198493-7329-43ff-bceb-56b50529be29,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e6755218-8c73-4191-a259-8f1f936838e8", "address": "fa:16:3e:44:8d:5e", "network": {"id": "9f0b1c9c-af46-4948-aeb8-e73013159ad4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2126041996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "58667b53361b490fa7f0236ee65934c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6755218-8c", "ovs_interfaceid": "e6755218-8c73-4191-a259-8f1f936838e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 12:22:50 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-9e07ff24-ea67-4caa-9cda-ec5ef0e1dda6 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Converting VIF {"id": "e6755218-8c73-4191-a259-8f1f936838e8", "address": "fa:16:3e:44:8d:5e", "network": {"id": "9f0b1c9c-af46-4948-aeb8-e73013159ad4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2126041996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "58667b53361b490fa7f0236ee65934c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6755218-8c", "ovs_interfaceid": "e6755218-8c73-4191-a259-8f1f936838e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:22:50 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-9e07ff24-ea67-4caa-9cda-ec5ef0e1dda6 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:8d:5e,bridge_name='br-int',has_traffic_filtering=True,id=e6755218-8c73-4191-a259-8f1f936838e8,network=Network(9f0b1c9c-af46-4948-aeb8-e73013159ad4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6755218-8c') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:22:50 user nova-compute[74960]: DEBUG os_vif [None req-9e07ff24-ea67-4caa-9cda-ec5ef0e1dda6 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:8d:5e,bridge_name='br-int',has_traffic_filtering=True,id=e6755218-8c73-4191-a259-8f1f936838e8,network=Network(9f0b1c9c-af46-4948-aeb8-e73013159ad4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6755218-8c') {{(pid=74960) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 12:22:50 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:22:50 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape6755218-8c, bridge=br-int, if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:22:50 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:22:50 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-fa8b34c6-accd-4cdf-a679-3dcb5e536def tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.249s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:22:50 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:22:50 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-fa8b34c6-accd-4cdf-a679-3dcb5e536def tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Acquiring lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:22:50 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-fa8b34c6-accd-4cdf-a679-3dcb5e536def tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:22:50 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-fa8b34c6-accd-4cdf-a679-3dcb5e536def tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:22:50 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:22:50 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dbade2eb-1028-4d50-a2e8-bf28f3da2fb9) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:22:50 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:22:50 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:22:50 user nova-compute[74960]: INFO os_vif [None req-9e07ff24-ea67-4caa-9cda-ec5ef0e1dda6 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:8d:5e,bridge_name='br-int',has_traffic_filtering=True,id=e6755218-8c73-4191-a259-8f1f936838e8,network=Network(9f0b1c9c-af46-4948-aeb8-e73013159ad4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6755218-8c')
Nov 03 12:22:50 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-9e07ff24-ea67-4caa-9cda-ec5ef0e1dda6 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] [instance: 0a198493-7329-43ff-bceb-56b50529be29] Deleting instance files /opt/stack/data/nova/instances/0a198493-7329-43ff-bceb-56b50529be29_del
Nov 03 12:22:50 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-9e07ff24-ea67-4caa-9cda-ec5ef0e1dda6 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] [instance: 0a198493-7329-43ff-bceb-56b50529be29] Deletion of /opt/stack/data/nova/instances/0a198493-7329-43ff-bceb-56b50529be29_del complete
Nov 03 12:22:50 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e91dfcf4-caef-43d0-a56b-b1282363d4e0/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:22:50 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e91dfcf4-caef-43d0-a56b-b1282363d4e0/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:22:50 user nova-compute[74960]: INFO nova.compute.manager [None req-9e07ff24-ea67-4caa-9cda-ec5ef0e1dda6 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] [instance: 0a198493-7329-43ff-bceb-56b50529be29] Took 1.11 seconds to destroy the instance on the hypervisor.
Nov 03 12:22:50 user nova-compute[74960]: DEBUG oslo.service.loopingcall [None req-9e07ff24-ea67-4caa-9cda-ec5ef0e1dda6 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74960) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 12:22:50 user nova-compute[74960]: DEBUG nova.compute.manager [-] [instance: 0a198493-7329-43ff-bceb-56b50529be29] Deallocating network for instance {{(pid=74960) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 12:22:50 user nova-compute[74960]: DEBUG nova.network.neutron [-] [instance: 0a198493-7329-43ff-bceb-56b50529be29] deallocate_for_instance() {{(pid=74960) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 12:22:50 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-fa8b34c6-accd-4cdf-a679-3dcb5e536def tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.196s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:22:50 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-fa8b34c6-accd-4cdf-a679-3dcb5e536def tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910,backing_fmt=raw /opt/stack/data/nova/instances/d5c87482-1883-43dc-8872-6a5dff128c94/disk 1073741824 {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:22:50 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e91dfcf4-caef-43d0-a56b-b1282363d4e0/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:22:50 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-fa8b34c6-accd-4cdf-a679-3dcb5e536def tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910,backing_fmt=raw /opt/stack/data/nova/instances/d5c87482-1883-43dc-8872-6a5dff128c94/disk 1073741824" returned: 0 in 0.088s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:22:50 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-fa8b34c6-accd-4cdf-a679-3dcb5e536def tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.291s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:22:50 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-fa8b34c6-accd-4cdf-a679-3dcb5e536def tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:22:51 user nova-compute[74960]: DEBUG nova.network.neutron [None req-fa8b34c6-accd-4cdf-a679-3dcb5e536def tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] [instance: d5c87482-1883-43dc-8872-6a5dff128c94] Successfully created port: 57e989be-1288-4c19-8194-6b36c3242bba {{(pid=74960) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 12:22:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-fa8b34c6-accd-4cdf-a679-3dcb5e536def tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.650s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:22:51 user nova-compute[74960]: DEBUG nova.virt.disk.api [None req-fa8b34c6-accd-4cdf-a679-3dcb5e536def tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d5c87482-1883-43dc-8872-6a5dff128c94/disk. size=1073741824 {{(pid=74960) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 12:22:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-fa8b34c6-accd-4cdf-a679-3dcb5e536def tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c87482-1883-43dc-8872-6a5dff128c94/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:22:51 user nova-compute[74960]: DEBUG nova.network.neutron [-] [instance: 0a198493-7329-43ff-bceb-56b50529be29] Updating instance_info_cache with network_info: [] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:22:51 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:22:51 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:22:51 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Hypervisor/Node resource view: name=user free_ram=7665MB free_disk=25.31290054321289GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74960) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 12:22:51 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:22:51 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:22:51 user nova-compute[74960]: INFO nova.compute.manager [-] [instance: 0a198493-7329-43ff-bceb-56b50529be29] Took 0.87 seconds to deallocate network for instance.
Nov 03 12:22:51 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-9e07ff24-ea67-4caa-9cda-ec5ef0e1dda6 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:22:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-fa8b34c6-accd-4cdf-a679-3dcb5e536def tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c87482-1883-43dc-8872-6a5dff128c94/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:22:51 user nova-compute[74960]: DEBUG nova.virt.disk.api [None req-fa8b34c6-accd-4cdf-a679-3dcb5e536def tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Cannot resize image /opt/stack/data/nova/instances/d5c87482-1883-43dc-8872-6a5dff128c94/disk to a smaller size. {{(pid=74960) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 12:22:51 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-fa8b34c6-accd-4cdf-a679-3dcb5e536def tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] [instance: d5c87482-1883-43dc-8872-6a5dff128c94] Created local disks {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 12:22:51 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-fa8b34c6-accd-4cdf-a679-3dcb5e536def tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] [instance: d5c87482-1883-43dc-8872-6a5dff128c94] Ensure instance console log exists: /opt/stack/data/nova/instances/d5c87482-1883-43dc-8872-6a5dff128c94/console.log {{(pid=74960) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 12:22:51 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-fa8b34c6-accd-4cdf-a679-3dcb5e536def tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:22:51 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-fa8b34c6-accd-4cdf-a679-3dcb5e536def tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:22:51 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-fa8b34c6-accd-4cdf-a679-3dcb5e536def tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:22:51 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 7769e3c5-136f-4282-8e3e-224e3a80922c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:22:51 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance e91dfcf4-caef-43d0-a56b-b1282363d4e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:22:51 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 8381c969-6a2d-4934-aadd-660ffa246b05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:22:51 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 05956d9b-0646-43d2-a4cd-19e9090020ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:22:51 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 6145a30b-809c-4bc5-a45f-c3ff3b170a22 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:22:51 user nova-compute[74960]: WARNING nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 0a198493-7329-43ff-bceb-56b50529be29 is not being actively managed by this compute host but has allocations referencing this compute host: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. Skipping heal of allocation because we do not know what to do.
Nov 03 12:22:51 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 7e5ec97f-80c4-4499-94bf-2584fc0eae03 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:22:51 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance fffd1dd7-b8e8-435c-bdfe-6c5001b21daf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:22:51 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance f009a400-0576-48a9-82e0-60de8935c498 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:22:51 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 9951fab7-4984-408e-94ca-11eab615ff25 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:22:51 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance d5c87482-1883-43dc-8872-6a5dff128c94 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:22:51 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74960) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 12:22:51 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74960) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 12:22:51 user nova-compute[74960]: DEBUG nova.compute.manager [req-e2be9cf3-5094-4b34-bb3a-cd79bac4aa7c req-8c3cbd58-8221-4e83-ab84-60d18d5eb9c4 service nova] [instance: 0a198493-7329-43ff-bceb-56b50529be29] Received event network-vif-plugged-e6755218-8c73-4191-a259-8f1f936838e8 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:22:51 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-e2be9cf3-5094-4b34-bb3a-cd79bac4aa7c req-8c3cbd58-8221-4e83-ab84-60d18d5eb9c4 service nova] Acquiring lock "0a198493-7329-43ff-bceb-56b50529be29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:22:51 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-e2be9cf3-5094-4b34-bb3a-cd79bac4aa7c req-8c3cbd58-8221-4e83-ab84-60d18d5eb9c4 service nova] Lock "0a198493-7329-43ff-bceb-56b50529be29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:22:51 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-e2be9cf3-5094-4b34-bb3a-cd79bac4aa7c req-8c3cbd58-8221-4e83-ab84-60d18d5eb9c4 service nova] Lock "0a198493-7329-43ff-bceb-56b50529be29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:22:51 user nova-compute[74960]: DEBUG nova.compute.manager [req-e2be9cf3-5094-4b34-bb3a-cd79bac4aa7c req-8c3cbd58-8221-4e83-ab84-60d18d5eb9c4 service nova] [instance: 0a198493-7329-43ff-bceb-56b50529be29] No waiting events found dispatching network-vif-plugged-e6755218-8c73-4191-a259-8f1f936838e8 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:22:51 user nova-compute[74960]: WARNING nova.compute.manager [req-e2be9cf3-5094-4b34-bb3a-cd79bac4aa7c req-8c3cbd58-8221-4e83-ab84-60d18d5eb9c4 service nova] [instance: 0a198493-7329-43ff-bceb-56b50529be29] Received unexpected event network-vif-plugged-e6755218-8c73-4191-a259-8f1f936838e8 for instance with vm_state deleted and task_state None.
Nov 03 12:22:51 user nova-compute[74960]: DEBUG nova.compute.manager [req-e2be9cf3-5094-4b34-bb3a-cd79bac4aa7c req-8c3cbd58-8221-4e83-ab84-60d18d5eb9c4 service nova] [instance: 0a198493-7329-43ff-bceb-56b50529be29] Received event network-vif-deleted-e6755218-8c73-4191-a259-8f1f936838e8 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:22:52 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:22:52 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:22:52 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Compute_service record updated for user:user {{(pid=74960) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 12:22:52 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.699s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:22:52 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-9e07ff24-ea67-4caa-9cda-ec5ef0e1dda6 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.595s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:22:52 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-9e07ff24-ea67-4caa-9cda-ec5ef0e1dda6 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.004s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:22:52 user nova-compute[74960]: INFO nova.scheduler.client.report [None req-9e07ff24-ea67-4caa-9cda-ec5ef0e1dda6 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Deleted allocations for instance 0a198493-7329-43ff-bceb-56b50529be29
Nov 03 12:22:52 user nova-compute[74960]: DEBUG nova.network.neutron [None req-fa8b34c6-accd-4cdf-a679-3dcb5e536def tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] [instance: d5c87482-1883-43dc-8872-6a5dff128c94] Successfully updated port: 57e989be-1288-4c19-8194-6b36c3242bba {{(pid=74960) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 12:22:52 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-fa8b34c6-accd-4cdf-a679-3dcb5e536def tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Acquiring lock "refresh_cache-d5c87482-1883-43dc-8872-6a5dff128c94" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:22:52 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-fa8b34c6-accd-4cdf-a679-3dcb5e536def tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Acquired lock "refresh_cache-d5c87482-1883-43dc-8872-6a5dff128c94" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:22:52 user nova-compute[74960]: DEBUG nova.network.neutron [None req-fa8b34c6-accd-4cdf-a679-3dcb5e536def tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] [instance: d5c87482-1883-43dc-8872-6a5dff128c94] Building network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 12:22:52 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-9e07ff24-ea67-4caa-9cda-ec5ef0e1dda6 tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Lock "0a198493-7329-43ff-bceb-56b50529be29" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.871s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:22:52 user nova-compute[74960]: DEBUG nova.network.neutron [None req-fa8b34c6-accd-4cdf-a679-3dcb5e536def tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] [instance: d5c87482-1883-43dc-8872-6a5dff128c94] Instance cache missing network info. {{(pid=74960) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 12:22:52 user nova-compute[74960]: DEBUG nova.network.neutron [None req-fa8b34c6-accd-4cdf-a679-3dcb5e536def tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] [instance: d5c87482-1883-43dc-8872-6a5dff128c94] Updating instance_info_cache with network_info: [{"id": "57e989be-1288-4c19-8194-6b36c3242bba", "address": "fa:16:3e:30:c8:cb", "network": {"id": "3a8a59cd-8076-41af-b566-9fc45a07a1df", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1235385625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e379e295cf984ca6bf5d84a60e56382d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57e989be-12", "ovs_interfaceid": "57e989be-1288-4c19-8194-6b36c3242bba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:22:52 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-fa8b34c6-accd-4cdf-a679-3dcb5e536def tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Releasing lock "refresh_cache-d5c87482-1883-43dc-8872-6a5dff128c94" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:22:52 user nova-compute[74960]: DEBUG nova.compute.manager [None req-fa8b34c6-accd-4cdf-a679-3dcb5e536def tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] [instance: d5c87482-1883-43dc-8872-6a5dff128c94] Instance network_info: |[{"id": "57e989be-1288-4c19-8194-6b36c3242bba", "address": "fa:16:3e:30:c8:cb", "network": {"id": "3a8a59cd-8076-41af-b566-9fc45a07a1df", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1235385625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e379e295cf984ca6bf5d84a60e56382d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57e989be-12", "ovs_interfaceid": "57e989be-1288-4c19-8194-6b36c3242bba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74960) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 12:22:52 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-fa8b34c6-accd-4cdf-a679-3dcb5e536def tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] [instance: d5c87482-1883-43dc-8872-6a5dff128c94] Start _get_guest_xml network_info=[{"id": "57e989be-1288-4c19-8194-6b36c3242bba", "address": "fa:16:3e:30:c8:cb", "network": {"id": "3a8a59cd-8076-41af-b566-9fc45a07a1df", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1235385625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e379e295cf984ca6bf5d84a60e56382d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57e989be-12", "ovs_interfaceid": "57e989be-1288-4c19-8194-6b36c3242bba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=549f51ba-ac69-494b-8de1-34635aa2d7cf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='63ee9c80c632442fb0379f47b784bd20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T12:13:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'image_id': '549f51ba-ac69-494b-8de1-34635aa2d7cf'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 12:22:52 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-fa8b34c6-accd-4cdf-a679-3dcb5e536def tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:22:52 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-fa8b34c6-accd-4cdf-a679-3dcb5e536def tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:22:52 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-fa8b34c6-accd-4cdf-a679-3dcb5e536def tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 12:22:52 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-fa8b34c6-accd-4cdf-a679-3dcb5e536def tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] CPU controller missing on host. {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 12:22:52 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-fa8b34c6-accd-4cdf-a679-3dcb5e536def tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 12:22:52 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-fa8b34c6-accd-4cdf-a679-3dcb5e536def tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] CPU controller found on host. {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 12:22:52 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-fa8b34c6-accd-4cdf-a679-3dcb5e536def tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74960) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 12:22:52 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-fa8b34c6-accd-4cdf-a679-3dcb5e536def tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=549f51ba-ac69-494b-8de1-34635aa2d7cf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='63ee9c80c632442fb0379f47b784bd20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T12:13:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 12:22:52 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-fa8b34c6-accd-4cdf-a679-3dcb5e536def tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Flavor limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 12:22:52 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-fa8b34c6-accd-4cdf-a679-3dcb5e536def tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Image limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 12:22:52 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-fa8b34c6-accd-4cdf-a679-3dcb5e536def tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Flavor pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 12:22:52 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-fa8b34c6-accd-4cdf-a679-3dcb5e536def tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Image pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 12:22:52 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-fa8b34c6-accd-4cdf-a679-3dcb5e536def tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 12:22:52 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-fa8b34c6-accd-4cdf-a679-3dcb5e536def tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 12:22:52 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-fa8b34c6-accd-4cdf-a679-3dcb5e536def tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 12:22:52 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-fa8b34c6-accd-4cdf-a679-3dcb5e536def tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Got 1 possible topologies {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 12:22:52 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-fa8b34c6-accd-4cdf-a679-3dcb5e536def tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 12:22:52 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-fa8b34c6-accd-4cdf-a679-3dcb5e536def tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 12:22:52 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-fa8b34c6-accd-4cdf-a679-3dcb5e536def tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:22:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-256470132',display_name='tempest-ServersNegativeTestJSON-server-256470132',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-256470132',id=17,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e379e295cf984ca6bf5d84a60e56382d',ramdisk_id='',reservation_id='r-mxu17fqz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-802200730',owner_user_name='tempest-ServersNegativeTestJSON-802200730-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:22:50Z,user_data=None,user_id='7a13ec06392c4ce5a81491a35a8d50d8',uuid=d5c87482-1883-43dc-8872-6a5dff128c94,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "57e989be-1288-4c19-8194-6b36c3242bba", "address": "fa:16:3e:30:c8:cb", "network": {"id": "3a8a59cd-8076-41af-b566-9fc45a07a1df", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1235385625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e379e295cf984ca6bf5d84a60e56382d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57e989be-12", "ovs_interfaceid": "57e989be-1288-4c19-8194-6b36c3242bba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74960) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 12:22:52 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-fa8b34c6-accd-4cdf-a679-3dcb5e536def tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Converting VIF {"id": "57e989be-1288-4c19-8194-6b36c3242bba", "address": "fa:16:3e:30:c8:cb", "network": {"id": "3a8a59cd-8076-41af-b566-9fc45a07a1df", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1235385625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e379e295cf984ca6bf5d84a60e56382d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57e989be-12", "ovs_interfaceid": "57e989be-1288-4c19-8194-6b36c3242bba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:22:52 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-fa8b34c6-accd-4cdf-a679-3dcb5e536def tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:c8:cb,bridge_name='br-int',has_traffic_filtering=True,id=57e989be-1288-4c19-8194-6b36c3242bba,network=Network(3a8a59cd-8076-41af-b566-9fc45a07a1df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57e989be-12') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:22:52 user nova-compute[74960]: DEBUG nova.objects.instance [None req-fa8b34c6-accd-4cdf-a679-3dcb5e536def tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Lazy-loading 'pci_devices' on Instance uuid d5c87482-1883-43dc-8872-6a5dff128c94 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:22:52 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:22:52 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-fa8b34c6-accd-4cdf-a679-3dcb5e536def tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] [instance: d5c87482-1883-43dc-8872-6a5dff128c94] End _get_guest_xml xml=<domain type="kvm">
Nov 03 12:22:52 user nova-compute[74960]:   <uuid>d5c87482-1883-43dc-8872-6a5dff128c94</uuid>
Nov 03 12:22:52 user nova-compute[74960]:   <name>instance-00000011</name>
Nov 03 12:22:52 user nova-compute[74960]:   <memory>524288</memory>
Nov 03 12:22:52 user nova-compute[74960]:   <vcpu>1</vcpu>
Nov 03 12:22:52 user nova-compute[74960]:   <metadata>
Nov 03 12:22:52 user nova-compute[74960]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 12:22:52 user nova-compute[74960]:       <nova:package version="0.0.0"/>
Nov 03 12:22:52 user nova-compute[74960]:       <nova:name>tempest-ServersNegativeTestJSON-server-256470132</nova:name>
Nov 03 12:22:52 user nova-compute[74960]:       <nova:creationTime>2023-11-03 12:22:52</nova:creationTime>
Nov 03 12:22:52 user nova-compute[74960]:       <nova:flavor name="m1.tiny">
Nov 03 12:22:52 user nova-compute[74960]:         <nova:memory>512</nova:memory>
Nov 03 12:22:52 user nova-compute[74960]:         <nova:disk>1</nova:disk>
Nov 03 12:22:52 user nova-compute[74960]:         <nova:swap>0</nova:swap>
Nov 03 12:22:52 user nova-compute[74960]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 12:22:52 user nova-compute[74960]:         <nova:vcpus>1</nova:vcpus>
Nov 03 12:22:52 user nova-compute[74960]:       </nova:flavor>
Nov 03 12:22:52 user nova-compute[74960]:       <nova:owner>
Nov 03 12:22:52 user nova-compute[74960]:         <nova:user uuid="7a13ec06392c4ce5a81491a35a8d50d8">tempest-ServersNegativeTestJSON-802200730-project-member</nova:user>
Nov 03 12:22:52 user nova-compute[74960]:         <nova:project uuid="e379e295cf984ca6bf5d84a60e56382d">tempest-ServersNegativeTestJSON-802200730</nova:project>
Nov 03 12:22:52 user nova-compute[74960]:       </nova:owner>
Nov 03 12:22:52 user nova-compute[74960]:       <nova:root type="image" uuid="549f51ba-ac69-494b-8de1-34635aa2d7cf"/>
Nov 03 12:22:52 user nova-compute[74960]:       <nova:ports>
Nov 03 12:22:52 user nova-compute[74960]:         <nova:port uuid="57e989be-1288-4c19-8194-6b36c3242bba">
Nov 03 12:22:52 user nova-compute[74960]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 03 12:22:52 user nova-compute[74960]:         </nova:port>
Nov 03 12:22:52 user nova-compute[74960]:       </nova:ports>
Nov 03 12:22:52 user nova-compute[74960]:     </nova:instance>
Nov 03 12:22:52 user nova-compute[74960]:   </metadata>
Nov 03 12:22:52 user nova-compute[74960]:   <sysinfo type="smbios">
Nov 03 12:22:52 user nova-compute[74960]:     <system>
Nov 03 12:22:52 user nova-compute[74960]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 12:22:52 user nova-compute[74960]:       <entry name="product">OpenStack Nova</entry>
Nov 03 12:22:52 user nova-compute[74960]:       <entry name="version">0.0.0</entry>
Nov 03 12:22:52 user nova-compute[74960]:       <entry name="serial">d5c87482-1883-43dc-8872-6a5dff128c94</entry>
Nov 03 12:22:52 user nova-compute[74960]:       <entry name="uuid">d5c87482-1883-43dc-8872-6a5dff128c94</entry>
Nov 03 12:22:52 user nova-compute[74960]:       <entry name="family">Virtual Machine</entry>
Nov 03 12:22:52 user nova-compute[74960]:     </system>
Nov 03 12:22:52 user nova-compute[74960]:   </sysinfo>
Nov 03 12:22:52 user nova-compute[74960]:   <os>
Nov 03 12:22:52 user nova-compute[74960]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 12:22:52 user nova-compute[74960]:     <boot dev="hd"/>
Nov 03 12:22:52 user nova-compute[74960]:     <smbios mode="sysinfo"/>
Nov 03 12:22:52 user nova-compute[74960]:   </os>
Nov 03 12:22:52 user nova-compute[74960]:   <features>
Nov 03 12:22:52 user nova-compute[74960]:     <acpi/>
Nov 03 12:22:52 user nova-compute[74960]:     <apic/>
Nov 03 12:22:52 user nova-compute[74960]:     <vmcoreinfo/>
Nov 03 12:22:52 user nova-compute[74960]:   </features>
Nov 03 12:22:52 user nova-compute[74960]:   <clock offset="utc">
Nov 03 12:22:52 user nova-compute[74960]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 12:22:52 user nova-compute[74960]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 12:22:52 user nova-compute[74960]:     <timer name="hpet" present="no"/>
Nov 03 12:22:52 user nova-compute[74960]:   </clock>
Nov 03 12:22:52 user nova-compute[74960]:   <cpu mode="custom" match="exact">
Nov 03 12:22:52 user nova-compute[74960]:     <model>Nehalem</model>
Nov 03 12:22:52 user nova-compute[74960]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 12:22:52 user nova-compute[74960]:   </cpu>
Nov 03 12:22:52 user nova-compute[74960]:   <devices>
Nov 03 12:22:52 user nova-compute[74960]:     <disk type="file" device="disk">
Nov 03 12:22:52 user nova-compute[74960]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 12:22:52 user nova-compute[74960]:       <source file="/opt/stack/data/nova/instances/d5c87482-1883-43dc-8872-6a5dff128c94/disk"/>
Nov 03 12:22:52 user nova-compute[74960]:       <target dev="vda" bus="virtio"/>
Nov 03 12:22:52 user nova-compute[74960]:     </disk>
Nov 03 12:22:52 user nova-compute[74960]:     <interface type="ethernet">
Nov 03 12:22:52 user nova-compute[74960]:       <mac address="fa:16:3e:30:c8:cb"/>
Nov 03 12:22:52 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:22:52 user nova-compute[74960]:       <mtu size="1442"/>
Nov 03 12:22:52 user nova-compute[74960]:       <target dev="tap57e989be-12"/>
Nov 03 12:22:52 user nova-compute[74960]:     </interface>
Nov 03 12:22:52 user nova-compute[74960]:     <serial type="pty">
Nov 03 12:22:52 user nova-compute[74960]:       <log file="/opt/stack/data/nova/instances/d5c87482-1883-43dc-8872-6a5dff128c94/console.log" append="off"/>
Nov 03 12:22:52 user nova-compute[74960]:     </serial>
Nov 03 12:22:52 user nova-compute[74960]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 12:22:52 user nova-compute[74960]:     <video>
Nov 03 12:22:52 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:22:52 user nova-compute[74960]:     </video>
Nov 03 12:22:52 user nova-compute[74960]:     <rng model="virtio">
Nov 03 12:22:52 user nova-compute[74960]:       <backend model="random">/dev/urandom</backend>
Nov 03 12:22:52 user nova-compute[74960]:     </rng>
Nov 03 12:22:52 user nova-compute[74960]:     <controller type="usb" index="0" model="none"/>
Nov 03 12:22:52 user nova-compute[74960]:     <memballoon model="virtio">
Nov 03 12:22:52 user nova-compute[74960]:       <stats period="10"/>
Nov 03 12:22:52 user nova-compute[74960]:     </memballoon>
Nov 03 12:22:52 user nova-compute[74960]:   </devices>
Nov 03 12:22:52 user nova-compute[74960]: </domain>
Nov 03 12:22:52 user nova-compute[74960]:  {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 12:22:52 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-fa8b34c6-accd-4cdf-a679-3dcb5e536def tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:22:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-256470132',display_name='tempest-ServersNegativeTestJSON-server-256470132',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-256470132',id=17,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e379e295cf984ca6bf5d84a60e56382d',ramdisk_id='',reservation_id='r-mxu17fqz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-802200730',owner_user_name='tempest-ServersNegativeTestJSON-802200730-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:22:50Z,user_data=None,user_id='7a13ec06392c4ce5a81491a35a8d50d8',uuid=d5c87482-1883-43dc-8872-6a5dff128c94,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "57e989be-1288-4c19-8194-6b36c3242bba", "address": "fa:16:3e:30:c8:cb", "network": {"id": "3a8a59cd-8076-41af-b566-9fc45a07a1df", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1235385625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e379e295cf984ca6bf5d84a60e56382d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57e989be-12", "ovs_interfaceid": "57e989be-1288-4c19-8194-6b36c3242bba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 12:22:52 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-fa8b34c6-accd-4cdf-a679-3dcb5e536def tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Converting VIF {"id": "57e989be-1288-4c19-8194-6b36c3242bba", "address": "fa:16:3e:30:c8:cb", "network": {"id": "3a8a59cd-8076-41af-b566-9fc45a07a1df", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1235385625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e379e295cf984ca6bf5d84a60e56382d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57e989be-12", "ovs_interfaceid": "57e989be-1288-4c19-8194-6b36c3242bba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:22:52 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-fa8b34c6-accd-4cdf-a679-3dcb5e536def tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:c8:cb,bridge_name='br-int',has_traffic_filtering=True,id=57e989be-1288-4c19-8194-6b36c3242bba,network=Network(3a8a59cd-8076-41af-b566-9fc45a07a1df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57e989be-12') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:22:52 user nova-compute[74960]: DEBUG os_vif [None req-fa8b34c6-accd-4cdf-a679-3dcb5e536def tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:c8:cb,bridge_name='br-int',has_traffic_filtering=True,id=57e989be-1288-4c19-8194-6b36c3242bba,network=Network(3a8a59cd-8076-41af-b566-9fc45a07a1df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57e989be-12') {{(pid=74960) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 12:22:52 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:22:52 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:22:52 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 12:22:52 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:22:52 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '12b6cb2f-aca8-5573-b1cb-ebe39f2df9b1', '_type': 'linux-noop'}}, row=False) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:22:52 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:22:52 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:22:52 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:22:52 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap57e989be-12, may_exist=True, interface_attrs={}) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:22:52 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap57e989be-12, col_values=(('qos', UUID('0a8586f1-4a29-46e6-8914-7c497a378c4f')),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:22:52 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap57e989be-12, col_values=(('external_ids', {'iface-id': '57e989be-1288-4c19-8194-6b36c3242bba', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:30:c8:cb', 'vm-uuid': 'd5c87482-1883-43dc-8872-6a5dff128c94'}),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:22:52 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:22:52 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:22:52 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:22:52 user nova-compute[74960]: INFO os_vif [None req-fa8b34c6-accd-4cdf-a679-3dcb5e536def tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:c8:cb,bridge_name='br-int',has_traffic_filtering=True,id=57e989be-1288-4c19-8194-6b36c3242bba,network=Network(3a8a59cd-8076-41af-b566-9fc45a07a1df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57e989be-12')
Nov 03 12:22:52 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-fa8b34c6-accd-4cdf-a679-3dcb5e536def tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] No BDM found with device name vda, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:22:52 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-fa8b34c6-accd-4cdf-a679-3dcb5e536def tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] No VIF found with MAC fa:16:3e:30:c8:cb, not building metadata {{(pid=74960) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 12:22:53 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:22:53 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74960) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 12:22:54 user nova-compute[74960]: DEBUG nova.compute.manager [req-ce144ece-f9c7-4f4b-8642-0f803910e3f8 req-fd2e87ad-5d2e-4d90-bc7d-37727273c38c service nova] [instance: d5c87482-1883-43dc-8872-6a5dff128c94] Received event network-changed-57e989be-1288-4c19-8194-6b36c3242bba {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:22:54 user nova-compute[74960]: DEBUG nova.compute.manager [req-ce144ece-f9c7-4f4b-8642-0f803910e3f8 req-fd2e87ad-5d2e-4d90-bc7d-37727273c38c service nova] [instance: d5c87482-1883-43dc-8872-6a5dff128c94] Refreshing instance network info cache due to event network-changed-57e989be-1288-4c19-8194-6b36c3242bba. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 12:22:54 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-ce144ece-f9c7-4f4b-8642-0f803910e3f8 req-fd2e87ad-5d2e-4d90-bc7d-37727273c38c service nova] Acquiring lock "refresh_cache-d5c87482-1883-43dc-8872-6a5dff128c94" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:22:54 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-ce144ece-f9c7-4f4b-8642-0f803910e3f8 req-fd2e87ad-5d2e-4d90-bc7d-37727273c38c service nova] Acquired lock "refresh_cache-d5c87482-1883-43dc-8872-6a5dff128c94" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:22:54 user nova-compute[74960]: DEBUG nova.network.neutron [req-ce144ece-f9c7-4f4b-8642-0f803910e3f8 req-fd2e87ad-5d2e-4d90-bc7d-37727273c38c service nova] [instance: d5c87482-1883-43dc-8872-6a5dff128c94] Refreshing network info cache for port 57e989be-1288-4c19-8194-6b36c3242bba {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 12:22:54 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:22:54 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:22:54 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:22:54 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:22:54 user nova-compute[74960]: DEBUG nova.network.neutron [req-ce144ece-f9c7-4f4b-8642-0f803910e3f8 req-fd2e87ad-5d2e-4d90-bc7d-37727273c38c service nova] [instance: d5c87482-1883-43dc-8872-6a5dff128c94] Updated VIF entry in instance network info cache for port 57e989be-1288-4c19-8194-6b36c3242bba. {{(pid=74960) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 12:22:54 user nova-compute[74960]: DEBUG nova.network.neutron [req-ce144ece-f9c7-4f4b-8642-0f803910e3f8 req-fd2e87ad-5d2e-4d90-bc7d-37727273c38c service nova] [instance: d5c87482-1883-43dc-8872-6a5dff128c94] Updating instance_info_cache with network_info: [{"id": "57e989be-1288-4c19-8194-6b36c3242bba", "address": "fa:16:3e:30:c8:cb", "network": {"id": "3a8a59cd-8076-41af-b566-9fc45a07a1df", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1235385625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e379e295cf984ca6bf5d84a60e56382d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57e989be-12", "ovs_interfaceid": "57e989be-1288-4c19-8194-6b36c3242bba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:22:54 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-ce144ece-f9c7-4f4b-8642-0f803910e3f8 req-fd2e87ad-5d2e-4d90-bc7d-37727273c38c service nova] Releasing lock "refresh_cache-d5c87482-1883-43dc-8872-6a5dff128c94" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:22:54 user nova-compute[74960]: DEBUG nova.compute.manager [req-238c39e5-db77-41d9-86a8-9835340d2110 req-8c4395df-52e8-47b6-96c9-8d55af746338 service nova] [instance: d5c87482-1883-43dc-8872-6a5dff128c94] Received event network-vif-plugged-57e989be-1288-4c19-8194-6b36c3242bba {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:22:54 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-238c39e5-db77-41d9-86a8-9835340d2110 req-8c4395df-52e8-47b6-96c9-8d55af746338 service nova] Acquiring lock "d5c87482-1883-43dc-8872-6a5dff128c94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:22:54 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-238c39e5-db77-41d9-86a8-9835340d2110 req-8c4395df-52e8-47b6-96c9-8d55af746338 service nova] Lock "d5c87482-1883-43dc-8872-6a5dff128c94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:22:54 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-238c39e5-db77-41d9-86a8-9835340d2110 req-8c4395df-52e8-47b6-96c9-8d55af746338 service nova] Lock "d5c87482-1883-43dc-8872-6a5dff128c94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:22:54 user nova-compute[74960]: DEBUG nova.compute.manager [req-238c39e5-db77-41d9-86a8-9835340d2110 req-8c4395df-52e8-47b6-96c9-8d55af746338 service nova] [instance: d5c87482-1883-43dc-8872-6a5dff128c94] No waiting events found dispatching network-vif-plugged-57e989be-1288-4c19-8194-6b36c3242bba {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:22:54 user nova-compute[74960]: WARNING nova.compute.manager [req-238c39e5-db77-41d9-86a8-9835340d2110 req-8c4395df-52e8-47b6-96c9-8d55af746338 service nova] [instance: d5c87482-1883-43dc-8872-6a5dff128c94] Received unexpected event network-vif-plugged-57e989be-1288-4c19-8194-6b36c3242bba for instance with vm_state building and task_state spawning.
Nov 03 12:22:54 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:22:56 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-7ff4a14b-8aae-4aa4-9657-f4113b7f3bc5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 7e5ec97f-80c4-4499-94bf-2584fc0eae03 is timed out.
Nov 03 12:22:56 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-7ff4a14b-8aae-4aa4-9657-f4113b7f3bc5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Successfully detached device vdc from instance 7e5ec97f-80c4-4499-94bf-2584fc0eae03 from the live domain config.
Nov 03 12:22:56 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ff4a14b-8aae-4aa4-9657-f4113b7f3bc5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] calling os-brick to detach iSCSI Volume {{(pid=74960) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 12:22:56 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ff4a14b-8aae-4aa4-9657-f4113b7f3bc5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9aa420acb0>, {'target_iqn': 'iqn.2010-10.org.openstack:8b06fb29-6288-4cca-aabd-39d9c089c045', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zhvlQkKU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:22:56 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-7ff4a14b-8aae-4aa4-9657-f4113b7f3bc5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:22:56 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-7ff4a14b-8aae-4aa4-9657-f4113b7f3bc5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:22:56 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-7ff4a14b-8aae-4aa4-9657-f4113b7f3bc5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:22:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:22:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:22:56 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[e50e8868-be47-49db-adf4-21910903e397]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8b06fb29-6288-4cca-aabd-39d9c089c045\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:22:56 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ff4a14b-8aae-4aa4-9657-f4113b7f3bc5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 12:22:56 user nova-compute[74960]: No targets found.
Nov 03 12:22:56 user nova-compute[74960]: iSNS:
Nov 03 12:22:56 user nova-compute[74960]: No targets found.
Nov 03 12:22:56 user nova-compute[74960]: STATIC:
Nov 03 12:22:56 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:8b06fb29-6288-4cca-aabd-39d9c089c045
Nov 03 12:22:56 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:22:56 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:22:56 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19
Nov 03 12:22:56 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:22:56 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:22:56 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02
Nov 03 12:22:56 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:22:56 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:22:56 user nova-compute[74960]: FIRMWARE:
Nov 03 12:22:56 user nova-compute[74960]: No targets found.
Nov 03 12:22:56 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:22:56 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ff4a14b-8aae-4aa4-9657-f4113b7f3bc5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 12:22:56 user nova-compute[74960]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 12:22:56 user nova-compute[74960]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74960) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 12:22:56 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ff4a14b-8aae-4aa4-9657-f4113b7f3bc5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8b06fb29-6288-4cca-aabd-39d9c089c045', 0)] {{(pid=74960) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 12:22:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:22:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:22:56 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[9610631b-e27b-441f-9c9b-78416202b6bb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8b06fb29-6288-4cca-aabd-39d9c089c045\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:22:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:22:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:22:56 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[378a046a-1163-458d-9688-79cf64fa5adb]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b06fb29-6288-4cca-aabd-39d9c089c045 (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:22:56 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ff4a14b-8aae-4aa4-9657-f4113b7f3bc5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02 (non-flash)
Nov 03 12:22:56 user nova-compute[74960]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19 (non-flash)
Nov 03 12:22:56 user nova-compute[74960]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b06fb29-6288-4cca-aabd-39d9c089c045 (non-flash)
Nov 03 12:22:56 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:22:56 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ff4a14b-8aae-4aa4-9657-f4113b7f3bc5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02 (non-flash)
Nov 03 12:22:56 user nova-compute[74960]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19 (non-flash)
Nov 03 12:22:56 user nova-compute[74960]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b06fb29-6288-4cca-aabd-39d9c089c045 (non-flash)
Nov 03 12:22:56 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:22:56 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ff4a14b-8aae-4aa4-9657-f4113b7f3bc5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9a8c47eef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8b06fb29-6288-4cca-aabd-39d9c089c045'): ({'sdb'}, set())}) {{(pid=74960) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 12:22:56 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-7ff4a14b-8aae-4aa4-9657-f4113b7f3bc5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Removing single pathed devices sdb {{(pid=74960) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 12:22:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:22:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:22:56 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c949f04-d595-4019-8451-5ca38bebefd0]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:22:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:22:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:22:56 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[95037b58-d2af-49e6-a5fa-792ad615c734]: (4, ('ok\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:22:56 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-7ff4a14b-8aae-4aa4-9657-f4113b7f3bc5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Flushing IO for device /dev/sdb {{(pid=74960) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 12:22:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:22:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:22:56 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dff84b1-fff2-48a4-974b-0a8d7be12ce3]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:22:56 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-7ff4a14b-8aae-4aa4-9657-f4113b7f3bc5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74960) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 12:22:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:22:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:22:56 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f5f6f51-1fe6-406b-8cd3-d28d0215f44d]: (4, ('1', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:22:56 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-7ff4a14b-8aae-4aa4-9657-f4113b7f3bc5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74960) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 12:22:56 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-7ff4a14b-8aae-4aa4-9657-f4113b7f3bc5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] SCSI volumes sdb have been removed. {{(pid=74960) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 12:22:56 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ff4a14b-8aae-4aa4-9657-f4113b7f3bc5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8b06fb29-6288-4cca-aabd-39d9c089c045')] {{(pid=74960) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 12:22:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b06fb29-6288-4cca-aabd-39d9c089c045 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:22:56 user nova-compute[74960]: DEBUG nova.compute.manager [req-ad6cc9b6-32b7-4472-abef-5b2798d8b2b8 req-8b1d2a69-9c70-4891-9838-6dc5f814826a service nova] [instance: d5c87482-1883-43dc-8872-6a5dff128c94] Received event network-vif-plugged-57e989be-1288-4c19-8194-6b36c3242bba {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:22:56 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-ad6cc9b6-32b7-4472-abef-5b2798d8b2b8 req-8b1d2a69-9c70-4891-9838-6dc5f814826a service nova] Acquiring lock "d5c87482-1883-43dc-8872-6a5dff128c94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:22:56 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-ad6cc9b6-32b7-4472-abef-5b2798d8b2b8 req-8b1d2a69-9c70-4891-9838-6dc5f814826a service nova] Lock "d5c87482-1883-43dc-8872-6a5dff128c94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:22:56 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-ad6cc9b6-32b7-4472-abef-5b2798d8b2b8 req-8b1d2a69-9c70-4891-9838-6dc5f814826a service nova] Lock "d5c87482-1883-43dc-8872-6a5dff128c94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:22:56 user nova-compute[74960]: DEBUG nova.compute.manager [req-ad6cc9b6-32b7-4472-abef-5b2798d8b2b8 req-8b1d2a69-9c70-4891-9838-6dc5f814826a service nova] [instance: d5c87482-1883-43dc-8872-6a5dff128c94] No waiting events found dispatching network-vif-plugged-57e989be-1288-4c19-8194-6b36c3242bba {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:22:56 user nova-compute[74960]: WARNING nova.compute.manager [req-ad6cc9b6-32b7-4472-abef-5b2798d8b2b8 req-8b1d2a69-9c70-4891-9838-6dc5f814826a service nova] [instance: d5c87482-1883-43dc-8872-6a5dff128c94] Received unexpected event network-vif-plugged-57e989be-1288-4c19-8194-6b36c3242bba for instance with vm_state building and task_state spawning.
Nov 03 12:22:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b06fb29-6288-4cca-aabd-39d9c089c045 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:22:56 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[002f1f06-93c6-40b3-abdf-b2a031248497]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:22:56 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ff4a14b-8aae-4aa4-9657-f4113b7f3bc5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:22:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b06fb29-6288-4cca-aabd-39d9c089c045 -p 172.16.0.220:3260 --logout {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:22:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b06fb29-6288-4cca-aabd-39d9c089c045 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:22:56 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f738070-2335-4f9d-a890-bfef7261b792]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:8b06fb29-6288-4cca-aabd-39d9c089c045, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:8b06fb29-6288-4cca-aabd-39d9c089c045, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:22:56 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ff4a14b-8aae-4aa4-9657-f4113b7f3bc5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:8b06fb29-6288-4cca-aabd-39d9c089c045, portal: 172.16.0.220,3260]
Nov 03 12:22:56 user nova-compute[74960]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:8b06fb29-6288-4cca-aabd-39d9c089c045, portal: 172.16.0.220,3260] successful.
Nov 03 12:22:56 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:22:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b06fb29-6288-4cca-aabd-39d9c089c045 -p 172.16.0.220:3260 --op delete {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:22:56 user nova-compute[74960]: DEBUG nova.compute.manager [None req-fa8b34c6-accd-4cdf-a679-3dcb5e536def tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] [instance: d5c87482-1883-43dc-8872-6a5dff128c94] Instance event wait completed in 0 seconds for  {{(pid=74960) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 12:22:56 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-fa8b34c6-accd-4cdf-a679-3dcb5e536def tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] [instance: d5c87482-1883-43dc-8872-6a5dff128c94] Guest created on hypervisor {{(pid=74960) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 12:22:56 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: d5c87482-1883-43dc-8872-6a5dff128c94] Instance spawned successfully.
Nov 03 12:22:56 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-fa8b34c6-accd-4cdf-a679-3dcb5e536def tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] [instance: d5c87482-1883-43dc-8872-6a5dff128c94] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 12:22:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b06fb29-6288-4cca-aabd-39d9c089c045 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:22:56 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[79445a02-95f7-4be1-9b1c-965b06f4714f]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:22:56 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ff4a14b-8aae-4aa4-9657-f4113b7f3bc5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:22:56 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-7ff4a14b-8aae-4aa4-9657-f4113b7f3bc5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:22:56 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ff4a14b-8aae-4aa4-9657-f4113b7f3bc5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] <== disconnect_volume: return (344ms) None {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:22:56 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ff4a14b-8aae-4aa4-9657-f4113b7f3bc5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Disconnected iSCSI Volume {{(pid=74960) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 12:22:56 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-fa8b34c6-accd-4cdf-a679-3dcb5e536def tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] [instance: d5c87482-1883-43dc-8872-6a5dff128c94] Found default for hw_cdrom_bus of ide {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:22:56 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-fa8b34c6-accd-4cdf-a679-3dcb5e536def tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] [instance: d5c87482-1883-43dc-8872-6a5dff128c94] Found default for hw_disk_bus of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:22:56 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-fa8b34c6-accd-4cdf-a679-3dcb5e536def tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] [instance: d5c87482-1883-43dc-8872-6a5dff128c94] Found default for hw_input_bus of None {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:22:56 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-fa8b34c6-accd-4cdf-a679-3dcb5e536def tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] [instance: d5c87482-1883-43dc-8872-6a5dff128c94] Found default for hw_pointer_model of None {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:22:56 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-fa8b34c6-accd-4cdf-a679-3dcb5e536def tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] [instance: d5c87482-1883-43dc-8872-6a5dff128c94] Found default for hw_video_model of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:22:56 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-fa8b34c6-accd-4cdf-a679-3dcb5e536def tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] [instance: d5c87482-1883-43dc-8872-6a5dff128c94] Found default for hw_vif_model of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:22:56 user nova-compute[74960]: INFO nova.compute.manager [None req-fa8b34c6-accd-4cdf-a679-3dcb5e536def tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] [instance: d5c87482-1883-43dc-8872-6a5dff128c94] Took 6.74 seconds to spawn the instance on the hypervisor.
Nov 03 12:22:56 user nova-compute[74960]: DEBUG nova.compute.manager [None req-fa8b34c6-accd-4cdf-a679-3dcb5e536def tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] [instance: d5c87482-1883-43dc-8872-6a5dff128c94] Checking state {{(pid=74960) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 12:22:57 user nova-compute[74960]: INFO nova.compute.manager [None req-fa8b34c6-accd-4cdf-a679-3dcb5e536def tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] [instance: d5c87482-1883-43dc-8872-6a5dff128c94] Took 8.89 seconds to build instance.
Nov 03 12:22:57 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-fa8b34c6-accd-4cdf-a679-3dcb5e536def tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Lock "d5c87482-1883-43dc-8872-6a5dff128c94" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.075s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:22:57 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:22:57 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:22:57 user nova-compute[74960]: DEBUG nova.objects.instance [None req-7ff4a14b-8aae-4aa4-9657-f4113b7f3bc5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Lazy-loading 'flavor' on Instance uuid 7e5ec97f-80c4-4499-94bf-2584fc0eae03 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:22:57 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-7ff4a14b-8aae-4aa4-9657-f4113b7f3bc5 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Lock "7e5ec97f-80c4-4499-94bf-2584fc0eae03" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.122s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:23:02 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:23:02 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:23:05 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-cf74327d-0460-49d8-8681-a3fba6677223 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] Acquiring lock "8381c969-6a2d-4934-aadd-660ffa246b05" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:23:05 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-cf74327d-0460-49d8-8681-a3fba6677223 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] Lock "8381c969-6a2d-4934-aadd-660ffa246b05" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:23:05 user nova-compute[74960]: INFO nova.compute.manager [None req-cf74327d-0460-49d8-8681-a3fba6677223 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] [instance: 8381c969-6a2d-4934-aadd-660ffa246b05] Detaching volume 4b85943b-1d18-4267-9329-4318e1923b19
Nov 03 12:23:05 user nova-compute[74960]: INFO nova.virt.block_device [None req-cf74327d-0460-49d8-8681-a3fba6677223 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] [instance: 8381c969-6a2d-4934-aadd-660ffa246b05] Attempting to driver detach volume 4b85943b-1d18-4267-9329-4318e1923b19 from mountpoint /dev/vdb
Nov 03 12:23:05 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-cf74327d-0460-49d8-8681-a3fba6677223 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] Attempting to detach device vdb from instance 8381c969-6a2d-4934-aadd-660ffa246b05 from the persistent domain config. {{(pid=74960) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 03 12:23:05 user nova-compute[74960]: DEBUG nova.virt.libvirt.guest [None req-cf74327d-0460-49d8-8681-a3fba6677223 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 12:23:05 user nova-compute[74960]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 12:23:05 user nova-compute[74960]:   <source dev="/dev/sde"/>
Nov 03 12:23:05 user nova-compute[74960]:   <target dev="vdb" bus="virtio"/>
Nov 03 12:23:05 user nova-compute[74960]:   <serial>4b85943b-1d18-4267-9329-4318e1923b19</serial>
Nov 03 12:23:05 user nova-compute[74960]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 12:23:05 user nova-compute[74960]: </disk>
Nov 03 12:23:05 user nova-compute[74960]:  {{(pid=74960) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 12:23:05 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-cf74327d-0460-49d8-8681-a3fba6677223 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] Successfully detached device vdb from instance 8381c969-6a2d-4934-aadd-660ffa246b05 from the persistent domain config.
Nov 03 12:23:05 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-cf74327d-0460-49d8-8681-a3fba6677223 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8381c969-6a2d-4934-aadd-660ffa246b05 from the live domain config. {{(pid=74960) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 03 12:23:05 user nova-compute[74960]: DEBUG nova.virt.libvirt.guest [None req-cf74327d-0460-49d8-8681-a3fba6677223 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 12:23:05 user nova-compute[74960]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 12:23:05 user nova-compute[74960]:   <source dev="/dev/sde"/>
Nov 03 12:23:05 user nova-compute[74960]:   <target dev="vdb" bus="virtio"/>
Nov 03 12:23:05 user nova-compute[74960]:   <serial>4b85943b-1d18-4267-9329-4318e1923b19</serial>
Nov 03 12:23:05 user nova-compute[74960]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 12:23:05 user nova-compute[74960]: </disk>
Nov 03 12:23:05 user nova-compute[74960]:  {{(pid=74960) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 12:23:06 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-cf74327d-0460-49d8-8681-a3fba6677223 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8381c969-6a2d-4934-aadd-660ffa246b05 {{(pid=74960) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 03 12:23:07 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:23:07 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:23:12 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:23:12 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:23:14 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f90c731-df2b-4ba4-b8b1-a43fe9f84a39 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] Calling os-brick to attach iSCSI Volume {{(pid=74960) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 12:23:14 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f90c731-df2b-4ba4-b8b1-a43fe9f84a39 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9aa420acb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XjKVSQTt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:23:14 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-0f90c731-df2b-4ba4-b8b1-a43fe9f84a39 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:23:14 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-0f90c731-df2b-4ba4-b8b1-a43fe9f84a39 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:23:14 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-0f90c731-df2b-4ba4-b8b1-a43fe9f84a39 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:23:14 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-0f90c731-df2b-4ba4-b8b1-a43fe9f84a39 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:23:14 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-0f90c731-df2b-4ba4-b8b1-a43fe9f84a39 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:23:14 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-0f90c731-df2b-4ba4-b8b1-a43fe9f84a39 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:23:14 user nova-compute[74960]: INFO os_brick.initiator.connectors.iscsi [None req-0f90c731-df2b-4ba4-b8b1-a43fe9f84a39 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 12:23:14 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01 -p 172.16.0.220:3260 {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:23:14 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:23:14 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[32cd132b-73bc-4e9f-b64d-3e4c4c38970c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:23:14 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f90c731-df2b-4ba4-b8b1-a43fe9f84a39 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 12:23:14 user nova-compute[74960]:  {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:23:14 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01 -p 172.16.0.220:3260 --interface default --op new {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:23:14 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:23:14 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[df7b2afc-c9dc-4c8b-9779-d84a49e2e96f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01] added\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:23:14 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f90c731-df2b-4ba4-b8b1-a43fe9f84a39 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01] added
Nov 03 12:23:14 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:23:14 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:23:14 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:23:14 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[791cc9f3-9627-4f60-9f9a-339e7aad5f61]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:23:14 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f90c731-df2b-4ba4-b8b1-a43fe9f84a39 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:23:14 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:23:14 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:23:14 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[e356d5d2-c3e3-447a-aaa0-04410a806011]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:23:14 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f90c731-df2b-4ba4-b8b1-a43fe9f84a39 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:23:14 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XjKVSQTt {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:23:14 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XjKVSQTt" returned: 0 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:23:14 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[51c2febf-ca71-477f-838e-3534926b3323]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:23:14 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f90c731-df2b-4ba4-b8b1-a43fe9f84a39 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XjKVSQTt'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:23:14 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:23:14 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:23:14 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf56c48-0cdf-4438-ae01-f3fec0a664e7]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:23:14 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f90c731-df2b-4ba4-b8b1-a43fe9f84a39 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:23:14 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:23:14 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:23:14 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e00c4cf-2021-4502-a569-406cb74c6712]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19 (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:23:14 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f90c731-df2b-4ba4-b8b1-a43fe9f84a39 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02 (non-flash)
Nov 03 12:23:14 user nova-compute[74960]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19 (non-flash)
Nov 03 12:23:14 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:23:14 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f90c731-df2b-4ba4-b8b1-a43fe9f84a39 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02 (non-flash)
Nov 03 12:23:14 user nova-compute[74960]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19 (non-flash)
Nov 03 12:23:14 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:23:14 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01 -p 172.16.0.220:3260 --login {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:23:14 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:23:14 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ebe407a-0e46-4bba-8353-62f4fda41ae4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:23:14 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f90c731-df2b-4ba4-b8b1-a43fe9f84a39 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01, portal: 172.16.0.220,3260]
Nov 03 12:23:14 user nova-compute[74960]: Login to [iface: default, target: iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01, portal: 172.16.0.220,3260] successful.
Nov 03 12:23:14 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:23:14 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:23:14 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:23:14 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[23cb9c50-44f1-4fc2-a975-4836883f3161]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:23:14 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f90c731-df2b-4ba4-b8b1-a43fe9f84a39 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:23:14 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:23:14 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:23:14 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[95cf6672-6d4e-4873-8e33-2d12d2507a4b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19 (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:23:14 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f90c731-df2b-4ba4-b8b1-a43fe9f84a39 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02 (non-flash)
Nov 03 12:23:14 user nova-compute[74960]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01 (non-flash)
Nov 03 12:23:14 user nova-compute[74960]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19 (non-flash)
Nov 03 12:23:14 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:23:14 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f90c731-df2b-4ba4-b8b1-a43fe9f84a39 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02 (non-flash)
Nov 03 12:23:14 user nova-compute[74960]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01 (non-flash)
Nov 03 12:23:14 user nova-compute[74960]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19 (non-flash)
Nov 03 12:23:14 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:23:14 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-0f90c731-df2b-4ba4-b8b1-a43fe9f84a39 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:23:14 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f90c731-df2b-4ba4-b8b1-a43fe9f84a39 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Connected to 172.16.0.220:3260 {{(pid=74960) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 12:23:14 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-0f90c731-df2b-4ba4-b8b1-a43fe9f84a39 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] HCTL ('33', '-', '-', 0) found on session 11 with lun 0 {{(pid=74960) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 12:23:14 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-0f90c731-df2b-4ba4-b8b1-a43fe9f84a39 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74960) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 12:23:14 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:23:14 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:23:14 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3fb5fbf-f49e-458a-9c2c-83891d69be84]: (4, ('- - 0', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:23:14 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-0f90c731-df2b-4ba4-b8b1-a43fe9f84a39 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Searching for a device in session 11 and hctl ['33', '*', '*', 0] yield: None {{(pid=74960) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 12:23:15 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-0f90c731-df2b-4ba4-b8b1-a43fe9f84a39 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Searching for a device in session 11 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74960) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 12:23:15 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f90c731-df2b-4ba4-b8b1-a43fe9f84a39 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XjKVSQTt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74960) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 12:23:15 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-0f90c731-df2b-4ba4-b8b1-a43fe9f84a39 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.347s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:23:15 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f90c731-df2b-4ba4-b8b1-a43fe9f84a39 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] <== connect_volume: return (1348ms) {'type': 'block', 'scsi_wwn': '26161303966333431', 'path': '/dev/sdb'} {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:23:15 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f90c731-df2b-4ba4-b8b1-a43fe9f84a39 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26161303966333431', 'path': '/dev/sdb'} {{(pid=74960) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 12:23:15 user nova-compute[74960]: DEBUG nova.objects.instance [None req-0f90c731-df2b-4ba4-b8b1-a43fe9f84a39 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Lazy-loading 'flavor' on Instance uuid 6145a30b-809c-4bc5-a45f-c3ff3b170a22 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:23:15 user nova-compute[74960]: DEBUG nova.virt.libvirt.guest [None req-0f90c731-df2b-4ba4-b8b1-a43fe9f84a39 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] attach device xml: <disk type="block" device="disk">
Nov 03 12:23:15 user nova-compute[74960]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 12:23:15 user nova-compute[74960]:   <source dev="/dev/sdb"/>
Nov 03 12:23:15 user nova-compute[74960]:   <target dev="vdb" bus="virtio"/>
Nov 03 12:23:15 user nova-compute[74960]:   <serial>91f59f2a-fb49-4bb7-8249-7c895b43aa01</serial>
Nov 03 12:23:15 user nova-compute[74960]: </disk>
Nov 03 12:23:15 user nova-compute[74960]:  {{(pid=74960) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 03 12:23:16 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-0f90c731-df2b-4ba4-b8b1-a43fe9f84a39 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] No BDM found with device name vda, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:23:16 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-0f90c731-df2b-4ba4-b8b1-a43fe9f84a39 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:23:16 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-0f90c731-df2b-4ba4-b8b1-a43fe9f84a39 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] No VIF found with MAC fa:16:3e:33:a0:07, not building metadata {{(pid=74960) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 12:23:16 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-0f90c731-df2b-4ba4-b8b1-a43fe9f84a39 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Lock "6145a30b-809c-4bc5-a45f-c3ff3b170a22" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 45.369s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:23:17 user nova-compute[74960]: INFO nova.compute.manager [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] Rebuilding instance
Nov 03 12:23:17 user nova-compute[74960]: DEBUG nova.compute.manager [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] Checking state {{(pid=74960) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 12:23:17 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:23:17 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:23:17 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:23:17 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:23:18 user nova-compute[74960]: DEBUG nova.compute.manager [req-dee8c3e2-987b-4543-9924-19d21c9c481c req-e873dc13-ce5f-4f08-a4e7-1412d8aae744 service nova] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] Received event network-vif-unplugged-c54167dd-e416-43bd-8271-dd55e9e71119 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:23:18 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-dee8c3e2-987b-4543-9924-19d21c9c481c req-e873dc13-ce5f-4f08-a4e7-1412d8aae744 service nova] Acquiring lock "6145a30b-809c-4bc5-a45f-c3ff3b170a22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:23:18 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-dee8c3e2-987b-4543-9924-19d21c9c481c req-e873dc13-ce5f-4f08-a4e7-1412d8aae744 service nova] Lock "6145a30b-809c-4bc5-a45f-c3ff3b170a22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:23:18 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-dee8c3e2-987b-4543-9924-19d21c9c481c req-e873dc13-ce5f-4f08-a4e7-1412d8aae744 service nova] Lock "6145a30b-809c-4bc5-a45f-c3ff3b170a22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:23:18 user nova-compute[74960]: DEBUG nova.compute.manager [req-dee8c3e2-987b-4543-9924-19d21c9c481c req-e873dc13-ce5f-4f08-a4e7-1412d8aae744 service nova] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] No waiting events found dispatching network-vif-unplugged-c54167dd-e416-43bd-8271-dd55e9e71119 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:23:18 user nova-compute[74960]: WARNING nova.compute.manager [req-dee8c3e2-987b-4543-9924-19d21c9c481c req-e873dc13-ce5f-4f08-a4e7-1412d8aae744 service nova] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] Received unexpected event network-vif-unplugged-c54167dd-e416-43bd-8271-dd55e9e71119 for instance with vm_state active and task_state rebuilding.
Nov 03 12:23:18 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:23:18 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:23:18 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] Instance destroyed successfully.
Nov 03 12:23:18 user nova-compute[74960]: INFO nova.compute.manager [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] Detaching volume 91f59f2a-fb49-4bb7-8249-7c895b43aa01
Nov 03 12:23:18 user nova-compute[74960]: INFO nova.virt.block_device [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] Attempting to driver detach volume 91f59f2a-fb49-4bb7-8249-7c895b43aa01 from mountpoint /dev/vdb
Nov 03 12:23:18 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Attempting to detach device vdb from instance 6145a30b-809c-4bc5-a45f-c3ff3b170a22 from the persistent domain config. {{(pid=74960) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 03 12:23:18 user nova-compute[74960]: DEBUG nova.virt.libvirt.guest [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 12:23:18 user nova-compute[74960]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 12:23:18 user nova-compute[74960]:   <source dev="/dev/sdb"/>
Nov 03 12:23:18 user nova-compute[74960]:   <target dev="vdb" bus="virtio"/>
Nov 03 12:23:18 user nova-compute[74960]:   <serial>91f59f2a-fb49-4bb7-8249-7c895b43aa01</serial>
Nov 03 12:23:18 user nova-compute[74960]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 12:23:18 user nova-compute[74960]: </disk>
Nov 03 12:23:18 user nova-compute[74960]:  {{(pid=74960) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 12:23:18 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Successfully detached device vdb from instance 6145a30b-809c-4bc5-a45f-c3ff3b170a22 from the persistent domain config.
Nov 03 12:23:18 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] calling os-brick to detach iSCSI Volume {{(pid=74960) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 12:23:18 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9aa420acb0>, {'target_iqn': 'iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XjKVSQTt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:23:18 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 03 12:23:18 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:23:18 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:23:18 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:23:18 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:23:18 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[71d5253d-c87a-47dd-a007-f1b352fa2141]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:23:18 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 12:23:18 user nova-compute[74960]: No targets found.
Nov 03 12:23:18 user nova-compute[74960]: iSNS:
Nov 03 12:23:18 user nova-compute[74960]: No targets found.
Nov 03 12:23:18 user nova-compute[74960]: STATIC:
Nov 03 12:23:18 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19
Nov 03 12:23:18 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:23:18 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:23:18 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02
Nov 03 12:23:18 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:23:18 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:23:18 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01
Nov 03 12:23:18 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:23:18 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:23:18 user nova-compute[74960]: FIRMWARE:
Nov 03 12:23:18 user nova-compute[74960]: No targets found.
Nov 03 12:23:18 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:23:18 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 12:23:18 user nova-compute[74960]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 12:23:18 user nova-compute[74960]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74960) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 12:23:18 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01', 0)] {{(pid=74960) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 12:23:18 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:23:18 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:23:18 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8ab23a1-e052-4087-93d7-b5f95ad8d333]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:23:18 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:23:18 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:23:18 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9e47b76-00a5-4296-957e-d0d730c270c0]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19 (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:23:18 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02 (non-flash)
Nov 03 12:23:18 user nova-compute[74960]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01 (non-flash)
Nov 03 12:23:18 user nova-compute[74960]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19 (non-flash)
Nov 03 12:23:18 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:23:18 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02 (non-flash)
Nov 03 12:23:18 user nova-compute[74960]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01 (non-flash)
Nov 03 12:23:18 user nova-compute[74960]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19 (non-flash)
Nov 03 12:23:18 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:23:18 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9a8c5db520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01'): ({'sdb'}, set())}) {{(pid=74960) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 12:23:19 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Removing single pathed devices sdb {{(pid=74960) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 12:23:19 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:23:19 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:23:19 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e722ac-71ef-4707-bffa-c00eb4f4e343]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:23:19 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:23:19 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:23:19 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7c09c02-a58a-4d3d-a8cd-1ff663218534]: (4, ('ok\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:23:19 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Flushing IO for device /dev/sdb {{(pid=74960) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 12:23:19 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:23:19 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:23:19 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9b19e07-a171-43bf-81a9-0459a0e1c05b]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:23:19 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74960) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 12:23:19 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:23:19 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.125s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:23:19 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[c11c3d71-5b08-40cb-bbb7-0d6702876c65]: (4, ('1', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:23:19 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74960) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 12:23:19 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] SCSI volumes sdb have been removed. {{(pid=74960) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 12:23:19 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01')] {{(pid=74960) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 12:23:19 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:23:19 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:23:19 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[e38a1a65-0687-45c2-94e7-319f6adc799d]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:23:19 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:23:19 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01 -p 172.16.0.220:3260 --logout {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:23:19 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:23:19 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[a40c2814-d946-4c6b-b19a-d974a245f95b]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:23:19 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01, portal: 172.16.0.220,3260]
Nov 03 12:23:19 user nova-compute[74960]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01, portal: 172.16.0.220,3260] successful.
Nov 03 12:23:19 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:23:19 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01 -p 172.16.0.220:3260 --op delete {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:23:19 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:23:19 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[a80925d1-b845-4ed6-b178-acac0b5f6275]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:23:19 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:23:19 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.403s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:23:19 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] <== disconnect_volume: return (406ms) None {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:23:19 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] Disconnected iSCSI Volume {{(pid=74960) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 12:23:20 user nova-compute[74960]: DEBUG nova.compute.manager [req-6ca1f834-f808-4d17-9f01-cf5437e66378 req-bca89853-6d08-42ce-96ef-199b010c37f4 service nova] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] Received event network-vif-plugged-c54167dd-e416-43bd-8271-dd55e9e71119 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:23:20 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-6ca1f834-f808-4d17-9f01-cf5437e66378 req-bca89853-6d08-42ce-96ef-199b010c37f4 service nova] Acquiring lock "6145a30b-809c-4bc5-a45f-c3ff3b170a22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:23:20 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-6ca1f834-f808-4d17-9f01-cf5437e66378 req-bca89853-6d08-42ce-96ef-199b010c37f4 service nova] Lock "6145a30b-809c-4bc5-a45f-c3ff3b170a22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:23:20 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-6ca1f834-f808-4d17-9f01-cf5437e66378 req-bca89853-6d08-42ce-96ef-199b010c37f4 service nova] Lock "6145a30b-809c-4bc5-a45f-c3ff3b170a22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:23:20 user nova-compute[74960]: DEBUG nova.compute.manager [req-6ca1f834-f808-4d17-9f01-cf5437e66378 req-bca89853-6d08-42ce-96ef-199b010c37f4 service nova] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] No waiting events found dispatching network-vif-plugged-c54167dd-e416-43bd-8271-dd55e9e71119 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:23:20 user nova-compute[74960]: WARNING nova.compute.manager [req-6ca1f834-f808-4d17-9f01-cf5437e66378 req-bca89853-6d08-42ce-96ef-199b010c37f4 service nova] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] Received unexpected event network-vif-plugged-c54167dd-e416-43bd-8271-dd55e9e71119 for instance with vm_state active and task_state rebuilding.
Nov 03 12:23:20 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] Instance destroyed successfully.
Nov 03 12:23:20 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:20:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-526247537',display_name='tempest-ServerActionsTestOtherA-server-1132506895',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-526247537',id=12,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDW7yXqa7k+YlhNoUvM+ny045GZm/Yl6hgASx9MMjKwBHiETYCiHL5EomYdUyz7ar/PJwyKpWPD39wbyG7SmL8Cwl0e8vcQuc7g6iuGDa+Ent75sR68D8/uWXXpX0MFRBg==',key_name='tempest-keypair-1690418913',keypairs=<?>,launch_index=0,launched_at=2023-11-03T12:20:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5320673ee4f0422989a3708915375cdb',ramdisk_id='',reservation_id='r-0h3abybt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1651581249',owner_user_name='tempest-ServerActionsTestOtherA-1651581249-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:23:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60d8d224d7204ede84c09433a3d82d0f',uuid=6145a30b-809c-4bc5-a45f-c3ff3b170a22,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c54167dd-e416-43bd-8271-dd55e9e71119", "address": "fa:16:3e:33:a0:07", "network": {"id": "9c5fae09-5df5-45a3-b9cd-7ac3763ba878", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1736223258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5320673ee4f0422989a3708915375cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc54167dd-e4", "ovs_interfaceid": "c54167dd-e416-43bd-8271-dd55e9e71119", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 12:23:20 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Converting VIF {"id": "c54167dd-e416-43bd-8271-dd55e9e71119", "address": "fa:16:3e:33:a0:07", "network": {"id": "9c5fae09-5df5-45a3-b9cd-7ac3763ba878", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1736223258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5320673ee4f0422989a3708915375cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc54167dd-e4", "ovs_interfaceid": "c54167dd-e416-43bd-8271-dd55e9e71119", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:23:20 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:33:a0:07,bridge_name='br-int',has_traffic_filtering=True,id=c54167dd-e416-43bd-8271-dd55e9e71119,network=Network(9c5fae09-5df5-45a3-b9cd-7ac3763ba878),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc54167dd-e4') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:23:20 user nova-compute[74960]: DEBUG os_vif [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:a0:07,bridge_name='br-int',has_traffic_filtering=True,id=c54167dd-e416-43bd-8271-dd55e9e71119,network=Network(9c5fae09-5df5-45a3-b9cd-7ac3763ba878),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc54167dd-e4') {{(pid=74960) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 12:23:20 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:23:20 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc54167dd-e4, bridge=br-int, if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:23:20 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:23:20 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:23:20 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=31dc3f13-0216-4526-ad39-4ade113c9248) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:23:20 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:23:20 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:23:20 user nova-compute[74960]: INFO os_vif [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:a0:07,bridge_name='br-int',has_traffic_filtering=True,id=c54167dd-e416-43bd-8271-dd55e9e71119,network=Network(9c5fae09-5df5-45a3-b9cd-7ac3763ba878),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc54167dd-e4')
Nov 03 12:23:20 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] calling os-brick to detach iSCSI Volume {{(pid=74960) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 12:23:20 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9aa420acb0>, {'target_iqn': 'iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XjKVSQTt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:23:20 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 03 12:23:20 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:23:20 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:23:20 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:23:20 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:23:20 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[8124efc9-f795-4c14-9f86-9d5793fc6c02]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:23:20 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 12:23:20 user nova-compute[74960]: No targets found.
Nov 03 12:23:20 user nova-compute[74960]: iSNS:
Nov 03 12:23:20 user nova-compute[74960]: No targets found.
Nov 03 12:23:20 user nova-compute[74960]: STATIC:
Nov 03 12:23:20 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19
Nov 03 12:23:20 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:23:20 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:23:20 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02
Nov 03 12:23:20 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:23:20 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:23:20 user nova-compute[74960]: FIRMWARE:
Nov 03 12:23:20 user nova-compute[74960]: No targets found.
Nov 03 12:23:20 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:23:20 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 12:23:20 user nova-compute[74960]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 12:23:20 user nova-compute[74960]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74960) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 12:23:20 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01', 0)] {{(pid=74960) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 12:23:20 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:23:20 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:23:20 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[b673108c-7e7e-4d78-9f17-2039c7549a39]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:23:20 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:23:20 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:23:20 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcd52696-8d18-4d97-92f4-4f7e35e3c28e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19 (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:23:20 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02 (non-flash)
Nov 03 12:23:20 user nova-compute[74960]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19 (non-flash)
Nov 03 12:23:20 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:23:20 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02 (non-flash)
Nov 03 12:23:20 user nova-compute[74960]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19 (non-flash)
Nov 03 12:23:20 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:23:20 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9a8c44bac0>, {}) {{(pid=74960) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 12:23:20 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Disconnecting from: [] {{(pid=74960) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 12:23:20 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.081s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:23:20 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] <== disconnect_volume: return (83ms) None {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:23:20 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] Disconnected iSCSI Volume {{(pid=74960) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 12:23:20 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] Deleting instance files /opt/stack/data/nova/instances/6145a30b-809c-4bc5-a45f-c3ff3b170a22_del
Nov 03 12:23:20 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] Deletion of /opt/stack/data/nova/instances/6145a30b-809c-4bc5-a45f-c3ff3b170a22_del complete
Nov 03 12:23:20 user nova-compute[74960]: INFO nova.virt.block_device [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] Booting with volume 91f59f2a-fb49-4bb7-8249-7c895b43aa01 at /dev/vdb
Nov 03 12:23:20 user nova-compute[74960]: DEBUG os_brick.utils [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:23:20 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:23:20 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:23:20 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf25b97a-31f5-4d5e-bd13-1abe95446568]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:75b8e219756\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:23:20 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:23:20 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:23:20 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[83c84819-961c-47f8-8e15-b20228afbf15]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:23:20 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:23:20 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:23:20 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[5697ce83-f2ef-4219-b415-b919b02ca6aa]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:23:20 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[9de2d67a-7c0c-4db2-afc4-ebf1b1bc5dff]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:23:20 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Running cmd (subprocess): nvme version {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:23:20 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] 'nvme version' failed. Not Retrying. {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 12:23:20 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.nvmeof [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] nvme not present on system {{(pid=74960) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 12:23:20 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:23:20 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 12:23:20 user nova-compute[74960]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 12:23:20 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[85c5199d-a775-44e4-a43e-f6f6f7c29c58]: (4, '') {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:23:20 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74960) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 12:23:20 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74960) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 12:23:20 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] LIGHTOS: no hostnqn found. {{(pid=74960) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 12:23:20 user nova-compute[74960]: DEBUG os_brick.utils [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:75b8e219756', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:23:20 user nova-compute[74960]: DEBUG nova.virt.block_device [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] Updating existing volume attachment record: c9fed2f0-ab28-4245-845e-03f8c7b0d1fc {{(pid=74960) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 12:23:22 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:23:25 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:23:26 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-cf74327d-0460-49d8-8681-a3fba6677223 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 8381c969-6a2d-4934-aadd-660ffa246b05 is timed out.
Nov 03 12:23:26 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-cf74327d-0460-49d8-8681-a3fba6677223 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] Successfully detached device vdb from instance 8381c969-6a2d-4934-aadd-660ffa246b05 from the live domain config.
Nov 03 12:23:26 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf74327d-0460-49d8-8681-a3fba6677223 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] [instance: 8381c969-6a2d-4934-aadd-660ffa246b05] calling os-brick to detach iSCSI Volume {{(pid=74960) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 12:23:26 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf74327d-0460-49d8-8681-a3fba6677223 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9aa420acb0>, {'target_iqn': 'iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QPLAizpI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:23:26 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-cf74327d-0460-49d8-8681-a3fba6677223 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:23:26 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-cf74327d-0460-49d8-8681-a3fba6677223 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:23:26 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-cf74327d-0460-49d8-8681-a3fba6677223 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:23:26 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:23:26 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:23:26 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[26f3764a-6ae5-4c22-b429-d129088f3c38]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:23:26 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf74327d-0460-49d8-8681-a3fba6677223 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 12:23:26 user nova-compute[74960]: No targets found.
Nov 03 12:23:26 user nova-compute[74960]: iSNS:
Nov 03 12:23:26 user nova-compute[74960]: No targets found.
Nov 03 12:23:26 user nova-compute[74960]: STATIC:
Nov 03 12:23:26 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19
Nov 03 12:23:26 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:23:26 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:23:26 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02
Nov 03 12:23:26 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:23:26 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:23:26 user nova-compute[74960]: FIRMWARE:
Nov 03 12:23:26 user nova-compute[74960]: No targets found.
Nov 03 12:23:26 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:23:26 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf74327d-0460-49d8-8681-a3fba6677223 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 12:23:26 user nova-compute[74960]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 12:23:26 user nova-compute[74960]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74960) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 12:23:26 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf74327d-0460-49d8-8681-a3fba6677223 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19', 0)] {{(pid=74960) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 12:23:26 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:23:26 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:23:26 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b35d451-b972-4f4a-81b7-341b6eb41bdd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:23:26 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:23:26 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-6c74493b-245f-4908-bad0-11aee606dddc tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Acquiring lock "7e5ec97f-80c4-4499-94bf-2584fc0eae03" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:23:26 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-6c74493b-245f-4908-bad0-11aee606dddc tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Lock "7e5ec97f-80c4-4499-94bf-2584fc0eae03" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:23:26 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-6c74493b-245f-4908-bad0-11aee606dddc tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Acquiring lock "7e5ec97f-80c4-4499-94bf-2584fc0eae03-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:23:26 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-6c74493b-245f-4908-bad0-11aee606dddc tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Lock "7e5ec97f-80c4-4499-94bf-2584fc0eae03-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:23:26 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-6c74493b-245f-4908-bad0-11aee606dddc tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Lock "7e5ec97f-80c4-4499-94bf-2584fc0eae03-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:23:26 user nova-compute[74960]: INFO nova.compute.manager [None req-6c74493b-245f-4908-bad0-11aee606dddc tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Terminating instance
Nov 03 12:23:26 user nova-compute[74960]: DEBUG nova.compute.manager [None req-6c74493b-245f-4908-bad0-11aee606dddc tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Start destroying the instance on the hypervisor. {{(pid=74960) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 12:23:26 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:23:26 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef0ece43-8014-4674-af6e-f61f812a794c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19 (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:23:26 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf74327d-0460-49d8-8681-a3fba6677223 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02 (non-flash)
Nov 03 12:23:26 user nova-compute[74960]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19 (non-flash)
Nov 03 12:23:26 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:23:26 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf74327d-0460-49d8-8681-a3fba6677223 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02 (non-flash)
Nov 03 12:23:26 user nova-compute[74960]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19 (non-flash)
Nov 03 12:23:26 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:23:26 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf74327d-0460-49d8-8681-a3fba6677223 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9ab068e680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19'): ({'sde'}, set())}) {{(pid=74960) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 12:23:26 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-cf74327d-0460-49d8-8681-a3fba6677223 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] Removing single pathed devices sde {{(pid=74960) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 12:23:26 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:23:26 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:23:26 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a934fa2-7166-4891-8fd8-a1cc71d1236f]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:23:26 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:23:26 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.024s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:23:26 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[82dab512-bb9d-4585-bb7d-b3ca8d51a7fb]: (4, ('ok\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:23:26 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-cf74327d-0460-49d8-8681-a3fba6677223 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] Flushing IO for device /dev/sde {{(pid=74960) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 12:23:26 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:23:26 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:23:26 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:23:26 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d3919ea-0f50-460c-9278-ee3de2041f85]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:23:26 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-cf74327d-0460-49d8-8681-a3fba6677223 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74960) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 12:23:26 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:23:26 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:23:26 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.036s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:23:26 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8ad4e07-08d0-4238-ba80-6c4310e8c4bc]: (4, ('1', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:23:26 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-cf74327d-0460-49d8-8681-a3fba6677223 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74960) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 12:23:26 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-cf74327d-0460-49d8-8681-a3fba6677223 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] SCSI volumes sde have been removed. {{(pid=74960) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 12:23:26 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf74327d-0460-49d8-8681-a3fba6677223 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19')] {{(pid=74960) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 12:23:26 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:23:26 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:23:26 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb6535c4-54b5-4fbe-b9db-3f62d3f0882d]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:23:26 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf74327d-0460-49d8-8681-a3fba6677223 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:23:26 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19 -p 172.16.0.220:3260 --logout {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:23:26 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:23:26 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19 -p 172.16.0.220:3260 --logout" returned: 0 in 0.094s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:23:26 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bf324be-cfad-4b0a-9da4-3fef2083e716]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:23:26 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf74327d-0460-49d8-8681-a3fba6677223 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19, portal: 172.16.0.220,3260]
Nov 03 12:23:26 user nova-compute[74960]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19, portal: 172.16.0.220,3260] successful.
Nov 03 12:23:26 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:23:26 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19 -p 172.16.0.220:3260 --op delete {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:23:26 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b85943b-1d18-4267-9329-4318e1923b19 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:23:26 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[7117462d-d234-4ff3-b254-e818791e463a]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:23:26 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf74327d-0460-49d8-8681-a3fba6677223 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:23:26 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-cf74327d-0460-49d8-8681-a3fba6677223 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.374s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:23:26 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf74327d-0460-49d8-8681-a3fba6677223 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] <== disconnect_volume: return (375ms) None {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:23:26 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf74327d-0460-49d8-8681-a3fba6677223 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] [instance: 8381c969-6a2d-4934-aadd-660ffa246b05] Disconnected iSCSI Volume {{(pid=74960) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 12:23:26 user nova-compute[74960]: DEBUG nova.compute.manager [req-9b4ced3e-8ecc-49ba-9a90-8d4caf4d5bf3 req-82176ab2-434d-4dce-addb-db3410bdcc25 service nova] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Received event network-vif-unplugged-e91b8148-e2ff-4124-9799-ba4efae837ff {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:23:26 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-9b4ced3e-8ecc-49ba-9a90-8d4caf4d5bf3 req-82176ab2-434d-4dce-addb-db3410bdcc25 service nova] Acquiring lock "7e5ec97f-80c4-4499-94bf-2584fc0eae03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:23:26 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-9b4ced3e-8ecc-49ba-9a90-8d4caf4d5bf3 req-82176ab2-434d-4dce-addb-db3410bdcc25 service nova] Lock "7e5ec97f-80c4-4499-94bf-2584fc0eae03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:23:26 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-9b4ced3e-8ecc-49ba-9a90-8d4caf4d5bf3 req-82176ab2-434d-4dce-addb-db3410bdcc25 service nova] Lock "7e5ec97f-80c4-4499-94bf-2584fc0eae03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:23:26 user nova-compute[74960]: DEBUG nova.compute.manager [req-9b4ced3e-8ecc-49ba-9a90-8d4caf4d5bf3 req-82176ab2-434d-4dce-addb-db3410bdcc25 service nova] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] No waiting events found dispatching network-vif-unplugged-e91b8148-e2ff-4124-9799-ba4efae837ff {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:23:26 user nova-compute[74960]: DEBUG nova.compute.manager [req-9b4ced3e-8ecc-49ba-9a90-8d4caf4d5bf3 req-82176ab2-434d-4dce-addb-db3410bdcc25 service nova] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Received event network-vif-unplugged-e91b8148-e2ff-4124-9799-ba4efae837ff for instance with task_state deleting. {{(pid=74960) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 12:23:26 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:23:26 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Instance destroyed successfully.
Nov 03 12:23:26 user nova-compute[74960]: DEBUG nova.objects.instance [None req-6c74493b-245f-4908-bad0-11aee606dddc tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Lazy-loading 'resources' on Instance uuid 7e5ec97f-80c4-4499-94bf-2584fc0eae03 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:23:26 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-6c74493b-245f-4908-bad0-11aee606dddc tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-03T12:16:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1395691218',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1395691218',id=2,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBORt24KiW0SvTfIC0cB1xZzGZhRsfKuon1UNTHIJ3rRPiaZtETCLFnldW9E15ZppsL+VgujOvzTcrAMfw0cF0wSfKUfWVBhncCb8D3gHhw/5cFu8NPOkNxszgCJRdkKvEg==',key_name='tempest-keypair-1234685962',keypairs=<?>,launch_index=0,launched_at=2023-11-03T12:21:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c216dd7629274eafbf0a5968ff2378a9',ramdisk_id='',reservation_id='r-36b8brxz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-258463843',owner_user_name='tempest-AttachVolumeShelveTestJSON-258463843-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T12:21:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fae69462930546bdb9cf6e2a11a0df2a',uuid=7e5ec97f-80c4-4499-94bf-2584fc0eae03,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e91b8148-e2ff-4124-9799-ba4efae837ff", "address": "fa:16:3e:40:35:d4", "network": {"id": "c03e854d-75a3-4e81-9cdf-f1139841266c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1632999031-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c216dd7629274eafbf0a5968ff2378a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape91b8148-e2", "ovs_interfaceid": "e91b8148-e2ff-4124-9799-ba4efae837ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 12:23:26 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-6c74493b-245f-4908-bad0-11aee606dddc tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Converting VIF {"id": "e91b8148-e2ff-4124-9799-ba4efae837ff", "address": "fa:16:3e:40:35:d4", "network": {"id": "c03e854d-75a3-4e81-9cdf-f1139841266c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1632999031-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c216dd7629274eafbf0a5968ff2378a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape91b8148-e2", "ovs_interfaceid": "e91b8148-e2ff-4124-9799-ba4efae837ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:23:26 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-6c74493b-245f-4908-bad0-11aee606dddc tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:35:d4,bridge_name='br-int',has_traffic_filtering=True,id=e91b8148-e2ff-4124-9799-ba4efae837ff,network=Network(c03e854d-75a3-4e81-9cdf-f1139841266c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape91b8148-e2') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:23:26 user nova-compute[74960]: DEBUG os_vif [None req-6c74493b-245f-4908-bad0-11aee606dddc tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:35:d4,bridge_name='br-int',has_traffic_filtering=True,id=e91b8148-e2ff-4124-9799-ba4efae837ff,network=Network(c03e854d-75a3-4e81-9cdf-f1139841266c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape91b8148-e2') {{(pid=74960) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 12:23:26 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:23:26 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape91b8148-e2, bridge=br-int, if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:23:26 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:23:26 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:23:27 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:23:27 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=eca94b45-08bf-4a77-a55b-2ad0b19c90ba) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:23:27 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:23:27 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:23:27 user nova-compute[74960]: INFO os_vif [None req-6c74493b-245f-4908-bad0-11aee606dddc tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:35:d4,bridge_name='br-int',has_traffic_filtering=True,id=e91b8148-e2ff-4124-9799-ba4efae837ff,network=Network(c03e854d-75a3-4e81-9cdf-f1139841266c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape91b8148-e2')
Nov 03 12:23:27 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-6c74493b-245f-4908-bad0-11aee606dddc tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Deleting instance files /opt/stack/data/nova/instances/7e5ec97f-80c4-4499-94bf-2584fc0eae03_del
Nov 03 12:23:27 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-6c74493b-245f-4908-bad0-11aee606dddc tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Deletion of /opt/stack/data/nova/instances/7e5ec97f-80c4-4499-94bf-2584fc0eae03_del complete
Nov 03 12:23:27 user nova-compute[74960]: INFO nova.compute.manager [None req-6c74493b-245f-4908-bad0-11aee606dddc tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 03 12:23:27 user nova-compute[74960]: DEBUG oslo.service.loopingcall [None req-6c74493b-245f-4908-bad0-11aee606dddc tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74960) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 12:23:27 user nova-compute[74960]: DEBUG nova.compute.manager [-] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Deallocating network for instance {{(pid=74960) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 12:23:27 user nova-compute[74960]: DEBUG nova.network.neutron [-] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] deallocate_for_instance() {{(pid=74960) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 12:23:27 user nova-compute[74960]: DEBUG nova.objects.instance [None req-cf74327d-0460-49d8-8681-a3fba6677223 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] Lazy-loading 'flavor' on Instance uuid 8381c969-6a2d-4934-aadd-660ffa246b05 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:23:27 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-cf74327d-0460-49d8-8681-a3fba6677223 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] Lock "8381c969-6a2d-4934-aadd-660ffa246b05" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.026s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:23:27 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:23:27 user nova-compute[74960]: DEBUG nova.network.neutron [-] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Updating instance_info_cache with network_info: [] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:23:27 user nova-compute[74960]: INFO nova.compute.manager [-] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Took 0.82 seconds to deallocate network for instance.
Nov 03 12:23:27 user nova-compute[74960]: DEBUG nova.compute.manager [req-886950ab-6a17-491c-b46d-7fbd4653ba28 req-27b29b31-189c-4854-8cb5-8b861ff52b9c service nova] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Received event network-vif-deleted-e91b8148-e2ff-4124-9799-ba4efae837ff {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:23:27 user nova-compute[74960]: INFO nova.compute.manager [req-886950ab-6a17-491c-b46d-7fbd4653ba28 req-27b29b31-189c-4854-8cb5-8b861ff52b9c service nova] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Neutron deleted interface e91b8148-e2ff-4124-9799-ba4efae837ff; detaching it from the instance and deleting it from the info cache
Nov 03 12:23:27 user nova-compute[74960]: DEBUG nova.network.neutron [req-886950ab-6a17-491c-b46d-7fbd4653ba28 req-27b29b31-189c-4854-8cb5-8b861ff52b9c service nova] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Updating instance_info_cache with network_info: [] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:23:27 user nova-compute[74960]: DEBUG nova.compute.manager [req-886950ab-6a17-491c-b46d-7fbd4653ba28 req-27b29b31-189c-4854-8cb5-8b861ff52b9c service nova] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Detach interface failed, port_id=e91b8148-e2ff-4124-9799-ba4efae837ff, reason: Instance 7e5ec97f-80c4-4499-94bf-2584fc0eae03 could not be found. {{(pid=74960) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 03 12:23:27 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-6c74493b-245f-4908-bad0-11aee606dddc tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:23:27 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-6c74493b-245f-4908-bad0-11aee606dddc tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:23:28 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-6c74493b-245f-4908-bad0-11aee606dddc tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:23:28 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-6c74493b-245f-4908-bad0-11aee606dddc tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:23:28 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-6c74493b-245f-4908-bad0-11aee606dddc tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.467s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:23:28 user nova-compute[74960]: INFO nova.scheduler.client.report [None req-6c74493b-245f-4908-bad0-11aee606dddc tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Deleted allocations for instance 7e5ec97f-80c4-4499-94bf-2584fc0eae03
Nov 03 12:23:28 user nova-compute[74960]: DEBUG nova.compute.manager [req-88b6f11e-279d-4578-816d-c1019913ad68 req-f052a0c4-c4e2-4d9b-84fc-9c588c330b3d service nova] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Received event network-vif-plugged-e91b8148-e2ff-4124-9799-ba4efae837ff {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:23:28 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-88b6f11e-279d-4578-816d-c1019913ad68 req-f052a0c4-c4e2-4d9b-84fc-9c588c330b3d service nova] Acquiring lock "7e5ec97f-80c4-4499-94bf-2584fc0eae03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:23:28 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-88b6f11e-279d-4578-816d-c1019913ad68 req-f052a0c4-c4e2-4d9b-84fc-9c588c330b3d service nova] Lock "7e5ec97f-80c4-4499-94bf-2584fc0eae03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:23:28 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-88b6f11e-279d-4578-816d-c1019913ad68 req-f052a0c4-c4e2-4d9b-84fc-9c588c330b3d service nova] Lock "7e5ec97f-80c4-4499-94bf-2584fc0eae03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:23:28 user nova-compute[74960]: DEBUG nova.compute.manager [req-88b6f11e-279d-4578-816d-c1019913ad68 req-f052a0c4-c4e2-4d9b-84fc-9c588c330b3d service nova] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] No waiting events found dispatching network-vif-plugged-e91b8148-e2ff-4124-9799-ba4efae837ff {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:23:28 user nova-compute[74960]: WARNING nova.compute.manager [req-88b6f11e-279d-4578-816d-c1019913ad68 req-f052a0c4-c4e2-4d9b-84fc-9c588c330b3d service nova] [instance: 7e5ec97f-80c4-4499-94bf-2584fc0eae03] Received unexpected event network-vif-plugged-e91b8148-e2ff-4124-9799-ba4efae837ff for instance with vm_state deleted and task_state None.
Nov 03 12:23:28 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-6c74493b-245f-4908-bad0-11aee606dddc tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Lock "7e5ec97f-80c4-4499-94bf-2584fc0eae03" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.435s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:23:32 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:23:32 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:23:34 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._sync_power_states {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:23:34 user nova-compute[74960]: WARNING nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] While synchronizing instance power states, found 9 instances in the database and 8 instances on the hypervisor.
Nov 03 12:23:34 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Triggering sync for uuid 7769e3c5-136f-4282-8e3e-224e3a80922c {{(pid=74960) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 12:23:34 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Triggering sync for uuid e91dfcf4-caef-43d0-a56b-b1282363d4e0 {{(pid=74960) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 12:23:34 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Triggering sync for uuid 8381c969-6a2d-4934-aadd-660ffa246b05 {{(pid=74960) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 12:23:34 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Triggering sync for uuid 05956d9b-0646-43d2-a4cd-19e9090020ee {{(pid=74960) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 12:23:34 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Triggering sync for uuid 6145a30b-809c-4bc5-a45f-c3ff3b170a22 {{(pid=74960) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 12:23:34 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Triggering sync for uuid fffd1dd7-b8e8-435c-bdfe-6c5001b21daf {{(pid=74960) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 12:23:34 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Triggering sync for uuid f009a400-0576-48a9-82e0-60de8935c498 {{(pid=74960) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 12:23:34 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Triggering sync for uuid 9951fab7-4984-408e-94ca-11eab615ff25 {{(pid=74960) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 12:23:34 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Triggering sync for uuid d5c87482-1883-43dc-8872-6a5dff128c94 {{(pid=74960) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 12:23:34 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "7769e3c5-136f-4282-8e3e-224e3a80922c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:23:34 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "7769e3c5-136f-4282-8e3e-224e3a80922c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:23:34 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "e91dfcf4-caef-43d0-a56b-b1282363d4e0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:23:34 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "e91dfcf4-caef-43d0-a56b-b1282363d4e0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:23:34 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "8381c969-6a2d-4934-aadd-660ffa246b05" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:23:34 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "8381c969-6a2d-4934-aadd-660ffa246b05" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:23:34 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "05956d9b-0646-43d2-a4cd-19e9090020ee" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:23:34 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "05956d9b-0646-43d2-a4cd-19e9090020ee" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:23:34 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "6145a30b-809c-4bc5-a45f-c3ff3b170a22" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:23:34 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "6145a30b-809c-4bc5-a45f-c3ff3b170a22" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:23:34 user nova-compute[74960]: INFO nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] During sync_power_state the instance has a pending task (rebuild_block_device_mapping). Skip.
Nov 03 12:23:34 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "6145a30b-809c-4bc5-a45f-c3ff3b170a22" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:23:34 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "fffd1dd7-b8e8-435c-bdfe-6c5001b21daf" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:23:34 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "fffd1dd7-b8e8-435c-bdfe-6c5001b21daf" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:23:34 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "f009a400-0576-48a9-82e0-60de8935c498" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:23:34 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "f009a400-0576-48a9-82e0-60de8935c498" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:23:34 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "9951fab7-4984-408e-94ca-11eab615ff25" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:23:34 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "9951fab7-4984-408e-94ca-11eab615ff25" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:23:34 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "d5c87482-1883-43dc-8872-6a5dff128c94" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:23:34 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "d5c87482-1883-43dc-8872-6a5dff128c94" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:23:34 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "7769e3c5-136f-4282-8e3e-224e3a80922c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.086s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:23:34 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "05956d9b-0646-43d2-a4cd-19e9090020ee" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.107s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:23:34 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "9951fab7-4984-408e-94ca-11eab615ff25" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.109s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:23:34 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "e91dfcf4-caef-43d0-a56b-b1282363d4e0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.135s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:23:35 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "8381c969-6a2d-4934-aadd-660ffa246b05" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.141s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:23:35 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "fffd1dd7-b8e8-435c-bdfe-6c5001b21daf" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.139s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:23:35 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "f009a400-0576-48a9-82e0-60de8935c498" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.148s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:23:35 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "d5c87482-1883-43dc-8872-6a5dff128c94" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.154s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:23:37 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:23:38 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:23:39 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:23:41 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:23:42 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:23:42 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:23:42 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] Creating instance directory {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 12:23:42 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] Creating image(s)
Nov 03 12:23:42 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Acquiring lock "/opt/stack/data/nova/instances/6145a30b-809c-4bc5-a45f-c3ff3b170a22/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:23:42 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Lock "/opt/stack/data/nova/instances/6145a30b-809c-4bc5-a45f-c3ff3b170a22/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:23:42 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Lock "/opt/stack/data/nova/instances/6145a30b-809c-4bc5-a45f-c3ff3b170a22/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:23:42 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:23:42 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.265s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:23:42 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Acquiring lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:23:42 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:23:42 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:23:43 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.180s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:23:43 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910,backing_fmt=raw /opt/stack/data/nova/instances/6145a30b-809c-4bc5-a45f-c3ff3b170a22/disk 1073741824 {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:23:43 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910,backing_fmt=raw /opt/stack/data/nova/instances/6145a30b-809c-4bc5-a45f-c3ff3b170a22/disk 1073741824" returned: 0 in 0.062s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:23:43 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:23:43 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:23:43 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.180s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:23:43 user nova-compute[74960]: DEBUG nova.virt.disk.api [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6145a30b-809c-4bc5-a45f-c3ff3b170a22/disk. size=1073741824 {{(pid=74960) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 12:23:43 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6145a30b-809c-4bc5-a45f-c3ff3b170a22/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:23:43 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6145a30b-809c-4bc5-a45f-c3ff3b170a22/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:23:43 user nova-compute[74960]: DEBUG nova.virt.disk.api [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Cannot resize image /opt/stack/data/nova/instances/6145a30b-809c-4bc5-a45f-c3ff3b170a22/disk to a smaller size. {{(pid=74960) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 12:23:43 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] Created local disks {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 12:23:43 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] Ensure instance console log exists: /opt/stack/data/nova/instances/6145a30b-809c-4bc5-a45f-c3ff3b170a22/console.log {{(pid=74960) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 12:23:43 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:23:43 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:23:43 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:23:43 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] Start _get_guest_xml network_info=[{"id": "c54167dd-e416-43bd-8271-dd55e9e71119", "address": "fa:16:3e:33:a0:07", "network": {"id": "9c5fae09-5df5-45a3-b9cd-7ac3763ba878", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1736223258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5320673ee4f0422989a3708915375cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc54167dd-e4", "ovs_interfaceid": "c54167dd-e416-43bd-8271-dd55e9e71119", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=549f51ba-ac69-494b-8de1-34635aa2d7cf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='63ee9c80c632442fb0379f47b784bd20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T12:13:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'image_id': '549f51ba-ac69-494b-8de1-34635aa2d7cf'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XjKVSQTt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6145a30b-809c-4bc5-a45f-c3ff3b170a22', 'attached_at': '', 'detached_at': '', 'volume_id': '91f59f2a-fb49-4bb7-8249-7c895b43aa01', 'serial': '91f59f2a-fb49-4bb7-8249-7c895b43aa01'}, 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'attachment_id': 'c9fed2f0-ab28-4245-845e-03f8c7b0d1fc', 'boot_index': None, 'guest_format': None, 'volume_type': None} {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 12:23:43 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 03 12:23:43 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 03 12:23:43 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 12:23:43 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] CPU controller missing on host. {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 12:23:43 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 12:23:43 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] CPU controller found on host. {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 12:23:43 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74960) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 12:23:43 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=549f51ba-ac69-494b-8de1-34635aa2d7cf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='63ee9c80c632442fb0379f47b784bd20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T12:13:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 12:23:43 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Flavor limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 12:23:43 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Image limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 12:23:43 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Flavor pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 12:23:43 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Image pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 12:23:43 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 12:23:43 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 12:23:43 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 12:23:43 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Got 1 possible topologies {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 12:23:43 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 12:23:43 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 12:23:43 user nova-compute[74960]: DEBUG nova.objects.instance [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6145a30b-809c-4bc5-a45f-c3ff3b170a22 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:23:43 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] Calling os-brick to attach iSCSI Volume {{(pid=74960) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 12:23:43 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9aa420acb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XjKVSQTt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:23:43 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 03 12:23:43 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:23:43 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:23:43 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 03 12:23:43 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:23:43 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:23:43 user nova-compute[74960]: INFO os_brick.initiator.connectors.iscsi [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 12:23:43 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01 -p 172.16.0.220:3260 {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:23:43 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:23:43 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3a498aa-0f99-44df-a32e-5720bb7e259a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:23:43 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 12:23:43 user nova-compute[74960]:  {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:23:43 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01 -p 172.16.0.220:3260 --interface default --op new {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:23:43 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:23:43 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[39ba7429-337c-469d-abdd-bfc39cd1caa7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01] added\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:23:43 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01] added
Nov 03 12:23:43 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:23:43 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:23:43 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:23:43 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef940b0-9557-4ac4-91c2-7ef879cf86e7]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:23:43 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:23:43 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:23:43 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:23:43 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[457dd3e0-153c-408b-94d2-75ace71ed577]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:23:43 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:23:43 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XjKVSQTt {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:23:43 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XjKVSQTt" returned: 0 in 0.023s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:23:43 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9a10b80-fd53-4d93-a6d0-478ae159d801]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:23:43 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XjKVSQTt'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:23:43 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:23:43 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:23:43 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[164fb11a-6963-42d6-83bd-22913ba66632]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:23:43 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:23:43 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:23:43 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:23:43 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[59194742-7819-4362-a791-a7f5e32dd8ae]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02 (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:23:43 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02 (non-flash)
Nov 03 12:23:43 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:23:43 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02 (non-flash)
Nov 03 12:23:43 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:23:43 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01 -p 172.16.0.220:3260 --login {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:23:43 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:23:43 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfdc716e-fb92-44fa-bd0a-09a2add5cf4f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:23:43 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01, portal: 172.16.0.220,3260]
Nov 03 12:23:43 user nova-compute[74960]: Login to [iface: default, target: iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01, portal: 172.16.0.220,3260] successful.
Nov 03 12:23:43 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:23:43 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:23:43 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:23:43 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[7862f661-0d06-45dd-96b1-3979cec95486]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:23:43 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:23:43 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:23:43 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:23:43 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[731de608-26bf-48be-835e-74af3dc7e3a6]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01 (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:23:43 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02 (non-flash)
Nov 03 12:23:43 user nova-compute[74960]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01 (non-flash)
Nov 03 12:23:43 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:23:43 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02 (non-flash)
Nov 03 12:23:43 user nova-compute[74960]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01 (non-flash)
Nov 03 12:23:43 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:23:43 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:23:43 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Connected to 172.16.0.220:3260 {{(pid=74960) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 12:23:43 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] HCTL ('33', '-', '-', 0) found on session 12 with lun 0 {{(pid=74960) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 12:23:43 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74960) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 12:23:43 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:23:44 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:23:44 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[85b36e8e-b9fa-4f7a-bd2f-8275edcb6c2c]: (4, ('- - 0', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:23:44 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Searching for a device in session 12 and hctl ['33', '*', '*', 0] yield: None {{(pid=74960) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 12:23:44 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Acquiring lock "db88322f-c2ad-4622-9a1a-c45439d875a8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:23:44 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Lock "db88322f-c2ad-4622-9a1a-c45439d875a8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:23:44 user nova-compute[74960]: DEBUG nova.compute.manager [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Starting instance... {{(pid=74960) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 12:23:44 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:23:44 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:23:44 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74960) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 12:23:44 user nova-compute[74960]: INFO nova.compute.claims [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Claim successful on node user
Nov 03 12:23:44 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:23:44 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Starting heal instance info cache {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 12:23:44 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Rebuilding the list of instances to heal {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 03 12:23:44 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "refresh_cache-7769e3c5-136f-4282-8e3e-224e3a80922c" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:23:44 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquired lock "refresh_cache-7769e3c5-136f-4282-8e3e-224e3a80922c" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:23:44 user nova-compute[74960]: DEBUG nova.network.neutron [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: 7769e3c5-136f-4282-8e3e-224e3a80922c] Forcefully refreshing network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 12:23:44 user nova-compute[74960]: DEBUG nova.objects.instance [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lazy-loading 'info_cache' on Instance uuid 7769e3c5-136f-4282-8e3e-224e3a80922c {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:23:44 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:23:44 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:23:44 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.600s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:23:44 user nova-compute[74960]: DEBUG nova.compute.manager [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Start building networks asynchronously for instance. {{(pid=74960) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 12:23:45 user nova-compute[74960]: DEBUG nova.compute.manager [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Allocating IP information in the background. {{(pid=74960) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 12:23:45 user nova-compute[74960]: DEBUG nova.network.neutron [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] allocate_for_instance() {{(pid=74960) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 12:23:45 user nova-compute[74960]: DEBUG nova.network.neutron [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: 7769e3c5-136f-4282-8e3e-224e3a80922c] Updating instance_info_cache with network_info: [{"id": "8fe46c5c-9093-43c4-8b0d-baf325c2e18b", "address": "fa:16:3e:ba:d5:3a", "network": {"id": "9c5fae09-5df5-45a3-b9cd-7ac3763ba878", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1736223258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5320673ee4f0422989a3708915375cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fe46c5c-90", "ovs_interfaceid": "8fe46c5c-9093-43c4-8b0d-baf325c2e18b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:23:45 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Searching for a device in session 12 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74960) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 12:23:45 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XjKVSQTt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74960) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 12:23:45 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:23:45 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] <== connect_volume: return (1334ms) {'type': 'block', 'scsi_wwn': '26161303966333431', 'path': '/dev/sdb'} {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:23:45 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26161303966333431', 'path': '/dev/sdb'} {{(pid=74960) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 12:23:45 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 12:23:45 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Releasing lock "refresh_cache-7769e3c5-136f-4282-8e3e-224e3a80922c" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:23:45 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: 7769e3c5-136f-4282-8e3e-224e3a80922c] Updated the network info_cache for instance {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 12:23:45 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:23:45 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-03T12:20:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-526247537',display_name='tempest-ServerActionsTestOtherA-server-1132506895',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-526247537',id=12,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDW7yXqa7k+YlhNoUvM+ny045GZm/Yl6hgASx9MMjKwBHiETYCiHL5EomYdUyz7ar/PJwyKpWPD39wbyG7SmL8Cwl0e8vcQuc7g6iuGDa+Ent75sR68D8/uWXXpX0MFRBg==',key_name='tempest-keypair-1690418913',keypairs=<?>,launch_index=0,launched_at=2023-11-03T12:20:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5320673ee4f0422989a3708915375cdb',ramdisk_id='',reservation_id='r-0h3abybt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1651581249',owner_user_name='tempest-ServerActionsTestOtherA-1651581249-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:23:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60d8d224d7204ede84c09433a3d82d0f',uuid=6145a30b-809c-4bc5-a45f-c3ff3b170a22,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c54167dd-e416-43bd-8271-dd55e9e71119", "address": "fa:16:3e:33:a0:07", "network": {"id": "9c5fae09-5df5-45a3-b9cd-7ac3763ba878", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1736223258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5320673ee4f0422989a3708915375cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc54167dd-e4", "ovs_interfaceid": "c54167dd-e416-43bd-8271-dd55e9e71119", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74960) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 12:23:45 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Converting VIF {"id": "c54167dd-e416-43bd-8271-dd55e9e71119", "address": "fa:16:3e:33:a0:07", "network": {"id": "9c5fae09-5df5-45a3-b9cd-7ac3763ba878", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1736223258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5320673ee4f0422989a3708915375cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc54167dd-e4", "ovs_interfaceid": "c54167dd-e416-43bd-8271-dd55e9e71119", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:23:45 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:33:a0:07,bridge_name='br-int',has_traffic_filtering=True,id=c54167dd-e416-43bd-8271-dd55e9e71119,network=Network(9c5fae09-5df5-45a3-b9cd-7ac3763ba878),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc54167dd-e4') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:23:45 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] End _get_guest_xml xml=<domain type="kvm">
Nov 03 12:23:45 user nova-compute[74960]:   <uuid>6145a30b-809c-4bc5-a45f-c3ff3b170a22</uuid>
Nov 03 12:23:45 user nova-compute[74960]:   <name>instance-0000000c</name>
Nov 03 12:23:45 user nova-compute[74960]:   <memory>524288</memory>
Nov 03 12:23:45 user nova-compute[74960]:   <vcpu>1</vcpu>
Nov 03 12:23:45 user nova-compute[74960]:   <metadata>
Nov 03 12:23:45 user nova-compute[74960]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 12:23:45 user nova-compute[74960]:       <nova:package version="0.0.0"/>
Nov 03 12:23:45 user nova-compute[74960]:       <nova:name>tempest-ServerActionsTestOtherA-server-1132506895</nova:name>
Nov 03 12:23:45 user nova-compute[74960]:       <nova:creationTime>2023-11-03 12:23:43</nova:creationTime>
Nov 03 12:23:45 user nova-compute[74960]:       <nova:flavor name="m1.tiny">
Nov 03 12:23:45 user nova-compute[74960]:         <nova:memory>512</nova:memory>
Nov 03 12:23:45 user nova-compute[74960]:         <nova:disk>1</nova:disk>
Nov 03 12:23:45 user nova-compute[74960]:         <nova:swap>0</nova:swap>
Nov 03 12:23:45 user nova-compute[74960]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 12:23:45 user nova-compute[74960]:         <nova:vcpus>1</nova:vcpus>
Nov 03 12:23:45 user nova-compute[74960]:       </nova:flavor>
Nov 03 12:23:45 user nova-compute[74960]:       <nova:owner>
Nov 03 12:23:45 user nova-compute[74960]:         <nova:user uuid="60d8d224d7204ede84c09433a3d82d0f">tempest-ServerActionsTestOtherA-1651581249-project-member</nova:user>
Nov 03 12:23:45 user nova-compute[74960]:         <nova:project uuid="5320673ee4f0422989a3708915375cdb">tempest-ServerActionsTestOtherA-1651581249</nova:project>
Nov 03 12:23:45 user nova-compute[74960]:       </nova:owner>
Nov 03 12:23:45 user nova-compute[74960]:       <nova:root type="image" uuid="549f51ba-ac69-494b-8de1-34635aa2d7cf"/>
Nov 03 12:23:45 user nova-compute[74960]:       <nova:ports>
Nov 03 12:23:45 user nova-compute[74960]:         <nova:port uuid="c54167dd-e416-43bd-8271-dd55e9e71119">
Nov 03 12:23:45 user nova-compute[74960]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 03 12:23:45 user nova-compute[74960]:         </nova:port>
Nov 03 12:23:45 user nova-compute[74960]:       </nova:ports>
Nov 03 12:23:45 user nova-compute[74960]:     </nova:instance>
Nov 03 12:23:45 user nova-compute[74960]:   </metadata>
Nov 03 12:23:45 user nova-compute[74960]:   <sysinfo type="smbios">
Nov 03 12:23:45 user nova-compute[74960]:     <system>
Nov 03 12:23:45 user nova-compute[74960]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 12:23:45 user nova-compute[74960]:       <entry name="product">OpenStack Nova</entry>
Nov 03 12:23:45 user nova-compute[74960]:       <entry name="version">0.0.0</entry>
Nov 03 12:23:45 user nova-compute[74960]:       <entry name="serial">6145a30b-809c-4bc5-a45f-c3ff3b170a22</entry>
Nov 03 12:23:45 user nova-compute[74960]:       <entry name="uuid">6145a30b-809c-4bc5-a45f-c3ff3b170a22</entry>
Nov 03 12:23:45 user nova-compute[74960]:       <entry name="family">Virtual Machine</entry>
Nov 03 12:23:45 user nova-compute[74960]:     </system>
Nov 03 12:23:45 user nova-compute[74960]:   </sysinfo>
Nov 03 12:23:45 user nova-compute[74960]:   <os>
Nov 03 12:23:45 user nova-compute[74960]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 12:23:45 user nova-compute[74960]:     <boot dev="hd"/>
Nov 03 12:23:45 user nova-compute[74960]:     <smbios mode="sysinfo"/>
Nov 03 12:23:45 user nova-compute[74960]:   </os>
Nov 03 12:23:45 user nova-compute[74960]:   <features>
Nov 03 12:23:45 user nova-compute[74960]:     <acpi/>
Nov 03 12:23:45 user nova-compute[74960]:     <apic/>
Nov 03 12:23:45 user nova-compute[74960]:     <vmcoreinfo/>
Nov 03 12:23:45 user nova-compute[74960]:   </features>
Nov 03 12:23:45 user nova-compute[74960]:   <clock offset="utc">
Nov 03 12:23:45 user nova-compute[74960]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 12:23:45 user nova-compute[74960]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 12:23:45 user nova-compute[74960]:     <timer name="hpet" present="no"/>
Nov 03 12:23:45 user nova-compute[74960]:   </clock>
Nov 03 12:23:45 user nova-compute[74960]:   <cpu mode="custom" match="exact">
Nov 03 12:23:45 user nova-compute[74960]:     <model>Nehalem</model>
Nov 03 12:23:45 user nova-compute[74960]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 12:23:45 user nova-compute[74960]:   </cpu>
Nov 03 12:23:45 user nova-compute[74960]:   <devices>
Nov 03 12:23:45 user nova-compute[74960]:     <disk type="file" device="disk">
Nov 03 12:23:45 user nova-compute[74960]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 12:23:45 user nova-compute[74960]:       <source file="/opt/stack/data/nova/instances/6145a30b-809c-4bc5-a45f-c3ff3b170a22/disk"/>
Nov 03 12:23:45 user nova-compute[74960]:       <target dev="vda" bus="virtio"/>
Nov 03 12:23:45 user nova-compute[74960]:     </disk>
Nov 03 12:23:45 user nova-compute[74960]:     <disk type="block" device="disk">
Nov 03 12:23:45 user nova-compute[74960]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 12:23:45 user nova-compute[74960]:       <source dev="/dev/sdb"/>
Nov 03 12:23:45 user nova-compute[74960]:       <target dev="vdb" bus="virtio"/>
Nov 03 12:23:45 user nova-compute[74960]:       <serial>91f59f2a-fb49-4bb7-8249-7c895b43aa01</serial>
Nov 03 12:23:45 user nova-compute[74960]:     </disk>
Nov 03 12:23:45 user nova-compute[74960]:     <interface type="ethernet">
Nov 03 12:23:45 user nova-compute[74960]:       <mac address="fa:16:3e:33:a0:07"/>
Nov 03 12:23:45 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:23:45 user nova-compute[74960]:       <mtu size="1442"/>
Nov 03 12:23:45 user nova-compute[74960]:       <target dev="tapc54167dd-e4"/>
Nov 03 12:23:45 user nova-compute[74960]:     </interface>
Nov 03 12:23:45 user nova-compute[74960]:     <serial type="pty">
Nov 03 12:23:45 user nova-compute[74960]:       <log file="/opt/stack/data/nova/instances/6145a30b-809c-4bc5-a45f-c3ff3b170a22/console.log" append="off"/>
Nov 03 12:23:45 user nova-compute[74960]:     </serial>
Nov 03 12:23:45 user nova-compute[74960]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 12:23:45 user nova-compute[74960]:     <video>
Nov 03 12:23:45 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:23:45 user nova-compute[74960]:     </video>
Nov 03 12:23:45 user nova-compute[74960]:     <rng model="virtio">
Nov 03 12:23:45 user nova-compute[74960]:       <backend model="random">/dev/urandom</backend>
Nov 03 12:23:45 user nova-compute[74960]:     </rng>
Nov 03 12:23:45 user nova-compute[74960]:     <controller type="usb" index="0" model="none"/>
Nov 03 12:23:45 user nova-compute[74960]:     <memballoon model="virtio">
Nov 03 12:23:45 user nova-compute[74960]:       <stats period="10"/>
Nov 03 12:23:45 user nova-compute[74960]:     </memballoon>
Nov 03 12:23:45 user nova-compute[74960]:   </devices>
Nov 03 12:23:45 user nova-compute[74960]: </domain>
Nov 03 12:23:45 user nova-compute[74960]:  {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 12:23:45 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-03T12:20:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-526247537',display_name='tempest-ServerActionsTestOtherA-server-1132506895',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-526247537',id=12,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDW7yXqa7k+YlhNoUvM+ny045GZm/Yl6hgASx9MMjKwBHiETYCiHL5EomYdUyz7ar/PJwyKpWPD39wbyG7SmL8Cwl0e8vcQuc7g6iuGDa+Ent75sR68D8/uWXXpX0MFRBg==',key_name='tempest-keypair-1690418913',keypairs=<?>,launch_index=0,launched_at=2023-11-03T12:20:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5320673ee4f0422989a3708915375cdb',ramdisk_id='',reservation_id='r-0h3abybt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1651581249',owner_user_name='tempest-ServerActionsTestOtherA-1651581249-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:23:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60d8d224d7204ede84c09433a3d82d0f',uuid=6145a30b-809c-4bc5-a45f-c3ff3b170a22,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c54167dd-e416-43bd-8271-dd55e9e71119", "address": "fa:16:3e:33:a0:07", "network": {"id": "9c5fae09-5df5-45a3-b9cd-7ac3763ba878", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1736223258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5320673ee4f0422989a3708915375cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc54167dd-e4", "ovs_interfaceid": "c54167dd-e416-43bd-8271-dd55e9e71119", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 12:23:45 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Converting VIF {"id": "c54167dd-e416-43bd-8271-dd55e9e71119", "address": "fa:16:3e:33:a0:07", "network": {"id": "9c5fae09-5df5-45a3-b9cd-7ac3763ba878", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1736223258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5320673ee4f0422989a3708915375cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc54167dd-e4", "ovs_interfaceid": "c54167dd-e416-43bd-8271-dd55e9e71119", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:23:45 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:33:a0:07,bridge_name='br-int',has_traffic_filtering=True,id=c54167dd-e416-43bd-8271-dd55e9e71119,network=Network(9c5fae09-5df5-45a3-b9cd-7ac3763ba878),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc54167dd-e4') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:23:45 user nova-compute[74960]: DEBUG os_vif [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:a0:07,bridge_name='br-int',has_traffic_filtering=True,id=c54167dd-e416-43bd-8271-dd55e9e71119,network=Network(9c5fae09-5df5-45a3-b9cd-7ac3763ba878),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc54167dd-e4') {{(pid=74960) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 12:23:45 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:23:45 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:23:45 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 12:23:45 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:23:45 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'aea1f4a3-cabe-5720-8e23-f6b3231c4f8c', '_type': 'linux-noop'}}, row=False) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:23:45 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:23:45 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:23:45 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:23:45 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc54167dd-e4, may_exist=True, interface_attrs={}) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:23:45 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc54167dd-e4, col_values=(('qos', UUID('c70eecf6-5f52-41bb-bbb5-e6bb0d8b6049')),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:23:45 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc54167dd-e4, col_values=(('external_ids', {'iface-id': 'c54167dd-e416-43bd-8271-dd55e9e71119', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:33:a0:07', 'vm-uuid': '6145a30b-809c-4bc5-a45f-c3ff3b170a22'}),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:23:45 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:23:45 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:23:45 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:23:45 user nova-compute[74960]: INFO os_vif [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:a0:07,bridge_name='br-int',has_traffic_filtering=True,id=c54167dd-e416-43bd-8271-dd55e9e71119,network=Network(9c5fae09-5df5-45a3-b9cd-7ac3763ba878),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc54167dd-e4')
Nov 03 12:23:45 user nova-compute[74960]: DEBUG nova.compute.manager [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Start building block device mappings for instance. {{(pid=74960) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 12:23:45 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] No BDM found with device name vda, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:23:45 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:23:45 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] No VIF found with MAC fa:16:3e:33:a0:07, not building metadata {{(pid=74960) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 12:23:45 user nova-compute[74960]: INFO nova.virt.block_device [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Booting with volume 64202938-e4d3-4072-ba6e-f144187c01a9 at /dev/vda
Nov 03 12:23:45 user nova-compute[74960]: DEBUG nova.policy [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '49d35d857fdf4e4f894a72610086d752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ecbf7a4b414f40ac9bb306bf9d4702', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74960) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 12:23:45 user nova-compute[74960]: DEBUG os_brick.utils [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:23:45 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:23:45 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:23:45 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[77b00f3d-0989-4fef-b192-da2a3b3aedcf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:75b8e219756\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:23:45 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:23:45 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:23:45 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ac7c56d-81be-4172-8df7-6d5c002c8459]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:23:45 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:23:45 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:23:45 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:23:45 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:23:45 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[158f1119-dd15-4b7f-85fa-03b56c321066]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:23:45 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce315699-b769-4a1a-80a3-99cbcc86b6be]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:23:45 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Running cmd (subprocess): nvme version {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:23:45 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] 'nvme version' failed. Not Retrying. {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 12:23:45 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.nvmeof [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] nvme not present on system {{(pid=74960) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 12:23:45 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:23:45 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:23:45 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:23:45 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Auditing locally available compute resources for user (node: user) {{(pid=74960) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 12:23:45 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:23:45 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 12:23:45 user nova-compute[74960]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 12:23:45 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a53271-19f7-412c-aa88-2161c626f612]: (4, '') {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:23:45 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74960) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 12:23:45 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74960) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 12:23:45 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] LIGHTOS: no hostnqn found. {{(pid=74960) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 12:23:45 user nova-compute[74960]: DEBUG os_brick.utils [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:75b8e219756', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:23:45 user nova-compute[74960]: DEBUG nova.virt.block_device [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Updating existing volume attachment record: b1a95216-e194-4996-82c3-e11c002de35a {{(pid=74960) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 12:23:45 user nova-compute[74960]: DEBUG nova.network.neutron [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Successfully created port: dae50cff-c0b2-4c50-bd31-0d1bf1a17e55 {{(pid=74960) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 12:23:46 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:23:46 user nova-compute[74960]: DEBUG nova.compute.manager [req-d551ed3c-0064-4bdb-82ff-2c7ff493460d req-9ffb5350-3953-4c46-88dc-c10296ea7eb7 service nova] [instance: f009a400-0576-48a9-82e0-60de8935c498] Received event network-changed-4b72249c-3aea-415f-83a8-d0498d55674e {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:23:46 user nova-compute[74960]: DEBUG nova.compute.manager [req-d551ed3c-0064-4bdb-82ff-2c7ff493460d req-9ffb5350-3953-4c46-88dc-c10296ea7eb7 service nova] [instance: f009a400-0576-48a9-82e0-60de8935c498] Refreshing instance network info cache due to event network-changed-4b72249c-3aea-415f-83a8-d0498d55674e. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 12:23:46 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-d551ed3c-0064-4bdb-82ff-2c7ff493460d req-9ffb5350-3953-4c46-88dc-c10296ea7eb7 service nova] Acquiring lock "refresh_cache-f009a400-0576-48a9-82e0-60de8935c498" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:23:46 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-d551ed3c-0064-4bdb-82ff-2c7ff493460d req-9ffb5350-3953-4c46-88dc-c10296ea7eb7 service nova] Acquired lock "refresh_cache-f009a400-0576-48a9-82e0-60de8935c498" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:23:46 user nova-compute[74960]: DEBUG nova.network.neutron [req-d551ed3c-0064-4bdb-82ff-2c7ff493460d req-9ffb5350-3953-4c46-88dc-c10296ea7eb7 service nova] [instance: f009a400-0576-48a9-82e0-60de8935c498] Refreshing network info cache for port 4b72249c-3aea-415f-83a8-d0498d55674e {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 12:23:46 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:23:46 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:23:46 user nova-compute[74960]: DEBUG nova.network.neutron [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Successfully created port: b905e727-4d81-4518-8cae-06f4e64bcccc {{(pid=74960) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 12:23:47 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:23:47 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:23:47 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9951fab7-4984-408e-94ca-11eab615ff25/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:23:47 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9951fab7-4984-408e-94ca-11eab615ff25/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:23:47 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9951fab7-4984-408e-94ca-11eab615ff25/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:23:47 user nova-compute[74960]: DEBUG nova.network.neutron [req-d551ed3c-0064-4bdb-82ff-2c7ff493460d req-9ffb5350-3953-4c46-88dc-c10296ea7eb7 service nova] [instance: f009a400-0576-48a9-82e0-60de8935c498] Updated VIF entry in instance network info cache for port 4b72249c-3aea-415f-83a8-d0498d55674e. {{(pid=74960) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 12:23:47 user nova-compute[74960]: DEBUG nova.network.neutron [req-d551ed3c-0064-4bdb-82ff-2c7ff493460d req-9ffb5350-3953-4c46-88dc-c10296ea7eb7 service nova] [instance: f009a400-0576-48a9-82e0-60de8935c498] Updating instance_info_cache with network_info: [{"id": "4b72249c-3aea-415f-83a8-d0498d55674e", "address": "fa:16:3e:81:8a:f6", "network": {"id": "b92f11b0-994f-48b7-be64-02cb782a1f8f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-997339008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d039968e1b97457b8fc21b593af4e1ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b72249c-3a", "ovs_interfaceid": "4b72249c-3aea-415f-83a8-d0498d55674e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:23:47 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-d551ed3c-0064-4bdb-82ff-2c7ff493460d req-9ffb5350-3953-4c46-88dc-c10296ea7eb7 service nova] Releasing lock "refresh_cache-f009a400-0576-48a9-82e0-60de8935c498" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:23:47 user nova-compute[74960]: DEBUG nova.network.neutron [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Successfully created port: 012765dc-7d42-41d5-b12b-34f3a2a7ef07 {{(pid=74960) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 12:23:47 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:23:47 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9951fab7-4984-408e-94ca-11eab615ff25/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:23:47 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05956d9b-0646-43d2-a4cd-19e9090020ee/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:23:48 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05956d9b-0646-43d2-a4cd-19e9090020ee/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:23:48 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05956d9b-0646-43d2-a4cd-19e9090020ee/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:23:48 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05956d9b-0646-43d2-a4cd-19e9090020ee/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:23:48 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74960) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 12:23:48 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7769e3c5-136f-4282-8e3e-224e3a80922c/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:23:48 user nova-compute[74960]: DEBUG nova.compute.manager [None req-d2c6fc32-67f0-43de-8db0-422430cd9e5d tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] [instance: f009a400-0576-48a9-82e0-60de8935c498] Checking state {{(pid=74960) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 12:23:48 user nova-compute[74960]: INFO nova.compute.manager [None req-d2c6fc32-67f0-43de-8db0-422430cd9e5d tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] [instance: f009a400-0576-48a9-82e0-60de8935c498] instance snapshotting
Nov 03 12:23:48 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7769e3c5-136f-4282-8e3e-224e3a80922c/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:23:48 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7769e3c5-136f-4282-8e3e-224e3a80922c/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:23:48 user nova-compute[74960]: DEBUG nova.network.neutron [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Successfully created port: 412bab8b-015e-4df4-92c8-2ed71a8ca2f7 {{(pid=74960) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 12:23:48 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-d2c6fc32-67f0-43de-8db0-422430cd9e5d tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] [instance: f009a400-0576-48a9-82e0-60de8935c498] Beginning live snapshot process
Nov 03 12:23:48 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7769e3c5-136f-4282-8e3e-224e3a80922c/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:23:48 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8381c969-6a2d-4934-aadd-660ffa246b05/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:23:48 user nova-compute[74960]: DEBUG nova.compute.manager [req-b4b0a004-e05e-4590-8942-8e61cc6501c4 req-cc59488b-ce95-4652-822a-805ae732367c service nova] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] Received event network-vif-plugged-c54167dd-e416-43bd-8271-dd55e9e71119 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:23:48 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-b4b0a004-e05e-4590-8942-8e61cc6501c4 req-cc59488b-ce95-4652-822a-805ae732367c service nova] Acquiring lock "6145a30b-809c-4bc5-a45f-c3ff3b170a22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:23:48 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-b4b0a004-e05e-4590-8942-8e61cc6501c4 req-cc59488b-ce95-4652-822a-805ae732367c service nova] Lock "6145a30b-809c-4bc5-a45f-c3ff3b170a22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:23:48 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-b4b0a004-e05e-4590-8942-8e61cc6501c4 req-cc59488b-ce95-4652-822a-805ae732367c service nova] Lock "6145a30b-809c-4bc5-a45f-c3ff3b170a22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:23:48 user nova-compute[74960]: DEBUG nova.compute.manager [req-b4b0a004-e05e-4590-8942-8e61cc6501c4 req-cc59488b-ce95-4652-822a-805ae732367c service nova] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] No waiting events found dispatching network-vif-plugged-c54167dd-e416-43bd-8271-dd55e9e71119 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:23:48 user nova-compute[74960]: WARNING nova.compute.manager [req-b4b0a004-e05e-4590-8942-8e61cc6501c4 req-cc59488b-ce95-4652-822a-805ae732367c service nova] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] Received unexpected event network-vif-plugged-c54167dd-e416-43bd-8271-dd55e9e71119 for instance with vm_state active and task_state rebuild_spawning.
Nov 03 12:23:48 user nova-compute[74960]: DEBUG nova.compute.manager [req-b4b0a004-e05e-4590-8942-8e61cc6501c4 req-cc59488b-ce95-4652-822a-805ae732367c service nova] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] Received event network-vif-plugged-c54167dd-e416-43bd-8271-dd55e9e71119 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:23:48 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-b4b0a004-e05e-4590-8942-8e61cc6501c4 req-cc59488b-ce95-4652-822a-805ae732367c service nova] Acquiring lock "6145a30b-809c-4bc5-a45f-c3ff3b170a22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:23:48 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-b4b0a004-e05e-4590-8942-8e61cc6501c4 req-cc59488b-ce95-4652-822a-805ae732367c service nova] Lock "6145a30b-809c-4bc5-a45f-c3ff3b170a22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:23:48 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-b4b0a004-e05e-4590-8942-8e61cc6501c4 req-cc59488b-ce95-4652-822a-805ae732367c service nova] Lock "6145a30b-809c-4bc5-a45f-c3ff3b170a22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:23:48 user nova-compute[74960]: DEBUG nova.compute.manager [req-b4b0a004-e05e-4590-8942-8e61cc6501c4 req-cc59488b-ce95-4652-822a-805ae732367c service nova] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] No waiting events found dispatching network-vif-plugged-c54167dd-e416-43bd-8271-dd55e9e71119 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:23:48 user nova-compute[74960]: WARNING nova.compute.manager [req-b4b0a004-e05e-4590-8942-8e61cc6501c4 req-cc59488b-ce95-4652-822a-805ae732367c service nova] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] Received unexpected event network-vif-plugged-c54167dd-e416-43bd-8271-dd55e9e71119 for instance with vm_state active and task_state rebuild_spawning.
Nov 03 12:23:48 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-d2c6fc32-67f0-43de-8db0-422430cd9e5d tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f009a400-0576-48a9-82e0-60de8935c498/disk --force-share --output=json -f qcow2 {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:23:48 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8381c969-6a2d-4934-aadd-660ffa246b05/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:23:48 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8381c969-6a2d-4934-aadd-660ffa246b05/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:23:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-d2c6fc32-67f0-43de-8db0-422430cd9e5d tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f009a400-0576-48a9-82e0-60de8935c498/disk --force-share --output=json -f qcow2" returned: 0 in 0.211s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:23:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-d2c6fc32-67f0-43de-8db0-422430cd9e5d tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f009a400-0576-48a9-82e0-60de8935c498/disk --force-share --output=json -f qcow2 {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:23:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8381c969-6a2d-4934-aadd-660ffa246b05/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:23:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fffd1dd7-b8e8-435c-bdfe-6c5001b21daf/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:23:49 user nova-compute[74960]: DEBUG nova.compute.manager [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] Instance event wait completed in 0 seconds for  {{(pid=74960) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 12:23:49 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] Guest created on hypervisor {{(pid=74960) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 12:23:49 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] Instance spawned successfully.
Nov 03 12:23:49 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 12:23:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-d2c6fc32-67f0-43de-8db0-422430cd9e5d tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f009a400-0576-48a9-82e0-60de8935c498/disk --force-share --output=json -f qcow2" returned: 0 in 0.191s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:23:49 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] Found default for hw_cdrom_bus of ide {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:23:49 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] Found default for hw_disk_bus of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:23:49 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] Found default for hw_input_bus of None {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:23:49 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] Found default for hw_pointer_model of None {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:23:49 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] Found default for hw_video_model of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:23:49 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] Found default for hw_vif_model of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:23:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-d2c6fc32-67f0-43de-8db0-422430cd9e5d tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:23:49 user nova-compute[74960]: DEBUG nova.network.neutron [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Successfully created port: 20575d86-ea6c-4d0d-8190-70fe728bc7c1 {{(pid=74960) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 12:23:49 user nova-compute[74960]: DEBUG nova.compute.manager [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] Checking state {{(pid=74960) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 12:23:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fffd1dd7-b8e8-435c-bdfe-6c5001b21daf/disk --force-share --output=json" returned: 0 in 0.282s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:23:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fffd1dd7-b8e8-435c-bdfe-6c5001b21daf/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:23:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-d2c6fc32-67f0-43de-8db0-422430cd9e5d tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.213s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:23:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-d2c6fc32-67f0-43de-8db0-422430cd9e5d tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpcrt8lv03/1a781710bc164d62a55f3ea8eb3c0eac.delta 1073741824 {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:23:49 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:23:49 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.003s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:23:49 user nova-compute[74960]: DEBUG nova.objects.instance [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74960) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 03 12:23:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-d2c6fc32-67f0-43de-8db0-422430cd9e5d tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpcrt8lv03/1a781710bc164d62a55f3ea8eb3c0eac.delta 1073741824" returned: 0 in 0.057s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:23:49 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-d2c6fc32-67f0-43de-8db0-422430cd9e5d tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] [instance: f009a400-0576-48a9-82e0-60de8935c498] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 03 12:23:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fffd1dd7-b8e8-435c-bdfe-6c5001b21daf/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:23:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c87482-1883-43dc-8872-6a5dff128c94/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:23:49 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-02befda3-faaa-4f07-af34-1c79aa6ef69f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.194s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:23:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c87482-1883-43dc-8872-6a5dff128c94/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:23:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c87482-1883-43dc-8872-6a5dff128c94/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:23:50 user nova-compute[74960]: DEBUG nova.network.neutron [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Successfully updated port: dae50cff-c0b2-4c50-bd31-0d1bf1a17e55 {{(pid=74960) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 12:23:50 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:23:50 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c87482-1883-43dc-8872-6a5dff128c94/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:23:50 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6145a30b-809c-4bc5-a45f-c3ff3b170a22/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:23:50 user nova-compute[74960]: DEBUG nova.compute.manager [req-d961ca81-2a1c-4e8b-aa0f-814f35d330ed req-e5ff4d31-39d8-4fc0-95b2-eaf96ba27862 service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Received event network-changed-dae50cff-c0b2-4c50-bd31-0d1bf1a17e55 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:23:50 user nova-compute[74960]: DEBUG nova.compute.manager [req-d961ca81-2a1c-4e8b-aa0f-814f35d330ed req-e5ff4d31-39d8-4fc0-95b2-eaf96ba27862 service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Refreshing instance network info cache due to event network-changed-dae50cff-c0b2-4c50-bd31-0d1bf1a17e55. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 12:23:50 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-d961ca81-2a1c-4e8b-aa0f-814f35d330ed req-e5ff4d31-39d8-4fc0-95b2-eaf96ba27862 service nova] Acquiring lock "refresh_cache-db88322f-c2ad-4622-9a1a-c45439d875a8" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:23:50 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-d961ca81-2a1c-4e8b-aa0f-814f35d330ed req-e5ff4d31-39d8-4fc0-95b2-eaf96ba27862 service nova] Acquired lock "refresh_cache-db88322f-c2ad-4622-9a1a-c45439d875a8" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:23:50 user nova-compute[74960]: DEBUG nova.network.neutron [req-d961ca81-2a1c-4e8b-aa0f-814f35d330ed req-e5ff4d31-39d8-4fc0-95b2-eaf96ba27862 service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Refreshing network info cache for port dae50cff-c0b2-4c50-bd31-0d1bf1a17e55 {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 12:23:50 user nova-compute[74960]: DEBUG nova.network.neutron [req-d961ca81-2a1c-4e8b-aa0f-814f35d330ed req-e5ff4d31-39d8-4fc0-95b2-eaf96ba27862 service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Instance cache missing network info. {{(pid=74960) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 12:23:50 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6145a30b-809c-4bc5-a45f-c3ff3b170a22/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:23:50 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6145a30b-809c-4bc5-a45f-c3ff3b170a22/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:23:50 user nova-compute[74960]: DEBUG nova.virt.libvirt.guest [None req-d2c6fc32-67f0-43de-8db0-422430cd9e5d tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74960) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 03 12:23:50 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6145a30b-809c-4bc5-a45f-c3ff3b170a22/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:23:50 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74960) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 12:23:50 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f009a400-0576-48a9-82e0-60de8935c498/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:23:50 user nova-compute[74960]: DEBUG nova.network.neutron [req-d961ca81-2a1c-4e8b-aa0f-814f35d330ed req-e5ff4d31-39d8-4fc0-95b2-eaf96ba27862 service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Updating instance_info_cache with network_info: [] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:23:50 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-d961ca81-2a1c-4e8b-aa0f-814f35d330ed req-e5ff4d31-39d8-4fc0-95b2-eaf96ba27862 service nova] Releasing lock "refresh_cache-db88322f-c2ad-4622-9a1a-c45439d875a8" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:23:50 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f009a400-0576-48a9-82e0-60de8935c498/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:23:50 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f009a400-0576-48a9-82e0-60de8935c498/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:23:51 user nova-compute[74960]: DEBUG nova.virt.libvirt.guest [None req-d2c6fc32-67f0-43de-8db0-422430cd9e5d tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74960) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 03 12:23:51 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-d2c6fc32-67f0-43de-8db0-422430cd9e5d tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] [instance: f009a400-0576-48a9-82e0-60de8935c498] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 03 12:23:51 user nova-compute[74960]: DEBUG nova.privsep.utils [None req-d2c6fc32-67f0-43de-8db0-422430cd9e5d tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74960) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 03 12:23:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-d2c6fc32-67f0-43de-8db0-422430cd9e5d tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpcrt8lv03/1a781710bc164d62a55f3ea8eb3c0eac.delta /opt/stack/data/nova/instances/snapshots/tmpcrt8lv03/1a781710bc164d62a55f3ea8eb3c0eac {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:23:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f009a400-0576-48a9-82e0-60de8935c498/disk --force-share --output=json" returned: 0 in 0.275s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:23:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e91dfcf4-caef-43d0-a56b-b1282363d4e0/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:23:51 user nova-compute[74960]: DEBUG nova.network.neutron [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Successfully updated port: 9207158b-c88b-44b8-b419-eba87e570339 {{(pid=74960) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 12:23:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e91dfcf4-caef-43d0-a56b-b1282363d4e0/disk --force-share --output=json" returned: 0 in 0.287s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:23:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e91dfcf4-caef-43d0-a56b-b1282363d4e0/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:23:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e91dfcf4-caef-43d0-a56b-b1282363d4e0/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:23:52 user nova-compute[74960]: DEBUG nova.network.neutron [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Successfully updated port: 72da800d-493b-4dc6-8988-1259e2423188 {{(pid=74960) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 12:23:52 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-d2c6fc32-67f0-43de-8db0-422430cd9e5d tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpcrt8lv03/1a781710bc164d62a55f3ea8eb3c0eac.delta /opt/stack/data/nova/instances/snapshots/tmpcrt8lv03/1a781710bc164d62a55f3ea8eb3c0eac" returned: 0 in 1.201s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:23:52 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-d2c6fc32-67f0-43de-8db0-422430cd9e5d tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] [instance: f009a400-0576-48a9-82e0-60de8935c498] Snapshot extracted, beginning image upload
Nov 03 12:23:52 user nova-compute[74960]: DEBUG nova.compute.manager [req-3d3f39b9-7135-4c25-9dc2-3956efd7a19e req-64c0ae17-cf77-467c-950b-a4f35c20cb2a service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Received event network-changed-9207158b-c88b-44b8-b419-eba87e570339 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:23:52 user nova-compute[74960]: DEBUG nova.compute.manager [req-3d3f39b9-7135-4c25-9dc2-3956efd7a19e req-64c0ae17-cf77-467c-950b-a4f35c20cb2a service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Refreshing instance network info cache due to event network-changed-9207158b-c88b-44b8-b419-eba87e570339. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 12:23:52 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-3d3f39b9-7135-4c25-9dc2-3956efd7a19e req-64c0ae17-cf77-467c-950b-a4f35c20cb2a service nova] Acquiring lock "refresh_cache-db88322f-c2ad-4622-9a1a-c45439d875a8" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:23:52 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-3d3f39b9-7135-4c25-9dc2-3956efd7a19e req-64c0ae17-cf77-467c-950b-a4f35c20cb2a service nova] Acquired lock "refresh_cache-db88322f-c2ad-4622-9a1a-c45439d875a8" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:23:52 user nova-compute[74960]: DEBUG nova.network.neutron [req-3d3f39b9-7135-4c25-9dc2-3956efd7a19e req-64c0ae17-cf77-467c-950b-a4f35c20cb2a service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Refreshing network info cache for port 9207158b-c88b-44b8-b419-eba87e570339 {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 12:23:52 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:23:52 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:23:52 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Hypervisor/Node resource view: name=user free_ram=7688MB free_disk=25.33527374267578GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74960) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 12:23:52 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:23:52 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:23:52 user nova-compute[74960]: DEBUG nova.network.neutron [req-3d3f39b9-7135-4c25-9dc2-3956efd7a19e req-64c0ae17-cf77-467c-950b-a4f35c20cb2a service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Instance cache missing network info. {{(pid=74960) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 12:23:52 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 7769e3c5-136f-4282-8e3e-224e3a80922c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:23:52 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance e91dfcf4-caef-43d0-a56b-b1282363d4e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:23:52 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 8381c969-6a2d-4934-aadd-660ffa246b05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:23:52 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 05956d9b-0646-43d2-a4cd-19e9090020ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:23:52 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 6145a30b-809c-4bc5-a45f-c3ff3b170a22 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:23:52 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance fffd1dd7-b8e8-435c-bdfe-6c5001b21daf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:23:52 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance f009a400-0576-48a9-82e0-60de8935c498 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:23:52 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 9951fab7-4984-408e-94ca-11eab615ff25 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:23:52 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance d5c87482-1883-43dc-8872-6a5dff128c94 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:23:52 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance db88322f-c2ad-4622-9a1a-c45439d875a8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:23:52 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74960) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 12:23:52 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74960) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 12:23:52 user nova-compute[74960]: DEBUG nova.network.neutron [req-3d3f39b9-7135-4c25-9dc2-3956efd7a19e req-64c0ae17-cf77-467c-950b-a4f35c20cb2a service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Updating instance_info_cache with network_info: [] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:23:52 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:23:52 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-3d3f39b9-7135-4c25-9dc2-3956efd7a19e req-64c0ae17-cf77-467c-950b-a4f35c20cb2a service nova] Releasing lock "refresh_cache-db88322f-c2ad-4622-9a1a-c45439d875a8" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:23:52 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:23:52 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:23:53 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Compute_service record updated for user:user {{(pid=74960) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 12:23:53 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.665s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:23:53 user nova-compute[74960]: DEBUG nova.network.neutron [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Successfully updated port: b905e727-4d81-4518-8cae-06f4e64bcccc {{(pid=74960) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 12:23:53 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c2f5226e-0e5f-4771-b229-68433d352f5b tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Acquiring lock "e91dfcf4-caef-43d0-a56b-b1282363d4e0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:23:53 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c2f5226e-0e5f-4771-b229-68433d352f5b tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Lock "e91dfcf4-caef-43d0-a56b-b1282363d4e0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:23:53 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c2f5226e-0e5f-4771-b229-68433d352f5b tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Acquiring lock "e91dfcf4-caef-43d0-a56b-b1282363d4e0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:23:53 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c2f5226e-0e5f-4771-b229-68433d352f5b tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Lock "e91dfcf4-caef-43d0-a56b-b1282363d4e0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:23:53 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c2f5226e-0e5f-4771-b229-68433d352f5b tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Lock "e91dfcf4-caef-43d0-a56b-b1282363d4e0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:23:53 user nova-compute[74960]: INFO nova.compute.manager [None req-c2f5226e-0e5f-4771-b229-68433d352f5b tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] [instance: e91dfcf4-caef-43d0-a56b-b1282363d4e0] Terminating instance
Nov 03 12:23:53 user nova-compute[74960]: DEBUG nova.compute.manager [None req-c2f5226e-0e5f-4771-b229-68433d352f5b tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] [instance: e91dfcf4-caef-43d0-a56b-b1282363d4e0] Start destroying the instance on the hypervisor. {{(pid=74960) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 12:23:53 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:23:53 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:23:53 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:23:53 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:23:54 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:23:54 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74960) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 12:23:54 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: e91dfcf4-caef-43d0-a56b-b1282363d4e0] Instance destroyed successfully.
Nov 03 12:23:54 user nova-compute[74960]: DEBUG nova.objects.instance [None req-c2f5226e-0e5f-4771-b229-68433d352f5b tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Lazy-loading 'resources' on Instance uuid e91dfcf4-caef-43d0-a56b-b1282363d4e0 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:23:54 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-c2f5226e-0e5f-4771-b229-68433d352f5b tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:17:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1967024778',display_name='tempest-VolumesAdminNegativeTest-server-1967024778',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1967024778',id=5,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCMRp5CndTHruRz19CmFaHvxQdY1bZiINFFMbD9NEa0ZEnxlBm61dlrJ//KM/VfEo2fNFfJ7JYDkZwHnBvcTZ2XRaqB7d0FWy1TWLDCFzpXnBYvtZaRQ4NRxpdAJZZd/UQ==',key_name='tempest-keypair-58872133',keypairs=<?>,launch_index=0,launched_at=2023-11-03T12:17:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='58667b53361b490fa7f0236ee65934c5',ramdisk_id='',reservation_id='r-es0lpr0i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1697926693',owner_user_name='tempest-VolumesAdminNegativeTest-1697926693-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T12:17:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='26930c47348248f681093b8e74e8c73c',uuid=e91dfcf4-caef-43d0-a56b-b1282363d4e0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ce7c2b72-12cb-4251-b6ac-f2f6724a509a", "address": "fa:16:3e:ef:a8:ac", "network": {"id": "9f0b1c9c-af46-4948-aeb8-e73013159ad4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2126041996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "58667b53361b490fa7f0236ee65934c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce7c2b72-12", "ovs_interfaceid": "ce7c2b72-12cb-4251-b6ac-f2f6724a509a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 12:23:54 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-c2f5226e-0e5f-4771-b229-68433d352f5b tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Converting VIF {"id": "ce7c2b72-12cb-4251-b6ac-f2f6724a509a", "address": "fa:16:3e:ef:a8:ac", "network": {"id": "9f0b1c9c-af46-4948-aeb8-e73013159ad4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2126041996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "58667b53361b490fa7f0236ee65934c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce7c2b72-12", "ovs_interfaceid": "ce7c2b72-12cb-4251-b6ac-f2f6724a509a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:23:54 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-c2f5226e-0e5f-4771-b229-68433d352f5b tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ef:a8:ac,bridge_name='br-int',has_traffic_filtering=True,id=ce7c2b72-12cb-4251-b6ac-f2f6724a509a,network=Network(9f0b1c9c-af46-4948-aeb8-e73013159ad4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce7c2b72-12') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:23:54 user nova-compute[74960]: DEBUG os_vif [None req-c2f5226e-0e5f-4771-b229-68433d352f5b tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:a8:ac,bridge_name='br-int',has_traffic_filtering=True,id=ce7c2b72-12cb-4251-b6ac-f2f6724a509a,network=Network(9f0b1c9c-af46-4948-aeb8-e73013159ad4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce7c2b72-12') {{(pid=74960) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 12:23:54 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:23:54 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapce7c2b72-12, bridge=br-int, if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:23:54 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:23:54 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:23:54 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:23:54 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bc25e2ca-cd96-4216-b8a8-46588e30958d) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:23:54 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:23:54 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:23:54 user nova-compute[74960]: INFO os_vif [None req-c2f5226e-0e5f-4771-b229-68433d352f5b tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:a8:ac,bridge_name='br-int',has_traffic_filtering=True,id=ce7c2b72-12cb-4251-b6ac-f2f6724a509a,network=Network(9f0b1c9c-af46-4948-aeb8-e73013159ad4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce7c2b72-12')
Nov 03 12:23:54 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-c2f5226e-0e5f-4771-b229-68433d352f5b tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] [instance: e91dfcf4-caef-43d0-a56b-b1282363d4e0] Deleting instance files /opt/stack/data/nova/instances/e91dfcf4-caef-43d0-a56b-b1282363d4e0_del
Nov 03 12:23:54 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-c2f5226e-0e5f-4771-b229-68433d352f5b tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] [instance: e91dfcf4-caef-43d0-a56b-b1282363d4e0] Deletion of /opt/stack/data/nova/instances/e91dfcf4-caef-43d0-a56b-b1282363d4e0_del complete
Nov 03 12:23:54 user nova-compute[74960]: DEBUG nova.compute.manager [req-9d553687-acf4-4448-912a-ce56136c1654 req-b02e9ef3-96bf-4e71-bd37-b723caf95706 service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Received event network-changed-72da800d-493b-4dc6-8988-1259e2423188 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:23:54 user nova-compute[74960]: DEBUG nova.compute.manager [req-9d553687-acf4-4448-912a-ce56136c1654 req-b02e9ef3-96bf-4e71-bd37-b723caf95706 service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Refreshing instance network info cache due to event network-changed-72da800d-493b-4dc6-8988-1259e2423188. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 12:23:54 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-9d553687-acf4-4448-912a-ce56136c1654 req-b02e9ef3-96bf-4e71-bd37-b723caf95706 service nova] Acquiring lock "refresh_cache-db88322f-c2ad-4622-9a1a-c45439d875a8" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:23:54 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-9d553687-acf4-4448-912a-ce56136c1654 req-b02e9ef3-96bf-4e71-bd37-b723caf95706 service nova] Acquired lock "refresh_cache-db88322f-c2ad-4622-9a1a-c45439d875a8" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:23:54 user nova-compute[74960]: DEBUG nova.network.neutron [req-9d553687-acf4-4448-912a-ce56136c1654 req-b02e9ef3-96bf-4e71-bd37-b723caf95706 service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Refreshing network info cache for port 72da800d-493b-4dc6-8988-1259e2423188 {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 12:23:54 user nova-compute[74960]: INFO nova.compute.manager [None req-c2f5226e-0e5f-4771-b229-68433d352f5b tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] [instance: e91dfcf4-caef-43d0-a56b-b1282363d4e0] Took 1.03 seconds to destroy the instance on the hypervisor.
Nov 03 12:23:54 user nova-compute[74960]: DEBUG oslo.service.loopingcall [None req-c2f5226e-0e5f-4771-b229-68433d352f5b tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74960) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 12:23:54 user nova-compute[74960]: DEBUG nova.compute.manager [-] [instance: e91dfcf4-caef-43d0-a56b-b1282363d4e0] Deallocating network for instance {{(pid=74960) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 12:23:54 user nova-compute[74960]: DEBUG nova.network.neutron [-] [instance: e91dfcf4-caef-43d0-a56b-b1282363d4e0] deallocate_for_instance() {{(pid=74960) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 12:23:54 user nova-compute[74960]: DEBUG nova.network.neutron [req-9d553687-acf4-4448-912a-ce56136c1654 req-b02e9ef3-96bf-4e71-bd37-b723caf95706 service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Instance cache missing network info. {{(pid=74960) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 12:23:54 user nova-compute[74960]: DEBUG nova.network.neutron [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Successfully updated port: 012765dc-7d42-41d5-b12b-34f3a2a7ef07 {{(pid=74960) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 12:23:54 user nova-compute[74960]: DEBUG nova.network.neutron [req-9d553687-acf4-4448-912a-ce56136c1654 req-b02e9ef3-96bf-4e71-bd37-b723caf95706 service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Updating instance_info_cache with network_info: [] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:23:54 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-9d553687-acf4-4448-912a-ce56136c1654 req-b02e9ef3-96bf-4e71-bd37-b723caf95706 service nova] Releasing lock "refresh_cache-db88322f-c2ad-4622-9a1a-c45439d875a8" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:23:54 user nova-compute[74960]: DEBUG nova.compute.manager [req-9d553687-acf4-4448-912a-ce56136c1654 req-b02e9ef3-96bf-4e71-bd37-b723caf95706 service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Received event network-changed-b905e727-4d81-4518-8cae-06f4e64bcccc {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:23:54 user nova-compute[74960]: DEBUG nova.compute.manager [req-9d553687-acf4-4448-912a-ce56136c1654 req-b02e9ef3-96bf-4e71-bd37-b723caf95706 service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Refreshing instance network info cache due to event network-changed-b905e727-4d81-4518-8cae-06f4e64bcccc. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 12:23:54 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-9d553687-acf4-4448-912a-ce56136c1654 req-b02e9ef3-96bf-4e71-bd37-b723caf95706 service nova] Acquiring lock "refresh_cache-db88322f-c2ad-4622-9a1a-c45439d875a8" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:23:54 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-9d553687-acf4-4448-912a-ce56136c1654 req-b02e9ef3-96bf-4e71-bd37-b723caf95706 service nova] Acquired lock "refresh_cache-db88322f-c2ad-4622-9a1a-c45439d875a8" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:23:54 user nova-compute[74960]: DEBUG nova.network.neutron [req-9d553687-acf4-4448-912a-ce56136c1654 req-b02e9ef3-96bf-4e71-bd37-b723caf95706 service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Refreshing network info cache for port b905e727-4d81-4518-8cae-06f4e64bcccc {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 12:23:54 user nova-compute[74960]: DEBUG nova.network.neutron [req-9d553687-acf4-4448-912a-ce56136c1654 req-b02e9ef3-96bf-4e71-bd37-b723caf95706 service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Instance cache missing network info. {{(pid=74960) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 12:23:55 user nova-compute[74960]: DEBUG nova.network.neutron [-] [instance: e91dfcf4-caef-43d0-a56b-b1282363d4e0] Updating instance_info_cache with network_info: [] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:23:55 user nova-compute[74960]: INFO nova.compute.manager [-] [instance: e91dfcf4-caef-43d0-a56b-b1282363d4e0] Took 1.41 seconds to deallocate network for instance.
Nov 03 12:23:55 user nova-compute[74960]: DEBUG nova.compute.manager [req-b0601786-d9aa-40c2-aa14-e9856f0fae8b req-e9cb37aa-bd2f-49ca-bf9e-0ec813a72db1 service nova] [instance: e91dfcf4-caef-43d0-a56b-b1282363d4e0] Received event network-vif-deleted-ce7c2b72-12cb-4251-b6ac-f2f6724a509a {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:23:55 user nova-compute[74960]: DEBUG nova.network.neutron [req-9d553687-acf4-4448-912a-ce56136c1654 req-b02e9ef3-96bf-4e71-bd37-b723caf95706 service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Updating instance_info_cache with network_info: [] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:23:55 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c2f5226e-0e5f-4771-b229-68433d352f5b tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:23:55 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c2f5226e-0e5f-4771-b229-68433d352f5b tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:23:55 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-858c0f92-69c3-4a86-968b-bce04a743bc4 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] Acquiring lock "8381c969-6a2d-4934-aadd-660ffa246b05" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:23:55 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-858c0f92-69c3-4a86-968b-bce04a743bc4 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] Lock "8381c969-6a2d-4934-aadd-660ffa246b05" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:23:55 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-858c0f92-69c3-4a86-968b-bce04a743bc4 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] Acquiring lock "8381c969-6a2d-4934-aadd-660ffa246b05-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:23:55 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-858c0f92-69c3-4a86-968b-bce04a743bc4 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] Lock "8381c969-6a2d-4934-aadd-660ffa246b05-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:23:55 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-858c0f92-69c3-4a86-968b-bce04a743bc4 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] Lock "8381c969-6a2d-4934-aadd-660ffa246b05-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:23:55 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-9d553687-acf4-4448-912a-ce56136c1654 req-b02e9ef3-96bf-4e71-bd37-b723caf95706 service nova] Releasing lock "refresh_cache-db88322f-c2ad-4622-9a1a-c45439d875a8" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:23:55 user nova-compute[74960]: DEBUG nova.compute.manager [req-9d553687-acf4-4448-912a-ce56136c1654 req-b02e9ef3-96bf-4e71-bd37-b723caf95706 service nova] [instance: e91dfcf4-caef-43d0-a56b-b1282363d4e0] Received event network-vif-unplugged-ce7c2b72-12cb-4251-b6ac-f2f6724a509a {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:23:55 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-9d553687-acf4-4448-912a-ce56136c1654 req-b02e9ef3-96bf-4e71-bd37-b723caf95706 service nova] Acquiring lock "e91dfcf4-caef-43d0-a56b-b1282363d4e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:23:55 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-9d553687-acf4-4448-912a-ce56136c1654 req-b02e9ef3-96bf-4e71-bd37-b723caf95706 service nova] Lock "e91dfcf4-caef-43d0-a56b-b1282363d4e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:23:55 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-9d553687-acf4-4448-912a-ce56136c1654 req-b02e9ef3-96bf-4e71-bd37-b723caf95706 service nova] Lock "e91dfcf4-caef-43d0-a56b-b1282363d4e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:23:55 user nova-compute[74960]: DEBUG nova.compute.manager [req-9d553687-acf4-4448-912a-ce56136c1654 req-b02e9ef3-96bf-4e71-bd37-b723caf95706 service nova] [instance: e91dfcf4-caef-43d0-a56b-b1282363d4e0] No waiting events found dispatching network-vif-unplugged-ce7c2b72-12cb-4251-b6ac-f2f6724a509a {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:23:55 user nova-compute[74960]: DEBUG nova.compute.manager [req-9d553687-acf4-4448-912a-ce56136c1654 req-b02e9ef3-96bf-4e71-bd37-b723caf95706 service nova] [instance: e91dfcf4-caef-43d0-a56b-b1282363d4e0] Received event network-vif-unplugged-ce7c2b72-12cb-4251-b6ac-f2f6724a509a for instance with task_state deleting. {{(pid=74960) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 12:23:55 user nova-compute[74960]: DEBUG nova.compute.manager [req-9d553687-acf4-4448-912a-ce56136c1654 req-b02e9ef3-96bf-4e71-bd37-b723caf95706 service nova] [instance: e91dfcf4-caef-43d0-a56b-b1282363d4e0] Received event network-vif-plugged-ce7c2b72-12cb-4251-b6ac-f2f6724a509a {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:23:55 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-9d553687-acf4-4448-912a-ce56136c1654 req-b02e9ef3-96bf-4e71-bd37-b723caf95706 service nova] Acquiring lock "e91dfcf4-caef-43d0-a56b-b1282363d4e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:23:55 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-9d553687-acf4-4448-912a-ce56136c1654 req-b02e9ef3-96bf-4e71-bd37-b723caf95706 service nova] Lock "e91dfcf4-caef-43d0-a56b-b1282363d4e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:23:55 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-9d553687-acf4-4448-912a-ce56136c1654 req-b02e9ef3-96bf-4e71-bd37-b723caf95706 service nova] Lock "e91dfcf4-caef-43d0-a56b-b1282363d4e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:23:55 user nova-compute[74960]: DEBUG nova.compute.manager [req-9d553687-acf4-4448-912a-ce56136c1654 req-b02e9ef3-96bf-4e71-bd37-b723caf95706 service nova] [instance: e91dfcf4-caef-43d0-a56b-b1282363d4e0] No waiting events found dispatching network-vif-plugged-ce7c2b72-12cb-4251-b6ac-f2f6724a509a {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:23:55 user nova-compute[74960]: WARNING nova.compute.manager [req-9d553687-acf4-4448-912a-ce56136c1654 req-b02e9ef3-96bf-4e71-bd37-b723caf95706 service nova] [instance: e91dfcf4-caef-43d0-a56b-b1282363d4e0] Received unexpected event network-vif-plugged-ce7c2b72-12cb-4251-b6ac-f2f6724a509a for instance with vm_state active and task_state deleting.
Nov 03 12:23:55 user nova-compute[74960]: INFO nova.compute.manager [None req-858c0f92-69c3-4a86-968b-bce04a743bc4 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] [instance: 8381c969-6a2d-4934-aadd-660ffa246b05] Terminating instance
Nov 03 12:23:55 user nova-compute[74960]: DEBUG nova.compute.manager [None req-858c0f92-69c3-4a86-968b-bce04a743bc4 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] [instance: 8381c969-6a2d-4934-aadd-660ffa246b05] Start destroying the instance on the hypervisor. {{(pid=74960) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 12:23:55 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:23:56 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:23:56 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:23:56 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:23:56 user nova-compute[74960]: DEBUG nova.compute.manager [req-74dfb30e-54ff-42f9-8638-66c7c53b174a req-0b786c10-58f1-44eb-8667-2a34f9b0ab04 service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Received event network-changed-012765dc-7d42-41d5-b12b-34f3a2a7ef07 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:23:56 user nova-compute[74960]: DEBUG nova.compute.manager [req-74dfb30e-54ff-42f9-8638-66c7c53b174a req-0b786c10-58f1-44eb-8667-2a34f9b0ab04 service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Refreshing instance network info cache due to event network-changed-012765dc-7d42-41d5-b12b-34f3a2a7ef07. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 12:23:56 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-74dfb30e-54ff-42f9-8638-66c7c53b174a req-0b786c10-58f1-44eb-8667-2a34f9b0ab04 service nova] Acquiring lock "refresh_cache-db88322f-c2ad-4622-9a1a-c45439d875a8" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:23:56 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-74dfb30e-54ff-42f9-8638-66c7c53b174a req-0b786c10-58f1-44eb-8667-2a34f9b0ab04 service nova] Acquired lock "refresh_cache-db88322f-c2ad-4622-9a1a-c45439d875a8" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:23:56 user nova-compute[74960]: DEBUG nova.network.neutron [req-74dfb30e-54ff-42f9-8638-66c7c53b174a req-0b786c10-58f1-44eb-8667-2a34f9b0ab04 service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Refreshing network info cache for port 012765dc-7d42-41d5-b12b-34f3a2a7ef07 {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 12:23:56 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-c2f5226e-0e5f-4771-b229-68433d352f5b tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:23:56 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-c2f5226e-0e5f-4771-b229-68433d352f5b tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:23:56 user nova-compute[74960]: DEBUG nova.network.neutron [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Successfully updated port: 412bab8b-015e-4df4-92c8-2ed71a8ca2f7 {{(pid=74960) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 12:23:56 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c2f5226e-0e5f-4771-b229-68433d352f5b tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.664s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:23:56 user nova-compute[74960]: INFO nova.scheduler.client.report [None req-c2f5226e-0e5f-4771-b229-68433d352f5b tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Deleted allocations for instance e91dfcf4-caef-43d0-a56b-b1282363d4e0
Nov 03 12:23:56 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-d2c6fc32-67f0-43de-8db0-422430cd9e5d tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] [instance: f009a400-0576-48a9-82e0-60de8935c498] Snapshot image upload complete
Nov 03 12:23:56 user nova-compute[74960]: INFO nova.compute.manager [None req-d2c6fc32-67f0-43de-8db0-422430cd9e5d tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] [instance: f009a400-0576-48a9-82e0-60de8935c498] Took 8.09 seconds to snapshot the instance on the hypervisor.
Nov 03 12:23:56 user nova-compute[74960]: DEBUG nova.network.neutron [req-74dfb30e-54ff-42f9-8638-66c7c53b174a req-0b786c10-58f1-44eb-8667-2a34f9b0ab04 service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Instance cache missing network info. {{(pid=74960) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 12:23:56 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c2f5226e-0e5f-4771-b229-68433d352f5b tempest-VolumesAdminNegativeTest-1697926693 tempest-VolumesAdminNegativeTest-1697926693-project-member] Lock "e91dfcf4-caef-43d0-a56b-b1282363d4e0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.417s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:23:56 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: 8381c969-6a2d-4934-aadd-660ffa246b05] Instance destroyed successfully.
Nov 03 12:23:56 user nova-compute[74960]: DEBUG nova.objects.instance [None req-858c0f92-69c3-4a86-968b-bce04a743bc4 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] Lazy-loading 'resources' on Instance uuid 8381c969-6a2d-4934-aadd-660ffa246b05 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:23:56 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-858c0f92-69c3-4a86-968b-bce04a743bc4 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:17:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1887246453',display_name='tempest-TestVolumeSwap-server-1887246453',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1887246453',id=6,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPijzC8lN2DSySUAgz+h17JPAKR6Do84TzAAXhx3c0TGsbnV/3XgwIiOdJM1YoFsgSmUy6MsHWQFG01KfzOmGvQ63FkQCOykBBdNS+34BhQUDmJz4zRczQ/tJdkdY5BZrA==',key_name='tempest-keypair-290186211',keypairs=<?>,launch_index=0,launched_at=2023-11-03T12:17:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5477a0b396d64025bfc321100dd29041',ramdisk_id='',reservation_id='r-n704us3p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1118632566',owner_user_name='tempest-TestVolumeSwap-1118632566-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T12:17:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0d10c1fea2544ff9b5b6edb05482607',uuid=8381c969-6a2d-4934-aadd-660ffa246b05,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "df5604b7-7f5b-4738-b218-0016b4441542", "address": "fa:16:3e:8c:e9:c2", "network": {"id": "148a1e23-c4e0-4ea4-98e4-443552dd8f70", "bridge": "br-int", "label": "tempest-TestVolumeSwap-874596856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5477a0b396d64025bfc321100dd29041", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf5604b7-7f", "ovs_interfaceid": "df5604b7-7f5b-4738-b218-0016b4441542", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 12:23:56 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-858c0f92-69c3-4a86-968b-bce04a743bc4 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] Converting VIF {"id": "df5604b7-7f5b-4738-b218-0016b4441542", "address": "fa:16:3e:8c:e9:c2", "network": {"id": "148a1e23-c4e0-4ea4-98e4-443552dd8f70", "bridge": "br-int", "label": "tempest-TestVolumeSwap-874596856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5477a0b396d64025bfc321100dd29041", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf5604b7-7f", "ovs_interfaceid": "df5604b7-7f5b-4738-b218-0016b4441542", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:23:56 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-858c0f92-69c3-4a86-968b-bce04a743bc4 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8c:e9:c2,bridge_name='br-int',has_traffic_filtering=True,id=df5604b7-7f5b-4738-b218-0016b4441542,network=Network(148a1e23-c4e0-4ea4-98e4-443552dd8f70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf5604b7-7f') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:23:56 user nova-compute[74960]: DEBUG os_vif [None req-858c0f92-69c3-4a86-968b-bce04a743bc4 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8c:e9:c2,bridge_name='br-int',has_traffic_filtering=True,id=df5604b7-7f5b-4738-b218-0016b4441542,network=Network(148a1e23-c4e0-4ea4-98e4-443552dd8f70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf5604b7-7f') {{(pid=74960) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 12:23:56 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:23:56 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdf5604b7-7f, bridge=br-int, if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:23:56 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:23:56 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:23:56 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:23:56 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f631ddc9-05ce-4c94-9773-a0d751ae27d0) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:23:56 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:23:56 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:23:56 user nova-compute[74960]: INFO os_vif [None req-858c0f92-69c3-4a86-968b-bce04a743bc4 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8c:e9:c2,bridge_name='br-int',has_traffic_filtering=True,id=df5604b7-7f5b-4738-b218-0016b4441542,network=Network(148a1e23-c4e0-4ea4-98e4-443552dd8f70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf5604b7-7f')
Nov 03 12:23:56 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-858c0f92-69c3-4a86-968b-bce04a743bc4 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] [instance: 8381c969-6a2d-4934-aadd-660ffa246b05] Deleting instance files /opt/stack/data/nova/instances/8381c969-6a2d-4934-aadd-660ffa246b05_del
Nov 03 12:23:56 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-858c0f92-69c3-4a86-968b-bce04a743bc4 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] [instance: 8381c969-6a2d-4934-aadd-660ffa246b05] Deletion of /opt/stack/data/nova/instances/8381c969-6a2d-4934-aadd-660ffa246b05_del complete
Nov 03 12:23:56 user nova-compute[74960]: INFO nova.compute.manager [None req-858c0f92-69c3-4a86-968b-bce04a743bc4 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] [instance: 8381c969-6a2d-4934-aadd-660ffa246b05] Took 1.00 seconds to destroy the instance on the hypervisor.
Nov 03 12:23:56 user nova-compute[74960]: DEBUG oslo.service.loopingcall [None req-858c0f92-69c3-4a86-968b-bce04a743bc4 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74960) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 12:23:56 user nova-compute[74960]: DEBUG nova.compute.manager [-] [instance: 8381c969-6a2d-4934-aadd-660ffa246b05] Deallocating network for instance {{(pid=74960) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 12:23:56 user nova-compute[74960]: DEBUG nova.network.neutron [-] [instance: 8381c969-6a2d-4934-aadd-660ffa246b05] deallocate_for_instance() {{(pid=74960) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 12:23:57 user nova-compute[74960]: DEBUG nova.network.neutron [req-74dfb30e-54ff-42f9-8638-66c7c53b174a req-0b786c10-58f1-44eb-8667-2a34f9b0ab04 service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Updating instance_info_cache with network_info: [] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:23:57 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-74dfb30e-54ff-42f9-8638-66c7c53b174a req-0b786c10-58f1-44eb-8667-2a34f9b0ab04 service nova] Releasing lock "refresh_cache-db88322f-c2ad-4622-9a1a-c45439d875a8" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:23:57 user nova-compute[74960]: DEBUG nova.network.neutron [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Successfully updated port: 20575d86-ea6c-4d0d-8190-70fe728bc7c1 {{(pid=74960) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 12:23:57 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Acquiring lock "refresh_cache-db88322f-c2ad-4622-9a1a-c45439d875a8" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:23:57 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Acquired lock "refresh_cache-db88322f-c2ad-4622-9a1a-c45439d875a8" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:23:57 user nova-compute[74960]: DEBUG nova.network.neutron [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Building network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 12:23:57 user nova-compute[74960]: DEBUG nova.network.neutron [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Instance cache missing network info. {{(pid=74960) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 12:23:57 user nova-compute[74960]: DEBUG nova.network.neutron [-] [instance: 8381c969-6a2d-4934-aadd-660ffa246b05] Updating instance_info_cache with network_info: [] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:23:57 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:23:57 user nova-compute[74960]: INFO nova.compute.manager [-] [instance: 8381c969-6a2d-4934-aadd-660ffa246b05] Took 0.92 seconds to deallocate network for instance.
Nov 03 12:23:57 user nova-compute[74960]: DEBUG nova.compute.manager [req-f56d3470-6f98-4292-aa3a-48b54382228e req-90f0a03a-7f67-49cc-90ba-d8a284b609db service nova] [instance: 8381c969-6a2d-4934-aadd-660ffa246b05] Received event network-vif-deleted-df5604b7-7f5b-4738-b218-0016b4441542 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:23:57 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-858c0f92-69c3-4a86-968b-bce04a743bc4 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:23:57 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-858c0f92-69c3-4a86-968b-bce04a743bc4 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:23:58 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-858c0f92-69c3-4a86-968b-bce04a743bc4 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:23:58 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-858c0f92-69c3-4a86-968b-bce04a743bc4 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:23:58 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-858c0f92-69c3-4a86-968b-bce04a743bc4 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.342s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:23:58 user nova-compute[74960]: INFO nova.scheduler.client.report [None req-858c0f92-69c3-4a86-968b-bce04a743bc4 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] Deleted allocations for instance 8381c969-6a2d-4934-aadd-660ffa246b05
Nov 03 12:23:58 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-858c0f92-69c3-4a86-968b-bce04a743bc4 tempest-TestVolumeSwap-1118632566 tempest-TestVolumeSwap-1118632566-project-member] Lock "8381c969-6a2d-4934-aadd-660ffa246b05" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.526s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:23:58 user nova-compute[74960]: DEBUG nova.compute.manager [req-3807797b-0966-43e1-930a-9be20004178d req-22b4d20e-c3e7-47a8-9f55-15dcd868b539 service nova] [instance: 8381c969-6a2d-4934-aadd-660ffa246b05] Received event network-vif-unplugged-df5604b7-7f5b-4738-b218-0016b4441542 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:23:58 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-3807797b-0966-43e1-930a-9be20004178d req-22b4d20e-c3e7-47a8-9f55-15dcd868b539 service nova] Acquiring lock "8381c969-6a2d-4934-aadd-660ffa246b05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:23:58 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-3807797b-0966-43e1-930a-9be20004178d req-22b4d20e-c3e7-47a8-9f55-15dcd868b539 service nova] Lock "8381c969-6a2d-4934-aadd-660ffa246b05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:23:58 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-3807797b-0966-43e1-930a-9be20004178d req-22b4d20e-c3e7-47a8-9f55-15dcd868b539 service nova] Lock "8381c969-6a2d-4934-aadd-660ffa246b05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:23:58 user nova-compute[74960]: DEBUG nova.compute.manager [req-3807797b-0966-43e1-930a-9be20004178d req-22b4d20e-c3e7-47a8-9f55-15dcd868b539 service nova] [instance: 8381c969-6a2d-4934-aadd-660ffa246b05] No waiting events found dispatching network-vif-unplugged-df5604b7-7f5b-4738-b218-0016b4441542 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:23:58 user nova-compute[74960]: WARNING nova.compute.manager [req-3807797b-0966-43e1-930a-9be20004178d req-22b4d20e-c3e7-47a8-9f55-15dcd868b539 service nova] [instance: 8381c969-6a2d-4934-aadd-660ffa246b05] Received unexpected event network-vif-unplugged-df5604b7-7f5b-4738-b218-0016b4441542 for instance with vm_state deleted and task_state None.
Nov 03 12:23:58 user nova-compute[74960]: DEBUG nova.compute.manager [req-3807797b-0966-43e1-930a-9be20004178d req-22b4d20e-c3e7-47a8-9f55-15dcd868b539 service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Received event network-changed-412bab8b-015e-4df4-92c8-2ed71a8ca2f7 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:23:58 user nova-compute[74960]: DEBUG nova.compute.manager [req-3807797b-0966-43e1-930a-9be20004178d req-22b4d20e-c3e7-47a8-9f55-15dcd868b539 service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Refreshing instance network info cache due to event network-changed-412bab8b-015e-4df4-92c8-2ed71a8ca2f7. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 12:23:58 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-3807797b-0966-43e1-930a-9be20004178d req-22b4d20e-c3e7-47a8-9f55-15dcd868b539 service nova] Acquiring lock "refresh_cache-db88322f-c2ad-4622-9a1a-c45439d875a8" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:23:59 user nova-compute[74960]: DEBUG nova.network.neutron [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Updating instance_info_cache with network_info: [{"id": "dae50cff-c0b2-4c50-bd31-0d1bf1a17e55", "address": "fa:16:3e:c8:88:99", "network": {"id": "f771bed5-ff95-49cd-9871-08b128de2619", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-756048610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32ecbf7a4b414f40ac9bb306bf9d4702", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdae50cff-c0", "ovs_interfaceid": "dae50cff-c0b2-4c50-bd31-0d1bf1a17e55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9207158b-c88b-44b8-b419-eba87e570339", "address": "fa:16:3e:1a:2c:15", "network": {"id": "a61d6a8a-acdb-4b52-bebc-1b90d89b25f2", "bridge": "br-int", "label": "tempest-device-tagging-net1-20653421", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32ecbf7a4b414f40ac9bb306bf9d4702", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9207158b-c8", "ovs_interfaceid": "9207158b-c88b-44b8-b419-eba87e570339", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "72da800d-493b-4dc6-8988-1259e2423188", "address": "fa:16:3e:ec:7f:b8", "network": {"id": "a61d6a8a-acdb-4b52-bebc-1b90d89b25f2", "bridge": "br-int", "label": "tempest-device-tagging-net1-20653421", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32ecbf7a4b414f40ac9bb306bf9d4702", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72da800d-49", "ovs_interfaceid": "72da800d-493b-4dc6-8988-1259e2423188", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b905e727-4d81-4518-8cae-06f4e64bcccc", "address": "fa:16:3e:b9:71:c0", "network": {"id": "a61d6a8a-acdb-4b52-bebc-1b90d89b25f2", "bridge": "br-int", "label": "tempest-device-tagging-net1-20653421", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32ecbf7a4b414f40ac9bb306bf9d4702", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb905e727-4d", "ovs_interfaceid": "b905e727-4d81-4518-8cae-06f4e64bcccc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "012765dc-7d42-41d5-b12b-34f3a2a7ef07", "address": "fa:16:3e:d6:f8:7b", "network": {"id": "a61d6a8a-acdb-4b52-bebc-1b90d89b25f2", "bridge": "br-int", "label": "tempest-device-tagging-net1-20653421", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32ecbf7a4b414f40ac9bb306bf9d4702", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap012765dc-7d", "ovs_interfaceid": "012765dc-7d42-41d5-b12b-34f3a2a7ef07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "412bab8b-015e-4df4-92c8-2ed71a8ca2f7", "address": "fa:16:3e:e5:6e:0a", "network": {"id": "103d876e-44c1-4732-b994-193d642fbd96", "bridge": "br-int", "label": "tempest-device-tagging-net2-1835187118", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "32ecbf7a4b414f40ac9bb306bf9d4702", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap412bab8b-01", "ovs_interfaceid": "412bab8b-015e-4df4-92c8-2ed71a8ca2f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "20575d86-ea6c-4d0d-8190-70fe728bc7c1", "address": "fa:16:3e:7c:5c:e8", "network": {"id": "103d876e-44c1-4732-b994-193d642fbd96", "bridge": "br-int", "label": "tempest-device-tagging-net2-1835187118", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "32ecbf7a4b414f40ac9bb306bf9d4702", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20575d86-ea", "ovs_interfaceid": "20575d86-ea6c-4d0d-8190-70fe728bc7c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:23:59 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Releasing lock "refresh_cache-db88322f-c2ad-4622-9a1a-c45439d875a8" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:23:59 user nova-compute[74960]: DEBUG nova.compute.manager [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Instance network_info: |[{"id": "dae50cff-c0b2-4c50-bd31-0d1bf1a17e55", "address": "fa:16:3e:c8:88:99", "network": {"id": "f771bed5-ff95-49cd-9871-08b128de2619", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-756048610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32ecbf7a4b414f40ac9bb306bf9d4702", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdae50cff-c0", "ovs_interfaceid": "dae50cff-c0b2-4c50-bd31-0d1bf1a17e55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9207158b-c88b-44b8-b419-eba87e570339", "address": "fa:16:3e:1a:2c:15", "network": {"id": "a61d6a8a-acdb-4b52-bebc-1b90d89b25f2", "bridge": "br-int", "label": "tempest-device-tagging-net1-20653421", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32ecbf7a4b414f40ac9bb306bf9d4702", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9207158b-c8", "ovs_interfaceid": "9207158b-c88b-44b8-b419-eba87e570339", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "72da800d-493b-4dc6-8988-1259e2423188", "address": "fa:16:3e:ec:7f:b8", "network": {"id": "a61d6a8a-acdb-4b52-bebc-1b90d89b25f2", "bridge": "br-int", "label": "tempest-device-tagging-net1-20653421", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32ecbf7a4b414f40ac9bb306bf9d4702", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72da800d-49", "ovs_interfaceid": "72da800d-493b-4dc6-8988-1259e2423188", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b905e727-4d81-4518-8cae-06f4e64bcccc", "address": "fa:16:3e:b9:71:c0", "network": {"id": "a61d6a8a-acdb-4b52-bebc-1b90d89b25f2", "bridge": "br-int", "label": "tempest-device-tagging-net1-20653421", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32ecbf7a4b414f40ac9bb306bf9d4702", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb905e727-4d", "ovs_interfaceid": "b905e727-4d81-4518-8cae-06f4e64bcccc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "012765dc-7d42-41d5-b12b-34f3a2a7ef07", "address": "fa:16:3e:d6:f8:7b", "network": {"id": "a61d6a8a-acdb-4b52-bebc-1b90d89b25f2", "bridge": "br-int", "label": "tempest-device-tagging-net1-20653421", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32ecbf7a4b414f40ac9bb306bf9d4702", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap012765dc-7d", "ovs_interfaceid": "012765dc-7d42-41d5-b12b-34f3a2a7ef07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "412bab8b-015e-4df4-92c8-2ed71a8ca2f7", "address": "fa:16:3e:e5:6e:0a", "network": {"id": "103d876e-44c1-4732-b994-193d642fbd96", "bridge": "br-int", "label": "tempest-device-tagging-net2-1835187118", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "32ecbf7a4b414f40ac9bb306bf9d4702", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap412bab8b-01", "ovs_interfaceid": "412bab8b-015e-4df4-92c8-2ed71a8ca2f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "20575d86-ea6c-4d0d-8190-70fe728bc7c1", "address": "fa:16:3e:7c:5c:e8", "network": {"id": "103d876e-44c1-4732-b994-193d642fbd96", "bridge": "br-int", "label": "tempest-device-tagging-net2-1835187118", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "32ecbf7a4b414f40ac9bb306bf9d4702", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20575d86-ea", "ovs_interfaceid": "20575d86-ea6c-4d0d-8190-70fe728bc7c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74960) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 12:23:59 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-3807797b-0966-43e1-930a-9be20004178d req-22b4d20e-c3e7-47a8-9f55-15dcd868b539 service nova] Acquired lock "refresh_cache-db88322f-c2ad-4622-9a1a-c45439d875a8" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:23:59 user nova-compute[74960]: DEBUG nova.network.neutron [req-3807797b-0966-43e1-930a-9be20004178d req-22b4d20e-c3e7-47a8-9f55-15dcd868b539 service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Refreshing network info cache for port 412bab8b-015e-4df4-92c8-2ed71a8ca2f7 {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 12:24:00 user nova-compute[74960]: DEBUG nova.network.neutron [req-3807797b-0966-43e1-930a-9be20004178d req-22b4d20e-c3e7-47a8-9f55-15dcd868b539 service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Updated VIF entry in instance network info cache for port 412bab8b-015e-4df4-92c8-2ed71a8ca2f7. {{(pid=74960) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 12:24:00 user nova-compute[74960]: DEBUG nova.network.neutron [req-3807797b-0966-43e1-930a-9be20004178d req-22b4d20e-c3e7-47a8-9f55-15dcd868b539 service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Updating instance_info_cache with network_info: [{"id": "dae50cff-c0b2-4c50-bd31-0d1bf1a17e55", "address": "fa:16:3e:c8:88:99", "network": {"id": "f771bed5-ff95-49cd-9871-08b128de2619", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-756048610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32ecbf7a4b414f40ac9bb306bf9d4702", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdae50cff-c0", "ovs_interfaceid": "dae50cff-c0b2-4c50-bd31-0d1bf1a17e55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9207158b-c88b-44b8-b419-eba87e570339", "address": "fa:16:3e:1a:2c:15", "network": {"id": "a61d6a8a-acdb-4b52-bebc-1b90d89b25f2", "bridge": "br-int", "label": "tempest-device-tagging-net1-20653421", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32ecbf7a4b414f40ac9bb306bf9d4702", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9207158b-c8", "ovs_interfaceid": "9207158b-c88b-44b8-b419-eba87e570339", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "72da800d-493b-4dc6-8988-1259e2423188", "address": "fa:16:3e:ec:7f:b8", "network": {"id": "a61d6a8a-acdb-4b52-bebc-1b90d89b25f2", "bridge": "br-int", "label": "tempest-device-tagging-net1-20653421", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32ecbf7a4b414f40ac9bb306bf9d4702", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72da800d-49", "ovs_interfaceid": "72da800d-493b-4dc6-8988-1259e2423188", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b905e727-4d81-4518-8cae-06f4e64bcccc", "address": "fa:16:3e:b9:71:c0", "network": {"id": "a61d6a8a-acdb-4b52-bebc-1b90d89b25f2", "bridge": "br-int", "label": "tempest-device-tagging-net1-20653421", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32ecbf7a4b414f40ac9bb306bf9d4702", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb905e727-4d", "ovs_interfaceid": "b905e727-4d81-4518-8cae-06f4e64bcccc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "012765dc-7d42-41d5-b12b-34f3a2a7ef07", "address": "fa:16:3e:d6:f8:7b", "network": {"id": "a61d6a8a-acdb-4b52-bebc-1b90d89b25f2", "bridge": "br-int", "label": "tempest-device-tagging-net1-20653421", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32ecbf7a4b414f40ac9bb306bf9d4702", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap012765dc-7d", "ovs_interfaceid": "012765dc-7d42-41d5-b12b-34f3a2a7ef07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "412bab8b-015e-4df4-92c8-2ed71a8ca2f7", "address": "fa:16:3e:e5:6e:0a", "network": {"id": "103d876e-44c1-4732-b994-193d642fbd96", "bridge": "br-int", "label": "tempest-device-tagging-net2-1835187118", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "32ecbf7a4b414f40ac9bb306bf9d4702", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap412bab8b-01", "ovs_interfaceid": "412bab8b-015e-4df4-92c8-2ed71a8ca2f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "20575d86-ea6c-4d0d-8190-70fe728bc7c1", "address": "fa:16:3e:7c:5c:e8", "network": {"id": "103d876e-44c1-4732-b994-193d642fbd96", "bridge": "br-int", "label": "tempest-device-tagging-net2-1835187118", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "32ecbf7a4b414f40ac9bb306bf9d4702", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20575d86-ea", "ovs_interfaceid": "20575d86-ea6c-4d0d-8190-70fe728bc7c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:24:00 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-3807797b-0966-43e1-930a-9be20004178d req-22b4d20e-c3e7-47a8-9f55-15dcd868b539 service nova] Releasing lock "refresh_cache-db88322f-c2ad-4622-9a1a-c45439d875a8" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:24:00 user nova-compute[74960]: DEBUG nova.compute.manager [req-3807797b-0966-43e1-930a-9be20004178d req-22b4d20e-c3e7-47a8-9f55-15dcd868b539 service nova] [instance: 8381c969-6a2d-4934-aadd-660ffa246b05] Received event network-vif-plugged-df5604b7-7f5b-4738-b218-0016b4441542 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:24:00 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-3807797b-0966-43e1-930a-9be20004178d req-22b4d20e-c3e7-47a8-9f55-15dcd868b539 service nova] Acquiring lock "8381c969-6a2d-4934-aadd-660ffa246b05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:24:00 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-3807797b-0966-43e1-930a-9be20004178d req-22b4d20e-c3e7-47a8-9f55-15dcd868b539 service nova] Lock "8381c969-6a2d-4934-aadd-660ffa246b05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:24:00 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-3807797b-0966-43e1-930a-9be20004178d req-22b4d20e-c3e7-47a8-9f55-15dcd868b539 service nova] Lock "8381c969-6a2d-4934-aadd-660ffa246b05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:24:00 user nova-compute[74960]: DEBUG nova.compute.manager [req-3807797b-0966-43e1-930a-9be20004178d req-22b4d20e-c3e7-47a8-9f55-15dcd868b539 service nova] [instance: 8381c969-6a2d-4934-aadd-660ffa246b05] No waiting events found dispatching network-vif-plugged-df5604b7-7f5b-4738-b218-0016b4441542 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:24:00 user nova-compute[74960]: WARNING nova.compute.manager [req-3807797b-0966-43e1-930a-9be20004178d req-22b4d20e-c3e7-47a8-9f55-15dcd868b539 service nova] [instance: 8381c969-6a2d-4934-aadd-660ffa246b05] Received unexpected event network-vif-plugged-df5604b7-7f5b-4738-b218-0016b4441542 for instance with vm_state deleted and task_state None.
Nov 03 12:24:00 user nova-compute[74960]: DEBUG nova.compute.manager [req-3807797b-0966-43e1-930a-9be20004178d req-22b4d20e-c3e7-47a8-9f55-15dcd868b539 service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Received event network-changed-20575d86-ea6c-4d0d-8190-70fe728bc7c1 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:24:00 user nova-compute[74960]: DEBUG nova.compute.manager [req-3807797b-0966-43e1-930a-9be20004178d req-22b4d20e-c3e7-47a8-9f55-15dcd868b539 service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Refreshing instance network info cache due to event network-changed-20575d86-ea6c-4d0d-8190-70fe728bc7c1. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 12:24:00 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-3807797b-0966-43e1-930a-9be20004178d req-22b4d20e-c3e7-47a8-9f55-15dcd868b539 service nova] Acquiring lock "refresh_cache-db88322f-c2ad-4622-9a1a-c45439d875a8" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:24:00 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-3807797b-0966-43e1-930a-9be20004178d req-22b4d20e-c3e7-47a8-9f55-15dcd868b539 service nova] Acquired lock "refresh_cache-db88322f-c2ad-4622-9a1a-c45439d875a8" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:24:00 user nova-compute[74960]: DEBUG nova.network.neutron [req-3807797b-0966-43e1-930a-9be20004178d req-22b4d20e-c3e7-47a8-9f55-15dcd868b539 service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Refreshing network info cache for port 20575d86-ea6c-4d0d-8190-70fe728bc7c1 {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 12:24:01 user nova-compute[74960]: DEBUG nova.network.neutron [req-3807797b-0966-43e1-930a-9be20004178d req-22b4d20e-c3e7-47a8-9f55-15dcd868b539 service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Updated VIF entry in instance network info cache for port 20575d86-ea6c-4d0d-8190-70fe728bc7c1. {{(pid=74960) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 12:24:01 user nova-compute[74960]: DEBUG nova.network.neutron [req-3807797b-0966-43e1-930a-9be20004178d req-22b4d20e-c3e7-47a8-9f55-15dcd868b539 service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Updating instance_info_cache with network_info: [{"id": "dae50cff-c0b2-4c50-bd31-0d1bf1a17e55", "address": "fa:16:3e:c8:88:99", "network": {"id": "f771bed5-ff95-49cd-9871-08b128de2619", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-756048610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32ecbf7a4b414f40ac9bb306bf9d4702", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdae50cff-c0", "ovs_interfaceid": "dae50cff-c0b2-4c50-bd31-0d1bf1a17e55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9207158b-c88b-44b8-b419-eba87e570339", "address": "fa:16:3e:1a:2c:15", "network": {"id": "a61d6a8a-acdb-4b52-bebc-1b90d89b25f2", "bridge": "br-int", "label": "tempest-device-tagging-net1-20653421", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32ecbf7a4b414f40ac9bb306bf9d4702", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9207158b-c8", "ovs_interfaceid": "9207158b-c88b-44b8-b419-eba87e570339", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "72da800d-493b-4dc6-8988-1259e2423188", "address": "fa:16:3e:ec:7f:b8", "network": {"id": "a61d6a8a-acdb-4b52-bebc-1b90d89b25f2", "bridge": "br-int", "label": "tempest-device-tagging-net1-20653421", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32ecbf7a4b414f40ac9bb306bf9d4702", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72da800d-49", "ovs_interfaceid": "72da800d-493b-4dc6-8988-1259e2423188", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b905e727-4d81-4518-8cae-06f4e64bcccc", "address": "fa:16:3e:b9:71:c0", "network": {"id": "a61d6a8a-acdb-4b52-bebc-1b90d89b25f2", "bridge": "br-int", "label": "tempest-device-tagging-net1-20653421", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32ecbf7a4b414f40ac9bb306bf9d4702", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb905e727-4d", "ovs_interfaceid": "b905e727-4d81-4518-8cae-06f4e64bcccc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "012765dc-7d42-41d5-b12b-34f3a2a7ef07", "address": "fa:16:3e:d6:f8:7b", "network": {"id": "a61d6a8a-acdb-4b52-bebc-1b90d89b25f2", "bridge": "br-int", "label": "tempest-device-tagging-net1-20653421", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32ecbf7a4b414f40ac9bb306bf9d4702", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap012765dc-7d", "ovs_interfaceid": "012765dc-7d42-41d5-b12b-34f3a2a7ef07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "412bab8b-015e-4df4-92c8-2ed71a8ca2f7", "address": "fa:16:3e:e5:6e:0a", "network": {"id": "103d876e-44c1-4732-b994-193d642fbd96", "bridge": "br-int", "label": "tempest-device-tagging-net2-1835187118", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "32ecbf7a4b414f40ac9bb306bf9d4702", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap412bab8b-01", "ovs_interfaceid": "412bab8b-015e-4df4-92c8-2ed71a8ca2f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "20575d86-ea6c-4d0d-8190-70fe728bc7c1", "address": "fa:16:3e:7c:5c:e8", "network": {"id": "103d876e-44c1-4732-b994-193d642fbd96", "bridge": "br-int", "label": "tempest-device-tagging-net2-1835187118", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "32ecbf7a4b414f40ac9bb306bf9d4702", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20575d86-ea", "ovs_interfaceid": "20575d86-ea6c-4d0d-8190-70fe728bc7c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:24:01 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-3807797b-0966-43e1-930a-9be20004178d req-22b4d20e-c3e7-47a8-9f55-15dcd868b539 service nova] Releasing lock "refresh_cache-db88322f-c2ad-4622-9a1a-c45439d875a8" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:24:01 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:24:02 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:24:06 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:24:07 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:24:08 user nova-compute[74960]: INFO nova.virt.block_device [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Booting with volume fd1b7665-8415-44ab-81f5-84493c50a786 at /dev/vdb
Nov 03 12:24:08 user nova-compute[74960]: DEBUG os_brick.utils [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:24:08 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:24:08 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:24:08 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[68f41022-c9ad-47fb-99ba-118a31a3c767]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:75b8e219756\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:24:08 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:24:08 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:24:08 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf2a0e16-6b8b-40a8-8a73-bed2786ed648]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:24:08 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:24:08 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:24:08 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[528f68c1-20bf-4d57-99c8-81727ae6d17b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:24:08 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[db840ff5-0c28-4643-9f5d-e92b49b02080]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:24:08 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Running cmd (subprocess): nvme version {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:24:08 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] 'nvme version' failed. Not Retrying. {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 12:24:08 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.nvmeof [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] nvme not present on system {{(pid=74960) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 12:24:08 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:24:08 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 12:24:08 user nova-compute[74960]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 12:24:08 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4f6bfc9-a0a5-4f07-923b-8b3195a43866]: (4, '') {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:24:08 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74960) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 12:24:08 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74960) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 12:24:08 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] LIGHTOS: no hostnqn found. {{(pid=74960) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 12:24:08 user nova-compute[74960]: DEBUG os_brick.utils [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:75b8e219756', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:24:08 user nova-compute[74960]: DEBUG nova.virt.block_device [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Updating existing volume attachment record: 9eaab91f-85c8-4173-9e8a-a3cb87616ec9 {{(pid=74960) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 12:24:11 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:24:12 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:24:14 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:24:16 user nova-compute[74960]: DEBUG nova.compute.manager [req-508a07de-2380-4914-8210-90aa868cef7a req-9c865270-82c6-40d1-8911-d4d4098decc9 service nova] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] Received event network-changed-4d0cd9f3-3345-43ce-b449-8a46402e6cbd {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:24:16 user nova-compute[74960]: DEBUG nova.compute.manager [req-508a07de-2380-4914-8210-90aa868cef7a req-9c865270-82c6-40d1-8911-d4d4098decc9 service nova] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] Refreshing instance network info cache due to event network-changed-4d0cd9f3-3345-43ce-b449-8a46402e6cbd. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 12:24:16 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-508a07de-2380-4914-8210-90aa868cef7a req-9c865270-82c6-40d1-8911-d4d4098decc9 service nova] Acquiring lock "refresh_cache-05956d9b-0646-43d2-a4cd-19e9090020ee" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:24:16 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-508a07de-2380-4914-8210-90aa868cef7a req-9c865270-82c6-40d1-8911-d4d4098decc9 service nova] Acquired lock "refresh_cache-05956d9b-0646-43d2-a4cd-19e9090020ee" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:24:16 user nova-compute[74960]: DEBUG nova.network.neutron [req-508a07de-2380-4914-8210-90aa868cef7a req-9c865270-82c6-40d1-8911-d4d4098decc9 service nova] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] Refreshing network info cache for port 4d0cd9f3-3345-43ce-b449-8a46402e6cbd {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 12:24:16 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:24:17 user nova-compute[74960]: DEBUG nova.network.neutron [req-508a07de-2380-4914-8210-90aa868cef7a req-9c865270-82c6-40d1-8911-d4d4098decc9 service nova] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] Updated VIF entry in instance network info cache for port 4d0cd9f3-3345-43ce-b449-8a46402e6cbd. {{(pid=74960) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 12:24:17 user nova-compute[74960]: DEBUG nova.network.neutron [req-508a07de-2380-4914-8210-90aa868cef7a req-9c865270-82c6-40d1-8911-d4d4098decc9 service nova] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] Updating instance_info_cache with network_info: [{"id": "4d0cd9f3-3345-43ce-b449-8a46402e6cbd", "address": "fa:16:3e:28:71:ee", "network": {"id": "b3813163-d09b-4c0b-a328-1bbb4c7e2875", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1681555035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d4a374c1c544718887bd75b77a72a3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d0cd9f3-33", "ovs_interfaceid": "4d0cd9f3-3345-43ce-b449-8a46402e6cbd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:24:17 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-508a07de-2380-4914-8210-90aa868cef7a req-9c865270-82c6-40d1-8911-d4d4098decc9 service nova] Releasing lock "refresh_cache-05956d9b-0646-43d2-a4cd-19e9090020ee" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:24:17 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:24:18 user nova-compute[74960]: DEBUG nova.compute.manager [req-fadf7429-5f0e-4ef3-a105-07aef75dfa0f req-d34efe63-7519-4d86-90b0-2730dd34ba07 service nova] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] Received event network-changed-4d0cd9f3-3345-43ce-b449-8a46402e6cbd {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:24:18 user nova-compute[74960]: DEBUG nova.compute.manager [req-fadf7429-5f0e-4ef3-a105-07aef75dfa0f req-d34efe63-7519-4d86-90b0-2730dd34ba07 service nova] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] Refreshing instance network info cache due to event network-changed-4d0cd9f3-3345-43ce-b449-8a46402e6cbd. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 12:24:18 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-fadf7429-5f0e-4ef3-a105-07aef75dfa0f req-d34efe63-7519-4d86-90b0-2730dd34ba07 service nova] Acquiring lock "refresh_cache-05956d9b-0646-43d2-a4cd-19e9090020ee" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:24:18 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-fadf7429-5f0e-4ef3-a105-07aef75dfa0f req-d34efe63-7519-4d86-90b0-2730dd34ba07 service nova] Acquired lock "refresh_cache-05956d9b-0646-43d2-a4cd-19e9090020ee" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:24:18 user nova-compute[74960]: DEBUG nova.network.neutron [req-fadf7429-5f0e-4ef3-a105-07aef75dfa0f req-d34efe63-7519-4d86-90b0-2730dd34ba07 service nova] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] Refreshing network info cache for port 4d0cd9f3-3345-43ce-b449-8a46402e6cbd {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 12:24:18 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-028ea2e9-2137-4c05-91be-0e3760278362 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Acquiring lock "05956d9b-0646-43d2-a4cd-19e9090020ee" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:24:18 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-028ea2e9-2137-4c05-91be-0e3760278362 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Lock "05956d9b-0646-43d2-a4cd-19e9090020ee" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:24:18 user nova-compute[74960]: INFO nova.compute.manager [None req-028ea2e9-2137-4c05-91be-0e3760278362 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] Detaching volume 1bcf17d9-fd5c-4707-9091-a767c871bc02
Nov 03 12:24:18 user nova-compute[74960]: INFO nova.virt.block_device [None req-028ea2e9-2137-4c05-91be-0e3760278362 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] Attempting to driver detach volume 1bcf17d9-fd5c-4707-9091-a767c871bc02 from mountpoint /dev/vdb
Nov 03 12:24:18 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-028ea2e9-2137-4c05-91be-0e3760278362 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Attempting to detach device vdb from instance 05956d9b-0646-43d2-a4cd-19e9090020ee from the persistent domain config. {{(pid=74960) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 03 12:24:18 user nova-compute[74960]: DEBUG nova.virt.libvirt.guest [None req-028ea2e9-2137-4c05-91be-0e3760278362 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 12:24:18 user nova-compute[74960]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 12:24:18 user nova-compute[74960]:   <source dev="/dev/sdc"/>
Nov 03 12:24:18 user nova-compute[74960]:   <target dev="vdb" bus="virtio"/>
Nov 03 12:24:18 user nova-compute[74960]:   <serial>1bcf17d9-fd5c-4707-9091-a767c871bc02</serial>
Nov 03 12:24:18 user nova-compute[74960]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 03 12:24:18 user nova-compute[74960]: </disk>
Nov 03 12:24:18 user nova-compute[74960]:  {{(pid=74960) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 12:24:18 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-028ea2e9-2137-4c05-91be-0e3760278362 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Successfully detached device vdb from instance 05956d9b-0646-43d2-a4cd-19e9090020ee from the persistent domain config.
Nov 03 12:24:18 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-028ea2e9-2137-4c05-91be-0e3760278362 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 05956d9b-0646-43d2-a4cd-19e9090020ee from the live domain config. {{(pid=74960) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 03 12:24:18 user nova-compute[74960]: DEBUG nova.virt.libvirt.guest [None req-028ea2e9-2137-4c05-91be-0e3760278362 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 12:24:18 user nova-compute[74960]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 12:24:18 user nova-compute[74960]:   <source dev="/dev/sdc"/>
Nov 03 12:24:18 user nova-compute[74960]:   <target dev="vdb" bus="virtio"/>
Nov 03 12:24:18 user nova-compute[74960]:   <serial>1bcf17d9-fd5c-4707-9091-a767c871bc02</serial>
Nov 03 12:24:18 user nova-compute[74960]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 03 12:24:18 user nova-compute[74960]: </disk>
Nov 03 12:24:18 user nova-compute[74960]:  {{(pid=74960) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 12:24:18 user nova-compute[74960]: DEBUG nova.network.neutron [req-fadf7429-5f0e-4ef3-a105-07aef75dfa0f req-d34efe63-7519-4d86-90b0-2730dd34ba07 service nova] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] Updated VIF entry in instance network info cache for port 4d0cd9f3-3345-43ce-b449-8a46402e6cbd. {{(pid=74960) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 12:24:18 user nova-compute[74960]: DEBUG nova.network.neutron [req-fadf7429-5f0e-4ef3-a105-07aef75dfa0f req-d34efe63-7519-4d86-90b0-2730dd34ba07 service nova] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] Updating instance_info_cache with network_info: [{"id": "4d0cd9f3-3345-43ce-b449-8a46402e6cbd", "address": "fa:16:3e:28:71:ee", "network": {"id": "b3813163-d09b-4c0b-a328-1bbb4c7e2875", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1681555035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d4a374c1c544718887bd75b77a72a3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d0cd9f3-33", "ovs_interfaceid": "4d0cd9f3-3345-43ce-b449-8a46402e6cbd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:24:18 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-fadf7429-5f0e-4ef3-a105-07aef75dfa0f req-d34efe63-7519-4d86-90b0-2730dd34ba07 service nova] Releasing lock "refresh_cache-05956d9b-0646-43d2-a4cd-19e9090020ee" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:24:18 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:24:18 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-028ea2e9-2137-4c05-91be-0e3760278362 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 05956d9b-0646-43d2-a4cd-19e9090020ee {{(pid=74960) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 03 12:24:20 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-2d88af51-e3c4-4d93-9a77-4bea25a41319 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Acquiring lock "e6cbb630-254f-4c56-9cf9-47d751c703be" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:24:20 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-2d88af51-e3c4-4d93-9a77-4bea25a41319 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Lock "e6cbb630-254f-4c56-9cf9-47d751c703be" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:24:20 user nova-compute[74960]: DEBUG nova.compute.manager [None req-2d88af51-e3c4-4d93-9a77-4bea25a41319 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: e6cbb630-254f-4c56-9cf9-47d751c703be] Starting instance... {{(pid=74960) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 12:24:21 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-2d88af51-e3c4-4d93-9a77-4bea25a41319 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:24:21 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-2d88af51-e3c4-4d93-9a77-4bea25a41319 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:24:21 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-2d88af51-e3c4-4d93-9a77-4bea25a41319 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74960) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 12:24:21 user nova-compute[74960]: INFO nova.compute.claims [None req-2d88af51-e3c4-4d93-9a77-4bea25a41319 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: e6cbb630-254f-4c56-9cf9-47d751c703be] Claim successful on node user
Nov 03 12:24:21 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-2d88af51-e3c4-4d93-9a77-4bea25a41319 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:24:21 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-2d88af51-e3c4-4d93-9a77-4bea25a41319 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:24:21 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-2d88af51-e3c4-4d93-9a77-4bea25a41319 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.446s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:24:21 user nova-compute[74960]: DEBUG nova.compute.manager [None req-2d88af51-e3c4-4d93-9a77-4bea25a41319 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: e6cbb630-254f-4c56-9cf9-47d751c703be] Start building networks asynchronously for instance. {{(pid=74960) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 12:24:21 user nova-compute[74960]: DEBUG nova.compute.manager [None req-2d88af51-e3c4-4d93-9a77-4bea25a41319 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: e6cbb630-254f-4c56-9cf9-47d751c703be] Allocating IP information in the background. {{(pid=74960) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 12:24:21 user nova-compute[74960]: DEBUG nova.network.neutron [None req-2d88af51-e3c4-4d93-9a77-4bea25a41319 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: e6cbb630-254f-4c56-9cf9-47d751c703be] allocate_for_instance() {{(pid=74960) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 12:24:21 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-2d88af51-e3c4-4d93-9a77-4bea25a41319 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: e6cbb630-254f-4c56-9cf9-47d751c703be] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 12:24:21 user nova-compute[74960]: DEBUG nova.compute.manager [None req-2d88af51-e3c4-4d93-9a77-4bea25a41319 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: e6cbb630-254f-4c56-9cf9-47d751c703be] Start building block device mappings for instance. {{(pid=74960) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 12:24:21 user nova-compute[74960]: DEBUG nova.policy [None req-2d88af51-e3c4-4d93-9a77-4bea25a41319 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fae69462930546bdb9cf6e2a11a0df2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c216dd7629274eafbf0a5968ff2378a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74960) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 12:24:21 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:24:21 user nova-compute[74960]: DEBUG nova.compute.manager [None req-2d88af51-e3c4-4d93-9a77-4bea25a41319 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: e6cbb630-254f-4c56-9cf9-47d751c703be] Start spawning the instance on the hypervisor. {{(pid=74960) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 12:24:21 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-2d88af51-e3c4-4d93-9a77-4bea25a41319 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: e6cbb630-254f-4c56-9cf9-47d751c703be] Creating instance directory {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 12:24:21 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-2d88af51-e3c4-4d93-9a77-4bea25a41319 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: e6cbb630-254f-4c56-9cf9-47d751c703be] Creating image(s)
Nov 03 12:24:21 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-2d88af51-e3c4-4d93-9a77-4bea25a41319 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Acquiring lock "/opt/stack/data/nova/instances/e6cbb630-254f-4c56-9cf9-47d751c703be/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:24:21 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-2d88af51-e3c4-4d93-9a77-4bea25a41319 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Lock "/opt/stack/data/nova/instances/e6cbb630-254f-4c56-9cf9-47d751c703be/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:24:21 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-2d88af51-e3c4-4d93-9a77-4bea25a41319 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Lock "/opt/stack/data/nova/instances/e6cbb630-254f-4c56-9cf9-47d751c703be/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:24:21 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-2d88af51-e3c4-4d93-9a77-4bea25a41319 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:24:22 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-2d88af51-e3c4-4d93-9a77-4bea25a41319 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.205s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:24:22 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-2d88af51-e3c4-4d93-9a77-4bea25a41319 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Acquiring lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:24:22 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-2d88af51-e3c4-4d93-9a77-4bea25a41319 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:24:22 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-2d88af51-e3c4-4d93-9a77-4bea25a41319 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:24:22 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-2d88af51-e3c4-4d93-9a77-4bea25a41319 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.183s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:24:22 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-2d88af51-e3c4-4d93-9a77-4bea25a41319 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910,backing_fmt=raw /opt/stack/data/nova/instances/e6cbb630-254f-4c56-9cf9-47d751c703be/disk 1073741824 {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:24:22 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-2d88af51-e3c4-4d93-9a77-4bea25a41319 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910,backing_fmt=raw /opt/stack/data/nova/instances/e6cbb630-254f-4c56-9cf9-47d751c703be/disk 1073741824" returned: 0 in 0.053s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:24:22 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-2d88af51-e3c4-4d93-9a77-4bea25a41319 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:24:22 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-2d88af51-e3c4-4d93-9a77-4bea25a41319 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:24:22 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-2d88af51-e3c4-4d93-9a77-4bea25a41319 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.190s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:24:22 user nova-compute[74960]: DEBUG nova.virt.disk.api [None req-2d88af51-e3c4-4d93-9a77-4bea25a41319 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e6cbb630-254f-4c56-9cf9-47d751c703be/disk. size=1073741824 {{(pid=74960) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 12:24:22 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-2d88af51-e3c4-4d93-9a77-4bea25a41319 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6cbb630-254f-4c56-9cf9-47d751c703be/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:24:22 user nova-compute[74960]: DEBUG nova.network.neutron [None req-2d88af51-e3c4-4d93-9a77-4bea25a41319 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: e6cbb630-254f-4c56-9cf9-47d751c703be] Successfully created port: b5f672c1-3298-4c5a-bf4d-7c712e4c5873 {{(pid=74960) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 12:24:22 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-2d88af51-e3c4-4d93-9a77-4bea25a41319 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6cbb630-254f-4c56-9cf9-47d751c703be/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:24:22 user nova-compute[74960]: DEBUG nova.virt.disk.api [None req-2d88af51-e3c4-4d93-9a77-4bea25a41319 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Cannot resize image /opt/stack/data/nova/instances/e6cbb630-254f-4c56-9cf9-47d751c703be/disk to a smaller size. {{(pid=74960) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 12:24:22 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-2d88af51-e3c4-4d93-9a77-4bea25a41319 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: e6cbb630-254f-4c56-9cf9-47d751c703be] Created local disks {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 12:24:22 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-2d88af51-e3c4-4d93-9a77-4bea25a41319 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: e6cbb630-254f-4c56-9cf9-47d751c703be] Ensure instance console log exists: /opt/stack/data/nova/instances/e6cbb630-254f-4c56-9cf9-47d751c703be/console.log {{(pid=74960) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 12:24:22 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-2d88af51-e3c4-4d93-9a77-4bea25a41319 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:24:22 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-2d88af51-e3c4-4d93-9a77-4bea25a41319 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:24:22 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-2d88af51-e3c4-4d93-9a77-4bea25a41319 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:24:22 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:24:23 user nova-compute[74960]: DEBUG nova.network.neutron [None req-2d88af51-e3c4-4d93-9a77-4bea25a41319 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: e6cbb630-254f-4c56-9cf9-47d751c703be] Successfully updated port: b5f672c1-3298-4c5a-bf4d-7c712e4c5873 {{(pid=74960) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 12:24:23 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-2d88af51-e3c4-4d93-9a77-4bea25a41319 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Acquiring lock "refresh_cache-e6cbb630-254f-4c56-9cf9-47d751c703be" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:24:23 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-2d88af51-e3c4-4d93-9a77-4bea25a41319 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Acquired lock "refresh_cache-e6cbb630-254f-4c56-9cf9-47d751c703be" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:24:23 user nova-compute[74960]: DEBUG nova.network.neutron [None req-2d88af51-e3c4-4d93-9a77-4bea25a41319 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: e6cbb630-254f-4c56-9cf9-47d751c703be] Building network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 12:24:23 user nova-compute[74960]: DEBUG nova.compute.manager [req-38774215-30d6-4b36-8c97-562f6b8167b1 req-8e6719cc-f9b4-4c9f-900e-598a77ce0ff7 service nova] [instance: e6cbb630-254f-4c56-9cf9-47d751c703be] Received event network-changed-b5f672c1-3298-4c5a-bf4d-7c712e4c5873 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:24:23 user nova-compute[74960]: DEBUG nova.compute.manager [req-38774215-30d6-4b36-8c97-562f6b8167b1 req-8e6719cc-f9b4-4c9f-900e-598a77ce0ff7 service nova] [instance: e6cbb630-254f-4c56-9cf9-47d751c703be] Refreshing instance network info cache due to event network-changed-b5f672c1-3298-4c5a-bf4d-7c712e4c5873. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 12:24:23 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-38774215-30d6-4b36-8c97-562f6b8167b1 req-8e6719cc-f9b4-4c9f-900e-598a77ce0ff7 service nova] Acquiring lock "refresh_cache-e6cbb630-254f-4c56-9cf9-47d751c703be" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:24:23 user nova-compute[74960]: DEBUG nova.network.neutron [None req-2d88af51-e3c4-4d93-9a77-4bea25a41319 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: e6cbb630-254f-4c56-9cf9-47d751c703be] Instance cache missing network info. {{(pid=74960) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 12:24:23 user nova-compute[74960]: DEBUG nova.network.neutron [None req-2d88af51-e3c4-4d93-9a77-4bea25a41319 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: e6cbb630-254f-4c56-9cf9-47d751c703be] Updating instance_info_cache with network_info: [{"id": "b5f672c1-3298-4c5a-bf4d-7c712e4c5873", "address": "fa:16:3e:5b:1b:87", "network": {"id": "c03e854d-75a3-4e81-9cdf-f1139841266c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1632999031-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c216dd7629274eafbf0a5968ff2378a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f672c1-32", "ovs_interfaceid": "b5f672c1-3298-4c5a-bf4d-7c712e4c5873", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:24:23 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-2d88af51-e3c4-4d93-9a77-4bea25a41319 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Releasing lock "refresh_cache-e6cbb630-254f-4c56-9cf9-47d751c703be" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:24:23 user nova-compute[74960]: DEBUG nova.compute.manager [None req-2d88af51-e3c4-4d93-9a77-4bea25a41319 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: e6cbb630-254f-4c56-9cf9-47d751c703be] Instance network_info: |[{"id": "b5f672c1-3298-4c5a-bf4d-7c712e4c5873", "address": "fa:16:3e:5b:1b:87", "network": {"id": "c03e854d-75a3-4e81-9cdf-f1139841266c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1632999031-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c216dd7629274eafbf0a5968ff2378a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f672c1-32", "ovs_interfaceid": "b5f672c1-3298-4c5a-bf4d-7c712e4c5873", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74960) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 12:24:23 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-38774215-30d6-4b36-8c97-562f6b8167b1 req-8e6719cc-f9b4-4c9f-900e-598a77ce0ff7 service nova] Acquired lock "refresh_cache-e6cbb630-254f-4c56-9cf9-47d751c703be" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:24:23 user nova-compute[74960]: DEBUG nova.network.neutron [req-38774215-30d6-4b36-8c97-562f6b8167b1 req-8e6719cc-f9b4-4c9f-900e-598a77ce0ff7 service nova] [instance: e6cbb630-254f-4c56-9cf9-47d751c703be] Refreshing network info cache for port b5f672c1-3298-4c5a-bf4d-7c712e4c5873 {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 12:24:23 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-2d88af51-e3c4-4d93-9a77-4bea25a41319 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: e6cbb630-254f-4c56-9cf9-47d751c703be] Start _get_guest_xml network_info=[{"id": "b5f672c1-3298-4c5a-bf4d-7c712e4c5873", "address": "fa:16:3e:5b:1b:87", "network": {"id": "c03e854d-75a3-4e81-9cdf-f1139841266c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1632999031-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c216dd7629274eafbf0a5968ff2378a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f672c1-32", "ovs_interfaceid": "b5f672c1-3298-4c5a-bf4d-7c712e4c5873", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=549f51ba-ac69-494b-8de1-34635aa2d7cf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='63ee9c80c632442fb0379f47b784bd20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T12:13:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'image_id': '549f51ba-ac69-494b-8de1-34635aa2d7cf'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 12:24:23 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-2d88af51-e3c4-4d93-9a77-4bea25a41319 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:24:23 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-2d88af51-e3c4-4d93-9a77-4bea25a41319 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:24:23 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-2d88af51-e3c4-4d93-9a77-4bea25a41319 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 12:24:23 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-2d88af51-e3c4-4d93-9a77-4bea25a41319 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] CPU controller missing on host. {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 12:24:23 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-2d88af51-e3c4-4d93-9a77-4bea25a41319 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 12:24:23 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-2d88af51-e3c4-4d93-9a77-4bea25a41319 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] CPU controller found on host. {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 12:24:23 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-2d88af51-e3c4-4d93-9a77-4bea25a41319 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74960) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 12:24:23 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-2d88af51-e3c4-4d93-9a77-4bea25a41319 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=549f51ba-ac69-494b-8de1-34635aa2d7cf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='63ee9c80c632442fb0379f47b784bd20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T12:13:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 12:24:23 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-2d88af51-e3c4-4d93-9a77-4bea25a41319 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Flavor limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 12:24:23 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-2d88af51-e3c4-4d93-9a77-4bea25a41319 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Image limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 12:24:23 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-2d88af51-e3c4-4d93-9a77-4bea25a41319 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Flavor pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 12:24:23 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-2d88af51-e3c4-4d93-9a77-4bea25a41319 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Image pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 12:24:23 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-2d88af51-e3c4-4d93-9a77-4bea25a41319 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 12:24:23 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-2d88af51-e3c4-4d93-9a77-4bea25a41319 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 12:24:23 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-2d88af51-e3c4-4d93-9a77-4bea25a41319 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 12:24:23 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-2d88af51-e3c4-4d93-9a77-4bea25a41319 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Got 1 possible topologies {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 12:24:23 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-2d88af51-e3c4-4d93-9a77-4bea25a41319 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 12:24:23 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-2d88af51-e3c4-4d93-9a77-4bea25a41319 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 12:24:23 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-2d88af51-e3c4-4d93-9a77-4bea25a41319 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:24:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1644828034',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1644828034',id=19,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBByEuco6vUpQ1yRzD8+T3c8kNK+AQMUFF0dlFJOn3loibIfbxPBaNP5PcdHo8YH4HcBd16j2Mx3GJQr5JshLcaNKXedxYhHHkaVLhD0FOSjY4W2miuaoDcU64srC5P9Ncg==',key_name='tempest-keypair-1090973974',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c216dd7629274eafbf0a5968ff2378a9',ramdisk_id='',reservation_id='r-t48sleg2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-258463843',owner_user_name='tempest-AttachVolumeShelveTestJSON-258463843-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:24:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fae69462930546bdb9cf6e2a11a0df2a',uuid=e6cbb630-254f-4c56-9cf9-47d751c703be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b5f672c1-3298-4c5a-bf4d-7c712e4c5873", "address": "fa:16:3e:5b:1b:87", "network": {"id": "c03e854d-75a3-4e81-9cdf-f1139841266c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1632999031-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c216dd7629274eafbf0a5968ff2378a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f672c1-32", "ovs_interfaceid": "b5f672c1-3298-4c5a-bf4d-7c712e4c5873", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74960) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 12:24:23 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-2d88af51-e3c4-4d93-9a77-4bea25a41319 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Converting VIF {"id": "b5f672c1-3298-4c5a-bf4d-7c712e4c5873", "address": "fa:16:3e:5b:1b:87", "network": {"id": "c03e854d-75a3-4e81-9cdf-f1139841266c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1632999031-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c216dd7629274eafbf0a5968ff2378a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f672c1-32", "ovs_interfaceid": "b5f672c1-3298-4c5a-bf4d-7c712e4c5873", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:24:23 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-2d88af51-e3c4-4d93-9a77-4bea25a41319 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:1b:87,bridge_name='br-int',has_traffic_filtering=True,id=b5f672c1-3298-4c5a-bf4d-7c712e4c5873,network=Network(c03e854d-75a3-4e81-9cdf-f1139841266c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5f672c1-32') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:24:23 user nova-compute[74960]: DEBUG nova.objects.instance [None req-2d88af51-e3c4-4d93-9a77-4bea25a41319 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Lazy-loading 'pci_devices' on Instance uuid e6cbb630-254f-4c56-9cf9-47d751c703be {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:24:23 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-2d88af51-e3c4-4d93-9a77-4bea25a41319 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: e6cbb630-254f-4c56-9cf9-47d751c703be] End _get_guest_xml xml=<domain type="kvm">
Nov 03 12:24:23 user nova-compute[74960]:   <uuid>e6cbb630-254f-4c56-9cf9-47d751c703be</uuid>
Nov 03 12:24:23 user nova-compute[74960]:   <name>instance-00000013</name>
Nov 03 12:24:23 user nova-compute[74960]:   <memory>524288</memory>
Nov 03 12:24:23 user nova-compute[74960]:   <vcpu>1</vcpu>
Nov 03 12:24:23 user nova-compute[74960]:   <metadata>
Nov 03 12:24:23 user nova-compute[74960]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 12:24:23 user nova-compute[74960]:       <nova:package version="0.0.0"/>
Nov 03 12:24:23 user nova-compute[74960]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1644828034</nova:name>
Nov 03 12:24:23 user nova-compute[74960]:       <nova:creationTime>2023-11-03 12:24:23</nova:creationTime>
Nov 03 12:24:23 user nova-compute[74960]:       <nova:flavor name="m1.tiny">
Nov 03 12:24:23 user nova-compute[74960]:         <nova:memory>512</nova:memory>
Nov 03 12:24:23 user nova-compute[74960]:         <nova:disk>1</nova:disk>
Nov 03 12:24:23 user nova-compute[74960]:         <nova:swap>0</nova:swap>
Nov 03 12:24:23 user nova-compute[74960]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 12:24:23 user nova-compute[74960]:         <nova:vcpus>1</nova:vcpus>
Nov 03 12:24:23 user nova-compute[74960]:       </nova:flavor>
Nov 03 12:24:23 user nova-compute[74960]:       <nova:owner>
Nov 03 12:24:23 user nova-compute[74960]:         <nova:user uuid="fae69462930546bdb9cf6e2a11a0df2a">tempest-AttachVolumeShelveTestJSON-258463843-project-member</nova:user>
Nov 03 12:24:23 user nova-compute[74960]:         <nova:project uuid="c216dd7629274eafbf0a5968ff2378a9">tempest-AttachVolumeShelveTestJSON-258463843</nova:project>
Nov 03 12:24:23 user nova-compute[74960]:       </nova:owner>
Nov 03 12:24:23 user nova-compute[74960]:       <nova:root type="image" uuid="549f51ba-ac69-494b-8de1-34635aa2d7cf"/>
Nov 03 12:24:23 user nova-compute[74960]:       <nova:ports>
Nov 03 12:24:23 user nova-compute[74960]:         <nova:port uuid="b5f672c1-3298-4c5a-bf4d-7c712e4c5873">
Nov 03 12:24:23 user nova-compute[74960]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 03 12:24:23 user nova-compute[74960]:         </nova:port>
Nov 03 12:24:23 user nova-compute[74960]:       </nova:ports>
Nov 03 12:24:23 user nova-compute[74960]:     </nova:instance>
Nov 03 12:24:23 user nova-compute[74960]:   </metadata>
Nov 03 12:24:23 user nova-compute[74960]:   <sysinfo type="smbios">
Nov 03 12:24:23 user nova-compute[74960]:     <system>
Nov 03 12:24:23 user nova-compute[74960]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 12:24:23 user nova-compute[74960]:       <entry name="product">OpenStack Nova</entry>
Nov 03 12:24:23 user nova-compute[74960]:       <entry name="version">0.0.0</entry>
Nov 03 12:24:23 user nova-compute[74960]:       <entry name="serial">e6cbb630-254f-4c56-9cf9-47d751c703be</entry>
Nov 03 12:24:23 user nova-compute[74960]:       <entry name="uuid">e6cbb630-254f-4c56-9cf9-47d751c703be</entry>
Nov 03 12:24:23 user nova-compute[74960]:       <entry name="family">Virtual Machine</entry>
Nov 03 12:24:23 user nova-compute[74960]:     </system>
Nov 03 12:24:23 user nova-compute[74960]:   </sysinfo>
Nov 03 12:24:23 user nova-compute[74960]:   <os>
Nov 03 12:24:23 user nova-compute[74960]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 12:24:23 user nova-compute[74960]:     <boot dev="hd"/>
Nov 03 12:24:23 user nova-compute[74960]:     <smbios mode="sysinfo"/>
Nov 03 12:24:23 user nova-compute[74960]:   </os>
Nov 03 12:24:23 user nova-compute[74960]:   <features>
Nov 03 12:24:23 user nova-compute[74960]:     <acpi/>
Nov 03 12:24:23 user nova-compute[74960]:     <apic/>
Nov 03 12:24:23 user nova-compute[74960]:     <vmcoreinfo/>
Nov 03 12:24:23 user nova-compute[74960]:   </features>
Nov 03 12:24:23 user nova-compute[74960]:   <clock offset="utc">
Nov 03 12:24:23 user nova-compute[74960]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 12:24:23 user nova-compute[74960]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 12:24:23 user nova-compute[74960]:     <timer name="hpet" present="no"/>
Nov 03 12:24:23 user nova-compute[74960]:   </clock>
Nov 03 12:24:23 user nova-compute[74960]:   <cpu mode="custom" match="exact">
Nov 03 12:24:23 user nova-compute[74960]:     <model>Nehalem</model>
Nov 03 12:24:23 user nova-compute[74960]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 12:24:23 user nova-compute[74960]:   </cpu>
Nov 03 12:24:23 user nova-compute[74960]:   <devices>
Nov 03 12:24:23 user nova-compute[74960]:     <disk type="file" device="disk">
Nov 03 12:24:23 user nova-compute[74960]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 12:24:23 user nova-compute[74960]:       <source file="/opt/stack/data/nova/instances/e6cbb630-254f-4c56-9cf9-47d751c703be/disk"/>
Nov 03 12:24:23 user nova-compute[74960]:       <target dev="vda" bus="virtio"/>
Nov 03 12:24:23 user nova-compute[74960]:     </disk>
Nov 03 12:24:23 user nova-compute[74960]:     <interface type="ethernet">
Nov 03 12:24:23 user nova-compute[74960]:       <mac address="fa:16:3e:5b:1b:87"/>
Nov 03 12:24:23 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:24:23 user nova-compute[74960]:       <mtu size="1442"/>
Nov 03 12:24:23 user nova-compute[74960]:       <target dev="tapb5f672c1-32"/>
Nov 03 12:24:23 user nova-compute[74960]:     </interface>
Nov 03 12:24:23 user nova-compute[74960]:     <serial type="pty">
Nov 03 12:24:23 user nova-compute[74960]:       <log file="/opt/stack/data/nova/instances/e6cbb630-254f-4c56-9cf9-47d751c703be/console.log" append="off"/>
Nov 03 12:24:23 user nova-compute[74960]:     </serial>
Nov 03 12:24:23 user nova-compute[74960]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 12:24:23 user nova-compute[74960]:     <video>
Nov 03 12:24:23 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:24:23 user nova-compute[74960]:     </video>
Nov 03 12:24:23 user nova-compute[74960]:     <rng model="virtio">
Nov 03 12:24:23 user nova-compute[74960]:       <backend model="random">/dev/urandom</backend>
Nov 03 12:24:23 user nova-compute[74960]:     </rng>
Nov 03 12:24:23 user nova-compute[74960]:     <controller type="usb" index="0" model="none"/>
Nov 03 12:24:23 user nova-compute[74960]:     <memballoon model="virtio">
Nov 03 12:24:23 user nova-compute[74960]:       <stats period="10"/>
Nov 03 12:24:23 user nova-compute[74960]:     </memballoon>
Nov 03 12:24:23 user nova-compute[74960]:   </devices>
Nov 03 12:24:23 user nova-compute[74960]: </domain>
Nov 03 12:24:23 user nova-compute[74960]:  {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 12:24:23 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-2d88af51-e3c4-4d93-9a77-4bea25a41319 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:24:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1644828034',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1644828034',id=19,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBByEuco6vUpQ1yRzD8+T3c8kNK+AQMUFF0dlFJOn3loibIfbxPBaNP5PcdHo8YH4HcBd16j2Mx3GJQr5JshLcaNKXedxYhHHkaVLhD0FOSjY4W2miuaoDcU64srC5P9Ncg==',key_name='tempest-keypair-1090973974',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c216dd7629274eafbf0a5968ff2378a9',ramdisk_id='',reservation_id='r-t48sleg2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-258463843',owner_user_name='tempest-AttachVolumeShelveTestJSON-258463843-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:24:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fae69462930546bdb9cf6e2a11a0df2a',uuid=e6cbb630-254f-4c56-9cf9-47d751c703be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b5f672c1-3298-4c5a-bf4d-7c712e4c5873", "address": "fa:16:3e:5b:1b:87", "network": {"id": "c03e854d-75a3-4e81-9cdf-f1139841266c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1632999031-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c216dd7629274eafbf0a5968ff2378a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f672c1-32", "ovs_interfaceid": "b5f672c1-3298-4c5a-bf4d-7c712e4c5873", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 12:24:23 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-2d88af51-e3c4-4d93-9a77-4bea25a41319 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Converting VIF {"id": "b5f672c1-3298-4c5a-bf4d-7c712e4c5873", "address": "fa:16:3e:5b:1b:87", "network": {"id": "c03e854d-75a3-4e81-9cdf-f1139841266c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1632999031-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c216dd7629274eafbf0a5968ff2378a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f672c1-32", "ovs_interfaceid": "b5f672c1-3298-4c5a-bf4d-7c712e4c5873", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:24:23 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-2d88af51-e3c4-4d93-9a77-4bea25a41319 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:1b:87,bridge_name='br-int',has_traffic_filtering=True,id=b5f672c1-3298-4c5a-bf4d-7c712e4c5873,network=Network(c03e854d-75a3-4e81-9cdf-f1139841266c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5f672c1-32') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:24:23 user nova-compute[74960]: DEBUG os_vif [None req-2d88af51-e3c4-4d93-9a77-4bea25a41319 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:1b:87,bridge_name='br-int',has_traffic_filtering=True,id=b5f672c1-3298-4c5a-bf4d-7c712e4c5873,network=Network(c03e854d-75a3-4e81-9cdf-f1139841266c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5f672c1-32') {{(pid=74960) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 12:24:23 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:24:23 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:24:23 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 12:24:23 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:24:23 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a1a03f82-a9d6-51cb-b8d5-13c2d7eb95c3', '_type': 'linux-noop'}}, row=False) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:24:23 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:24:23 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:24:23 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:24:23 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb5f672c1-32, may_exist=True, interface_attrs={}) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:24:23 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb5f672c1-32, col_values=(('qos', UUID('51c126d6-af27-4c84-b645-15ab7f00f779')),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:24:23 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb5f672c1-32, col_values=(('external_ids', {'iface-id': 'b5f672c1-3298-4c5a-bf4d-7c712e4c5873', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5b:1b:87', 'vm-uuid': 'e6cbb630-254f-4c56-9cf9-47d751c703be'}),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:24:23 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:24:23 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:24:23 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:24:23 user nova-compute[74960]: INFO os_vif [None req-2d88af51-e3c4-4d93-9a77-4bea25a41319 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:1b:87,bridge_name='br-int',has_traffic_filtering=True,id=b5f672c1-3298-4c5a-bf4d-7c712e4c5873,network=Network(c03e854d-75a3-4e81-9cdf-f1139841266c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5f672c1-32')
Nov 03 12:24:23 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-2d88af51-e3c4-4d93-9a77-4bea25a41319 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] No BDM found with device name vda, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:24:23 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-2d88af51-e3c4-4d93-9a77-4bea25a41319 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] No VIF found with MAC fa:16:3e:5b:1b:87, not building metadata {{(pid=74960) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 12:24:24 user nova-compute[74960]: DEBUG nova.network.neutron [req-38774215-30d6-4b36-8c97-562f6b8167b1 req-8e6719cc-f9b4-4c9f-900e-598a77ce0ff7 service nova] [instance: e6cbb630-254f-4c56-9cf9-47d751c703be] Updated VIF entry in instance network info cache for port b5f672c1-3298-4c5a-bf4d-7c712e4c5873. {{(pid=74960) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 12:24:24 user nova-compute[74960]: DEBUG nova.network.neutron [req-38774215-30d6-4b36-8c97-562f6b8167b1 req-8e6719cc-f9b4-4c9f-900e-598a77ce0ff7 service nova] [instance: e6cbb630-254f-4c56-9cf9-47d751c703be] Updating instance_info_cache with network_info: [{"id": "b5f672c1-3298-4c5a-bf4d-7c712e4c5873", "address": "fa:16:3e:5b:1b:87", "network": {"id": "c03e854d-75a3-4e81-9cdf-f1139841266c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1632999031-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c216dd7629274eafbf0a5968ff2378a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f672c1-32", "ovs_interfaceid": "b5f672c1-3298-4c5a-bf4d-7c712e4c5873", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:24:24 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-38774215-30d6-4b36-8c97-562f6b8167b1 req-8e6719cc-f9b4-4c9f-900e-598a77ce0ff7 service nova] Releasing lock "refresh_cache-e6cbb630-254f-4c56-9cf9-47d751c703be" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:24:25 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:24:25 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:24:25 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:24:25 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:24:25 user nova-compute[74960]: DEBUG nova.compute.manager [req-5bcf86e1-cb8a-4974-a433-baf162c101ab req-c8bc809b-26ea-4e3c-a653-eccb1d80bd5c service nova] [instance: e6cbb630-254f-4c56-9cf9-47d751c703be] Received event network-vif-plugged-b5f672c1-3298-4c5a-bf4d-7c712e4c5873 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:24:25 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-5bcf86e1-cb8a-4974-a433-baf162c101ab req-c8bc809b-26ea-4e3c-a653-eccb1d80bd5c service nova] Acquiring lock "e6cbb630-254f-4c56-9cf9-47d751c703be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:24:25 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-5bcf86e1-cb8a-4974-a433-baf162c101ab req-c8bc809b-26ea-4e3c-a653-eccb1d80bd5c service nova] Lock "e6cbb630-254f-4c56-9cf9-47d751c703be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:24:25 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-5bcf86e1-cb8a-4974-a433-baf162c101ab req-c8bc809b-26ea-4e3c-a653-eccb1d80bd5c service nova] Lock "e6cbb630-254f-4c56-9cf9-47d751c703be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:24:25 user nova-compute[74960]: DEBUG nova.compute.manager [req-5bcf86e1-cb8a-4974-a433-baf162c101ab req-c8bc809b-26ea-4e3c-a653-eccb1d80bd5c service nova] [instance: e6cbb630-254f-4c56-9cf9-47d751c703be] No waiting events found dispatching network-vif-plugged-b5f672c1-3298-4c5a-bf4d-7c712e4c5873 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:24:25 user nova-compute[74960]: WARNING nova.compute.manager [req-5bcf86e1-cb8a-4974-a433-baf162c101ab req-c8bc809b-26ea-4e3c-a653-eccb1d80bd5c service nova] [instance: e6cbb630-254f-4c56-9cf9-47d751c703be] Received unexpected event network-vif-plugged-b5f672c1-3298-4c5a-bf4d-7c712e4c5873 for instance with vm_state building and task_state spawning.
Nov 03 12:24:25 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:24:25 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:24:25 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:24:26 user nova-compute[74960]: DEBUG nova.compute.manager [req-be0a8082-ba76-4313-b034-6dcb182dac14 req-0d96e7ee-f891-4ed3-8199-2d5577ef17e4 service nova] [instance: 9951fab7-4984-408e-94ca-11eab615ff25] Received event network-changed-5782b039-1492-4364-b1b2-6b27ee06c5ce {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:24:26 user nova-compute[74960]: DEBUG nova.compute.manager [req-be0a8082-ba76-4313-b034-6dcb182dac14 req-0d96e7ee-f891-4ed3-8199-2d5577ef17e4 service nova] [instance: 9951fab7-4984-408e-94ca-11eab615ff25] Refreshing instance network info cache due to event network-changed-5782b039-1492-4364-b1b2-6b27ee06c5ce. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 12:24:26 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-be0a8082-ba76-4313-b034-6dcb182dac14 req-0d96e7ee-f891-4ed3-8199-2d5577ef17e4 service nova] Acquiring lock "refresh_cache-9951fab7-4984-408e-94ca-11eab615ff25" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:24:26 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-be0a8082-ba76-4313-b034-6dcb182dac14 req-0d96e7ee-f891-4ed3-8199-2d5577ef17e4 service nova] Acquired lock "refresh_cache-9951fab7-4984-408e-94ca-11eab615ff25" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:24:26 user nova-compute[74960]: DEBUG nova.network.neutron [req-be0a8082-ba76-4313-b034-6dcb182dac14 req-0d96e7ee-f891-4ed3-8199-2d5577ef17e4 service nova] [instance: 9951fab7-4984-408e-94ca-11eab615ff25] Refreshing network info cache for port 5782b039-1492-4364-b1b2-6b27ee06c5ce {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 12:24:27 user nova-compute[74960]: DEBUG nova.network.neutron [req-be0a8082-ba76-4313-b034-6dcb182dac14 req-0d96e7ee-f891-4ed3-8199-2d5577ef17e4 service nova] [instance: 9951fab7-4984-408e-94ca-11eab615ff25] Updated VIF entry in instance network info cache for port 5782b039-1492-4364-b1b2-6b27ee06c5ce. {{(pid=74960) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 12:24:27 user nova-compute[74960]: DEBUG nova.network.neutron [req-be0a8082-ba76-4313-b034-6dcb182dac14 req-0d96e7ee-f891-4ed3-8199-2d5577ef17e4 service nova] [instance: 9951fab7-4984-408e-94ca-11eab615ff25] Updating instance_info_cache with network_info: [{"id": "5782b039-1492-4364-b1b2-6b27ee06c5ce", "address": "fa:16:3e:55:0b:75", "network": {"id": "d6261390-d9b7-447c-be8e-ff6dd1a367ef", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1772643385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d6fbb72509e44ef8003aa2c58a7cf88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5782b039-14", "ovs_interfaceid": "5782b039-1492-4364-b1b2-6b27ee06c5ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:24:27 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-be0a8082-ba76-4313-b034-6dcb182dac14 req-0d96e7ee-f891-4ed3-8199-2d5577ef17e4 service nova] Releasing lock "refresh_cache-9951fab7-4984-408e-94ca-11eab615ff25" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:24:27 user nova-compute[74960]: DEBUG nova.compute.manager [req-169eaa66-f3c6-442f-bdda-ead83d7dce50 req-a71b204e-8bd6-43bd-95d5-cb2e1bccc918 service nova] [instance: e6cbb630-254f-4c56-9cf9-47d751c703be] Received event network-vif-plugged-b5f672c1-3298-4c5a-bf4d-7c712e4c5873 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:24:27 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-169eaa66-f3c6-442f-bdda-ead83d7dce50 req-a71b204e-8bd6-43bd-95d5-cb2e1bccc918 service nova] Acquiring lock "e6cbb630-254f-4c56-9cf9-47d751c703be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:24:27 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-169eaa66-f3c6-442f-bdda-ead83d7dce50 req-a71b204e-8bd6-43bd-95d5-cb2e1bccc918 service nova] Lock "e6cbb630-254f-4c56-9cf9-47d751c703be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:24:27 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-169eaa66-f3c6-442f-bdda-ead83d7dce50 req-a71b204e-8bd6-43bd-95d5-cb2e1bccc918 service nova] Lock "e6cbb630-254f-4c56-9cf9-47d751c703be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:24:27 user nova-compute[74960]: DEBUG nova.compute.manager [req-169eaa66-f3c6-442f-bdda-ead83d7dce50 req-a71b204e-8bd6-43bd-95d5-cb2e1bccc918 service nova] [instance: e6cbb630-254f-4c56-9cf9-47d751c703be] No waiting events found dispatching network-vif-plugged-b5f672c1-3298-4c5a-bf4d-7c712e4c5873 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:24:27 user nova-compute[74960]: WARNING nova.compute.manager [req-169eaa66-f3c6-442f-bdda-ead83d7dce50 req-a71b204e-8bd6-43bd-95d5-cb2e1bccc918 service nova] [instance: e6cbb630-254f-4c56-9cf9-47d751c703be] Received unexpected event network-vif-plugged-b5f672c1-3298-4c5a-bf4d-7c712e4c5873 for instance with vm_state building and task_state spawning.
Nov 03 12:24:27 user nova-compute[74960]: DEBUG nova.compute.manager [None req-2d88af51-e3c4-4d93-9a77-4bea25a41319 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: e6cbb630-254f-4c56-9cf9-47d751c703be] Instance event wait completed in 0 seconds for  {{(pid=74960) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 12:24:27 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-2d88af51-e3c4-4d93-9a77-4bea25a41319 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: e6cbb630-254f-4c56-9cf9-47d751c703be] Guest created on hypervisor {{(pid=74960) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 12:24:27 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: e6cbb630-254f-4c56-9cf9-47d751c703be] Instance spawned successfully.
Nov 03 12:24:27 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-2d88af51-e3c4-4d93-9a77-4bea25a41319 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: e6cbb630-254f-4c56-9cf9-47d751c703be] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 12:24:27 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-2d88af51-e3c4-4d93-9a77-4bea25a41319 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: e6cbb630-254f-4c56-9cf9-47d751c703be] Found default for hw_cdrom_bus of ide {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:24:27 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-2d88af51-e3c4-4d93-9a77-4bea25a41319 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: e6cbb630-254f-4c56-9cf9-47d751c703be] Found default for hw_disk_bus of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:24:27 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-2d88af51-e3c4-4d93-9a77-4bea25a41319 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: e6cbb630-254f-4c56-9cf9-47d751c703be] Found default for hw_input_bus of None {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:24:27 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-2d88af51-e3c4-4d93-9a77-4bea25a41319 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: e6cbb630-254f-4c56-9cf9-47d751c703be] Found default for hw_pointer_model of None {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:24:27 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-2d88af51-e3c4-4d93-9a77-4bea25a41319 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: e6cbb630-254f-4c56-9cf9-47d751c703be] Found default for hw_video_model of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:24:27 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-2d88af51-e3c4-4d93-9a77-4bea25a41319 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: e6cbb630-254f-4c56-9cf9-47d751c703be] Found default for hw_vif_model of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:24:27 user nova-compute[74960]: INFO nova.compute.manager [None req-2d88af51-e3c4-4d93-9a77-4bea25a41319 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: e6cbb630-254f-4c56-9cf9-47d751c703be] Took 5.94 seconds to spawn the instance on the hypervisor.
Nov 03 12:24:27 user nova-compute[74960]: DEBUG nova.compute.manager [None req-2d88af51-e3c4-4d93-9a77-4bea25a41319 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: e6cbb630-254f-4c56-9cf9-47d751c703be] Checking state {{(pid=74960) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 12:24:27 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:24:27 user nova-compute[74960]: INFO nova.compute.manager [None req-2d88af51-e3c4-4d93-9a77-4bea25a41319 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: e6cbb630-254f-4c56-9cf9-47d751c703be] Took 6.83 seconds to build instance.
Nov 03 12:24:27 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-2d88af51-e3c4-4d93-9a77-4bea25a41319 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Lock "e6cbb630-254f-4c56-9cf9-47d751c703be" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.945s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:24:28 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:24:31 user nova-compute[74960]: INFO nova.virt.block_device [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Booting with volume f629b2b5-39ab-4ee3-9633-a534a39c93a5 at /dev/vdc
Nov 03 12:24:32 user nova-compute[74960]: DEBUG os_brick.utils [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:24:32 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:24:32 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:24:32 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ae0d475-a962-4115-94fd-1cd305c13e7d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:75b8e219756\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:24:32 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:24:32 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:24:32 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[b245901d-12a7-4195-921b-c881453140b7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:24:32 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:24:32 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.029s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:24:32 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[56e0e3ba-ff9d-4e15-b00a-08d23a38e9fa]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:24:32 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0d3cb8f-f4b9-4674-b3c4-b755cd26611a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:24:32 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Running cmd (subprocess): nvme version {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:24:32 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] 'nvme version' failed. Not Retrying. {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 12:24:32 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.nvmeof [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] nvme not present on system {{(pid=74960) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 12:24:32 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:24:32 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 12:24:32 user nova-compute[74960]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 12:24:32 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9f5e08e-c128-4dfc-9721-2a348026af93]: (4, '') {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:24:32 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74960) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 12:24:32 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74960) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 12:24:32 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] LIGHTOS: no hostnqn found. {{(pid=74960) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 12:24:32 user nova-compute[74960]: DEBUG os_brick.utils [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:75b8e219756', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:24:32 user nova-compute[74960]: DEBUG nova.virt.block_device [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Updating existing volume attachment record: 7779c008-abc8-461e-ad0e-c96ade62ef55 {{(pid=74960) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 12:24:32 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:24:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:24:37 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:24:38 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-ff4ed1cd-136f-4c84-9208-92cf4fd87a0a tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Acquiring lock "d5c87482-1883-43dc-8872-6a5dff128c94" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:24:38 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-ff4ed1cd-136f-4c84-9208-92cf4fd87a0a tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Lock "d5c87482-1883-43dc-8872-6a5dff128c94" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:24:38 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-ff4ed1cd-136f-4c84-9208-92cf4fd87a0a tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Acquiring lock "d5c87482-1883-43dc-8872-6a5dff128c94-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:24:38 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-ff4ed1cd-136f-4c84-9208-92cf4fd87a0a tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Lock "d5c87482-1883-43dc-8872-6a5dff128c94-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:24:38 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-ff4ed1cd-136f-4c84-9208-92cf4fd87a0a tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Lock "d5c87482-1883-43dc-8872-6a5dff128c94-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:24:38 user nova-compute[74960]: INFO nova.compute.manager [None req-ff4ed1cd-136f-4c84-9208-92cf4fd87a0a tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] [instance: d5c87482-1883-43dc-8872-6a5dff128c94] Terminating instance
Nov 03 12:24:38 user nova-compute[74960]: DEBUG nova.compute.manager [None req-ff4ed1cd-136f-4c84-9208-92cf4fd87a0a tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] [instance: d5c87482-1883-43dc-8872-6a5dff128c94] Start destroying the instance on the hypervisor. {{(pid=74960) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 12:24:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:24:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:24:38 user nova-compute[74960]: DEBUG nova.compute.manager [req-ea24db50-038f-488e-a510-a6038f91057f req-956ce7ef-1b11-4ddb-8345-849fcb68efb5 service nova] [instance: d5c87482-1883-43dc-8872-6a5dff128c94] Received event network-vif-unplugged-57e989be-1288-4c19-8194-6b36c3242bba {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:24:38 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-ea24db50-038f-488e-a510-a6038f91057f req-956ce7ef-1b11-4ddb-8345-849fcb68efb5 service nova] Acquiring lock "d5c87482-1883-43dc-8872-6a5dff128c94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:24:38 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-ea24db50-038f-488e-a510-a6038f91057f req-956ce7ef-1b11-4ddb-8345-849fcb68efb5 service nova] Lock "d5c87482-1883-43dc-8872-6a5dff128c94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:24:38 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-ea24db50-038f-488e-a510-a6038f91057f req-956ce7ef-1b11-4ddb-8345-849fcb68efb5 service nova] Lock "d5c87482-1883-43dc-8872-6a5dff128c94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:24:38 user nova-compute[74960]: DEBUG nova.compute.manager [req-ea24db50-038f-488e-a510-a6038f91057f req-956ce7ef-1b11-4ddb-8345-849fcb68efb5 service nova] [instance: d5c87482-1883-43dc-8872-6a5dff128c94] No waiting events found dispatching network-vif-unplugged-57e989be-1288-4c19-8194-6b36c3242bba {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:24:38 user nova-compute[74960]: DEBUG nova.compute.manager [req-ea24db50-038f-488e-a510-a6038f91057f req-956ce7ef-1b11-4ddb-8345-849fcb68efb5 service nova] [instance: d5c87482-1883-43dc-8872-6a5dff128c94] Received event network-vif-unplugged-57e989be-1288-4c19-8194-6b36c3242bba for instance with task_state deleting. {{(pid=74960) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 12:24:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:24:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:24:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:24:38 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: d5c87482-1883-43dc-8872-6a5dff128c94] Instance destroyed successfully.
Nov 03 12:24:38 user nova-compute[74960]: DEBUG nova.objects.instance [None req-ff4ed1cd-136f-4c84-9208-92cf4fd87a0a tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Lazy-loading 'resources' on Instance uuid d5c87482-1883-43dc-8872-6a5dff128c94 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:24:38 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-ff4ed1cd-136f-4c84-9208-92cf4fd87a0a tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:22:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-256470132',display_name='tempest-ServersNegativeTestJSON-server-256470132',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-256470132',id=17,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-03T12:22:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e379e295cf984ca6bf5d84a60e56382d',ramdisk_id='',reservation_id='r-mxu17fqz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-802200730',owner_user_name='tempest-ServersNegativeTestJSON-802200730-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T12:22:57Z,user_data=None,user_id='7a13ec06392c4ce5a81491a35a8d50d8',uuid=d5c87482-1883-43dc-8872-6a5dff128c94,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "57e989be-1288-4c19-8194-6b36c3242bba", "address": "fa:16:3e:30:c8:cb", "network": {"id": "3a8a59cd-8076-41af-b566-9fc45a07a1df", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1235385625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e379e295cf984ca6bf5d84a60e56382d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57e989be-12", "ovs_interfaceid": "57e989be-1288-4c19-8194-6b36c3242bba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 12:24:38 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-ff4ed1cd-136f-4c84-9208-92cf4fd87a0a tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Converting VIF {"id": "57e989be-1288-4c19-8194-6b36c3242bba", "address": "fa:16:3e:30:c8:cb", "network": {"id": "3a8a59cd-8076-41af-b566-9fc45a07a1df", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1235385625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e379e295cf984ca6bf5d84a60e56382d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57e989be-12", "ovs_interfaceid": "57e989be-1288-4c19-8194-6b36c3242bba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:24:38 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-ff4ed1cd-136f-4c84-9208-92cf4fd87a0a tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:c8:cb,bridge_name='br-int',has_traffic_filtering=True,id=57e989be-1288-4c19-8194-6b36c3242bba,network=Network(3a8a59cd-8076-41af-b566-9fc45a07a1df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57e989be-12') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:24:38 user nova-compute[74960]: DEBUG os_vif [None req-ff4ed1cd-136f-4c84-9208-92cf4fd87a0a tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:c8:cb,bridge_name='br-int',has_traffic_filtering=True,id=57e989be-1288-4c19-8194-6b36c3242bba,network=Network(3a8a59cd-8076-41af-b566-9fc45a07a1df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57e989be-12') {{(pid=74960) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 12:24:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:24:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap57e989be-12, bridge=br-int, if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:24:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:24:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:24:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:24:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0a8586f1-4a29-46e6-8914-7c497a378c4f) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:24:38 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-028ea2e9-2137-4c05-91be-0e3760278362 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 05956d9b-0646-43d2-a4cd-19e9090020ee is timed out.
Nov 03 12:24:39 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:24:39 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:24:39 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-028ea2e9-2137-4c05-91be-0e3760278362 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Successfully detached device vdb from instance 05956d9b-0646-43d2-a4cd-19e9090020ee from the live domain config.
Nov 03 12:24:39 user nova-compute[74960]: INFO os_vif [None req-ff4ed1cd-136f-4c84-9208-92cf4fd87a0a tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:c8:cb,bridge_name='br-int',has_traffic_filtering=True,id=57e989be-1288-4c19-8194-6b36c3242bba,network=Network(3a8a59cd-8076-41af-b566-9fc45a07a1df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57e989be-12')
Nov 03 12:24:39 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-ff4ed1cd-136f-4c84-9208-92cf4fd87a0a tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] [instance: d5c87482-1883-43dc-8872-6a5dff128c94] Deleting instance files /opt/stack/data/nova/instances/d5c87482-1883-43dc-8872-6a5dff128c94_del
Nov 03 12:24:39 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-ff4ed1cd-136f-4c84-9208-92cf4fd87a0a tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] [instance: d5c87482-1883-43dc-8872-6a5dff128c94] Deletion of /opt/stack/data/nova/instances/d5c87482-1883-43dc-8872-6a5dff128c94_del complete
Nov 03 12:24:39 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-028ea2e9-2137-4c05-91be-0e3760278362 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] calling os-brick to detach iSCSI Volume {{(pid=74960) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 12:24:39 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-028ea2e9-2137-4c05-91be-0e3760278362 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9aa420acb0>, {'target_iqn': 'iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OLuClVhy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:24:39 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-028ea2e9-2137-4c05-91be-0e3760278362 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:24:39 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-028ea2e9-2137-4c05-91be-0e3760278362 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:24:39 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-028ea2e9-2137-4c05-91be-0e3760278362 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:24:39 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:24:39 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:24:39 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[96a2a6be-17b3-49e3-92b6-5be1564d7621]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:24:39 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-028ea2e9-2137-4c05-91be-0e3760278362 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 12:24:39 user nova-compute[74960]: No targets found.
Nov 03 12:24:39 user nova-compute[74960]: iSNS:
Nov 03 12:24:39 user nova-compute[74960]: No targets found.
Nov 03 12:24:39 user nova-compute[74960]: STATIC:
Nov 03 12:24:39 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02
Nov 03 12:24:39 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:24:39 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:24:39 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01
Nov 03 12:24:39 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:24:39 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:24:39 user nova-compute[74960]: FIRMWARE:
Nov 03 12:24:39 user nova-compute[74960]: No targets found.
Nov 03 12:24:39 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:24:39 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-028ea2e9-2137-4c05-91be-0e3760278362 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 12:24:39 user nova-compute[74960]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 12:24:39 user nova-compute[74960]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74960) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 12:24:39 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-028ea2e9-2137-4c05-91be-0e3760278362 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02', 0)] {{(pid=74960) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 12:24:39 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:24:39 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:24:39 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[2387d0aa-2d69-4903-bce3-15844d15f225]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:24:39 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:24:39 user nova-compute[74960]: INFO nova.compute.manager [None req-ff4ed1cd-136f-4c84-9208-92cf4fd87a0a tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] [instance: d5c87482-1883-43dc-8872-6a5dff128c94] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 03 12:24:39 user nova-compute[74960]: DEBUG oslo.service.loopingcall [None req-ff4ed1cd-136f-4c84-9208-92cf4fd87a0a tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74960) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 12:24:39 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:24:39 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[82328c0a-1652-47b0-b357-c7d0b1cefc76]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01 (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:24:39 user nova-compute[74960]: DEBUG nova.compute.manager [-] [instance: d5c87482-1883-43dc-8872-6a5dff128c94] Deallocating network for instance {{(pid=74960) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 12:24:39 user nova-compute[74960]: DEBUG nova.network.neutron [-] [instance: d5c87482-1883-43dc-8872-6a5dff128c94] deallocate_for_instance() {{(pid=74960) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 12:24:39 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-028ea2e9-2137-4c05-91be-0e3760278362 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02 (non-flash)
Nov 03 12:24:39 user nova-compute[74960]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01 (non-flash)
Nov 03 12:24:39 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:24:39 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-028ea2e9-2137-4c05-91be-0e3760278362 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02 (non-flash)
Nov 03 12:24:39 user nova-compute[74960]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01 (non-flash)
Nov 03 12:24:39 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:24:39 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-028ea2e9-2137-4c05-91be-0e3760278362 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9a8c43c0d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02'): ({'sdc'}, set())}) {{(pid=74960) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 12:24:39 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-028ea2e9-2137-4c05-91be-0e3760278362 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Removing single pathed devices sdc {{(pid=74960) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 12:24:39 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:24:39 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:24:39 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[dae069c5-da22-479c-9701-a0ab518f8349]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:24:39 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:24:39 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:24:39 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee6428f-70bf-4a04-8b7a-1081c479309d]: (4, ('ok\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:24:39 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-028ea2e9-2137-4c05-91be-0e3760278362 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Flushing IO for device /dev/sdc {{(pid=74960) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 12:24:39 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:24:39 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:24:39 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2d2a7c6-8abc-48c3-a931-1a15fdf37590]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:24:39 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-028ea2e9-2137-4c05-91be-0e3760278362 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74960) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 12:24:39 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:24:39 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.056s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:24:39 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[1440e3d3-5c99-46da-a92b-8f97e2bbd16c]: (4, ('1', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:24:39 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-028ea2e9-2137-4c05-91be-0e3760278362 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74960) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 12:24:39 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-028ea2e9-2137-4c05-91be-0e3760278362 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] SCSI volumes sdc have been removed. {{(pid=74960) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 12:24:39 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-028ea2e9-2137-4c05-91be-0e3760278362 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02')] {{(pid=74960) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 12:24:39 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:24:39 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:24:39 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ba1c984-fd26-4968-bfdc-09ab695ab8fd]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:24:39 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-028ea2e9-2137-4c05-91be-0e3760278362 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:24:39 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02 -p 172.16.0.220:3260 --logout {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:24:39 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:24:39 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f1550c0-8ea0-4a15-9a78-a5dc3eae3aa9]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:24:39 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-028ea2e9-2137-4c05-91be-0e3760278362 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02, portal: 172.16.0.220,3260]
Nov 03 12:24:39 user nova-compute[74960]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02, portal: 172.16.0.220,3260] successful.
Nov 03 12:24:39 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:24:39 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02 -p 172.16.0.220:3260 --op delete {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:24:39 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bcf17d9-fd5c-4707-9091-a767c871bc02 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:24:39 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ff1ac0e-e534-446f-9b4e-26ee8431e9aa]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:24:39 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-028ea2e9-2137-4c05-91be-0e3760278362 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:24:39 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-028ea2e9-2137-4c05-91be-0e3760278362 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.367s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:24:39 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-028ea2e9-2137-4c05-91be-0e3760278362 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] <== disconnect_volume: return (370ms) None {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:24:39 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-028ea2e9-2137-4c05-91be-0e3760278362 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] Disconnected iSCSI Volume {{(pid=74960) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 12:24:39 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:24:39 user nova-compute[74960]: DEBUG nova.network.neutron [-] [instance: d5c87482-1883-43dc-8872-6a5dff128c94] Updating instance_info_cache with network_info: [] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:24:39 user nova-compute[74960]: INFO nova.compute.manager [-] [instance: d5c87482-1883-43dc-8872-6a5dff128c94] Took 0.66 seconds to deallocate network for instance.
Nov 03 12:24:39 user nova-compute[74960]: DEBUG nova.compute.manager [req-5421d637-15f3-4492-a5dc-7c543d96814f req-47cfb620-6fc5-4af2-b8f7-c23a016387a3 service nova] [instance: d5c87482-1883-43dc-8872-6a5dff128c94] Received event network-vif-deleted-57e989be-1288-4c19-8194-6b36c3242bba {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:24:39 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-ff4ed1cd-136f-4c84-9208-92cf4fd87a0a tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:24:39 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-ff4ed1cd-136f-4c84-9208-92cf4fd87a0a tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:24:40 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-ff4ed1cd-136f-4c84-9208-92cf4fd87a0a tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:24:40 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-ff4ed1cd-136f-4c84-9208-92cf4fd87a0a tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:24:40 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-ff4ed1cd-136f-4c84-9208-92cf4fd87a0a tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.401s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:24:40 user nova-compute[74960]: INFO nova.scheduler.client.report [None req-ff4ed1cd-136f-4c84-9208-92cf4fd87a0a tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Deleted allocations for instance d5c87482-1883-43dc-8872-6a5dff128c94
Nov 03 12:24:40 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:24:40 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:24:40 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-ff4ed1cd-136f-4c84-9208-92cf4fd87a0a tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Lock "d5c87482-1883-43dc-8872-6a5dff128c94" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.261s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:24:40 user nova-compute[74960]: DEBUG nova.objects.instance [None req-028ea2e9-2137-4c05-91be-0e3760278362 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Lazy-loading 'flavor' on Instance uuid 05956d9b-0646-43d2-a4cd-19e9090020ee {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:24:40 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-028ea2e9-2137-4c05-91be-0e3760278362 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Lock "05956d9b-0646-43d2-a4cd-19e9090020ee" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.188s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:24:40 user nova-compute[74960]: DEBUG nova.compute.manager [req-65702d27-4749-4dc4-a661-feed34658a9c req-9c9ba3c3-4d36-43de-9601-9072adb0ad69 service nova] [instance: d5c87482-1883-43dc-8872-6a5dff128c94] Received event network-vif-plugged-57e989be-1288-4c19-8194-6b36c3242bba {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:24:40 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-65702d27-4749-4dc4-a661-feed34658a9c req-9c9ba3c3-4d36-43de-9601-9072adb0ad69 service nova] Acquiring lock "d5c87482-1883-43dc-8872-6a5dff128c94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:24:40 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-65702d27-4749-4dc4-a661-feed34658a9c req-9c9ba3c3-4d36-43de-9601-9072adb0ad69 service nova] Lock "d5c87482-1883-43dc-8872-6a5dff128c94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:24:40 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-65702d27-4749-4dc4-a661-feed34658a9c req-9c9ba3c3-4d36-43de-9601-9072adb0ad69 service nova] Lock "d5c87482-1883-43dc-8872-6a5dff128c94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:24:40 user nova-compute[74960]: DEBUG nova.compute.manager [req-65702d27-4749-4dc4-a661-feed34658a9c req-9c9ba3c3-4d36-43de-9601-9072adb0ad69 service nova] [instance: d5c87482-1883-43dc-8872-6a5dff128c94] No waiting events found dispatching network-vif-plugged-57e989be-1288-4c19-8194-6b36c3242bba {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:24:40 user nova-compute[74960]: WARNING nova.compute.manager [req-65702d27-4749-4dc4-a661-feed34658a9c req-9c9ba3c3-4d36-43de-9601-9072adb0ad69 service nova] [instance: d5c87482-1883-43dc-8872-6a5dff128c94] Received unexpected event network-vif-plugged-57e989be-1288-4c19-8194-6b36c3242bba for instance with vm_state deleted and task_state None.
Nov 03 12:24:42 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:24:42 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:24:42 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:24:43 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:24:46 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:24:46 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Starting heal instance info cache {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 12:24:46 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "refresh_cache-05956d9b-0646-43d2-a4cd-19e9090020ee" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:24:46 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquired lock "refresh_cache-05956d9b-0646-43d2-a4cd-19e9090020ee" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:24:46 user nova-compute[74960]: DEBUG nova.network.neutron [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] Forcefully refreshing network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 12:24:47 user nova-compute[74960]: DEBUG nova.network.neutron [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] Updating instance_info_cache with network_info: [{"id": "4d0cd9f3-3345-43ce-b449-8a46402e6cbd", "address": "fa:16:3e:28:71:ee", "network": {"id": "b3813163-d09b-4c0b-a328-1bbb4c7e2875", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1681555035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d4a374c1c544718887bd75b77a72a3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d0cd9f3-33", "ovs_interfaceid": "4d0cd9f3-3345-43ce-b449-8a46402e6cbd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:24:47 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Releasing lock "refresh_cache-05956d9b-0646-43d2-a4cd-19e9090020ee" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:24:47 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] Updated the network info_cache for instance {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 12:24:47 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:24:47 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:24:47 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:24:47 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:24:47 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:24:47 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Auditing locally available compute resources for user (node: user) {{(pid=74960) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 12:24:47 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9951fab7-4984-408e-94ca-11eab615ff25/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:24:47 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9951fab7-4984-408e-94ca-11eab615ff25/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:24:47 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9951fab7-4984-408e-94ca-11eab615ff25/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:24:47 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:24:47 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9951fab7-4984-408e-94ca-11eab615ff25/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:24:47 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05956d9b-0646-43d2-a4cd-19e9090020ee/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:24:48 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:24:48 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05956d9b-0646-43d2-a4cd-19e9090020ee/disk --force-share --output=json" returned: 0 in 0.542s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:24:48 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05956d9b-0646-43d2-a4cd-19e9090020ee/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:24:48 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05956d9b-0646-43d2-a4cd-19e9090020ee/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:24:48 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7769e3c5-136f-4282-8e3e-224e3a80922c/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:24:48 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7769e3c5-136f-4282-8e3e-224e3a80922c/disk --force-share --output=json" returned: 0 in 0.268s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:24:48 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7769e3c5-136f-4282-8e3e-224e3a80922c/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:24:49 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:24:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7769e3c5-136f-4282-8e3e-224e3a80922c/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:24:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fffd1dd7-b8e8-435c-bdfe-6c5001b21daf/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:24:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fffd1dd7-b8e8-435c-bdfe-6c5001b21daf/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:24:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fffd1dd7-b8e8-435c-bdfe-6c5001b21daf/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:24:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fffd1dd7-b8e8-435c-bdfe-6c5001b21daf/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:24:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6145a30b-809c-4bc5-a45f-c3ff3b170a22/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:24:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6145a30b-809c-4bc5-a45f-c3ff3b170a22/disk --force-share --output=json" returned: 0 in 0.275s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:24:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6145a30b-809c-4bc5-a45f-c3ff3b170a22/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:24:50 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6145a30b-809c-4bc5-a45f-c3ff3b170a22/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:24:50 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74960) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 12:24:50 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f009a400-0576-48a9-82e0-60de8935c498/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:24:50 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f009a400-0576-48a9-82e0-60de8935c498/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:24:50 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f009a400-0576-48a9-82e0-60de8935c498/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:24:50 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f009a400-0576-48a9-82e0-60de8935c498/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:24:50 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6cbb630-254f-4c56-9cf9-47d751c703be/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:24:50 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6cbb630-254f-4c56-9cf9-47d751c703be/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:24:50 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6cbb630-254f-4c56-9cf9-47d751c703be/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:24:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6cbb630-254f-4c56-9cf9-47d751c703be/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:24:51 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:24:51 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:24:51 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Hypervisor/Node resource view: name=user free_ram=7867MB free_disk=25.283973693847656GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74960) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 12:24:51 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:24:51 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:24:51 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 7769e3c5-136f-4282-8e3e-224e3a80922c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:24:51 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 05956d9b-0646-43d2-a4cd-19e9090020ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:24:51 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 6145a30b-809c-4bc5-a45f-c3ff3b170a22 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:24:51 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance fffd1dd7-b8e8-435c-bdfe-6c5001b21daf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:24:51 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance f009a400-0576-48a9-82e0-60de8935c498 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:24:51 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 9951fab7-4984-408e-94ca-11eab615ff25 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:24:51 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance db88322f-c2ad-4622-9a1a-c45439d875a8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:24:51 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance e6cbb630-254f-4c56-9cf9-47d751c703be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:24:51 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74960) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 12:24:51 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74960) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 12:24:52 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:24:52 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:24:52 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:24:52 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Compute_service record updated for user:user {{(pid=74960) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 12:24:52 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.526s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:24:52 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:24:52 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:24:52 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:24:52 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74960) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 12:24:52 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:24:54 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:24:56 user nova-compute[74960]: DEBUG nova.compute.manager [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Start spawning the instance on the hypervisor. {{(pid=74960) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 12:24:56 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Creating instance directory {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 12:24:56 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Creating image(s)
Nov 03 12:24:56 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Did not create local disks {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 03 12:24:56 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Ensure instance console log exists: /opt/stack/data/nova/instances/db88322f-c2ad-4622-9a1a-c45439d875a8/console.log {{(pid=74960) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 12:24:56 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:24:56 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:24:56 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:24:56 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Start _get_guest_xml network_info=[{"id": "dae50cff-c0b2-4c50-bd31-0d1bf1a17e55", "address": "fa:16:3e:c8:88:99", "network": {"id": "f771bed5-ff95-49cd-9871-08b128de2619", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-756048610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32ecbf7a4b414f40ac9bb306bf9d4702", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdae50cff-c0", "ovs_interfaceid": "dae50cff-c0b2-4c50-bd31-0d1bf1a17e55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9207158b-c88b-44b8-b419-eba87e570339", "address": "fa:16:3e:1a:2c:15", "network": {"id": "a61d6a8a-acdb-4b52-bebc-1b90d89b25f2", "bridge": "br-int", "label": "tempest-device-tagging-net1-20653421", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32ecbf7a4b414f40ac9bb306bf9d4702", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9207158b-c8", "ovs_interfaceid": "9207158b-c88b-44b8-b419-eba87e570339", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "72da800d-493b-4dc6-8988-1259e2423188", "address": "fa:16:3e:ec:7f:b8", "network": {"id": "a61d6a8a-acdb-4b52-bebc-1b90d89b25f2", "bridge": "br-int", "label": "tempest-device-tagging-net1-20653421", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32ecbf7a4b414f40ac9bb306bf9d4702", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72da800d-49", "ovs_interfaceid": "72da800d-493b-4dc6-8988-1259e2423188", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b905e727-4d81-4518-8cae-06f4e64bcccc", "address": "fa:16:3e:b9:71:c0", "network": {"id": "a61d6a8a-acdb-4b52-bebc-1b90d89b25f2", "bridge": "br-int", "label": "tempest-device-tagging-net1-20653421", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32ecbf7a4b414f40ac9bb306bf9d4702", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb905e727-4d", "ovs_interfaceid": "b905e727-4d81-4518-8cae-06f4e64bcccc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "012765dc-7d42-41d5-b12b-34f3a2a7ef07", "address": "fa:16:3e:d6:f8:7b", "network": {"id": "a61d6a8a-acdb-4b52-bebc-1b90d89b25f2", "bridge": "br-int", "label": "tempest-device-tagging-net1-20653421", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32ecbf7a4b414f40ac9bb306bf9d4702", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap012765dc-7d", "ovs_interfaceid": "012765dc-7d42-41d5-b12b-34f3a2a7ef07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "412bab8b-015e-4df4-92c8-2ed71a8ca2f7", "address": "fa:16:3e:e5:6e:0a", "network": {"id": "103d876e-44c1-4732-b994-193d642fbd96", "bridge": "br-int", "label": "tempest-device-tagging-net2-1835187118", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "32ecbf7a4b414f40ac9bb306bf9d4702", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap412bab8b-01", "ovs_interfaceid": "412bab8b-015e-4df4-92c8-2ed71a8ca2f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "20575d86-ea6c-4d0d-8190-70fe728bc7c1", "address": "fa:16:3e:7c:5c:e8", "network": {"id": "103d876e-44c1-4732-b994-193d642fbd96", "bridge": "br-int", "label": "tempest-device-tagging-net2-1835187118", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "32ecbf7a4b414f40ac9bb306bf9d4702", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20575d86-ea", "ovs_interfaceid": "20575d86-ea6c-4d0d-8190-70fe728bc7c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=549f51ba-ac69-494b-8de1-34635aa2d7cf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='63ee9c80c632442fb0379f47b784bd20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T12:13:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:64202938-e4d3-4072-ba6e-f144187c01a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pzThHSen', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'db88322f-c2ad-4622-9a1a-c45439d875a8', 'attached_at': '', 'detached_at': '', 'volume_id': '64202938-e4d3-4072-ba6e-f144187c01a9', 'serial': '64202938-e4d3-4072-ba6e-f144187c01a9'}, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'device_type': 'disk', 'attachment_id': 'b1a95216-e194-4996-82c3-e11c002de35a', 'boot_index': 0, 'guest_format': None, 'volume_type': None}, {'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fd1b7665-8415-44ab-81f5-84493c50a786', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FXhkgQTi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'db88322f-c2ad-4622-9a1a-c45439d875a8', 'attached_at': '', 'detached_at': '', 'volume_id': 'fd1b7665-8415-44ab-81f5-84493c50a786', 'serial': 'fd1b7665-8415-44ab-81f5-84493c50a786'}, 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'attachment_id': '9eaab91f-85c8-4173-9e8a-a3cb87616ec9', 'boot_index': 1, 'guest_format': None, 'volume_type': None}, {'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f629b2b5-39ab-4ee3-9633-a534a39c93a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xvTyfXno', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'db88322f-c2ad-4622-9a1a-c45439d875a8', 'attached_at': '', 'detached_at': '', 'volume_id': 'f629b2b5-39ab-4ee3-9633-a534a39c93a5', 'serial': 'f629b2b5-39ab-4ee3-9633-a534a39c93a5'}, 'delete_on_termination': False, 'mount_device': '/dev/vdc', 'device_type': 'disk', 'attachment_id': '7779c008-abc8-461e-ad0e-c96ade62ef55', 'boot_index': 2, 'guest_format': None, 'volume_type': None} {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 12:24:56 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:24:56 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:24:56 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 12:24:56 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] CPU controller missing on host. {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 12:24:56 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 12:24:56 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] CPU controller found on host. {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 12:24:56 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74960) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 12:24:56 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=549f51ba-ac69-494b-8de1-34635aa2d7cf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='63ee9c80c632442fb0379f47b784bd20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T12:13:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 12:24:56 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Flavor limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 12:24:56 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Image limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 12:24:56 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Flavor pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 12:24:56 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Image pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 12:24:56 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 12:24:56 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 12:24:56 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 12:24:56 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Got 1 possible topologies {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 12:24:56 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 12:24:56 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 12:24:56 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Calling os-brick to attach iSCSI Volume {{(pid=74960) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 12:24:56 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9aa420acb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:64202938-e4d3-4072-ba6e-f144187c01a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pzThHSen', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:24:56 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:24:56 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:24:56 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:24:56 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:24:56 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64202938-e4d3-4072-ba6e-f144187c01a9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:24:56 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64202938-e4d3-4072-ba6e-f144187c01a9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:24:56 user nova-compute[74960]: INFO os_brick.initiator.connectors.iscsi [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 12:24:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64202938-e4d3-4072-ba6e-f144187c01a9 -p 172.16.0.220:3260 {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:24:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64202938-e4d3-4072-ba6e-f144187c01a9 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:24:56 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[6943cc0a-a6a1-4a90-9e8f-1c6d18662ce1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:24:56 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 12:24:56 user nova-compute[74960]:  {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:24:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64202938-e4d3-4072-ba6e-f144187c01a9 -p 172.16.0.220:3260 --interface default --op new {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:24:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64202938-e4d3-4072-ba6e-f144187c01a9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:24:56 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[cae80226-4d77-4996-8637-bf614a750a57]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:64202938-e4d3-4072-ba6e-f144187c01a9] added\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:24:56 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:64202938-e4d3-4072-ba6e-f144187c01a9] added
Nov 03 12:24:56 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:24:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64202938-e4d3-4072-ba6e-f144187c01a9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:24:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64202938-e4d3-4072-ba6e-f144187c01a9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:24:56 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[3db5d513-d4f9-4ac7-9d25-c0f4127fb13a]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:24:56 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:24:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64202938-e4d3-4072-ba6e-f144187c01a9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:24:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64202938-e4d3-4072-ba6e-f144187c01a9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:24:56 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8e8e7a0-be08-4610-a7dc-b7befa0af45b]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:24:56 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:24:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64202938-e4d3-4072-ba6e-f144187c01a9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pzThHSen {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:24:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64202938-e4d3-4072-ba6e-f144187c01a9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pzThHSen" returned: 0 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:24:56 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdf6d5f6-cf8a-4460-a2eb-44f79639eb83]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:24:56 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pzThHSen'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:24:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64202938-e4d3-4072-ba6e-f144187c01a9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:24:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64202938-e4d3-4072-ba6e-f144187c01a9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:24:56 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0a7e885-dce9-4b3c-90f7-b2096b375326]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:24:56 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:24:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:24:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:24:56 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[15fc1283-397c-46ae-9f6c-058fad92f097]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01 (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:24:56 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01 (non-flash)
Nov 03 12:24:56 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:24:56 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01 (non-flash)
Nov 03 12:24:56 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:24:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64202938-e4d3-4072-ba6e-f144187c01a9 -p 172.16.0.220:3260 --login {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:24:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64202938-e4d3-4072-ba6e-f144187c01a9 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:24:56 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[59a2fcbd-f43f-48b8-b4c9-a948b80255ab]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:64202938-e4d3-4072-ba6e-f144187c01a9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:64202938-e4d3-4072-ba6e-f144187c01a9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:24:56 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:64202938-e4d3-4072-ba6e-f144187c01a9, portal: 172.16.0.220,3260]
Nov 03 12:24:56 user nova-compute[74960]: Login to [iface: default, target: iqn.2010-10.org.openstack:64202938-e4d3-4072-ba6e-f144187c01a9, portal: 172.16.0.220,3260] successful.
Nov 03 12:24:56 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:24:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64202938-e4d3-4072-ba6e-f144187c01a9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:24:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64202938-e4d3-4072-ba6e-f144187c01a9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:24:56 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4cf8e34-0f28-459b-a181-c20819750b11]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:24:56 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:24:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:24:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:24:56 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0581d02-8ce7-4d17-9d22-83ca3daee2ea]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64202938-e4d3-4072-ba6e-f144187c01a9 (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:24:56 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01 (non-flash)
Nov 03 12:24:56 user nova-compute[74960]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64202938-e4d3-4072-ba6e-f144187c01a9 (non-flash)
Nov 03 12:24:56 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:24:56 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01 (non-flash)
Nov 03 12:24:56 user nova-compute[74960]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64202938-e4d3-4072-ba6e-f144187c01a9 (non-flash)
Nov 03 12:24:56 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:24:56 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64202938-e4d3-4072-ba6e-f144187c01a9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.322s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:24:56 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Connected to 172.16.0.220:3260 {{(pid=74960) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 12:24:56 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] HCTL ('34', '-', '-', 0) found on session 13 with lun 0 {{(pid=74960) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 12:24:56 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74960) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 12:24:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:24:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.023s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:24:56 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[77393a1a-0d14-4adf-a5d3-0cdd94e96001]: (4, ('- - 0', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:24:56 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Searching for a device in session 13 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74960) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 12:24:56 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:64202938-e4d3-4072-ba6e-f144187c01a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pzThHSen', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74960) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 12:24:57 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:24:57 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.368s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:24:57 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] <== connect_volume: return (1369ms) {'type': 'block', 'scsi_wwn': '23766353062386335', 'path': '/dev/sdc'} {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:24:57 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23766353062386335', 'path': '/dev/sdc'} {{(pid=74960) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 12:24:57 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Calling os-brick to attach iSCSI Volume {{(pid=74960) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 12:24:57 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9aa420acb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fd1b7665-8415-44ab-81f5-84493c50a786', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FXhkgQTi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:24:57 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:24:57 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:24:57 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:24:57 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:24:57 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd1b7665-8415-44ab-81f5-84493c50a786" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:24:57 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd1b7665-8415-44ab-81f5-84493c50a786" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:24:57 user nova-compute[74960]: INFO os_brick.initiator.connectors.iscsi [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 12:24:57 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd1b7665-8415-44ab-81f5-84493c50a786 -p 172.16.0.220:3260 {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:24:57 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd1b7665-8415-44ab-81f5-84493c50a786 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:24:57 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[22eb39d4-5332-41e3-b32f-e7db3c3b77ac]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:24:57 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 12:24:57 user nova-compute[74960]:  {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:24:57 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd1b7665-8415-44ab-81f5-84493c50a786 -p 172.16.0.220:3260 --interface default --op new {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:24:57 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd1b7665-8415-44ab-81f5-84493c50a786 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:24:57 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[0123655f-4326-4fbc-869b-eb158a465bc5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fd1b7665-8415-44ab-81f5-84493c50a786] added\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:24:57 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fd1b7665-8415-44ab-81f5-84493c50a786] added
Nov 03 12:24:57 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:24:57 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd1b7665-8415-44ab-81f5-84493c50a786 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:24:58 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd1b7665-8415-44ab-81f5-84493c50a786 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.051s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:24:58 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[0176166d-4565-468b-9362-98e69ece7544]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:24:58 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:24:58 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd1b7665-8415-44ab-81f5-84493c50a786 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:24:58 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd1b7665-8415-44ab-81f5-84493c50a786 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:24:58 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[7db8f320-4ec7-4026-b7ec-16aebea258c8]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:24:58 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:24:58 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd1b7665-8415-44ab-81f5-84493c50a786 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FXhkgQTi {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:24:58 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd1b7665-8415-44ab-81f5-84493c50a786 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FXhkgQTi" returned: 0 in 0.033s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:24:58 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aad172d-0f57-44b8-b09b-568f2b5c0c92]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:24:58 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FXhkgQTi'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:24:58 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd1b7665-8415-44ab-81f5-84493c50a786 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:24:58 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd1b7665-8415-44ab-81f5-84493c50a786 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:24:58 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f16716d-def0-42c2-b3e9-51db954b239f]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:24:58 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:24:58 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:24:58 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:24:58 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[21e9dfeb-6c2b-4793-9462-cfe0629ebaa4]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64202938-e4d3-4072-ba6e-f144187c01a9 (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:24:58 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01 (non-flash)
Nov 03 12:24:58 user nova-compute[74960]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64202938-e4d3-4072-ba6e-f144187c01a9 (non-flash)
Nov 03 12:24:58 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:24:58 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01 (non-flash)
Nov 03 12:24:58 user nova-compute[74960]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64202938-e4d3-4072-ba6e-f144187c01a9 (non-flash)
Nov 03 12:24:58 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:24:58 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd1b7665-8415-44ab-81f5-84493c50a786 -p 172.16.0.220:3260 --login {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:24:58 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd1b7665-8415-44ab-81f5-84493c50a786 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:24:58 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[a93194a4-f67f-47d6-9f80-a155a11ff960]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fd1b7665-8415-44ab-81f5-84493c50a786, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fd1b7665-8415-44ab-81f5-84493c50a786, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:24:58 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fd1b7665-8415-44ab-81f5-84493c50a786, portal: 172.16.0.220,3260]
Nov 03 12:24:58 user nova-compute[74960]: Login to [iface: default, target: iqn.2010-10.org.openstack:fd1b7665-8415-44ab-81f5-84493c50a786, portal: 172.16.0.220,3260] successful.
Nov 03 12:24:58 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:24:58 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd1b7665-8415-44ab-81f5-84493c50a786 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:24:58 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd1b7665-8415-44ab-81f5-84493c50a786 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:24:58 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f9975e3-f72e-42cd-9b21-886c19b92b0c]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:24:58 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:24:58 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:24:58 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:24:58 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5c27762-d8aa-4204-8871-2907a523834f]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64202938-e4d3-4072-ba6e-f144187c01a9 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd1b7665-8415-44ab-81f5-84493c50a786 (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:24:58 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01 (non-flash)
Nov 03 12:24:58 user nova-compute[74960]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64202938-e4d3-4072-ba6e-f144187c01a9 (non-flash)
Nov 03 12:24:58 user nova-compute[74960]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd1b7665-8415-44ab-81f5-84493c50a786 (non-flash)
Nov 03 12:24:58 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:24:58 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01 (non-flash)
Nov 03 12:24:58 user nova-compute[74960]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64202938-e4d3-4072-ba6e-f144187c01a9 (non-flash)
Nov 03 12:24:58 user nova-compute[74960]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd1b7665-8415-44ab-81f5-84493c50a786 (non-flash)
Nov 03 12:24:58 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:24:58 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd1b7665-8415-44ab-81f5-84493c50a786" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.361s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:24:58 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Connected to 172.16.0.220:3260 {{(pid=74960) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 12:24:58 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] HCTL ('35', '-', '-', 0) found on session 14 with lun 0 {{(pid=74960) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 12:24:58 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74960) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 12:24:58 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:24:58 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:24:58 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[a18bded1-b492-4c5c-aebb-3e39d7f16d41]: (4, ('- - 0', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:24:58 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Searching for a device in session 14 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74960) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 12:24:58 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:fd1b7665-8415-44ab-81f5-84493c50a786', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FXhkgQTi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74960) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 12:24:58 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:24:59 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:24:59 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.396s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:24:59 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] <== connect_volume: return (1398ms) {'type': 'block', 'scsi_wwn': '26461616132393861', 'path': '/dev/sdd'} {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:24:59 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26461616132393861', 'path': '/dev/sdd'} {{(pid=74960) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 12:24:59 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Calling os-brick to attach iSCSI Volume {{(pid=74960) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 12:24:59 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9aa420acb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f629b2b5-39ab-4ee3-9633-a534a39c93a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xvTyfXno', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:24:59 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:24:59 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:24:59 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:24:59 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:24:59 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f629b2b5-39ab-4ee3-9633-a534a39c93a5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:24:59 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f629b2b5-39ab-4ee3-9633-a534a39c93a5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:24:59 user nova-compute[74960]: INFO os_brick.initiator.connectors.iscsi [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 12:24:59 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f629b2b5-39ab-4ee3-9633-a534a39c93a5 -p 172.16.0.220:3260 {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:24:59 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f629b2b5-39ab-4ee3-9633-a534a39c93a5 -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:24:59 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[b83fa223-bbff-49ea-86b6-436c85348180]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:24:59 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 12:24:59 user nova-compute[74960]:  {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:24:59 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f629b2b5-39ab-4ee3-9633-a534a39c93a5 -p 172.16.0.220:3260 --interface default --op new {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:24:59 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f629b2b5-39ab-4ee3-9633-a534a39c93a5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:24:59 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc4e8343-a885-4bb1-b119-417b58b46909]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f629b2b5-39ab-4ee3-9633-a534a39c93a5] added\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:24:59 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f629b2b5-39ab-4ee3-9633-a534a39c93a5] added
Nov 03 12:24:59 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:24:59 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f629b2b5-39ab-4ee3-9633-a534a39c93a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:24:59 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f629b2b5-39ab-4ee3-9633-a534a39c93a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:24:59 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[c64a4178-47a6-44ad-bcf6-280b6057a409]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:24:59 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:24:59 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f629b2b5-39ab-4ee3-9633-a534a39c93a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:24:59 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f629b2b5-39ab-4ee3-9633-a534a39c93a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:24:59 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[717c353e-f558-4ed7-a9e3-c909e74b7463]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:24:59 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:24:59 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f629b2b5-39ab-4ee3-9633-a534a39c93a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xvTyfXno {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:24:59 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f629b2b5-39ab-4ee3-9633-a534a39c93a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xvTyfXno" returned: 0 in 0.023s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:24:59 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[878f28bd-4f4e-4bd2-a7f1-494f7974c409]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:24:59 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xvTyfXno'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:24:59 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f629b2b5-39ab-4ee3-9633-a534a39c93a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:24:59 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f629b2b5-39ab-4ee3-9633-a534a39c93a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:24:59 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[255a12f9-64f3-4f59-92ef-882d5d5a9472]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:24:59 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:24:59 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:24:59 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:24:59 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[11d0e69a-cc91-40ab-a82d-db94fa601a60]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64202938-e4d3-4072-ba6e-f144187c01a9 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd1b7665-8415-44ab-81f5-84493c50a786 (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:24:59 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01 (non-flash)
Nov 03 12:24:59 user nova-compute[74960]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64202938-e4d3-4072-ba6e-f144187c01a9 (non-flash)
Nov 03 12:24:59 user nova-compute[74960]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd1b7665-8415-44ab-81f5-84493c50a786 (non-flash)
Nov 03 12:24:59 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:24:59 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01 (non-flash)
Nov 03 12:24:59 user nova-compute[74960]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64202938-e4d3-4072-ba6e-f144187c01a9 (non-flash)
Nov 03 12:24:59 user nova-compute[74960]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd1b7665-8415-44ab-81f5-84493c50a786 (non-flash)
Nov 03 12:24:59 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:24:59 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f629b2b5-39ab-4ee3-9633-a534a39c93a5 -p 172.16.0.220:3260 --login {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:24:59 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f629b2b5-39ab-4ee3-9633-a534a39c93a5 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:24:59 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[91667931-92ae-4910-9906-98275bb56284]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f629b2b5-39ab-4ee3-9633-a534a39c93a5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f629b2b5-39ab-4ee3-9633-a534a39c93a5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:24:59 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f629b2b5-39ab-4ee3-9633-a534a39c93a5, portal: 172.16.0.220,3260]
Nov 03 12:24:59 user nova-compute[74960]: Login to [iface: default, target: iqn.2010-10.org.openstack:f629b2b5-39ab-4ee3-9633-a534a39c93a5, portal: 172.16.0.220,3260] successful.
Nov 03 12:24:59 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:24:59 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f629b2b5-39ab-4ee3-9633-a534a39c93a5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:24:59 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f629b2b5-39ab-4ee3-9633-a534a39c93a5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:24:59 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[053568ca-6e37-44d2-ac57-bcdb0b47a896]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:24:59 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:24:59 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:24:59 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:24:59 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee7744d0-0881-42f5-8aa8-ec7cde9016f4]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64202938-e4d3-4072-ba6e-f144187c01a9 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd1b7665-8415-44ab-81f5-84493c50a786 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f629b2b5-39ab-4ee3-9633-a534a39c93a5 (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:24:59 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01 (non-flash)
Nov 03 12:24:59 user nova-compute[74960]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64202938-e4d3-4072-ba6e-f144187c01a9 (non-flash)
Nov 03 12:24:59 user nova-compute[74960]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd1b7665-8415-44ab-81f5-84493c50a786 (non-flash)
Nov 03 12:24:59 user nova-compute[74960]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f629b2b5-39ab-4ee3-9633-a534a39c93a5 (non-flash)
Nov 03 12:24:59 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:24:59 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01 (non-flash)
Nov 03 12:24:59 user nova-compute[74960]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64202938-e4d3-4072-ba6e-f144187c01a9 (non-flash)
Nov 03 12:24:59 user nova-compute[74960]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd1b7665-8415-44ab-81f5-84493c50a786 (non-flash)
Nov 03 12:24:59 user nova-compute[74960]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f629b2b5-39ab-4ee3-9633-a534a39c93a5 (non-flash)
Nov 03 12:24:59 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:24:59 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f629b2b5-39ab-4ee3-9633-a534a39c93a5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.350s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:24:59 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Connected to 172.16.0.220:3260 {{(pid=74960) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 12:24:59 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] HCTL ('36', '-', '-', 0) found on session 15 with lun 0 {{(pid=74960) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 12:24:59 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74960) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 12:24:59 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:24:59 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.023s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:24:59 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffe93b9a-fc47-44e2-b014-cd00342bda2b]: (4, ('- - 0', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:24:59 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Searching for a device in session 15 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74960) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 12:24:59 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:f629b2b5-39ab-4ee3-9633-a534a39c93a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xvTyfXno', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74960) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 12:25:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:00 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.392s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:25:00 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] <== connect_volume: return (1393ms) {'type': 'block', 'scsi_wwn': '26634633462623137', 'path': '/dev/sde'} {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:25:00 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26634633462623137', 'path': '/dev/sde'} {{(pid=74960) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 12:25:00 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T12:23:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1565525940',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1565525940',id=18,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK+6ZHlH1wKTndCYBIgu6ANG9Y2bIdl4FNNh18qkCmwdesNa7MOCTQ0WhOi5eCN1Qx65IdW7gj2YQX2eDDhNwRN+7BelIOC4SN1r8Sh9sZUc1XmzARyI8Hgp+1UUgZcu7Q==',key_name='tempest-keypair-788787740',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='32ecbf7a4b414f40ac9bb306bf9d4702',ramdisk_id='',reservation_id='r-2r3kgklh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1985714310',owner_user_name='tempest-TaggedBootDevicesTest_v242-1985714310-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:23:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='49d35d857fdf4e4f894a72610086d752',uuid=db88322f-c2ad-4622-9a1a-c45439d875a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dae50cff-c0b2-4c50-bd31-0d1bf1a17e55", "address": "fa:16:3e:c8:88:99", "network": {"id": "f771bed5-ff95-49cd-9871-08b128de2619", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-756048610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32ecbf7a4b414f40ac9bb306bf9d4702", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdae50cff-c0", "ovs_interfaceid": "dae50cff-c0b2-4c50-bd31-0d1bf1a17e55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74960) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 12:25:00 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Converting VIF {"id": "dae50cff-c0b2-4c50-bd31-0d1bf1a17e55", "address": "fa:16:3e:c8:88:99", "network": {"id": "f771bed5-ff95-49cd-9871-08b128de2619", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-756048610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32ecbf7a4b414f40ac9bb306bf9d4702", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdae50cff-c0", "ovs_interfaceid": "dae50cff-c0b2-4c50-bd31-0d1bf1a17e55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:25:00 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:88:99,bridge_name='br-int',has_traffic_filtering=True,id=dae50cff-c0b2-4c50-bd31-0d1bf1a17e55,network=Network(f771bed5-ff95-49cd-9871-08b128de2619),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdae50cff-c0') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:25:00 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T12:23:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1565525940',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1565525940',id=18,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK+6ZHlH1wKTndCYBIgu6ANG9Y2bIdl4FNNh18qkCmwdesNa7MOCTQ0WhOi5eCN1Qx65IdW7gj2YQX2eDDhNwRN+7BelIOC4SN1r8Sh9sZUc1XmzARyI8Hgp+1UUgZcu7Q==',key_name='tempest-keypair-788787740',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='32ecbf7a4b414f40ac9bb306bf9d4702',ramdisk_id='',reservation_id='r-2r3kgklh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1985714310',owner_user_name='tempest-TaggedBootDevicesTest_v242-1985714310-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:23:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='49d35d857fdf4e4f894a72610086d752',uuid=db88322f-c2ad-4622-9a1a-c45439d875a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9207158b-c88b-44b8-b419-eba87e570339", "address": "fa:16:3e:1a:2c:15", "network": {"id": "a61d6a8a-acdb-4b52-bebc-1b90d89b25f2", "bridge": "br-int", "label": "tempest-device-tagging-net1-20653421", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32ecbf7a4b414f40ac9bb306bf9d4702", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9207158b-c8", "ovs_interfaceid": "9207158b-c88b-44b8-b419-eba87e570339", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74960) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 12:25:00 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Converting VIF {"id": "9207158b-c88b-44b8-b419-eba87e570339", "address": "fa:16:3e:1a:2c:15", "network": {"id": "a61d6a8a-acdb-4b52-bebc-1b90d89b25f2", "bridge": "br-int", "label": "tempest-device-tagging-net1-20653421", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32ecbf7a4b414f40ac9bb306bf9d4702", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9207158b-c8", "ovs_interfaceid": "9207158b-c88b-44b8-b419-eba87e570339", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:25:00 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:2c:15,bridge_name='br-int',has_traffic_filtering=True,id=9207158b-c88b-44b8-b419-eba87e570339,network=Network(a61d6a8a-acdb-4b52-bebc-1b90d89b25f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9207158b-c8') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:25:00 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T12:23:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1565525940',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1565525940',id=18,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK+6ZHlH1wKTndCYBIgu6ANG9Y2bIdl4FNNh18qkCmwdesNa7MOCTQ0WhOi5eCN1Qx65IdW7gj2YQX2eDDhNwRN+7BelIOC4SN1r8Sh9sZUc1XmzARyI8Hgp+1UUgZcu7Q==',key_name='tempest-keypair-788787740',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='32ecbf7a4b414f40ac9bb306bf9d4702',ramdisk_id='',reservation_id='r-2r3kgklh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1985714310',owner_user_name='tempest-TaggedBootDevicesTest_v242-1985714310-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:23:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='49d35d857fdf4e4f894a72610086d752',uuid=db88322f-c2ad-4622-9a1a-c45439d875a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "72da800d-493b-4dc6-8988-1259e2423188", "address": "fa:16:3e:ec:7f:b8", "network": {"id": "a61d6a8a-acdb-4b52-bebc-1b90d89b25f2", "bridge": "br-int", "label": "tempest-device-tagging-net1-20653421", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32ecbf7a4b414f40ac9bb306bf9d4702", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72da800d-49", "ovs_interfaceid": "72da800d-493b-4dc6-8988-1259e2423188", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74960) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 12:25:00 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Converting VIF {"id": "72da800d-493b-4dc6-8988-1259e2423188", "address": "fa:16:3e:ec:7f:b8", "network": {"id": "a61d6a8a-acdb-4b52-bebc-1b90d89b25f2", "bridge": "br-int", "label": "tempest-device-tagging-net1-20653421", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32ecbf7a4b414f40ac9bb306bf9d4702", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72da800d-49", "ovs_interfaceid": "72da800d-493b-4dc6-8988-1259e2423188", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:25:00 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:7f:b8,bridge_name='br-int',has_traffic_filtering=True,id=72da800d-493b-4dc6-8988-1259e2423188,network=Network(a61d6a8a-acdb-4b52-bebc-1b90d89b25f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap72da800d-49') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:25:00 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T12:23:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1565525940',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1565525940',id=18,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK+6ZHlH1wKTndCYBIgu6ANG9Y2bIdl4FNNh18qkCmwdesNa7MOCTQ0WhOi5eCN1Qx65IdW7gj2YQX2eDDhNwRN+7BelIOC4SN1r8Sh9sZUc1XmzARyI8Hgp+1UUgZcu7Q==',key_name='tempest-keypair-788787740',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='32ecbf7a4b414f40ac9bb306bf9d4702',ramdisk_id='',reservation_id='r-2r3kgklh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1985714310',owner_user_name='tempest-TaggedBootDevicesTest_v242-1985714310-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:23:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='49d35d857fdf4e4f894a72610086d752',uuid=db88322f-c2ad-4622-9a1a-c45439d875a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b905e727-4d81-4518-8cae-06f4e64bcccc", "address": "fa:16:3e:b9:71:c0", "network": {"id": "a61d6a8a-acdb-4b52-bebc-1b90d89b25f2", "bridge": "br-int", "label": "tempest-device-tagging-net1-20653421", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32ecbf7a4b414f40ac9bb306bf9d4702", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb905e727-4d", "ovs_interfaceid": "b905e727-4d81-4518-8cae-06f4e64bcccc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74960) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 12:25:00 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Converting VIF {"id": "b905e727-4d81-4518-8cae-06f4e64bcccc", "address": "fa:16:3e:b9:71:c0", "network": {"id": "a61d6a8a-acdb-4b52-bebc-1b90d89b25f2", "bridge": "br-int", "label": "tempest-device-tagging-net1-20653421", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32ecbf7a4b414f40ac9bb306bf9d4702", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb905e727-4d", "ovs_interfaceid": "b905e727-4d81-4518-8cae-06f4e64bcccc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:25:00 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:71:c0,bridge_name='br-int',has_traffic_filtering=True,id=b905e727-4d81-4518-8cae-06f4e64bcccc,network=Network(a61d6a8a-acdb-4b52-bebc-1b90d89b25f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb905e727-4d') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:25:00 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T12:23:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1565525940',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1565525940',id=18,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK+6ZHlH1wKTndCYBIgu6ANG9Y2bIdl4FNNh18qkCmwdesNa7MOCTQ0WhOi5eCN1Qx65IdW7gj2YQX2eDDhNwRN+7BelIOC4SN1r8Sh9sZUc1XmzARyI8Hgp+1UUgZcu7Q==',key_name='tempest-keypair-788787740',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='32ecbf7a4b414f40ac9bb306bf9d4702',ramdisk_id='',reservation_id='r-2r3kgklh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1985714310',owner_user_name='tempest-TaggedBootDevicesTest_v242-1985714310-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:23:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='49d35d857fdf4e4f894a72610086d752',uuid=db88322f-c2ad-4622-9a1a-c45439d875a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "012765dc-7d42-41d5-b12b-34f3a2a7ef07", "address": "fa:16:3e:d6:f8:7b", "network": {"id": "a61d6a8a-acdb-4b52-bebc-1b90d89b25f2", "bridge": "br-int", "label": "tempest-device-tagging-net1-20653421", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32ecbf7a4b414f40ac9bb306bf9d4702", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap012765dc-7d", "ovs_interfaceid": "012765dc-7d42-41d5-b12b-34f3a2a7ef07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74960) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 12:25:00 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Converting VIF {"id": "012765dc-7d42-41d5-b12b-34f3a2a7ef07", "address": "fa:16:3e:d6:f8:7b", "network": {"id": "a61d6a8a-acdb-4b52-bebc-1b90d89b25f2", "bridge": "br-int", "label": "tempest-device-tagging-net1-20653421", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32ecbf7a4b414f40ac9bb306bf9d4702", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap012765dc-7d", "ovs_interfaceid": "012765dc-7d42-41d5-b12b-34f3a2a7ef07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:25:00 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:f8:7b,bridge_name='br-int',has_traffic_filtering=True,id=012765dc-7d42-41d5-b12b-34f3a2a7ef07,network=Network(a61d6a8a-acdb-4b52-bebc-1b90d89b25f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap012765dc-7d') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:25:00 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T12:23:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1565525940',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1565525940',id=18,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK+6ZHlH1wKTndCYBIgu6ANG9Y2bIdl4FNNh18qkCmwdesNa7MOCTQ0WhOi5eCN1Qx65IdW7gj2YQX2eDDhNwRN+7BelIOC4SN1r8Sh9sZUc1XmzARyI8Hgp+1UUgZcu7Q==',key_name='tempest-keypair-788787740',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='32ecbf7a4b414f40ac9bb306bf9d4702',ramdisk_id='',reservation_id='r-2r3kgklh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1985714310',owner_user_name='tempest-TaggedBootDevicesTest_v242-1985714310-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:23:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='49d35d857fdf4e4f894a72610086d752',uuid=db88322f-c2ad-4622-9a1a-c45439d875a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "412bab8b-015e-4df4-92c8-2ed71a8ca2f7", "address": "fa:16:3e:e5:6e:0a", "network": {"id": "103d876e-44c1-4732-b994-193d642fbd96", "bridge": "br-int", "label": "tempest-device-tagging-net2-1835187118", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "32ecbf7a4b414f40ac9bb306bf9d4702", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap412bab8b-01", "ovs_interfaceid": "412bab8b-015e-4df4-92c8-2ed71a8ca2f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74960) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 12:25:00 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Converting VIF {"id": "412bab8b-015e-4df4-92c8-2ed71a8ca2f7", "address": "fa:16:3e:e5:6e:0a", "network": {"id": "103d876e-44c1-4732-b994-193d642fbd96", "bridge": "br-int", "label": "tempest-device-tagging-net2-1835187118", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "32ecbf7a4b414f40ac9bb306bf9d4702", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap412bab8b-01", "ovs_interfaceid": "412bab8b-015e-4df4-92c8-2ed71a8ca2f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:25:00 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:6e:0a,bridge_name='br-int',has_traffic_filtering=True,id=412bab8b-015e-4df4-92c8-2ed71a8ca2f7,network=Network(103d876e-44c1-4732-b994-193d642fbd96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap412bab8b-01') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:25:00 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T12:23:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1565525940',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1565525940',id=18,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK+6ZHlH1wKTndCYBIgu6ANG9Y2bIdl4FNNh18qkCmwdesNa7MOCTQ0WhOi5eCN1Qx65IdW7gj2YQX2eDDhNwRN+7BelIOC4SN1r8Sh9sZUc1XmzARyI8Hgp+1UUgZcu7Q==',key_name='tempest-keypair-788787740',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='32ecbf7a4b414f40ac9bb306bf9d4702',ramdisk_id='',reservation_id='r-2r3kgklh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1985714310',owner_user_name='tempest-TaggedBootDevicesTest_v242-1985714310-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:23:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='49d35d857fdf4e4f894a72610086d752',uuid=db88322f-c2ad-4622-9a1a-c45439d875a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "20575d86-ea6c-4d0d-8190-70fe728bc7c1", "address": "fa:16:3e:7c:5c:e8", "network": {"id": "103d876e-44c1-4732-b994-193d642fbd96", "bridge": "br-int", "label": "tempest-device-tagging-net2-1835187118", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "32ecbf7a4b414f40ac9bb306bf9d4702", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20575d86-ea", "ovs_interfaceid": "20575d86-ea6c-4d0d-8190-70fe728bc7c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74960) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 12:25:00 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Converting VIF {"id": "20575d86-ea6c-4d0d-8190-70fe728bc7c1", "address": "fa:16:3e:7c:5c:e8", "network": {"id": "103d876e-44c1-4732-b994-193d642fbd96", "bridge": "br-int", "label": "tempest-device-tagging-net2-1835187118", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "32ecbf7a4b414f40ac9bb306bf9d4702", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20575d86-ea", "ovs_interfaceid": "20575d86-ea6c-4d0d-8190-70fe728bc7c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:25:00 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:5c:e8,bridge_name='br-int',has_traffic_filtering=True,id=20575d86-ea6c-4d0d-8190-70fe728bc7c1,network=Network(103d876e-44c1-4732-b994-193d642fbd96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20575d86-ea') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:25:00 user nova-compute[74960]: DEBUG nova.objects.instance [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Lazy-loading 'pci_devices' on Instance uuid db88322f-c2ad-4622-9a1a-c45439d875a8 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:25:00 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] End _get_guest_xml xml=<domain type="kvm">
Nov 03 12:25:00 user nova-compute[74960]:   <uuid>db88322f-c2ad-4622-9a1a-c45439d875a8</uuid>
Nov 03 12:25:00 user nova-compute[74960]:   <name>instance-00000012</name>
Nov 03 12:25:00 user nova-compute[74960]:   <memory>524288</memory>
Nov 03 12:25:00 user nova-compute[74960]:   <vcpu>1</vcpu>
Nov 03 12:25:00 user nova-compute[74960]:   <metadata>
Nov 03 12:25:00 user nova-compute[74960]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 12:25:00 user nova-compute[74960]:       <nova:package version="0.0.0"/>
Nov 03 12:25:00 user nova-compute[74960]:       <nova:name>tempest-device-tagging-server-1565525940</nova:name>
Nov 03 12:25:00 user nova-compute[74960]:       <nova:creationTime>2023-11-03 12:24:56</nova:creationTime>
Nov 03 12:25:00 user nova-compute[74960]:       <nova:flavor name="m1.tiny">
Nov 03 12:25:00 user nova-compute[74960]:         <nova:memory>512</nova:memory>
Nov 03 12:25:00 user nova-compute[74960]:         <nova:disk>1</nova:disk>
Nov 03 12:25:00 user nova-compute[74960]:         <nova:swap>0</nova:swap>
Nov 03 12:25:00 user nova-compute[74960]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 12:25:00 user nova-compute[74960]:         <nova:vcpus>1</nova:vcpus>
Nov 03 12:25:00 user nova-compute[74960]:       </nova:flavor>
Nov 03 12:25:00 user nova-compute[74960]:       <nova:owner>
Nov 03 12:25:00 user nova-compute[74960]:         <nova:user uuid="49d35d857fdf4e4f894a72610086d752">tempest-TaggedBootDevicesTest_v242-1985714310-project-member</nova:user>
Nov 03 12:25:00 user nova-compute[74960]:         <nova:project uuid="32ecbf7a4b414f40ac9bb306bf9d4702">tempest-TaggedBootDevicesTest_v242-1985714310</nova:project>
Nov 03 12:25:00 user nova-compute[74960]:       </nova:owner>
Nov 03 12:25:00 user nova-compute[74960]:       <nova:root type="image" uuid="549f51ba-ac69-494b-8de1-34635aa2d7cf"/>
Nov 03 12:25:00 user nova-compute[74960]:       <nova:ports>
Nov 03 12:25:00 user nova-compute[74960]:         <nova:port uuid="dae50cff-c0b2-4c50-bd31-0d1bf1a17e55">
Nov 03 12:25:00 user nova-compute[74960]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 03 12:25:00 user nova-compute[74960]:         </nova:port>
Nov 03 12:25:00 user nova-compute[74960]:         <nova:port uuid="9207158b-c88b-44b8-b419-eba87e570339">
Nov 03 12:25:00 user nova-compute[74960]:           <nova:ip type="fixed" address="10.1.1.93" ipVersion="4"/>
Nov 03 12:25:00 user nova-compute[74960]:         </nova:port>
Nov 03 12:25:00 user nova-compute[74960]:         <nova:port uuid="72da800d-493b-4dc6-8988-1259e2423188">
Nov 03 12:25:00 user nova-compute[74960]:           <nova:ip type="fixed" address="10.1.1.33" ipVersion="4"/>
Nov 03 12:25:00 user nova-compute[74960]:         </nova:port>
Nov 03 12:25:00 user nova-compute[74960]:         <nova:port uuid="b905e727-4d81-4518-8cae-06f4e64bcccc">
Nov 03 12:25:00 user nova-compute[74960]:           <nova:ip type="fixed" address="10.1.1.69" ipVersion="4"/>
Nov 03 12:25:00 user nova-compute[74960]:         </nova:port>
Nov 03 12:25:00 user nova-compute[74960]:         <nova:port uuid="012765dc-7d42-41d5-b12b-34f3a2a7ef07">
Nov 03 12:25:00 user nova-compute[74960]:           <nova:ip type="fixed" address="10.1.1.139" ipVersion="4"/>
Nov 03 12:25:00 user nova-compute[74960]:         </nova:port>
Nov 03 12:25:00 user nova-compute[74960]:         <nova:port uuid="412bab8b-015e-4df4-92c8-2ed71a8ca2f7">
Nov 03 12:25:00 user nova-compute[74960]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 03 12:25:00 user nova-compute[74960]:         </nova:port>
Nov 03 12:25:00 user nova-compute[74960]:         <nova:port uuid="20575d86-ea6c-4d0d-8190-70fe728bc7c1">
Nov 03 12:25:00 user nova-compute[74960]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 03 12:25:00 user nova-compute[74960]:         </nova:port>
Nov 03 12:25:00 user nova-compute[74960]:       </nova:ports>
Nov 03 12:25:00 user nova-compute[74960]:     </nova:instance>
Nov 03 12:25:00 user nova-compute[74960]:   </metadata>
Nov 03 12:25:00 user nova-compute[74960]:   <sysinfo type="smbios">
Nov 03 12:25:00 user nova-compute[74960]:     <system>
Nov 03 12:25:00 user nova-compute[74960]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 12:25:00 user nova-compute[74960]:       <entry name="product">OpenStack Nova</entry>
Nov 03 12:25:00 user nova-compute[74960]:       <entry name="version">0.0.0</entry>
Nov 03 12:25:00 user nova-compute[74960]:       <entry name="serial">db88322f-c2ad-4622-9a1a-c45439d875a8</entry>
Nov 03 12:25:00 user nova-compute[74960]:       <entry name="uuid">db88322f-c2ad-4622-9a1a-c45439d875a8</entry>
Nov 03 12:25:00 user nova-compute[74960]:       <entry name="family">Virtual Machine</entry>
Nov 03 12:25:00 user nova-compute[74960]:     </system>
Nov 03 12:25:00 user nova-compute[74960]:   </sysinfo>
Nov 03 12:25:00 user nova-compute[74960]:   <os>
Nov 03 12:25:00 user nova-compute[74960]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 12:25:00 user nova-compute[74960]:     <boot dev="hd"/>
Nov 03 12:25:00 user nova-compute[74960]:     <smbios mode="sysinfo"/>
Nov 03 12:25:00 user nova-compute[74960]:   </os>
Nov 03 12:25:00 user nova-compute[74960]:   <features>
Nov 03 12:25:00 user nova-compute[74960]:     <acpi/>
Nov 03 12:25:00 user nova-compute[74960]:     <apic/>
Nov 03 12:25:00 user nova-compute[74960]:     <vmcoreinfo/>
Nov 03 12:25:00 user nova-compute[74960]:   </features>
Nov 03 12:25:00 user nova-compute[74960]:   <clock offset="utc">
Nov 03 12:25:00 user nova-compute[74960]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 12:25:00 user nova-compute[74960]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 12:25:00 user nova-compute[74960]:     <timer name="hpet" present="no"/>
Nov 03 12:25:00 user nova-compute[74960]:   </clock>
Nov 03 12:25:00 user nova-compute[74960]:   <cpu mode="custom" match="exact">
Nov 03 12:25:00 user nova-compute[74960]:     <model>Nehalem</model>
Nov 03 12:25:00 user nova-compute[74960]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 12:25:00 user nova-compute[74960]:   </cpu>
Nov 03 12:25:00 user nova-compute[74960]:   <devices>
Nov 03 12:25:00 user nova-compute[74960]:     <disk type="file" device="cdrom">
Nov 03 12:25:00 user nova-compute[74960]:       <driver name="qemu" type="raw" cache="none"/>
Nov 03 12:25:00 user nova-compute[74960]:       <source file="/opt/stack/data/nova/instances/db88322f-c2ad-4622-9a1a-c45439d875a8/disk.config"/>
Nov 03 12:25:00 user nova-compute[74960]:       <target dev="hda" bus="ide"/>
Nov 03 12:25:00 user nova-compute[74960]:     </disk>
Nov 03 12:25:00 user nova-compute[74960]:     <disk type="block" device="disk">
Nov 03 12:25:00 user nova-compute[74960]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 12:25:00 user nova-compute[74960]:       <source dev="/dev/sdc"/>
Nov 03 12:25:00 user nova-compute[74960]:       <target dev="vda" bus="virtio"/>
Nov 03 12:25:00 user nova-compute[74960]:       <serial>64202938-e4d3-4072-ba6e-f144187c01a9</serial>
Nov 03 12:25:00 user nova-compute[74960]:     </disk>
Nov 03 12:25:00 user nova-compute[74960]:     <disk type="block" device="disk">
Nov 03 12:25:00 user nova-compute[74960]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 12:25:00 user nova-compute[74960]:       <source dev="/dev/sdd"/>
Nov 03 12:25:00 user nova-compute[74960]:       <target dev="vdb" bus="virtio"/>
Nov 03 12:25:00 user nova-compute[74960]:       <serial>fd1b7665-8415-44ab-81f5-84493c50a786</serial>
Nov 03 12:25:00 user nova-compute[74960]:     </disk>
Nov 03 12:25:00 user nova-compute[74960]:     <disk type="block" device="disk">
Nov 03 12:25:00 user nova-compute[74960]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 12:25:00 user nova-compute[74960]:       <source dev="/dev/sde"/>
Nov 03 12:25:00 user nova-compute[74960]:       <target dev="vdc" bus="virtio"/>
Nov 03 12:25:00 user nova-compute[74960]:       <serial>f629b2b5-39ab-4ee3-9633-a534a39c93a5</serial>
Nov 03 12:25:00 user nova-compute[74960]:     </disk>
Nov 03 12:25:00 user nova-compute[74960]:     <interface type="ethernet">
Nov 03 12:25:00 user nova-compute[74960]:       <mac address="fa:16:3e:c8:88:99"/>
Nov 03 12:25:00 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:25:00 user nova-compute[74960]:       <mtu size="1442"/>
Nov 03 12:25:00 user nova-compute[74960]:       <target dev="tapdae50cff-c0"/>
Nov 03 12:25:00 user nova-compute[74960]:     </interface>
Nov 03 12:25:00 user nova-compute[74960]:     <interface type="ethernet">
Nov 03 12:25:00 user nova-compute[74960]:       <mac address="fa:16:3e:1a:2c:15"/>
Nov 03 12:25:00 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:25:00 user nova-compute[74960]:       <mtu size="1442"/>
Nov 03 12:25:00 user nova-compute[74960]:       <target dev="tap9207158b-c8"/>
Nov 03 12:25:00 user nova-compute[74960]:     </interface>
Nov 03 12:25:00 user nova-compute[74960]:     <interface type="ethernet">
Nov 03 12:25:00 user nova-compute[74960]:       <mac address="fa:16:3e:ec:7f:b8"/>
Nov 03 12:25:00 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:25:00 user nova-compute[74960]:       <mtu size="1442"/>
Nov 03 12:25:00 user nova-compute[74960]:       <target dev="tap72da800d-49"/>
Nov 03 12:25:00 user nova-compute[74960]:     </interface>
Nov 03 12:25:00 user nova-compute[74960]:     <interface type="ethernet">
Nov 03 12:25:00 user nova-compute[74960]:       <mac address="fa:16:3e:b9:71:c0"/>
Nov 03 12:25:00 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:25:00 user nova-compute[74960]:       <mtu size="1442"/>
Nov 03 12:25:00 user nova-compute[74960]:       <target dev="tapb905e727-4d"/>
Nov 03 12:25:00 user nova-compute[74960]:     </interface>
Nov 03 12:25:00 user nova-compute[74960]:     <interface type="ethernet">
Nov 03 12:25:00 user nova-compute[74960]:       <mac address="fa:16:3e:d6:f8:7b"/>
Nov 03 12:25:00 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:25:00 user nova-compute[74960]:       <mtu size="1442"/>
Nov 03 12:25:00 user nova-compute[74960]:       <target dev="tap012765dc-7d"/>
Nov 03 12:25:00 user nova-compute[74960]:     </interface>
Nov 03 12:25:00 user nova-compute[74960]:     <interface type="ethernet">
Nov 03 12:25:00 user nova-compute[74960]:       <mac address="fa:16:3e:e5:6e:0a"/>
Nov 03 12:25:00 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:25:00 user nova-compute[74960]:       <mtu size="1442"/>
Nov 03 12:25:00 user nova-compute[74960]:       <target dev="tap412bab8b-01"/>
Nov 03 12:25:00 user nova-compute[74960]:     </interface>
Nov 03 12:25:00 user nova-compute[74960]:     <interface type="ethernet">
Nov 03 12:25:00 user nova-compute[74960]:       <mac address="fa:16:3e:7c:5c:e8"/>
Nov 03 12:25:00 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:25:00 user nova-compute[74960]:       <mtu size="1442"/>
Nov 03 12:25:00 user nova-compute[74960]:       <target dev="tap20575d86-ea"/>
Nov 03 12:25:00 user nova-compute[74960]:     </interface>
Nov 03 12:25:00 user nova-compute[74960]:     <serial type="pty">
Nov 03 12:25:00 user nova-compute[74960]:       <log file="/opt/stack/data/nova/instances/db88322f-c2ad-4622-9a1a-c45439d875a8/console.log" append="off"/>
Nov 03 12:25:00 user nova-compute[74960]:     </serial>
Nov 03 12:25:00 user nova-compute[74960]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 12:25:00 user nova-compute[74960]:     <video>
Nov 03 12:25:00 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:25:00 user nova-compute[74960]:     </video>
Nov 03 12:25:00 user nova-compute[74960]:     <rng model="virtio">
Nov 03 12:25:00 user nova-compute[74960]:       <backend model="random">/dev/urandom</backend>
Nov 03 12:25:00 user nova-compute[74960]:     </rng>
Nov 03 12:25:00 user nova-compute[74960]:     <controller type="usb" index="0" model="none"/>
Nov 03 12:25:00 user nova-compute[74960]:     <memballoon model="virtio">
Nov 03 12:25:00 user nova-compute[74960]:       <stats period="10"/>
Nov 03 12:25:00 user nova-compute[74960]:     </memballoon>
Nov 03 12:25:00 user nova-compute[74960]:   </devices>
Nov 03 12:25:00 user nova-compute[74960]: </domain>
Nov 03 12:25:00 user nova-compute[74960]:  {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 12:25:00 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T12:23:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1565525940',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1565525940',id=18,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK+6ZHlH1wKTndCYBIgu6ANG9Y2bIdl4FNNh18qkCmwdesNa7MOCTQ0WhOi5eCN1Qx65IdW7gj2YQX2eDDhNwRN+7BelIOC4SN1r8Sh9sZUc1XmzARyI8Hgp+1UUgZcu7Q==',key_name='tempest-keypair-788787740',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='32ecbf7a4b414f40ac9bb306bf9d4702',ramdisk_id='',reservation_id='r-2r3kgklh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1985714310',owner_user_name='tempest-TaggedBootDevicesTest_v242-1985714310-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:23:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='49d35d857fdf4e4f894a72610086d752',uuid=db88322f-c2ad-4622-9a1a-c45439d875a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dae50cff-c0b2-4c50-bd31-0d1bf1a17e55", "address": "fa:16:3e:c8:88:99", "network": {"id": "f771bed5-ff95-49cd-9871-08b128de2619", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-756048610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32ecbf7a4b414f40ac9bb306bf9d4702", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdae50cff-c0", "ovs_interfaceid": "dae50cff-c0b2-4c50-bd31-0d1bf1a17e55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 12:25:00 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Converting VIF {"id": "dae50cff-c0b2-4c50-bd31-0d1bf1a17e55", "address": "fa:16:3e:c8:88:99", "network": {"id": "f771bed5-ff95-49cd-9871-08b128de2619", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-756048610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32ecbf7a4b414f40ac9bb306bf9d4702", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdae50cff-c0", "ovs_interfaceid": "dae50cff-c0b2-4c50-bd31-0d1bf1a17e55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:25:00 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:88:99,bridge_name='br-int',has_traffic_filtering=True,id=dae50cff-c0b2-4c50-bd31-0d1bf1a17e55,network=Network(f771bed5-ff95-49cd-9871-08b128de2619),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdae50cff-c0') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:25:00 user nova-compute[74960]: DEBUG os_vif [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:88:99,bridge_name='br-int',has_traffic_filtering=True,id=dae50cff-c0b2-4c50-bd31-0d1bf1a17e55,network=Network(f771bed5-ff95-49cd-9871-08b128de2619),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdae50cff-c0') {{(pid=74960) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 12:25:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:25:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 12:25:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4a077627-e53a-561c-9cdc-150cb9e2ada2', '_type': 'linux-noop'}}, row=False) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:25:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:25:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdae50cff-c0, may_exist=True, interface_attrs={}) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:25:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdae50cff-c0, col_values=(('qos', UUID('f19a4de5-94ca-4caa-b6ad-b8c6b0582645')),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:25:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdae50cff-c0, col_values=(('external_ids', {'iface-id': 'dae50cff-c0b2-4c50-bd31-0d1bf1a17e55', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c8:88:99', 'vm-uuid': 'db88322f-c2ad-4622-9a1a-c45439d875a8'}),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:25:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:25:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:00 user nova-compute[74960]: INFO os_vif [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:88:99,bridge_name='br-int',has_traffic_filtering=True,id=dae50cff-c0b2-4c50-bd31-0d1bf1a17e55,network=Network(f771bed5-ff95-49cd-9871-08b128de2619),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdae50cff-c0')
Nov 03 12:25:00 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T12:23:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1565525940',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1565525940',id=18,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK+6ZHlH1wKTndCYBIgu6ANG9Y2bIdl4FNNh18qkCmwdesNa7MOCTQ0WhOi5eCN1Qx65IdW7gj2YQX2eDDhNwRN+7BelIOC4SN1r8Sh9sZUc1XmzARyI8Hgp+1UUgZcu7Q==',key_name='tempest-keypair-788787740',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='32ecbf7a4b414f40ac9bb306bf9d4702',ramdisk_id='',reservation_id='r-2r3kgklh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1985714310',owner_user_name='tempest-TaggedBootDevicesTest_v242-1985714310-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:23:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='49d35d857fdf4e4f894a72610086d752',uuid=db88322f-c2ad-4622-9a1a-c45439d875a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9207158b-c88b-44b8-b419-eba87e570339", "address": "fa:16:3e:1a:2c:15", "network": {"id": "a61d6a8a-acdb-4b52-bebc-1b90d89b25f2", "bridge": "br-int", "label": "tempest-device-tagging-net1-20653421", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32ecbf7a4b414f40ac9bb306bf9d4702", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9207158b-c8", "ovs_interfaceid": "9207158b-c88b-44b8-b419-eba87e570339", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74960) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 12:25:00 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Converting VIF {"id": "9207158b-c88b-44b8-b419-eba87e570339", "address": "fa:16:3e:1a:2c:15", "network": {"id": "a61d6a8a-acdb-4b52-bebc-1b90d89b25f2", "bridge": "br-int", "label": "tempest-device-tagging-net1-20653421", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32ecbf7a4b414f40ac9bb306bf9d4702", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9207158b-c8", "ovs_interfaceid": "9207158b-c88b-44b8-b419-eba87e570339", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:25:00 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:2c:15,bridge_name='br-int',has_traffic_filtering=True,id=9207158b-c88b-44b8-b419-eba87e570339,network=Network(a61d6a8a-acdb-4b52-bebc-1b90d89b25f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9207158b-c8') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:25:00 user nova-compute[74960]: DEBUG os_vif [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:2c:15,bridge_name='br-int',has_traffic_filtering=True,id=9207158b-c88b-44b8-b419-eba87e570339,network=Network(a61d6a8a-acdb-4b52-bebc-1b90d89b25f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9207158b-c8') {{(pid=74960) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 12:25:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:25:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 12:25:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3b680329-9e7b-5cf0-b4d7-7ba847d2bef4', '_type': 'linux-noop'}}, row=False) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:25:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:25:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9207158b-c8, may_exist=True, interface_attrs={}) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:25:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9207158b-c8, col_values=(('qos', UUID('ade94521-5c1b-41ab-bcb0-5f5682272696')),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:25:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9207158b-c8, col_values=(('external_ids', {'iface-id': '9207158b-c88b-44b8-b419-eba87e570339', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1a:2c:15', 'vm-uuid': 'db88322f-c2ad-4622-9a1a-c45439d875a8'}),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:25:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:25:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:00 user nova-compute[74960]: INFO os_vif [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:2c:15,bridge_name='br-int',has_traffic_filtering=True,id=9207158b-c88b-44b8-b419-eba87e570339,network=Network(a61d6a8a-acdb-4b52-bebc-1b90d89b25f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9207158b-c8')
Nov 03 12:25:00 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T12:23:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1565525940',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1565525940',id=18,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK+6ZHlH1wKTndCYBIgu6ANG9Y2bIdl4FNNh18qkCmwdesNa7MOCTQ0WhOi5eCN1Qx65IdW7gj2YQX2eDDhNwRN+7BelIOC4SN1r8Sh9sZUc1XmzARyI8Hgp+1UUgZcu7Q==',key_name='tempest-keypair-788787740',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='32ecbf7a4b414f40ac9bb306bf9d4702',ramdisk_id='',reservation_id='r-2r3kgklh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1985714310',owner_user_name='tempest-TaggedBootDevicesTest_v242-1985714310-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:23:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='49d35d857fdf4e4f894a72610086d752',uuid=db88322f-c2ad-4622-9a1a-c45439d875a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "72da800d-493b-4dc6-8988-1259e2423188", "address": "fa:16:3e:ec:7f:b8", "network": {"id": "a61d6a8a-acdb-4b52-bebc-1b90d89b25f2", "bridge": "br-int", "label": "tempest-device-tagging-net1-20653421", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32ecbf7a4b414f40ac9bb306bf9d4702", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72da800d-49", "ovs_interfaceid": "72da800d-493b-4dc6-8988-1259e2423188", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74960) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 12:25:00 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Converting VIF {"id": "72da800d-493b-4dc6-8988-1259e2423188", "address": "fa:16:3e:ec:7f:b8", "network": {"id": "a61d6a8a-acdb-4b52-bebc-1b90d89b25f2", "bridge": "br-int", "label": "tempest-device-tagging-net1-20653421", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32ecbf7a4b414f40ac9bb306bf9d4702", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72da800d-49", "ovs_interfaceid": "72da800d-493b-4dc6-8988-1259e2423188", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:25:00 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:7f:b8,bridge_name='br-int',has_traffic_filtering=True,id=72da800d-493b-4dc6-8988-1259e2423188,network=Network(a61d6a8a-acdb-4b52-bebc-1b90d89b25f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap72da800d-49') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:25:00 user nova-compute[74960]: DEBUG os_vif [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:7f:b8,bridge_name='br-int',has_traffic_filtering=True,id=72da800d-493b-4dc6-8988-1259e2423188,network=Network(a61d6a8a-acdb-4b52-bebc-1b90d89b25f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap72da800d-49') {{(pid=74960) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 12:25:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:25:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 12:25:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e9aac288-879f-58b9-9ca6-90b75aa43ed8', '_type': 'linux-noop'}}, row=False) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:25:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:25:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap72da800d-49, may_exist=True, interface_attrs={}) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:25:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap72da800d-49, col_values=(('qos', UUID('98fd1593-d9c1-4560-92a9-2abe88b26805')),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:25:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap72da800d-49, col_values=(('external_ids', {'iface-id': '72da800d-493b-4dc6-8988-1259e2423188', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ec:7f:b8', 'vm-uuid': 'db88322f-c2ad-4622-9a1a-c45439d875a8'}),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:25:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:25:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:00 user nova-compute[74960]: INFO os_vif [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:7f:b8,bridge_name='br-int',has_traffic_filtering=True,id=72da800d-493b-4dc6-8988-1259e2423188,network=Network(a61d6a8a-acdb-4b52-bebc-1b90d89b25f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap72da800d-49')
Nov 03 12:25:00 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T12:23:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1565525940',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1565525940',id=18,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK+6ZHlH1wKTndCYBIgu6ANG9Y2bIdl4FNNh18qkCmwdesNa7MOCTQ0WhOi5eCN1Qx65IdW7gj2YQX2eDDhNwRN+7BelIOC4SN1r8Sh9sZUc1XmzARyI8Hgp+1UUgZcu7Q==',key_name='tempest-keypair-788787740',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='32ecbf7a4b414f40ac9bb306bf9d4702',ramdisk_id='',reservation_id='r-2r3kgklh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1985714310',owner_user_name='tempest-TaggedBootDevicesTest_v242-1985714310-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:23:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='49d35d857fdf4e4f894a72610086d752',uuid=db88322f-c2ad-4622-9a1a-c45439d875a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b905e727-4d81-4518-8cae-06f4e64bcccc", "address": "fa:16:3e:b9:71:c0", "network": {"id": "a61d6a8a-acdb-4b52-bebc-1b90d89b25f2", "bridge": "br-int", "label": "tempest-device-tagging-net1-20653421", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32ecbf7a4b414f40ac9bb306bf9d4702", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb905e727-4d", "ovs_interfaceid": "b905e727-4d81-4518-8cae-06f4e64bcccc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 12:25:00 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Converting VIF {"id": "b905e727-4d81-4518-8cae-06f4e64bcccc", "address": "fa:16:3e:b9:71:c0", "network": {"id": "a61d6a8a-acdb-4b52-bebc-1b90d89b25f2", "bridge": "br-int", "label": "tempest-device-tagging-net1-20653421", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32ecbf7a4b414f40ac9bb306bf9d4702", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb905e727-4d", "ovs_interfaceid": "b905e727-4d81-4518-8cae-06f4e64bcccc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:25:00 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:71:c0,bridge_name='br-int',has_traffic_filtering=True,id=b905e727-4d81-4518-8cae-06f4e64bcccc,network=Network(a61d6a8a-acdb-4b52-bebc-1b90d89b25f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb905e727-4d') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:25:00 user nova-compute[74960]: DEBUG os_vif [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:71:c0,bridge_name='br-int',has_traffic_filtering=True,id=b905e727-4d81-4518-8cae-06f4e64bcccc,network=Network(a61d6a8a-acdb-4b52-bebc-1b90d89b25f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb905e727-4d') {{(pid=74960) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 12:25:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:25:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 12:25:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5b808163-385c-5768-aed7-a7b80daf9a10', '_type': 'linux-noop'}}, row=False) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:25:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:25:01 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:01 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:01 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb905e727-4d, may_exist=True, interface_attrs={}) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:25:01 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb905e727-4d, col_values=(('qos', UUID('bc676965-446a-44ed-b68b-49bd71ba368d')),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:25:01 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb905e727-4d, col_values=(('external_ids', {'iface-id': 'b905e727-4d81-4518-8cae-06f4e64bcccc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b9:71:c0', 'vm-uuid': 'db88322f-c2ad-4622-9a1a-c45439d875a8'}),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:25:01 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:01 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:25:01 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:01 user nova-compute[74960]: INFO os_vif [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:71:c0,bridge_name='br-int',has_traffic_filtering=True,id=b905e727-4d81-4518-8cae-06f4e64bcccc,network=Network(a61d6a8a-acdb-4b52-bebc-1b90d89b25f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb905e727-4d')
Nov 03 12:25:01 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T12:23:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1565525940',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1565525940',id=18,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK+6ZHlH1wKTndCYBIgu6ANG9Y2bIdl4FNNh18qkCmwdesNa7MOCTQ0WhOi5eCN1Qx65IdW7gj2YQX2eDDhNwRN+7BelIOC4SN1r8Sh9sZUc1XmzARyI8Hgp+1UUgZcu7Q==',key_name='tempest-keypair-788787740',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='32ecbf7a4b414f40ac9bb306bf9d4702',ramdisk_id='',reservation_id='r-2r3kgklh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1985714310',owner_user_name='tempest-TaggedBootDevicesTest_v242-1985714310-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:23:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='49d35d857fdf4e4f894a72610086d752',uuid=db88322f-c2ad-4622-9a1a-c45439d875a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "012765dc-7d42-41d5-b12b-34f3a2a7ef07", "address": "fa:16:3e:d6:f8:7b", "network": {"id": "a61d6a8a-acdb-4b52-bebc-1b90d89b25f2", "bridge": "br-int", "label": "tempest-device-tagging-net1-20653421", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32ecbf7a4b414f40ac9bb306bf9d4702", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap012765dc-7d", "ovs_interfaceid": "012765dc-7d42-41d5-b12b-34f3a2a7ef07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 12:25:01 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Converting VIF {"id": "012765dc-7d42-41d5-b12b-34f3a2a7ef07", "address": "fa:16:3e:d6:f8:7b", "network": {"id": "a61d6a8a-acdb-4b52-bebc-1b90d89b25f2", "bridge": "br-int", "label": "tempest-device-tagging-net1-20653421", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32ecbf7a4b414f40ac9bb306bf9d4702", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap012765dc-7d", "ovs_interfaceid": "012765dc-7d42-41d5-b12b-34f3a2a7ef07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:25:01 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:f8:7b,bridge_name='br-int',has_traffic_filtering=True,id=012765dc-7d42-41d5-b12b-34f3a2a7ef07,network=Network(a61d6a8a-acdb-4b52-bebc-1b90d89b25f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap012765dc-7d') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:25:01 user nova-compute[74960]: DEBUG os_vif [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:f8:7b,bridge_name='br-int',has_traffic_filtering=True,id=012765dc-7d42-41d5-b12b-34f3a2a7ef07,network=Network(a61d6a8a-acdb-4b52-bebc-1b90d89b25f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap012765dc-7d') {{(pid=74960) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 12:25:01 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:01 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:25:01 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 12:25:01 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:01 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4b838bd4-9348-5fb9-99d0-4037956ad3c5', '_type': 'linux-noop'}}, row=False) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:25:01 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:01 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:25:01 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:01 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:01 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap012765dc-7d, may_exist=True, interface_attrs={}) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:25:01 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap012765dc-7d, col_values=(('qos', UUID('715a68c2-48f0-4460-af98-db530454abc3')),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:25:01 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap012765dc-7d, col_values=(('external_ids', {'iface-id': '012765dc-7d42-41d5-b12b-34f3a2a7ef07', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d6:f8:7b', 'vm-uuid': 'db88322f-c2ad-4622-9a1a-c45439d875a8'}),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:25:01 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:01 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:25:01 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:01 user nova-compute[74960]: INFO os_vif [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:f8:7b,bridge_name='br-int',has_traffic_filtering=True,id=012765dc-7d42-41d5-b12b-34f3a2a7ef07,network=Network(a61d6a8a-acdb-4b52-bebc-1b90d89b25f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap012765dc-7d')
Nov 03 12:25:01 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T12:23:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1565525940',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1565525940',id=18,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK+6ZHlH1wKTndCYBIgu6ANG9Y2bIdl4FNNh18qkCmwdesNa7MOCTQ0WhOi5eCN1Qx65IdW7gj2YQX2eDDhNwRN+7BelIOC4SN1r8Sh9sZUc1XmzARyI8Hgp+1UUgZcu7Q==',key_name='tempest-keypair-788787740',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='32ecbf7a4b414f40ac9bb306bf9d4702',ramdisk_id='',reservation_id='r-2r3kgklh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1985714310',owner_user_name='tempest-TaggedBootDevicesTest_v242-1985714310-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:23:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='49d35d857fdf4e4f894a72610086d752',uuid=db88322f-c2ad-4622-9a1a-c45439d875a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "412bab8b-015e-4df4-92c8-2ed71a8ca2f7", "address": "fa:16:3e:e5:6e:0a", "network": {"id": "103d876e-44c1-4732-b994-193d642fbd96", "bridge": "br-int", "label": "tempest-device-tagging-net2-1835187118", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "32ecbf7a4b414f40ac9bb306bf9d4702", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap412bab8b-01", "ovs_interfaceid": "412bab8b-015e-4df4-92c8-2ed71a8ca2f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 12:25:01 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Converting VIF {"id": "412bab8b-015e-4df4-92c8-2ed71a8ca2f7", "address": "fa:16:3e:e5:6e:0a", "network": {"id": "103d876e-44c1-4732-b994-193d642fbd96", "bridge": "br-int", "label": "tempest-device-tagging-net2-1835187118", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "32ecbf7a4b414f40ac9bb306bf9d4702", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap412bab8b-01", "ovs_interfaceid": "412bab8b-015e-4df4-92c8-2ed71a8ca2f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:25:01 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:6e:0a,bridge_name='br-int',has_traffic_filtering=True,id=412bab8b-015e-4df4-92c8-2ed71a8ca2f7,network=Network(103d876e-44c1-4732-b994-193d642fbd96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap412bab8b-01') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:25:01 user nova-compute[74960]: DEBUG os_vif [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:6e:0a,bridge_name='br-int',has_traffic_filtering=True,id=412bab8b-015e-4df4-92c8-2ed71a8ca2f7,network=Network(103d876e-44c1-4732-b994-193d642fbd96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap412bab8b-01') {{(pid=74960) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 12:25:01 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:01 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:25:01 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 12:25:01 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:01 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bc1fcca2-2e37-5965-95e6-1987c550d538', '_type': 'linux-noop'}}, row=False) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:25:01 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:01 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:25:01 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:01 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:01 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap412bab8b-01, may_exist=True, interface_attrs={}) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:25:01 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap412bab8b-01, col_values=(('qos', UUID('7933366c-7a14-4112-b1ba-3ff16a0501e2')),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:25:01 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap412bab8b-01, col_values=(('external_ids', {'iface-id': '412bab8b-015e-4df4-92c8-2ed71a8ca2f7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e5:6e:0a', 'vm-uuid': 'db88322f-c2ad-4622-9a1a-c45439d875a8'}),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:25:01 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:01 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:25:01 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:01 user nova-compute[74960]: INFO os_vif [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:6e:0a,bridge_name='br-int',has_traffic_filtering=True,id=412bab8b-015e-4df4-92c8-2ed71a8ca2f7,network=Network(103d876e-44c1-4732-b994-193d642fbd96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap412bab8b-01')
Nov 03 12:25:01 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T12:23:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1565525940',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1565525940',id=18,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK+6ZHlH1wKTndCYBIgu6ANG9Y2bIdl4FNNh18qkCmwdesNa7MOCTQ0WhOi5eCN1Qx65IdW7gj2YQX2eDDhNwRN+7BelIOC4SN1r8Sh9sZUc1XmzARyI8Hgp+1UUgZcu7Q==',key_name='tempest-keypair-788787740',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='32ecbf7a4b414f40ac9bb306bf9d4702',ramdisk_id='',reservation_id='r-2r3kgklh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1985714310',owner_user_name='tempest-TaggedBootDevicesTest_v242-1985714310-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:23:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='49d35d857fdf4e4f894a72610086d752',uuid=db88322f-c2ad-4622-9a1a-c45439d875a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "20575d86-ea6c-4d0d-8190-70fe728bc7c1", "address": "fa:16:3e:7c:5c:e8", "network": {"id": "103d876e-44c1-4732-b994-193d642fbd96", "bridge": "br-int", "label": "tempest-device-tagging-net2-1835187118", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "32ecbf7a4b414f40ac9bb306bf9d4702", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20575d86-ea", "ovs_interfaceid": "20575d86-ea6c-4d0d-8190-70fe728bc7c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 12:25:01 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Converting VIF {"id": "20575d86-ea6c-4d0d-8190-70fe728bc7c1", "address": "fa:16:3e:7c:5c:e8", "network": {"id": "103d876e-44c1-4732-b994-193d642fbd96", "bridge": "br-int", "label": "tempest-device-tagging-net2-1835187118", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "32ecbf7a4b414f40ac9bb306bf9d4702", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20575d86-ea", "ovs_interfaceid": "20575d86-ea6c-4d0d-8190-70fe728bc7c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:25:01 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:5c:e8,bridge_name='br-int',has_traffic_filtering=True,id=20575d86-ea6c-4d0d-8190-70fe728bc7c1,network=Network(103d876e-44c1-4732-b994-193d642fbd96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20575d86-ea') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:25:01 user nova-compute[74960]: DEBUG os_vif [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:5c:e8,bridge_name='br-int',has_traffic_filtering=True,id=20575d86-ea6c-4d0d-8190-70fe728bc7c1,network=Network(103d876e-44c1-4732-b994-193d642fbd96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20575d86-ea') {{(pid=74960) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 12:25:01 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:01 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:25:01 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 12:25:01 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:01 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '811f303c-67dc-5e6a-8e5c-2c89531393dc', '_type': 'linux-noop'}}, row=False) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:25:01 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:01 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:25:01 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:01 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:01 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap20575d86-ea, may_exist=True, interface_attrs={}) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:25:01 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap20575d86-ea, col_values=(('qos', UUID('c8969923-f6e8-4841-a9b6-5ac5a960bce1')),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:25:01 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap20575d86-ea, col_values=(('external_ids', {'iface-id': '20575d86-ea6c-4d0d-8190-70fe728bc7c1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7c:5c:e8', 'vm-uuid': 'db88322f-c2ad-4622-9a1a-c45439d875a8'}),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:25:01 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:01 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:25:01 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:01 user nova-compute[74960]: INFO os_vif [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:5c:e8,bridge_name='br-int',has_traffic_filtering=True,id=20575d86-ea6c-4d0d-8190-70fe728bc7c1,network=Network(103d876e-44c1-4732-b994-193d642fbd96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20575d86-ea')
Nov 03 12:25:01 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] No BDM found with device name hda, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:25:01 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:25:01 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] No VIF found with MAC fa:16:3e:c8:88:99, not building metadata {{(pid=74960) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 12:25:01 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] No VIF found with MAC fa:16:3e:d6:f8:7b, not building metadata {{(pid=74960) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 12:25:01 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Using config drive
Nov 03 12:25:01 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Creating config drive at /opt/stack/data/nova/instances/db88322f-c2ad-4622-9a1a-c45439d875a8/disk.config
Nov 03 12:25:01 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/db88322f-c2ad-4622-9a1a-c45439d875a8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpi9hmdz_l {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:25:01 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/db88322f-c2ad-4622-9a1a-c45439d875a8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpi9hmdz_l" returned: 0 in 0.078s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:25:02 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-bf46ed48-31ca-4e01-9fa7-0097c8718d1c tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Acquiring lock "87f15f5f-8afa-4d7b-bb45-5887184f9ee5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:25:02 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-bf46ed48-31ca-4e01-9fa7-0097c8718d1c tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Lock "87f15f5f-8afa-4d7b-bb45-5887184f9ee5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:25:02 user nova-compute[74960]: DEBUG nova.compute.manager [None req-bf46ed48-31ca-4e01-9fa7-0097c8718d1c tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: 87f15f5f-8afa-4d7b-bb45-5887184f9ee5] Starting instance... {{(pid=74960) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 12:25:02 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-bf46ed48-31ca-4e01-9fa7-0097c8718d1c tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:25:02 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-bf46ed48-31ca-4e01-9fa7-0097c8718d1c tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:25:02 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-bf46ed48-31ca-4e01-9fa7-0097c8718d1c tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74960) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 12:25:02 user nova-compute[74960]: INFO nova.compute.claims [None req-bf46ed48-31ca-4e01-9fa7-0097c8718d1c tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: 87f15f5f-8afa-4d7b-bb45-5887184f9ee5] Claim successful on node user
Nov 03 12:25:02 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-bf46ed48-31ca-4e01-9fa7-0097c8718d1c tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:25:02 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-bf46ed48-31ca-4e01-9fa7-0097c8718d1c tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:25:02 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-bf46ed48-31ca-4e01-9fa7-0097c8718d1c tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.446s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:25:02 user nova-compute[74960]: DEBUG nova.compute.manager [None req-bf46ed48-31ca-4e01-9fa7-0097c8718d1c tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: 87f15f5f-8afa-4d7b-bb45-5887184f9ee5] Start building networks asynchronously for instance. {{(pid=74960) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 12:25:02 user nova-compute[74960]: DEBUG nova.compute.manager [None req-bf46ed48-31ca-4e01-9fa7-0097c8718d1c tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: 87f15f5f-8afa-4d7b-bb45-5887184f9ee5] Allocating IP information in the background. {{(pid=74960) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 12:25:02 user nova-compute[74960]: DEBUG nova.network.neutron [None req-bf46ed48-31ca-4e01-9fa7-0097c8718d1c tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: 87f15f5f-8afa-4d7b-bb45-5887184f9ee5] allocate_for_instance() {{(pid=74960) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 12:25:02 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-bf46ed48-31ca-4e01-9fa7-0097c8718d1c tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: 87f15f5f-8afa-4d7b-bb45-5887184f9ee5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 12:25:02 user nova-compute[74960]: DEBUG nova.compute.manager [None req-bf46ed48-31ca-4e01-9fa7-0097c8718d1c tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: 87f15f5f-8afa-4d7b-bb45-5887184f9ee5] Start building block device mappings for instance. {{(pid=74960) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 12:25:02 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:02 user nova-compute[74960]: DEBUG nova.policy [None req-bf46ed48-31ca-4e01-9fa7-0097c8718d1c tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c473215929044a108c9fc4d6327dfc3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc95d68d5e147e1953c855169b17091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74960) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 12:25:02 user nova-compute[74960]: DEBUG nova.compute.manager [None req-bf46ed48-31ca-4e01-9fa7-0097c8718d1c tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: 87f15f5f-8afa-4d7b-bb45-5887184f9ee5] Start spawning the instance on the hypervisor. {{(pid=74960) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 12:25:02 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-bf46ed48-31ca-4e01-9fa7-0097c8718d1c tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: 87f15f5f-8afa-4d7b-bb45-5887184f9ee5] Creating instance directory {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 12:25:02 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-bf46ed48-31ca-4e01-9fa7-0097c8718d1c tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: 87f15f5f-8afa-4d7b-bb45-5887184f9ee5] Creating image(s)
Nov 03 12:25:02 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-bf46ed48-31ca-4e01-9fa7-0097c8718d1c tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Acquiring lock "/opt/stack/data/nova/instances/87f15f5f-8afa-4d7b-bb45-5887184f9ee5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:25:02 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-bf46ed48-31ca-4e01-9fa7-0097c8718d1c tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Lock "/opt/stack/data/nova/instances/87f15f5f-8afa-4d7b-bb45-5887184f9ee5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:25:02 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-bf46ed48-31ca-4e01-9fa7-0097c8718d1c tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Lock "/opt/stack/data/nova/instances/87f15f5f-8afa-4d7b-bb45-5887184f9ee5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:25:02 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-bf46ed48-31ca-4e01-9fa7-0097c8718d1c tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:25:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-bf46ed48-31ca-4e01-9fa7-0097c8718d1c tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.244s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:25:03 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-bf46ed48-31ca-4e01-9fa7-0097c8718d1c tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Acquiring lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:25:03 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-bf46ed48-31ca-4e01-9fa7-0097c8718d1c tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:25:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-bf46ed48-31ca-4e01-9fa7-0097c8718d1c tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:25:03 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:03 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-bf46ed48-31ca-4e01-9fa7-0097c8718d1c tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.235s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:25:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-bf46ed48-31ca-4e01-9fa7-0097c8718d1c tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910,backing_fmt=raw /opt/stack/data/nova/instances/87f15f5f-8afa-4d7b-bb45-5887184f9ee5/disk 1073741824 {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:25:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-bf46ed48-31ca-4e01-9fa7-0097c8718d1c tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910,backing_fmt=raw /opt/stack/data/nova/instances/87f15f5f-8afa-4d7b-bb45-5887184f9ee5/disk 1073741824" returned: 0 in 0.053s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:25:03 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-bf46ed48-31ca-4e01-9fa7-0097c8718d1c tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.299s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:25:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-bf46ed48-31ca-4e01-9fa7-0097c8718d1c tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:25:03 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-bf46ed48-31ca-4e01-9fa7-0097c8718d1c tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.194s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:25:03 user nova-compute[74960]: DEBUG nova.virt.disk.api [None req-bf46ed48-31ca-4e01-9fa7-0097c8718d1c tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Checking if we can resize image /opt/stack/data/nova/instances/87f15f5f-8afa-4d7b-bb45-5887184f9ee5/disk. size=1073741824 {{(pid=74960) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 12:25:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-bf46ed48-31ca-4e01-9fa7-0097c8718d1c tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f15f5f-8afa-4d7b-bb45-5887184f9ee5/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:25:03 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:03 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:03 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:03 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-bf46ed48-31ca-4e01-9fa7-0097c8718d1c tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f15f5f-8afa-4d7b-bb45-5887184f9ee5/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:25:03 user nova-compute[74960]: DEBUG nova.virt.disk.api [None req-bf46ed48-31ca-4e01-9fa7-0097c8718d1c tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Cannot resize image /opt/stack/data/nova/instances/87f15f5f-8afa-4d7b-bb45-5887184f9ee5/disk to a smaller size. {{(pid=74960) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 12:25:03 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-bf46ed48-31ca-4e01-9fa7-0097c8718d1c tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: 87f15f5f-8afa-4d7b-bb45-5887184f9ee5] Created local disks {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 12:25:03 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-bf46ed48-31ca-4e01-9fa7-0097c8718d1c tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: 87f15f5f-8afa-4d7b-bb45-5887184f9ee5] Ensure instance console log exists: /opt/stack/data/nova/instances/87f15f5f-8afa-4d7b-bb45-5887184f9ee5/console.log {{(pid=74960) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 12:25:03 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-bf46ed48-31ca-4e01-9fa7-0097c8718d1c tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:25:03 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-bf46ed48-31ca-4e01-9fa7-0097c8718d1c tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:25:03 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-bf46ed48-31ca-4e01-9fa7-0097c8718d1c tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:25:03 user nova-compute[74960]: DEBUG nova.network.neutron [None req-bf46ed48-31ca-4e01-9fa7-0097c8718d1c tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: 87f15f5f-8afa-4d7b-bb45-5887184f9ee5] Successfully created port: 4a12f8bf-1920-4e7a-afec-9b716b73ff63 {{(pid=74960) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 12:25:03 user nova-compute[74960]: DEBUG nova.compute.manager [req-0e2f4025-28a5-4fbc-b0c2-2421c0172ab1 req-af042493-a997-40a2-8159-a06ee92f8683 service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Received event network-vif-plugged-dae50cff-c0b2-4c50-bd31-0d1bf1a17e55 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:25:03 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-0e2f4025-28a5-4fbc-b0c2-2421c0172ab1 req-af042493-a997-40a2-8159-a06ee92f8683 service nova] Acquiring lock "db88322f-c2ad-4622-9a1a-c45439d875a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:25:03 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-0e2f4025-28a5-4fbc-b0c2-2421c0172ab1 req-af042493-a997-40a2-8159-a06ee92f8683 service nova] Lock "db88322f-c2ad-4622-9a1a-c45439d875a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:25:03 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-0e2f4025-28a5-4fbc-b0c2-2421c0172ab1 req-af042493-a997-40a2-8159-a06ee92f8683 service nova] Lock "db88322f-c2ad-4622-9a1a-c45439d875a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:25:03 user nova-compute[74960]: DEBUG nova.compute.manager [req-0e2f4025-28a5-4fbc-b0c2-2421c0172ab1 req-af042493-a997-40a2-8159-a06ee92f8683 service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] No waiting events found dispatching network-vif-plugged-dae50cff-c0b2-4c50-bd31-0d1bf1a17e55 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:25:03 user nova-compute[74960]: WARNING nova.compute.manager [req-0e2f4025-28a5-4fbc-b0c2-2421c0172ab1 req-af042493-a997-40a2-8159-a06ee92f8683 service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Received unexpected event network-vif-plugged-dae50cff-c0b2-4c50-bd31-0d1bf1a17e55 for instance with vm_state building and task_state spawning.
Nov 03 12:25:04 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:04 user nova-compute[74960]: DEBUG nova.compute.manager [req-48ed360d-b3dc-4cea-bd47-b28a832feaf4 req-fee81837-c49e-47c8-8bf7-cd59435e14a9 service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Received event network-vif-plugged-9207158b-c88b-44b8-b419-eba87e570339 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:25:04 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-48ed360d-b3dc-4cea-bd47-b28a832feaf4 req-fee81837-c49e-47c8-8bf7-cd59435e14a9 service nova] Acquiring lock "db88322f-c2ad-4622-9a1a-c45439d875a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:25:04 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-48ed360d-b3dc-4cea-bd47-b28a832feaf4 req-fee81837-c49e-47c8-8bf7-cd59435e14a9 service nova] Lock "db88322f-c2ad-4622-9a1a-c45439d875a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:25:04 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-48ed360d-b3dc-4cea-bd47-b28a832feaf4 req-fee81837-c49e-47c8-8bf7-cd59435e14a9 service nova] Lock "db88322f-c2ad-4622-9a1a-c45439d875a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:25:04 user nova-compute[74960]: DEBUG nova.compute.manager [req-48ed360d-b3dc-4cea-bd47-b28a832feaf4 req-fee81837-c49e-47c8-8bf7-cd59435e14a9 service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] No waiting events found dispatching network-vif-plugged-9207158b-c88b-44b8-b419-eba87e570339 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:25:04 user nova-compute[74960]: WARNING nova.compute.manager [req-48ed360d-b3dc-4cea-bd47-b28a832feaf4 req-fee81837-c49e-47c8-8bf7-cd59435e14a9 service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Received unexpected event network-vif-plugged-9207158b-c88b-44b8-b419-eba87e570339 for instance with vm_state building and task_state spawning.
Nov 03 12:25:04 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:04 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:04 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:04 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:04 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:04 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:04 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:04 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:04 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:04 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:04 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:04 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:04 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:04 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:04 user nova-compute[74960]: DEBUG nova.network.neutron [None req-bf46ed48-31ca-4e01-9fa7-0097c8718d1c tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: 87f15f5f-8afa-4d7b-bb45-5887184f9ee5] Successfully updated port: 4a12f8bf-1920-4e7a-afec-9b716b73ff63 {{(pid=74960) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 12:25:04 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-bf46ed48-31ca-4e01-9fa7-0097c8718d1c tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Acquiring lock "refresh_cache-87f15f5f-8afa-4d7b-bb45-5887184f9ee5" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:25:04 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-bf46ed48-31ca-4e01-9fa7-0097c8718d1c tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Acquired lock "refresh_cache-87f15f5f-8afa-4d7b-bb45-5887184f9ee5" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:25:04 user nova-compute[74960]: DEBUG nova.network.neutron [None req-bf46ed48-31ca-4e01-9fa7-0097c8718d1c tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: 87f15f5f-8afa-4d7b-bb45-5887184f9ee5] Building network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 12:25:04 user nova-compute[74960]: DEBUG nova.network.neutron [None req-bf46ed48-31ca-4e01-9fa7-0097c8718d1c tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: 87f15f5f-8afa-4d7b-bb45-5887184f9ee5] Instance cache missing network info. {{(pid=74960) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 12:25:05 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:05 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:05 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:05 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:05 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:05 user nova-compute[74960]: DEBUG nova.network.neutron [None req-bf46ed48-31ca-4e01-9fa7-0097c8718d1c tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: 87f15f5f-8afa-4d7b-bb45-5887184f9ee5] Updating instance_info_cache with network_info: [{"id": "4a12f8bf-1920-4e7a-afec-9b716b73ff63", "address": "fa:16:3e:be:f4:7d", "network": {"id": "dec66832-56d5-4d68-b11f-8e8eed38f045", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-79099436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc95d68d5e147e1953c855169b17091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a12f8bf-19", "ovs_interfaceid": "4a12f8bf-1920-4e7a-afec-9b716b73ff63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:25:05 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-bf46ed48-31ca-4e01-9fa7-0097c8718d1c tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Releasing lock "refresh_cache-87f15f5f-8afa-4d7b-bb45-5887184f9ee5" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:25:05 user nova-compute[74960]: DEBUG nova.compute.manager [None req-bf46ed48-31ca-4e01-9fa7-0097c8718d1c tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: 87f15f5f-8afa-4d7b-bb45-5887184f9ee5] Instance network_info: |[{"id": "4a12f8bf-1920-4e7a-afec-9b716b73ff63", "address": "fa:16:3e:be:f4:7d", "network": {"id": "dec66832-56d5-4d68-b11f-8e8eed38f045", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-79099436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc95d68d5e147e1953c855169b17091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a12f8bf-19", "ovs_interfaceid": "4a12f8bf-1920-4e7a-afec-9b716b73ff63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74960) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 12:25:05 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-bf46ed48-31ca-4e01-9fa7-0097c8718d1c tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: 87f15f5f-8afa-4d7b-bb45-5887184f9ee5] Start _get_guest_xml network_info=[{"id": "4a12f8bf-1920-4e7a-afec-9b716b73ff63", "address": "fa:16:3e:be:f4:7d", "network": {"id": "dec66832-56d5-4d68-b11f-8e8eed38f045", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-79099436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc95d68d5e147e1953c855169b17091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a12f8bf-19", "ovs_interfaceid": "4a12f8bf-1920-4e7a-afec-9b716b73ff63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=549f51ba-ac69-494b-8de1-34635aa2d7cf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='63ee9c80c632442fb0379f47b784bd20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T12:13:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'image_id': '549f51ba-ac69-494b-8de1-34635aa2d7cf'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 12:25:05 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-bf46ed48-31ca-4e01-9fa7-0097c8718d1c tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:25:05 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-bf46ed48-31ca-4e01-9fa7-0097c8718d1c tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:25:05 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-bf46ed48-31ca-4e01-9fa7-0097c8718d1c tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 12:25:05 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-bf46ed48-31ca-4e01-9fa7-0097c8718d1c tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] CPU controller missing on host. {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 12:25:05 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-bf46ed48-31ca-4e01-9fa7-0097c8718d1c tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 12:25:05 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-bf46ed48-31ca-4e01-9fa7-0097c8718d1c tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] CPU controller found on host. {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 12:25:05 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-bf46ed48-31ca-4e01-9fa7-0097c8718d1c tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74960) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 12:25:05 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-bf46ed48-31ca-4e01-9fa7-0097c8718d1c tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=549f51ba-ac69-494b-8de1-34635aa2d7cf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='63ee9c80c632442fb0379f47b784bd20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T12:13:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 12:25:05 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-bf46ed48-31ca-4e01-9fa7-0097c8718d1c tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Flavor limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 12:25:05 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-bf46ed48-31ca-4e01-9fa7-0097c8718d1c tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Image limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 12:25:05 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-bf46ed48-31ca-4e01-9fa7-0097c8718d1c tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Flavor pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 12:25:05 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-bf46ed48-31ca-4e01-9fa7-0097c8718d1c tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Image pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 12:25:05 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-bf46ed48-31ca-4e01-9fa7-0097c8718d1c tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 12:25:05 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-bf46ed48-31ca-4e01-9fa7-0097c8718d1c tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 12:25:05 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-bf46ed48-31ca-4e01-9fa7-0097c8718d1c tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 12:25:05 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-bf46ed48-31ca-4e01-9fa7-0097c8718d1c tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Got 1 possible topologies {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 12:25:05 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-bf46ed48-31ca-4e01-9fa7-0097c8718d1c tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 12:25:05 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-bf46ed48-31ca-4e01-9fa7-0097c8718d1c tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 12:25:05 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-bf46ed48-31ca-4e01-9fa7-0097c8718d1c tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:25:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1850575870',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1850575870',id=20,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dbc95d68d5e147e1953c855169b17091',ramdisk_id='',reservation_id='r-lmzfgdct',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-195954071',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:25:03Z,user_data=None,user_id='c473215929044a108c9fc4d6327dfc3d',uuid=87f15f5f-8afa-4d7b-bb45-5887184f9ee5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4a12f8bf-1920-4e7a-afec-9b716b73ff63", "address": "fa:16:3e:be:f4:7d", "network": {"id": "dec66832-56d5-4d68-b11f-8e8eed38f045", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-79099436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc95d68d5e147e1953c855169b17091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a12f8bf-19", "ovs_interfaceid": "4a12f8bf-1920-4e7a-afec-9b716b73ff63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74960) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 12:25:05 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-bf46ed48-31ca-4e01-9fa7-0097c8718d1c tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Converting VIF {"id": "4a12f8bf-1920-4e7a-afec-9b716b73ff63", "address": "fa:16:3e:be:f4:7d", "network": {"id": "dec66832-56d5-4d68-b11f-8e8eed38f045", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-79099436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc95d68d5e147e1953c855169b17091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a12f8bf-19", "ovs_interfaceid": "4a12f8bf-1920-4e7a-afec-9b716b73ff63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:25:05 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-bf46ed48-31ca-4e01-9fa7-0097c8718d1c tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:f4:7d,bridge_name='br-int',has_traffic_filtering=True,id=4a12f8bf-1920-4e7a-afec-9b716b73ff63,network=Network(dec66832-56d5-4d68-b11f-8e8eed38f045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a12f8bf-19') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:25:05 user nova-compute[74960]: DEBUG nova.objects.instance [None req-bf46ed48-31ca-4e01-9fa7-0097c8718d1c tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Lazy-loading 'pci_devices' on Instance uuid 87f15f5f-8afa-4d7b-bb45-5887184f9ee5 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:25:05 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:05 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-bf46ed48-31ca-4e01-9fa7-0097c8718d1c tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: 87f15f5f-8afa-4d7b-bb45-5887184f9ee5] End _get_guest_xml xml=<domain type="kvm">
Nov 03 12:25:05 user nova-compute[74960]:   <uuid>87f15f5f-8afa-4d7b-bb45-5887184f9ee5</uuid>
Nov 03 12:25:05 user nova-compute[74960]:   <name>instance-00000014</name>
Nov 03 12:25:05 user nova-compute[74960]:   <memory>524288</memory>
Nov 03 12:25:05 user nova-compute[74960]:   <vcpu>1</vcpu>
Nov 03 12:25:05 user nova-compute[74960]:   <metadata>
Nov 03 12:25:05 user nova-compute[74960]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 12:25:05 user nova-compute[74960]:       <nova:package version="0.0.0"/>
Nov 03 12:25:05 user nova-compute[74960]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1850575870</nova:name>
Nov 03 12:25:05 user nova-compute[74960]:       <nova:creationTime>2023-11-03 12:25:05</nova:creationTime>
Nov 03 12:25:05 user nova-compute[74960]:       <nova:flavor name="m1.tiny">
Nov 03 12:25:05 user nova-compute[74960]:         <nova:memory>512</nova:memory>
Nov 03 12:25:05 user nova-compute[74960]:         <nova:disk>1</nova:disk>
Nov 03 12:25:05 user nova-compute[74960]:         <nova:swap>0</nova:swap>
Nov 03 12:25:05 user nova-compute[74960]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 12:25:05 user nova-compute[74960]:         <nova:vcpus>1</nova:vcpus>
Nov 03 12:25:05 user nova-compute[74960]:       </nova:flavor>
Nov 03 12:25:05 user nova-compute[74960]:       <nova:owner>
Nov 03 12:25:05 user nova-compute[74960]:         <nova:user uuid="c473215929044a108c9fc4d6327dfc3d">tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member</nova:user>
Nov 03 12:25:05 user nova-compute[74960]:         <nova:project uuid="dbc95d68d5e147e1953c855169b17091">tempest-ServerBootFromVolumeStableRescueTest-195954071</nova:project>
Nov 03 12:25:05 user nova-compute[74960]:       </nova:owner>
Nov 03 12:25:05 user nova-compute[74960]:       <nova:root type="image" uuid="549f51ba-ac69-494b-8de1-34635aa2d7cf"/>
Nov 03 12:25:05 user nova-compute[74960]:       <nova:ports>
Nov 03 12:25:05 user nova-compute[74960]:         <nova:port uuid="4a12f8bf-1920-4e7a-afec-9b716b73ff63">
Nov 03 12:25:05 user nova-compute[74960]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 03 12:25:05 user nova-compute[74960]:         </nova:port>
Nov 03 12:25:05 user nova-compute[74960]:       </nova:ports>
Nov 03 12:25:05 user nova-compute[74960]:     </nova:instance>
Nov 03 12:25:05 user nova-compute[74960]:   </metadata>
Nov 03 12:25:05 user nova-compute[74960]:   <sysinfo type="smbios">
Nov 03 12:25:05 user nova-compute[74960]:     <system>
Nov 03 12:25:05 user nova-compute[74960]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 12:25:05 user nova-compute[74960]:       <entry name="product">OpenStack Nova</entry>
Nov 03 12:25:05 user nova-compute[74960]:       <entry name="version">0.0.0</entry>
Nov 03 12:25:05 user nova-compute[74960]:       <entry name="serial">87f15f5f-8afa-4d7b-bb45-5887184f9ee5</entry>
Nov 03 12:25:05 user nova-compute[74960]:       <entry name="uuid">87f15f5f-8afa-4d7b-bb45-5887184f9ee5</entry>
Nov 03 12:25:05 user nova-compute[74960]:       <entry name="family">Virtual Machine</entry>
Nov 03 12:25:05 user nova-compute[74960]:     </system>
Nov 03 12:25:05 user nova-compute[74960]:   </sysinfo>
Nov 03 12:25:05 user nova-compute[74960]:   <os>
Nov 03 12:25:05 user nova-compute[74960]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 12:25:05 user nova-compute[74960]:     <boot dev="hd"/>
Nov 03 12:25:05 user nova-compute[74960]:     <smbios mode="sysinfo"/>
Nov 03 12:25:05 user nova-compute[74960]:   </os>
Nov 03 12:25:05 user nova-compute[74960]:   <features>
Nov 03 12:25:05 user nova-compute[74960]:     <acpi/>
Nov 03 12:25:05 user nova-compute[74960]:     <apic/>
Nov 03 12:25:05 user nova-compute[74960]:     <vmcoreinfo/>
Nov 03 12:25:05 user nova-compute[74960]:   </features>
Nov 03 12:25:05 user nova-compute[74960]:   <clock offset="utc">
Nov 03 12:25:05 user nova-compute[74960]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 12:25:05 user nova-compute[74960]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 12:25:05 user nova-compute[74960]:     <timer name="hpet" present="no"/>
Nov 03 12:25:05 user nova-compute[74960]:   </clock>
Nov 03 12:25:05 user nova-compute[74960]:   <cpu mode="custom" match="exact">
Nov 03 12:25:05 user nova-compute[74960]:     <model>Nehalem</model>
Nov 03 12:25:05 user nova-compute[74960]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 12:25:05 user nova-compute[74960]:   </cpu>
Nov 03 12:25:05 user nova-compute[74960]:   <devices>
Nov 03 12:25:05 user nova-compute[74960]:     <disk type="file" device="disk">
Nov 03 12:25:05 user nova-compute[74960]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 12:25:05 user nova-compute[74960]:       <source file="/opt/stack/data/nova/instances/87f15f5f-8afa-4d7b-bb45-5887184f9ee5/disk"/>
Nov 03 12:25:05 user nova-compute[74960]:       <target dev="vda" bus="virtio"/>
Nov 03 12:25:05 user nova-compute[74960]:     </disk>
Nov 03 12:25:05 user nova-compute[74960]:     <interface type="ethernet">
Nov 03 12:25:05 user nova-compute[74960]:       <mac address="fa:16:3e:be:f4:7d"/>
Nov 03 12:25:05 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:25:05 user nova-compute[74960]:       <mtu size="1442"/>
Nov 03 12:25:05 user nova-compute[74960]:       <target dev="tap4a12f8bf-19"/>
Nov 03 12:25:05 user nova-compute[74960]:     </interface>
Nov 03 12:25:05 user nova-compute[74960]:     <serial type="pty">
Nov 03 12:25:05 user nova-compute[74960]:       <log file="/opt/stack/data/nova/instances/87f15f5f-8afa-4d7b-bb45-5887184f9ee5/console.log" append="off"/>
Nov 03 12:25:05 user nova-compute[74960]:     </serial>
Nov 03 12:25:05 user nova-compute[74960]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 12:25:05 user nova-compute[74960]:     <video>
Nov 03 12:25:05 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:25:05 user nova-compute[74960]:     </video>
Nov 03 12:25:05 user nova-compute[74960]:     <rng model="virtio">
Nov 03 12:25:05 user nova-compute[74960]:       <backend model="random">/dev/urandom</backend>
Nov 03 12:25:05 user nova-compute[74960]:     </rng>
Nov 03 12:25:05 user nova-compute[74960]:     <controller type="usb" index="0" model="none"/>
Nov 03 12:25:05 user nova-compute[74960]:     <memballoon model="virtio">
Nov 03 12:25:05 user nova-compute[74960]:       <stats period="10"/>
Nov 03 12:25:05 user nova-compute[74960]:     </memballoon>
Nov 03 12:25:05 user nova-compute[74960]:   </devices>
Nov 03 12:25:05 user nova-compute[74960]: </domain>
Nov 03 12:25:05 user nova-compute[74960]:  {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 12:25:05 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-bf46ed48-31ca-4e01-9fa7-0097c8718d1c tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:25:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1850575870',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1850575870',id=20,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dbc95d68d5e147e1953c855169b17091',ramdisk_id='',reservation_id='r-lmzfgdct',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-195954071',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:25:03Z,user_data=None,user_id='c473215929044a108c9fc4d6327dfc3d',uuid=87f15f5f-8afa-4d7b-bb45-5887184f9ee5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4a12f8bf-1920-4e7a-afec-9b716b73ff63", "address": "fa:16:3e:be:f4:7d", "network": {"id": "dec66832-56d5-4d68-b11f-8e8eed38f045", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-79099436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc95d68d5e147e1953c855169b17091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a12f8bf-19", "ovs_interfaceid": "4a12f8bf-1920-4e7a-afec-9b716b73ff63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 12:25:05 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-bf46ed48-31ca-4e01-9fa7-0097c8718d1c tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Converting VIF {"id": "4a12f8bf-1920-4e7a-afec-9b716b73ff63", "address": "fa:16:3e:be:f4:7d", "network": {"id": "dec66832-56d5-4d68-b11f-8e8eed38f045", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-79099436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc95d68d5e147e1953c855169b17091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a12f8bf-19", "ovs_interfaceid": "4a12f8bf-1920-4e7a-afec-9b716b73ff63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:25:05 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-bf46ed48-31ca-4e01-9fa7-0097c8718d1c tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:f4:7d,bridge_name='br-int',has_traffic_filtering=True,id=4a12f8bf-1920-4e7a-afec-9b716b73ff63,network=Network(dec66832-56d5-4d68-b11f-8e8eed38f045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a12f8bf-19') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:25:05 user nova-compute[74960]: DEBUG os_vif [None req-bf46ed48-31ca-4e01-9fa7-0097c8718d1c tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:f4:7d,bridge_name='br-int',has_traffic_filtering=True,id=4a12f8bf-1920-4e7a-afec-9b716b73ff63,network=Network(dec66832-56d5-4d68-b11f-8e8eed38f045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a12f8bf-19') {{(pid=74960) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 12:25:05 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:05 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:25:05 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 12:25:05 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:05 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7b1177c2-bea2-5bfc-9df4-903e612decf5', '_type': 'linux-noop'}}, row=False) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:25:05 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:05 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:25:05 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:05 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:05 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4a12f8bf-19, may_exist=True, interface_attrs={}) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:25:05 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4a12f8bf-19, col_values=(('qos', UUID('97ed9f45-a8d5-4787-99cc-8d0a275d786a')),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:25:05 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4a12f8bf-19, col_values=(('external_ids', {'iface-id': '4a12f8bf-1920-4e7a-afec-9b716b73ff63', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:be:f4:7d', 'vm-uuid': '87f15f5f-8afa-4d7b-bb45-5887184f9ee5'}),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:25:05 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:05 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:25:05 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:05 user nova-compute[74960]: INFO os_vif [None req-bf46ed48-31ca-4e01-9fa7-0097c8718d1c tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:f4:7d,bridge_name='br-int',has_traffic_filtering=True,id=4a12f8bf-1920-4e7a-afec-9b716b73ff63,network=Network(dec66832-56d5-4d68-b11f-8e8eed38f045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a12f8bf-19')
Nov 03 12:25:05 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-bf46ed48-31ca-4e01-9fa7-0097c8718d1c tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] No BDM found with device name vda, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:25:05 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-bf46ed48-31ca-4e01-9fa7-0097c8718d1c tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] No VIF found with MAC fa:16:3e:be:f4:7d, not building metadata {{(pid=74960) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 12:25:05 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:05 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:05 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:05 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:06 user nova-compute[74960]: DEBUG nova.compute.manager [req-37176435-d584-4794-b6cb-a39bf6ec1724 req-151284bb-88ec-49ff-84e2-b0cf1ef0c7bb service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Received event network-vif-plugged-dae50cff-c0b2-4c50-bd31-0d1bf1a17e55 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:25:06 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-37176435-d584-4794-b6cb-a39bf6ec1724 req-151284bb-88ec-49ff-84e2-b0cf1ef0c7bb service nova] Acquiring lock "db88322f-c2ad-4622-9a1a-c45439d875a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:25:06 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-37176435-d584-4794-b6cb-a39bf6ec1724 req-151284bb-88ec-49ff-84e2-b0cf1ef0c7bb service nova] Lock "db88322f-c2ad-4622-9a1a-c45439d875a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:25:06 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-37176435-d584-4794-b6cb-a39bf6ec1724 req-151284bb-88ec-49ff-84e2-b0cf1ef0c7bb service nova] Lock "db88322f-c2ad-4622-9a1a-c45439d875a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:25:06 user nova-compute[74960]: DEBUG nova.compute.manager [req-37176435-d584-4794-b6cb-a39bf6ec1724 req-151284bb-88ec-49ff-84e2-b0cf1ef0c7bb service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] No waiting events found dispatching network-vif-plugged-dae50cff-c0b2-4c50-bd31-0d1bf1a17e55 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:25:06 user nova-compute[74960]: WARNING nova.compute.manager [req-37176435-d584-4794-b6cb-a39bf6ec1724 req-151284bb-88ec-49ff-84e2-b0cf1ef0c7bb service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Received unexpected event network-vif-plugged-dae50cff-c0b2-4c50-bd31-0d1bf1a17e55 for instance with vm_state building and task_state spawning.
Nov 03 12:25:06 user nova-compute[74960]: DEBUG nova.compute.manager [req-37176435-d584-4794-b6cb-a39bf6ec1724 req-151284bb-88ec-49ff-84e2-b0cf1ef0c7bb service nova] [instance: 87f15f5f-8afa-4d7b-bb45-5887184f9ee5] Received event network-changed-4a12f8bf-1920-4e7a-afec-9b716b73ff63 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:25:06 user nova-compute[74960]: DEBUG nova.compute.manager [req-37176435-d584-4794-b6cb-a39bf6ec1724 req-151284bb-88ec-49ff-84e2-b0cf1ef0c7bb service nova] [instance: 87f15f5f-8afa-4d7b-bb45-5887184f9ee5] Refreshing instance network info cache due to event network-changed-4a12f8bf-1920-4e7a-afec-9b716b73ff63. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 12:25:06 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-37176435-d584-4794-b6cb-a39bf6ec1724 req-151284bb-88ec-49ff-84e2-b0cf1ef0c7bb service nova] Acquiring lock "refresh_cache-87f15f5f-8afa-4d7b-bb45-5887184f9ee5" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:25:06 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-37176435-d584-4794-b6cb-a39bf6ec1724 req-151284bb-88ec-49ff-84e2-b0cf1ef0c7bb service nova] Acquired lock "refresh_cache-87f15f5f-8afa-4d7b-bb45-5887184f9ee5" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:25:06 user nova-compute[74960]: DEBUG nova.network.neutron [req-37176435-d584-4794-b6cb-a39bf6ec1724 req-151284bb-88ec-49ff-84e2-b0cf1ef0c7bb service nova] [instance: 87f15f5f-8afa-4d7b-bb45-5887184f9ee5] Refreshing network info cache for port 4a12f8bf-1920-4e7a-afec-9b716b73ff63 {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 12:25:06 user nova-compute[74960]: DEBUG nova.compute.manager [req-45b5bb8c-1d04-4673-923c-48356ddfadc8 req-2acecdd5-c403-4fc6-811d-1db0aa5d2eef service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Received event network-vif-plugged-9207158b-c88b-44b8-b419-eba87e570339 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:25:06 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-45b5bb8c-1d04-4673-923c-48356ddfadc8 req-2acecdd5-c403-4fc6-811d-1db0aa5d2eef service nova] Acquiring lock "db88322f-c2ad-4622-9a1a-c45439d875a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:25:06 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-45b5bb8c-1d04-4673-923c-48356ddfadc8 req-2acecdd5-c403-4fc6-811d-1db0aa5d2eef service nova] Lock "db88322f-c2ad-4622-9a1a-c45439d875a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:25:06 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-45b5bb8c-1d04-4673-923c-48356ddfadc8 req-2acecdd5-c403-4fc6-811d-1db0aa5d2eef service nova] Lock "db88322f-c2ad-4622-9a1a-c45439d875a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:25:06 user nova-compute[74960]: DEBUG nova.compute.manager [req-45b5bb8c-1d04-4673-923c-48356ddfadc8 req-2acecdd5-c403-4fc6-811d-1db0aa5d2eef service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] No waiting events found dispatching network-vif-plugged-9207158b-c88b-44b8-b419-eba87e570339 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:25:06 user nova-compute[74960]: WARNING nova.compute.manager [req-45b5bb8c-1d04-4673-923c-48356ddfadc8 req-2acecdd5-c403-4fc6-811d-1db0aa5d2eef service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Received unexpected event network-vif-plugged-9207158b-c88b-44b8-b419-eba87e570339 for instance with vm_state building and task_state spawning.
Nov 03 12:25:06 user nova-compute[74960]: DEBUG nova.compute.manager [req-45b5bb8c-1d04-4673-923c-48356ddfadc8 req-2acecdd5-c403-4fc6-811d-1db0aa5d2eef service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Received event network-vif-plugged-012765dc-7d42-41d5-b12b-34f3a2a7ef07 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:25:06 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-45b5bb8c-1d04-4673-923c-48356ddfadc8 req-2acecdd5-c403-4fc6-811d-1db0aa5d2eef service nova] Acquiring lock "db88322f-c2ad-4622-9a1a-c45439d875a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:25:06 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-45b5bb8c-1d04-4673-923c-48356ddfadc8 req-2acecdd5-c403-4fc6-811d-1db0aa5d2eef service nova] Lock "db88322f-c2ad-4622-9a1a-c45439d875a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:25:06 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-45b5bb8c-1d04-4673-923c-48356ddfadc8 req-2acecdd5-c403-4fc6-811d-1db0aa5d2eef service nova] Lock "db88322f-c2ad-4622-9a1a-c45439d875a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:25:06 user nova-compute[74960]: DEBUG nova.compute.manager [req-45b5bb8c-1d04-4673-923c-48356ddfadc8 req-2acecdd5-c403-4fc6-811d-1db0aa5d2eef service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] No waiting events found dispatching network-vif-plugged-012765dc-7d42-41d5-b12b-34f3a2a7ef07 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:25:06 user nova-compute[74960]: WARNING nova.compute.manager [req-45b5bb8c-1d04-4673-923c-48356ddfadc8 req-2acecdd5-c403-4fc6-811d-1db0aa5d2eef service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Received unexpected event network-vif-plugged-012765dc-7d42-41d5-b12b-34f3a2a7ef07 for instance with vm_state building and task_state spawning.
Nov 03 12:25:06 user nova-compute[74960]: DEBUG nova.compute.manager [req-45b5bb8c-1d04-4673-923c-48356ddfadc8 req-2acecdd5-c403-4fc6-811d-1db0aa5d2eef service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Received event network-vif-plugged-012765dc-7d42-41d5-b12b-34f3a2a7ef07 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:25:06 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-45b5bb8c-1d04-4673-923c-48356ddfadc8 req-2acecdd5-c403-4fc6-811d-1db0aa5d2eef service nova] Acquiring lock "db88322f-c2ad-4622-9a1a-c45439d875a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:25:06 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-45b5bb8c-1d04-4673-923c-48356ddfadc8 req-2acecdd5-c403-4fc6-811d-1db0aa5d2eef service nova] Lock "db88322f-c2ad-4622-9a1a-c45439d875a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:25:06 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-45b5bb8c-1d04-4673-923c-48356ddfadc8 req-2acecdd5-c403-4fc6-811d-1db0aa5d2eef service nova] Lock "db88322f-c2ad-4622-9a1a-c45439d875a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:25:06 user nova-compute[74960]: DEBUG nova.compute.manager [req-45b5bb8c-1d04-4673-923c-48356ddfadc8 req-2acecdd5-c403-4fc6-811d-1db0aa5d2eef service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] No waiting events found dispatching network-vif-plugged-012765dc-7d42-41d5-b12b-34f3a2a7ef07 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:25:06 user nova-compute[74960]: WARNING nova.compute.manager [req-45b5bb8c-1d04-4673-923c-48356ddfadc8 req-2acecdd5-c403-4fc6-811d-1db0aa5d2eef service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Received unexpected event network-vif-plugged-012765dc-7d42-41d5-b12b-34f3a2a7ef07 for instance with vm_state building and task_state spawning.
Nov 03 12:25:06 user nova-compute[74960]: DEBUG nova.compute.manager [req-45b5bb8c-1d04-4673-923c-48356ddfadc8 req-2acecdd5-c403-4fc6-811d-1db0aa5d2eef service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Received event network-vif-plugged-20575d86-ea6c-4d0d-8190-70fe728bc7c1 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:25:06 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-45b5bb8c-1d04-4673-923c-48356ddfadc8 req-2acecdd5-c403-4fc6-811d-1db0aa5d2eef service nova] Acquiring lock "db88322f-c2ad-4622-9a1a-c45439d875a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:25:06 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-45b5bb8c-1d04-4673-923c-48356ddfadc8 req-2acecdd5-c403-4fc6-811d-1db0aa5d2eef service nova] Lock "db88322f-c2ad-4622-9a1a-c45439d875a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:25:06 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-45b5bb8c-1d04-4673-923c-48356ddfadc8 req-2acecdd5-c403-4fc6-811d-1db0aa5d2eef service nova] Lock "db88322f-c2ad-4622-9a1a-c45439d875a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:25:06 user nova-compute[74960]: DEBUG nova.compute.manager [req-45b5bb8c-1d04-4673-923c-48356ddfadc8 req-2acecdd5-c403-4fc6-811d-1db0aa5d2eef service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] No waiting events found dispatching network-vif-plugged-20575d86-ea6c-4d0d-8190-70fe728bc7c1 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:25:06 user nova-compute[74960]: WARNING nova.compute.manager [req-45b5bb8c-1d04-4673-923c-48356ddfadc8 req-2acecdd5-c403-4fc6-811d-1db0aa5d2eef service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Received unexpected event network-vif-plugged-20575d86-ea6c-4d0d-8190-70fe728bc7c1 for instance with vm_state building and task_state spawning.
Nov 03 12:25:06 user nova-compute[74960]: DEBUG nova.compute.manager [req-45b5bb8c-1d04-4673-923c-48356ddfadc8 req-2acecdd5-c403-4fc6-811d-1db0aa5d2eef service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Received event network-vif-plugged-20575d86-ea6c-4d0d-8190-70fe728bc7c1 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:25:06 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-45b5bb8c-1d04-4673-923c-48356ddfadc8 req-2acecdd5-c403-4fc6-811d-1db0aa5d2eef service nova] Acquiring lock "db88322f-c2ad-4622-9a1a-c45439d875a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:25:06 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-45b5bb8c-1d04-4673-923c-48356ddfadc8 req-2acecdd5-c403-4fc6-811d-1db0aa5d2eef service nova] Lock "db88322f-c2ad-4622-9a1a-c45439d875a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:25:06 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-45b5bb8c-1d04-4673-923c-48356ddfadc8 req-2acecdd5-c403-4fc6-811d-1db0aa5d2eef service nova] Lock "db88322f-c2ad-4622-9a1a-c45439d875a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:25:06 user nova-compute[74960]: DEBUG nova.compute.manager [req-45b5bb8c-1d04-4673-923c-48356ddfadc8 req-2acecdd5-c403-4fc6-811d-1db0aa5d2eef service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] No waiting events found dispatching network-vif-plugged-20575d86-ea6c-4d0d-8190-70fe728bc7c1 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:25:06 user nova-compute[74960]: WARNING nova.compute.manager [req-45b5bb8c-1d04-4673-923c-48356ddfadc8 req-2acecdd5-c403-4fc6-811d-1db0aa5d2eef service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Received unexpected event network-vif-plugged-20575d86-ea6c-4d0d-8190-70fe728bc7c1 for instance with vm_state building and task_state spawning.
Nov 03 12:25:06 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:06 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:06 user nova-compute[74960]: DEBUG nova.network.neutron [req-37176435-d584-4794-b6cb-a39bf6ec1724 req-151284bb-88ec-49ff-84e2-b0cf1ef0c7bb service nova] [instance: 87f15f5f-8afa-4d7b-bb45-5887184f9ee5] Updated VIF entry in instance network info cache for port 4a12f8bf-1920-4e7a-afec-9b716b73ff63. {{(pid=74960) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 12:25:06 user nova-compute[74960]: DEBUG nova.network.neutron [req-37176435-d584-4794-b6cb-a39bf6ec1724 req-151284bb-88ec-49ff-84e2-b0cf1ef0c7bb service nova] [instance: 87f15f5f-8afa-4d7b-bb45-5887184f9ee5] Updating instance_info_cache with network_info: [{"id": "4a12f8bf-1920-4e7a-afec-9b716b73ff63", "address": "fa:16:3e:be:f4:7d", "network": {"id": "dec66832-56d5-4d68-b11f-8e8eed38f045", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-79099436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc95d68d5e147e1953c855169b17091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a12f8bf-19", "ovs_interfaceid": "4a12f8bf-1920-4e7a-afec-9b716b73ff63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:25:06 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-37176435-d584-4794-b6cb-a39bf6ec1724 req-151284bb-88ec-49ff-84e2-b0cf1ef0c7bb service nova] Releasing lock "refresh_cache-87f15f5f-8afa-4d7b-bb45-5887184f9ee5" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:25:06 user nova-compute[74960]: DEBUG nova.compute.manager [req-37176435-d584-4794-b6cb-a39bf6ec1724 req-151284bb-88ec-49ff-84e2-b0cf1ef0c7bb service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Received event network-vif-plugged-412bab8b-015e-4df4-92c8-2ed71a8ca2f7 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:25:06 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-37176435-d584-4794-b6cb-a39bf6ec1724 req-151284bb-88ec-49ff-84e2-b0cf1ef0c7bb service nova] Acquiring lock "db88322f-c2ad-4622-9a1a-c45439d875a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:25:06 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-37176435-d584-4794-b6cb-a39bf6ec1724 req-151284bb-88ec-49ff-84e2-b0cf1ef0c7bb service nova] Lock "db88322f-c2ad-4622-9a1a-c45439d875a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:25:06 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-37176435-d584-4794-b6cb-a39bf6ec1724 req-151284bb-88ec-49ff-84e2-b0cf1ef0c7bb service nova] Lock "db88322f-c2ad-4622-9a1a-c45439d875a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:25:06 user nova-compute[74960]: DEBUG nova.compute.manager [req-37176435-d584-4794-b6cb-a39bf6ec1724 req-151284bb-88ec-49ff-84e2-b0cf1ef0c7bb service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] No waiting events found dispatching network-vif-plugged-412bab8b-015e-4df4-92c8-2ed71a8ca2f7 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:25:06 user nova-compute[74960]: WARNING nova.compute.manager [req-37176435-d584-4794-b6cb-a39bf6ec1724 req-151284bb-88ec-49ff-84e2-b0cf1ef0c7bb service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Received unexpected event network-vif-plugged-412bab8b-015e-4df4-92c8-2ed71a8ca2f7 for instance with vm_state building and task_state spawning.
Nov 03 12:25:06 user nova-compute[74960]: DEBUG nova.compute.manager [req-37176435-d584-4794-b6cb-a39bf6ec1724 req-151284bb-88ec-49ff-84e2-b0cf1ef0c7bb service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Received event network-vif-plugged-412bab8b-015e-4df4-92c8-2ed71a8ca2f7 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:25:06 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-37176435-d584-4794-b6cb-a39bf6ec1724 req-151284bb-88ec-49ff-84e2-b0cf1ef0c7bb service nova] Acquiring lock "db88322f-c2ad-4622-9a1a-c45439d875a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:25:06 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-37176435-d584-4794-b6cb-a39bf6ec1724 req-151284bb-88ec-49ff-84e2-b0cf1ef0c7bb service nova] Lock "db88322f-c2ad-4622-9a1a-c45439d875a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:25:06 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-37176435-d584-4794-b6cb-a39bf6ec1724 req-151284bb-88ec-49ff-84e2-b0cf1ef0c7bb service nova] Lock "db88322f-c2ad-4622-9a1a-c45439d875a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:25:06 user nova-compute[74960]: DEBUG nova.compute.manager [req-37176435-d584-4794-b6cb-a39bf6ec1724 req-151284bb-88ec-49ff-84e2-b0cf1ef0c7bb service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] No waiting events found dispatching network-vif-plugged-412bab8b-015e-4df4-92c8-2ed71a8ca2f7 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:25:06 user nova-compute[74960]: WARNING nova.compute.manager [req-37176435-d584-4794-b6cb-a39bf6ec1724 req-151284bb-88ec-49ff-84e2-b0cf1ef0c7bb service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Received unexpected event network-vif-plugged-412bab8b-015e-4df4-92c8-2ed71a8ca2f7 for instance with vm_state building and task_state spawning.
Nov 03 12:25:06 user nova-compute[74960]: DEBUG nova.compute.manager [req-608ba480-8595-4763-b539-2b3ed7d2d6e8 req-10dc997f-ba9d-49fb-a1bd-b1209ae2b48c service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Received event network-vif-plugged-72da800d-493b-4dc6-8988-1259e2423188 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:25:06 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-608ba480-8595-4763-b539-2b3ed7d2d6e8 req-10dc997f-ba9d-49fb-a1bd-b1209ae2b48c service nova] Acquiring lock "db88322f-c2ad-4622-9a1a-c45439d875a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:25:06 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-608ba480-8595-4763-b539-2b3ed7d2d6e8 req-10dc997f-ba9d-49fb-a1bd-b1209ae2b48c service nova] Lock "db88322f-c2ad-4622-9a1a-c45439d875a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:25:06 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-608ba480-8595-4763-b539-2b3ed7d2d6e8 req-10dc997f-ba9d-49fb-a1bd-b1209ae2b48c service nova] Lock "db88322f-c2ad-4622-9a1a-c45439d875a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:25:06 user nova-compute[74960]: DEBUG nova.compute.manager [req-608ba480-8595-4763-b539-2b3ed7d2d6e8 req-10dc997f-ba9d-49fb-a1bd-b1209ae2b48c service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] No waiting events found dispatching network-vif-plugged-72da800d-493b-4dc6-8988-1259e2423188 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:25:06 user nova-compute[74960]: WARNING nova.compute.manager [req-608ba480-8595-4763-b539-2b3ed7d2d6e8 req-10dc997f-ba9d-49fb-a1bd-b1209ae2b48c service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Received unexpected event network-vif-plugged-72da800d-493b-4dc6-8988-1259e2423188 for instance with vm_state building and task_state spawning.
Nov 03 12:25:06 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:06 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:07 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:07 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:07 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:07 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:07 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:07 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:07 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:07 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:08 user nova-compute[74960]: DEBUG nova.compute.manager [req-d3454574-f751-488d-a6fe-6feddf70c9d7 req-d04b17ed-f1a2-4434-9582-7ab87330504d service nova] [instance: 87f15f5f-8afa-4d7b-bb45-5887184f9ee5] Received event network-vif-plugged-4a12f8bf-1920-4e7a-afec-9b716b73ff63 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:25:08 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-d3454574-f751-488d-a6fe-6feddf70c9d7 req-d04b17ed-f1a2-4434-9582-7ab87330504d service nova] Acquiring lock "87f15f5f-8afa-4d7b-bb45-5887184f9ee5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:25:08 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-d3454574-f751-488d-a6fe-6feddf70c9d7 req-d04b17ed-f1a2-4434-9582-7ab87330504d service nova] Lock "87f15f5f-8afa-4d7b-bb45-5887184f9ee5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:25:08 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-d3454574-f751-488d-a6fe-6feddf70c9d7 req-d04b17ed-f1a2-4434-9582-7ab87330504d service nova] Lock "87f15f5f-8afa-4d7b-bb45-5887184f9ee5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:25:08 user nova-compute[74960]: DEBUG nova.compute.manager [req-d3454574-f751-488d-a6fe-6feddf70c9d7 req-d04b17ed-f1a2-4434-9582-7ab87330504d service nova] [instance: 87f15f5f-8afa-4d7b-bb45-5887184f9ee5] No waiting events found dispatching network-vif-plugged-4a12f8bf-1920-4e7a-afec-9b716b73ff63 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:25:08 user nova-compute[74960]: WARNING nova.compute.manager [req-d3454574-f751-488d-a6fe-6feddf70c9d7 req-d04b17ed-f1a2-4434-9582-7ab87330504d service nova] [instance: 87f15f5f-8afa-4d7b-bb45-5887184f9ee5] Received unexpected event network-vif-plugged-4a12f8bf-1920-4e7a-afec-9b716b73ff63 for instance with vm_state building and task_state spawning.
Nov 03 12:25:08 user nova-compute[74960]: DEBUG nova.compute.manager [req-d3454574-f751-488d-a6fe-6feddf70c9d7 req-d04b17ed-f1a2-4434-9582-7ab87330504d service nova] [instance: 87f15f5f-8afa-4d7b-bb45-5887184f9ee5] Received event network-vif-plugged-4a12f8bf-1920-4e7a-afec-9b716b73ff63 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:25:08 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-d3454574-f751-488d-a6fe-6feddf70c9d7 req-d04b17ed-f1a2-4434-9582-7ab87330504d service nova] Acquiring lock "87f15f5f-8afa-4d7b-bb45-5887184f9ee5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:25:08 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-d3454574-f751-488d-a6fe-6feddf70c9d7 req-d04b17ed-f1a2-4434-9582-7ab87330504d service nova] Lock "87f15f5f-8afa-4d7b-bb45-5887184f9ee5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:25:08 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-d3454574-f751-488d-a6fe-6feddf70c9d7 req-d04b17ed-f1a2-4434-9582-7ab87330504d service nova] Lock "87f15f5f-8afa-4d7b-bb45-5887184f9ee5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:25:08 user nova-compute[74960]: DEBUG nova.compute.manager [req-d3454574-f751-488d-a6fe-6feddf70c9d7 req-d04b17ed-f1a2-4434-9582-7ab87330504d service nova] [instance: 87f15f5f-8afa-4d7b-bb45-5887184f9ee5] No waiting events found dispatching network-vif-plugged-4a12f8bf-1920-4e7a-afec-9b716b73ff63 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:25:08 user nova-compute[74960]: WARNING nova.compute.manager [req-d3454574-f751-488d-a6fe-6feddf70c9d7 req-d04b17ed-f1a2-4434-9582-7ab87330504d service nova] [instance: 87f15f5f-8afa-4d7b-bb45-5887184f9ee5] Received unexpected event network-vif-plugged-4a12f8bf-1920-4e7a-afec-9b716b73ff63 for instance with vm_state building and task_state spawning.
Nov 03 12:25:08 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:08 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:08 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:08 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:08 user nova-compute[74960]: DEBUG nova.compute.manager [req-b62d9360-9e25-4c5a-ba9b-80688f0a7e97 req-40a8fd77-0690-46e2-85c2-f62de6962524 service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Received event network-vif-plugged-72da800d-493b-4dc6-8988-1259e2423188 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:25:08 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-b62d9360-9e25-4c5a-ba9b-80688f0a7e97 req-40a8fd77-0690-46e2-85c2-f62de6962524 service nova] Acquiring lock "db88322f-c2ad-4622-9a1a-c45439d875a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:25:08 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-b62d9360-9e25-4c5a-ba9b-80688f0a7e97 req-40a8fd77-0690-46e2-85c2-f62de6962524 service nova] Lock "db88322f-c2ad-4622-9a1a-c45439d875a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:25:08 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-b62d9360-9e25-4c5a-ba9b-80688f0a7e97 req-40a8fd77-0690-46e2-85c2-f62de6962524 service nova] Lock "db88322f-c2ad-4622-9a1a-c45439d875a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:25:08 user nova-compute[74960]: DEBUG nova.compute.manager [req-b62d9360-9e25-4c5a-ba9b-80688f0a7e97 req-40a8fd77-0690-46e2-85c2-f62de6962524 service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] No waiting events found dispatching network-vif-plugged-72da800d-493b-4dc6-8988-1259e2423188 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:25:08 user nova-compute[74960]: WARNING nova.compute.manager [req-b62d9360-9e25-4c5a-ba9b-80688f0a7e97 req-40a8fd77-0690-46e2-85c2-f62de6962524 service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Received unexpected event network-vif-plugged-72da800d-493b-4dc6-8988-1259e2423188 for instance with vm_state building and task_state spawning.
Nov 03 12:25:08 user nova-compute[74960]: DEBUG nova.compute.manager [req-b62d9360-9e25-4c5a-ba9b-80688f0a7e97 req-40a8fd77-0690-46e2-85c2-f62de6962524 service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Received event network-vif-plugged-b905e727-4d81-4518-8cae-06f4e64bcccc {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:25:08 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-b62d9360-9e25-4c5a-ba9b-80688f0a7e97 req-40a8fd77-0690-46e2-85c2-f62de6962524 service nova] Acquiring lock "db88322f-c2ad-4622-9a1a-c45439d875a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:25:08 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-b62d9360-9e25-4c5a-ba9b-80688f0a7e97 req-40a8fd77-0690-46e2-85c2-f62de6962524 service nova] Lock "db88322f-c2ad-4622-9a1a-c45439d875a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:25:08 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-b62d9360-9e25-4c5a-ba9b-80688f0a7e97 req-40a8fd77-0690-46e2-85c2-f62de6962524 service nova] Lock "db88322f-c2ad-4622-9a1a-c45439d875a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:25:08 user nova-compute[74960]: DEBUG nova.compute.manager [req-b62d9360-9e25-4c5a-ba9b-80688f0a7e97 req-40a8fd77-0690-46e2-85c2-f62de6962524 service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] No waiting events found dispatching network-vif-plugged-b905e727-4d81-4518-8cae-06f4e64bcccc {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:25:08 user nova-compute[74960]: WARNING nova.compute.manager [req-b62d9360-9e25-4c5a-ba9b-80688f0a7e97 req-40a8fd77-0690-46e2-85c2-f62de6962524 service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Received unexpected event network-vif-plugged-b905e727-4d81-4518-8cae-06f4e64bcccc for instance with vm_state building and task_state spawning.
Nov 03 12:25:08 user nova-compute[74960]: DEBUG nova.compute.manager [req-b62d9360-9e25-4c5a-ba9b-80688f0a7e97 req-40a8fd77-0690-46e2-85c2-f62de6962524 service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Received event network-vif-plugged-b905e727-4d81-4518-8cae-06f4e64bcccc {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:25:08 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-b62d9360-9e25-4c5a-ba9b-80688f0a7e97 req-40a8fd77-0690-46e2-85c2-f62de6962524 service nova] Acquiring lock "db88322f-c2ad-4622-9a1a-c45439d875a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:25:08 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-b62d9360-9e25-4c5a-ba9b-80688f0a7e97 req-40a8fd77-0690-46e2-85c2-f62de6962524 service nova] Lock "db88322f-c2ad-4622-9a1a-c45439d875a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:25:08 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-b62d9360-9e25-4c5a-ba9b-80688f0a7e97 req-40a8fd77-0690-46e2-85c2-f62de6962524 service nova] Lock "db88322f-c2ad-4622-9a1a-c45439d875a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:25:08 user nova-compute[74960]: DEBUG nova.compute.manager [req-b62d9360-9e25-4c5a-ba9b-80688f0a7e97 req-40a8fd77-0690-46e2-85c2-f62de6962524 service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] No waiting events found dispatching network-vif-plugged-b905e727-4d81-4518-8cae-06f4e64bcccc {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:25:08 user nova-compute[74960]: WARNING nova.compute.manager [req-b62d9360-9e25-4c5a-ba9b-80688f0a7e97 req-40a8fd77-0690-46e2-85c2-f62de6962524 service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Received unexpected event network-vif-plugged-b905e727-4d81-4518-8cae-06f4e64bcccc for instance with vm_state building and task_state spawning.
Nov 03 12:25:09 user nova-compute[74960]: DEBUG nova.compute.manager [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Instance event wait completed in 0 seconds for  {{(pid=74960) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 12:25:09 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Guest created on hypervisor {{(pid=74960) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 12:25:09 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Instance spawned successfully.
Nov 03 12:25:09 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 12:25:09 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Found default for hw_cdrom_bus of ide {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:25:09 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Found default for hw_disk_bus of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:25:09 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Found default for hw_input_bus of None {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:25:09 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Found default for hw_pointer_model of None {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:25:09 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Found default for hw_video_model of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:25:09 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Found default for hw_vif_model of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:25:09 user nova-compute[74960]: INFO nova.compute.manager [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Took 12.88 seconds to spawn the instance on the hypervisor.
Nov 03 12:25:09 user nova-compute[74960]: DEBUG nova.compute.manager [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Checking state {{(pid=74960) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 12:25:09 user nova-compute[74960]: INFO nova.compute.manager [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Took 85.14 seconds to build instance.
Nov 03 12:25:09 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-43477683-0ee7-4a5c-99a5-69941d20e0fd tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Lock "db88322f-c2ad-4622-9a1a-c45439d875a8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 85.263s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:25:09 user nova-compute[74960]: DEBUG nova.compute.manager [None req-bf46ed48-31ca-4e01-9fa7-0097c8718d1c tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: 87f15f5f-8afa-4d7b-bb45-5887184f9ee5] Instance event wait completed in 0 seconds for  {{(pid=74960) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 12:25:09 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-bf46ed48-31ca-4e01-9fa7-0097c8718d1c tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: 87f15f5f-8afa-4d7b-bb45-5887184f9ee5] Guest created on hypervisor {{(pid=74960) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 12:25:09 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: 87f15f5f-8afa-4d7b-bb45-5887184f9ee5] Instance spawned successfully.
Nov 03 12:25:09 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-bf46ed48-31ca-4e01-9fa7-0097c8718d1c tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: 87f15f5f-8afa-4d7b-bb45-5887184f9ee5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 12:25:09 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-bf46ed48-31ca-4e01-9fa7-0097c8718d1c tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: 87f15f5f-8afa-4d7b-bb45-5887184f9ee5] Found default for hw_cdrom_bus of ide {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:25:09 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-bf46ed48-31ca-4e01-9fa7-0097c8718d1c tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: 87f15f5f-8afa-4d7b-bb45-5887184f9ee5] Found default for hw_disk_bus of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:25:09 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-bf46ed48-31ca-4e01-9fa7-0097c8718d1c tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: 87f15f5f-8afa-4d7b-bb45-5887184f9ee5] Found default for hw_input_bus of None {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:25:09 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-bf46ed48-31ca-4e01-9fa7-0097c8718d1c tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: 87f15f5f-8afa-4d7b-bb45-5887184f9ee5] Found default for hw_pointer_model of None {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:25:09 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-bf46ed48-31ca-4e01-9fa7-0097c8718d1c tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: 87f15f5f-8afa-4d7b-bb45-5887184f9ee5] Found default for hw_video_model of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:25:09 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-bf46ed48-31ca-4e01-9fa7-0097c8718d1c tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: 87f15f5f-8afa-4d7b-bb45-5887184f9ee5] Found default for hw_vif_model of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:25:09 user nova-compute[74960]: INFO nova.compute.manager [None req-bf46ed48-31ca-4e01-9fa7-0097c8718d1c tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: 87f15f5f-8afa-4d7b-bb45-5887184f9ee5] Took 6.94 seconds to spawn the instance on the hypervisor.
Nov 03 12:25:09 user nova-compute[74960]: DEBUG nova.compute.manager [None req-bf46ed48-31ca-4e01-9fa7-0097c8718d1c tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: 87f15f5f-8afa-4d7b-bb45-5887184f9ee5] Checking state {{(pid=74960) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 12:25:09 user nova-compute[74960]: INFO nova.compute.manager [None req-bf46ed48-31ca-4e01-9fa7-0097c8718d1c tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: 87f15f5f-8afa-4d7b-bb45-5887184f9ee5] Took 7.77 seconds to build instance.
Nov 03 12:25:09 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-bf46ed48-31ca-4e01-9fa7-0097c8718d1c tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Lock "87f15f5f-8afa-4d7b-bb45-5887184f9ee5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.880s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:25:10 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:12 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:15 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:17 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:17 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:20 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:20 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:21 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:21 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-3b992dce-cbf8-4bf1-94d0-4d64426ea3df tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Acquiring lock "05956d9b-0646-43d2-a4cd-19e9090020ee" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:25:21 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-3b992dce-cbf8-4bf1-94d0-4d64426ea3df tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Lock "05956d9b-0646-43d2-a4cd-19e9090020ee" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:25:21 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-3b992dce-cbf8-4bf1-94d0-4d64426ea3df tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Acquiring lock "05956d9b-0646-43d2-a4cd-19e9090020ee-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:25:21 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-3b992dce-cbf8-4bf1-94d0-4d64426ea3df tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Lock "05956d9b-0646-43d2-a4cd-19e9090020ee-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:25:21 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-3b992dce-cbf8-4bf1-94d0-4d64426ea3df tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Lock "05956d9b-0646-43d2-a4cd-19e9090020ee-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:25:21 user nova-compute[74960]: INFO nova.compute.manager [None req-3b992dce-cbf8-4bf1-94d0-4d64426ea3df tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] Terminating instance
Nov 03 12:25:21 user nova-compute[74960]: DEBUG nova.compute.manager [None req-3b992dce-cbf8-4bf1-94d0-4d64426ea3df tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] Start destroying the instance on the hypervisor. {{(pid=74960) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 12:25:21 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:21 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:21 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:21 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:21 user nova-compute[74960]: DEBUG nova.compute.manager [req-a2941b96-7a7e-4939-8aa6-667ab8921f50 req-1d737694-d2fb-4199-be01-5441a4a26f55 service nova] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] Received event network-vif-unplugged-4d0cd9f3-3345-43ce-b449-8a46402e6cbd {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:25:21 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-a2941b96-7a7e-4939-8aa6-667ab8921f50 req-1d737694-d2fb-4199-be01-5441a4a26f55 service nova] Acquiring lock "05956d9b-0646-43d2-a4cd-19e9090020ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:25:21 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-a2941b96-7a7e-4939-8aa6-667ab8921f50 req-1d737694-d2fb-4199-be01-5441a4a26f55 service nova] Lock "05956d9b-0646-43d2-a4cd-19e9090020ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:25:21 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-a2941b96-7a7e-4939-8aa6-667ab8921f50 req-1d737694-d2fb-4199-be01-5441a4a26f55 service nova] Lock "05956d9b-0646-43d2-a4cd-19e9090020ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:25:21 user nova-compute[74960]: DEBUG nova.compute.manager [req-a2941b96-7a7e-4939-8aa6-667ab8921f50 req-1d737694-d2fb-4199-be01-5441a4a26f55 service nova] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] No waiting events found dispatching network-vif-unplugged-4d0cd9f3-3345-43ce-b449-8a46402e6cbd {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:25:21 user nova-compute[74960]: DEBUG nova.compute.manager [req-a2941b96-7a7e-4939-8aa6-667ab8921f50 req-1d737694-d2fb-4199-be01-5441a4a26f55 service nova] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] Received event network-vif-unplugged-4d0cd9f3-3345-43ce-b449-8a46402e6cbd for instance with task_state deleting. {{(pid=74960) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 12:25:22 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] Instance destroyed successfully.
Nov 03 12:25:22 user nova-compute[74960]: DEBUG nova.objects.instance [None req-3b992dce-cbf8-4bf1-94d0-4d64426ea3df tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Lazy-loading 'resources' on Instance uuid 05956d9b-0646-43d2-a4cd-19e9090020ee {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:25:22 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-3b992dce-cbf8-4bf1-94d0-4d64426ea3df tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:18:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2026890033',display_name='tempest-TestMinimumBasicScenario-server-2026890033',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2026890033',id=10,image_ref='22e1e9fb-500f-48a2-9f93-47a950579b41',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEmmaNRsYvlITo2mBRrQk4Ph36BrmDVaNziIg/uzay0OjgI7mZIcYRdg4M+NpnkQoh0QuRzo+cbfBEGhGGbEQaBkR5RXU9uN2kRmYlLXm8XiWRT2sIof/dwVYJht5VILJQ==',key_name='tempest-TestMinimumBasicScenario-307288959',keypairs=<?>,launch_index=0,launched_at=2023-11-03T12:18:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9d4a374c1c544718887bd75b77a72a3a',ramdisk_id='',reservation_id='r-4pweyes6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='22e1e9fb-500f-48a2-9f93-47a950579b41',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-585836766',owner_user_name='tempest-TestMinimumBasicScenario-585836766-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T12:22:32Z,user_data=None,user_id='1c9880db5b784aadaeba7492523df5e8',uuid=05956d9b-0646-43d2-a4cd-19e9090020ee,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4d0cd9f3-3345-43ce-b449-8a46402e6cbd", "address": "fa:16:3e:28:71:ee", "network": {"id": "b3813163-d09b-4c0b-a328-1bbb4c7e2875", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1681555035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d4a374c1c544718887bd75b77a72a3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d0cd9f3-33", "ovs_interfaceid": "4d0cd9f3-3345-43ce-b449-8a46402e6cbd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 12:25:22 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-3b992dce-cbf8-4bf1-94d0-4d64426ea3df tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Converting VIF {"id": "4d0cd9f3-3345-43ce-b449-8a46402e6cbd", "address": "fa:16:3e:28:71:ee", "network": {"id": "b3813163-d09b-4c0b-a328-1bbb4c7e2875", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1681555035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d4a374c1c544718887bd75b77a72a3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d0cd9f3-33", "ovs_interfaceid": "4d0cd9f3-3345-43ce-b449-8a46402e6cbd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:25:22 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-3b992dce-cbf8-4bf1-94d0-4d64426ea3df tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:28:71:ee,bridge_name='br-int',has_traffic_filtering=True,id=4d0cd9f3-3345-43ce-b449-8a46402e6cbd,network=Network(b3813163-d09b-4c0b-a328-1bbb4c7e2875),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d0cd9f3-33') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:25:22 user nova-compute[74960]: DEBUG os_vif [None req-3b992dce-cbf8-4bf1-94d0-4d64426ea3df tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:71:ee,bridge_name='br-int',has_traffic_filtering=True,id=4d0cd9f3-3345-43ce-b449-8a46402e6cbd,network=Network(b3813163-d09b-4c0b-a328-1bbb4c7e2875),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d0cd9f3-33') {{(pid=74960) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 12:25:22 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:22 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4d0cd9f3-33, bridge=br-int, if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:25:22 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:25:22 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:22 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fceee3d3-a0df-40a0-ba18-e8cbe7b37838) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:25:22 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:22 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:25:22 user nova-compute[74960]: INFO os_vif [None req-3b992dce-cbf8-4bf1-94d0-4d64426ea3df tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:71:ee,bridge_name='br-int',has_traffic_filtering=True,id=4d0cd9f3-3345-43ce-b449-8a46402e6cbd,network=Network(b3813163-d09b-4c0b-a328-1bbb4c7e2875),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d0cd9f3-33')
Nov 03 12:25:22 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-3b992dce-cbf8-4bf1-94d0-4d64426ea3df tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] Deleting instance files /opt/stack/data/nova/instances/05956d9b-0646-43d2-a4cd-19e9090020ee_del
Nov 03 12:25:22 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-3b992dce-cbf8-4bf1-94d0-4d64426ea3df tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] Deletion of /opt/stack/data/nova/instances/05956d9b-0646-43d2-a4cd-19e9090020ee_del complete
Nov 03 12:25:22 user nova-compute[74960]: INFO nova.compute.manager [None req-3b992dce-cbf8-4bf1-94d0-4d64426ea3df tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] Took 1.02 seconds to destroy the instance on the hypervisor.
Nov 03 12:25:22 user nova-compute[74960]: DEBUG oslo.service.loopingcall [None req-3b992dce-cbf8-4bf1-94d0-4d64426ea3df tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74960) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 12:25:22 user nova-compute[74960]: DEBUG nova.compute.manager [-] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] Deallocating network for instance {{(pid=74960) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 12:25:22 user nova-compute[74960]: DEBUG nova.network.neutron [-] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] deallocate_for_instance() {{(pid=74960) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 12:25:22 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:23 user nova-compute[74960]: DEBUG nova.network.neutron [-] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] Updating instance_info_cache with network_info: [] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:25:23 user nova-compute[74960]: DEBUG nova.compute.manager [req-4d52f14b-eb8b-489c-84f1-5868c78b4576 req-2d743c37-4609-4506-ab48-33acf4fb1fed service nova] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] Received event network-vif-deleted-4d0cd9f3-3345-43ce-b449-8a46402e6cbd {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:25:23 user nova-compute[74960]: INFO nova.compute.manager [req-4d52f14b-eb8b-489c-84f1-5868c78b4576 req-2d743c37-4609-4506-ab48-33acf4fb1fed service nova] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] Neutron deleted interface 4d0cd9f3-3345-43ce-b449-8a46402e6cbd; detaching it from the instance and deleting it from the info cache
Nov 03 12:25:23 user nova-compute[74960]: DEBUG nova.network.neutron [req-4d52f14b-eb8b-489c-84f1-5868c78b4576 req-2d743c37-4609-4506-ab48-33acf4fb1fed service nova] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] Updating instance_info_cache with network_info: [] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:25:23 user nova-compute[74960]: INFO nova.compute.manager [-] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] Took 0.89 seconds to deallocate network for instance.
Nov 03 12:25:23 user nova-compute[74960]: DEBUG nova.compute.manager [req-4d52f14b-eb8b-489c-84f1-5868c78b4576 req-2d743c37-4609-4506-ab48-33acf4fb1fed service nova] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] Detach interface failed, port_id=4d0cd9f3-3345-43ce-b449-8a46402e6cbd, reason: Instance 05956d9b-0646-43d2-a4cd-19e9090020ee could not be found. {{(pid=74960) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 03 12:25:23 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-3b992dce-cbf8-4bf1-94d0-4d64426ea3df tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:25:23 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-3b992dce-cbf8-4bf1-94d0-4d64426ea3df tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:25:23 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-3b992dce-cbf8-4bf1-94d0-4d64426ea3df tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:25:23 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-3b992dce-cbf8-4bf1-94d0-4d64426ea3df tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:25:23 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-3b992dce-cbf8-4bf1-94d0-4d64426ea3df tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.363s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:25:23 user nova-compute[74960]: INFO nova.scheduler.client.report [None req-3b992dce-cbf8-4bf1-94d0-4d64426ea3df tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Deleted allocations for instance 05956d9b-0646-43d2-a4cd-19e9090020ee
Nov 03 12:25:23 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-3b992dce-cbf8-4bf1-94d0-4d64426ea3df tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Lock "05956d9b-0646-43d2-a4cd-19e9090020ee" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.516s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:25:23 user nova-compute[74960]: DEBUG nova.compute.manager [req-59c04b34-3091-4022-97ea-880943526979 req-a2b89916-4c27-4d69-ab39-301ff2e73433 service nova] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] Received event network-vif-plugged-4d0cd9f3-3345-43ce-b449-8a46402e6cbd {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:25:23 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-59c04b34-3091-4022-97ea-880943526979 req-a2b89916-4c27-4d69-ab39-301ff2e73433 service nova] Acquiring lock "05956d9b-0646-43d2-a4cd-19e9090020ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:25:23 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-59c04b34-3091-4022-97ea-880943526979 req-a2b89916-4c27-4d69-ab39-301ff2e73433 service nova] Lock "05956d9b-0646-43d2-a4cd-19e9090020ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:25:23 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-59c04b34-3091-4022-97ea-880943526979 req-a2b89916-4c27-4d69-ab39-301ff2e73433 service nova] Lock "05956d9b-0646-43d2-a4cd-19e9090020ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:25:23 user nova-compute[74960]: DEBUG nova.compute.manager [req-59c04b34-3091-4022-97ea-880943526979 req-a2b89916-4c27-4d69-ab39-301ff2e73433 service nova] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] No waiting events found dispatching network-vif-plugged-4d0cd9f3-3345-43ce-b449-8a46402e6cbd {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:25:23 user nova-compute[74960]: WARNING nova.compute.manager [req-59c04b34-3091-4022-97ea-880943526979 req-a2b89916-4c27-4d69-ab39-301ff2e73433 service nova] [instance: 05956d9b-0646-43d2-a4cd-19e9090020ee] Received unexpected event network-vif-plugged-4d0cd9f3-3345-43ce-b449-8a46402e6cbd for instance with vm_state deleted and task_state None.
Nov 03 12:25:24 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:27 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:27 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:29 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:31 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:32 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:32 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:35 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c40fb9c5-64af-46b4-897d-cfe117b01416 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Acquiring lock "7a33549f-51ea-42d0-8c8a-67d9c74784fd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:25:35 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c40fb9c5-64af-46b4-897d-cfe117b01416 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Lock "7a33549f-51ea-42d0-8c8a-67d9c74784fd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:25:35 user nova-compute[74960]: DEBUG nova.compute.manager [None req-c40fb9c5-64af-46b4-897d-cfe117b01416 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] [instance: 7a33549f-51ea-42d0-8c8a-67d9c74784fd] Starting instance... {{(pid=74960) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 12:25:35 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c40fb9c5-64af-46b4-897d-cfe117b01416 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:25:35 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c40fb9c5-64af-46b4-897d-cfe117b01416 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:25:36 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-c40fb9c5-64af-46b4-897d-cfe117b01416 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74960) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 12:25:36 user nova-compute[74960]: INFO nova.compute.claims [None req-c40fb9c5-64af-46b4-897d-cfe117b01416 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] [instance: 7a33549f-51ea-42d0-8c8a-67d9c74784fd] Claim successful on node user
Nov 03 12:25:36 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-c40fb9c5-64af-46b4-897d-cfe117b01416 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:25:36 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-c40fb9c5-64af-46b4-897d-cfe117b01416 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:25:36 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c40fb9c5-64af-46b4-897d-cfe117b01416 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.641s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:25:36 user nova-compute[74960]: DEBUG nova.compute.manager [None req-c40fb9c5-64af-46b4-897d-cfe117b01416 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] [instance: 7a33549f-51ea-42d0-8c8a-67d9c74784fd] Start building networks asynchronously for instance. {{(pid=74960) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 12:25:36 user nova-compute[74960]: DEBUG nova.compute.manager [None req-c40fb9c5-64af-46b4-897d-cfe117b01416 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] [instance: 7a33549f-51ea-42d0-8c8a-67d9c74784fd] Allocating IP information in the background. {{(pid=74960) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 12:25:36 user nova-compute[74960]: DEBUG nova.network.neutron [None req-c40fb9c5-64af-46b4-897d-cfe117b01416 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] [instance: 7a33549f-51ea-42d0-8c8a-67d9c74784fd] allocate_for_instance() {{(pid=74960) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 12:25:36 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-c40fb9c5-64af-46b4-897d-cfe117b01416 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] [instance: 7a33549f-51ea-42d0-8c8a-67d9c74784fd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 12:25:36 user nova-compute[74960]: DEBUG nova.compute.manager [None req-c40fb9c5-64af-46b4-897d-cfe117b01416 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] [instance: 7a33549f-51ea-42d0-8c8a-67d9c74784fd] Start building block device mappings for instance. {{(pid=74960) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 12:25:36 user nova-compute[74960]: DEBUG nova.policy [None req-c40fb9c5-64af-46b4-897d-cfe117b01416 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '15d7b1f66fd542abbadfcb9ccb888a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef726fdd031e432489ebe9a7b0ddc97f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74960) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 12:25:36 user nova-compute[74960]: DEBUG nova.compute.manager [None req-c40fb9c5-64af-46b4-897d-cfe117b01416 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] [instance: 7a33549f-51ea-42d0-8c8a-67d9c74784fd] Start spawning the instance on the hypervisor. {{(pid=74960) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 12:25:36 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-c40fb9c5-64af-46b4-897d-cfe117b01416 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] [instance: 7a33549f-51ea-42d0-8c8a-67d9c74784fd] Creating instance directory {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 12:25:36 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-c40fb9c5-64af-46b4-897d-cfe117b01416 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] [instance: 7a33549f-51ea-42d0-8c8a-67d9c74784fd] Creating image(s)
Nov 03 12:25:36 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c40fb9c5-64af-46b4-897d-cfe117b01416 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Acquiring lock "/opt/stack/data/nova/instances/7a33549f-51ea-42d0-8c8a-67d9c74784fd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:25:36 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c40fb9c5-64af-46b4-897d-cfe117b01416 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Lock "/opt/stack/data/nova/instances/7a33549f-51ea-42d0-8c8a-67d9c74784fd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:25:36 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c40fb9c5-64af-46b4-897d-cfe117b01416 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Lock "/opt/stack/data/nova/instances/7a33549f-51ea-42d0-8c8a-67d9c74784fd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:25:36 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-c40fb9c5-64af-46b4-897d-cfe117b01416 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:25:37 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:37 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-c40fb9c5-64af-46b4-897d-cfe117b01416 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.203s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:25:37 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c40fb9c5-64af-46b4-897d-cfe117b01416 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Acquiring lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:25:37 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c40fb9c5-64af-46b4-897d-cfe117b01416 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:25:37 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-c40fb9c5-64af-46b4-897d-cfe117b01416 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:25:37 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-c40fb9c5-64af-46b4-897d-cfe117b01416 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.218s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:25:37 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-c40fb9c5-64af-46b4-897d-cfe117b01416 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910,backing_fmt=raw /opt/stack/data/nova/instances/7a33549f-51ea-42d0-8c8a-67d9c74784fd/disk 1073741824 {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:25:37 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-c40fb9c5-64af-46b4-897d-cfe117b01416 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910,backing_fmt=raw /opt/stack/data/nova/instances/7a33549f-51ea-42d0-8c8a-67d9c74784fd/disk 1073741824" returned: 0 in 0.052s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:25:37 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c40fb9c5-64af-46b4-897d-cfe117b01416 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.279s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:25:37 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-c40fb9c5-64af-46b4-897d-cfe117b01416 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:25:37 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-c40fb9c5-64af-46b4-897d-cfe117b01416 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.221s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:25:37 user nova-compute[74960]: DEBUG nova.virt.disk.api [None req-c40fb9c5-64af-46b4-897d-cfe117b01416 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7a33549f-51ea-42d0-8c8a-67d9c74784fd/disk. size=1073741824 {{(pid=74960) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 12:25:37 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-c40fb9c5-64af-46b4-897d-cfe117b01416 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a33549f-51ea-42d0-8c8a-67d9c74784fd/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:25:37 user nova-compute[74960]: DEBUG nova.network.neutron [None req-c40fb9c5-64af-46b4-897d-cfe117b01416 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] [instance: 7a33549f-51ea-42d0-8c8a-67d9c74784fd] Successfully created port: 158f13f7-d1d8-49aa-94e1-86d34a25f75e {{(pid=74960) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 12:25:37 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:37 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-c40fb9c5-64af-46b4-897d-cfe117b01416 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a33549f-51ea-42d0-8c8a-67d9c74784fd/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:25:37 user nova-compute[74960]: DEBUG nova.virt.disk.api [None req-c40fb9c5-64af-46b4-897d-cfe117b01416 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Cannot resize image /opt/stack/data/nova/instances/7a33549f-51ea-42d0-8c8a-67d9c74784fd/disk to a smaller size. {{(pid=74960) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 12:25:37 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-c40fb9c5-64af-46b4-897d-cfe117b01416 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] [instance: 7a33549f-51ea-42d0-8c8a-67d9c74784fd] Created local disks {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 12:25:37 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-c40fb9c5-64af-46b4-897d-cfe117b01416 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] [instance: 7a33549f-51ea-42d0-8c8a-67d9c74784fd] Ensure instance console log exists: /opt/stack/data/nova/instances/7a33549f-51ea-42d0-8c8a-67d9c74784fd/console.log {{(pid=74960) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 12:25:37 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c40fb9c5-64af-46b4-897d-cfe117b01416 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:25:37 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c40fb9c5-64af-46b4-897d-cfe117b01416 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:25:37 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c40fb9c5-64af-46b4-897d-cfe117b01416 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:25:38 user nova-compute[74960]: DEBUG nova.network.neutron [None req-c40fb9c5-64af-46b4-897d-cfe117b01416 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] [instance: 7a33549f-51ea-42d0-8c8a-67d9c74784fd] Successfully updated port: 158f13f7-d1d8-49aa-94e1-86d34a25f75e {{(pid=74960) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 12:25:38 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c40fb9c5-64af-46b4-897d-cfe117b01416 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Acquiring lock "refresh_cache-7a33549f-51ea-42d0-8c8a-67d9c74784fd" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:25:38 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c40fb9c5-64af-46b4-897d-cfe117b01416 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Acquired lock "refresh_cache-7a33549f-51ea-42d0-8c8a-67d9c74784fd" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:25:38 user nova-compute[74960]: DEBUG nova.network.neutron [None req-c40fb9c5-64af-46b4-897d-cfe117b01416 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] [instance: 7a33549f-51ea-42d0-8c8a-67d9c74784fd] Building network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 12:25:38 user nova-compute[74960]: DEBUG nova.compute.manager [req-d9782e05-8e3f-4410-901f-b740047dbe3f req-59604eb7-7dad-4307-883b-935fadfa664f service nova] [instance: 7a33549f-51ea-42d0-8c8a-67d9c74784fd] Received event network-changed-158f13f7-d1d8-49aa-94e1-86d34a25f75e {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:25:38 user nova-compute[74960]: DEBUG nova.compute.manager [req-d9782e05-8e3f-4410-901f-b740047dbe3f req-59604eb7-7dad-4307-883b-935fadfa664f service nova] [instance: 7a33549f-51ea-42d0-8c8a-67d9c74784fd] Refreshing instance network info cache due to event network-changed-158f13f7-d1d8-49aa-94e1-86d34a25f75e. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 12:25:38 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-d9782e05-8e3f-4410-901f-b740047dbe3f req-59604eb7-7dad-4307-883b-935fadfa664f service nova] Acquiring lock "refresh_cache-7a33549f-51ea-42d0-8c8a-67d9c74784fd" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:25:38 user nova-compute[74960]: DEBUG nova.network.neutron [None req-c40fb9c5-64af-46b4-897d-cfe117b01416 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] [instance: 7a33549f-51ea-42d0-8c8a-67d9c74784fd] Instance cache missing network info. {{(pid=74960) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 12:25:38 user nova-compute[74960]: DEBUG nova.network.neutron [None req-c40fb9c5-64af-46b4-897d-cfe117b01416 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] [instance: 7a33549f-51ea-42d0-8c8a-67d9c74784fd] Updating instance_info_cache with network_info: [{"id": "158f13f7-d1d8-49aa-94e1-86d34a25f75e", "address": "fa:16:3e:1d:94:c7", "network": {"id": "d311275c-1112-433a-a2ae-7d0e452d825b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1949997511-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef726fdd031e432489ebe9a7b0ddc97f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap158f13f7-d1", "ovs_interfaceid": "158f13f7-d1d8-49aa-94e1-86d34a25f75e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:25:38 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c40fb9c5-64af-46b4-897d-cfe117b01416 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Releasing lock "refresh_cache-7a33549f-51ea-42d0-8c8a-67d9c74784fd" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:25:38 user nova-compute[74960]: DEBUG nova.compute.manager [None req-c40fb9c5-64af-46b4-897d-cfe117b01416 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] [instance: 7a33549f-51ea-42d0-8c8a-67d9c74784fd] Instance network_info: |[{"id": "158f13f7-d1d8-49aa-94e1-86d34a25f75e", "address": "fa:16:3e:1d:94:c7", "network": {"id": "d311275c-1112-433a-a2ae-7d0e452d825b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1949997511-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef726fdd031e432489ebe9a7b0ddc97f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap158f13f7-d1", "ovs_interfaceid": "158f13f7-d1d8-49aa-94e1-86d34a25f75e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74960) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 12:25:38 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-d9782e05-8e3f-4410-901f-b740047dbe3f req-59604eb7-7dad-4307-883b-935fadfa664f service nova] Acquired lock "refresh_cache-7a33549f-51ea-42d0-8c8a-67d9c74784fd" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:25:38 user nova-compute[74960]: DEBUG nova.network.neutron [req-d9782e05-8e3f-4410-901f-b740047dbe3f req-59604eb7-7dad-4307-883b-935fadfa664f service nova] [instance: 7a33549f-51ea-42d0-8c8a-67d9c74784fd] Refreshing network info cache for port 158f13f7-d1d8-49aa-94e1-86d34a25f75e {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 12:25:38 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-c40fb9c5-64af-46b4-897d-cfe117b01416 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] [instance: 7a33549f-51ea-42d0-8c8a-67d9c74784fd] Start _get_guest_xml network_info=[{"id": "158f13f7-d1d8-49aa-94e1-86d34a25f75e", "address": "fa:16:3e:1d:94:c7", "network": {"id": "d311275c-1112-433a-a2ae-7d0e452d825b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1949997511-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef726fdd031e432489ebe9a7b0ddc97f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap158f13f7-d1", "ovs_interfaceid": "158f13f7-d1d8-49aa-94e1-86d34a25f75e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=549f51ba-ac69-494b-8de1-34635aa2d7cf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='63ee9c80c632442fb0379f47b784bd20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T12:13:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'image_id': '549f51ba-ac69-494b-8de1-34635aa2d7cf'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 12:25:38 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-c40fb9c5-64af-46b4-897d-cfe117b01416 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:25:38 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-c40fb9c5-64af-46b4-897d-cfe117b01416 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:25:38 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-c40fb9c5-64af-46b4-897d-cfe117b01416 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 12:25:38 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-c40fb9c5-64af-46b4-897d-cfe117b01416 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] CPU controller missing on host. {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 12:25:38 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-c40fb9c5-64af-46b4-897d-cfe117b01416 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 12:25:38 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-c40fb9c5-64af-46b4-897d-cfe117b01416 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] CPU controller found on host. {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 12:25:38 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-c40fb9c5-64af-46b4-897d-cfe117b01416 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74960) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 12:25:38 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-c40fb9c5-64af-46b4-897d-cfe117b01416 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=549f51ba-ac69-494b-8de1-34635aa2d7cf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='63ee9c80c632442fb0379f47b784bd20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T12:13:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 12:25:38 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-c40fb9c5-64af-46b4-897d-cfe117b01416 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Flavor limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 12:25:38 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-c40fb9c5-64af-46b4-897d-cfe117b01416 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Image limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 12:25:38 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-c40fb9c5-64af-46b4-897d-cfe117b01416 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Flavor pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 12:25:38 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-c40fb9c5-64af-46b4-897d-cfe117b01416 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Image pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 12:25:38 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-c40fb9c5-64af-46b4-897d-cfe117b01416 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 12:25:38 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-c40fb9c5-64af-46b4-897d-cfe117b01416 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 12:25:38 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-c40fb9c5-64af-46b4-897d-cfe117b01416 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 12:25:38 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-c40fb9c5-64af-46b4-897d-cfe117b01416 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Got 1 possible topologies {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 12:25:38 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-c40fb9c5-64af-46b4-897d-cfe117b01416 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 12:25:38 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-c40fb9c5-64af-46b4-897d-cfe117b01416 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 12:25:38 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-c40fb9c5-64af-46b4-897d-cfe117b01416 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:25:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-944804881',display_name='tempest-TestServerVolumeAttachmentScenario-server-944804881',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-944804881',id=21,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP9hTP9Rn5S3uup79Imaa70Le/FY0pvmyj+fPRkzHKeBrHQvbFUbePNk6boUMNbSHGFM4JP22LalfBLwcgreE38zI4RAzwqFTyB1g7kqP9kilVEk/fAA27qCcIAWsxCjyQ==',key_name='tempest-keypair-1217467644',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ef726fdd031e432489ebe9a7b0ddc97f',ramdisk_id='',reservation_id='r-ro4vbnru',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1974523773',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1974523773-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:25:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='15d7b1f66fd542abbadfcb9ccb888a5a',uuid=7a33549f-51ea-42d0-8c8a-67d9c74784fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "158f13f7-d1d8-49aa-94e1-86d34a25f75e", "address": "fa:16:3e:1d:94:c7", "network": {"id": "d311275c-1112-433a-a2ae-7d0e452d825b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1949997511-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef726fdd031e432489ebe9a7b0ddc97f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap158f13f7-d1", "ovs_interfaceid": "158f13f7-d1d8-49aa-94e1-86d34a25f75e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74960) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 12:25:38 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-c40fb9c5-64af-46b4-897d-cfe117b01416 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Converting VIF {"id": "158f13f7-d1d8-49aa-94e1-86d34a25f75e", "address": "fa:16:3e:1d:94:c7", "network": {"id": "d311275c-1112-433a-a2ae-7d0e452d825b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1949997511-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef726fdd031e432489ebe9a7b0ddc97f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap158f13f7-d1", "ovs_interfaceid": "158f13f7-d1d8-49aa-94e1-86d34a25f75e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:25:38 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-c40fb9c5-64af-46b4-897d-cfe117b01416 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:94:c7,bridge_name='br-int',has_traffic_filtering=True,id=158f13f7-d1d8-49aa-94e1-86d34a25f75e,network=Network(d311275c-1112-433a-a2ae-7d0e452d825b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap158f13f7-d1') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:25:38 user nova-compute[74960]: DEBUG nova.objects.instance [None req-c40fb9c5-64af-46b4-897d-cfe117b01416 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Lazy-loading 'pci_devices' on Instance uuid 7a33549f-51ea-42d0-8c8a-67d9c74784fd {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:25:38 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-c40fb9c5-64af-46b4-897d-cfe117b01416 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] [instance: 7a33549f-51ea-42d0-8c8a-67d9c74784fd] End _get_guest_xml xml=<domain type="kvm">
Nov 03 12:25:38 user nova-compute[74960]:   <uuid>7a33549f-51ea-42d0-8c8a-67d9c74784fd</uuid>
Nov 03 12:25:38 user nova-compute[74960]:   <name>instance-00000015</name>
Nov 03 12:25:38 user nova-compute[74960]:   <memory>524288</memory>
Nov 03 12:25:38 user nova-compute[74960]:   <vcpu>1</vcpu>
Nov 03 12:25:38 user nova-compute[74960]:   <metadata>
Nov 03 12:25:38 user nova-compute[74960]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 12:25:38 user nova-compute[74960]:       <nova:package version="0.0.0"/>
Nov 03 12:25:38 user nova-compute[74960]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-944804881</nova:name>
Nov 03 12:25:38 user nova-compute[74960]:       <nova:creationTime>2023-11-03 12:25:38</nova:creationTime>
Nov 03 12:25:38 user nova-compute[74960]:       <nova:flavor name="m1.tiny">
Nov 03 12:25:38 user nova-compute[74960]:         <nova:memory>512</nova:memory>
Nov 03 12:25:38 user nova-compute[74960]:         <nova:disk>1</nova:disk>
Nov 03 12:25:38 user nova-compute[74960]:         <nova:swap>0</nova:swap>
Nov 03 12:25:38 user nova-compute[74960]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 12:25:38 user nova-compute[74960]:         <nova:vcpus>1</nova:vcpus>
Nov 03 12:25:38 user nova-compute[74960]:       </nova:flavor>
Nov 03 12:25:38 user nova-compute[74960]:       <nova:owner>
Nov 03 12:25:38 user nova-compute[74960]:         <nova:user uuid="15d7b1f66fd542abbadfcb9ccb888a5a">tempest-TestServerVolumeAttachmentScenario-1974523773-project-member</nova:user>
Nov 03 12:25:38 user nova-compute[74960]:         <nova:project uuid="ef726fdd031e432489ebe9a7b0ddc97f">tempest-TestServerVolumeAttachmentScenario-1974523773</nova:project>
Nov 03 12:25:38 user nova-compute[74960]:       </nova:owner>
Nov 03 12:25:38 user nova-compute[74960]:       <nova:root type="image" uuid="549f51ba-ac69-494b-8de1-34635aa2d7cf"/>
Nov 03 12:25:38 user nova-compute[74960]:       <nova:ports>
Nov 03 12:25:38 user nova-compute[74960]:         <nova:port uuid="158f13f7-d1d8-49aa-94e1-86d34a25f75e">
Nov 03 12:25:38 user nova-compute[74960]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 03 12:25:38 user nova-compute[74960]:         </nova:port>
Nov 03 12:25:38 user nova-compute[74960]:       </nova:ports>
Nov 03 12:25:38 user nova-compute[74960]:     </nova:instance>
Nov 03 12:25:38 user nova-compute[74960]:   </metadata>
Nov 03 12:25:38 user nova-compute[74960]:   <sysinfo type="smbios">
Nov 03 12:25:38 user nova-compute[74960]:     <system>
Nov 03 12:25:38 user nova-compute[74960]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 12:25:38 user nova-compute[74960]:       <entry name="product">OpenStack Nova</entry>
Nov 03 12:25:38 user nova-compute[74960]:       <entry name="version">0.0.0</entry>
Nov 03 12:25:38 user nova-compute[74960]:       <entry name="serial">7a33549f-51ea-42d0-8c8a-67d9c74784fd</entry>
Nov 03 12:25:38 user nova-compute[74960]:       <entry name="uuid">7a33549f-51ea-42d0-8c8a-67d9c74784fd</entry>
Nov 03 12:25:38 user nova-compute[74960]:       <entry name="family">Virtual Machine</entry>
Nov 03 12:25:38 user nova-compute[74960]:     </system>
Nov 03 12:25:38 user nova-compute[74960]:   </sysinfo>
Nov 03 12:25:38 user nova-compute[74960]:   <os>
Nov 03 12:25:38 user nova-compute[74960]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 12:25:38 user nova-compute[74960]:     <boot dev="hd"/>
Nov 03 12:25:38 user nova-compute[74960]:     <smbios mode="sysinfo"/>
Nov 03 12:25:38 user nova-compute[74960]:   </os>
Nov 03 12:25:38 user nova-compute[74960]:   <features>
Nov 03 12:25:38 user nova-compute[74960]:     <acpi/>
Nov 03 12:25:38 user nova-compute[74960]:     <apic/>
Nov 03 12:25:38 user nova-compute[74960]:     <vmcoreinfo/>
Nov 03 12:25:38 user nova-compute[74960]:   </features>
Nov 03 12:25:38 user nova-compute[74960]:   <clock offset="utc">
Nov 03 12:25:38 user nova-compute[74960]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 12:25:38 user nova-compute[74960]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 12:25:38 user nova-compute[74960]:     <timer name="hpet" present="no"/>
Nov 03 12:25:38 user nova-compute[74960]:   </clock>
Nov 03 12:25:38 user nova-compute[74960]:   <cpu mode="custom" match="exact">
Nov 03 12:25:38 user nova-compute[74960]:     <model>Nehalem</model>
Nov 03 12:25:38 user nova-compute[74960]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 12:25:38 user nova-compute[74960]:   </cpu>
Nov 03 12:25:38 user nova-compute[74960]:   <devices>
Nov 03 12:25:38 user nova-compute[74960]:     <disk type="file" device="disk">
Nov 03 12:25:38 user nova-compute[74960]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 12:25:38 user nova-compute[74960]:       <source file="/opt/stack/data/nova/instances/7a33549f-51ea-42d0-8c8a-67d9c74784fd/disk"/>
Nov 03 12:25:38 user nova-compute[74960]:       <target dev="vda" bus="virtio"/>
Nov 03 12:25:38 user nova-compute[74960]:     </disk>
Nov 03 12:25:38 user nova-compute[74960]:     <interface type="ethernet">
Nov 03 12:25:38 user nova-compute[74960]:       <mac address="fa:16:3e:1d:94:c7"/>
Nov 03 12:25:38 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:25:38 user nova-compute[74960]:       <mtu size="1442"/>
Nov 03 12:25:38 user nova-compute[74960]:       <target dev="tap158f13f7-d1"/>
Nov 03 12:25:38 user nova-compute[74960]:     </interface>
Nov 03 12:25:38 user nova-compute[74960]:     <serial type="pty">
Nov 03 12:25:38 user nova-compute[74960]:       <log file="/opt/stack/data/nova/instances/7a33549f-51ea-42d0-8c8a-67d9c74784fd/console.log" append="off"/>
Nov 03 12:25:38 user nova-compute[74960]:     </serial>
Nov 03 12:25:38 user nova-compute[74960]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 12:25:38 user nova-compute[74960]:     <video>
Nov 03 12:25:38 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:25:38 user nova-compute[74960]:     </video>
Nov 03 12:25:38 user nova-compute[74960]:     <rng model="virtio">
Nov 03 12:25:38 user nova-compute[74960]:       <backend model="random">/dev/urandom</backend>
Nov 03 12:25:38 user nova-compute[74960]:     </rng>
Nov 03 12:25:38 user nova-compute[74960]:     <controller type="usb" index="0" model="none"/>
Nov 03 12:25:38 user nova-compute[74960]:     <memballoon model="virtio">
Nov 03 12:25:38 user nova-compute[74960]:       <stats period="10"/>
Nov 03 12:25:38 user nova-compute[74960]:     </memballoon>
Nov 03 12:25:38 user nova-compute[74960]:   </devices>
Nov 03 12:25:38 user nova-compute[74960]: </domain>
Nov 03 12:25:38 user nova-compute[74960]:  {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 12:25:38 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-c40fb9c5-64af-46b4-897d-cfe117b01416 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:25:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-944804881',display_name='tempest-TestServerVolumeAttachmentScenario-server-944804881',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-944804881',id=21,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP9hTP9Rn5S3uup79Imaa70Le/FY0pvmyj+fPRkzHKeBrHQvbFUbePNk6boUMNbSHGFM4JP22LalfBLwcgreE38zI4RAzwqFTyB1g7kqP9kilVEk/fAA27qCcIAWsxCjyQ==',key_name='tempest-keypair-1217467644',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ef726fdd031e432489ebe9a7b0ddc97f',ramdisk_id='',reservation_id='r-ro4vbnru',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1974523773',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1974523773-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:25:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='15d7b1f66fd542abbadfcb9ccb888a5a',uuid=7a33549f-51ea-42d0-8c8a-67d9c74784fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "158f13f7-d1d8-49aa-94e1-86d34a25f75e", "address": "fa:16:3e:1d:94:c7", "network": {"id": "d311275c-1112-433a-a2ae-7d0e452d825b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1949997511-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef726fdd031e432489ebe9a7b0ddc97f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap158f13f7-d1", "ovs_interfaceid": "158f13f7-d1d8-49aa-94e1-86d34a25f75e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 12:25:38 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-c40fb9c5-64af-46b4-897d-cfe117b01416 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Converting VIF {"id": "158f13f7-d1d8-49aa-94e1-86d34a25f75e", "address": "fa:16:3e:1d:94:c7", "network": {"id": "d311275c-1112-433a-a2ae-7d0e452d825b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1949997511-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef726fdd031e432489ebe9a7b0ddc97f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap158f13f7-d1", "ovs_interfaceid": "158f13f7-d1d8-49aa-94e1-86d34a25f75e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:25:38 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-c40fb9c5-64af-46b4-897d-cfe117b01416 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:94:c7,bridge_name='br-int',has_traffic_filtering=True,id=158f13f7-d1d8-49aa-94e1-86d34a25f75e,network=Network(d311275c-1112-433a-a2ae-7d0e452d825b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap158f13f7-d1') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:25:38 user nova-compute[74960]: DEBUG os_vif [None req-c40fb9c5-64af-46b4-897d-cfe117b01416 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:94:c7,bridge_name='br-int',has_traffic_filtering=True,id=158f13f7-d1d8-49aa-94e1-86d34a25f75e,network=Network(d311275c-1112-433a-a2ae-7d0e452d825b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap158f13f7-d1') {{(pid=74960) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 12:25:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:25:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 12:25:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '81d29738-0c62-59d3-aa13-a3b5f0f6e5e1', '_type': 'linux-noop'}}, row=False) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:25:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:25:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap158f13f7-d1, may_exist=True, interface_attrs={}) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:25:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap158f13f7-d1, col_values=(('qos', UUID('a955c54f-06a9-4850-866a-2a66468290f9')),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:25:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap158f13f7-d1, col_values=(('external_ids', {'iface-id': '158f13f7-d1d8-49aa-94e1-86d34a25f75e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1d:94:c7', 'vm-uuid': '7a33549f-51ea-42d0-8c8a-67d9c74784fd'}),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:25:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:25:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:38 user nova-compute[74960]: INFO os_vif [None req-c40fb9c5-64af-46b4-897d-cfe117b01416 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:94:c7,bridge_name='br-int',has_traffic_filtering=True,id=158f13f7-d1d8-49aa-94e1-86d34a25f75e,network=Network(d311275c-1112-433a-a2ae-7d0e452d825b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap158f13f7-d1')
Nov 03 12:25:39 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-c40fb9c5-64af-46b4-897d-cfe117b01416 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] No BDM found with device name vda, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:25:39 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-c40fb9c5-64af-46b4-897d-cfe117b01416 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] No VIF found with MAC fa:16:3e:1d:94:c7, not building metadata {{(pid=74960) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 12:25:39 user nova-compute[74960]: DEBUG nova.network.neutron [req-d9782e05-8e3f-4410-901f-b740047dbe3f req-59604eb7-7dad-4307-883b-935fadfa664f service nova] [instance: 7a33549f-51ea-42d0-8c8a-67d9c74784fd] Updated VIF entry in instance network info cache for port 158f13f7-d1d8-49aa-94e1-86d34a25f75e. {{(pid=74960) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 12:25:39 user nova-compute[74960]: DEBUG nova.network.neutron [req-d9782e05-8e3f-4410-901f-b740047dbe3f req-59604eb7-7dad-4307-883b-935fadfa664f service nova] [instance: 7a33549f-51ea-42d0-8c8a-67d9c74784fd] Updating instance_info_cache with network_info: [{"id": "158f13f7-d1d8-49aa-94e1-86d34a25f75e", "address": "fa:16:3e:1d:94:c7", "network": {"id": "d311275c-1112-433a-a2ae-7d0e452d825b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1949997511-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef726fdd031e432489ebe9a7b0ddc97f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap158f13f7-d1", "ovs_interfaceid": "158f13f7-d1d8-49aa-94e1-86d34a25f75e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:25:39 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-d9782e05-8e3f-4410-901f-b740047dbe3f req-59604eb7-7dad-4307-883b-935fadfa664f service nova] Releasing lock "refresh_cache-7a33549f-51ea-42d0-8c8a-67d9c74784fd" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:25:39 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-2dae5e82-0227-4bfa-95fe-0a03a2f6101c tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Acquiring lock "f009a400-0576-48a9-82e0-60de8935c498" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:25:39 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-2dae5e82-0227-4bfa-95fe-0a03a2f6101c tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Lock "f009a400-0576-48a9-82e0-60de8935c498" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:25:39 user nova-compute[74960]: DEBUG nova.objects.instance [None req-2dae5e82-0227-4bfa-95fe-0a03a2f6101c tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Lazy-loading 'flavor' on Instance uuid f009a400-0576-48a9-82e0-60de8935c498 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:25:39 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-2dae5e82-0227-4bfa-95fe-0a03a2f6101c tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Lock "f009a400-0576-48a9-82e0-60de8935c498" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:25:40 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-2dae5e82-0227-4bfa-95fe-0a03a2f6101c tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Acquiring lock "f009a400-0576-48a9-82e0-60de8935c498" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:25:40 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-2dae5e82-0227-4bfa-95fe-0a03a2f6101c tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Lock "f009a400-0576-48a9-82e0-60de8935c498" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:25:40 user nova-compute[74960]: INFO nova.compute.manager [None req-2dae5e82-0227-4bfa-95fe-0a03a2f6101c tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] [instance: f009a400-0576-48a9-82e0-60de8935c498] Attaching volume 9101c521-a24b-4b03-b2b1-d73585222815 to /dev/vdb
Nov 03 12:25:40 user nova-compute[74960]: DEBUG os_brick.utils [None req-2dae5e82-0227-4bfa-95fe-0a03a2f6101c tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:25:40 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:25:40 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:25:40 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6fa1cc7-204c-4a44-bb73-3945f03c7938]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:75b8e219756\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:25:40 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:25:40 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:25:40 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[1335db69-871e-46d2-a66d-d0911de87231]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:25:40 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:25:40 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:25:40 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[4518b0ce-18f0-4730-8cc6-21583bab72b6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:25:40 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[e78b469e-0191-404e-afb8-71d716a173f0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:25:40 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-2dae5e82-0227-4bfa-95fe-0a03a2f6101c tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Running cmd (subprocess): nvme version {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:25:40 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-2dae5e82-0227-4bfa-95fe-0a03a2f6101c tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] 'nvme version' failed. Not Retrying. {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 12:25:40 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:25:40 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2dae5e82-0227-4bfa-95fe-0a03a2f6101c tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] nvme not present on system {{(pid=74960) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 12:25:40 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:25:40 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 12:25:40 user nova-compute[74960]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 12:25:40 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[f43c6574-6aec-4116-9ce1-69c3b43c7926]: (4, '') {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:25:40 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-2dae5e82-0227-4bfa-95fe-0a03a2f6101c tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74960) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 12:25:40 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-2dae5e82-0227-4bfa-95fe-0a03a2f6101c tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74960) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 12:25:40 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-2dae5e82-0227-4bfa-95fe-0a03a2f6101c tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] LIGHTOS: no hostnqn found. {{(pid=74960) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 12:25:40 user nova-compute[74960]: DEBUG os_brick.utils [None req-2dae5e82-0227-4bfa-95fe-0a03a2f6101c tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:75b8e219756', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:25:40 user nova-compute[74960]: DEBUG nova.virt.block_device [None req-2dae5e82-0227-4bfa-95fe-0a03a2f6101c tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] [instance: f009a400-0576-48a9-82e0-60de8935c498] Updating existing volume attachment record: 06526461-dd7d-4f5d-918d-7884accfb994 {{(pid=74960) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 12:25:40 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:40 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:40 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:40 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:40 user nova-compute[74960]: DEBUG nova.compute.manager [req-029e7331-1713-453f-8238-5cbf3aa336f7 req-707a92b6-d68f-446b-b2aa-145b83e95973 service nova] [instance: 7a33549f-51ea-42d0-8c8a-67d9c74784fd] Received event network-vif-plugged-158f13f7-d1d8-49aa-94e1-86d34a25f75e {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:25:40 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-029e7331-1713-453f-8238-5cbf3aa336f7 req-707a92b6-d68f-446b-b2aa-145b83e95973 service nova] Acquiring lock "7a33549f-51ea-42d0-8c8a-67d9c74784fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:25:40 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-029e7331-1713-453f-8238-5cbf3aa336f7 req-707a92b6-d68f-446b-b2aa-145b83e95973 service nova] Lock "7a33549f-51ea-42d0-8c8a-67d9c74784fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:25:40 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-029e7331-1713-453f-8238-5cbf3aa336f7 req-707a92b6-d68f-446b-b2aa-145b83e95973 service nova] Lock "7a33549f-51ea-42d0-8c8a-67d9c74784fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:25:40 user nova-compute[74960]: DEBUG nova.compute.manager [req-029e7331-1713-453f-8238-5cbf3aa336f7 req-707a92b6-d68f-446b-b2aa-145b83e95973 service nova] [instance: 7a33549f-51ea-42d0-8c8a-67d9c74784fd] No waiting events found dispatching network-vif-plugged-158f13f7-d1d8-49aa-94e1-86d34a25f75e {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:25:40 user nova-compute[74960]: WARNING nova.compute.manager [req-029e7331-1713-453f-8238-5cbf3aa336f7 req-707a92b6-d68f-446b-b2aa-145b83e95973 service nova] [instance: 7a33549f-51ea-42d0-8c8a-67d9c74784fd] Received unexpected event network-vif-plugged-158f13f7-d1d8-49aa-94e1-86d34a25f75e for instance with vm_state building and task_state spawning.
Nov 03 12:25:41 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:41 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:41 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:41 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:41 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:25:42 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:25:42 user nova-compute[74960]: DEBUG nova.compute.manager [req-61c7be72-267f-4d4b-95bd-29ec3bbd65f1 req-42e5242c-9db4-41c9-ad36-a478d21fc6b2 service nova] [instance: 7a33549f-51ea-42d0-8c8a-67d9c74784fd] Received event network-vif-plugged-158f13f7-d1d8-49aa-94e1-86d34a25f75e {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:25:42 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-61c7be72-267f-4d4b-95bd-29ec3bbd65f1 req-42e5242c-9db4-41c9-ad36-a478d21fc6b2 service nova] Acquiring lock "7a33549f-51ea-42d0-8c8a-67d9c74784fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:25:42 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-61c7be72-267f-4d4b-95bd-29ec3bbd65f1 req-42e5242c-9db4-41c9-ad36-a478d21fc6b2 service nova] Lock "7a33549f-51ea-42d0-8c8a-67d9c74784fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:25:42 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-61c7be72-267f-4d4b-95bd-29ec3bbd65f1 req-42e5242c-9db4-41c9-ad36-a478d21fc6b2 service nova] Lock "7a33549f-51ea-42d0-8c8a-67d9c74784fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:25:42 user nova-compute[74960]: DEBUG nova.compute.manager [req-61c7be72-267f-4d4b-95bd-29ec3bbd65f1 req-42e5242c-9db4-41c9-ad36-a478d21fc6b2 service nova] [instance: 7a33549f-51ea-42d0-8c8a-67d9c74784fd] No waiting events found dispatching network-vif-plugged-158f13f7-d1d8-49aa-94e1-86d34a25f75e {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:25:42 user nova-compute[74960]: WARNING nova.compute.manager [req-61c7be72-267f-4d4b-95bd-29ec3bbd65f1 req-42e5242c-9db4-41c9-ad36-a478d21fc6b2 service nova] [instance: 7a33549f-51ea-42d0-8c8a-67d9c74784fd] Received unexpected event network-vif-plugged-158f13f7-d1d8-49aa-94e1-86d34a25f75e for instance with vm_state building and task_state spawning.
Nov 03 12:25:42 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:42 user nova-compute[74960]: DEBUG nova.compute.manager [None req-c40fb9c5-64af-46b4-897d-cfe117b01416 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] [instance: 7a33549f-51ea-42d0-8c8a-67d9c74784fd] Instance event wait completed in 0 seconds for  {{(pid=74960) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 12:25:42 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-c40fb9c5-64af-46b4-897d-cfe117b01416 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] [instance: 7a33549f-51ea-42d0-8c8a-67d9c74784fd] Guest created on hypervisor {{(pid=74960) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 12:25:42 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: 7a33549f-51ea-42d0-8c8a-67d9c74784fd] Instance spawned successfully.
Nov 03 12:25:42 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-c40fb9c5-64af-46b4-897d-cfe117b01416 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] [instance: 7a33549f-51ea-42d0-8c8a-67d9c74784fd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 12:25:42 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-c40fb9c5-64af-46b4-897d-cfe117b01416 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] [instance: 7a33549f-51ea-42d0-8c8a-67d9c74784fd] Found default for hw_cdrom_bus of ide {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:25:42 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-c40fb9c5-64af-46b4-897d-cfe117b01416 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] [instance: 7a33549f-51ea-42d0-8c8a-67d9c74784fd] Found default for hw_disk_bus of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:25:42 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-c40fb9c5-64af-46b4-897d-cfe117b01416 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] [instance: 7a33549f-51ea-42d0-8c8a-67d9c74784fd] Found default for hw_input_bus of None {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:25:42 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-c40fb9c5-64af-46b4-897d-cfe117b01416 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] [instance: 7a33549f-51ea-42d0-8c8a-67d9c74784fd] Found default for hw_pointer_model of None {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:25:42 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-c40fb9c5-64af-46b4-897d-cfe117b01416 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] [instance: 7a33549f-51ea-42d0-8c8a-67d9c74784fd] Found default for hw_video_model of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:25:42 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-c40fb9c5-64af-46b4-897d-cfe117b01416 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] [instance: 7a33549f-51ea-42d0-8c8a-67d9c74784fd] Found default for hw_vif_model of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:25:43 user nova-compute[74960]: INFO nova.compute.manager [None req-c40fb9c5-64af-46b4-897d-cfe117b01416 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] [instance: 7a33549f-51ea-42d0-8c8a-67d9c74784fd] Took 6.09 seconds to spawn the instance on the hypervisor.
Nov 03 12:25:43 user nova-compute[74960]: DEBUG nova.compute.manager [None req-c40fb9c5-64af-46b4-897d-cfe117b01416 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] [instance: 7a33549f-51ea-42d0-8c8a-67d9c74784fd] Checking state {{(pid=74960) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 12:25:43 user nova-compute[74960]: INFO nova.compute.manager [None req-c40fb9c5-64af-46b4-897d-cfe117b01416 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] [instance: 7a33549f-51ea-42d0-8c8a-67d9c74784fd] Took 7.21 seconds to build instance.
Nov 03 12:25:43 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c40fb9c5-64af-46b4-897d-cfe117b01416 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Lock "7a33549f-51ea-42d0-8c8a-67d9c74784fd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.391s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:25:43 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:44 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:25:47 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:25:47 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Starting heal instance info cache {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 12:25:47 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "refresh_cache-fffd1dd7-b8e8-435c-bdfe-6c5001b21daf" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:25:47 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquired lock "refresh_cache-fffd1dd7-b8e8-435c-bdfe-6c5001b21daf" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:25:47 user nova-compute[74960]: DEBUG nova.network.neutron [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: fffd1dd7-b8e8-435c-bdfe-6c5001b21daf] Forcefully refreshing network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 12:25:47 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:48 user nova-compute[74960]: DEBUG nova.network.neutron [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: fffd1dd7-b8e8-435c-bdfe-6c5001b21daf] Updating instance_info_cache with network_info: [{"id": "51edd11b-19e3-40e1-a3a8-56485553eebb", "address": "fa:16:3e:f5:df:89", "network": {"id": "3a8a59cd-8076-41af-b566-9fc45a07a1df", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1235385625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e379e295cf984ca6bf5d84a60e56382d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51edd11b-19", "ovs_interfaceid": "51edd11b-19e3-40e1-a3a8-56485553eebb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:25:48 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Releasing lock "refresh_cache-fffd1dd7-b8e8-435c-bdfe-6c5001b21daf" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:25:48 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: fffd1dd7-b8e8-435c-bdfe-6c5001b21daf] Updated the network info_cache for instance {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 12:25:48 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:25:48 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:25:48 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:25:48 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:25:48 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Auditing locally available compute resources for user (node: user) {{(pid=74960) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 12:25:48 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9951fab7-4984-408e-94ca-11eab615ff25/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:25:48 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9951fab7-4984-408e-94ca-11eab615ff25/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:25:48 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9951fab7-4984-408e-94ca-11eab615ff25/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:25:48 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9951fab7-4984-408e-94ca-11eab615ff25/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:25:48 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:48 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7769e3c5-136f-4282-8e3e-224e3a80922c/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:25:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7769e3c5-136f-4282-8e3e-224e3a80922c/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:25:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7769e3c5-136f-4282-8e3e-224e3a80922c/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:25:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7769e3c5-136f-4282-8e3e-224e3a80922c/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:25:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fffd1dd7-b8e8-435c-bdfe-6c5001b21daf/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:25:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fffd1dd7-b8e8-435c-bdfe-6c5001b21daf/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:25:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fffd1dd7-b8e8-435c-bdfe-6c5001b21daf/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:25:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fffd1dd7-b8e8-435c-bdfe-6c5001b21daf/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:25:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f15f5f-8afa-4d7b-bb45-5887184f9ee5/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:25:50 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f15f5f-8afa-4d7b-bb45-5887184f9ee5/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:25:50 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f15f5f-8afa-4d7b-bb45-5887184f9ee5/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:25:50 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f15f5f-8afa-4d7b-bb45-5887184f9ee5/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:25:50 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6145a30b-809c-4bc5-a45f-c3ff3b170a22/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:25:50 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6145a30b-809c-4bc5-a45f-c3ff3b170a22/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:25:50 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6145a30b-809c-4bc5-a45f-c3ff3b170a22/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:25:50 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6145a30b-809c-4bc5-a45f-c3ff3b170a22/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:25:50 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74960) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 12:25:50 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f009a400-0576-48a9-82e0-60de8935c498/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:25:50 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f009a400-0576-48a9-82e0-60de8935c498/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:25:50 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f009a400-0576-48a9-82e0-60de8935c498/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:25:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f009a400-0576-48a9-82e0-60de8935c498/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:25:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6cbb630-254f-4c56-9cf9-47d751c703be/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:25:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6cbb630-254f-4c56-9cf9-47d751c703be/disk --force-share --output=json" returned: 0 in 0.277s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:25:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6cbb630-254f-4c56-9cf9-47d751c703be/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:25:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6cbb630-254f-4c56-9cf9-47d751c703be/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:25:51 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74960) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 12:25:51 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74960) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 12:25:51 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=74960) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 12:25:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a33549f-51ea-42d0-8c8a-67d9c74784fd/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:25:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a33549f-51ea-42d0-8c8a-67d9c74784fd/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:25:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a33549f-51ea-42d0-8c8a-67d9c74784fd/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:25:52 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a33549f-51ea-42d0-8c8a-67d9c74784fd/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:25:52 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:25:52 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:25:52 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Hypervisor/Node resource view: name=user free_ram=7654MB free_disk=25.26462173461914GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74960) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 12:25:52 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:25:52 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:25:52 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 7769e3c5-136f-4282-8e3e-224e3a80922c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:25:52 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 6145a30b-809c-4bc5-a45f-c3ff3b170a22 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:25:52 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance fffd1dd7-b8e8-435c-bdfe-6c5001b21daf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:25:52 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance f009a400-0576-48a9-82e0-60de8935c498 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:25:52 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 9951fab7-4984-408e-94ca-11eab615ff25 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:25:52 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance db88322f-c2ad-4622-9a1a-c45439d875a8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:25:52 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance e6cbb630-254f-4c56-9cf9-47d751c703be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:25:52 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 87f15f5f-8afa-4d7b-bb45-5887184f9ee5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:25:52 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 7a33549f-51ea-42d0-8c8a-67d9c74784fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:25:52 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74960) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 12:25:52 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74960) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 12:25:52 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:53 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:25:53 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:25:53 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Compute_service record updated for user:user {{(pid=74960) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 12:25:53 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.582s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:25:53 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:25:53 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:25:53 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:25:53 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74960) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 12:25:53 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:57 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:25:58 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:02 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:03 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2dae5e82-0227-4bfa-95fe-0a03a2f6101c tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] [instance: f009a400-0576-48a9-82e0-60de8935c498] Calling os-brick to attach iSCSI Volume {{(pid=74960) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 12:26:03 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dae5e82-0227-4bfa-95fe-0a03a2f6101c tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9aa420acb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QDgJxOCT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:26:03 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-2dae5e82-0227-4bfa-95fe-0a03a2f6101c tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:26:03 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-2dae5e82-0227-4bfa-95fe-0a03a2f6101c tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:26:03 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-2dae5e82-0227-4bfa-95fe-0a03a2f6101c tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:26:03 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-2dae5e82-0227-4bfa-95fe-0a03a2f6101c tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:26:03 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-2dae5e82-0227-4bfa-95fe-0a03a2f6101c tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:26:03 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-2dae5e82-0227-4bfa-95fe-0a03a2f6101c tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:26:03 user nova-compute[74960]: INFO os_brick.initiator.connectors.iscsi [None req-2dae5e82-0227-4bfa-95fe-0a03a2f6101c tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 12:26:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815 -p 172.16.0.220:3260 {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:26:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:26:03 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8fd8572-9b8e-40ce-a326-d5132ce84a0c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:26:03 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dae5e82-0227-4bfa-95fe-0a03a2f6101c tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 12:26:03 user nova-compute[74960]:  {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:26:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815 -p 172.16.0.220:3260 --interface default --op new {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:26:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:26:03 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[7850d381-eb6f-4f1c-a810-a53ceb6ab12f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815] added\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:26:03 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dae5e82-0227-4bfa-95fe-0a03a2f6101c tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815] added
Nov 03 12:26:03 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:26:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:26:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:26:03 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[ced2a6e6-bf15-4239-ab6a-601d708fa43b]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:26:03 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dae5e82-0227-4bfa-95fe-0a03a2f6101c tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:26:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:26:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:26:03 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[8800f66d-ade9-43b0-a2bf-45d7dab5844a]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:26:03 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dae5e82-0227-4bfa-95fe-0a03a2f6101c tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:26:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QDgJxOCT {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:26:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QDgJxOCT" returned: 0 in 0.022s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:26:03 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[e438ba67-ce33-48be-aecb-626acecc0848]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:26:03 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dae5e82-0227-4bfa-95fe-0a03a2f6101c tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QDgJxOCT'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:26:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:26:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:26:03 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[392d2d62-fd59-4109-9ae3-61d5afd576b7]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:26:03 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dae5e82-0227-4bfa-95fe-0a03a2f6101c tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:26:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:26:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:26:03 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[04cbc41d-b1bf-44b0-842e-a1a9546adda1]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64202938-e4d3-4072-ba6e-f144187c01a9 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd1b7665-8415-44ab-81f5-84493c50a786 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f629b2b5-39ab-4ee3-9633-a534a39c93a5 (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:26:03 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dae5e82-0227-4bfa-95fe-0a03a2f6101c tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01 (non-flash)
Nov 03 12:26:03 user nova-compute[74960]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64202938-e4d3-4072-ba6e-f144187c01a9 (non-flash)
Nov 03 12:26:03 user nova-compute[74960]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd1b7665-8415-44ab-81f5-84493c50a786 (non-flash)
Nov 03 12:26:03 user nova-compute[74960]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f629b2b5-39ab-4ee3-9633-a534a39c93a5 (non-flash)
Nov 03 12:26:03 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:26:03 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dae5e82-0227-4bfa-95fe-0a03a2f6101c tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01 (non-flash)
Nov 03 12:26:03 user nova-compute[74960]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64202938-e4d3-4072-ba6e-f144187c01a9 (non-flash)
Nov 03 12:26:03 user nova-compute[74960]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd1b7665-8415-44ab-81f5-84493c50a786 (non-flash)
Nov 03 12:26:03 user nova-compute[74960]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f629b2b5-39ab-4ee3-9633-a534a39c93a5 (non-flash)
Nov 03 12:26:03 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:26:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815 -p 172.16.0.220:3260 --login {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:26:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:26:03 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[88f3c09c-30f3-42da-902d-d44445ed001b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:26:03 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dae5e82-0227-4bfa-95fe-0a03a2f6101c tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815, portal: 172.16.0.220,3260]
Nov 03 12:26:03 user nova-compute[74960]: Login to [iface: default, target: iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815, portal: 172.16.0.220,3260] successful.
Nov 03 12:26:03 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:26:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:26:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:26:03 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[80f5a26c-f460-4478-9b1d-eee49526bb4c]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:26:03 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dae5e82-0227-4bfa-95fe-0a03a2f6101c tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:26:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:26:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:26:03 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[468fee87-fb04-42b2-8ae3-a6eab2ba6c94]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64202938-e4d3-4072-ba6e-f144187c01a9 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd1b7665-8415-44ab-81f5-84493c50a786 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f629b2b5-39ab-4ee3-9633-a534a39c93a5 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815 (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:26:03 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dae5e82-0227-4bfa-95fe-0a03a2f6101c tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01 (non-flash)
Nov 03 12:26:03 user nova-compute[74960]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64202938-e4d3-4072-ba6e-f144187c01a9 (non-flash)
Nov 03 12:26:03 user nova-compute[74960]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd1b7665-8415-44ab-81f5-84493c50a786 (non-flash)
Nov 03 12:26:03 user nova-compute[74960]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f629b2b5-39ab-4ee3-9633-a534a39c93a5 (non-flash)
Nov 03 12:26:03 user nova-compute[74960]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815 (non-flash)
Nov 03 12:26:03 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:26:03 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dae5e82-0227-4bfa-95fe-0a03a2f6101c tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01 (non-flash)
Nov 03 12:26:03 user nova-compute[74960]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64202938-e4d3-4072-ba6e-f144187c01a9 (non-flash)
Nov 03 12:26:03 user nova-compute[74960]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd1b7665-8415-44ab-81f5-84493c50a786 (non-flash)
Nov 03 12:26:03 user nova-compute[74960]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f629b2b5-39ab-4ee3-9633-a534a39c93a5 (non-flash)
Nov 03 12:26:03 user nova-compute[74960]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815 (non-flash)
Nov 03 12:26:03 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:26:03 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-2dae5e82-0227-4bfa-95fe-0a03a2f6101c tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:26:03 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dae5e82-0227-4bfa-95fe-0a03a2f6101c tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Connected to 172.16.0.220:3260 {{(pid=74960) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 12:26:03 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-2dae5e82-0227-4bfa-95fe-0a03a2f6101c tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] HCTL ('37', '-', '-', 0) found on session 16 with lun 0 {{(pid=74960) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 12:26:03 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-2dae5e82-0227-4bfa-95fe-0a03a2f6101c tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74960) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 12:26:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:26:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:26:03 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[09410142-2f44-4e8d-82e5-aeca7f2decf5]: (4, ('- - 0', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:26:03 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-2dae5e82-0227-4bfa-95fe-0a03a2f6101c tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Searching for a device in session 16 and hctl ['37', '*', '*', 0] yield: None {{(pid=74960) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 12:26:03 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:04 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-2dae5e82-0227-4bfa-95fe-0a03a2f6101c tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Searching for a device in session 16 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74960) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 12:26:04 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dae5e82-0227-4bfa-95fe-0a03a2f6101c tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QDgJxOCT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74960) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 12:26:04 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-2dae5e82-0227-4bfa-95fe-0a03a2f6101c tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.340s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:26:04 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dae5e82-0227-4bfa-95fe-0a03a2f6101c tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] <== connect_volume: return (1342ms) {'type': 'block', 'scsi_wwn': '23732363931633161', 'path': '/dev/sdf'} {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:26:04 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2dae5e82-0227-4bfa-95fe-0a03a2f6101c tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] [instance: f009a400-0576-48a9-82e0-60de8935c498] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23732363931633161', 'path': '/dev/sdf'} {{(pid=74960) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 12:26:04 user nova-compute[74960]: DEBUG nova.objects.instance [None req-2dae5e82-0227-4bfa-95fe-0a03a2f6101c tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Lazy-loading 'flavor' on Instance uuid f009a400-0576-48a9-82e0-60de8935c498 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:26:04 user nova-compute[74960]: DEBUG nova.virt.libvirt.guest [None req-2dae5e82-0227-4bfa-95fe-0a03a2f6101c tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] attach device xml: <disk type="block" device="disk">
Nov 03 12:26:04 user nova-compute[74960]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 12:26:04 user nova-compute[74960]:   <source dev="/dev/sdf"/>
Nov 03 12:26:04 user nova-compute[74960]:   <target dev="vdb" bus="virtio"/>
Nov 03 12:26:04 user nova-compute[74960]:   <serial>9101c521-a24b-4b03-b2b1-d73585222815</serial>
Nov 03 12:26:04 user nova-compute[74960]: </disk>
Nov 03 12:26:04 user nova-compute[74960]:  {{(pid=74960) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 03 12:26:04 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-2dae5e82-0227-4bfa-95fe-0a03a2f6101c tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] No BDM found with device name vda, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:26:04 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-2dae5e82-0227-4bfa-95fe-0a03a2f6101c tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:26:04 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-2dae5e82-0227-4bfa-95fe-0a03a2f6101c tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] No VIF found with MAC fa:16:3e:81:8a:f6, not building metadata {{(pid=74960) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 12:26:05 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-2dae5e82-0227-4bfa-95fe-0a03a2f6101c tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Lock "f009a400-0576-48a9-82e0-60de8935c498" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.011s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:26:06 user nova-compute[74960]: INFO nova.compute.manager [None req-7f78f9f5-2a2f-41be-9c0e-04000fc5693d tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] [instance: f009a400-0576-48a9-82e0-60de8935c498] Rescuing
Nov 03 12:26:06 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-7f78f9f5-2a2f-41be-9c0e-04000fc5693d tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Acquiring lock "refresh_cache-f009a400-0576-48a9-82e0-60de8935c498" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:26:06 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-7f78f9f5-2a2f-41be-9c0e-04000fc5693d tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Acquired lock "refresh_cache-f009a400-0576-48a9-82e0-60de8935c498" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:26:06 user nova-compute[74960]: DEBUG nova.network.neutron [None req-7f78f9f5-2a2f-41be-9c0e-04000fc5693d tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] [instance: f009a400-0576-48a9-82e0-60de8935c498] Building network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 12:26:06 user nova-compute[74960]: DEBUG nova.network.neutron [None req-7f78f9f5-2a2f-41be-9c0e-04000fc5693d tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] [instance: f009a400-0576-48a9-82e0-60de8935c498] Updating instance_info_cache with network_info: [{"id": "4b72249c-3aea-415f-83a8-d0498d55674e", "address": "fa:16:3e:81:8a:f6", "network": {"id": "b92f11b0-994f-48b7-be64-02cb782a1f8f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-997339008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d039968e1b97457b8fc21b593af4e1ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b72249c-3a", "ovs_interfaceid": "4b72249c-3aea-415f-83a8-d0498d55674e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:26:06 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-7f78f9f5-2a2f-41be-9c0e-04000fc5693d tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Releasing lock "refresh_cache-f009a400-0576-48a9-82e0-60de8935c498" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:26:07 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:07 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:07 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:07 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:07 user nova-compute[74960]: DEBUG nova.compute.manager [req-919eeea4-5bce-48a4-b03d-29e920aac49b req-11b068f6-8262-4c60-8f95-f189c2d298fb service nova] [instance: f009a400-0576-48a9-82e0-60de8935c498] Received event network-vif-unplugged-4b72249c-3aea-415f-83a8-d0498d55674e {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:26:07 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-919eeea4-5bce-48a4-b03d-29e920aac49b req-11b068f6-8262-4c60-8f95-f189c2d298fb service nova] Acquiring lock "f009a400-0576-48a9-82e0-60de8935c498-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:26:07 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-919eeea4-5bce-48a4-b03d-29e920aac49b req-11b068f6-8262-4c60-8f95-f189c2d298fb service nova] Lock "f009a400-0576-48a9-82e0-60de8935c498-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:26:07 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-919eeea4-5bce-48a4-b03d-29e920aac49b req-11b068f6-8262-4c60-8f95-f189c2d298fb service nova] Lock "f009a400-0576-48a9-82e0-60de8935c498-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:26:07 user nova-compute[74960]: DEBUG nova.compute.manager [req-919eeea4-5bce-48a4-b03d-29e920aac49b req-11b068f6-8262-4c60-8f95-f189c2d298fb service nova] [instance: f009a400-0576-48a9-82e0-60de8935c498] No waiting events found dispatching network-vif-unplugged-4b72249c-3aea-415f-83a8-d0498d55674e {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:26:07 user nova-compute[74960]: WARNING nova.compute.manager [req-919eeea4-5bce-48a4-b03d-29e920aac49b req-11b068f6-8262-4c60-8f95-f189c2d298fb service nova] [instance: f009a400-0576-48a9-82e0-60de8935c498] Received unexpected event network-vif-unplugged-4b72249c-3aea-415f-83a8-d0498d55674e for instance with vm_state active and task_state rescuing.
Nov 03 12:26:07 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: f009a400-0576-48a9-82e0-60de8935c498] Instance destroyed successfully.
Nov 03 12:26:07 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-7f78f9f5-2a2f-41be-9c0e-04000fc5693d tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] [instance: f009a400-0576-48a9-82e0-60de8935c498] Attempting a stable device rescue
Nov 03 12:26:07 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-7f78f9f5-2a2f-41be-9c0e-04000fc5693d tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=74960) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 03 12:26:07 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-7f78f9f5-2a2f-41be-9c0e-04000fc5693d tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] [instance: f009a400-0576-48a9-82e0-60de8935c498] Instance directory exists: not creating {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 03 12:26:07 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-7f78f9f5-2a2f-41be-9c0e-04000fc5693d tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] [instance: f009a400-0576-48a9-82e0-60de8935c498] Creating image(s)
Nov 03 12:26:07 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-7f78f9f5-2a2f-41be-9c0e-04000fc5693d tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Acquiring lock "/opt/stack/data/nova/instances/f009a400-0576-48a9-82e0-60de8935c498/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:26:07 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-7f78f9f5-2a2f-41be-9c0e-04000fc5693d tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Lock "/opt/stack/data/nova/instances/f009a400-0576-48a9-82e0-60de8935c498/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:26:07 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-7f78f9f5-2a2f-41be-9c0e-04000fc5693d tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Lock "/opt/stack/data/nova/instances/f009a400-0576-48a9-82e0-60de8935c498/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:26:07 user nova-compute[74960]: DEBUG nova.objects.instance [None req-7f78f9f5-2a2f-41be-9c0e-04000fc5693d tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Lazy-loading 'trusted_certs' on Instance uuid f009a400-0576-48a9-82e0-60de8935c498 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:26:07 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-7f78f9f5-2a2f-41be-9c0e-04000fc5693d tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Acquiring lock "40928fe67a462526e212953cfebd65bd57921145" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:26:07 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-7f78f9f5-2a2f-41be-9c0e-04000fc5693d tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Lock "40928fe67a462526e212953cfebd65bd57921145" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:26:07 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:09 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-7f78f9f5-2a2f-41be-9c0e-04000fc5693d tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/40928fe67a462526e212953cfebd65bd57921145.part --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:26:09 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:09 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-7f78f9f5-2a2f-41be-9c0e-04000fc5693d tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/40928fe67a462526e212953cfebd65bd57921145.part --force-share --output=json" returned: 0 in 0.191s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:26:09 user nova-compute[74960]: DEBUG nova.virt.images [None req-7f78f9f5-2a2f-41be-9c0e-04000fc5693d tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] eef7f785-814c-43dd-bb9e-83bc3b0c506f was qcow2, converting to raw {{(pid=74960) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 03 12:26:09 user nova-compute[74960]: DEBUG nova.privsep.utils [None req-7f78f9f5-2a2f-41be-9c0e-04000fc5693d tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74960) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 03 12:26:09 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-7f78f9f5-2a2f-41be-9c0e-04000fc5693d tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/40928fe67a462526e212953cfebd65bd57921145.part /opt/stack/data/nova/instances/_base/40928fe67a462526e212953cfebd65bd57921145.converted {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:26:09 user nova-compute[74960]: DEBUG nova.compute.manager [req-47b20deb-9f05-4b69-838b-2db5acf0b1ed req-8b525256-68de-4753-965b-e41ea349a4ec service nova] [instance: f009a400-0576-48a9-82e0-60de8935c498] Received event network-vif-plugged-4b72249c-3aea-415f-83a8-d0498d55674e {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:26:09 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-47b20deb-9f05-4b69-838b-2db5acf0b1ed req-8b525256-68de-4753-965b-e41ea349a4ec service nova] Acquiring lock "f009a400-0576-48a9-82e0-60de8935c498-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:26:09 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-47b20deb-9f05-4b69-838b-2db5acf0b1ed req-8b525256-68de-4753-965b-e41ea349a4ec service nova] Lock "f009a400-0576-48a9-82e0-60de8935c498-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:26:09 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-47b20deb-9f05-4b69-838b-2db5acf0b1ed req-8b525256-68de-4753-965b-e41ea349a4ec service nova] Lock "f009a400-0576-48a9-82e0-60de8935c498-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:26:09 user nova-compute[74960]: DEBUG nova.compute.manager [req-47b20deb-9f05-4b69-838b-2db5acf0b1ed req-8b525256-68de-4753-965b-e41ea349a4ec service nova] [instance: f009a400-0576-48a9-82e0-60de8935c498] No waiting events found dispatching network-vif-plugged-4b72249c-3aea-415f-83a8-d0498d55674e {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:26:09 user nova-compute[74960]: WARNING nova.compute.manager [req-47b20deb-9f05-4b69-838b-2db5acf0b1ed req-8b525256-68de-4753-965b-e41ea349a4ec service nova] [instance: f009a400-0576-48a9-82e0-60de8935c498] Received unexpected event network-vif-plugged-4b72249c-3aea-415f-83a8-d0498d55674e for instance with vm_state active and task_state rescuing.
Nov 03 12:26:09 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-0a2565de-9e74-41d7-b7b1-9780983c8a36 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Acquiring lock "6145a30b-809c-4bc5-a45f-c3ff3b170a22" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:26:09 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-0a2565de-9e74-41d7-b7b1-9780983c8a36 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Lock "6145a30b-809c-4bc5-a45f-c3ff3b170a22" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:26:09 user nova-compute[74960]: INFO nova.compute.manager [None req-0a2565de-9e74-41d7-b7b1-9780983c8a36 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] Detaching volume 91f59f2a-fb49-4bb7-8249-7c895b43aa01
Nov 03 12:26:09 user nova-compute[74960]: INFO nova.virt.block_device [None req-0a2565de-9e74-41d7-b7b1-9780983c8a36 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] Attempting to driver detach volume 91f59f2a-fb49-4bb7-8249-7c895b43aa01 from mountpoint /dev/vdb
Nov 03 12:26:09 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-0a2565de-9e74-41d7-b7b1-9780983c8a36 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Attempting to detach device vdb from instance 6145a30b-809c-4bc5-a45f-c3ff3b170a22 from the persistent domain config. {{(pid=74960) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 03 12:26:09 user nova-compute[74960]: DEBUG nova.virt.libvirt.guest [None req-0a2565de-9e74-41d7-b7b1-9780983c8a36 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 12:26:09 user nova-compute[74960]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 12:26:09 user nova-compute[74960]:   <source dev="/dev/sdb"/>
Nov 03 12:26:09 user nova-compute[74960]:   <target dev="vdb" bus="virtio"/>
Nov 03 12:26:09 user nova-compute[74960]:   <serial>91f59f2a-fb49-4bb7-8249-7c895b43aa01</serial>
Nov 03 12:26:09 user nova-compute[74960]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 03 12:26:09 user nova-compute[74960]: </disk>
Nov 03 12:26:09 user nova-compute[74960]:  {{(pid=74960) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 12:26:09 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-0a2565de-9e74-41d7-b7b1-9780983c8a36 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Successfully detached device vdb from instance 6145a30b-809c-4bc5-a45f-c3ff3b170a22 from the persistent domain config.
Nov 03 12:26:09 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-0a2565de-9e74-41d7-b7b1-9780983c8a36 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6145a30b-809c-4bc5-a45f-c3ff3b170a22 from the live domain config. {{(pid=74960) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 03 12:26:09 user nova-compute[74960]: DEBUG nova.virt.libvirt.guest [None req-0a2565de-9e74-41d7-b7b1-9780983c8a36 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 12:26:09 user nova-compute[74960]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 12:26:09 user nova-compute[74960]:   <source dev="/dev/sdb"/>
Nov 03 12:26:09 user nova-compute[74960]:   <target dev="vdb" bus="virtio"/>
Nov 03 12:26:09 user nova-compute[74960]:   <serial>91f59f2a-fb49-4bb7-8249-7c895b43aa01</serial>
Nov 03 12:26:09 user nova-compute[74960]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 03 12:26:09 user nova-compute[74960]: </disk>
Nov 03 12:26:09 user nova-compute[74960]:  {{(pid=74960) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 12:26:09 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-7f78f9f5-2a2f-41be-9c0e-04000fc5693d tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/40928fe67a462526e212953cfebd65bd57921145.part /opt/stack/data/nova/instances/_base/40928fe67a462526e212953cfebd65bd57921145.converted" returned: 0 in 0.656s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:26:09 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-7f78f9f5-2a2f-41be-9c0e-04000fc5693d tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/40928fe67a462526e212953cfebd65bd57921145.converted --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:26:10 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-7f78f9f5-2a2f-41be-9c0e-04000fc5693d tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/40928fe67a462526e212953cfebd65bd57921145.converted --force-share --output=json" returned: 0 in 0.224s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:26:10 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-7f78f9f5-2a2f-41be-9c0e-04000fc5693d tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Lock "40928fe67a462526e212953cfebd65bd57921145" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.222s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:26:10 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-7f78f9f5-2a2f-41be-9c0e-04000fc5693d tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Acquiring lock "40928fe67a462526e212953cfebd65bd57921145" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:26:10 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-7f78f9f5-2a2f-41be-9c0e-04000fc5693d tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Lock "40928fe67a462526e212953cfebd65bd57921145" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:26:10 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-7f78f9f5-2a2f-41be-9c0e-04000fc5693d tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/40928fe67a462526e212953cfebd65bd57921145 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:26:10 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-0a2565de-9e74-41d7-b7b1-9780983c8a36 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6145a30b-809c-4bc5-a45f-c3ff3b170a22 {{(pid=74960) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 03 12:26:10 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-7f78f9f5-2a2f-41be-9c0e-04000fc5693d tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/40928fe67a462526e212953cfebd65bd57921145 --force-share --output=json" returned: 0 in 0.195s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:26:10 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-7f78f9f5-2a2f-41be-9c0e-04000fc5693d tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/40928fe67a462526e212953cfebd65bd57921145,backing_fmt=raw /opt/stack/data/nova/instances/f009a400-0576-48a9-82e0-60de8935c498/disk.rescue {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:26:10 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-7f78f9f5-2a2f-41be-9c0e-04000fc5693d tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/40928fe67a462526e212953cfebd65bd57921145,backing_fmt=raw /opt/stack/data/nova/instances/f009a400-0576-48a9-82e0-60de8935c498/disk.rescue" returned: 0 in 0.060s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:26:10 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-7f78f9f5-2a2f-41be-9c0e-04000fc5693d tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Lock "40928fe67a462526e212953cfebd65bd57921145" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.261s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:26:10 user nova-compute[74960]: DEBUG nova.objects.instance [None req-7f78f9f5-2a2f-41be-9c0e-04000fc5693d tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Lazy-loading 'migration_context' on Instance uuid f009a400-0576-48a9-82e0-60de8935c498 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:26:10 user nova-compute[74960]: DEBUG nova.objects.base [None req-7f78f9f5-2a2f-41be-9c0e-04000fc5693d tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Object Instance<f009a400-0576-48a9-82e0-60de8935c498> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74960) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 12:26:10 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-7f78f9f5-2a2f-41be-9c0e-04000fc5693d tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] [instance: f009a400-0576-48a9-82e0-60de8935c498] Created local disks {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 12:26:10 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-7f78f9f5-2a2f-41be-9c0e-04000fc5693d tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] [instance: f009a400-0576-48a9-82e0-60de8935c498] Start _get_guest_xml network_info=[{"id": "4b72249c-3aea-415f-83a8-d0498d55674e", "address": "fa:16:3e:81:8a:f6", "network": {"id": "b92f11b0-994f-48b7-be64-02cb782a1f8f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-997339008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-997339008-network", "vif_mac": "fa:16:3e:81:8a:f6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d039968e1b97457b8fc21b593af4e1ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b72249c-3a", "ovs_interfaceid": "4b72249c-3aea-415f-83a8-d0498d55674e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=549f51ba-ac69-494b-8de1-34635aa2d7cf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='63ee9c80c632442fb0379f47b784bd20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T12:13:04Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'eef7f785-814c-43dd-bb9e-83bc3b0c506f', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'image_id': '549f51ba-ac69-494b-8de1-34635aa2d7cf'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QDgJxOCT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': 'f009a400-0576-48a9-82e0-60de8935c498', 'attached_at': '', 'detached_at': '', 'volume_id': '9101c521-a24b-4b03-b2b1-d73585222815', 'serial': '9101c521-a24b-4b03-b2b1-d73585222815'}, 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'attachment_id': '06526461-dd7d-4f5d-918d-7884accfb994', 'boot_index': None, 'guest_format': None, 'volume_type': None} {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 12:26:10 user nova-compute[74960]: DEBUG nova.objects.instance [None req-7f78f9f5-2a2f-41be-9c0e-04000fc5693d tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Lazy-loading 'resources' on Instance uuid f009a400-0576-48a9-82e0-60de8935c498 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:26:10 user nova-compute[74960]: DEBUG nova.objects.base [None req-7f78f9f5-2a2f-41be-9c0e-04000fc5693d tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Object Instance<f009a400-0576-48a9-82e0-60de8935c498> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74960) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 12:26:10 user nova-compute[74960]: DEBUG nova.objects.instance [None req-7f78f9f5-2a2f-41be-9c0e-04000fc5693d tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Lazy-loading 'numa_topology' on Instance uuid f009a400-0576-48a9-82e0-60de8935c498 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:26:10 user nova-compute[74960]: DEBUG nova.objects.base [None req-7f78f9f5-2a2f-41be-9c0e-04000fc5693d tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Object Instance<f009a400-0576-48a9-82e0-60de8935c498> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74960) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 12:26:10 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-7f78f9f5-2a2f-41be-9c0e-04000fc5693d tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:26:10 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-7f78f9f5-2a2f-41be-9c0e-04000fc5693d tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:26:10 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-7f78f9f5-2a2f-41be-9c0e-04000fc5693d tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 12:26:10 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-7f78f9f5-2a2f-41be-9c0e-04000fc5693d tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] CPU controller missing on host. {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 12:26:10 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-7f78f9f5-2a2f-41be-9c0e-04000fc5693d tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 12:26:10 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-7f78f9f5-2a2f-41be-9c0e-04000fc5693d tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] CPU controller found on host. {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 12:26:10 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-7f78f9f5-2a2f-41be-9c0e-04000fc5693d tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74960) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 12:26:10 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-7f78f9f5-2a2f-41be-9c0e-04000fc5693d tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=549f51ba-ac69-494b-8de1-34635aa2d7cf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='63ee9c80c632442fb0379f47b784bd20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T12:13:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 12:26:10 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-7f78f9f5-2a2f-41be-9c0e-04000fc5693d tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Flavor limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 12:26:10 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-7f78f9f5-2a2f-41be-9c0e-04000fc5693d tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Image limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 12:26:10 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-7f78f9f5-2a2f-41be-9c0e-04000fc5693d tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Flavor pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 12:26:10 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-7f78f9f5-2a2f-41be-9c0e-04000fc5693d tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Image pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 12:26:10 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-7f78f9f5-2a2f-41be-9c0e-04000fc5693d tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 12:26:10 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-7f78f9f5-2a2f-41be-9c0e-04000fc5693d tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 12:26:10 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-7f78f9f5-2a2f-41be-9c0e-04000fc5693d tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 12:26:10 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-7f78f9f5-2a2f-41be-9c0e-04000fc5693d tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Got 1 possible topologies {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 12:26:10 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-7f78f9f5-2a2f-41be-9c0e-04000fc5693d tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 12:26:10 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-7f78f9f5-2a2f-41be-9c0e-04000fc5693d tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 12:26:10 user nova-compute[74960]: DEBUG nova.objects.instance [None req-7f78f9f5-2a2f-41be-9c0e-04000fc5693d tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Lazy-loading 'vcpu_model' on Instance uuid f009a400-0576-48a9-82e0-60de8935c498 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:26:10 user nova-compute[74960]: DEBUG nova.objects.base [None req-7f78f9f5-2a2f-41be-9c0e-04000fc5693d tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Object Instance<f009a400-0576-48a9-82e0-60de8935c498> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74960) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 12:26:10 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f78f9f5-2a2f-41be-9c0e-04000fc5693d tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] [instance: f009a400-0576-48a9-82e0-60de8935c498] Calling os-brick to attach iSCSI Volume {{(pid=74960) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 12:26:10 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f78f9f5-2a2f-41be-9c0e-04000fc5693d tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9aa420acb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QDgJxOCT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:26:10 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-7f78f9f5-2a2f-41be-9c0e-04000fc5693d tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:26:10 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-7f78f9f5-2a2f-41be-9c0e-04000fc5693d tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:26:10 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-7f78f9f5-2a2f-41be-9c0e-04000fc5693d tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:26:10 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-7f78f9f5-2a2f-41be-9c0e-04000fc5693d tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:26:10 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-7f78f9f5-2a2f-41be-9c0e-04000fc5693d tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:26:10 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-7f78f9f5-2a2f-41be-9c0e-04000fc5693d tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:26:10 user nova-compute[74960]: INFO os_brick.initiator.connectors.iscsi [None req-7f78f9f5-2a2f-41be-9c0e-04000fc5693d tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 12:26:10 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815 -p 172.16.0.220:3260 {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:26:10 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815 -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:26:10 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ffa1c9f-a6ff-4193-baeb-11a519763647]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = QDgJxOCT\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:26:10 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f78f9f5-2a2f-41be-9c0e-04000fc5693d tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 03 12:26:10 user nova-compute[74960]: node.name = iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815
Nov 03 12:26:10 user nova-compute[74960]: node.tpgt = -1
Nov 03 12:26:10 user nova-compute[74960]: node.startup = automatic
Nov 03 12:26:10 user nova-compute[74960]: node.leading_login = No
Nov 03 12:26:10 user nova-compute[74960]: iface.iscsi_ifacename = default
Nov 03 12:26:10 user nova-compute[74960]: iface.net_ifacename = <empty>
Nov 03 12:26:10 user nova-compute[74960]: iface.ipaddress = <empty>
Nov 03 12:26:10 user nova-compute[74960]: iface.prefix_len = 0
Nov 03 12:26:10 user nova-compute[74960]: iface.hwaddress = <empty>
Nov 03 12:26:10 user nova-compute[74960]: iface.transport_name = tcp
Nov 03 12:26:10 user nova-compute[74960]: iface.initiatorname = <empty>
Nov 03 12:26:10 user nova-compute[74960]: iface.state = <empty>
Nov 03 12:26:10 user nova-compute[74960]: iface.vlan_id = 0
Nov 03 12:26:10 user nova-compute[74960]: iface.vlan_priority = 0
Nov 03 12:26:10 user nova-compute[74960]: iface.vlan_state = <empty>
Nov 03 12:26:10 user nova-compute[74960]: iface.iface_num = 0
Nov 03 12:26:10 user nova-compute[74960]: iface.mtu = 0
Nov 03 12:26:10 user nova-compute[74960]: iface.port = 0
Nov 03 12:26:10 user nova-compute[74960]: iface.bootproto = <empty>
Nov 03 12:26:10 user nova-compute[74960]: iface.subnet_mask = <empty>
Nov 03 12:26:10 user nova-compute[74960]: iface.gateway = <empty>
Nov 03 12:26:10 user nova-compute[74960]: iface.dhcp_alt_client_id_state = <empty>
Nov 03 12:26:10 user nova-compute[74960]: iface.dhcp_alt_client_id = <empty>
Nov 03 12:26:10 user nova-compute[74960]: iface.dhcp_dns = <empty>
Nov 03 12:26:10 user nova-compute[74960]: iface.dhcp_learn_iqn = <empty>
Nov 03 12:26:10 user nova-compute[74960]: iface.dhcp_req_vendor_id_state = <empty>
Nov 03 12:26:10 user nova-compute[74960]: iface.dhcp_vendor_id_state = <empty>
Nov 03 12:26:10 user nova-compute[74960]: iface.dhcp_vendor_id = <empty>
Nov 03 12:26:10 user nova-compute[74960]: iface.dhcp_slp_da = <empty>
Nov 03 12:26:10 user nova-compute[74960]: iface.fragmentation = <empty>
Nov 03 12:26:10 user nova-compute[74960]: iface.gratuitous_arp = <empty>
Nov 03 12:26:10 user nova-compute[74960]: iface.incoming_forwarding = <empty>
Nov 03 12:26:10 user nova-compute[74960]: iface.tos_state = <empty>
Nov 03 12:26:10 user nova-compute[74960]: iface.tos = 0
Nov 03 12:26:10 user nova-compute[74960]: iface.ttl = 0
Nov 03 12:26:10 user nova-compute[74960]: iface.delayed_ack = <empty>
Nov 03 12:26:10 user nova-compute[74960]: iface.tcp_nagle = <empty>
Nov 03 12:26:10 user nova-compute[74960]: iface.tcp_wsf_state = <empty>
Nov 03 12:26:10 user nova-compute[74960]: iface.tcp_wsf = 0
Nov 03 12:26:10 user nova-compute[74960]: iface.tcp_timer_scale = 0
Nov 03 12:26:10 user nova-compute[74960]: iface.tcp_timestamp = <empty>
Nov 03 12:26:10 user nova-compute[74960]: iface.redirect = <empty>
Nov 03 12:26:10 user nova-compute[74960]: iface.def_task_mgmt_timeout = 0
Nov 03 12:26:10 user nova-compute[74960]: iface.header_digest = <empty>
Nov 03 12:26:10 user nova-compute[74960]: iface.data_digest = <empty>
Nov 03 12:26:10 user nova-compute[74960]: iface.immediate_data = <empty>
Nov 03 12:26:10 user nova-compute[74960]: iface.initial_r2t = <empty>
Nov 03 12:26:10 user nova-compute[74960]: iface.data_seq_inorder = <empty>
Nov 03 12:26:10 user nova-compute[74960]: iface.data_pdu_inorder = <empty>
Nov 03 12:26:10 user nova-compute[74960]: iface.erl = 0
Nov 03 12:26:10 user nova-compute[74960]: iface.max_receive_data_len = 0
Nov 03 12:26:10 user nova-compute[74960]: iface.first_burst_len = 0
Nov 03 12:26:10 user nova-compute[74960]: iface.max_outstanding_r2t = 0
Nov 03 12:26:10 user nova-compute[74960]: iface.max_burst_len = 0
Nov 03 12:26:10 user nova-compute[74960]: iface.chap_auth = <empty>
Nov 03 12:26:10 user nova-compute[74960]: iface.bidi_chap = <empty>
Nov 03 12:26:10 user nova-compute[74960]: iface.strict_login_compliance = <empty>
Nov 03 12:26:10 user nova-compute[74960]: iface.discovery_auth = <empty>
Nov 03 12:26:10 user nova-compute[74960]: iface.discovery_logout = <empty>
Nov 03 12:26:10 user nova-compute[74960]: node.discovery_address = <empty>
Nov 03 12:26:10 user nova-compute[74960]: node.discovery_port = 0
Nov 03 12:26:10 user nova-compute[74960]: node.discovery_type = static
Nov 03 12:26:10 user nova-compute[74960]: node.session.initial_cmdsn = 0
Nov 03 12:26:10 user nova-compute[74960]: node.session.initial_login_retry_max = 8
Nov 03 12:26:10 user nova-compute[74960]: node.session.xmit_thread_priority = -20
Nov 03 12:26:10 user nova-compute[74960]: node.session.cmds_max = 128
Nov 03 12:26:10 user nova-compute[74960]: node.session.queue_depth = 32
Nov 03 12:26:10 user nova-compute[74960]: node.session.nr_sessions = 1
Nov 03 12:26:10 user nova-compute[74960]: node.session.auth.authmethod = CHAP
Nov 03 12:26:10 user nova-compute[74960]: node.session.auth.username = QDgJxOCT
Nov 03 12:26:10 user nova-compute[74960]: node.session.auth.password = ***
Nov 03 12:26:10 user nova-compute[74960]: node.session.auth.username_in = <empty>
Nov 03 12:26:10 user nova-compute[74960]: node.session.auth.password_in = <empty>
Nov 03 12:26:10 user nova-compute[74960]: node.session.auth.chap_algs = MD5
Nov 03 12:26:10 user nova-compute[74960]: node.session.timeo.replacement_timeout = 120
Nov 03 12:26:10 user nova-compute[74960]: node.session.err_timeo.abort_timeout = 15
Nov 03 12:26:10 user nova-compute[74960]: node.session.err_timeo.lu_reset_timeout = 30
Nov 03 12:26:10 user nova-compute[74960]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 03 12:26:10 user nova-compute[74960]: node.session.err_timeo.host_reset_timeout = 60
Nov 03 12:26:10 user nova-compute[74960]: node.session.iscsi.FastAbort = Yes
Nov 03 12:26:10 user nova-compute[74960]: node.session.iscsi.InitialR2T = No
Nov 03 12:26:10 user nova-compute[74960]: node.session.iscsi.ImmediateData = Yes
Nov 03 12:26:10 user nova-compute[74960]: node.session.iscsi.FirstBurstLength = 262144
Nov 03 12:26:10 user nova-compute[74960]: node.session.iscsi.MaxBurstLength = 16776192
Nov 03 12:26:10 user nova-compute[74960]: node.session.iscsi.DefaultTime2Retain = 0
Nov 03 12:26:10 user nova-compute[74960]: node.session.iscsi.DefaultTime2Wait = 2
Nov 03 12:26:10 user nova-compute[74960]: node.session.iscsi.MaxConnections = 1
Nov 03 12:26:10 user nova-compute[74960]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 03 12:26:10 user nova-compute[74960]: node.session.iscsi.ERL = 0
Nov 03 12:26:10 user nova-compute[74960]: node.session.scan = manual
Nov 03 12:26:10 user nova-compute[74960]: node.session.reopen_max = 0
Nov 03 12:26:10 user nova-compute[74960]: node.conn[0].address = 172.16.0.220
Nov 03 12:26:10 user nova-compute[74960]: node.conn[0].port = 3260
Nov 03 12:26:10 user nova-compute[74960]: node.conn[0].startup = manual
Nov 03 12:26:10 user nova-compute[74960]: node.conn[0].tcp.window_size = 524288
Nov 03 12:26:10 user nova-compute[74960]: node.conn[0].tcp.type_of_service = 0
Nov 03 12:26:10 user nova-compute[74960]: node.conn[0].timeo.logout_timeout = 15
Nov 03 12:26:10 user nova-compute[74960]: node.conn[0].timeo.login_timeout = 15
Nov 03 12:26:10 user nova-compute[74960]: node.conn[0].timeo.auth_timeout = 45
Nov 03 12:26:10 user nova-compute[74960]: node.conn[0].timeo.noop_out_interval = 5
Nov 03 12:26:10 user nova-compute[74960]: node.conn[0].timeo.noop_out_timeout = 5
Nov 03 12:26:10 user nova-compute[74960]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 03 12:26:10 user nova-compute[74960]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 03 12:26:10 user nova-compute[74960]: node.conn[0].iscsi.HeaderDigest = None
Nov 03 12:26:10 user nova-compute[74960]: node.conn[0].iscsi.DataDigest = None
Nov 03 12:26:10 user nova-compute[74960]: node.conn[0].iscsi.IFMarker = No
Nov 03 12:26:10 user nova-compute[74960]: node.conn[0].iscsi.OFMarker = No
Nov 03 12:26:10 user nova-compute[74960]: # END RECORD
Nov 03 12:26:10 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:26:10 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:26:10 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:26:10 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c91eded-3b40-4aa4-8231-304fbc037142]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:26:10 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f78f9f5-2a2f-41be-9c0e-04000fc5693d tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:26:10 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:26:10 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:26:10 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[fce50331-a4da-4019-b82b-8e82d4c44ff3]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:26:10 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f78f9f5-2a2f-41be-9c0e-04000fc5693d tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:26:10 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QDgJxOCT {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:26:10 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QDgJxOCT" returned: 0 in 0.020s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:26:10 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[b33a37e8-4f5f-40d5-af07-54c95ee47f10]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:26:10 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f78f9f5-2a2f-41be-9c0e-04000fc5693d tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QDgJxOCT'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:26:10 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:26:10 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:26:10 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[69e63f0d-1104-4d26-8649-aab60a7eb824]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:26:10 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f78f9f5-2a2f-41be-9c0e-04000fc5693d tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:26:10 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:26:10 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:26:10 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e5419f1-60a5-4eb4-ad14-72d619de8cf6]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64202938-e4d3-4072-ba6e-f144187c01a9 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd1b7665-8415-44ab-81f5-84493c50a786 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f629b2b5-39ab-4ee3-9633-a534a39c93a5 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815 (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:26:10 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f78f9f5-2a2f-41be-9c0e-04000fc5693d tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01 (non-flash)
Nov 03 12:26:10 user nova-compute[74960]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64202938-e4d3-4072-ba6e-f144187c01a9 (non-flash)
Nov 03 12:26:10 user nova-compute[74960]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd1b7665-8415-44ab-81f5-84493c50a786 (non-flash)
Nov 03 12:26:10 user nova-compute[74960]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f629b2b5-39ab-4ee3-9633-a534a39c93a5 (non-flash)
Nov 03 12:26:10 user nova-compute[74960]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815 (non-flash)
Nov 03 12:26:10 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:26:10 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f78f9f5-2a2f-41be-9c0e-04000fc5693d tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01 (non-flash)
Nov 03 12:26:10 user nova-compute[74960]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64202938-e4d3-4072-ba6e-f144187c01a9 (non-flash)
Nov 03 12:26:10 user nova-compute[74960]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd1b7665-8415-44ab-81f5-84493c50a786 (non-flash)
Nov 03 12:26:10 user nova-compute[74960]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f629b2b5-39ab-4ee3-9633-a534a39c93a5 (non-flash)
Nov 03 12:26:10 user nova-compute[74960]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815 (non-flash)
Nov 03 12:26:10 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:26:10 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-7f78f9f5-2a2f-41be-9c0e-04000fc5693d tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.156s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:26:10 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f78f9f5-2a2f-41be-9c0e-04000fc5693d tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Connected to 172.16.0.220:3260 {{(pid=74960) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 12:26:10 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-7f78f9f5-2a2f-41be-9c0e-04000fc5693d tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] HCTL ('37', '0', '0', 0) found on session 16 with lun 0 {{(pid=74960) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 12:26:10 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-7f78f9f5-2a2f-41be-9c0e-04000fc5693d tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Scanning host 37 c: 0, t: 0, l: 0) {{(pid=74960) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 12:26:10 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:26:10 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:26:10 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[1715d3de-7268-4675-b9c6-8300a490efc2]: (4, ('0 0 0', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:26:10 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-7f78f9f5-2a2f-41be-9c0e-04000fc5693d tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Searching for a device in session 16 and hctl ('37', '0', '0', 0) yield: sdf {{(pid=74960) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 12:26:10 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f78f9f5-2a2f-41be-9c0e-04000fc5693d tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QDgJxOCT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74960) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 12:26:10 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-7f78f9f5-2a2f-41be-9c0e-04000fc5693d tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.187s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:26:10 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f78f9f5-2a2f-41be-9c0e-04000fc5693d tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] <== connect_volume: return (189ms) {'type': 'block', 'scsi_wwn': '23732363931633161', 'path': '/dev/sdf'} {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:26:10 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f78f9f5-2a2f-41be-9c0e-04000fc5693d tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] [instance: f009a400-0576-48a9-82e0-60de8935c498] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23732363931633161', 'path': '/dev/sdf'} {{(pid=74960) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 12:26:10 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-7f78f9f5-2a2f-41be-9c0e-04000fc5693d tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:21:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-302715128',display_name='tempest-ServerStableDeviceRescueTest-server-302715128',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-302715128',id=15,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKEJiNHk1MpJMHtnc9xz6UlLngjMhp2MEBhRlDPcSKLcrBwK03cPu7BEeyeirBfTHeIalig4pFBXX2rcKQNvvtYx9QYR4XrIrZ4ChHFhaM/FICjNG5IWTOJ5TxEEBwPkoQ==',key_name='tempest-keypair-1624034761',keypairs=<?>,launch_index=0,launched_at=2023-11-03T12:22:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d039968e1b97457b8fc21b593af4e1ff',ramdisk_id='',reservation_id='r-2awyc6mw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1015453085',owner_user_name='tempest-ServerStableDeviceRescueTest-1015453085-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:23:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7080314bc6e400d97bdb4b9bd4071c3',uuid=f009a400-0576-48a9-82e0-60de8935c498,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4b72249c-3aea-415f-83a8-d0498d55674e", "address": "fa:16:3e:81:8a:f6", "network": {"id": "b92f11b0-994f-48b7-be64-02cb782a1f8f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-997339008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-997339008-network", "vif_mac": "fa:16:3e:81:8a:f6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d039968e1b97457b8fc21b593af4e1ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b72249c-3a", "ovs_interfaceid": "4b72249c-3aea-415f-83a8-d0498d55674e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74960) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 12:26:10 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-7f78f9f5-2a2f-41be-9c0e-04000fc5693d tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Converting VIF {"id": "4b72249c-3aea-415f-83a8-d0498d55674e", "address": "fa:16:3e:81:8a:f6", "network": {"id": "b92f11b0-994f-48b7-be64-02cb782a1f8f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-997339008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-997339008-network", "vif_mac": "fa:16:3e:81:8a:f6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d039968e1b97457b8fc21b593af4e1ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b72249c-3a", "ovs_interfaceid": "4b72249c-3aea-415f-83a8-d0498d55674e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:26:10 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-7f78f9f5-2a2f-41be-9c0e-04000fc5693d tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:81:8a:f6,bridge_name='br-int',has_traffic_filtering=True,id=4b72249c-3aea-415f-83a8-d0498d55674e,network=Network(b92f11b0-994f-48b7-be64-02cb782a1f8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b72249c-3a') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:26:10 user nova-compute[74960]: DEBUG nova.objects.instance [None req-7f78f9f5-2a2f-41be-9c0e-04000fc5693d tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Lazy-loading 'pci_devices' on Instance uuid f009a400-0576-48a9-82e0-60de8935c498 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:26:10 user nova-compute[74960]: DEBUG nova.objects.base [None req-7f78f9f5-2a2f-41be-9c0e-04000fc5693d tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Object Instance<f009a400-0576-48a9-82e0-60de8935c498> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74960) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 12:26:10 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-7f78f9f5-2a2f-41be-9c0e-04000fc5693d tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] [instance: f009a400-0576-48a9-82e0-60de8935c498] End _get_guest_xml xml=<domain type="kvm">
Nov 03 12:26:10 user nova-compute[74960]:   <uuid>f009a400-0576-48a9-82e0-60de8935c498</uuid>
Nov 03 12:26:10 user nova-compute[74960]:   <name>instance-0000000f</name>
Nov 03 12:26:10 user nova-compute[74960]:   <memory>524288</memory>
Nov 03 12:26:10 user nova-compute[74960]:   <vcpu>1</vcpu>
Nov 03 12:26:10 user nova-compute[74960]:   <metadata>
Nov 03 12:26:10 user nova-compute[74960]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 12:26:10 user nova-compute[74960]:       <nova:package version="0.0.0"/>
Nov 03 12:26:10 user nova-compute[74960]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-302715128</nova:name>
Nov 03 12:26:10 user nova-compute[74960]:       <nova:creationTime>2023-11-03 12:26:10</nova:creationTime>
Nov 03 12:26:10 user nova-compute[74960]:       <nova:flavor name="m1.tiny">
Nov 03 12:26:10 user nova-compute[74960]:         <nova:memory>512</nova:memory>
Nov 03 12:26:10 user nova-compute[74960]:         <nova:disk>1</nova:disk>
Nov 03 12:26:10 user nova-compute[74960]:         <nova:swap>0</nova:swap>
Nov 03 12:26:10 user nova-compute[74960]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 12:26:10 user nova-compute[74960]:         <nova:vcpus>1</nova:vcpus>
Nov 03 12:26:10 user nova-compute[74960]:       </nova:flavor>
Nov 03 12:26:10 user nova-compute[74960]:       <nova:owner>
Nov 03 12:26:10 user nova-compute[74960]:         <nova:user uuid="b7080314bc6e400d97bdb4b9bd4071c3">tempest-ServerStableDeviceRescueTest-1015453085-project-member</nova:user>
Nov 03 12:26:10 user nova-compute[74960]:         <nova:project uuid="d039968e1b97457b8fc21b593af4e1ff">tempest-ServerStableDeviceRescueTest-1015453085</nova:project>
Nov 03 12:26:10 user nova-compute[74960]:       </nova:owner>
Nov 03 12:26:10 user nova-compute[74960]:       <nova:root type="image" uuid="549f51ba-ac69-494b-8de1-34635aa2d7cf"/>
Nov 03 12:26:10 user nova-compute[74960]:       <nova:ports>
Nov 03 12:26:10 user nova-compute[74960]:         <nova:port uuid="4b72249c-3aea-415f-83a8-d0498d55674e">
Nov 03 12:26:10 user nova-compute[74960]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 03 12:26:10 user nova-compute[74960]:         </nova:port>
Nov 03 12:26:10 user nova-compute[74960]:       </nova:ports>
Nov 03 12:26:10 user nova-compute[74960]:     </nova:instance>
Nov 03 12:26:10 user nova-compute[74960]:   </metadata>
Nov 03 12:26:10 user nova-compute[74960]:   <sysinfo type="smbios">
Nov 03 12:26:10 user nova-compute[74960]:     <system>
Nov 03 12:26:10 user nova-compute[74960]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 12:26:10 user nova-compute[74960]:       <entry name="product">OpenStack Nova</entry>
Nov 03 12:26:10 user nova-compute[74960]:       <entry name="version">0.0.0</entry>
Nov 03 12:26:10 user nova-compute[74960]:       <entry name="serial">f009a400-0576-48a9-82e0-60de8935c498</entry>
Nov 03 12:26:10 user nova-compute[74960]:       <entry name="uuid">f009a400-0576-48a9-82e0-60de8935c498</entry>
Nov 03 12:26:10 user nova-compute[74960]:       <entry name="family">Virtual Machine</entry>
Nov 03 12:26:10 user nova-compute[74960]:     </system>
Nov 03 12:26:10 user nova-compute[74960]:   </sysinfo>
Nov 03 12:26:10 user nova-compute[74960]:   <os>
Nov 03 12:26:10 user nova-compute[74960]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 12:26:10 user nova-compute[74960]:     <smbios mode="sysinfo"/>
Nov 03 12:26:10 user nova-compute[74960]:   </os>
Nov 03 12:26:10 user nova-compute[74960]:   <features>
Nov 03 12:26:10 user nova-compute[74960]:     <acpi/>
Nov 03 12:26:10 user nova-compute[74960]:     <apic/>
Nov 03 12:26:10 user nova-compute[74960]:     <vmcoreinfo/>
Nov 03 12:26:10 user nova-compute[74960]:   </features>
Nov 03 12:26:10 user nova-compute[74960]:   <clock offset="utc">
Nov 03 12:26:10 user nova-compute[74960]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 12:26:10 user nova-compute[74960]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 12:26:10 user nova-compute[74960]:     <timer name="hpet" present="no"/>
Nov 03 12:26:10 user nova-compute[74960]:   </clock>
Nov 03 12:26:10 user nova-compute[74960]:   <cpu mode="custom" match="exact">
Nov 03 12:26:10 user nova-compute[74960]:     <model>Nehalem</model>
Nov 03 12:26:10 user nova-compute[74960]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 12:26:10 user nova-compute[74960]:   </cpu>
Nov 03 12:26:10 user nova-compute[74960]:   <devices>
Nov 03 12:26:10 user nova-compute[74960]:     <disk type="file" device="disk">
Nov 03 12:26:10 user nova-compute[74960]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 12:26:10 user nova-compute[74960]:       <source file="/opt/stack/data/nova/instances/f009a400-0576-48a9-82e0-60de8935c498/disk"/>
Nov 03 12:26:10 user nova-compute[74960]:       <target dev="vda" bus="virtio"/>
Nov 03 12:26:10 user nova-compute[74960]:     </disk>
Nov 03 12:26:10 user nova-compute[74960]:     <disk type="block" device="disk">
Nov 03 12:26:10 user nova-compute[74960]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 12:26:10 user nova-compute[74960]:       <source dev="/dev/sdf"/>
Nov 03 12:26:10 user nova-compute[74960]:       <target dev="vdb" bus="virtio"/>
Nov 03 12:26:10 user nova-compute[74960]:       <serial>9101c521-a24b-4b03-b2b1-d73585222815</serial>
Nov 03 12:26:10 user nova-compute[74960]:     </disk>
Nov 03 12:26:10 user nova-compute[74960]:     <disk type="file" device="disk">
Nov 03 12:26:10 user nova-compute[74960]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 12:26:10 user nova-compute[74960]:       <source file="/opt/stack/data/nova/instances/f009a400-0576-48a9-82e0-60de8935c498/disk.rescue"/>
Nov 03 12:26:10 user nova-compute[74960]:       <target dev="vdc" bus="virtio"/>
Nov 03 12:26:10 user nova-compute[74960]:       <boot order="1"/>
Nov 03 12:26:10 user nova-compute[74960]:     </disk>
Nov 03 12:26:10 user nova-compute[74960]:     <interface type="ethernet">
Nov 03 12:26:10 user nova-compute[74960]:       <mac address="fa:16:3e:81:8a:f6"/>
Nov 03 12:26:10 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:26:10 user nova-compute[74960]:       <mtu size="1442"/>
Nov 03 12:26:10 user nova-compute[74960]:       <target dev="tap4b72249c-3a"/>
Nov 03 12:26:10 user nova-compute[74960]:     </interface>
Nov 03 12:26:10 user nova-compute[74960]:     <serial type="pty">
Nov 03 12:26:10 user nova-compute[74960]:       <log file="/opt/stack/data/nova/instances/f009a400-0576-48a9-82e0-60de8935c498/console.log" append="off"/>
Nov 03 12:26:10 user nova-compute[74960]:     </serial>
Nov 03 12:26:10 user nova-compute[74960]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 12:26:10 user nova-compute[74960]:     <video>
Nov 03 12:26:10 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:26:10 user nova-compute[74960]:     </video>
Nov 03 12:26:10 user nova-compute[74960]:     <rng model="virtio">
Nov 03 12:26:10 user nova-compute[74960]:       <backend model="random">/dev/urandom</backend>
Nov 03 12:26:10 user nova-compute[74960]:     </rng>
Nov 03 12:26:10 user nova-compute[74960]:     <controller type="usb" index="0" model="none"/>
Nov 03 12:26:10 user nova-compute[74960]:     <memballoon model="virtio">
Nov 03 12:26:10 user nova-compute[74960]:       <stats period="10"/>
Nov 03 12:26:10 user nova-compute[74960]:     </memballoon>
Nov 03 12:26:10 user nova-compute[74960]:   </devices>
Nov 03 12:26:10 user nova-compute[74960]: </domain>
Nov 03 12:26:10 user nova-compute[74960]:  {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 12:26:10 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: f009a400-0576-48a9-82e0-60de8935c498] Instance destroyed successfully.
Nov 03 12:26:10 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-7f78f9f5-2a2f-41be-9c0e-04000fc5693d tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] No BDM found with device name vda, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:26:10 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-7f78f9f5-2a2f-41be-9c0e-04000fc5693d tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:26:10 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-7f78f9f5-2a2f-41be-9c0e-04000fc5693d tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:26:10 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-7f78f9f5-2a2f-41be-9c0e-04000fc5693d tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] No VIF found with MAC fa:16:3e:81:8a:f6, not building metadata {{(pid=74960) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 12:26:11 user nova-compute[74960]: DEBUG nova.compute.manager [req-82d7798e-5c5d-49ec-876d-80d8dac8e911 req-ef4d721a-21d9-4f35-8c01-153ae248eb4c service nova] [instance: e6cbb630-254f-4c56-9cf9-47d751c703be] Received event network-changed-b5f672c1-3298-4c5a-bf4d-7c712e4c5873 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:26:11 user nova-compute[74960]: DEBUG nova.compute.manager [req-82d7798e-5c5d-49ec-876d-80d8dac8e911 req-ef4d721a-21d9-4f35-8c01-153ae248eb4c service nova] [instance: e6cbb630-254f-4c56-9cf9-47d751c703be] Refreshing instance network info cache due to event network-changed-b5f672c1-3298-4c5a-bf4d-7c712e4c5873. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 12:26:11 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-82d7798e-5c5d-49ec-876d-80d8dac8e911 req-ef4d721a-21d9-4f35-8c01-153ae248eb4c service nova] Acquiring lock "refresh_cache-e6cbb630-254f-4c56-9cf9-47d751c703be" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:26:11 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-82d7798e-5c5d-49ec-876d-80d8dac8e911 req-ef4d721a-21d9-4f35-8c01-153ae248eb4c service nova] Acquired lock "refresh_cache-e6cbb630-254f-4c56-9cf9-47d751c703be" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:26:11 user nova-compute[74960]: DEBUG nova.network.neutron [req-82d7798e-5c5d-49ec-876d-80d8dac8e911 req-ef4d721a-21d9-4f35-8c01-153ae248eb4c service nova] [instance: e6cbb630-254f-4c56-9cf9-47d751c703be] Refreshing network info cache for port b5f672c1-3298-4c5a-bf4d-7c712e4c5873 {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 12:26:12 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:12 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:12 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:12 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:12 user nova-compute[74960]: DEBUG nova.network.neutron [req-82d7798e-5c5d-49ec-876d-80d8dac8e911 req-ef4d721a-21d9-4f35-8c01-153ae248eb4c service nova] [instance: e6cbb630-254f-4c56-9cf9-47d751c703be] Updated VIF entry in instance network info cache for port b5f672c1-3298-4c5a-bf4d-7c712e4c5873. {{(pid=74960) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 12:26:12 user nova-compute[74960]: DEBUG nova.network.neutron [req-82d7798e-5c5d-49ec-876d-80d8dac8e911 req-ef4d721a-21d9-4f35-8c01-153ae248eb4c service nova] [instance: e6cbb630-254f-4c56-9cf9-47d751c703be] Updating instance_info_cache with network_info: [{"id": "b5f672c1-3298-4c5a-bf4d-7c712e4c5873", "address": "fa:16:3e:5b:1b:87", "network": {"id": "c03e854d-75a3-4e81-9cdf-f1139841266c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1632999031-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c216dd7629274eafbf0a5968ff2378a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f672c1-32", "ovs_interfaceid": "b5f672c1-3298-4c5a-bf4d-7c712e4c5873", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:26:12 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-82d7798e-5c5d-49ec-876d-80d8dac8e911 req-ef4d721a-21d9-4f35-8c01-153ae248eb4c service nova] Releasing lock "refresh_cache-e6cbb630-254f-4c56-9cf9-47d751c703be" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:26:12 user nova-compute[74960]: DEBUG nova.compute.manager [req-e67e10a0-9cb0-4a90-bfd1-0f768b04b026 req-ad9ec438-7b26-4de7-b70e-be90495d4664 service nova] [instance: f009a400-0576-48a9-82e0-60de8935c498] Received event network-vif-plugged-4b72249c-3aea-415f-83a8-d0498d55674e {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:26:12 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-e67e10a0-9cb0-4a90-bfd1-0f768b04b026 req-ad9ec438-7b26-4de7-b70e-be90495d4664 service nova] Acquiring lock "f009a400-0576-48a9-82e0-60de8935c498-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:26:12 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-e67e10a0-9cb0-4a90-bfd1-0f768b04b026 req-ad9ec438-7b26-4de7-b70e-be90495d4664 service nova] Lock "f009a400-0576-48a9-82e0-60de8935c498-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:26:12 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-e67e10a0-9cb0-4a90-bfd1-0f768b04b026 req-ad9ec438-7b26-4de7-b70e-be90495d4664 service nova] Lock "f009a400-0576-48a9-82e0-60de8935c498-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:26:12 user nova-compute[74960]: DEBUG nova.compute.manager [req-e67e10a0-9cb0-4a90-bfd1-0f768b04b026 req-ad9ec438-7b26-4de7-b70e-be90495d4664 service nova] [instance: f009a400-0576-48a9-82e0-60de8935c498] No waiting events found dispatching network-vif-plugged-4b72249c-3aea-415f-83a8-d0498d55674e {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:26:12 user nova-compute[74960]: WARNING nova.compute.manager [req-e67e10a0-9cb0-4a90-bfd1-0f768b04b026 req-ad9ec438-7b26-4de7-b70e-be90495d4664 service nova] [instance: f009a400-0576-48a9-82e0-60de8935c498] Received unexpected event network-vif-plugged-4b72249c-3aea-415f-83a8-d0498d55674e for instance with vm_state active and task_state rescuing.
Nov 03 12:26:12 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:13 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:13 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:13 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:13 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:14 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:14 user nova-compute[74960]: DEBUG nova.compute.manager [req-d686cba6-c22b-4676-a252-525e3b0b46ba req-423d56a3-4dec-4cf6-b7c8-abab039d8348 service nova] [instance: f009a400-0576-48a9-82e0-60de8935c498] Received event network-vif-plugged-4b72249c-3aea-415f-83a8-d0498d55674e {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:26:14 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-d686cba6-c22b-4676-a252-525e3b0b46ba req-423d56a3-4dec-4cf6-b7c8-abab039d8348 service nova] Acquiring lock "f009a400-0576-48a9-82e0-60de8935c498-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:26:14 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-d686cba6-c22b-4676-a252-525e3b0b46ba req-423d56a3-4dec-4cf6-b7c8-abab039d8348 service nova] Lock "f009a400-0576-48a9-82e0-60de8935c498-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:26:14 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-d686cba6-c22b-4676-a252-525e3b0b46ba req-423d56a3-4dec-4cf6-b7c8-abab039d8348 service nova] Lock "f009a400-0576-48a9-82e0-60de8935c498-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:26:14 user nova-compute[74960]: DEBUG nova.compute.manager [req-d686cba6-c22b-4676-a252-525e3b0b46ba req-423d56a3-4dec-4cf6-b7c8-abab039d8348 service nova] [instance: f009a400-0576-48a9-82e0-60de8935c498] No waiting events found dispatching network-vif-plugged-4b72249c-3aea-415f-83a8-d0498d55674e {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:26:14 user nova-compute[74960]: WARNING nova.compute.manager [req-d686cba6-c22b-4676-a252-525e3b0b46ba req-423d56a3-4dec-4cf6-b7c8-abab039d8348 service nova] [instance: f009a400-0576-48a9-82e0-60de8935c498] Received unexpected event network-vif-plugged-4b72249c-3aea-415f-83a8-d0498d55674e for instance with vm_state active and task_state rescuing.
Nov 03 12:26:14 user nova-compute[74960]: DEBUG nova.compute.manager [None req-7f78f9f5-2a2f-41be-9c0e-04000fc5693d tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] [instance: f009a400-0576-48a9-82e0-60de8935c498] Checking state {{(pid=74960) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 12:26:16 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-edf4fb1f-c31f-4a3d-8108-8101383b7170 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Acquiring lock "be38c803-d97c-4939-9852-e8db1c44bb65" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:26:16 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-edf4fb1f-c31f-4a3d-8108-8101383b7170 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Lock "be38c803-d97c-4939-9852-e8db1c44bb65" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:26:16 user nova-compute[74960]: DEBUG nova.compute.manager [None req-edf4fb1f-c31f-4a3d-8108-8101383b7170 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] [instance: be38c803-d97c-4939-9852-e8db1c44bb65] Starting instance... {{(pid=74960) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 12:26:16 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-edf4fb1f-c31f-4a3d-8108-8101383b7170 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:26:16 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-edf4fb1f-c31f-4a3d-8108-8101383b7170 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:26:16 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-edf4fb1f-c31f-4a3d-8108-8101383b7170 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74960) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 12:26:16 user nova-compute[74960]: INFO nova.compute.claims [None req-edf4fb1f-c31f-4a3d-8108-8101383b7170 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] [instance: be38c803-d97c-4939-9852-e8db1c44bb65] Claim successful on node user
Nov 03 12:26:17 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-edf4fb1f-c31f-4a3d-8108-8101383b7170 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:26:17 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-edf4fb1f-c31f-4a3d-8108-8101383b7170 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:26:17 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-edf4fb1f-c31f-4a3d-8108-8101383b7170 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.543s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:26:17 user nova-compute[74960]: DEBUG nova.compute.manager [None req-edf4fb1f-c31f-4a3d-8108-8101383b7170 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] [instance: be38c803-d97c-4939-9852-e8db1c44bb65] Start building networks asynchronously for instance. {{(pid=74960) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 12:26:17 user nova-compute[74960]: DEBUG nova.compute.manager [None req-edf4fb1f-c31f-4a3d-8108-8101383b7170 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] [instance: be38c803-d97c-4939-9852-e8db1c44bb65] Allocating IP information in the background. {{(pid=74960) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 12:26:17 user nova-compute[74960]: DEBUG nova.network.neutron [None req-edf4fb1f-c31f-4a3d-8108-8101383b7170 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] [instance: be38c803-d97c-4939-9852-e8db1c44bb65] allocate_for_instance() {{(pid=74960) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 12:26:17 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-edf4fb1f-c31f-4a3d-8108-8101383b7170 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] [instance: be38c803-d97c-4939-9852-e8db1c44bb65] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 12:26:17 user nova-compute[74960]: DEBUG nova.compute.manager [None req-edf4fb1f-c31f-4a3d-8108-8101383b7170 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] [instance: be38c803-d97c-4939-9852-e8db1c44bb65] Start building block device mappings for instance. {{(pid=74960) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 12:26:17 user nova-compute[74960]: DEBUG nova.policy [None req-edf4fb1f-c31f-4a3d-8108-8101383b7170 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1c9880db5b784aadaeba7492523df5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4a374c1c544718887bd75b77a72a3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74960) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 12:26:17 user nova-compute[74960]: DEBUG nova.compute.manager [None req-edf4fb1f-c31f-4a3d-8108-8101383b7170 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] [instance: be38c803-d97c-4939-9852-e8db1c44bb65] Start spawning the instance on the hypervisor. {{(pid=74960) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 12:26:17 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-edf4fb1f-c31f-4a3d-8108-8101383b7170 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] [instance: be38c803-d97c-4939-9852-e8db1c44bb65] Creating instance directory {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 12:26:17 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-edf4fb1f-c31f-4a3d-8108-8101383b7170 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] [instance: be38c803-d97c-4939-9852-e8db1c44bb65] Creating image(s)
Nov 03 12:26:17 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-edf4fb1f-c31f-4a3d-8108-8101383b7170 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Acquiring lock "/opt/stack/data/nova/instances/be38c803-d97c-4939-9852-e8db1c44bb65/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:26:17 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-edf4fb1f-c31f-4a3d-8108-8101383b7170 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Lock "/opt/stack/data/nova/instances/be38c803-d97c-4939-9852-e8db1c44bb65/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:26:17 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-edf4fb1f-c31f-4a3d-8108-8101383b7170 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Lock "/opt/stack/data/nova/instances/be38c803-d97c-4939-9852-e8db1c44bb65/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:26:17 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-edf4fb1f-c31f-4a3d-8108-8101383b7170 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Acquiring lock "21782977f2ca10f55b0849c8717736f9d23ded60" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:26:17 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-edf4fb1f-c31f-4a3d-8108-8101383b7170 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Lock "21782977f2ca10f55b0849c8717736f9d23ded60" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:26:18 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-edf4fb1f-c31f-4a3d-8108-8101383b7170 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21782977f2ca10f55b0849c8717736f9d23ded60.part --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:26:18 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:18 user nova-compute[74960]: DEBUG nova.network.neutron [None req-edf4fb1f-c31f-4a3d-8108-8101383b7170 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] [instance: be38c803-d97c-4939-9852-e8db1c44bb65] Successfully created port: b70bcefe-a1cc-4f5c-98f6-3d6914d66a9b {{(pid=74960) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 12:26:18 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-edf4fb1f-c31f-4a3d-8108-8101383b7170 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21782977f2ca10f55b0849c8717736f9d23ded60.part --force-share --output=json" returned: 0 in 0.184s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:26:18 user nova-compute[74960]: DEBUG nova.virt.images [None req-edf4fb1f-c31f-4a3d-8108-8101383b7170 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] fb9c8513-58b6-4564-a720-c65a023a5977 was qcow2, converting to raw {{(pid=74960) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 03 12:26:18 user nova-compute[74960]: DEBUG nova.privsep.utils [None req-edf4fb1f-c31f-4a3d-8108-8101383b7170 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74960) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 03 12:26:18 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-edf4fb1f-c31f-4a3d-8108-8101383b7170 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/21782977f2ca10f55b0849c8717736f9d23ded60.part /opt/stack/data/nova/instances/_base/21782977f2ca10f55b0849c8717736f9d23ded60.converted {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:26:18 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-edf4fb1f-c31f-4a3d-8108-8101383b7170 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/21782977f2ca10f55b0849c8717736f9d23ded60.part /opt/stack/data/nova/instances/_base/21782977f2ca10f55b0849c8717736f9d23ded60.converted" returned: 0 in 0.191s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:26:18 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-edf4fb1f-c31f-4a3d-8108-8101383b7170 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21782977f2ca10f55b0849c8717736f9d23ded60.converted --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:26:18 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-edf4fb1f-c31f-4a3d-8108-8101383b7170 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21782977f2ca10f55b0849c8717736f9d23ded60.converted --force-share --output=json" returned: 0 in 0.196s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:26:18 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-edf4fb1f-c31f-4a3d-8108-8101383b7170 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Lock "21782977f2ca10f55b0849c8717736f9d23ded60" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.105s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:26:18 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-edf4fb1f-c31f-4a3d-8108-8101383b7170 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21782977f2ca10f55b0849c8717736f9d23ded60 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:26:19 user nova-compute[74960]: DEBUG nova.network.neutron [None req-edf4fb1f-c31f-4a3d-8108-8101383b7170 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] [instance: be38c803-d97c-4939-9852-e8db1c44bb65] Successfully updated port: b70bcefe-a1cc-4f5c-98f6-3d6914d66a9b {{(pid=74960) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 12:26:19 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-edf4fb1f-c31f-4a3d-8108-8101383b7170 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21782977f2ca10f55b0849c8717736f9d23ded60 --force-share --output=json" returned: 0 in 0.218s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:26:19 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-edf4fb1f-c31f-4a3d-8108-8101383b7170 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Acquiring lock "21782977f2ca10f55b0849c8717736f9d23ded60" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:26:19 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-edf4fb1f-c31f-4a3d-8108-8101383b7170 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Lock "21782977f2ca10f55b0849c8717736f9d23ded60" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:26:19 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-edf4fb1f-c31f-4a3d-8108-8101383b7170 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21782977f2ca10f55b0849c8717736f9d23ded60 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:26:19 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:19 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-edf4fb1f-c31f-4a3d-8108-8101383b7170 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Acquiring lock "refresh_cache-be38c803-d97c-4939-9852-e8db1c44bb65" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:26:19 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-edf4fb1f-c31f-4a3d-8108-8101383b7170 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Acquired lock "refresh_cache-be38c803-d97c-4939-9852-e8db1c44bb65" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:26:19 user nova-compute[74960]: DEBUG nova.network.neutron [None req-edf4fb1f-c31f-4a3d-8108-8101383b7170 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] [instance: be38c803-d97c-4939-9852-e8db1c44bb65] Building network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 12:26:19 user nova-compute[74960]: DEBUG nova.compute.manager [req-327f4e77-0e53-462f-8ee3-0d6e915a6fb1 req-abfd34ea-d6c3-41af-a80d-c1bc6a455589 service nova] [instance: be38c803-d97c-4939-9852-e8db1c44bb65] Received event network-changed-b70bcefe-a1cc-4f5c-98f6-3d6914d66a9b {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:26:19 user nova-compute[74960]: DEBUG nova.compute.manager [req-327f4e77-0e53-462f-8ee3-0d6e915a6fb1 req-abfd34ea-d6c3-41af-a80d-c1bc6a455589 service nova] [instance: be38c803-d97c-4939-9852-e8db1c44bb65] Refreshing instance network info cache due to event network-changed-b70bcefe-a1cc-4f5c-98f6-3d6914d66a9b. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 12:26:19 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-327f4e77-0e53-462f-8ee3-0d6e915a6fb1 req-abfd34ea-d6c3-41af-a80d-c1bc6a455589 service nova] Acquiring lock "refresh_cache-be38c803-d97c-4939-9852-e8db1c44bb65" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:26:19 user nova-compute[74960]: DEBUG nova.network.neutron [None req-edf4fb1f-c31f-4a3d-8108-8101383b7170 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] [instance: be38c803-d97c-4939-9852-e8db1c44bb65] Instance cache missing network info. {{(pid=74960) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 12:26:19 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-edf4fb1f-c31f-4a3d-8108-8101383b7170 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21782977f2ca10f55b0849c8717736f9d23ded60 --force-share --output=json" returned: 0 in 0.211s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:26:19 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-edf4fb1f-c31f-4a3d-8108-8101383b7170 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/21782977f2ca10f55b0849c8717736f9d23ded60,backing_fmt=raw /opt/stack/data/nova/instances/be38c803-d97c-4939-9852-e8db1c44bb65/disk 1073741824 {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:26:19 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-edf4fb1f-c31f-4a3d-8108-8101383b7170 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/21782977f2ca10f55b0849c8717736f9d23ded60,backing_fmt=raw /opt/stack/data/nova/instances/be38c803-d97c-4939-9852-e8db1c44bb65/disk 1073741824" returned: 0 in 0.091s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:26:19 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-edf4fb1f-c31f-4a3d-8108-8101383b7170 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Lock "21782977f2ca10f55b0849c8717736f9d23ded60" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.307s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:26:19 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-edf4fb1f-c31f-4a3d-8108-8101383b7170 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21782977f2ca10f55b0849c8717736f9d23ded60 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:26:19 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-3061a957-d1f4-479d-962a-b55d066e6236 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Acquiring lock "e6cbb630-254f-4c56-9cf9-47d751c703be" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:26:19 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-3061a957-d1f4-479d-962a-b55d066e6236 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Lock "e6cbb630-254f-4c56-9cf9-47d751c703be" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:26:19 user nova-compute[74960]: INFO nova.compute.manager [None req-3061a957-d1f4-479d-962a-b55d066e6236 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: e6cbb630-254f-4c56-9cf9-47d751c703be] Shelving
Nov 03 12:26:19 user nova-compute[74960]: DEBUG nova.network.neutron [None req-edf4fb1f-c31f-4a3d-8108-8101383b7170 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] [instance: be38c803-d97c-4939-9852-e8db1c44bb65] Updating instance_info_cache with network_info: [{"id": "b70bcefe-a1cc-4f5c-98f6-3d6914d66a9b", "address": "fa:16:3e:3f:59:21", "network": {"id": "b3813163-d09b-4c0b-a328-1bbb4c7e2875", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1681555035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d4a374c1c544718887bd75b77a72a3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb70bcefe-a1", "ovs_interfaceid": "b70bcefe-a1cc-4f5c-98f6-3d6914d66a9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:26:19 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-edf4fb1f-c31f-4a3d-8108-8101383b7170 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Releasing lock "refresh_cache-be38c803-d97c-4939-9852-e8db1c44bb65" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:26:19 user nova-compute[74960]: DEBUG nova.compute.manager [None req-edf4fb1f-c31f-4a3d-8108-8101383b7170 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] [instance: be38c803-d97c-4939-9852-e8db1c44bb65] Instance network_info: |[{"id": "b70bcefe-a1cc-4f5c-98f6-3d6914d66a9b", "address": "fa:16:3e:3f:59:21", "network": {"id": "b3813163-d09b-4c0b-a328-1bbb4c7e2875", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1681555035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d4a374c1c544718887bd75b77a72a3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb70bcefe-a1", "ovs_interfaceid": "b70bcefe-a1cc-4f5c-98f6-3d6914d66a9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74960) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 12:26:19 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-327f4e77-0e53-462f-8ee3-0d6e915a6fb1 req-abfd34ea-d6c3-41af-a80d-c1bc6a455589 service nova] Acquired lock "refresh_cache-be38c803-d97c-4939-9852-e8db1c44bb65" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:26:19 user nova-compute[74960]: DEBUG nova.network.neutron [req-327f4e77-0e53-462f-8ee3-0d6e915a6fb1 req-abfd34ea-d6c3-41af-a80d-c1bc6a455589 service nova] [instance: be38c803-d97c-4939-9852-e8db1c44bb65] Refreshing network info cache for port b70bcefe-a1cc-4f5c-98f6-3d6914d66a9b {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 12:26:19 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:19 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-edf4fb1f-c31f-4a3d-8108-8101383b7170 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21782977f2ca10f55b0849c8717736f9d23ded60 --force-share --output=json" returned: 0 in 0.269s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:26:19 user nova-compute[74960]: DEBUG nova.virt.disk.api [None req-edf4fb1f-c31f-4a3d-8108-8101383b7170 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Checking if we can resize image /opt/stack/data/nova/instances/be38c803-d97c-4939-9852-e8db1c44bb65/disk. size=1073741824 {{(pid=74960) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 12:26:19 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-edf4fb1f-c31f-4a3d-8108-8101383b7170 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be38c803-d97c-4939-9852-e8db1c44bb65/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:26:19 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:19 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:19 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-edf4fb1f-c31f-4a3d-8108-8101383b7170 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be38c803-d97c-4939-9852-e8db1c44bb65/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:26:19 user nova-compute[74960]: DEBUG nova.virt.disk.api [None req-edf4fb1f-c31f-4a3d-8108-8101383b7170 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Cannot resize image /opt/stack/data/nova/instances/be38c803-d97c-4939-9852-e8db1c44bb65/disk to a smaller size. {{(pid=74960) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 12:26:19 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-edf4fb1f-c31f-4a3d-8108-8101383b7170 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] [instance: be38c803-d97c-4939-9852-e8db1c44bb65] Created local disks {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 12:26:19 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-edf4fb1f-c31f-4a3d-8108-8101383b7170 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] [instance: be38c803-d97c-4939-9852-e8db1c44bb65] Ensure instance console log exists: /opt/stack/data/nova/instances/be38c803-d97c-4939-9852-e8db1c44bb65/console.log {{(pid=74960) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 12:26:19 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-edf4fb1f-c31f-4a3d-8108-8101383b7170 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:26:19 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-edf4fb1f-c31f-4a3d-8108-8101383b7170 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:26:19 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-edf4fb1f-c31f-4a3d-8108-8101383b7170 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:26:19 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-edf4fb1f-c31f-4a3d-8108-8101383b7170 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] [instance: be38c803-d97c-4939-9852-e8db1c44bb65] Start _get_guest_xml network_info=[{"id": "b70bcefe-a1cc-4f5c-98f6-3d6914d66a9b", "address": "fa:16:3e:3f:59:21", "network": {"id": "b3813163-d09b-4c0b-a328-1bbb4c7e2875", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1681555035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d4a374c1c544718887bd75b77a72a3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb70bcefe-a1", "ovs_interfaceid": "b70bcefe-a1cc-4f5c-98f6-3d6914d66a9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T12:26:13Z,direct_url=<?>,disk_format='qcow2',id=fb9c8513-58b6-4564-a720-c65a023a5977,min_disk=0,min_ram=0,name='tempest-scenario-img--579178950',owner='9d4a374c1c544718887bd75b77a72a3a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T12:26:15Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'image_id': 'fb9c8513-58b6-4564-a720-c65a023a5977'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 12:26:19 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-edf4fb1f-c31f-4a3d-8108-8101383b7170 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:26:19 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-edf4fb1f-c31f-4a3d-8108-8101383b7170 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:26:19 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-edf4fb1f-c31f-4a3d-8108-8101383b7170 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 12:26:19 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-edf4fb1f-c31f-4a3d-8108-8101383b7170 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] CPU controller missing on host. {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 12:26:19 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-edf4fb1f-c31f-4a3d-8108-8101383b7170 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 12:26:19 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-edf4fb1f-c31f-4a3d-8108-8101383b7170 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] CPU controller found on host. {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 12:26:19 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-edf4fb1f-c31f-4a3d-8108-8101383b7170 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74960) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 12:26:19 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-edf4fb1f-c31f-4a3d-8108-8101383b7170 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T12:26:13Z,direct_url=<?>,disk_format='qcow2',id=fb9c8513-58b6-4564-a720-c65a023a5977,min_disk=0,min_ram=0,name='tempest-scenario-img--579178950',owner='9d4a374c1c544718887bd75b77a72a3a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T12:26:15Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 12:26:19 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-edf4fb1f-c31f-4a3d-8108-8101383b7170 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Flavor limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 12:26:19 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-edf4fb1f-c31f-4a3d-8108-8101383b7170 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Image limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 12:26:19 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-edf4fb1f-c31f-4a3d-8108-8101383b7170 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Flavor pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 12:26:19 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-edf4fb1f-c31f-4a3d-8108-8101383b7170 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Image pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 12:26:19 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-edf4fb1f-c31f-4a3d-8108-8101383b7170 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 12:26:19 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-edf4fb1f-c31f-4a3d-8108-8101383b7170 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 12:26:19 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-edf4fb1f-c31f-4a3d-8108-8101383b7170 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 12:26:19 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-edf4fb1f-c31f-4a3d-8108-8101383b7170 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Got 1 possible topologies {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 12:26:19 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-edf4fb1f-c31f-4a3d-8108-8101383b7170 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 12:26:19 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-edf4fb1f-c31f-4a3d-8108-8101383b7170 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 12:26:19 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-edf4fb1f-c31f-4a3d-8108-8101383b7170 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:26:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1085803212',display_name='tempest-TestMinimumBasicScenario-server-1085803212',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1085803212',id=22,image_ref='fb9c8513-58b6-4564-a720-c65a023a5977',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJyvc843+/PbK161410wXm+upnPhpb+kaHvjFoC5mB+vplUJNwSiHz6MEOZaIfZMr/BVqOZF9VNBe4y4XXUpwhvUlOjeq2DLlkq8xy5NZbFAMIKTFs1bBhh11b2OsO2jjQ==',key_name='tempest-TestMinimumBasicScenario-859556410',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d4a374c1c544718887bd75b77a72a3a',ramdisk_id='',reservation_id='r-vhqahztr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fb9c8513-58b6-4564-a720-c65a023a5977',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-585836766',owner_user_name='tempest-TestMinimumBasicScenario-585836766-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:26:18Z,user_data=None,user_id='1c9880db5b784aadaeba7492523df5e8',uuid=be38c803-d97c-4939-9852-e8db1c44bb65,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b70bcefe-a1cc-4f5c-98f6-3d6914d66a9b", "address": "fa:16:3e:3f:59:21", "network": {"id": "b3813163-d09b-4c0b-a328-1bbb4c7e2875", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1681555035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d4a374c1c544718887bd75b77a72a3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb70bcefe-a1", "ovs_interfaceid": "b70bcefe-a1cc-4f5c-98f6-3d6914d66a9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74960) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 12:26:19 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-edf4fb1f-c31f-4a3d-8108-8101383b7170 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Converting VIF {"id": "b70bcefe-a1cc-4f5c-98f6-3d6914d66a9b", "address": "fa:16:3e:3f:59:21", "network": {"id": "b3813163-d09b-4c0b-a328-1bbb4c7e2875", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1681555035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d4a374c1c544718887bd75b77a72a3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb70bcefe-a1", "ovs_interfaceid": "b70bcefe-a1cc-4f5c-98f6-3d6914d66a9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:26:19 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-edf4fb1f-c31f-4a3d-8108-8101383b7170 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:59:21,bridge_name='br-int',has_traffic_filtering=True,id=b70bcefe-a1cc-4f5c-98f6-3d6914d66a9b,network=Network(b3813163-d09b-4c0b-a328-1bbb4c7e2875),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb70bcefe-a1') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:26:19 user nova-compute[74960]: DEBUG nova.objects.instance [None req-edf4fb1f-c31f-4a3d-8108-8101383b7170 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Lazy-loading 'pci_devices' on Instance uuid be38c803-d97c-4939-9852-e8db1c44bb65 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:26:19 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-edf4fb1f-c31f-4a3d-8108-8101383b7170 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] [instance: be38c803-d97c-4939-9852-e8db1c44bb65] End _get_guest_xml xml=<domain type="kvm">
Nov 03 12:26:19 user nova-compute[74960]:   <uuid>be38c803-d97c-4939-9852-e8db1c44bb65</uuid>
Nov 03 12:26:19 user nova-compute[74960]:   <name>instance-00000016</name>
Nov 03 12:26:19 user nova-compute[74960]:   <memory>524288</memory>
Nov 03 12:26:19 user nova-compute[74960]:   <vcpu>1</vcpu>
Nov 03 12:26:19 user nova-compute[74960]:   <metadata>
Nov 03 12:26:19 user nova-compute[74960]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 12:26:19 user nova-compute[74960]:       <nova:package version="0.0.0"/>
Nov 03 12:26:19 user nova-compute[74960]:       <nova:name>tempest-TestMinimumBasicScenario-server-1085803212</nova:name>
Nov 03 12:26:19 user nova-compute[74960]:       <nova:creationTime>2023-11-03 12:26:19</nova:creationTime>
Nov 03 12:26:19 user nova-compute[74960]:       <nova:flavor name="m1.tiny">
Nov 03 12:26:19 user nova-compute[74960]:         <nova:memory>512</nova:memory>
Nov 03 12:26:19 user nova-compute[74960]:         <nova:disk>1</nova:disk>
Nov 03 12:26:19 user nova-compute[74960]:         <nova:swap>0</nova:swap>
Nov 03 12:26:19 user nova-compute[74960]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 12:26:19 user nova-compute[74960]:         <nova:vcpus>1</nova:vcpus>
Nov 03 12:26:19 user nova-compute[74960]:       </nova:flavor>
Nov 03 12:26:19 user nova-compute[74960]:       <nova:owner>
Nov 03 12:26:19 user nova-compute[74960]:         <nova:user uuid="1c9880db5b784aadaeba7492523df5e8">tempest-TestMinimumBasicScenario-585836766-project-member</nova:user>
Nov 03 12:26:19 user nova-compute[74960]:         <nova:project uuid="9d4a374c1c544718887bd75b77a72a3a">tempest-TestMinimumBasicScenario-585836766</nova:project>
Nov 03 12:26:19 user nova-compute[74960]:       </nova:owner>
Nov 03 12:26:19 user nova-compute[74960]:       <nova:root type="image" uuid="fb9c8513-58b6-4564-a720-c65a023a5977"/>
Nov 03 12:26:19 user nova-compute[74960]:       <nova:ports>
Nov 03 12:26:19 user nova-compute[74960]:         <nova:port uuid="b70bcefe-a1cc-4f5c-98f6-3d6914d66a9b">
Nov 03 12:26:19 user nova-compute[74960]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 03 12:26:19 user nova-compute[74960]:         </nova:port>
Nov 03 12:26:19 user nova-compute[74960]:       </nova:ports>
Nov 03 12:26:19 user nova-compute[74960]:     </nova:instance>
Nov 03 12:26:19 user nova-compute[74960]:   </metadata>
Nov 03 12:26:19 user nova-compute[74960]:   <sysinfo type="smbios">
Nov 03 12:26:19 user nova-compute[74960]:     <system>
Nov 03 12:26:19 user nova-compute[74960]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 12:26:19 user nova-compute[74960]:       <entry name="product">OpenStack Nova</entry>
Nov 03 12:26:19 user nova-compute[74960]:       <entry name="version">0.0.0</entry>
Nov 03 12:26:19 user nova-compute[74960]:       <entry name="serial">be38c803-d97c-4939-9852-e8db1c44bb65</entry>
Nov 03 12:26:19 user nova-compute[74960]:       <entry name="uuid">be38c803-d97c-4939-9852-e8db1c44bb65</entry>
Nov 03 12:26:19 user nova-compute[74960]:       <entry name="family">Virtual Machine</entry>
Nov 03 12:26:19 user nova-compute[74960]:     </system>
Nov 03 12:26:19 user nova-compute[74960]:   </sysinfo>
Nov 03 12:26:19 user nova-compute[74960]:   <os>
Nov 03 12:26:19 user nova-compute[74960]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 12:26:19 user nova-compute[74960]:     <boot dev="hd"/>
Nov 03 12:26:19 user nova-compute[74960]:     <smbios mode="sysinfo"/>
Nov 03 12:26:19 user nova-compute[74960]:   </os>
Nov 03 12:26:19 user nova-compute[74960]:   <features>
Nov 03 12:26:19 user nova-compute[74960]:     <acpi/>
Nov 03 12:26:19 user nova-compute[74960]:     <apic/>
Nov 03 12:26:19 user nova-compute[74960]:     <vmcoreinfo/>
Nov 03 12:26:19 user nova-compute[74960]:   </features>
Nov 03 12:26:19 user nova-compute[74960]:   <clock offset="utc">
Nov 03 12:26:19 user nova-compute[74960]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 12:26:19 user nova-compute[74960]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 12:26:19 user nova-compute[74960]:     <timer name="hpet" present="no"/>
Nov 03 12:26:19 user nova-compute[74960]:   </clock>
Nov 03 12:26:19 user nova-compute[74960]:   <cpu mode="custom" match="exact">
Nov 03 12:26:19 user nova-compute[74960]:     <model>Nehalem</model>
Nov 03 12:26:19 user nova-compute[74960]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 12:26:19 user nova-compute[74960]:   </cpu>
Nov 03 12:26:19 user nova-compute[74960]:   <devices>
Nov 03 12:26:19 user nova-compute[74960]:     <disk type="file" device="disk">
Nov 03 12:26:19 user nova-compute[74960]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 12:26:19 user nova-compute[74960]:       <source file="/opt/stack/data/nova/instances/be38c803-d97c-4939-9852-e8db1c44bb65/disk"/>
Nov 03 12:26:19 user nova-compute[74960]:       <target dev="vda" bus="virtio"/>
Nov 03 12:26:19 user nova-compute[74960]:     </disk>
Nov 03 12:26:19 user nova-compute[74960]:     <interface type="ethernet">
Nov 03 12:26:19 user nova-compute[74960]:       <mac address="fa:16:3e:3f:59:21"/>
Nov 03 12:26:19 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:26:19 user nova-compute[74960]:       <mtu size="1442"/>
Nov 03 12:26:19 user nova-compute[74960]:       <target dev="tapb70bcefe-a1"/>
Nov 03 12:26:19 user nova-compute[74960]:     </interface>
Nov 03 12:26:19 user nova-compute[74960]:     <serial type="pty">
Nov 03 12:26:19 user nova-compute[74960]:       <log file="/opt/stack/data/nova/instances/be38c803-d97c-4939-9852-e8db1c44bb65/console.log" append="off"/>
Nov 03 12:26:19 user nova-compute[74960]:     </serial>
Nov 03 12:26:19 user nova-compute[74960]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 12:26:19 user nova-compute[74960]:     <video>
Nov 03 12:26:19 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:26:19 user nova-compute[74960]:     </video>
Nov 03 12:26:19 user nova-compute[74960]:     <rng model="virtio">
Nov 03 12:26:19 user nova-compute[74960]:       <backend model="random">/dev/urandom</backend>
Nov 03 12:26:19 user nova-compute[74960]:     </rng>
Nov 03 12:26:19 user nova-compute[74960]:     <controller type="usb" index="0" model="none"/>
Nov 03 12:26:19 user nova-compute[74960]:     <memballoon model="virtio">
Nov 03 12:26:19 user nova-compute[74960]:       <stats period="10"/>
Nov 03 12:26:19 user nova-compute[74960]:     </memballoon>
Nov 03 12:26:19 user nova-compute[74960]:   </devices>
Nov 03 12:26:19 user nova-compute[74960]: </domain>
Nov 03 12:26:19 user nova-compute[74960]:  {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 12:26:19 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-edf4fb1f-c31f-4a3d-8108-8101383b7170 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:26:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1085803212',display_name='tempest-TestMinimumBasicScenario-server-1085803212',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1085803212',id=22,image_ref='fb9c8513-58b6-4564-a720-c65a023a5977',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJyvc843+/PbK161410wXm+upnPhpb+kaHvjFoC5mB+vplUJNwSiHz6MEOZaIfZMr/BVqOZF9VNBe4y4XXUpwhvUlOjeq2DLlkq8xy5NZbFAMIKTFs1bBhh11b2OsO2jjQ==',key_name='tempest-TestMinimumBasicScenario-859556410',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d4a374c1c544718887bd75b77a72a3a',ramdisk_id='',reservation_id='r-vhqahztr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fb9c8513-58b6-4564-a720-c65a023a5977',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-585836766',owner_user_name='tempest-TestMinimumBasicScenario-585836766-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:26:18Z,user_data=None,user_id='1c9880db5b784aadaeba7492523df5e8',uuid=be38c803-d97c-4939-9852-e8db1c44bb65,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b70bcefe-a1cc-4f5c-98f6-3d6914d66a9b", "address": "fa:16:3e:3f:59:21", "network": {"id": "b3813163-d09b-4c0b-a328-1bbb4c7e2875", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1681555035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d4a374c1c544718887bd75b77a72a3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb70bcefe-a1", "ovs_interfaceid": "b70bcefe-a1cc-4f5c-98f6-3d6914d66a9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 12:26:19 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-edf4fb1f-c31f-4a3d-8108-8101383b7170 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Converting VIF {"id": "b70bcefe-a1cc-4f5c-98f6-3d6914d66a9b", "address": "fa:16:3e:3f:59:21", "network": {"id": "b3813163-d09b-4c0b-a328-1bbb4c7e2875", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1681555035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d4a374c1c544718887bd75b77a72a3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb70bcefe-a1", "ovs_interfaceid": "b70bcefe-a1cc-4f5c-98f6-3d6914d66a9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:26:19 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-edf4fb1f-c31f-4a3d-8108-8101383b7170 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:59:21,bridge_name='br-int',has_traffic_filtering=True,id=b70bcefe-a1cc-4f5c-98f6-3d6914d66a9b,network=Network(b3813163-d09b-4c0b-a328-1bbb4c7e2875),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb70bcefe-a1') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:26:19 user nova-compute[74960]: DEBUG os_vif [None req-edf4fb1f-c31f-4a3d-8108-8101383b7170 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:59:21,bridge_name='br-int',has_traffic_filtering=True,id=b70bcefe-a1cc-4f5c-98f6-3d6914d66a9b,network=Network(b3813163-d09b-4c0b-a328-1bbb4c7e2875),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb70bcefe-a1') {{(pid=74960) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 12:26:19 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:19 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:26:19 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 12:26:19 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:19 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '88d0ddd0-b902-5d6e-a24b-5f95cccf9c72', '_type': 'linux-noop'}}, row=False) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:26:19 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:19 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:26:19 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:20 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:20 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb70bcefe-a1, may_exist=True, interface_attrs={}) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:26:20 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb70bcefe-a1, col_values=(('qos', UUID('01afa5ea-65d9-4296-ac6f-f499fff2d990')),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:26:20 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb70bcefe-a1, col_values=(('external_ids', {'iface-id': 'b70bcefe-a1cc-4f5c-98f6-3d6914d66a9b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3f:59:21', 'vm-uuid': 'be38c803-d97c-4939-9852-e8db1c44bb65'}),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:26:20 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:20 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:26:20 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:20 user nova-compute[74960]: INFO os_vif [None req-edf4fb1f-c31f-4a3d-8108-8101383b7170 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:59:21,bridge_name='br-int',has_traffic_filtering=True,id=b70bcefe-a1cc-4f5c-98f6-3d6914d66a9b,network=Network(b3813163-d09b-4c0b-a328-1bbb4c7e2875),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb70bcefe-a1')
Nov 03 12:26:20 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-edf4fb1f-c31f-4a3d-8108-8101383b7170 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] No BDM found with device name vda, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:26:20 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-edf4fb1f-c31f-4a3d-8108-8101383b7170 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] No VIF found with MAC fa:16:3e:3f:59:21, not building metadata {{(pid=74960) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 12:26:20 user nova-compute[74960]: DEBUG nova.network.neutron [req-327f4e77-0e53-462f-8ee3-0d6e915a6fb1 req-abfd34ea-d6c3-41af-a80d-c1bc6a455589 service nova] [instance: be38c803-d97c-4939-9852-e8db1c44bb65] Updated VIF entry in instance network info cache for port b70bcefe-a1cc-4f5c-98f6-3d6914d66a9b. {{(pid=74960) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 12:26:20 user nova-compute[74960]: DEBUG nova.network.neutron [req-327f4e77-0e53-462f-8ee3-0d6e915a6fb1 req-abfd34ea-d6c3-41af-a80d-c1bc6a455589 service nova] [instance: be38c803-d97c-4939-9852-e8db1c44bb65] Updating instance_info_cache with network_info: [{"id": "b70bcefe-a1cc-4f5c-98f6-3d6914d66a9b", "address": "fa:16:3e:3f:59:21", "network": {"id": "b3813163-d09b-4c0b-a328-1bbb4c7e2875", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1681555035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d4a374c1c544718887bd75b77a72a3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb70bcefe-a1", "ovs_interfaceid": "b70bcefe-a1cc-4f5c-98f6-3d6914d66a9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:26:20 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-327f4e77-0e53-462f-8ee3-0d6e915a6fb1 req-abfd34ea-d6c3-41af-a80d-c1bc6a455589 service nova] Releasing lock "refresh_cache-be38c803-d97c-4939-9852-e8db1c44bb65" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:26:20 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: e6cbb630-254f-4c56-9cf9-47d751c703be] Instance destroyed successfully.
Nov 03 12:26:20 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-3061a957-d1f4-479d-962a-b55d066e6236 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: e6cbb630-254f-4c56-9cf9-47d751c703be] Beginning cold snapshot process
Nov 03 12:26:20 user nova-compute[74960]: DEBUG nova.privsep.utils [None req-3061a957-d1f4-479d-962a-b55d066e6236 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74960) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 03 12:26:20 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-3061a957-d1f4-479d-962a-b55d066e6236 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/e6cbb630-254f-4c56-9cf9-47d751c703be/disk /opt/stack/data/nova/instances/snapshots/tmpcl6343b0/717e5ebfa44441a397f429fc207f61ec {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:26:21 user nova-compute[74960]: DEBUG nova.compute.manager [req-dd8f1312-b3c2-4e87-8c80-830e6305d7a0 req-226daf44-0c94-4185-bed7-c430f6218fcb service nova] [instance: e6cbb630-254f-4c56-9cf9-47d751c703be] Received event network-vif-unplugged-b5f672c1-3298-4c5a-bf4d-7c712e4c5873 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:26:21 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-dd8f1312-b3c2-4e87-8c80-830e6305d7a0 req-226daf44-0c94-4185-bed7-c430f6218fcb service nova] Acquiring lock "e6cbb630-254f-4c56-9cf9-47d751c703be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:26:21 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-dd8f1312-b3c2-4e87-8c80-830e6305d7a0 req-226daf44-0c94-4185-bed7-c430f6218fcb service nova] Lock "e6cbb630-254f-4c56-9cf9-47d751c703be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:26:21 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-dd8f1312-b3c2-4e87-8c80-830e6305d7a0 req-226daf44-0c94-4185-bed7-c430f6218fcb service nova] Lock "e6cbb630-254f-4c56-9cf9-47d751c703be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:26:21 user nova-compute[74960]: DEBUG nova.compute.manager [req-dd8f1312-b3c2-4e87-8c80-830e6305d7a0 req-226daf44-0c94-4185-bed7-c430f6218fcb service nova] [instance: e6cbb630-254f-4c56-9cf9-47d751c703be] No waiting events found dispatching network-vif-unplugged-b5f672c1-3298-4c5a-bf4d-7c712e4c5873 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:26:21 user nova-compute[74960]: WARNING nova.compute.manager [req-dd8f1312-b3c2-4e87-8c80-830e6305d7a0 req-226daf44-0c94-4185-bed7-c430f6218fcb service nova] [instance: e6cbb630-254f-4c56-9cf9-47d751c703be] Received unexpected event network-vif-unplugged-b5f672c1-3298-4c5a-bf4d-7c712e4c5873 for instance with vm_state active and task_state shelving_image_pending_upload.
Nov 03 12:26:21 user nova-compute[74960]: DEBUG nova.compute.manager [req-dd8f1312-b3c2-4e87-8c80-830e6305d7a0 req-226daf44-0c94-4185-bed7-c430f6218fcb service nova] [instance: e6cbb630-254f-4c56-9cf9-47d751c703be] Received event network-vif-plugged-b5f672c1-3298-4c5a-bf4d-7c712e4c5873 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:26:21 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-dd8f1312-b3c2-4e87-8c80-830e6305d7a0 req-226daf44-0c94-4185-bed7-c430f6218fcb service nova] Acquiring lock "e6cbb630-254f-4c56-9cf9-47d751c703be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:26:21 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-dd8f1312-b3c2-4e87-8c80-830e6305d7a0 req-226daf44-0c94-4185-bed7-c430f6218fcb service nova] Lock "e6cbb630-254f-4c56-9cf9-47d751c703be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:26:21 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-dd8f1312-b3c2-4e87-8c80-830e6305d7a0 req-226daf44-0c94-4185-bed7-c430f6218fcb service nova] Lock "e6cbb630-254f-4c56-9cf9-47d751c703be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:26:21 user nova-compute[74960]: DEBUG nova.compute.manager [req-dd8f1312-b3c2-4e87-8c80-830e6305d7a0 req-226daf44-0c94-4185-bed7-c430f6218fcb service nova] [instance: e6cbb630-254f-4c56-9cf9-47d751c703be] No waiting events found dispatching network-vif-plugged-b5f672c1-3298-4c5a-bf4d-7c712e4c5873 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:26:21 user nova-compute[74960]: WARNING nova.compute.manager [req-dd8f1312-b3c2-4e87-8c80-830e6305d7a0 req-226daf44-0c94-4185-bed7-c430f6218fcb service nova] [instance: e6cbb630-254f-4c56-9cf9-47d751c703be] Received unexpected event network-vif-plugged-b5f672c1-3298-4c5a-bf4d-7c712e4c5873 for instance with vm_state active and task_state shelving_image_pending_upload.
Nov 03 12:26:21 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-3061a957-d1f4-479d-962a-b55d066e6236 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/e6cbb630-254f-4c56-9cf9-47d751c703be/disk /opt/stack/data/nova/instances/snapshots/tmpcl6343b0/717e5ebfa44441a397f429fc207f61ec" returned: 0 in 0.880s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:26:21 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-3061a957-d1f4-479d-962a-b55d066e6236 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: e6cbb630-254f-4c56-9cf9-47d751c703be] Snapshot extracted, beginning image upload
Nov 03 12:26:21 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:22 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:22 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:22 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:22 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:22 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:22 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:22 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:22 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:23 user nova-compute[74960]: DEBUG nova.compute.manager [req-6d162690-1d23-4d2a-a1be-d5b0cac69dd2 req-d175db17-8cf0-4178-9dd3-b57f684b46c4 service nova] [instance: be38c803-d97c-4939-9852-e8db1c44bb65] Received event network-vif-plugged-b70bcefe-a1cc-4f5c-98f6-3d6914d66a9b {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:26:23 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-6d162690-1d23-4d2a-a1be-d5b0cac69dd2 req-d175db17-8cf0-4178-9dd3-b57f684b46c4 service nova] Acquiring lock "be38c803-d97c-4939-9852-e8db1c44bb65-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:26:23 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-6d162690-1d23-4d2a-a1be-d5b0cac69dd2 req-d175db17-8cf0-4178-9dd3-b57f684b46c4 service nova] Lock "be38c803-d97c-4939-9852-e8db1c44bb65-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:26:23 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-6d162690-1d23-4d2a-a1be-d5b0cac69dd2 req-d175db17-8cf0-4178-9dd3-b57f684b46c4 service nova] Lock "be38c803-d97c-4939-9852-e8db1c44bb65-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:26:23 user nova-compute[74960]: DEBUG nova.compute.manager [req-6d162690-1d23-4d2a-a1be-d5b0cac69dd2 req-d175db17-8cf0-4178-9dd3-b57f684b46c4 service nova] [instance: be38c803-d97c-4939-9852-e8db1c44bb65] No waiting events found dispatching network-vif-plugged-b70bcefe-a1cc-4f5c-98f6-3d6914d66a9b {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:26:23 user nova-compute[74960]: WARNING nova.compute.manager [req-6d162690-1d23-4d2a-a1be-d5b0cac69dd2 req-d175db17-8cf0-4178-9dd3-b57f684b46c4 service nova] [instance: be38c803-d97c-4939-9852-e8db1c44bb65] Received unexpected event network-vif-plugged-b70bcefe-a1cc-4f5c-98f6-3d6914d66a9b for instance with vm_state building and task_state spawning.
Nov 03 12:26:23 user nova-compute[74960]: DEBUG nova.compute.manager [req-6d162690-1d23-4d2a-a1be-d5b0cac69dd2 req-d175db17-8cf0-4178-9dd3-b57f684b46c4 service nova] [instance: be38c803-d97c-4939-9852-e8db1c44bb65] Received event network-vif-plugged-b70bcefe-a1cc-4f5c-98f6-3d6914d66a9b {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:26:23 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-6d162690-1d23-4d2a-a1be-d5b0cac69dd2 req-d175db17-8cf0-4178-9dd3-b57f684b46c4 service nova] Acquiring lock "be38c803-d97c-4939-9852-e8db1c44bb65-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:26:23 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-6d162690-1d23-4d2a-a1be-d5b0cac69dd2 req-d175db17-8cf0-4178-9dd3-b57f684b46c4 service nova] Lock "be38c803-d97c-4939-9852-e8db1c44bb65-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:26:23 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-6d162690-1d23-4d2a-a1be-d5b0cac69dd2 req-d175db17-8cf0-4178-9dd3-b57f684b46c4 service nova] Lock "be38c803-d97c-4939-9852-e8db1c44bb65-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:26:23 user nova-compute[74960]: DEBUG nova.compute.manager [req-6d162690-1d23-4d2a-a1be-d5b0cac69dd2 req-d175db17-8cf0-4178-9dd3-b57f684b46c4 service nova] [instance: be38c803-d97c-4939-9852-e8db1c44bb65] No waiting events found dispatching network-vif-plugged-b70bcefe-a1cc-4f5c-98f6-3d6914d66a9b {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:26:23 user nova-compute[74960]: WARNING nova.compute.manager [req-6d162690-1d23-4d2a-a1be-d5b0cac69dd2 req-d175db17-8cf0-4178-9dd3-b57f684b46c4 service nova] [instance: be38c803-d97c-4939-9852-e8db1c44bb65] Received unexpected event network-vif-plugged-b70bcefe-a1cc-4f5c-98f6-3d6914d66a9b for instance with vm_state building and task_state spawning.
Nov 03 12:26:24 user nova-compute[74960]: DEBUG nova.compute.manager [None req-edf4fb1f-c31f-4a3d-8108-8101383b7170 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] [instance: be38c803-d97c-4939-9852-e8db1c44bb65] Instance event wait completed in 0 seconds for  {{(pid=74960) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 12:26:24 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-edf4fb1f-c31f-4a3d-8108-8101383b7170 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] [instance: be38c803-d97c-4939-9852-e8db1c44bb65] Guest created on hypervisor {{(pid=74960) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 12:26:24 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: be38c803-d97c-4939-9852-e8db1c44bb65] Instance spawned successfully.
Nov 03 12:26:24 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-edf4fb1f-c31f-4a3d-8108-8101383b7170 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] [instance: be38c803-d97c-4939-9852-e8db1c44bb65] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 12:26:24 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-edf4fb1f-c31f-4a3d-8108-8101383b7170 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] [instance: be38c803-d97c-4939-9852-e8db1c44bb65] Found default for hw_cdrom_bus of ide {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:26:24 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-edf4fb1f-c31f-4a3d-8108-8101383b7170 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] [instance: be38c803-d97c-4939-9852-e8db1c44bb65] Found default for hw_disk_bus of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:26:24 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-edf4fb1f-c31f-4a3d-8108-8101383b7170 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] [instance: be38c803-d97c-4939-9852-e8db1c44bb65] Found default for hw_input_bus of None {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:26:24 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-edf4fb1f-c31f-4a3d-8108-8101383b7170 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] [instance: be38c803-d97c-4939-9852-e8db1c44bb65] Found default for hw_pointer_model of None {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:26:24 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-edf4fb1f-c31f-4a3d-8108-8101383b7170 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] [instance: be38c803-d97c-4939-9852-e8db1c44bb65] Found default for hw_video_model of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:26:24 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-edf4fb1f-c31f-4a3d-8108-8101383b7170 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] [instance: be38c803-d97c-4939-9852-e8db1c44bb65] Found default for hw_vif_model of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:26:24 user nova-compute[74960]: INFO nova.compute.manager [None req-edf4fb1f-c31f-4a3d-8108-8101383b7170 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] [instance: be38c803-d97c-4939-9852-e8db1c44bb65] Took 6.75 seconds to spawn the instance on the hypervisor.
Nov 03 12:26:24 user nova-compute[74960]: DEBUG nova.compute.manager [None req-edf4fb1f-c31f-4a3d-8108-8101383b7170 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] [instance: be38c803-d97c-4939-9852-e8db1c44bb65] Checking state {{(pid=74960) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 12:26:24 user nova-compute[74960]: INFO nova.compute.manager [None req-edf4fb1f-c31f-4a3d-8108-8101383b7170 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] [instance: be38c803-d97c-4939-9852-e8db1c44bb65] Took 7.71 seconds to build instance.
Nov 03 12:26:24 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-edf4fb1f-c31f-4a3d-8108-8101383b7170 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Lock "be38c803-d97c-4939-9852-e8db1c44bb65" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.858s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:26:24 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-3061a957-d1f4-479d-962a-b55d066e6236 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: e6cbb630-254f-4c56-9cf9-47d751c703be] Snapshot image upload complete
Nov 03 12:26:24 user nova-compute[74960]: DEBUG nova.compute.manager [None req-3061a957-d1f4-479d-962a-b55d066e6236 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: e6cbb630-254f-4c56-9cf9-47d751c703be] Checking state {{(pid=74960) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 12:26:24 user nova-compute[74960]: INFO nova.compute.manager [None req-3061a957-d1f4-479d-962a-b55d066e6236 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: e6cbb630-254f-4c56-9cf9-47d751c703be] Shelve offloading
Nov 03 12:26:25 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:25 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: e6cbb630-254f-4c56-9cf9-47d751c703be] Instance destroyed successfully.
Nov 03 12:26:25 user nova-compute[74960]: DEBUG nova.compute.manager [None req-3061a957-d1f4-479d-962a-b55d066e6236 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: e6cbb630-254f-4c56-9cf9-47d751c703be] Checking state {{(pid=74960) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 12:26:25 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-3061a957-d1f4-479d-962a-b55d066e6236 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Acquiring lock "refresh_cache-e6cbb630-254f-4c56-9cf9-47d751c703be" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:26:25 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-3061a957-d1f4-479d-962a-b55d066e6236 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Acquired lock "refresh_cache-e6cbb630-254f-4c56-9cf9-47d751c703be" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:26:25 user nova-compute[74960]: DEBUG nova.network.neutron [None req-3061a957-d1f4-479d-962a-b55d066e6236 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: e6cbb630-254f-4c56-9cf9-47d751c703be] Building network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 12:26:25 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-7a68e76e-bf35-4a17-86be-8b5176a97596 tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] Acquiring lock "9951fab7-4984-408e-94ca-11eab615ff25" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:26:25 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-7a68e76e-bf35-4a17-86be-8b5176a97596 tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] Lock "9951fab7-4984-408e-94ca-11eab615ff25" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:26:25 user nova-compute[74960]: DEBUG nova.objects.instance [None req-7a68e76e-bf35-4a17-86be-8b5176a97596 tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] Lazy-loading 'flavor' on Instance uuid 9951fab7-4984-408e-94ca-11eab615ff25 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:26:25 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-7a68e76e-bf35-4a17-86be-8b5176a97596 tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] Lock "9951fab7-4984-408e-94ca-11eab615ff25" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.093s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:26:25 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-7a68e76e-bf35-4a17-86be-8b5176a97596 tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] Acquiring lock "9951fab7-4984-408e-94ca-11eab615ff25" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:26:25 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-7a68e76e-bf35-4a17-86be-8b5176a97596 tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] Lock "9951fab7-4984-408e-94ca-11eab615ff25" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:26:25 user nova-compute[74960]: INFO nova.compute.manager [None req-7a68e76e-bf35-4a17-86be-8b5176a97596 tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] [instance: 9951fab7-4984-408e-94ca-11eab615ff25] Attaching volume 6e4fa603-3516-40fc-a324-bdd390ec4df1 to /dev/vdb
Nov 03 12:26:25 user nova-compute[74960]: DEBUG os_brick.utils [None req-7a68e76e-bf35-4a17-86be-8b5176a97596 tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:26:25 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:26:25 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.063s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:26:25 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[42040b69-fe66-4b93-b83b-0b72b4e7d650]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:75b8e219756\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:26:25 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:26:25 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:26:25 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[9010eab3-4591-432f-a1b3-10ee319fef78]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:26:25 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:26:25 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:26:25 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[77dd3c1e-33a4-49c1-8c9e-49f46a029177]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:26:25 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[a744cd20-8011-4287-bf42-ebea679d9eef]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:26:25 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-7a68e76e-bf35-4a17-86be-8b5176a97596 tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] Running cmd (subprocess): nvme version {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:26:26 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-7a68e76e-bf35-4a17-86be-8b5176a97596 tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] 'nvme version' failed. Not Retrying. {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 12:26:26 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7a68e76e-bf35-4a17-86be-8b5176a97596 tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] nvme not present on system {{(pid=74960) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 12:26:26 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:26:26 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 12:26:26 user nova-compute[74960]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 12:26:26 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[410571a7-a56d-4bff-b076-1eb247c28770]: (4, '') {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:26:26 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-7a68e76e-bf35-4a17-86be-8b5176a97596 tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74960) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 12:26:26 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-7a68e76e-bf35-4a17-86be-8b5176a97596 tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74960) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 12:26:26 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-7a68e76e-bf35-4a17-86be-8b5176a97596 tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] LIGHTOS: no hostnqn found. {{(pid=74960) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 12:26:26 user nova-compute[74960]: DEBUG os_brick.utils [None req-7a68e76e-bf35-4a17-86be-8b5176a97596 tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] <== get_connector_properties: return (186ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:75b8e219756', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:26:26 user nova-compute[74960]: DEBUG nova.virt.block_device [None req-7a68e76e-bf35-4a17-86be-8b5176a97596 tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] [instance: 9951fab7-4984-408e-94ca-11eab615ff25] Updating existing volume attachment record: 4e9f9263-5267-4ac7-ae19-1bd27486bf34 {{(pid=74960) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 12:26:26 user nova-compute[74960]: DEBUG nova.network.neutron [None req-3061a957-d1f4-479d-962a-b55d066e6236 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: e6cbb630-254f-4c56-9cf9-47d751c703be] Updating instance_info_cache with network_info: [{"id": "b5f672c1-3298-4c5a-bf4d-7c712e4c5873", "address": "fa:16:3e:5b:1b:87", "network": {"id": "c03e854d-75a3-4e81-9cdf-f1139841266c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1632999031-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c216dd7629274eafbf0a5968ff2378a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f672c1-32", "ovs_interfaceid": "b5f672c1-3298-4c5a-bf4d-7c712e4c5873", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:26:26 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-3061a957-d1f4-479d-962a-b55d066e6236 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Releasing lock "refresh_cache-e6cbb630-254f-4c56-9cf9-47d751c703be" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:26:27 user nova-compute[74960]: DEBUG nova.compute.manager [req-af10f96d-1dc6-49b5-b363-e867754c3495 req-33711c2e-948c-4917-bbc5-b40e026ed1df service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Received event network-changed-dae50cff-c0b2-4c50-bd31-0d1bf1a17e55 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:26:27 user nova-compute[74960]: DEBUG nova.compute.manager [req-af10f96d-1dc6-49b5-b363-e867754c3495 req-33711c2e-948c-4917-bbc5-b40e026ed1df service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Refreshing instance network info cache due to event network-changed-dae50cff-c0b2-4c50-bd31-0d1bf1a17e55. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 12:26:27 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-af10f96d-1dc6-49b5-b363-e867754c3495 req-33711c2e-948c-4917-bbc5-b40e026ed1df service nova] Acquiring lock "refresh_cache-db88322f-c2ad-4622-9a1a-c45439d875a8" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:26:27 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-af10f96d-1dc6-49b5-b363-e867754c3495 req-33711c2e-948c-4917-bbc5-b40e026ed1df service nova] Acquired lock "refresh_cache-db88322f-c2ad-4622-9a1a-c45439d875a8" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:26:27 user nova-compute[74960]: DEBUG nova.network.neutron [req-af10f96d-1dc6-49b5-b363-e867754c3495 req-33711c2e-948c-4917-bbc5-b40e026ed1df service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Refreshing network info cache for port dae50cff-c0b2-4c50-bd31-0d1bf1a17e55 {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 12:26:27 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: e6cbb630-254f-4c56-9cf9-47d751c703be] Instance destroyed successfully.
Nov 03 12:26:27 user nova-compute[74960]: DEBUG nova.objects.instance [None req-3061a957-d1f4-479d-962a-b55d066e6236 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Lazy-loading 'resources' on Instance uuid e6cbb630-254f-4c56-9cf9-47d751c703be {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:26:27 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-3061a957-d1f4-479d-962a-b55d066e6236 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:24:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1644828034',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1644828034',id=19,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBByEuco6vUpQ1yRzD8+T3c8kNK+AQMUFF0dlFJOn3loibIfbxPBaNP5PcdHo8YH4HcBd16j2Mx3GJQr5JshLcaNKXedxYhHHkaVLhD0FOSjY4W2miuaoDcU64srC5P9Ncg==',key_name='tempest-keypair-1090973974',keypairs=<?>,launch_index=0,launched_at=2023-11-03T12:24:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='c216dd7629274eafbf0a5968ff2378a9',ramdisk_id='',reservation_id='r-t48sleg2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-258463843',owner_user_name='tempest-AttachVolumeShelveTestJSON-258463843-project-member',shelved_at='2023-11-03T12:26:24.907044',shelved_host='user',shelved_image_id='79caf2c3-5132-4c51-9b2e-7761bce2f259'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T12:26:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fae69462930546bdb9cf6e2a11a0df2a',uuid=e6cbb630-254f-4c56-9cf9-47d751c703be,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "b5f672c1-3298-4c5a-bf4d-7c712e4c5873", "address": "fa:16:3e:5b:1b:87", "network": {"id": "c03e854d-75a3-4e81-9cdf-f1139841266c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1632999031-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c216dd7629274eafbf0a5968ff2378a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f672c1-32", "ovs_interfaceid": "b5f672c1-3298-4c5a-bf4d-7c712e4c5873", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 12:26:27 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-3061a957-d1f4-479d-962a-b55d066e6236 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Converting VIF {"id": "b5f672c1-3298-4c5a-bf4d-7c712e4c5873", "address": "fa:16:3e:5b:1b:87", "network": {"id": "c03e854d-75a3-4e81-9cdf-f1139841266c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1632999031-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c216dd7629274eafbf0a5968ff2378a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f672c1-32", "ovs_interfaceid": "b5f672c1-3298-4c5a-bf4d-7c712e4c5873", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:26:27 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-3061a957-d1f4-479d-962a-b55d066e6236 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:1b:87,bridge_name='br-int',has_traffic_filtering=True,id=b5f672c1-3298-4c5a-bf4d-7c712e4c5873,network=Network(c03e854d-75a3-4e81-9cdf-f1139841266c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5f672c1-32') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:26:27 user nova-compute[74960]: DEBUG os_vif [None req-3061a957-d1f4-479d-962a-b55d066e6236 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:1b:87,bridge_name='br-int',has_traffic_filtering=True,id=b5f672c1-3298-4c5a-bf4d-7c712e4c5873,network=Network(c03e854d-75a3-4e81-9cdf-f1139841266c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5f672c1-32') {{(pid=74960) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 12:26:27 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:27 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb5f672c1-32, bridge=br-int, if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:26:27 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:27 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:26:27 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:27 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=51c126d6-af27-4c84-b645-15ab7f00f779) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:26:27 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:27 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:27 user nova-compute[74960]: INFO os_vif [None req-3061a957-d1f4-479d-962a-b55d066e6236 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:1b:87,bridge_name='br-int',has_traffic_filtering=True,id=b5f672c1-3298-4c5a-bf4d-7c712e4c5873,network=Network(c03e854d-75a3-4e81-9cdf-f1139841266c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5f672c1-32')
Nov 03 12:26:27 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-3061a957-d1f4-479d-962a-b55d066e6236 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: e6cbb630-254f-4c56-9cf9-47d751c703be] Deleting instance files /opt/stack/data/nova/instances/e6cbb630-254f-4c56-9cf9-47d751c703be_del
Nov 03 12:26:27 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-3061a957-d1f4-479d-962a-b55d066e6236 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: e6cbb630-254f-4c56-9cf9-47d751c703be] Deletion of /opt/stack/data/nova/instances/e6cbb630-254f-4c56-9cf9-47d751c703be_del complete
Nov 03 12:26:27 user nova-compute[74960]: INFO nova.scheduler.client.report [None req-3061a957-d1f4-479d-962a-b55d066e6236 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Deleted allocations for instance e6cbb630-254f-4c56-9cf9-47d751c703be
Nov 03 12:26:27 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-3061a957-d1f4-479d-962a-b55d066e6236 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:26:27 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-3061a957-d1f4-479d-962a-b55d066e6236 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:26:27 user nova-compute[74960]: DEBUG nova.objects.instance [None req-3061a957-d1f4-479d-962a-b55d066e6236 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Lazy-loading 'numa_topology' on Instance uuid e6cbb630-254f-4c56-9cf9-47d751c703be {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:26:27 user nova-compute[74960]: DEBUG nova.objects.base [None req-3061a957-d1f4-479d-962a-b55d066e6236 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Object Instance<e6cbb630-254f-4c56-9cf9-47d751c703be> lazy-loaded attributes: resources,numa_topology {{(pid=74960) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 12:26:27 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:28 user nova-compute[74960]: DEBUG nova.network.neutron [req-af10f96d-1dc6-49b5-b363-e867754c3495 req-33711c2e-948c-4917-bbc5-b40e026ed1df service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Updated VIF entry in instance network info cache for port dae50cff-c0b2-4c50-bd31-0d1bf1a17e55. {{(pid=74960) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 12:26:28 user nova-compute[74960]: DEBUG nova.network.neutron [req-af10f96d-1dc6-49b5-b363-e867754c3495 req-33711c2e-948c-4917-bbc5-b40e026ed1df service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Updating instance_info_cache with network_info: [{"id": "dae50cff-c0b2-4c50-bd31-0d1bf1a17e55", "address": "fa:16:3e:c8:88:99", "network": {"id": "f771bed5-ff95-49cd-9871-08b128de2619", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-756048610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32ecbf7a4b414f40ac9bb306bf9d4702", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdae50cff-c0", "ovs_interfaceid": "dae50cff-c0b2-4c50-bd31-0d1bf1a17e55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9207158b-c88b-44b8-b419-eba87e570339", "address": "fa:16:3e:1a:2c:15", "network": {"id": "a61d6a8a-acdb-4b52-bebc-1b90d89b25f2", "bridge": "br-int", "label": "tempest-device-tagging-net1-20653421", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32ecbf7a4b414f40ac9bb306bf9d4702", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9207158b-c8", "ovs_interfaceid": "9207158b-c88b-44b8-b419-eba87e570339", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "72da800d-493b-4dc6-8988-1259e2423188", "address": "fa:16:3e:ec:7f:b8", "network": {"id": "a61d6a8a-acdb-4b52-bebc-1b90d89b25f2", "bridge": "br-int", "label": "tempest-device-tagging-net1-20653421", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32ecbf7a4b414f40ac9bb306bf9d4702", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72da800d-49", "ovs_interfaceid": "72da800d-493b-4dc6-8988-1259e2423188", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b905e727-4d81-4518-8cae-06f4e64bcccc", "address": "fa:16:3e:b9:71:c0", "network": {"id": "a61d6a8a-acdb-4b52-bebc-1b90d89b25f2", "bridge": "br-int", "label": "tempest-device-tagging-net1-20653421", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32ecbf7a4b414f40ac9bb306bf9d4702", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb905e727-4d", "ovs_interfaceid": "b905e727-4d81-4518-8cae-06f4e64bcccc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "012765dc-7d42-41d5-b12b-34f3a2a7ef07", "address": "fa:16:3e:d6:f8:7b", "network": {"id": "a61d6a8a-acdb-4b52-bebc-1b90d89b25f2", "bridge": "br-int", "label": "tempest-device-tagging-net1-20653421", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32ecbf7a4b414f40ac9bb306bf9d4702", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap012765dc-7d", "ovs_interfaceid": "012765dc-7d42-41d5-b12b-34f3a2a7ef07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "412bab8b-015e-4df4-92c8-2ed71a8ca2f7", "address": "fa:16:3e:e5:6e:0a", "network": {"id": "103d876e-44c1-4732-b994-193d642fbd96", "bridge": "br-int", "label": "tempest-device-tagging-net2-1835187118", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "32ecbf7a4b414f40ac9bb306bf9d4702", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap412bab8b-01", "ovs_interfaceid": "412bab8b-015e-4df4-92c8-2ed71a8ca2f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "20575d86-ea6c-4d0d-8190-70fe728bc7c1", "address": "fa:16:3e:7c:5c:e8", "network": {"id": "103d876e-44c1-4732-b994-193d642fbd96", "bridge": "br-int", "label": "tempest-device-tagging-net2-1835187118", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "32ecbf7a4b414f40ac9bb306bf9d4702", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20575d86-ea", "ovs_interfaceid": "20575d86-ea6c-4d0d-8190-70fe728bc7c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:26:28 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-3061a957-d1f4-479d-962a-b55d066e6236 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:26:28 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-af10f96d-1dc6-49b5-b363-e867754c3495 req-33711c2e-948c-4917-bbc5-b40e026ed1df service nova] Releasing lock "refresh_cache-db88322f-c2ad-4622-9a1a-c45439d875a8" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:26:28 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-3061a957-d1f4-479d-962a-b55d066e6236 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:26:28 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-3061a957-d1f4-479d-962a-b55d066e6236 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.506s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:26:28 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-3061a957-d1f4-479d-962a-b55d066e6236 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Lock "e6cbb630-254f-4c56-9cf9-47d751c703be" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 8.880s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:26:30 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-0a2565de-9e74-41d7-b7b1-9780983c8a36 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 6145a30b-809c-4bc5-a45f-c3ff3b170a22 is timed out.
Nov 03 12:26:30 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-0a2565de-9e74-41d7-b7b1-9780983c8a36 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Successfully detached device vdb from instance 6145a30b-809c-4bc5-a45f-c3ff3b170a22 from the live domain config.
Nov 03 12:26:30 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a2565de-9e74-41d7-b7b1-9780983c8a36 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] calling os-brick to detach iSCSI Volume {{(pid=74960) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 12:26:30 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a2565de-9e74-41d7-b7b1-9780983c8a36 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9aa420acb0>, {'target_iqn': 'iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XjKVSQTt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:26:30 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-0a2565de-9e74-41d7-b7b1-9780983c8a36 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:26:30 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-0a2565de-9e74-41d7-b7b1-9780983c8a36 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:26:30 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-0a2565de-9e74-41d7-b7b1-9780983c8a36 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:26:30 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:26:30 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.049s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:26:30 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[db69107a-51c5-4399-b496-154172fb6273]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:64202938-e4d3-4072-ba6e-f144187c01a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fd1b7665-8415-44ab-81f5-84493c50a786\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f629b2b5-39ab-4ee3-9633-a534a39c93a5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:26:30 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a2565de-9e74-41d7-b7b1-9780983c8a36 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 12:26:30 user nova-compute[74960]: No targets found.
Nov 03 12:26:30 user nova-compute[74960]: iSNS:
Nov 03 12:26:30 user nova-compute[74960]: No targets found.
Nov 03 12:26:30 user nova-compute[74960]: STATIC:
Nov 03 12:26:30 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:64202938-e4d3-4072-ba6e-f144187c01a9
Nov 03 12:26:30 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:26:30 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:26:30 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:fd1b7665-8415-44ab-81f5-84493c50a786
Nov 03 12:26:30 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:26:30 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:26:30 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01
Nov 03 12:26:30 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:26:30 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:26:30 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815
Nov 03 12:26:30 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:26:30 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:26:30 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:f629b2b5-39ab-4ee3-9633-a534a39c93a5
Nov 03 12:26:30 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:26:30 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:26:30 user nova-compute[74960]: FIRMWARE:
Nov 03 12:26:30 user nova-compute[74960]: No targets found.
Nov 03 12:26:30 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:26:30 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a2565de-9e74-41d7-b7b1-9780983c8a36 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 12:26:30 user nova-compute[74960]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 12:26:30 user nova-compute[74960]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74960) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 12:26:30 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a2565de-9e74-41d7-b7b1-9780983c8a36 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01', 0)] {{(pid=74960) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 12:26:30 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:26:30 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:26:30 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee751e6d-74f8-40ec-bfad-75ce7a1d88fa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64202938-e4d3-4072-ba6e-f144187c01a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f629b2b5-39ab-4ee3-9633-a534a39c93a5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd1b7665-8415-44ab-81f5-84493c50a786\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:26:30 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:26:30 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:26:30 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[24e8b810-cd99-4bae-bfdc-144f584a08a3]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64202938-e4d3-4072-ba6e-f144187c01a9 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd1b7665-8415-44ab-81f5-84493c50a786 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f629b2b5-39ab-4ee3-9633-a534a39c93a5 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815 (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:26:30 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a2565de-9e74-41d7-b7b1-9780983c8a36 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01 (non-flash)
Nov 03 12:26:30 user nova-compute[74960]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64202938-e4d3-4072-ba6e-f144187c01a9 (non-flash)
Nov 03 12:26:30 user nova-compute[74960]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd1b7665-8415-44ab-81f5-84493c50a786 (non-flash)
Nov 03 12:26:30 user nova-compute[74960]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f629b2b5-39ab-4ee3-9633-a534a39c93a5 (non-flash)
Nov 03 12:26:30 user nova-compute[74960]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815 (non-flash)
Nov 03 12:26:30 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:26:30 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a2565de-9e74-41d7-b7b1-9780983c8a36 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01 (non-flash)
Nov 03 12:26:30 user nova-compute[74960]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64202938-e4d3-4072-ba6e-f144187c01a9 (non-flash)
Nov 03 12:26:30 user nova-compute[74960]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd1b7665-8415-44ab-81f5-84493c50a786 (non-flash)
Nov 03 12:26:30 user nova-compute[74960]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f629b2b5-39ab-4ee3-9633-a534a39c93a5 (non-flash)
Nov 03 12:26:30 user nova-compute[74960]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815 (non-flash)
Nov 03 12:26:30 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:26:30 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a2565de-9e74-41d7-b7b1-9780983c8a36 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9ab065f760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01'): ({'sdb'}, set())}) {{(pid=74960) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 12:26:30 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-0a2565de-9e74-41d7-b7b1-9780983c8a36 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Removing single pathed devices sdb {{(pid=74960) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 12:26:30 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:26:30 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.037s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:26:30 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[14932173-9232-446f-8d66-fe3ef290adb8]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:26:30 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:26:30 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:26:30 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[f46dc997-b77d-4efd-bc05-186552290fe1]: (4, ('ok\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:26:30 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-0a2565de-9e74-41d7-b7b1-9780983c8a36 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Flushing IO for device /dev/sdb {{(pid=74960) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 12:26:30 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:26:30 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:26:30 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[90cf613e-1198-40ec-83c5-37903fc7b35a]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:26:30 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-0a2565de-9e74-41d7-b7b1-9780983c8a36 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74960) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 12:26:30 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:26:30 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.065s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:26:30 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f85cac7-58a0-4456-bbe0-a0ce6412aec1]: (4, ('1', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:26:30 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-0a2565de-9e74-41d7-b7b1-9780983c8a36 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74960) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 12:26:30 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-0a2565de-9e74-41d7-b7b1-9780983c8a36 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] SCSI volumes sdb have been removed. {{(pid=74960) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 12:26:30 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a2565de-9e74-41d7-b7b1-9780983c8a36 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01')] {{(pid=74960) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 12:26:30 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:26:30 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:26:30 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[7763a3a1-7b71-4f44-9cd8-db646c02fb72]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:26:30 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a2565de-9e74-41d7-b7b1-9780983c8a36 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:26:30 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01 -p 172.16.0.220:3260 --logout {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:26:30 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:26:30 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfdfdaec-0df3-4ac0-9548-95eceefd357e]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:26:30 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a2565de-9e74-41d7-b7b1-9780983c8a36 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01, portal: 172.16.0.220,3260]
Nov 03 12:26:30 user nova-compute[74960]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01, portal: 172.16.0.220,3260] successful.
Nov 03 12:26:30 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:26:30 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01 -p 172.16.0.220:3260 --op delete {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:26:30 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91f59f2a-fb49-4bb7-8249-7c895b43aa01 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:26:30 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd70fd4-0f20-4298-9afa-f96f1e210625]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:26:30 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a2565de-9e74-41d7-b7b1-9780983c8a36 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:26:30 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-0a2565de-9e74-41d7-b7b1-9780983c8a36 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.440s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:26:30 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a2565de-9e74-41d7-b7b1-9780983c8a36 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] <== disconnect_volume: return (442ms) None {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:26:30 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a2565de-9e74-41d7-b7b1-9780983c8a36 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] Disconnected iSCSI Volume {{(pid=74960) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 12:26:31 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Acquiring lock "db88322f-c2ad-4622-9a1a-c45439d875a8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:26:31 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Lock "db88322f-c2ad-4622-9a1a-c45439d875a8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:26:31 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Acquiring lock "db88322f-c2ad-4622-9a1a-c45439d875a8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:26:31 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Lock "db88322f-c2ad-4622-9a1a-c45439d875a8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:26:31 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Lock "db88322f-c2ad-4622-9a1a-c45439d875a8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:26:31 user nova-compute[74960]: INFO nova.compute.manager [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Terminating instance
Nov 03 12:26:31 user nova-compute[74960]: DEBUG nova.compute.manager [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Start destroying the instance on the hypervisor. {{(pid=74960) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 12:26:31 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:31 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:31 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:31 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:31 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:31 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:31 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:31 user nova-compute[74960]: DEBUG nova.compute.manager [req-514cc53a-9ac1-47c8-beb8-d9860c5ec448 req-1fe2d8d6-b0a9-47ba-be0d-c48a7eeebda4 service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Received event network-vif-unplugged-dae50cff-c0b2-4c50-bd31-0d1bf1a17e55 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:26:31 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-514cc53a-9ac1-47c8-beb8-d9860c5ec448 req-1fe2d8d6-b0a9-47ba-be0d-c48a7eeebda4 service nova] Acquiring lock "db88322f-c2ad-4622-9a1a-c45439d875a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:26:31 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-514cc53a-9ac1-47c8-beb8-d9860c5ec448 req-1fe2d8d6-b0a9-47ba-be0d-c48a7eeebda4 service nova] Lock "db88322f-c2ad-4622-9a1a-c45439d875a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:26:31 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-514cc53a-9ac1-47c8-beb8-d9860c5ec448 req-1fe2d8d6-b0a9-47ba-be0d-c48a7eeebda4 service nova] Lock "db88322f-c2ad-4622-9a1a-c45439d875a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:26:31 user nova-compute[74960]: DEBUG nova.compute.manager [req-514cc53a-9ac1-47c8-beb8-d9860c5ec448 req-1fe2d8d6-b0a9-47ba-be0d-c48a7eeebda4 service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] No waiting events found dispatching network-vif-unplugged-dae50cff-c0b2-4c50-bd31-0d1bf1a17e55 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:26:31 user nova-compute[74960]: DEBUG nova.compute.manager [req-514cc53a-9ac1-47c8-beb8-d9860c5ec448 req-1fe2d8d6-b0a9-47ba-be0d-c48a7eeebda4 service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Received event network-vif-unplugged-dae50cff-c0b2-4c50-bd31-0d1bf1a17e55 for instance with task_state deleting. {{(pid=74960) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 12:26:31 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:31 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:31 user nova-compute[74960]: DEBUG nova.compute.manager [req-605199aa-8ac2-4c43-9560-df0f58cf51a1 req-fbcdcc9f-9fd6-4ef5-9dbe-7e0320dc9c46 service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Received event network-vif-unplugged-9207158b-c88b-44b8-b419-eba87e570339 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:26:31 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-605199aa-8ac2-4c43-9560-df0f58cf51a1 req-fbcdcc9f-9fd6-4ef5-9dbe-7e0320dc9c46 service nova] Acquiring lock "db88322f-c2ad-4622-9a1a-c45439d875a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:26:31 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-605199aa-8ac2-4c43-9560-df0f58cf51a1 req-fbcdcc9f-9fd6-4ef5-9dbe-7e0320dc9c46 service nova] Lock "db88322f-c2ad-4622-9a1a-c45439d875a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:26:31 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-605199aa-8ac2-4c43-9560-df0f58cf51a1 req-fbcdcc9f-9fd6-4ef5-9dbe-7e0320dc9c46 service nova] Lock "db88322f-c2ad-4622-9a1a-c45439d875a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:26:31 user nova-compute[74960]: DEBUG nova.compute.manager [req-605199aa-8ac2-4c43-9560-df0f58cf51a1 req-fbcdcc9f-9fd6-4ef5-9dbe-7e0320dc9c46 service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] No waiting events found dispatching network-vif-unplugged-9207158b-c88b-44b8-b419-eba87e570339 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:26:31 user nova-compute[74960]: DEBUG nova.compute.manager [req-605199aa-8ac2-4c43-9560-df0f58cf51a1 req-fbcdcc9f-9fd6-4ef5-9dbe-7e0320dc9c46 service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Received event network-vif-unplugged-9207158b-c88b-44b8-b419-eba87e570339 for instance with task_state deleting. {{(pid=74960) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 12:26:31 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:31 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:31 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:31 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:31 user nova-compute[74960]: DEBUG nova.compute.manager [req-ea9c985b-16a4-4d6a-8fbd-14245289b840 req-3f983c23-c171-467d-b5c5-bdccffcf5326 service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Received event network-vif-unplugged-72da800d-493b-4dc6-8988-1259e2423188 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:26:31 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-ea9c985b-16a4-4d6a-8fbd-14245289b840 req-3f983c23-c171-467d-b5c5-bdccffcf5326 service nova] Acquiring lock "db88322f-c2ad-4622-9a1a-c45439d875a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:26:31 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-ea9c985b-16a4-4d6a-8fbd-14245289b840 req-3f983c23-c171-467d-b5c5-bdccffcf5326 service nova] Lock "db88322f-c2ad-4622-9a1a-c45439d875a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:26:31 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-ea9c985b-16a4-4d6a-8fbd-14245289b840 req-3f983c23-c171-467d-b5c5-bdccffcf5326 service nova] Lock "db88322f-c2ad-4622-9a1a-c45439d875a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:26:31 user nova-compute[74960]: DEBUG nova.compute.manager [req-ea9c985b-16a4-4d6a-8fbd-14245289b840 req-3f983c23-c171-467d-b5c5-bdccffcf5326 service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] No waiting events found dispatching network-vif-unplugged-72da800d-493b-4dc6-8988-1259e2423188 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:26:31 user nova-compute[74960]: DEBUG nova.compute.manager [req-ea9c985b-16a4-4d6a-8fbd-14245289b840 req-3f983c23-c171-467d-b5c5-bdccffcf5326 service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Received event network-vif-unplugged-72da800d-493b-4dc6-8988-1259e2423188 for instance with task_state deleting. {{(pid=74960) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 12:26:31 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:31 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:32 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:32 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:32 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:32 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:32 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:32 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:32 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:32 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:32 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:32 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:33 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Instance destroyed successfully.
Nov 03 12:26:33 user nova-compute[74960]: DEBUG nova.objects.instance [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Lazy-loading 'resources' on Instance uuid db88322f-c2ad-4622-9a1a-c45439d875a8 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T12:23:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1565525940',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1565525940',id=18,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK+6ZHlH1wKTndCYBIgu6ANG9Y2bIdl4FNNh18qkCmwdesNa7MOCTQ0WhOi5eCN1Qx65IdW7gj2YQX2eDDhNwRN+7BelIOC4SN1r8Sh9sZUc1XmzARyI8Hgp+1UUgZcu7Q==',key_name='tempest-keypair-788787740',keypairs=<?>,launch_index=0,launched_at=2023-11-03T12:25:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='32ecbf7a4b414f40ac9bb306bf9d4702',ramdisk_id='',reservation_id='r-2r3kgklh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1985714310',owner_user_name='tempest-TaggedBootDevicesTest_v242-1985714310-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T12:25:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='49d35d857fdf4e4f894a72610086d752',uuid=db88322f-c2ad-4622-9a1a-c45439d875a8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dae50cff-c0b2-4c50-bd31-0d1bf1a17e55", "address": "fa:16:3e:c8:88:99", "network": {"id": "f771bed5-ff95-49cd-9871-08b128de2619", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-756048610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32ecbf7a4b414f40ac9bb306bf9d4702", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdae50cff-c0", "ovs_interfaceid": "dae50cff-c0b2-4c50-bd31-0d1bf1a17e55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Converting VIF {"id": "dae50cff-c0b2-4c50-bd31-0d1bf1a17e55", "address": "fa:16:3e:c8:88:99", "network": {"id": "f771bed5-ff95-49cd-9871-08b128de2619", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-756048610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32ecbf7a4b414f40ac9bb306bf9d4702", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdae50cff-c0", "ovs_interfaceid": "dae50cff-c0b2-4c50-bd31-0d1bf1a17e55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c8:88:99,bridge_name='br-int',has_traffic_filtering=True,id=dae50cff-c0b2-4c50-bd31-0d1bf1a17e55,network=Network(f771bed5-ff95-49cd-9871-08b128de2619),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdae50cff-c0') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG os_vif [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c8:88:99,bridge_name='br-int',has_traffic_filtering=True,id=dae50cff-c0b2-4c50-bd31-0d1bf1a17e55,network=Network(f771bed5-ff95-49cd-9871-08b128de2619),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdae50cff-c0') {{(pid=74960) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdae50cff-c0, bridge=br-int, if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f19a4de5-94ca-4caa-b6ad-b8c6b0582645) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:33 user nova-compute[74960]: INFO os_vif [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c8:88:99,bridge_name='br-int',has_traffic_filtering=True,id=dae50cff-c0b2-4c50-bd31-0d1bf1a17e55,network=Network(f771bed5-ff95-49cd-9871-08b128de2619),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdae50cff-c0')
Nov 03 12:26:33 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T12:23:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1565525940',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1565525940',id=18,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK+6ZHlH1wKTndCYBIgu6ANG9Y2bIdl4FNNh18qkCmwdesNa7MOCTQ0WhOi5eCN1Qx65IdW7gj2YQX2eDDhNwRN+7BelIOC4SN1r8Sh9sZUc1XmzARyI8Hgp+1UUgZcu7Q==',key_name='tempest-keypair-788787740',keypairs=<?>,launch_index=0,launched_at=2023-11-03T12:25:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='32ecbf7a4b414f40ac9bb306bf9d4702',ramdisk_id='',reservation_id='r-2r3kgklh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1985714310',owner_user_name='tempest-TaggedBootDevicesTest_v242-1985714310-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T12:25:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='49d35d857fdf4e4f894a72610086d752',uuid=db88322f-c2ad-4622-9a1a-c45439d875a8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9207158b-c88b-44b8-b419-eba87e570339", "address": "fa:16:3e:1a:2c:15", "network": {"id": "a61d6a8a-acdb-4b52-bebc-1b90d89b25f2", "bridge": "br-int", "label": "tempest-device-tagging-net1-20653421", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32ecbf7a4b414f40ac9bb306bf9d4702", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9207158b-c8", "ovs_interfaceid": "9207158b-c88b-44b8-b419-eba87e570339", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74960) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Converting VIF {"id": "9207158b-c88b-44b8-b419-eba87e570339", "address": "fa:16:3e:1a:2c:15", "network": {"id": "a61d6a8a-acdb-4b52-bebc-1b90d89b25f2", "bridge": "br-int", "label": "tempest-device-tagging-net1-20653421", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32ecbf7a4b414f40ac9bb306bf9d4702", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9207158b-c8", "ovs_interfaceid": "9207158b-c88b-44b8-b419-eba87e570339", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:2c:15,bridge_name='br-int',has_traffic_filtering=True,id=9207158b-c88b-44b8-b419-eba87e570339,network=Network(a61d6a8a-acdb-4b52-bebc-1b90d89b25f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9207158b-c8') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG os_vif [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:2c:15,bridge_name='br-int',has_traffic_filtering=True,id=9207158b-c88b-44b8-b419-eba87e570339,network=Network(a61d6a8a-acdb-4b52-bebc-1b90d89b25f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9207158b-c8') {{(pid=74960) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9207158b-c8, bridge=br-int, if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ade94521-5c1b-41ab-bcb0-5f5682272696) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:33 user nova-compute[74960]: INFO os_vif [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:2c:15,bridge_name='br-int',has_traffic_filtering=True,id=9207158b-c88b-44b8-b419-eba87e570339,network=Network(a61d6a8a-acdb-4b52-bebc-1b90d89b25f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9207158b-c8')
Nov 03 12:26:33 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T12:23:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1565525940',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1565525940',id=18,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK+6ZHlH1wKTndCYBIgu6ANG9Y2bIdl4FNNh18qkCmwdesNa7MOCTQ0WhOi5eCN1Qx65IdW7gj2YQX2eDDhNwRN+7BelIOC4SN1r8Sh9sZUc1XmzARyI8Hgp+1UUgZcu7Q==',key_name='tempest-keypair-788787740',keypairs=<?>,launch_index=0,launched_at=2023-11-03T12:25:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='32ecbf7a4b414f40ac9bb306bf9d4702',ramdisk_id='',reservation_id='r-2r3kgklh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1985714310',owner_user_name='tempest-TaggedBootDevicesTest_v242-1985714310-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T12:25:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='49d35d857fdf4e4f894a72610086d752',uuid=db88322f-c2ad-4622-9a1a-c45439d875a8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "72da800d-493b-4dc6-8988-1259e2423188", "address": "fa:16:3e:ec:7f:b8", "network": {"id": "a61d6a8a-acdb-4b52-bebc-1b90d89b25f2", "bridge": "br-int", "label": "tempest-device-tagging-net1-20653421", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32ecbf7a4b414f40ac9bb306bf9d4702", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72da800d-49", "ovs_interfaceid": "72da800d-493b-4dc6-8988-1259e2423188", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74960) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Converting VIF {"id": "72da800d-493b-4dc6-8988-1259e2423188", "address": "fa:16:3e:ec:7f:b8", "network": {"id": "a61d6a8a-acdb-4b52-bebc-1b90d89b25f2", "bridge": "br-int", "label": "tempest-device-tagging-net1-20653421", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32ecbf7a4b414f40ac9bb306bf9d4702", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72da800d-49", "ovs_interfaceid": "72da800d-493b-4dc6-8988-1259e2423188", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:7f:b8,bridge_name='br-int',has_traffic_filtering=True,id=72da800d-493b-4dc6-8988-1259e2423188,network=Network(a61d6a8a-acdb-4b52-bebc-1b90d89b25f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap72da800d-49') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG os_vif [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:7f:b8,bridge_name='br-int',has_traffic_filtering=True,id=72da800d-493b-4dc6-8988-1259e2423188,network=Network(a61d6a8a-acdb-4b52-bebc-1b90d89b25f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap72da800d-49') {{(pid=74960) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap72da800d-49, bridge=br-int, if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=98fd1593-d9c1-4560-92a9-2abe88b26805) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:33 user nova-compute[74960]: INFO os_vif [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:7f:b8,bridge_name='br-int',has_traffic_filtering=True,id=72da800d-493b-4dc6-8988-1259e2423188,network=Network(a61d6a8a-acdb-4b52-bebc-1b90d89b25f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap72da800d-49')
Nov 03 12:26:33 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T12:23:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1565525940',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1565525940',id=18,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK+6ZHlH1wKTndCYBIgu6ANG9Y2bIdl4FNNh18qkCmwdesNa7MOCTQ0WhOi5eCN1Qx65IdW7gj2YQX2eDDhNwRN+7BelIOC4SN1r8Sh9sZUc1XmzARyI8Hgp+1UUgZcu7Q==',key_name='tempest-keypair-788787740',keypairs=<?>,launch_index=0,launched_at=2023-11-03T12:25:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='32ecbf7a4b414f40ac9bb306bf9d4702',ramdisk_id='',reservation_id='r-2r3kgklh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1985714310',owner_user_name='tempest-TaggedBootDevicesTest_v242-1985714310-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T12:25:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='49d35d857fdf4e4f894a72610086d752',uuid=db88322f-c2ad-4622-9a1a-c45439d875a8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b905e727-4d81-4518-8cae-06f4e64bcccc", "address": "fa:16:3e:b9:71:c0", "network": {"id": "a61d6a8a-acdb-4b52-bebc-1b90d89b25f2", "bridge": "br-int", "label": "tempest-device-tagging-net1-20653421", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32ecbf7a4b414f40ac9bb306bf9d4702", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb905e727-4d", "ovs_interfaceid": "b905e727-4d81-4518-8cae-06f4e64bcccc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Converting VIF {"id": "b905e727-4d81-4518-8cae-06f4e64bcccc", "address": "fa:16:3e:b9:71:c0", "network": {"id": "a61d6a8a-acdb-4b52-bebc-1b90d89b25f2", "bridge": "br-int", "label": "tempest-device-tagging-net1-20653421", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32ecbf7a4b414f40ac9bb306bf9d4702", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb905e727-4d", "ovs_interfaceid": "b905e727-4d81-4518-8cae-06f4e64bcccc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:71:c0,bridge_name='br-int',has_traffic_filtering=True,id=b905e727-4d81-4518-8cae-06f4e64bcccc,network=Network(a61d6a8a-acdb-4b52-bebc-1b90d89b25f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb905e727-4d') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG os_vif [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:71:c0,bridge_name='br-int',has_traffic_filtering=True,id=b905e727-4d81-4518-8cae-06f4e64bcccc,network=Network(a61d6a8a-acdb-4b52-bebc-1b90d89b25f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb905e727-4d') {{(pid=74960) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb905e727-4d, bridge=br-int, if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bc676965-446a-44ed-b68b-49bd71ba368d) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:33 user nova-compute[74960]: INFO os_vif [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:71:c0,bridge_name='br-int',has_traffic_filtering=True,id=b905e727-4d81-4518-8cae-06f4e64bcccc,network=Network(a61d6a8a-acdb-4b52-bebc-1b90d89b25f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb905e727-4d')
Nov 03 12:26:33 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T12:23:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1565525940',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1565525940',id=18,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK+6ZHlH1wKTndCYBIgu6ANG9Y2bIdl4FNNh18qkCmwdesNa7MOCTQ0WhOi5eCN1Qx65IdW7gj2YQX2eDDhNwRN+7BelIOC4SN1r8Sh9sZUc1XmzARyI8Hgp+1UUgZcu7Q==',key_name='tempest-keypair-788787740',keypairs=<?>,launch_index=0,launched_at=2023-11-03T12:25:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='32ecbf7a4b414f40ac9bb306bf9d4702',ramdisk_id='',reservation_id='r-2r3kgklh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1985714310',owner_user_name='tempest-TaggedBootDevicesTest_v242-1985714310-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T12:25:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='49d35d857fdf4e4f894a72610086d752',uuid=db88322f-c2ad-4622-9a1a-c45439d875a8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "012765dc-7d42-41d5-b12b-34f3a2a7ef07", "address": "fa:16:3e:d6:f8:7b", "network": {"id": "a61d6a8a-acdb-4b52-bebc-1b90d89b25f2", "bridge": "br-int", "label": "tempest-device-tagging-net1-20653421", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32ecbf7a4b414f40ac9bb306bf9d4702", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap012765dc-7d", "ovs_interfaceid": "012765dc-7d42-41d5-b12b-34f3a2a7ef07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Converting VIF {"id": "012765dc-7d42-41d5-b12b-34f3a2a7ef07", "address": "fa:16:3e:d6:f8:7b", "network": {"id": "a61d6a8a-acdb-4b52-bebc-1b90d89b25f2", "bridge": "br-int", "label": "tempest-device-tagging-net1-20653421", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32ecbf7a4b414f40ac9bb306bf9d4702", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap012765dc-7d", "ovs_interfaceid": "012765dc-7d42-41d5-b12b-34f3a2a7ef07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:f8:7b,bridge_name='br-int',has_traffic_filtering=True,id=012765dc-7d42-41d5-b12b-34f3a2a7ef07,network=Network(a61d6a8a-acdb-4b52-bebc-1b90d89b25f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap012765dc-7d') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG os_vif [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:f8:7b,bridge_name='br-int',has_traffic_filtering=True,id=012765dc-7d42-41d5-b12b-34f3a2a7ef07,network=Network(a61d6a8a-acdb-4b52-bebc-1b90d89b25f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap012765dc-7d') {{(pid=74960) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap012765dc-7d, bridge=br-int, if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=715a68c2-48f0-4460-af98-db530454abc3) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:33 user nova-compute[74960]: INFO os_vif [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:f8:7b,bridge_name='br-int',has_traffic_filtering=True,id=012765dc-7d42-41d5-b12b-34f3a2a7ef07,network=Network(a61d6a8a-acdb-4b52-bebc-1b90d89b25f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap012765dc-7d')
Nov 03 12:26:33 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T12:23:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1565525940',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1565525940',id=18,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK+6ZHlH1wKTndCYBIgu6ANG9Y2bIdl4FNNh18qkCmwdesNa7MOCTQ0WhOi5eCN1Qx65IdW7gj2YQX2eDDhNwRN+7BelIOC4SN1r8Sh9sZUc1XmzARyI8Hgp+1UUgZcu7Q==',key_name='tempest-keypair-788787740',keypairs=<?>,launch_index=0,launched_at=2023-11-03T12:25:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='32ecbf7a4b414f40ac9bb306bf9d4702',ramdisk_id='',reservation_id='r-2r3kgklh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1985714310',owner_user_name='tempest-TaggedBootDevicesTest_v242-1985714310-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T12:25:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='49d35d857fdf4e4f894a72610086d752',uuid=db88322f-c2ad-4622-9a1a-c45439d875a8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "412bab8b-015e-4df4-92c8-2ed71a8ca2f7", "address": "fa:16:3e:e5:6e:0a", "network": {"id": "103d876e-44c1-4732-b994-193d642fbd96", "bridge": "br-int", "label": "tempest-device-tagging-net2-1835187118", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "32ecbf7a4b414f40ac9bb306bf9d4702", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap412bab8b-01", "ovs_interfaceid": "412bab8b-015e-4df4-92c8-2ed71a8ca2f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Converting VIF {"id": "412bab8b-015e-4df4-92c8-2ed71a8ca2f7", "address": "fa:16:3e:e5:6e:0a", "network": {"id": "103d876e-44c1-4732-b994-193d642fbd96", "bridge": "br-int", "label": "tempest-device-tagging-net2-1835187118", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "32ecbf7a4b414f40ac9bb306bf9d4702", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap412bab8b-01", "ovs_interfaceid": "412bab8b-015e-4df4-92c8-2ed71a8ca2f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:6e:0a,bridge_name='br-int',has_traffic_filtering=True,id=412bab8b-015e-4df4-92c8-2ed71a8ca2f7,network=Network(103d876e-44c1-4732-b994-193d642fbd96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap412bab8b-01') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG os_vif [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:6e:0a,bridge_name='br-int',has_traffic_filtering=True,id=412bab8b-015e-4df4-92c8-2ed71a8ca2f7,network=Network(103d876e-44c1-4732-b994-193d642fbd96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap412bab8b-01') {{(pid=74960) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap412bab8b-01, bridge=br-int, if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7933366c-7a14-4112-b1ba-3ff16a0501e2) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:33 user nova-compute[74960]: INFO os_vif [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:6e:0a,bridge_name='br-int',has_traffic_filtering=True,id=412bab8b-015e-4df4-92c8-2ed71a8ca2f7,network=Network(103d876e-44c1-4732-b994-193d642fbd96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap412bab8b-01')
Nov 03 12:26:33 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T12:23:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1565525940',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1565525940',id=18,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK+6ZHlH1wKTndCYBIgu6ANG9Y2bIdl4FNNh18qkCmwdesNa7MOCTQ0WhOi5eCN1Qx65IdW7gj2YQX2eDDhNwRN+7BelIOC4SN1r8Sh9sZUc1XmzARyI8Hgp+1UUgZcu7Q==',key_name='tempest-keypair-788787740',keypairs=<?>,launch_index=0,launched_at=2023-11-03T12:25:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='32ecbf7a4b414f40ac9bb306bf9d4702',ramdisk_id='',reservation_id='r-2r3kgklh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1985714310',owner_user_name='tempest-TaggedBootDevicesTest_v242-1985714310-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T12:25:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='49d35d857fdf4e4f894a72610086d752',uuid=db88322f-c2ad-4622-9a1a-c45439d875a8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "20575d86-ea6c-4d0d-8190-70fe728bc7c1", "address": "fa:16:3e:7c:5c:e8", "network": {"id": "103d876e-44c1-4732-b994-193d642fbd96", "bridge": "br-int", "label": "tempest-device-tagging-net2-1835187118", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "32ecbf7a4b414f40ac9bb306bf9d4702", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20575d86-ea", "ovs_interfaceid": "20575d86-ea6c-4d0d-8190-70fe728bc7c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Converting VIF {"id": "20575d86-ea6c-4d0d-8190-70fe728bc7c1", "address": "fa:16:3e:7c:5c:e8", "network": {"id": "103d876e-44c1-4732-b994-193d642fbd96", "bridge": "br-int", "label": "tempest-device-tagging-net2-1835187118", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "32ecbf7a4b414f40ac9bb306bf9d4702", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20575d86-ea", "ovs_interfaceid": "20575d86-ea6c-4d0d-8190-70fe728bc7c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:5c:e8,bridge_name='br-int',has_traffic_filtering=True,id=20575d86-ea6c-4d0d-8190-70fe728bc7c1,network=Network(103d876e-44c1-4732-b994-193d642fbd96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20575d86-ea') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG os_vif [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:5c:e8,bridge_name='br-int',has_traffic_filtering=True,id=20575d86-ea6c-4d0d-8190-70fe728bc7c1,network=Network(103d876e-44c1-4732-b994-193d642fbd96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20575d86-ea') {{(pid=74960) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap20575d86-ea, bridge=br-int, if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c8969923-f6e8-4841-a9b6-5ac5a960bce1) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:33 user nova-compute[74960]: INFO os_vif [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:5c:e8,bridge_name='br-int',has_traffic_filtering=True,id=20575d86-ea6c-4d0d-8190-70fe728bc7c1,network=Network(103d876e-44c1-4732-b994-193d642fbd96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20575d86-ea')
Nov 03 12:26:33 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] calling os-brick to detach iSCSI Volume {{(pid=74960) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9aa420acb0>, {'target_iqn': 'iqn.2010-10.org.openstack:64202938-e4d3-4072-ba6e-f144187c01a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pzThHSen', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:26:33 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:26:33 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[a71b71ca-fe42-4676-a7b6-71f26b7fab61]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:64202938-e4d3-4072-ba6e-f144187c01a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fd1b7665-8415-44ab-81f5-84493c50a786\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f629b2b5-39ab-4ee3-9633-a534a39c93a5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 12:26:33 user nova-compute[74960]: No targets found.
Nov 03 12:26:33 user nova-compute[74960]: iSNS:
Nov 03 12:26:33 user nova-compute[74960]: No targets found.
Nov 03 12:26:33 user nova-compute[74960]: STATIC:
Nov 03 12:26:33 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:64202938-e4d3-4072-ba6e-f144187c01a9
Nov 03 12:26:33 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:26:33 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:26:33 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:fd1b7665-8415-44ab-81f5-84493c50a786
Nov 03 12:26:33 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:26:33 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:26:33 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815
Nov 03 12:26:33 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:26:33 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:26:33 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:f629b2b5-39ab-4ee3-9633-a534a39c93a5
Nov 03 12:26:33 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:26:33 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:26:33 user nova-compute[74960]: FIRMWARE:
Nov 03 12:26:33 user nova-compute[74960]: No targets found.
Nov 03 12:26:33 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 12:26:33 user nova-compute[74960]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 12:26:33 user nova-compute[74960]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74960) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64202938-e4d3-4072-ba6e-f144187c01a9', 0)] {{(pid=74960) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc85d60b-8a4d-4691-a768-7e3700177bd6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64202938-e4d3-4072-ba6e-f144187c01a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f629b2b5-39ab-4ee3-9633-a534a39c93a5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd1b7665-8415-44ab-81f5-84493c50a786\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG nova.compute.manager [req-fd0bdb42-1a3d-4ede-a6f5-711d158f29f8 req-203f04df-f788-4e94-a6f0-18f0f742864d service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Received event network-vif-plugged-dae50cff-c0b2-4c50-bd31-0d1bf1a17e55 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-fd0bdb42-1a3d-4ede-a6f5-711d158f29f8 req-203f04df-f788-4e94-a6f0-18f0f742864d service nova] Acquiring lock "db88322f-c2ad-4622-9a1a-c45439d875a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-fd0bdb42-1a3d-4ede-a6f5-711d158f29f8 req-203f04df-f788-4e94-a6f0-18f0f742864d service nova] Lock "db88322f-c2ad-4622-9a1a-c45439d875a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-fd0bdb42-1a3d-4ede-a6f5-711d158f29f8 req-203f04df-f788-4e94-a6f0-18f0f742864d service nova] Lock "db88322f-c2ad-4622-9a1a-c45439d875a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG nova.compute.manager [req-fd0bdb42-1a3d-4ede-a6f5-711d158f29f8 req-203f04df-f788-4e94-a6f0-18f0f742864d service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] No waiting events found dispatching network-vif-plugged-dae50cff-c0b2-4c50-bd31-0d1bf1a17e55 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:26:33 user nova-compute[74960]: WARNING nova.compute.manager [req-fd0bdb42-1a3d-4ede-a6f5-711d158f29f8 req-203f04df-f788-4e94-a6f0-18f0f742864d service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Received unexpected event network-vif-plugged-dae50cff-c0b2-4c50-bd31-0d1bf1a17e55 for instance with vm_state active and task_state deleting.
Nov 03 12:26:33 user nova-compute[74960]: DEBUG nova.compute.manager [req-fd0bdb42-1a3d-4ede-a6f5-711d158f29f8 req-203f04df-f788-4e94-a6f0-18f0f742864d service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Received event network-vif-unplugged-412bab8b-015e-4df4-92c8-2ed71a8ca2f7 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-fd0bdb42-1a3d-4ede-a6f5-711d158f29f8 req-203f04df-f788-4e94-a6f0-18f0f742864d service nova] Acquiring lock "db88322f-c2ad-4622-9a1a-c45439d875a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-fd0bdb42-1a3d-4ede-a6f5-711d158f29f8 req-203f04df-f788-4e94-a6f0-18f0f742864d service nova] Lock "db88322f-c2ad-4622-9a1a-c45439d875a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-fd0bdb42-1a3d-4ede-a6f5-711d158f29f8 req-203f04df-f788-4e94-a6f0-18f0f742864d service nova] Lock "db88322f-c2ad-4622-9a1a-c45439d875a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG nova.compute.manager [req-fd0bdb42-1a3d-4ede-a6f5-711d158f29f8 req-203f04df-f788-4e94-a6f0-18f0f742864d service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] No waiting events found dispatching network-vif-unplugged-412bab8b-015e-4df4-92c8-2ed71a8ca2f7 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG nova.compute.manager [req-fd0bdb42-1a3d-4ede-a6f5-711d158f29f8 req-203f04df-f788-4e94-a6f0-18f0f742864d service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Received event network-vif-unplugged-412bab8b-015e-4df4-92c8-2ed71a8ca2f7 for instance with task_state deleting. {{(pid=74960) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG nova.compute.manager [req-fd0bdb42-1a3d-4ede-a6f5-711d158f29f8 req-203f04df-f788-4e94-a6f0-18f0f742864d service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Received event network-vif-plugged-412bab8b-015e-4df4-92c8-2ed71a8ca2f7 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-fd0bdb42-1a3d-4ede-a6f5-711d158f29f8 req-203f04df-f788-4e94-a6f0-18f0f742864d service nova] Acquiring lock "db88322f-c2ad-4622-9a1a-c45439d875a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-fd0bdb42-1a3d-4ede-a6f5-711d158f29f8 req-203f04df-f788-4e94-a6f0-18f0f742864d service nova] Lock "db88322f-c2ad-4622-9a1a-c45439d875a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-fd0bdb42-1a3d-4ede-a6f5-711d158f29f8 req-203f04df-f788-4e94-a6f0-18f0f742864d service nova] Lock "db88322f-c2ad-4622-9a1a-c45439d875a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG nova.compute.manager [req-fd0bdb42-1a3d-4ede-a6f5-711d158f29f8 req-203f04df-f788-4e94-a6f0-18f0f742864d service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] No waiting events found dispatching network-vif-plugged-412bab8b-015e-4df4-92c8-2ed71a8ca2f7 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:26:33 user nova-compute[74960]: WARNING nova.compute.manager [req-fd0bdb42-1a3d-4ede-a6f5-711d158f29f8 req-203f04df-f788-4e94-a6f0-18f0f742864d service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Received unexpected event network-vif-plugged-412bab8b-015e-4df4-92c8-2ed71a8ca2f7 for instance with vm_state active and task_state deleting.
Nov 03 12:26:33 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b86419f-a119-493d-8a2a-e30d28c23e10]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64202938-e4d3-4072-ba6e-f144187c01a9 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd1b7665-8415-44ab-81f5-84493c50a786 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f629b2b5-39ab-4ee3-9633-a534a39c93a5 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815 (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64202938-e4d3-4072-ba6e-f144187c01a9 (non-flash)
Nov 03 12:26:33 user nova-compute[74960]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd1b7665-8415-44ab-81f5-84493c50a786 (non-flash)
Nov 03 12:26:33 user nova-compute[74960]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f629b2b5-39ab-4ee3-9633-a534a39c93a5 (non-flash)
Nov 03 12:26:33 user nova-compute[74960]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815 (non-flash)
Nov 03 12:26:33 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64202938-e4d3-4072-ba6e-f144187c01a9 (non-flash)
Nov 03 12:26:33 user nova-compute[74960]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd1b7665-8415-44ab-81f5-84493c50a786 (non-flash)
Nov 03 12:26:33 user nova-compute[74960]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f629b2b5-39ab-4ee3-9633-a534a39c93a5 (non-flash)
Nov 03 12:26:33 user nova-compute[74960]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815 (non-flash)
Nov 03 12:26:33 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9ab09bf010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64202938-e4d3-4072-ba6e-f144187c01a9'): ({'sdc'}, set())}) {{(pid=74960) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Removing single pathed devices sdc {{(pid=74960) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f1901e9-d59b-493c-9cda-9718cbfc6883]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[25e209e5-7adc-423f-a5c5-1d034f8a3459]: (4, ('ok\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Flushing IO for device /dev/sdc {{(pid=74960) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[c701a8aa-258e-41d3-ad60-9eccaff35239]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74960) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG nova.compute.manager [req-910dc230-b32d-48cf-9325-f60042d96a1b req-e8482731-cfa1-4819-b8e0-7e77d41d55a4 service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Received event network-vif-plugged-9207158b-c88b-44b8-b419-eba87e570339 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-910dc230-b32d-48cf-9325-f60042d96a1b req-e8482731-cfa1-4819-b8e0-7e77d41d55a4 service nova] Acquiring lock "db88322f-c2ad-4622-9a1a-c45439d875a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-910dc230-b32d-48cf-9325-f60042d96a1b req-e8482731-cfa1-4819-b8e0-7e77d41d55a4 service nova] Lock "db88322f-c2ad-4622-9a1a-c45439d875a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-910dc230-b32d-48cf-9325-f60042d96a1b req-e8482731-cfa1-4819-b8e0-7e77d41d55a4 service nova] Lock "db88322f-c2ad-4622-9a1a-c45439d875a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG nova.compute.manager [req-910dc230-b32d-48cf-9325-f60042d96a1b req-e8482731-cfa1-4819-b8e0-7e77d41d55a4 service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] No waiting events found dispatching network-vif-plugged-9207158b-c88b-44b8-b419-eba87e570339 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:26:33 user nova-compute[74960]: WARNING nova.compute.manager [req-910dc230-b32d-48cf-9325-f60042d96a1b req-e8482731-cfa1-4819-b8e0-7e77d41d55a4 service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Received unexpected event network-vif-plugged-9207158b-c88b-44b8-b419-eba87e570339 for instance with vm_state active and task_state deleting.
Nov 03 12:26:33 user nova-compute[74960]: DEBUG nova.compute.manager [req-910dc230-b32d-48cf-9325-f60042d96a1b req-e8482731-cfa1-4819-b8e0-7e77d41d55a4 service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Received event network-vif-unplugged-012765dc-7d42-41d5-b12b-34f3a2a7ef07 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-910dc230-b32d-48cf-9325-f60042d96a1b req-e8482731-cfa1-4819-b8e0-7e77d41d55a4 service nova] Acquiring lock "db88322f-c2ad-4622-9a1a-c45439d875a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-910dc230-b32d-48cf-9325-f60042d96a1b req-e8482731-cfa1-4819-b8e0-7e77d41d55a4 service nova] Lock "db88322f-c2ad-4622-9a1a-c45439d875a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-910dc230-b32d-48cf-9325-f60042d96a1b req-e8482731-cfa1-4819-b8e0-7e77d41d55a4 service nova] Lock "db88322f-c2ad-4622-9a1a-c45439d875a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG nova.compute.manager [req-910dc230-b32d-48cf-9325-f60042d96a1b req-e8482731-cfa1-4819-b8e0-7e77d41d55a4 service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] No waiting events found dispatching network-vif-unplugged-012765dc-7d42-41d5-b12b-34f3a2a7ef07 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG nova.compute.manager [req-910dc230-b32d-48cf-9325-f60042d96a1b req-e8482731-cfa1-4819-b8e0-7e77d41d55a4 service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Received event network-vif-unplugged-012765dc-7d42-41d5-b12b-34f3a2a7ef07 for instance with task_state deleting. {{(pid=74960) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG nova.compute.manager [req-910dc230-b32d-48cf-9325-f60042d96a1b req-e8482731-cfa1-4819-b8e0-7e77d41d55a4 service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Received event network-vif-plugged-012765dc-7d42-41d5-b12b-34f3a2a7ef07 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-910dc230-b32d-48cf-9325-f60042d96a1b req-e8482731-cfa1-4819-b8e0-7e77d41d55a4 service nova] Acquiring lock "db88322f-c2ad-4622-9a1a-c45439d875a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-910dc230-b32d-48cf-9325-f60042d96a1b req-e8482731-cfa1-4819-b8e0-7e77d41d55a4 service nova] Lock "db88322f-c2ad-4622-9a1a-c45439d875a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-910dc230-b32d-48cf-9325-f60042d96a1b req-e8482731-cfa1-4819-b8e0-7e77d41d55a4 service nova] Lock "db88322f-c2ad-4622-9a1a-c45439d875a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG nova.compute.manager [req-910dc230-b32d-48cf-9325-f60042d96a1b req-e8482731-cfa1-4819-b8e0-7e77d41d55a4 service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] No waiting events found dispatching network-vif-plugged-012765dc-7d42-41d5-b12b-34f3a2a7ef07 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:26:33 user nova-compute[74960]: WARNING nova.compute.manager [req-910dc230-b32d-48cf-9325-f60042d96a1b req-e8482731-cfa1-4819-b8e0-7e77d41d55a4 service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Received unexpected event network-vif-plugged-012765dc-7d42-41d5-b12b-34f3a2a7ef07 for instance with vm_state active and task_state deleting.
Nov 03 12:26:33 user nova-compute[74960]: DEBUG nova.compute.manager [req-910dc230-b32d-48cf-9325-f60042d96a1b req-e8482731-cfa1-4819-b8e0-7e77d41d55a4 service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Received event network-vif-unplugged-20575d86-ea6c-4d0d-8190-70fe728bc7c1 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-910dc230-b32d-48cf-9325-f60042d96a1b req-e8482731-cfa1-4819-b8e0-7e77d41d55a4 service nova] Acquiring lock "db88322f-c2ad-4622-9a1a-c45439d875a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-910dc230-b32d-48cf-9325-f60042d96a1b req-e8482731-cfa1-4819-b8e0-7e77d41d55a4 service nova] Lock "db88322f-c2ad-4622-9a1a-c45439d875a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-910dc230-b32d-48cf-9325-f60042d96a1b req-e8482731-cfa1-4819-b8e0-7e77d41d55a4 service nova] Lock "db88322f-c2ad-4622-9a1a-c45439d875a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG nova.compute.manager [req-910dc230-b32d-48cf-9325-f60042d96a1b req-e8482731-cfa1-4819-b8e0-7e77d41d55a4 service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] No waiting events found dispatching network-vif-unplugged-20575d86-ea6c-4d0d-8190-70fe728bc7c1 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG nova.compute.manager [req-910dc230-b32d-48cf-9325-f60042d96a1b req-e8482731-cfa1-4819-b8e0-7e77d41d55a4 service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Received event network-vif-unplugged-20575d86-ea6c-4d0d-8190-70fe728bc7c1 for instance with task_state deleting. {{(pid=74960) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG nova.compute.manager [req-910dc230-b32d-48cf-9325-f60042d96a1b req-e8482731-cfa1-4819-b8e0-7e77d41d55a4 service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Received event network-vif-plugged-20575d86-ea6c-4d0d-8190-70fe728bc7c1 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-910dc230-b32d-48cf-9325-f60042d96a1b req-e8482731-cfa1-4819-b8e0-7e77d41d55a4 service nova] Acquiring lock "db88322f-c2ad-4622-9a1a-c45439d875a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-910dc230-b32d-48cf-9325-f60042d96a1b req-e8482731-cfa1-4819-b8e0-7e77d41d55a4 service nova] Lock "db88322f-c2ad-4622-9a1a-c45439d875a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-910dc230-b32d-48cf-9325-f60042d96a1b req-e8482731-cfa1-4819-b8e0-7e77d41d55a4 service nova] Lock "db88322f-c2ad-4622-9a1a-c45439d875a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG nova.compute.manager [req-910dc230-b32d-48cf-9325-f60042d96a1b req-e8482731-cfa1-4819-b8e0-7e77d41d55a4 service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] No waiting events found dispatching network-vif-plugged-20575d86-ea6c-4d0d-8190-70fe728bc7c1 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:26:33 user nova-compute[74960]: WARNING nova.compute.manager [req-910dc230-b32d-48cf-9325-f60042d96a1b req-e8482731-cfa1-4819-b8e0-7e77d41d55a4 service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Received unexpected event network-vif-plugged-20575d86-ea6c-4d0d-8190-70fe728bc7c1 for instance with vm_state active and task_state deleting.
Nov 03 12:26:33 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce6c762b-368d-4dd1-9dbf-42b1129a3486]: (4, ('1', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74960) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] SCSI volumes sdc have been removed. {{(pid=74960) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64202938-e4d3-4072-ba6e-f144187c01a9')] {{(pid=74960) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64202938-e4d3-4072-ba6e-f144187c01a9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64202938-e4d3-4072-ba6e-f144187c01a9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[332811ae-5d3c-4fd7-8ead-234e1548af86]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64202938-e4d3-4072-ba6e-f144187c01a9 -p 172.16.0.220:3260 --logout {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64202938-e4d3-4072-ba6e-f144187c01a9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1df397f-2914-4eb1-9a2e-873fe7beb380]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:64202938-e4d3-4072-ba6e-f144187c01a9, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:64202938-e4d3-4072-ba6e-f144187c01a9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:64202938-e4d3-4072-ba6e-f144187c01a9, portal: 172.16.0.220,3260]
Nov 03 12:26:33 user nova-compute[74960]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:64202938-e4d3-4072-ba6e-f144187c01a9, portal: 172.16.0.220,3260] successful.
Nov 03 12:26:33 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64202938-e4d3-4072-ba6e-f144187c01a9 -p 172.16.0.220:3260 --op delete {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64202938-e4d3-4072-ba6e-f144187c01a9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c929f1d-8fec-45e7-b4ee-03c286030bd3]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] <== disconnect_volume: return (339ms) None {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Disconnected iSCSI Volume {{(pid=74960) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] calling os-brick to detach iSCSI Volume {{(pid=74960) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9aa420acb0>, {'target_iqn': 'iqn.2010-10.org.openstack:fd1b7665-8415-44ab-81f5-84493c50a786', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FXhkgQTi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:26:33 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:26:33 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:26:33 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:26:34 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:26:34 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[05020a1b-685a-4734-a12b-1483209127da]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fd1b7665-8415-44ab-81f5-84493c50a786\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f629b2b5-39ab-4ee3-9633-a534a39c93a5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:26:34 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 12:26:34 user nova-compute[74960]: No targets found.
Nov 03 12:26:34 user nova-compute[74960]: iSNS:
Nov 03 12:26:34 user nova-compute[74960]: No targets found.
Nov 03 12:26:34 user nova-compute[74960]: STATIC:
Nov 03 12:26:34 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:fd1b7665-8415-44ab-81f5-84493c50a786
Nov 03 12:26:34 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:26:34 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:26:34 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815
Nov 03 12:26:34 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:26:34 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:26:34 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:f629b2b5-39ab-4ee3-9633-a534a39c93a5
Nov 03 12:26:34 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:26:34 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:26:34 user nova-compute[74960]: FIRMWARE:
Nov 03 12:26:34 user nova-compute[74960]: No targets found.
Nov 03 12:26:34 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:26:34 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 12:26:34 user nova-compute[74960]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 12:26:34 user nova-compute[74960]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74960) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 12:26:34 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd1b7665-8415-44ab-81f5-84493c50a786', 0)] {{(pid=74960) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 12:26:34 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:26:34 user nova-compute[74960]: DEBUG nova.compute.manager [req-b211b74f-d225-45b8-aace-81d9353096e0 req-d0f4a7a2-3574-486e-b76f-cbe8584d07dc service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Received event network-vif-plugged-72da800d-493b-4dc6-8988-1259e2423188 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:26:34 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-b211b74f-d225-45b8-aace-81d9353096e0 req-d0f4a7a2-3574-486e-b76f-cbe8584d07dc service nova] Acquiring lock "db88322f-c2ad-4622-9a1a-c45439d875a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:26:34 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-b211b74f-d225-45b8-aace-81d9353096e0 req-d0f4a7a2-3574-486e-b76f-cbe8584d07dc service nova] Lock "db88322f-c2ad-4622-9a1a-c45439d875a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:26:34 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-b211b74f-d225-45b8-aace-81d9353096e0 req-d0f4a7a2-3574-486e-b76f-cbe8584d07dc service nova] Lock "db88322f-c2ad-4622-9a1a-c45439d875a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:26:34 user nova-compute[74960]: DEBUG nova.compute.manager [req-b211b74f-d225-45b8-aace-81d9353096e0 req-d0f4a7a2-3574-486e-b76f-cbe8584d07dc service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] No waiting events found dispatching network-vif-plugged-72da800d-493b-4dc6-8988-1259e2423188 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:26:34 user nova-compute[74960]: WARNING nova.compute.manager [req-b211b74f-d225-45b8-aace-81d9353096e0 req-d0f4a7a2-3574-486e-b76f-cbe8584d07dc service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Received unexpected event network-vif-plugged-72da800d-493b-4dc6-8988-1259e2423188 for instance with vm_state active and task_state deleting.
Nov 03 12:26:34 user nova-compute[74960]: DEBUG nova.compute.manager [req-b211b74f-d225-45b8-aace-81d9353096e0 req-d0f4a7a2-3574-486e-b76f-cbe8584d07dc service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Received event network-vif-unplugged-b905e727-4d81-4518-8cae-06f4e64bcccc {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:26:34 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-b211b74f-d225-45b8-aace-81d9353096e0 req-d0f4a7a2-3574-486e-b76f-cbe8584d07dc service nova] Acquiring lock "db88322f-c2ad-4622-9a1a-c45439d875a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:26:34 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-b211b74f-d225-45b8-aace-81d9353096e0 req-d0f4a7a2-3574-486e-b76f-cbe8584d07dc service nova] Lock "db88322f-c2ad-4622-9a1a-c45439d875a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:26:34 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-b211b74f-d225-45b8-aace-81d9353096e0 req-d0f4a7a2-3574-486e-b76f-cbe8584d07dc service nova] Lock "db88322f-c2ad-4622-9a1a-c45439d875a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:26:34 user nova-compute[74960]: DEBUG nova.compute.manager [req-b211b74f-d225-45b8-aace-81d9353096e0 req-d0f4a7a2-3574-486e-b76f-cbe8584d07dc service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] No waiting events found dispatching network-vif-unplugged-b905e727-4d81-4518-8cae-06f4e64bcccc {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:26:34 user nova-compute[74960]: DEBUG nova.compute.manager [req-b211b74f-d225-45b8-aace-81d9353096e0 req-d0f4a7a2-3574-486e-b76f-cbe8584d07dc service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Received event network-vif-unplugged-b905e727-4d81-4518-8cae-06f4e64bcccc for instance with task_state deleting. {{(pid=74960) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 12:26:34 user nova-compute[74960]: DEBUG nova.compute.manager [req-b211b74f-d225-45b8-aace-81d9353096e0 req-d0f4a7a2-3574-486e-b76f-cbe8584d07dc service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Received event network-vif-plugged-b905e727-4d81-4518-8cae-06f4e64bcccc {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:26:34 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-b211b74f-d225-45b8-aace-81d9353096e0 req-d0f4a7a2-3574-486e-b76f-cbe8584d07dc service nova] Acquiring lock "db88322f-c2ad-4622-9a1a-c45439d875a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:26:34 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-b211b74f-d225-45b8-aace-81d9353096e0 req-d0f4a7a2-3574-486e-b76f-cbe8584d07dc service nova] Lock "db88322f-c2ad-4622-9a1a-c45439d875a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:26:34 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-b211b74f-d225-45b8-aace-81d9353096e0 req-d0f4a7a2-3574-486e-b76f-cbe8584d07dc service nova] Lock "db88322f-c2ad-4622-9a1a-c45439d875a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:26:34 user nova-compute[74960]: DEBUG nova.compute.manager [req-b211b74f-d225-45b8-aace-81d9353096e0 req-d0f4a7a2-3574-486e-b76f-cbe8584d07dc service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] No waiting events found dispatching network-vif-plugged-b905e727-4d81-4518-8cae-06f4e64bcccc {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:26:34 user nova-compute[74960]: WARNING nova.compute.manager [req-b211b74f-d225-45b8-aace-81d9353096e0 req-d0f4a7a2-3574-486e-b76f-cbe8584d07dc service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Received unexpected event network-vif-plugged-b905e727-4d81-4518-8cae-06f4e64bcccc for instance with vm_state active and task_state deleting.
Nov 03 12:26:34 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:26:34 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a031a13-dd35-4f67-9e8f-61d002e13aa3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f629b2b5-39ab-4ee3-9633-a534a39c93a5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd1b7665-8415-44ab-81f5-84493c50a786\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:26:34 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:26:34 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:26:34 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b3e5e5-d163-47d2-bb97-0ecaa3824037]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd1b7665-8415-44ab-81f5-84493c50a786 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f629b2b5-39ab-4ee3-9633-a534a39c93a5 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815 (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:26:34 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd1b7665-8415-44ab-81f5-84493c50a786 (non-flash)
Nov 03 12:26:34 user nova-compute[74960]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f629b2b5-39ab-4ee3-9633-a534a39c93a5 (non-flash)
Nov 03 12:26:34 user nova-compute[74960]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815 (non-flash)
Nov 03 12:26:34 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:26:34 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd1b7665-8415-44ab-81f5-84493c50a786 (non-flash)
Nov 03 12:26:34 user nova-compute[74960]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f629b2b5-39ab-4ee3-9633-a534a39c93a5 (non-flash)
Nov 03 12:26:34 user nova-compute[74960]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815 (non-flash)
Nov 03 12:26:34 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:26:34 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9a8c5d9630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd1b7665-8415-44ab-81f5-84493c50a786'): ({'sdd'}, set())}) {{(pid=74960) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 12:26:34 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Removing single pathed devices sdd {{(pid=74960) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 12:26:34 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:26:34 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:26:34 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e859e63-be4b-4293-8f79-e1879719d9c5]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:26:34 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:26:34 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.017s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:26:34 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[55064d35-3c9f-4f86-8075-609ec7978ae6]: (4, ('ok\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:26:34 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Flushing IO for device /dev/sdd {{(pid=74960) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 12:26:34 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:26:34 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:26:34 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[33fc23ae-1368-46ab-84f8-27d246f50490]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:26:34 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74960) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 12:26:34 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:26:34 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.037s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:26:34 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ce7dd53-f99a-41bc-8a83-d8faa18a96cd]: (4, ('1', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:26:34 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74960) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 12:26:34 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] SCSI volumes sdd have been removed. {{(pid=74960) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 12:26:34 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd1b7665-8415-44ab-81f5-84493c50a786')] {{(pid=74960) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 12:26:34 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd1b7665-8415-44ab-81f5-84493c50a786 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:26:34 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd1b7665-8415-44ab-81f5-84493c50a786 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:26:34 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[d462de2e-cd9f-4dab-a003-414061f9477e]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:26:34 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:26:34 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd1b7665-8415-44ab-81f5-84493c50a786 -p 172.16.0.220:3260 --logout {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:26:34 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd1b7665-8415-44ab-81f5-84493c50a786 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:26:34 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fbfea5c-b6ff-4f80-8746-217f55be7fed]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:fd1b7665-8415-44ab-81f5-84493c50a786, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:fd1b7665-8415-44ab-81f5-84493c50a786, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:26:34 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:fd1b7665-8415-44ab-81f5-84493c50a786, portal: 172.16.0.220,3260]
Nov 03 12:26:34 user nova-compute[74960]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:fd1b7665-8415-44ab-81f5-84493c50a786, portal: 172.16.0.220,3260] successful.
Nov 03 12:26:34 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:26:34 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd1b7665-8415-44ab-81f5-84493c50a786 -p 172.16.0.220:3260 --op delete {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:26:34 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd1b7665-8415-44ab-81f5-84493c50a786 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:26:34 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8b7af1d-5725-48bb-9933-9e7094d68932]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:26:34 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:26:34 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:26:34 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] <== disconnect_volume: return (322ms) None {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:26:34 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Disconnected iSCSI Volume {{(pid=74960) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 12:26:34 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] calling os-brick to detach iSCSI Volume {{(pid=74960) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 12:26:34 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9aa420acb0>, {'target_iqn': 'iqn.2010-10.org.openstack:f629b2b5-39ab-4ee3-9633-a534a39c93a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xvTyfXno', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:26:34 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:26:34 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:26:34 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:26:34 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:26:34 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:26:34 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[145b496d-64f4-4cbc-bf6d-824a1e541b8b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f629b2b5-39ab-4ee3-9633-a534a39c93a5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:26:34 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 12:26:34 user nova-compute[74960]: No targets found.
Nov 03 12:26:34 user nova-compute[74960]: iSNS:
Nov 03 12:26:34 user nova-compute[74960]: No targets found.
Nov 03 12:26:34 user nova-compute[74960]: STATIC:
Nov 03 12:26:34 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815
Nov 03 12:26:34 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:26:34 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:26:34 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:f629b2b5-39ab-4ee3-9633-a534a39c93a5
Nov 03 12:26:34 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:26:34 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:26:34 user nova-compute[74960]: FIRMWARE:
Nov 03 12:26:34 user nova-compute[74960]: No targets found.
Nov 03 12:26:34 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:26:34 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 12:26:34 user nova-compute[74960]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 12:26:34 user nova-compute[74960]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74960) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 12:26:34 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f629b2b5-39ab-4ee3-9633-a534a39c93a5', 0)] {{(pid=74960) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 12:26:34 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:26:34 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:26:34 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e6f3a21-4bac-448e-8085-6e0de7a629a6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f629b2b5-39ab-4ee3-9633-a534a39c93a5\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:26:34 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:26:34 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:26:34 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e321b82-f405-4820-bb37-f68873cd9bae]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f629b2b5-39ab-4ee3-9633-a534a39c93a5 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815 (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:26:34 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f629b2b5-39ab-4ee3-9633-a534a39c93a5 (non-flash)
Nov 03 12:26:34 user nova-compute[74960]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815 (non-flash)
Nov 03 12:26:34 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:26:34 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f629b2b5-39ab-4ee3-9633-a534a39c93a5 (non-flash)
Nov 03 12:26:34 user nova-compute[74960]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815 (non-flash)
Nov 03 12:26:34 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:26:34 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9aa42d13f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f629b2b5-39ab-4ee3-9633-a534a39c93a5'): ({'sde'}, set())}) {{(pid=74960) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 12:26:34 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Removing single pathed devices sde {{(pid=74960) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 12:26:34 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:26:34 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:26:34 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9dd3d22-bdb9-4c0f-8540-1eba7b68c8ca]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:26:34 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:26:34 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:26:34 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2d2fdeb-dca1-4a6e-b0fc-e6409017c784]: (4, ('ok\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:26:34 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Flushing IO for device /dev/sde {{(pid=74960) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 12:26:34 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:26:34 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:26:34 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddf76985-f584-4d8e-8c42-fd8b7242f7b8]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:26:34 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74960) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 12:26:34 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:26:34 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.040s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:26:34 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[690cd7ac-aa37-4b08-ac06-0fd2218ce854]: (4, ('1', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:26:34 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74960) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 12:26:34 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] SCSI volumes sde have been removed. {{(pid=74960) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 12:26:34 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f629b2b5-39ab-4ee3-9633-a534a39c93a5')] {{(pid=74960) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 12:26:34 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f629b2b5-39ab-4ee3-9633-a534a39c93a5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:26:34 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f629b2b5-39ab-4ee3-9633-a534a39c93a5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:26:34 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad66aed6-f398-4f58-9ab4-e51e0bc7f6f8]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:26:34 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:26:34 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f629b2b5-39ab-4ee3-9633-a534a39c93a5 -p 172.16.0.220:3260 --logout {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:26:34 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f629b2b5-39ab-4ee3-9633-a534a39c93a5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:26:34 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[11cc8ec4-7bd7-4846-8e33-d19df2d25c90]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:f629b2b5-39ab-4ee3-9633-a534a39c93a5, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:f629b2b5-39ab-4ee3-9633-a534a39c93a5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:26:34 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:f629b2b5-39ab-4ee3-9633-a534a39c93a5, portal: 172.16.0.220,3260]
Nov 03 12:26:34 user nova-compute[74960]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:f629b2b5-39ab-4ee3-9633-a534a39c93a5, portal: 172.16.0.220,3260] successful.
Nov 03 12:26:34 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:26:34 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f629b2b5-39ab-4ee3-9633-a534a39c93a5 -p 172.16.0.220:3260 --op delete {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:26:34 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f629b2b5-39ab-4ee3-9633-a534a39c93a5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:26:34 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[a269d6ad-3ff7-4dae-af25-708aeaa874b9]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:26:34 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:26:34 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:26:34 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] <== disconnect_volume: return (297ms) None {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:26:34 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Disconnected iSCSI Volume {{(pid=74960) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 12:26:34 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Deleting instance files /opt/stack/data/nova/instances/db88322f-c2ad-4622-9a1a-c45439d875a8_del
Nov 03 12:26:34 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Deletion of /opt/stack/data/nova/instances/db88322f-c2ad-4622-9a1a-c45439d875a8_del complete
Nov 03 12:26:34 user nova-compute[74960]: INFO nova.compute.manager [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Took 3.48 seconds to destroy the instance on the hypervisor.
Nov 03 12:26:34 user nova-compute[74960]: DEBUG oslo.service.loopingcall [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74960) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 12:26:34 user nova-compute[74960]: DEBUG nova.compute.manager [-] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Deallocating network for instance {{(pid=74960) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 12:26:34 user nova-compute[74960]: DEBUG nova.network.neutron [-] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] deallocate_for_instance() {{(pid=74960) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 12:26:36 user nova-compute[74960]: DEBUG nova.compute.manager [req-2e7cdc0b-250c-4ad6-975a-6b877c3df62b req-c79ba624-2049-4e7a-9579-cfea4b94a5a1 service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Received event network-vif-deleted-20575d86-ea6c-4d0d-8190-70fe728bc7c1 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:26:36 user nova-compute[74960]: INFO nova.compute.manager [req-2e7cdc0b-250c-4ad6-975a-6b877c3df62b req-c79ba624-2049-4e7a-9579-cfea4b94a5a1 service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Neutron deleted interface 20575d86-ea6c-4d0d-8190-70fe728bc7c1; detaching it from the instance and deleting it from the info cache
Nov 03 12:26:36 user nova-compute[74960]: DEBUG nova.network.neutron [req-2e7cdc0b-250c-4ad6-975a-6b877c3df62b req-c79ba624-2049-4e7a-9579-cfea4b94a5a1 service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Updating instance_info_cache with network_info: [{"id": "dae50cff-c0b2-4c50-bd31-0d1bf1a17e55", "address": "fa:16:3e:c8:88:99", "network": {"id": "f771bed5-ff95-49cd-9871-08b128de2619", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-756048610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32ecbf7a4b414f40ac9bb306bf9d4702", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdae50cff-c0", "ovs_interfaceid": "dae50cff-c0b2-4c50-bd31-0d1bf1a17e55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9207158b-c88b-44b8-b419-eba87e570339", "address": "fa:16:3e:1a:2c:15", "network": {"id": "a61d6a8a-acdb-4b52-bebc-1b90d89b25f2", "bridge": "br-int", "label": "tempest-device-tagging-net1-20653421", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32ecbf7a4b414f40ac9bb306bf9d4702", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9207158b-c8", "ovs_interfaceid": "9207158b-c88b-44b8-b419-eba87e570339", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "72da800d-493b-4dc6-8988-1259e2423188", "address": "fa:16:3e:ec:7f:b8", "network": {"id": "a61d6a8a-acdb-4b52-bebc-1b90d89b25f2", "bridge": "br-int", "label": "tempest-device-tagging-net1-20653421", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32ecbf7a4b414f40ac9bb306bf9d4702", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72da800d-49", "ovs_interfaceid": "72da800d-493b-4dc6-8988-1259e2423188", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b905e727-4d81-4518-8cae-06f4e64bcccc", "address": "fa:16:3e:b9:71:c0", "network": {"id": "a61d6a8a-acdb-4b52-bebc-1b90d89b25f2", "bridge": "br-int", "label": "tempest-device-tagging-net1-20653421", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32ecbf7a4b414f40ac9bb306bf9d4702", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb905e727-4d", "ovs_interfaceid": "b905e727-4d81-4518-8cae-06f4e64bcccc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "012765dc-7d42-41d5-b12b-34f3a2a7ef07", "address": "fa:16:3e:d6:f8:7b", "network": {"id": "a61d6a8a-acdb-4b52-bebc-1b90d89b25f2", "bridge": "br-int", "label": "tempest-device-tagging-net1-20653421", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32ecbf7a4b414f40ac9bb306bf9d4702", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap012765dc-7d", "ovs_interfaceid": "012765dc-7d42-41d5-b12b-34f3a2a7ef07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "412bab8b-015e-4df4-92c8-2ed71a8ca2f7", "address": "fa:16:3e:e5:6e:0a", "network": {"id": "103d876e-44c1-4732-b994-193d642fbd96", "bridge": "br-int", "label": "tempest-device-tagging-net2-1835187118", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "32ecbf7a4b414f40ac9bb306bf9d4702", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap412bab8b-01", "ovs_interfaceid": "412bab8b-015e-4df4-92c8-2ed71a8ca2f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:26:36 user nova-compute[74960]: DEBUG nova.compute.manager [req-2e7cdc0b-250c-4ad6-975a-6b877c3df62b req-c79ba624-2049-4e7a-9579-cfea4b94a5a1 service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Detach interface failed, port_id=20575d86-ea6c-4d0d-8190-70fe728bc7c1, reason: Instance db88322f-c2ad-4622-9a1a-c45439d875a8 could not be found. {{(pid=74960) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 03 12:26:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:38 user nova-compute[74960]: DEBUG nova.network.neutron [-] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Updating instance_info_cache with network_info: [] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:26:38 user nova-compute[74960]: INFO nova.compute.manager [-] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Took 3.92 seconds to deallocate network for instance.
Nov 03 12:26:38 user nova-compute[74960]: DEBUG nova.compute.manager [req-62629b3d-2023-451f-a1ac-f8dfff55f887 req-19f76110-5091-4c1f-9e45-e35b0f820abe service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Received event network-vif-deleted-412bab8b-015e-4df4-92c8-2ed71a8ca2f7 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:26:38 user nova-compute[74960]: DEBUG nova.compute.manager [req-62629b3d-2023-451f-a1ac-f8dfff55f887 req-19f76110-5091-4c1f-9e45-e35b0f820abe service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Received event network-vif-deleted-dae50cff-c0b2-4c50-bd31-0d1bf1a17e55 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:26:38 user nova-compute[74960]: DEBUG nova.compute.manager [req-62629b3d-2023-451f-a1ac-f8dfff55f887 req-19f76110-5091-4c1f-9e45-e35b0f820abe service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Received event network-vif-deleted-012765dc-7d42-41d5-b12b-34f3a2a7ef07 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:26:38 user nova-compute[74960]: DEBUG nova.compute.manager [req-62629b3d-2023-451f-a1ac-f8dfff55f887 req-19f76110-5091-4c1f-9e45-e35b0f820abe service nova] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Received event network-vif-deleted-b905e727-4d81-4518-8cae-06f4e64bcccc {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:26:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:39 user nova-compute[74960]: ERROR nova.volume.cinder [None req-7a68e76e-bf35-4a17-86be-8b5176a97596 tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] Update attachment failed for attachment 4e9f9263-5267-4ac7-ae19-1bd27486bf34. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-93732d97-6ea0-4ca7-b93d-f88ad001309c) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-93732d97-6ea0-4ca7-b93d-f88ad001309c)
Nov 03 12:26:40 user nova-compute[74960]: ERROR nova.compute.manager [None req-7a68e76e-bf35-4a17-86be-8b5176a97596 tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] [instance: 9951fab7-4984-408e-94ca-11eab615ff25] Failed to attach 6e4fa603-3516-40fc-a324-bdd390ec4df1 at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-93732d97-6ea0-4ca7-b93d-f88ad001309c)
Nov 03 12:26:40 user nova-compute[74960]: ERROR nova.compute.manager [instance: 9951fab7-4984-408e-94ca-11eab615ff25] Traceback (most recent call last):
Nov 03 12:26:40 user nova-compute[74960]: ERROR nova.compute.manager [instance: 9951fab7-4984-408e-94ca-11eab615ff25]   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 03 12:26:40 user nova-compute[74960]: ERROR nova.compute.manager [instance: 9951fab7-4984-408e-94ca-11eab615ff25]     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 03 12:26:40 user nova-compute[74960]: ERROR nova.compute.manager [instance: 9951fab7-4984-408e-94ca-11eab615ff25]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 03 12:26:40 user nova-compute[74960]: ERROR nova.compute.manager [instance: 9951fab7-4984-408e-94ca-11eab615ff25]     ret_val = method(obj, context, *args, **kwargs)
Nov 03 12:26:40 user nova-compute[74960]: ERROR nova.compute.manager [instance: 9951fab7-4984-408e-94ca-11eab615ff25]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 03 12:26:40 user nova-compute[74960]: ERROR nova.compute.manager [instance: 9951fab7-4984-408e-94ca-11eab615ff25]     self._do_attach(context, instance, volume, volume_api,
Nov 03 12:26:40 user nova-compute[74960]: ERROR nova.compute.manager [instance: 9951fab7-4984-408e-94ca-11eab615ff25]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 03 12:26:40 user nova-compute[74960]: ERROR nova.compute.manager [instance: 9951fab7-4984-408e-94ca-11eab615ff25]     self._volume_attach(context, volume, connector, instance,
Nov 03 12:26:40 user nova-compute[74960]: ERROR nova.compute.manager [instance: 9951fab7-4984-408e-94ca-11eab615ff25]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 03 12:26:40 user nova-compute[74960]: ERROR nova.compute.manager [instance: 9951fab7-4984-408e-94ca-11eab615ff25]     connection_info = volume_api.attachment_update(
Nov 03 12:26:40 user nova-compute[74960]: ERROR nova.compute.manager [instance: 9951fab7-4984-408e-94ca-11eab615ff25]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 03 12:26:40 user nova-compute[74960]: ERROR nova.compute.manager [instance: 9951fab7-4984-408e-94ca-11eab615ff25]     res = method(self, ctx, *args, **kwargs)
Nov 03 12:26:40 user nova-compute[74960]: ERROR nova.compute.manager [instance: 9951fab7-4984-408e-94ca-11eab615ff25]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 03 12:26:40 user nova-compute[74960]: ERROR nova.compute.manager [instance: 9951fab7-4984-408e-94ca-11eab615ff25]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 03 12:26:40 user nova-compute[74960]: ERROR nova.compute.manager [instance: 9951fab7-4984-408e-94ca-11eab615ff25]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 03 12:26:40 user nova-compute[74960]: ERROR nova.compute.manager [instance: 9951fab7-4984-408e-94ca-11eab615ff25]     with excutils.save_and_reraise_exception():
Nov 03 12:26:40 user nova-compute[74960]: ERROR nova.compute.manager [instance: 9951fab7-4984-408e-94ca-11eab615ff25]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 03 12:26:40 user nova-compute[74960]: ERROR nova.compute.manager [instance: 9951fab7-4984-408e-94ca-11eab615ff25]     self.force_reraise()
Nov 03 12:26:40 user nova-compute[74960]: ERROR nova.compute.manager [instance: 9951fab7-4984-408e-94ca-11eab615ff25]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 03 12:26:40 user nova-compute[74960]: ERROR nova.compute.manager [instance: 9951fab7-4984-408e-94ca-11eab615ff25]     raise self.value
Nov 03 12:26:40 user nova-compute[74960]: ERROR nova.compute.manager [instance: 9951fab7-4984-408e-94ca-11eab615ff25]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 03 12:26:40 user nova-compute[74960]: ERROR nova.compute.manager [instance: 9951fab7-4984-408e-94ca-11eab615ff25]     context, '3.44', skip_version_check=True).attachments.update(
Nov 03 12:26:40 user nova-compute[74960]: ERROR nova.compute.manager [instance: 9951fab7-4984-408e-94ca-11eab615ff25]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 03 12:26:40 user nova-compute[74960]: ERROR nova.compute.manager [instance: 9951fab7-4984-408e-94ca-11eab615ff25]     return method.func(obj, *args, **kwargs)
Nov 03 12:26:40 user nova-compute[74960]: ERROR nova.compute.manager [instance: 9951fab7-4984-408e-94ca-11eab615ff25]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 03 12:26:40 user nova-compute[74960]: ERROR nova.compute.manager [instance: 9951fab7-4984-408e-94ca-11eab615ff25]     resp = self._update('/attachments/%s' % id, body)
Nov 03 12:26:40 user nova-compute[74960]: ERROR nova.compute.manager [instance: 9951fab7-4984-408e-94ca-11eab615ff25]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 03 12:26:40 user nova-compute[74960]: ERROR nova.compute.manager [instance: 9951fab7-4984-408e-94ca-11eab615ff25]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 03 12:26:40 user nova-compute[74960]: ERROR nova.compute.manager [instance: 9951fab7-4984-408e-94ca-11eab615ff25]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 03 12:26:40 user nova-compute[74960]: ERROR nova.compute.manager [instance: 9951fab7-4984-408e-94ca-11eab615ff25]     return self._cs_request(url, 'PUT', **kwargs)
Nov 03 12:26:40 user nova-compute[74960]: ERROR nova.compute.manager [instance: 9951fab7-4984-408e-94ca-11eab615ff25]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 03 12:26:40 user nova-compute[74960]: ERROR nova.compute.manager [instance: 9951fab7-4984-408e-94ca-11eab615ff25]     return self.request(url, method, **kwargs)
Nov 03 12:26:40 user nova-compute[74960]: ERROR nova.compute.manager [instance: 9951fab7-4984-408e-94ca-11eab615ff25]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 03 12:26:40 user nova-compute[74960]: ERROR nova.compute.manager [instance: 9951fab7-4984-408e-94ca-11eab615ff25]     raise exceptions.from_response(resp, body)
Nov 03 12:26:40 user nova-compute[74960]: ERROR nova.compute.manager [instance: 9951fab7-4984-408e-94ca-11eab615ff25] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-93732d97-6ea0-4ca7-b93d-f88ad001309c)
Nov 03 12:26:40 user nova-compute[74960]: ERROR nova.compute.manager [instance: 9951fab7-4984-408e-94ca-11eab615ff25] 
Nov 03 12:26:40 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-7a68e76e-bf35-4a17-86be-8b5176a97596 tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] Lock "9951fab7-4984-408e-94ca-11eab615ff25" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.377s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:26:40 user nova-compute[74960]: ERROR oslo_messaging.rpc.server [None req-7a68e76e-bf35-4a17-86be-8b5176a97596 tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-93732d97-6ea0-4ca7-b93d-f88ad001309c)
Nov 03 12:26:40 user nova-compute[74960]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 03 12:26:40 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 03 12:26:40 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 03 12:26:40 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 03 12:26:40 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 03 12:26:40 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 03 12:26:40 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 03 12:26:40 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 03 12:26:40 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 03 12:26:40 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 03 12:26:40 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 03 12:26:40 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 03 12:26:40 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 03 12:26:40 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 03 12:26:40 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 03 12:26:40 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Nov 03 12:26:40 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 03 12:26:40 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Nov 03 12:26:40 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 03 12:26:40 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 03 12:26:40 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 03 12:26:40 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 03 12:26:40 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 03 12:26:40 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Nov 03 12:26:40 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 03 12:26:40 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7553, in attach_volume
Nov 03 12:26:40 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Nov 03 12:26:40 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Nov 03 12:26:40 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Nov 03 12:26:40 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7550, in do_attach_volume
Nov 03 12:26:40 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 03 12:26:40 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 03 12:26:40 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 03 12:26:40 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 03 12:26:40 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 03 12:26:40 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7548, in do_attach_volume
Nov 03 12:26:40 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Nov 03 12:26:40 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7570, in _attach_volume
Nov 03 12:26:40 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 03 12:26:40 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 03 12:26:40 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 03 12:26:40 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 03 12:26:40 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 03 12:26:40 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 03 12:26:40 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 03 12:26:40 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 03 12:26:40 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Nov 03 12:26:40 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 03 12:26:40 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Nov 03 12:26:40 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 03 12:26:40 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Nov 03 12:26:40 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 03 12:26:40 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Nov 03 12:26:40 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 03 12:26:40 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Nov 03 12:26:40 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 03 12:26:40 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 03 12:26:40 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 03 12:26:40 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 03 12:26:40 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 03 12:26:40 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 03 12:26:40 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 03 12:26:40 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 03 12:26:40 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 03 12:26:40 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Nov 03 12:26:40 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 03 12:26:40 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Nov 03 12:26:40 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 03 12:26:40 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Nov 03 12:26:40 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 03 12:26:40 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 03 12:26:40 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 03 12:26:40 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Nov 03 12:26:40 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 03 12:26:40 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Nov 03 12:26:40 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 03 12:26:40 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Nov 03 12:26:40 user nova-compute[74960]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-93732d97-6ea0-4ca7-b93d-f88ad001309c)
Nov 03 12:26:40 user nova-compute[74960]: ERROR oslo_messaging.rpc.server 
Nov 03 12:26:40 user nova-compute[74960]: DEBUG nova.objects.instance [None req-0a2565de-9e74-41d7-b7b1-9780983c8a36 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Lazy-loading 'flavor' on Instance uuid 6145a30b-809c-4bc5-a45f-c3ff3b170a22 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:26:40 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-0a2565de-9e74-41d7-b7b1-9780983c8a36 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Lock "6145a30b-809c-4bc5-a45f-c3ff3b170a22" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 30.964s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:26:41 user nova-compute[74960]: INFO nova.compute.manager [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] [instance: db88322f-c2ad-4622-9a1a-c45439d875a8] Took 3.02 seconds to detach 3 volumes for instance.
Nov 03 12:26:41 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:26:41 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:26:41 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:26:41 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:26:42 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.345s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:26:42 user nova-compute[74960]: INFO nova.scheduler.client.report [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Deleted allocations for instance db88322f-c2ad-4622-9a1a-c45439d875a8
Nov 03 12:26:42 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-5ce764ea-a60f-47f1-ad1c-be260d7eedc4 tempest-TaggedBootDevicesTest_v242-1985714310 tempest-TaggedBootDevicesTest_v242-1985714310-project-member] Lock "db88322f-c2ad-4622-9a1a-c45439d875a8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.976s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:26:42 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:26:43 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:43 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:26:43 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:26:43 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:45 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:26:47 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:26:47 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Starting heal instance info cache {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 12:26:47 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "refresh_cache-f009a400-0576-48a9-82e0-60de8935c498" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:26:47 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquired lock "refresh_cache-f009a400-0576-48a9-82e0-60de8935c498" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:26:47 user nova-compute[74960]: DEBUG nova.network.neutron [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: f009a400-0576-48a9-82e0-60de8935c498] Forcefully refreshing network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 12:26:48 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:48 user nova-compute[74960]: DEBUG nova.network.neutron [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: f009a400-0576-48a9-82e0-60de8935c498] Updating instance_info_cache with network_info: [{"id": "4b72249c-3aea-415f-83a8-d0498d55674e", "address": "fa:16:3e:81:8a:f6", "network": {"id": "b92f11b0-994f-48b7-be64-02cb782a1f8f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-997339008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d039968e1b97457b8fc21b593af4e1ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b72249c-3a", "ovs_interfaceid": "4b72249c-3aea-415f-83a8-d0498d55674e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:26:48 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Releasing lock "refresh_cache-f009a400-0576-48a9-82e0-60de8935c498" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:26:48 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: f009a400-0576-48a9-82e0-60de8935c498] Updated the network info_cache for instance {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 12:26:48 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:26:48 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:26:48 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:26:48 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:26:48 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Auditing locally available compute resources for user (node: user) {{(pid=74960) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 12:26:48 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9951fab7-4984-408e-94ca-11eab615ff25/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:26:48 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9951fab7-4984-408e-94ca-11eab615ff25/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:26:48 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9951fab7-4984-408e-94ca-11eab615ff25/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:26:48 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:48 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9951fab7-4984-408e-94ca-11eab615ff25/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:26:48 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7769e3c5-136f-4282-8e3e-224e3a80922c/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:26:48 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7769e3c5-136f-4282-8e3e-224e3a80922c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:26:48 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7769e3c5-136f-4282-8e3e-224e3a80922c/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:26:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7769e3c5-136f-4282-8e3e-224e3a80922c/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:26:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be38c803-d97c-4939-9852-e8db1c44bb65/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:26:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be38c803-d97c-4939-9852-e8db1c44bb65/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:26:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be38c803-d97c-4939-9852-e8db1c44bb65/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:26:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be38c803-d97c-4939-9852-e8db1c44bb65/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:26:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fffd1dd7-b8e8-435c-bdfe-6c5001b21daf/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:26:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fffd1dd7-b8e8-435c-bdfe-6c5001b21daf/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:26:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fffd1dd7-b8e8-435c-bdfe-6c5001b21daf/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:26:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fffd1dd7-b8e8-435c-bdfe-6c5001b21daf/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:26:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f15f5f-8afa-4d7b-bb45-5887184f9ee5/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:26:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f15f5f-8afa-4d7b-bb45-5887184f9ee5/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:26:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f15f5f-8afa-4d7b-bb45-5887184f9ee5/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:26:50 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f15f5f-8afa-4d7b-bb45-5887184f9ee5/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:26:50 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6145a30b-809c-4bc5-a45f-c3ff3b170a22/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:26:50 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6145a30b-809c-4bc5-a45f-c3ff3b170a22/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:26:50 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6145a30b-809c-4bc5-a45f-c3ff3b170a22/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:26:50 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6145a30b-809c-4bc5-a45f-c3ff3b170a22/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:26:50 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f009a400-0576-48a9-82e0-60de8935c498/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:26:50 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f009a400-0576-48a9-82e0-60de8935c498/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:26:50 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f009a400-0576-48a9-82e0-60de8935c498/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:26:50 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f009a400-0576-48a9-82e0-60de8935c498/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:26:50 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74960) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 12:26:50 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f009a400-0576-48a9-82e0-60de8935c498/disk.rescue --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:26:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f009a400-0576-48a9-82e0-60de8935c498/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:26:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f009a400-0576-48a9-82e0-60de8935c498/disk.rescue --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:26:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f009a400-0576-48a9-82e0-60de8935c498/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:26:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a33549f-51ea-42d0-8c8a-67d9c74784fd/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:26:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a33549f-51ea-42d0-8c8a-67d9c74784fd/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:26:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a33549f-51ea-42d0-8c8a-67d9c74784fd/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:26:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a33549f-51ea-42d0-8c8a-67d9c74784fd/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:26:52 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:26:52 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:26:52 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Hypervisor/Node resource view: name=user free_ram=7717MB free_disk=25.0589599609375GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74960) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 12:26:52 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:26:52 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:26:52 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 7769e3c5-136f-4282-8e3e-224e3a80922c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:26:52 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 6145a30b-809c-4bc5-a45f-c3ff3b170a22 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:26:52 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance fffd1dd7-b8e8-435c-bdfe-6c5001b21daf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:26:52 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance f009a400-0576-48a9-82e0-60de8935c498 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:26:52 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 9951fab7-4984-408e-94ca-11eab615ff25 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:26:52 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 87f15f5f-8afa-4d7b-bb45-5887184f9ee5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:26:52 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 7a33549f-51ea-42d0-8c8a-67d9c74784fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:26:52 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance be38c803-d97c-4939-9852-e8db1c44bb65 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:26:52 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74960) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 12:26:52 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74960) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 12:26:52 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:26:52 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:26:52 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Compute_service record updated for user:user {{(pid=74960) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 12:26:52 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.499s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:26:52 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:26:52 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:26:52 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:26:52 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74960) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 12:26:53 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:53 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:26:53 user nova-compute[74960]: DEBUG nova.compute.manager [None req-084450ee-32ea-4c48-91fa-c880eb79c8d7 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: 87f15f5f-8afa-4d7b-bb45-5887184f9ee5] Checking state {{(pid=74960) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 12:26:53 user nova-compute[74960]: INFO nova.compute.manager [None req-084450ee-32ea-4c48-91fa-c880eb79c8d7 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: 87f15f5f-8afa-4d7b-bb45-5887184f9ee5] instance snapshotting
Nov 03 12:26:53 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-084450ee-32ea-4c48-91fa-c880eb79c8d7 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: 87f15f5f-8afa-4d7b-bb45-5887184f9ee5] Beginning live snapshot process
Nov 03 12:26:53 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:53 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-084450ee-32ea-4c48-91fa-c880eb79c8d7 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f15f5f-8afa-4d7b-bb45-5887184f9ee5/disk --force-share --output=json -f qcow2 {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:26:53 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-084450ee-32ea-4c48-91fa-c880eb79c8d7 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f15f5f-8afa-4d7b-bb45-5887184f9ee5/disk --force-share --output=json -f qcow2" returned: 0 in 0.193s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:26:53 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-084450ee-32ea-4c48-91fa-c880eb79c8d7 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f15f5f-8afa-4d7b-bb45-5887184f9ee5/disk --force-share --output=json -f qcow2 {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:26:54 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-084450ee-32ea-4c48-91fa-c880eb79c8d7 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f15f5f-8afa-4d7b-bb45-5887184f9ee5/disk --force-share --output=json -f qcow2" returned: 0 in 0.185s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:26:54 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-084450ee-32ea-4c48-91fa-c880eb79c8d7 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:26:54 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-084450ee-32ea-4c48-91fa-c880eb79c8d7 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.190s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:26:54 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-084450ee-32ea-4c48-91fa-c880eb79c8d7 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp9mwizprd/a5c0d698085e4c4a8090a0a9091067eb.delta 1073741824 {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:26:54 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-084450ee-32ea-4c48-91fa-c880eb79c8d7 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp9mwizprd/a5c0d698085e4c4a8090a0a9091067eb.delta 1073741824" returned: 0 in 0.059s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:26:54 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-084450ee-32ea-4c48-91fa-c880eb79c8d7 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: 87f15f5f-8afa-4d7b-bb45-5887184f9ee5] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 03 12:26:55 user nova-compute[74960]: DEBUG nova.virt.libvirt.guest [None req-084450ee-32ea-4c48-91fa-c880eb79c8d7 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74960) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 03 12:26:55 user nova-compute[74960]: DEBUG nova.virt.libvirt.guest [None req-084450ee-32ea-4c48-91fa-c880eb79c8d7 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74960) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 03 12:26:55 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-084450ee-32ea-4c48-91fa-c880eb79c8d7 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: 87f15f5f-8afa-4d7b-bb45-5887184f9ee5] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 03 12:26:55 user nova-compute[74960]: DEBUG nova.privsep.utils [None req-084450ee-32ea-4c48-91fa-c880eb79c8d7 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74960) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 03 12:26:55 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-084450ee-32ea-4c48-91fa-c880eb79c8d7 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp9mwizprd/a5c0d698085e4c4a8090a0a9091067eb.delta /opt/stack/data/nova/instances/snapshots/tmp9mwizprd/a5c0d698085e4c4a8090a0a9091067eb {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:26:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-084450ee-32ea-4c48-91fa-c880eb79c8d7 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp9mwizprd/a5c0d698085e4c4a8090a0a9091067eb.delta /opt/stack/data/nova/instances/snapshots/tmp9mwizprd/a5c0d698085e4c4a8090a0a9091067eb" returned: 0 in 0.672s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:26:56 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-084450ee-32ea-4c48-91fa-c880eb79c8d7 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: 87f15f5f-8afa-4d7b-bb45-5887184f9ee5] Snapshot extracted, beginning image upload
Nov 03 12:26:58 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:58 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:26:59 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-084450ee-32ea-4c48-91fa-c880eb79c8d7 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: 87f15f5f-8afa-4d7b-bb45-5887184f9ee5] Snapshot image upload complete
Nov 03 12:26:59 user nova-compute[74960]: INFO nova.compute.manager [None req-084450ee-32ea-4c48-91fa-c880eb79c8d7 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: 87f15f5f-8afa-4d7b-bb45-5887184f9ee5] Took 5.57 seconds to snapshot the instance on the hypervisor.
Nov 03 12:26:59 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-b8cd9926-d5f8-47cc-8b23-96d3ec1b7f48 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Acquiring lock "6145a30b-809c-4bc5-a45f-c3ff3b170a22" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:26:59 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-b8cd9926-d5f8-47cc-8b23-96d3ec1b7f48 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Lock "6145a30b-809c-4bc5-a45f-c3ff3b170a22" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:26:59 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-b8cd9926-d5f8-47cc-8b23-96d3ec1b7f48 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Acquiring lock "6145a30b-809c-4bc5-a45f-c3ff3b170a22-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:26:59 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-b8cd9926-d5f8-47cc-8b23-96d3ec1b7f48 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Lock "6145a30b-809c-4bc5-a45f-c3ff3b170a22-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:26:59 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-b8cd9926-d5f8-47cc-8b23-96d3ec1b7f48 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Lock "6145a30b-809c-4bc5-a45f-c3ff3b170a22-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:26:59 user nova-compute[74960]: INFO nova.compute.manager [None req-b8cd9926-d5f8-47cc-8b23-96d3ec1b7f48 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] Terminating instance
Nov 03 12:26:59 user nova-compute[74960]: DEBUG nova.compute.manager [None req-b8cd9926-d5f8-47cc-8b23-96d3ec1b7f48 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] Start destroying the instance on the hypervisor. {{(pid=74960) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 12:26:59 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-82352e00-4a0d-46b3-9526-75dd26394e98 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] Acquiring lock "4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:27:00 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-82352e00-4a0d-46b3-9526-75dd26394e98 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] Lock "4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:27:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:27:00 user nova-compute[74960]: DEBUG nova.compute.manager [None req-82352e00-4a0d-46b3-9526-75dd26394e98 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] [instance: 4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8] Starting instance... {{(pid=74960) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 12:27:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:27:00 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-82352e00-4a0d-46b3-9526-75dd26394e98 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:27:00 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-82352e00-4a0d-46b3-9526-75dd26394e98 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:27:00 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-82352e00-4a0d-46b3-9526-75dd26394e98 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74960) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 12:27:00 user nova-compute[74960]: INFO nova.compute.claims [None req-82352e00-4a0d-46b3-9526-75dd26394e98 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] [instance: 4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8] Claim successful on node user
Nov 03 12:27:00 user nova-compute[74960]: DEBUG nova.compute.manager [req-a2def33c-d49f-485c-8154-7fa9faee730f req-645895bf-1763-403c-92e2-7c2523aa8189 service nova] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] Received event network-vif-unplugged-c54167dd-e416-43bd-8271-dd55e9e71119 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:27:00 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-a2def33c-d49f-485c-8154-7fa9faee730f req-645895bf-1763-403c-92e2-7c2523aa8189 service nova] Acquiring lock "6145a30b-809c-4bc5-a45f-c3ff3b170a22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:27:00 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-a2def33c-d49f-485c-8154-7fa9faee730f req-645895bf-1763-403c-92e2-7c2523aa8189 service nova] Lock "6145a30b-809c-4bc5-a45f-c3ff3b170a22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:27:00 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-a2def33c-d49f-485c-8154-7fa9faee730f req-645895bf-1763-403c-92e2-7c2523aa8189 service nova] Lock "6145a30b-809c-4bc5-a45f-c3ff3b170a22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:27:00 user nova-compute[74960]: DEBUG nova.compute.manager [req-a2def33c-d49f-485c-8154-7fa9faee730f req-645895bf-1763-403c-92e2-7c2523aa8189 service nova] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] No waiting events found dispatching network-vif-unplugged-c54167dd-e416-43bd-8271-dd55e9e71119 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:27:00 user nova-compute[74960]: DEBUG nova.compute.manager [req-a2def33c-d49f-485c-8154-7fa9faee730f req-645895bf-1763-403c-92e2-7c2523aa8189 service nova] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] Received event network-vif-unplugged-c54167dd-e416-43bd-8271-dd55e9e71119 for instance with task_state deleting. {{(pid=74960) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 12:27:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:27:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:27:00 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-82352e00-4a0d-46b3-9526-75dd26394e98 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:27:00 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-82352e00-4a0d-46b3-9526-75dd26394e98 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:27:00 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-82352e00-4a0d-46b3-9526-75dd26394e98 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.381s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:27:00 user nova-compute[74960]: DEBUG nova.compute.manager [None req-82352e00-4a0d-46b3-9526-75dd26394e98 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] [instance: 4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8] Start building networks asynchronously for instance. {{(pid=74960) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 12:27:00 user nova-compute[74960]: DEBUG nova.compute.manager [None req-82352e00-4a0d-46b3-9526-75dd26394e98 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] [instance: 4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8] Allocating IP information in the background. {{(pid=74960) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 12:27:00 user nova-compute[74960]: DEBUG nova.network.neutron [None req-82352e00-4a0d-46b3-9526-75dd26394e98 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] [instance: 4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8] allocate_for_instance() {{(pid=74960) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 12:27:00 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-82352e00-4a0d-46b3-9526-75dd26394e98 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] [instance: 4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 12:27:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:27:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:27:00 user nova-compute[74960]: DEBUG nova.compute.manager [None req-82352e00-4a0d-46b3-9526-75dd26394e98 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] [instance: 4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8] Start building block device mappings for instance. {{(pid=74960) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 12:27:00 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] Instance destroyed successfully.
Nov 03 12:27:00 user nova-compute[74960]: DEBUG nova.objects.instance [None req-b8cd9926-d5f8-47cc-8b23-96d3ec1b7f48 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Lazy-loading 'resources' on Instance uuid 6145a30b-809c-4bc5-a45f-c3ff3b170a22 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:27:00 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-b8cd9926-d5f8-47cc-8b23-96d3ec1b7f48 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-03T12:20:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-526247537',display_name='tempest-ServerActionsTestOtherA-server-1132506895',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-526247537',id=12,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDW7yXqa7k+YlhNoUvM+ny045GZm/Yl6hgASx9MMjKwBHiETYCiHL5EomYdUyz7ar/PJwyKpWPD39wbyG7SmL8Cwl0e8vcQuc7g6iuGDa+Ent75sR68D8/uWXXpX0MFRBg==',key_name='tempest-keypair-1690418913',keypairs=<?>,launch_index=0,launched_at=2023-11-03T12:23:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5320673ee4f0422989a3708915375cdb',ramdisk_id='',reservation_id='r-0h3abybt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1651581249',owner_user_name='tempest-ServerActionsTestOtherA-1651581249-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T12:23:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60d8d224d7204ede84c09433a3d82d0f',uuid=6145a30b-809c-4bc5-a45f-c3ff3b170a22,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c54167dd-e416-43bd-8271-dd55e9e71119", "address": "fa:16:3e:33:a0:07", "network": {"id": "9c5fae09-5df5-45a3-b9cd-7ac3763ba878", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1736223258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5320673ee4f0422989a3708915375cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc54167dd-e4", "ovs_interfaceid": "c54167dd-e416-43bd-8271-dd55e9e71119", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 12:27:00 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-b8cd9926-d5f8-47cc-8b23-96d3ec1b7f48 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Converting VIF {"id": "c54167dd-e416-43bd-8271-dd55e9e71119", "address": "fa:16:3e:33:a0:07", "network": {"id": "9c5fae09-5df5-45a3-b9cd-7ac3763ba878", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1736223258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5320673ee4f0422989a3708915375cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc54167dd-e4", "ovs_interfaceid": "c54167dd-e416-43bd-8271-dd55e9e71119", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:27:00 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-b8cd9926-d5f8-47cc-8b23-96d3ec1b7f48 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:33:a0:07,bridge_name='br-int',has_traffic_filtering=True,id=c54167dd-e416-43bd-8271-dd55e9e71119,network=Network(9c5fae09-5df5-45a3-b9cd-7ac3763ba878),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc54167dd-e4') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:27:00 user nova-compute[74960]: DEBUG os_vif [None req-b8cd9926-d5f8-47cc-8b23-96d3ec1b7f48 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:a0:07,bridge_name='br-int',has_traffic_filtering=True,id=c54167dd-e416-43bd-8271-dd55e9e71119,network=Network(9c5fae09-5df5-45a3-b9cd-7ac3763ba878),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc54167dd-e4') {{(pid=74960) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 12:27:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:27:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc54167dd-e4, bridge=br-int, if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:27:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:27:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:27:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:27:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c70eecf6-5f52-41bb-bbb5-e6bb0d8b6049) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:27:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:27:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:27:00 user nova-compute[74960]: INFO os_vif [None req-b8cd9926-d5f8-47cc-8b23-96d3ec1b7f48 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:a0:07,bridge_name='br-int',has_traffic_filtering=True,id=c54167dd-e416-43bd-8271-dd55e9e71119,network=Network(9c5fae09-5df5-45a3-b9cd-7ac3763ba878),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc54167dd-e4')
Nov 03 12:27:00 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-b8cd9926-d5f8-47cc-8b23-96d3ec1b7f48 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] Deleting instance files /opt/stack/data/nova/instances/6145a30b-809c-4bc5-a45f-c3ff3b170a22_del
Nov 03 12:27:00 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-b8cd9926-d5f8-47cc-8b23-96d3ec1b7f48 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] Deletion of /opt/stack/data/nova/instances/6145a30b-809c-4bc5-a45f-c3ff3b170a22_del complete
Nov 03 12:27:00 user nova-compute[74960]: DEBUG nova.compute.manager [None req-82352e00-4a0d-46b3-9526-75dd26394e98 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] [instance: 4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8] Start spawning the instance on the hypervisor. {{(pid=74960) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 12:27:00 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-82352e00-4a0d-46b3-9526-75dd26394e98 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] [instance: 4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8] Creating instance directory {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 12:27:00 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-82352e00-4a0d-46b3-9526-75dd26394e98 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] [instance: 4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8] Creating image(s)
Nov 03 12:27:00 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-82352e00-4a0d-46b3-9526-75dd26394e98 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] Acquiring lock "/opt/stack/data/nova/instances/4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:27:00 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-82352e00-4a0d-46b3-9526-75dd26394e98 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] Lock "/opt/stack/data/nova/instances/4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:27:00 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-82352e00-4a0d-46b3-9526-75dd26394e98 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] Lock "/opt/stack/data/nova/instances/4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:27:00 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-82352e00-4a0d-46b3-9526-75dd26394e98 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:27:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:27:00 user nova-compute[74960]: DEBUG nova.policy [None req-82352e00-4a0d-46b3-9526-75dd26394e98 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '69d2653507ea4a98a65a484fc21c6dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4eecbf67d5f42a5bd652c35460c5bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74960) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 12:27:00 user nova-compute[74960]: INFO nova.compute.manager [None req-b8cd9926-d5f8-47cc-8b23-96d3ec1b7f48 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 03 12:27:00 user nova-compute[74960]: DEBUG oslo.service.loopingcall [None req-b8cd9926-d5f8-47cc-8b23-96d3ec1b7f48 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74960) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 12:27:00 user nova-compute[74960]: DEBUG nova.compute.manager [-] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] Deallocating network for instance {{(pid=74960) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 12:27:00 user nova-compute[74960]: DEBUG nova.network.neutron [-] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] deallocate_for_instance() {{(pid=74960) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 12:27:00 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-82352e00-4a0d-46b3-9526-75dd26394e98 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.178s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:27:00 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-82352e00-4a0d-46b3-9526-75dd26394e98 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] Acquiring lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:27:00 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-82352e00-4a0d-46b3-9526-75dd26394e98 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] Lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:27:00 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-82352e00-4a0d-46b3-9526-75dd26394e98 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:27:01 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-82352e00-4a0d-46b3-9526-75dd26394e98 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.210s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:27:01 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-82352e00-4a0d-46b3-9526-75dd26394e98 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910,backing_fmt=raw /opt/stack/data/nova/instances/4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8/disk 1073741824 {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:27:01 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-82352e00-4a0d-46b3-9526-75dd26394e98 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910,backing_fmt=raw /opt/stack/data/nova/instances/4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8/disk 1073741824" returned: 0 in 0.053s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:27:01 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-82352e00-4a0d-46b3-9526-75dd26394e98 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] Lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.270s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:27:01 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-82352e00-4a0d-46b3-9526-75dd26394e98 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:27:01 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-82352e00-4a0d-46b3-9526-75dd26394e98 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.198s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:27:01 user nova-compute[74960]: DEBUG nova.virt.disk.api [None req-82352e00-4a0d-46b3-9526-75dd26394e98 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8/disk. size=1073741824 {{(pid=74960) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 12:27:01 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-82352e00-4a0d-46b3-9526-75dd26394e98 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:27:01 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-82352e00-4a0d-46b3-9526-75dd26394e98 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:27:01 user nova-compute[74960]: DEBUG nova.virt.disk.api [None req-82352e00-4a0d-46b3-9526-75dd26394e98 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] Cannot resize image /opt/stack/data/nova/instances/4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8/disk to a smaller size. {{(pid=74960) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 12:27:01 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-82352e00-4a0d-46b3-9526-75dd26394e98 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] [instance: 4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8] Created local disks {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 12:27:01 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-82352e00-4a0d-46b3-9526-75dd26394e98 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] [instance: 4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8] Ensure instance console log exists: /opt/stack/data/nova/instances/4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8/console.log {{(pid=74960) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 12:27:01 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-82352e00-4a0d-46b3-9526-75dd26394e98 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:27:01 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-82352e00-4a0d-46b3-9526-75dd26394e98 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:27:01 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-82352e00-4a0d-46b3-9526-75dd26394e98 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:27:01 user nova-compute[74960]: DEBUG nova.network.neutron [-] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] Updating instance_info_cache with network_info: [] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:27:01 user nova-compute[74960]: INFO nova.compute.manager [-] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] Took 0.79 seconds to deallocate network for instance.
Nov 03 12:27:01 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-b8cd9926-d5f8-47cc-8b23-96d3ec1b7f48 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:27:01 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-b8cd9926-d5f8-47cc-8b23-96d3ec1b7f48 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:27:01 user nova-compute[74960]: DEBUG nova.compute.manager [req-62963c54-4cc5-4a87-b599-2fbb53d5a293 req-3dd82173-210f-426c-9b6c-ce1e38b73ca5 service nova] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] Received event network-vif-deleted-c54167dd-e416-43bd-8271-dd55e9e71119 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:27:02 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-b8cd9926-d5f8-47cc-8b23-96d3ec1b7f48 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:27:02 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-b8cd9926-d5f8-47cc-8b23-96d3ec1b7f48 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:27:02 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-b8cd9926-d5f8-47cc-8b23-96d3ec1b7f48 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.349s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:27:02 user nova-compute[74960]: INFO nova.scheduler.client.report [None req-b8cd9926-d5f8-47cc-8b23-96d3ec1b7f48 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Deleted allocations for instance 6145a30b-809c-4bc5-a45f-c3ff3b170a22
Nov 03 12:27:02 user nova-compute[74960]: DEBUG nova.network.neutron [None req-82352e00-4a0d-46b3-9526-75dd26394e98 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] [instance: 4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8] Successfully created port: c3166a00-dc11-448b-8d36-fdf64043f186 {{(pid=74960) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 12:27:02 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-b8cd9926-d5f8-47cc-8b23-96d3ec1b7f48 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Lock "6145a30b-809c-4bc5-a45f-c3ff3b170a22" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.295s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:27:02 user nova-compute[74960]: DEBUG nova.compute.manager [req-44782de9-7472-452b-930c-3b277ca86046 req-6aaae824-9fe0-4a77-98eb-7660549583af service nova] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] Received event network-vif-plugged-c54167dd-e416-43bd-8271-dd55e9e71119 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:27:02 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-44782de9-7472-452b-930c-3b277ca86046 req-6aaae824-9fe0-4a77-98eb-7660549583af service nova] Acquiring lock "6145a30b-809c-4bc5-a45f-c3ff3b170a22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:27:02 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-44782de9-7472-452b-930c-3b277ca86046 req-6aaae824-9fe0-4a77-98eb-7660549583af service nova] Lock "6145a30b-809c-4bc5-a45f-c3ff3b170a22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:27:02 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-44782de9-7472-452b-930c-3b277ca86046 req-6aaae824-9fe0-4a77-98eb-7660549583af service nova] Lock "6145a30b-809c-4bc5-a45f-c3ff3b170a22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:27:02 user nova-compute[74960]: DEBUG nova.compute.manager [req-44782de9-7472-452b-930c-3b277ca86046 req-6aaae824-9fe0-4a77-98eb-7660549583af service nova] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] No waiting events found dispatching network-vif-plugged-c54167dd-e416-43bd-8271-dd55e9e71119 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:27:02 user nova-compute[74960]: WARNING nova.compute.manager [req-44782de9-7472-452b-930c-3b277ca86046 req-6aaae824-9fe0-4a77-98eb-7660549583af service nova] [instance: 6145a30b-809c-4bc5-a45f-c3ff3b170a22] Received unexpected event network-vif-plugged-c54167dd-e416-43bd-8271-dd55e9e71119 for instance with vm_state deleted and task_state None.
Nov 03 12:27:02 user nova-compute[74960]: DEBUG nova.network.neutron [None req-82352e00-4a0d-46b3-9526-75dd26394e98 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] [instance: 4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8] Successfully updated port: c3166a00-dc11-448b-8d36-fdf64043f186 {{(pid=74960) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 12:27:02 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-82352e00-4a0d-46b3-9526-75dd26394e98 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] Acquiring lock "refresh_cache-4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:27:02 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-82352e00-4a0d-46b3-9526-75dd26394e98 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] Acquired lock "refresh_cache-4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:27:02 user nova-compute[74960]: DEBUG nova.network.neutron [None req-82352e00-4a0d-46b3-9526-75dd26394e98 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] [instance: 4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8] Building network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 12:27:02 user nova-compute[74960]: DEBUG nova.compute.manager [req-98b71c9a-7a9a-462d-ada8-3c002d9f2612 req-9806be82-f046-4f46-8ce7-7caf291268a0 service nova] [instance: 4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8] Received event network-changed-c3166a00-dc11-448b-8d36-fdf64043f186 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:27:02 user nova-compute[74960]: DEBUG nova.compute.manager [req-98b71c9a-7a9a-462d-ada8-3c002d9f2612 req-9806be82-f046-4f46-8ce7-7caf291268a0 service nova] [instance: 4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8] Refreshing instance network info cache due to event network-changed-c3166a00-dc11-448b-8d36-fdf64043f186. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 12:27:02 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-98b71c9a-7a9a-462d-ada8-3c002d9f2612 req-9806be82-f046-4f46-8ce7-7caf291268a0 service nova] Acquiring lock "refresh_cache-4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:27:02 user nova-compute[74960]: DEBUG nova.network.neutron [None req-82352e00-4a0d-46b3-9526-75dd26394e98 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] [instance: 4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8] Instance cache missing network info. {{(pid=74960) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 12:27:03 user nova-compute[74960]: DEBUG nova.network.neutron [None req-82352e00-4a0d-46b3-9526-75dd26394e98 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] [instance: 4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8] Updating instance_info_cache with network_info: [{"id": "c3166a00-dc11-448b-8d36-fdf64043f186", "address": "fa:16:3e:4f:76:01", "network": {"id": "f8cfc91c-2af0-409c-b7cc-8845ec47b4d5", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "63ee9c80c632442fb0379f47b784bd20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3166a00-dc", "ovs_interfaceid": "c3166a00-dc11-448b-8d36-fdf64043f186", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:27:03 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-82352e00-4a0d-46b3-9526-75dd26394e98 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] Releasing lock "refresh_cache-4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:27:03 user nova-compute[74960]: DEBUG nova.compute.manager [None req-82352e00-4a0d-46b3-9526-75dd26394e98 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] [instance: 4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8] Instance network_info: |[{"id": "c3166a00-dc11-448b-8d36-fdf64043f186", "address": "fa:16:3e:4f:76:01", "network": {"id": "f8cfc91c-2af0-409c-b7cc-8845ec47b4d5", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "63ee9c80c632442fb0379f47b784bd20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3166a00-dc", "ovs_interfaceid": "c3166a00-dc11-448b-8d36-fdf64043f186", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74960) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 12:27:03 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-98b71c9a-7a9a-462d-ada8-3c002d9f2612 req-9806be82-f046-4f46-8ce7-7caf291268a0 service nova] Acquired lock "refresh_cache-4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:27:03 user nova-compute[74960]: DEBUG nova.network.neutron [req-98b71c9a-7a9a-462d-ada8-3c002d9f2612 req-9806be82-f046-4f46-8ce7-7caf291268a0 service nova] [instance: 4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8] Refreshing network info cache for port c3166a00-dc11-448b-8d36-fdf64043f186 {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 12:27:03 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-82352e00-4a0d-46b3-9526-75dd26394e98 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] [instance: 4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8] Start _get_guest_xml network_info=[{"id": "c3166a00-dc11-448b-8d36-fdf64043f186", "address": "fa:16:3e:4f:76:01", "network": {"id": "f8cfc91c-2af0-409c-b7cc-8845ec47b4d5", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "63ee9c80c632442fb0379f47b784bd20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3166a00-dc", "ovs_interfaceid": "c3166a00-dc11-448b-8d36-fdf64043f186", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=549f51ba-ac69-494b-8de1-34635aa2d7cf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='63ee9c80c632442fb0379f47b784bd20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T12:13:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'image_id': '549f51ba-ac69-494b-8de1-34635aa2d7cf'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 12:27:03 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-82352e00-4a0d-46b3-9526-75dd26394e98 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:27:03 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-82352e00-4a0d-46b3-9526-75dd26394e98 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:27:03 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-82352e00-4a0d-46b3-9526-75dd26394e98 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 12:27:03 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-82352e00-4a0d-46b3-9526-75dd26394e98 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] CPU controller missing on host. {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 12:27:03 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-82352e00-4a0d-46b3-9526-75dd26394e98 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 12:27:03 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-82352e00-4a0d-46b3-9526-75dd26394e98 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] CPU controller found on host. {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 12:27:03 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-82352e00-4a0d-46b3-9526-75dd26394e98 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74960) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 12:27:03 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-82352e00-4a0d-46b3-9526-75dd26394e98 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=549f51ba-ac69-494b-8de1-34635aa2d7cf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='63ee9c80c632442fb0379f47b784bd20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T12:13:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 12:27:03 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-82352e00-4a0d-46b3-9526-75dd26394e98 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] Flavor limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 12:27:03 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-82352e00-4a0d-46b3-9526-75dd26394e98 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] Image limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 12:27:03 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-82352e00-4a0d-46b3-9526-75dd26394e98 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] Flavor pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 12:27:03 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-82352e00-4a0d-46b3-9526-75dd26394e98 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] Image pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 12:27:03 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-82352e00-4a0d-46b3-9526-75dd26394e98 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 12:27:03 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-82352e00-4a0d-46b3-9526-75dd26394e98 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 12:27:03 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-82352e00-4a0d-46b3-9526-75dd26394e98 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 12:27:03 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-82352e00-4a0d-46b3-9526-75dd26394e98 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] Got 1 possible topologies {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 12:27:03 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-82352e00-4a0d-46b3-9526-75dd26394e98 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 12:27:03 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-82352e00-4a0d-46b3-9526-75dd26394e98 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 12:27:03 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-82352e00-4a0d-46b3-9526-75dd26394e98 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:26:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-2083477859',display_name='tempest-VolumesNegativeTest-instance-2083477859',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-2083477859',id=23,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f4eecbf67d5f42a5bd652c35460c5bdb',ramdisk_id='',reservation_id='r-7xv6egl8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-188495882',owner_user_name='tempest-VolumesNegativeTest-188495882-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:27:01Z,user_data=None,user_id='69d2653507ea4a98a65a484fc21c6dbf',uuid=4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c3166a00-dc11-448b-8d36-fdf64043f186", "address": "fa:16:3e:4f:76:01", "network": {"id": "f8cfc91c-2af0-409c-b7cc-8845ec47b4d5", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "63ee9c80c632442fb0379f47b784bd20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3166a00-dc", "ovs_interfaceid": "c3166a00-dc11-448b-8d36-fdf64043f186", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74960) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 12:27:03 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-82352e00-4a0d-46b3-9526-75dd26394e98 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] Converting VIF {"id": "c3166a00-dc11-448b-8d36-fdf64043f186", "address": "fa:16:3e:4f:76:01", "network": {"id": "f8cfc91c-2af0-409c-b7cc-8845ec47b4d5", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "63ee9c80c632442fb0379f47b784bd20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3166a00-dc", "ovs_interfaceid": "c3166a00-dc11-448b-8d36-fdf64043f186", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:27:03 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-82352e00-4a0d-46b3-9526-75dd26394e98 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:76:01,bridge_name='br-int',has_traffic_filtering=True,id=c3166a00-dc11-448b-8d36-fdf64043f186,network=Network(f8cfc91c-2af0-409c-b7cc-8845ec47b4d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3166a00-dc') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:27:03 user nova-compute[74960]: DEBUG nova.objects.instance [None req-82352e00-4a0d-46b3-9526-75dd26394e98 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] Lazy-loading 'pci_devices' on Instance uuid 4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:27:03 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-82352e00-4a0d-46b3-9526-75dd26394e98 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] [instance: 4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8] End _get_guest_xml xml=<domain type="kvm">
Nov 03 12:27:03 user nova-compute[74960]:   <uuid>4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8</uuid>
Nov 03 12:27:03 user nova-compute[74960]:   <name>instance-00000017</name>
Nov 03 12:27:03 user nova-compute[74960]:   <memory>524288</memory>
Nov 03 12:27:03 user nova-compute[74960]:   <vcpu>1</vcpu>
Nov 03 12:27:03 user nova-compute[74960]:   <metadata>
Nov 03 12:27:03 user nova-compute[74960]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 12:27:03 user nova-compute[74960]:       <nova:package version="0.0.0"/>
Nov 03 12:27:03 user nova-compute[74960]:       <nova:name>tempest-VolumesNegativeTest-instance-2083477859</nova:name>
Nov 03 12:27:03 user nova-compute[74960]:       <nova:creationTime>2023-11-03 12:27:03</nova:creationTime>
Nov 03 12:27:03 user nova-compute[74960]:       <nova:flavor name="m1.tiny">
Nov 03 12:27:03 user nova-compute[74960]:         <nova:memory>512</nova:memory>
Nov 03 12:27:03 user nova-compute[74960]:         <nova:disk>1</nova:disk>
Nov 03 12:27:03 user nova-compute[74960]:         <nova:swap>0</nova:swap>
Nov 03 12:27:03 user nova-compute[74960]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 12:27:03 user nova-compute[74960]:         <nova:vcpus>1</nova:vcpus>
Nov 03 12:27:03 user nova-compute[74960]:       </nova:flavor>
Nov 03 12:27:03 user nova-compute[74960]:       <nova:owner>
Nov 03 12:27:03 user nova-compute[74960]:         <nova:user uuid="69d2653507ea4a98a65a484fc21c6dbf">tempest-VolumesNegativeTest-188495882-project-member</nova:user>
Nov 03 12:27:03 user nova-compute[74960]:         <nova:project uuid="f4eecbf67d5f42a5bd652c35460c5bdb">tempest-VolumesNegativeTest-188495882</nova:project>
Nov 03 12:27:03 user nova-compute[74960]:       </nova:owner>
Nov 03 12:27:03 user nova-compute[74960]:       <nova:root type="image" uuid="549f51ba-ac69-494b-8de1-34635aa2d7cf"/>
Nov 03 12:27:03 user nova-compute[74960]:       <nova:ports>
Nov 03 12:27:03 user nova-compute[74960]:         <nova:port uuid="c3166a00-dc11-448b-8d36-fdf64043f186">
Nov 03 12:27:03 user nova-compute[74960]:           <nova:ip type="fixed" address="192.168.233.234" ipVersion="4"/>
Nov 03 12:27:03 user nova-compute[74960]:         </nova:port>
Nov 03 12:27:03 user nova-compute[74960]:       </nova:ports>
Nov 03 12:27:03 user nova-compute[74960]:     </nova:instance>
Nov 03 12:27:03 user nova-compute[74960]:   </metadata>
Nov 03 12:27:03 user nova-compute[74960]:   <sysinfo type="smbios">
Nov 03 12:27:03 user nova-compute[74960]:     <system>
Nov 03 12:27:03 user nova-compute[74960]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 12:27:03 user nova-compute[74960]:       <entry name="product">OpenStack Nova</entry>
Nov 03 12:27:03 user nova-compute[74960]:       <entry name="version">0.0.0</entry>
Nov 03 12:27:03 user nova-compute[74960]:       <entry name="serial">4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8</entry>
Nov 03 12:27:03 user nova-compute[74960]:       <entry name="uuid">4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8</entry>
Nov 03 12:27:03 user nova-compute[74960]:       <entry name="family">Virtual Machine</entry>
Nov 03 12:27:03 user nova-compute[74960]:     </system>
Nov 03 12:27:03 user nova-compute[74960]:   </sysinfo>
Nov 03 12:27:03 user nova-compute[74960]:   <os>
Nov 03 12:27:03 user nova-compute[74960]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 12:27:03 user nova-compute[74960]:     <boot dev="hd"/>
Nov 03 12:27:03 user nova-compute[74960]:     <smbios mode="sysinfo"/>
Nov 03 12:27:03 user nova-compute[74960]:   </os>
Nov 03 12:27:03 user nova-compute[74960]:   <features>
Nov 03 12:27:03 user nova-compute[74960]:     <acpi/>
Nov 03 12:27:03 user nova-compute[74960]:     <apic/>
Nov 03 12:27:03 user nova-compute[74960]:     <vmcoreinfo/>
Nov 03 12:27:03 user nova-compute[74960]:   </features>
Nov 03 12:27:03 user nova-compute[74960]:   <clock offset="utc">
Nov 03 12:27:03 user nova-compute[74960]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 12:27:03 user nova-compute[74960]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 12:27:03 user nova-compute[74960]:     <timer name="hpet" present="no"/>
Nov 03 12:27:03 user nova-compute[74960]:   </clock>
Nov 03 12:27:03 user nova-compute[74960]:   <cpu mode="custom" match="exact">
Nov 03 12:27:03 user nova-compute[74960]:     <model>Nehalem</model>
Nov 03 12:27:03 user nova-compute[74960]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 12:27:03 user nova-compute[74960]:   </cpu>
Nov 03 12:27:03 user nova-compute[74960]:   <devices>
Nov 03 12:27:03 user nova-compute[74960]:     <disk type="file" device="disk">
Nov 03 12:27:03 user nova-compute[74960]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 12:27:03 user nova-compute[74960]:       <source file="/opt/stack/data/nova/instances/4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8/disk"/>
Nov 03 12:27:03 user nova-compute[74960]:       <target dev="vda" bus="virtio"/>
Nov 03 12:27:03 user nova-compute[74960]:     </disk>
Nov 03 12:27:03 user nova-compute[74960]:     <interface type="ethernet">
Nov 03 12:27:03 user nova-compute[74960]:       <mac address="fa:16:3e:4f:76:01"/>
Nov 03 12:27:03 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:27:03 user nova-compute[74960]:       <mtu size="1442"/>
Nov 03 12:27:03 user nova-compute[74960]:       <target dev="tapc3166a00-dc"/>
Nov 03 12:27:03 user nova-compute[74960]:     </interface>
Nov 03 12:27:03 user nova-compute[74960]:     <serial type="pty">
Nov 03 12:27:03 user nova-compute[74960]:       <log file="/opt/stack/data/nova/instances/4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8/console.log" append="off"/>
Nov 03 12:27:03 user nova-compute[74960]:     </serial>
Nov 03 12:27:03 user nova-compute[74960]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 12:27:03 user nova-compute[74960]:     <video>
Nov 03 12:27:03 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:27:03 user nova-compute[74960]:     </video>
Nov 03 12:27:03 user nova-compute[74960]:     <rng model="virtio">
Nov 03 12:27:03 user nova-compute[74960]:       <backend model="random">/dev/urandom</backend>
Nov 03 12:27:03 user nova-compute[74960]:     </rng>
Nov 03 12:27:03 user nova-compute[74960]:     <controller type="usb" index="0" model="none"/>
Nov 03 12:27:03 user nova-compute[74960]:     <memballoon model="virtio">
Nov 03 12:27:03 user nova-compute[74960]:       <stats period="10"/>
Nov 03 12:27:03 user nova-compute[74960]:     </memballoon>
Nov 03 12:27:03 user nova-compute[74960]:   </devices>
Nov 03 12:27:03 user nova-compute[74960]: </domain>
Nov 03 12:27:03 user nova-compute[74960]:  {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 12:27:03 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-82352e00-4a0d-46b3-9526-75dd26394e98 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:26:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-2083477859',display_name='tempest-VolumesNegativeTest-instance-2083477859',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-2083477859',id=23,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f4eecbf67d5f42a5bd652c35460c5bdb',ramdisk_id='',reservation_id='r-7xv6egl8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-188495882',owner_user_name='tempest-VolumesNegativeTest-188495882-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:27:01Z,user_data=None,user_id='69d2653507ea4a98a65a484fc21c6dbf',uuid=4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c3166a00-dc11-448b-8d36-fdf64043f186", "address": "fa:16:3e:4f:76:01", "network": {"id": "f8cfc91c-2af0-409c-b7cc-8845ec47b4d5", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "63ee9c80c632442fb0379f47b784bd20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3166a00-dc", "ovs_interfaceid": "c3166a00-dc11-448b-8d36-fdf64043f186", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 12:27:03 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-82352e00-4a0d-46b3-9526-75dd26394e98 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] Converting VIF {"id": "c3166a00-dc11-448b-8d36-fdf64043f186", "address": "fa:16:3e:4f:76:01", "network": {"id": "f8cfc91c-2af0-409c-b7cc-8845ec47b4d5", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "63ee9c80c632442fb0379f47b784bd20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3166a00-dc", "ovs_interfaceid": "c3166a00-dc11-448b-8d36-fdf64043f186", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:27:03 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-82352e00-4a0d-46b3-9526-75dd26394e98 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:76:01,bridge_name='br-int',has_traffic_filtering=True,id=c3166a00-dc11-448b-8d36-fdf64043f186,network=Network(f8cfc91c-2af0-409c-b7cc-8845ec47b4d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3166a00-dc') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:27:03 user nova-compute[74960]: DEBUG os_vif [None req-82352e00-4a0d-46b3-9526-75dd26394e98 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:76:01,bridge_name='br-int',has_traffic_filtering=True,id=c3166a00-dc11-448b-8d36-fdf64043f186,network=Network(f8cfc91c-2af0-409c-b7cc-8845ec47b4d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3166a00-dc') {{(pid=74960) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 12:27:03 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:27:03 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:27:03 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 12:27:03 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:27:03 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2c6c8be4-4048-5a09-9082-c3536f5b1eb9', '_type': 'linux-noop'}}, row=False) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:27:03 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:27:03 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:27:03 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:27:03 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc3166a00-dc, may_exist=True, interface_attrs={}) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:27:03 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc3166a00-dc, col_values=(('qos', UUID('4b4b4136-a0e0-4dda-8296-c8d576d4b0cb')),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:27:03 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc3166a00-dc, col_values=(('external_ids', {'iface-id': 'c3166a00-dc11-448b-8d36-fdf64043f186', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4f:76:01', 'vm-uuid': '4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8'}),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:27:03 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:27:03 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:27:03 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:27:03 user nova-compute[74960]: INFO os_vif [None req-82352e00-4a0d-46b3-9526-75dd26394e98 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:76:01,bridge_name='br-int',has_traffic_filtering=True,id=c3166a00-dc11-448b-8d36-fdf64043f186,network=Network(f8cfc91c-2af0-409c-b7cc-8845ec47b4d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3166a00-dc')
Nov 03 12:27:03 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-82352e00-4a0d-46b3-9526-75dd26394e98 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] No BDM found with device name vda, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:27:03 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-82352e00-4a0d-46b3-9526-75dd26394e98 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] No VIF found with MAC fa:16:3e:4f:76:01, not building metadata {{(pid=74960) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 12:27:03 user nova-compute[74960]: DEBUG nova.network.neutron [req-98b71c9a-7a9a-462d-ada8-3c002d9f2612 req-9806be82-f046-4f46-8ce7-7caf291268a0 service nova] [instance: 4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8] Updated VIF entry in instance network info cache for port c3166a00-dc11-448b-8d36-fdf64043f186. {{(pid=74960) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 12:27:03 user nova-compute[74960]: DEBUG nova.network.neutron [req-98b71c9a-7a9a-462d-ada8-3c002d9f2612 req-9806be82-f046-4f46-8ce7-7caf291268a0 service nova] [instance: 4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8] Updating instance_info_cache with network_info: [{"id": "c3166a00-dc11-448b-8d36-fdf64043f186", "address": "fa:16:3e:4f:76:01", "network": {"id": "f8cfc91c-2af0-409c-b7cc-8845ec47b4d5", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "63ee9c80c632442fb0379f47b784bd20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3166a00-dc", "ovs_interfaceid": "c3166a00-dc11-448b-8d36-fdf64043f186", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:27:03 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-98b71c9a-7a9a-462d-ada8-3c002d9f2612 req-9806be82-f046-4f46-8ce7-7caf291268a0 service nova] Releasing lock "refresh_cache-4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:27:04 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:27:04 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:27:04 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:27:04 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:27:04 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:27:05 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:27:05 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:27:06 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:27:06 user nova-compute[74960]: DEBUG nova.compute.manager [None req-82352e00-4a0d-46b3-9526-75dd26394e98 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] [instance: 4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8] Instance event wait completed in 0 seconds for  {{(pid=74960) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 12:27:06 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-82352e00-4a0d-46b3-9526-75dd26394e98 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] [instance: 4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8] Guest created on hypervisor {{(pid=74960) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 12:27:06 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: 4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8] Instance spawned successfully.
Nov 03 12:27:06 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-82352e00-4a0d-46b3-9526-75dd26394e98 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] [instance: 4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 12:27:06 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-82352e00-4a0d-46b3-9526-75dd26394e98 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] [instance: 4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8] Found default for hw_cdrom_bus of ide {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:27:06 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-82352e00-4a0d-46b3-9526-75dd26394e98 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] [instance: 4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8] Found default for hw_disk_bus of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:27:06 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-82352e00-4a0d-46b3-9526-75dd26394e98 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] [instance: 4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8] Found default for hw_input_bus of None {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:27:06 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-82352e00-4a0d-46b3-9526-75dd26394e98 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] [instance: 4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8] Found default for hw_pointer_model of None {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:27:06 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-82352e00-4a0d-46b3-9526-75dd26394e98 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] [instance: 4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8] Found default for hw_video_model of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:27:06 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-82352e00-4a0d-46b3-9526-75dd26394e98 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] [instance: 4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8] Found default for hw_vif_model of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:27:06 user nova-compute[74960]: INFO nova.compute.manager [None req-82352e00-4a0d-46b3-9526-75dd26394e98 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] [instance: 4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8] Took 5.99 seconds to spawn the instance on the hypervisor.
Nov 03 12:27:06 user nova-compute[74960]: DEBUG nova.compute.manager [None req-82352e00-4a0d-46b3-9526-75dd26394e98 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] [instance: 4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8] Checking state {{(pid=74960) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 12:27:06 user nova-compute[74960]: INFO nova.compute.manager [None req-82352e00-4a0d-46b3-9526-75dd26394e98 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] [instance: 4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8] Took 6.72 seconds to build instance.
Nov 03 12:27:06 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-82352e00-4a0d-46b3-9526-75dd26394e98 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] Lock "4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.867s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:27:07 user nova-compute[74960]: DEBUG nova.compute.manager [req-8b45ee38-07cb-4258-a5f4-3774e9e74839 req-69f23c29-8043-4e51-bc88-1bee4565a927 service nova] [instance: 4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8] Received event network-vif-plugged-c3166a00-dc11-448b-8d36-fdf64043f186 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:27:07 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-8b45ee38-07cb-4258-a5f4-3774e9e74839 req-69f23c29-8043-4e51-bc88-1bee4565a927 service nova] Acquiring lock "4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:27:07 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-8b45ee38-07cb-4258-a5f4-3774e9e74839 req-69f23c29-8043-4e51-bc88-1bee4565a927 service nova] Lock "4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:27:07 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-8b45ee38-07cb-4258-a5f4-3774e9e74839 req-69f23c29-8043-4e51-bc88-1bee4565a927 service nova] Lock "4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:27:07 user nova-compute[74960]: DEBUG nova.compute.manager [req-8b45ee38-07cb-4258-a5f4-3774e9e74839 req-69f23c29-8043-4e51-bc88-1bee4565a927 service nova] [instance: 4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8] No waiting events found dispatching network-vif-plugged-c3166a00-dc11-448b-8d36-fdf64043f186 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:27:07 user nova-compute[74960]: WARNING nova.compute.manager [req-8b45ee38-07cb-4258-a5f4-3774e9e74839 req-69f23c29-8043-4e51-bc88-1bee4565a927 service nova] [instance: 4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8] Received unexpected event network-vif-plugged-c3166a00-dc11-448b-8d36-fdf64043f186 for instance with vm_state active and task_state None.
Nov 03 12:27:08 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:27:08 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:27:09 user nova-compute[74960]: DEBUG nova.compute.manager [req-707ea21e-2028-4fa6-959c-b454c43575dc req-eb0625a2-fe52-40fd-bd41-efeca94f0bb0 service nova] [instance: 4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8] Received event network-vif-plugged-c3166a00-dc11-448b-8d36-fdf64043f186 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:27:09 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-707ea21e-2028-4fa6-959c-b454c43575dc req-eb0625a2-fe52-40fd-bd41-efeca94f0bb0 service nova] Acquiring lock "4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:27:09 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-707ea21e-2028-4fa6-959c-b454c43575dc req-eb0625a2-fe52-40fd-bd41-efeca94f0bb0 service nova] Lock "4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:27:09 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-707ea21e-2028-4fa6-959c-b454c43575dc req-eb0625a2-fe52-40fd-bd41-efeca94f0bb0 service nova] Lock "4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:27:09 user nova-compute[74960]: DEBUG nova.compute.manager [req-707ea21e-2028-4fa6-959c-b454c43575dc req-eb0625a2-fe52-40fd-bd41-efeca94f0bb0 service nova] [instance: 4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8] No waiting events found dispatching network-vif-plugged-c3166a00-dc11-448b-8d36-fdf64043f186 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:27:09 user nova-compute[74960]: WARNING nova.compute.manager [req-707ea21e-2028-4fa6-959c-b454c43575dc req-eb0625a2-fe52-40fd-bd41-efeca94f0bb0 service nova] [instance: 4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8] Received unexpected event network-vif-plugged-c3166a00-dc11-448b-8d36-fdf64043f186 for instance with vm_state active and task_state None.
Nov 03 12:27:13 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:27:13 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:27:13 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-d2179258-d4de-4fe0-82cc-7109ab4cc2e3 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Acquiring lock "7ec0d7c3-a6bd-40a2-997a-5cdbe9436305" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:27:13 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-d2179258-d4de-4fe0-82cc-7109ab4cc2e3 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Lock "7ec0d7c3-a6bd-40a2-997a-5cdbe9436305" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:27:13 user nova-compute[74960]: DEBUG nova.compute.manager [None req-d2179258-d4de-4fe0-82cc-7109ab4cc2e3 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] [instance: 7ec0d7c3-a6bd-40a2-997a-5cdbe9436305] Starting instance... {{(pid=74960) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 12:27:13 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-d2179258-d4de-4fe0-82cc-7109ab4cc2e3 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:27:13 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-d2179258-d4de-4fe0-82cc-7109ab4cc2e3 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:27:13 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-d2179258-d4de-4fe0-82cc-7109ab4cc2e3 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74960) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 12:27:13 user nova-compute[74960]: INFO nova.compute.claims [None req-d2179258-d4de-4fe0-82cc-7109ab4cc2e3 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] [instance: 7ec0d7c3-a6bd-40a2-997a-5cdbe9436305] Claim successful on node user
Nov 03 12:27:13 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-d2179258-d4de-4fe0-82cc-7109ab4cc2e3 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:27:13 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-d2179258-d4de-4fe0-82cc-7109ab4cc2e3 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:27:13 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-d2179258-d4de-4fe0-82cc-7109ab4cc2e3 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.357s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:27:13 user nova-compute[74960]: DEBUG nova.compute.manager [None req-d2179258-d4de-4fe0-82cc-7109ab4cc2e3 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] [instance: 7ec0d7c3-a6bd-40a2-997a-5cdbe9436305] Start building networks asynchronously for instance. {{(pid=74960) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 12:27:13 user nova-compute[74960]: DEBUG nova.compute.manager [None req-d2179258-d4de-4fe0-82cc-7109ab4cc2e3 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] [instance: 7ec0d7c3-a6bd-40a2-997a-5cdbe9436305] Allocating IP information in the background. {{(pid=74960) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 12:27:13 user nova-compute[74960]: DEBUG nova.network.neutron [None req-d2179258-d4de-4fe0-82cc-7109ab4cc2e3 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] [instance: 7ec0d7c3-a6bd-40a2-997a-5cdbe9436305] allocate_for_instance() {{(pid=74960) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 12:27:14 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-d2179258-d4de-4fe0-82cc-7109ab4cc2e3 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] [instance: 7ec0d7c3-a6bd-40a2-997a-5cdbe9436305] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 12:27:14 user nova-compute[74960]: DEBUG nova.compute.manager [None req-d2179258-d4de-4fe0-82cc-7109ab4cc2e3 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] [instance: 7ec0d7c3-a6bd-40a2-997a-5cdbe9436305] Start building block device mappings for instance. {{(pid=74960) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 12:27:14 user nova-compute[74960]: DEBUG nova.policy [None req-d2179258-d4de-4fe0-82cc-7109ab4cc2e3 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b10ff362bd8641e184623b5506ec875e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91dff8e248b4ca2bedc8631fcaf06f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74960) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 12:27:14 user nova-compute[74960]: DEBUG nova.compute.manager [None req-d2179258-d4de-4fe0-82cc-7109ab4cc2e3 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] [instance: 7ec0d7c3-a6bd-40a2-997a-5cdbe9436305] Start spawning the instance on the hypervisor. {{(pid=74960) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 12:27:14 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-d2179258-d4de-4fe0-82cc-7109ab4cc2e3 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] [instance: 7ec0d7c3-a6bd-40a2-997a-5cdbe9436305] Creating instance directory {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 12:27:14 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-d2179258-d4de-4fe0-82cc-7109ab4cc2e3 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] [instance: 7ec0d7c3-a6bd-40a2-997a-5cdbe9436305] Creating image(s)
Nov 03 12:27:14 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-d2179258-d4de-4fe0-82cc-7109ab4cc2e3 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Acquiring lock "/opt/stack/data/nova/instances/7ec0d7c3-a6bd-40a2-997a-5cdbe9436305/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:27:14 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-d2179258-d4de-4fe0-82cc-7109ab4cc2e3 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Lock "/opt/stack/data/nova/instances/7ec0d7c3-a6bd-40a2-997a-5cdbe9436305/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:27:14 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-d2179258-d4de-4fe0-82cc-7109ab4cc2e3 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Lock "/opt/stack/data/nova/instances/7ec0d7c3-a6bd-40a2-997a-5cdbe9436305/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:27:14 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-d2179258-d4de-4fe0-82cc-7109ab4cc2e3 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:27:14 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-d2179258-d4de-4fe0-82cc-7109ab4cc2e3 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.170s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:27:14 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-d2179258-d4de-4fe0-82cc-7109ab4cc2e3 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Acquiring lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:27:14 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-d2179258-d4de-4fe0-82cc-7109ab4cc2e3 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:27:14 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-d2179258-d4de-4fe0-82cc-7109ab4cc2e3 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:27:14 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-d2179258-d4de-4fe0-82cc-7109ab4cc2e3 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.180s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:27:14 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-d2179258-d4de-4fe0-82cc-7109ab4cc2e3 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910,backing_fmt=raw /opt/stack/data/nova/instances/7ec0d7c3-a6bd-40a2-997a-5cdbe9436305/disk 1073741824 {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:27:14 user nova-compute[74960]: DEBUG nova.network.neutron [None req-d2179258-d4de-4fe0-82cc-7109ab4cc2e3 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] [instance: 7ec0d7c3-a6bd-40a2-997a-5cdbe9436305] Successfully created port: 4a8609a8-f748-4982-9a03-1650a5433e9c {{(pid=74960) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 12:27:14 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-d2179258-d4de-4fe0-82cc-7109ab4cc2e3 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910,backing_fmt=raw /opt/stack/data/nova/instances/7ec0d7c3-a6bd-40a2-997a-5cdbe9436305/disk 1073741824" returned: 0 in 0.052s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:27:14 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-d2179258-d4de-4fe0-82cc-7109ab4cc2e3 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:27:14 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-d2179258-d4de-4fe0-82cc-7109ab4cc2e3 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:27:14 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-d2179258-d4de-4fe0-82cc-7109ab4cc2e3 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.168s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:27:14 user nova-compute[74960]: DEBUG nova.virt.disk.api [None req-d2179258-d4de-4fe0-82cc-7109ab4cc2e3 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7ec0d7c3-a6bd-40a2-997a-5cdbe9436305/disk. size=1073741824 {{(pid=74960) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 12:27:14 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-d2179258-d4de-4fe0-82cc-7109ab4cc2e3 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec0d7c3-a6bd-40a2-997a-5cdbe9436305/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:27:14 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-d2179258-d4de-4fe0-82cc-7109ab4cc2e3 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec0d7c3-a6bd-40a2-997a-5cdbe9436305/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:27:14 user nova-compute[74960]: DEBUG nova.virt.disk.api [None req-d2179258-d4de-4fe0-82cc-7109ab4cc2e3 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Cannot resize image /opt/stack/data/nova/instances/7ec0d7c3-a6bd-40a2-997a-5cdbe9436305/disk to a smaller size. {{(pid=74960) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 12:27:14 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-d2179258-d4de-4fe0-82cc-7109ab4cc2e3 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] [instance: 7ec0d7c3-a6bd-40a2-997a-5cdbe9436305] Created local disks {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 12:27:14 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-d2179258-d4de-4fe0-82cc-7109ab4cc2e3 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] [instance: 7ec0d7c3-a6bd-40a2-997a-5cdbe9436305] Ensure instance console log exists: /opt/stack/data/nova/instances/7ec0d7c3-a6bd-40a2-997a-5cdbe9436305/console.log {{(pid=74960) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 12:27:14 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-d2179258-d4de-4fe0-82cc-7109ab4cc2e3 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:27:14 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-d2179258-d4de-4fe0-82cc-7109ab4cc2e3 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:27:14 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-d2179258-d4de-4fe0-82cc-7109ab4cc2e3 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:27:15 user nova-compute[74960]: DEBUG nova.network.neutron [None req-d2179258-d4de-4fe0-82cc-7109ab4cc2e3 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] [instance: 7ec0d7c3-a6bd-40a2-997a-5cdbe9436305] Successfully updated port: 4a8609a8-f748-4982-9a03-1650a5433e9c {{(pid=74960) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 12:27:15 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-d2179258-d4de-4fe0-82cc-7109ab4cc2e3 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Acquiring lock "refresh_cache-7ec0d7c3-a6bd-40a2-997a-5cdbe9436305" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:27:15 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-d2179258-d4de-4fe0-82cc-7109ab4cc2e3 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Acquired lock "refresh_cache-7ec0d7c3-a6bd-40a2-997a-5cdbe9436305" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:27:15 user nova-compute[74960]: DEBUG nova.network.neutron [None req-d2179258-d4de-4fe0-82cc-7109ab4cc2e3 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] [instance: 7ec0d7c3-a6bd-40a2-997a-5cdbe9436305] Building network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 12:27:15 user nova-compute[74960]: DEBUG nova.compute.manager [req-a5f5af7f-fda5-4a57-81e6-fa079a6d2294 req-370d126c-86e2-4c98-9a00-d36f064b0f8c service nova] [instance: 7ec0d7c3-a6bd-40a2-997a-5cdbe9436305] Received event network-changed-4a8609a8-f748-4982-9a03-1650a5433e9c {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:27:15 user nova-compute[74960]: DEBUG nova.compute.manager [req-a5f5af7f-fda5-4a57-81e6-fa079a6d2294 req-370d126c-86e2-4c98-9a00-d36f064b0f8c service nova] [instance: 7ec0d7c3-a6bd-40a2-997a-5cdbe9436305] Refreshing instance network info cache due to event network-changed-4a8609a8-f748-4982-9a03-1650a5433e9c. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 12:27:15 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-a5f5af7f-fda5-4a57-81e6-fa079a6d2294 req-370d126c-86e2-4c98-9a00-d36f064b0f8c service nova] Acquiring lock "refresh_cache-7ec0d7c3-a6bd-40a2-997a-5cdbe9436305" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:27:15 user nova-compute[74960]: DEBUG nova.network.neutron [None req-d2179258-d4de-4fe0-82cc-7109ab4cc2e3 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] [instance: 7ec0d7c3-a6bd-40a2-997a-5cdbe9436305] Instance cache missing network info. {{(pid=74960) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 12:27:15 user nova-compute[74960]: DEBUG nova.network.neutron [None req-d2179258-d4de-4fe0-82cc-7109ab4cc2e3 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] [instance: 7ec0d7c3-a6bd-40a2-997a-5cdbe9436305] Updating instance_info_cache with network_info: [{"id": "4a8609a8-f748-4982-9a03-1650a5433e9c", "address": "fa:16:3e:bb:75:23", "network": {"id": "78afe6eb-a6db-4f0c-a135-32b7775b5e2a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1883110422-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f91dff8e248b4ca2bedc8631fcaf06f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a8609a8-f7", "ovs_interfaceid": "4a8609a8-f748-4982-9a03-1650a5433e9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:27:15 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-d2179258-d4de-4fe0-82cc-7109ab4cc2e3 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Releasing lock "refresh_cache-7ec0d7c3-a6bd-40a2-997a-5cdbe9436305" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:27:15 user nova-compute[74960]: DEBUG nova.compute.manager [None req-d2179258-d4de-4fe0-82cc-7109ab4cc2e3 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] [instance: 7ec0d7c3-a6bd-40a2-997a-5cdbe9436305] Instance network_info: |[{"id": "4a8609a8-f748-4982-9a03-1650a5433e9c", "address": "fa:16:3e:bb:75:23", "network": {"id": "78afe6eb-a6db-4f0c-a135-32b7775b5e2a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1883110422-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f91dff8e248b4ca2bedc8631fcaf06f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a8609a8-f7", "ovs_interfaceid": "4a8609a8-f748-4982-9a03-1650a5433e9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74960) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 12:27:15 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-a5f5af7f-fda5-4a57-81e6-fa079a6d2294 req-370d126c-86e2-4c98-9a00-d36f064b0f8c service nova] Acquired lock "refresh_cache-7ec0d7c3-a6bd-40a2-997a-5cdbe9436305" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:27:15 user nova-compute[74960]: DEBUG nova.network.neutron [req-a5f5af7f-fda5-4a57-81e6-fa079a6d2294 req-370d126c-86e2-4c98-9a00-d36f064b0f8c service nova] [instance: 7ec0d7c3-a6bd-40a2-997a-5cdbe9436305] Refreshing network info cache for port 4a8609a8-f748-4982-9a03-1650a5433e9c {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 12:27:15 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-d2179258-d4de-4fe0-82cc-7109ab4cc2e3 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] [instance: 7ec0d7c3-a6bd-40a2-997a-5cdbe9436305] Start _get_guest_xml network_info=[{"id": "4a8609a8-f748-4982-9a03-1650a5433e9c", "address": "fa:16:3e:bb:75:23", "network": {"id": "78afe6eb-a6db-4f0c-a135-32b7775b5e2a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1883110422-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f91dff8e248b4ca2bedc8631fcaf06f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a8609a8-f7", "ovs_interfaceid": "4a8609a8-f748-4982-9a03-1650a5433e9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=549f51ba-ac69-494b-8de1-34635aa2d7cf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='63ee9c80c632442fb0379f47b784bd20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T12:13:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'image_id': '549f51ba-ac69-494b-8de1-34635aa2d7cf'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 12:27:15 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-d2179258-d4de-4fe0-82cc-7109ab4cc2e3 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:27:15 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-d2179258-d4de-4fe0-82cc-7109ab4cc2e3 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:27:15 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-d2179258-d4de-4fe0-82cc-7109ab4cc2e3 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 12:27:15 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-d2179258-d4de-4fe0-82cc-7109ab4cc2e3 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] CPU controller missing on host. {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 12:27:15 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-d2179258-d4de-4fe0-82cc-7109ab4cc2e3 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 12:27:15 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-d2179258-d4de-4fe0-82cc-7109ab4cc2e3 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] CPU controller found on host. {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 12:27:15 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-d2179258-d4de-4fe0-82cc-7109ab4cc2e3 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74960) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 12:27:15 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-d2179258-d4de-4fe0-82cc-7109ab4cc2e3 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=549f51ba-ac69-494b-8de1-34635aa2d7cf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='63ee9c80c632442fb0379f47b784bd20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T12:13:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 12:27:15 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-d2179258-d4de-4fe0-82cc-7109ab4cc2e3 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Flavor limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 12:27:15 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-d2179258-d4de-4fe0-82cc-7109ab4cc2e3 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Image limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 12:27:15 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-d2179258-d4de-4fe0-82cc-7109ab4cc2e3 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Flavor pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 12:27:15 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-d2179258-d4de-4fe0-82cc-7109ab4cc2e3 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Image pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 12:27:15 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-d2179258-d4de-4fe0-82cc-7109ab4cc2e3 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 12:27:15 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-d2179258-d4de-4fe0-82cc-7109ab4cc2e3 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 12:27:15 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-d2179258-d4de-4fe0-82cc-7109ab4cc2e3 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 12:27:15 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-d2179258-d4de-4fe0-82cc-7109ab4cc2e3 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Got 1 possible topologies {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 12:27:15 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-d2179258-d4de-4fe0-82cc-7109ab4cc2e3 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 12:27:15 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-d2179258-d4de-4fe0-82cc-7109ab4cc2e3 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 12:27:15 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-d2179258-d4de-4fe0-82cc-7109ab4cc2e3 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:27:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-379748673',display_name='tempest-VolumesActionsTest-instance-379748673',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-379748673',id=24,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f91dff8e248b4ca2bedc8631fcaf06f3',ramdisk_id='',reservation_id='r-9y5ax62s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1450410058',owner_user_name='tempest-VolumesActionsTest-1450410058-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:27:14Z,user_data=None,user_id='b10ff362bd8641e184623b5506ec875e',uuid=7ec0d7c3-a6bd-40a2-997a-5cdbe9436305,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4a8609a8-f748-4982-9a03-1650a5433e9c", "address": "fa:16:3e:bb:75:23", "network": {"id": "78afe6eb-a6db-4f0c-a135-32b7775b5e2a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1883110422-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f91dff8e248b4ca2bedc8631fcaf06f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a8609a8-f7", "ovs_interfaceid": "4a8609a8-f748-4982-9a03-1650a5433e9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74960) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 12:27:15 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-d2179258-d4de-4fe0-82cc-7109ab4cc2e3 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Converting VIF {"id": "4a8609a8-f748-4982-9a03-1650a5433e9c", "address": "fa:16:3e:bb:75:23", "network": {"id": "78afe6eb-a6db-4f0c-a135-32b7775b5e2a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1883110422-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f91dff8e248b4ca2bedc8631fcaf06f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a8609a8-f7", "ovs_interfaceid": "4a8609a8-f748-4982-9a03-1650a5433e9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:27:15 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-d2179258-d4de-4fe0-82cc-7109ab4cc2e3 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:75:23,bridge_name='br-int',has_traffic_filtering=True,id=4a8609a8-f748-4982-9a03-1650a5433e9c,network=Network(78afe6eb-a6db-4f0c-a135-32b7775b5e2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a8609a8-f7') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:27:15 user nova-compute[74960]: DEBUG nova.objects.instance [None req-d2179258-d4de-4fe0-82cc-7109ab4cc2e3 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Lazy-loading 'pci_devices' on Instance uuid 7ec0d7c3-a6bd-40a2-997a-5cdbe9436305 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:27:15 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-d2179258-d4de-4fe0-82cc-7109ab4cc2e3 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] [instance: 7ec0d7c3-a6bd-40a2-997a-5cdbe9436305] End _get_guest_xml xml=<domain type="kvm">
Nov 03 12:27:15 user nova-compute[74960]:   <uuid>7ec0d7c3-a6bd-40a2-997a-5cdbe9436305</uuid>
Nov 03 12:27:15 user nova-compute[74960]:   <name>instance-00000018</name>
Nov 03 12:27:15 user nova-compute[74960]:   <memory>524288</memory>
Nov 03 12:27:15 user nova-compute[74960]:   <vcpu>1</vcpu>
Nov 03 12:27:15 user nova-compute[74960]:   <metadata>
Nov 03 12:27:15 user nova-compute[74960]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 12:27:15 user nova-compute[74960]:       <nova:package version="0.0.0"/>
Nov 03 12:27:15 user nova-compute[74960]:       <nova:name>tempest-VolumesActionsTest-instance-379748673</nova:name>
Nov 03 12:27:15 user nova-compute[74960]:       <nova:creationTime>2023-11-03 12:27:15</nova:creationTime>
Nov 03 12:27:15 user nova-compute[74960]:       <nova:flavor name="m1.tiny">
Nov 03 12:27:15 user nova-compute[74960]:         <nova:memory>512</nova:memory>
Nov 03 12:27:15 user nova-compute[74960]:         <nova:disk>1</nova:disk>
Nov 03 12:27:15 user nova-compute[74960]:         <nova:swap>0</nova:swap>
Nov 03 12:27:15 user nova-compute[74960]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 12:27:15 user nova-compute[74960]:         <nova:vcpus>1</nova:vcpus>
Nov 03 12:27:15 user nova-compute[74960]:       </nova:flavor>
Nov 03 12:27:15 user nova-compute[74960]:       <nova:owner>
Nov 03 12:27:15 user nova-compute[74960]:         <nova:user uuid="b10ff362bd8641e184623b5506ec875e">tempest-VolumesActionsTest-1450410058-project-member</nova:user>
Nov 03 12:27:15 user nova-compute[74960]:         <nova:project uuid="f91dff8e248b4ca2bedc8631fcaf06f3">tempest-VolumesActionsTest-1450410058</nova:project>
Nov 03 12:27:15 user nova-compute[74960]:       </nova:owner>
Nov 03 12:27:15 user nova-compute[74960]:       <nova:root type="image" uuid="549f51ba-ac69-494b-8de1-34635aa2d7cf"/>
Nov 03 12:27:15 user nova-compute[74960]:       <nova:ports>
Nov 03 12:27:15 user nova-compute[74960]:         <nova:port uuid="4a8609a8-f748-4982-9a03-1650a5433e9c">
Nov 03 12:27:15 user nova-compute[74960]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 03 12:27:15 user nova-compute[74960]:         </nova:port>
Nov 03 12:27:15 user nova-compute[74960]:       </nova:ports>
Nov 03 12:27:15 user nova-compute[74960]:     </nova:instance>
Nov 03 12:27:15 user nova-compute[74960]:   </metadata>
Nov 03 12:27:15 user nova-compute[74960]:   <sysinfo type="smbios">
Nov 03 12:27:15 user nova-compute[74960]:     <system>
Nov 03 12:27:15 user nova-compute[74960]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 12:27:15 user nova-compute[74960]:       <entry name="product">OpenStack Nova</entry>
Nov 03 12:27:15 user nova-compute[74960]:       <entry name="version">0.0.0</entry>
Nov 03 12:27:15 user nova-compute[74960]:       <entry name="serial">7ec0d7c3-a6bd-40a2-997a-5cdbe9436305</entry>
Nov 03 12:27:15 user nova-compute[74960]:       <entry name="uuid">7ec0d7c3-a6bd-40a2-997a-5cdbe9436305</entry>
Nov 03 12:27:15 user nova-compute[74960]:       <entry name="family">Virtual Machine</entry>
Nov 03 12:27:15 user nova-compute[74960]:     </system>
Nov 03 12:27:15 user nova-compute[74960]:   </sysinfo>
Nov 03 12:27:15 user nova-compute[74960]:   <os>
Nov 03 12:27:15 user nova-compute[74960]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 12:27:15 user nova-compute[74960]:     <boot dev="hd"/>
Nov 03 12:27:15 user nova-compute[74960]:     <smbios mode="sysinfo"/>
Nov 03 12:27:15 user nova-compute[74960]:   </os>
Nov 03 12:27:15 user nova-compute[74960]:   <features>
Nov 03 12:27:15 user nova-compute[74960]:     <acpi/>
Nov 03 12:27:15 user nova-compute[74960]:     <apic/>
Nov 03 12:27:15 user nova-compute[74960]:     <vmcoreinfo/>
Nov 03 12:27:15 user nova-compute[74960]:   </features>
Nov 03 12:27:15 user nova-compute[74960]:   <clock offset="utc">
Nov 03 12:27:15 user nova-compute[74960]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 12:27:15 user nova-compute[74960]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 12:27:15 user nova-compute[74960]:     <timer name="hpet" present="no"/>
Nov 03 12:27:15 user nova-compute[74960]:   </clock>
Nov 03 12:27:15 user nova-compute[74960]:   <cpu mode="custom" match="exact">
Nov 03 12:27:15 user nova-compute[74960]:     <model>Nehalem</model>
Nov 03 12:27:15 user nova-compute[74960]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 12:27:15 user nova-compute[74960]:   </cpu>
Nov 03 12:27:15 user nova-compute[74960]:   <devices>
Nov 03 12:27:15 user nova-compute[74960]:     <disk type="file" device="disk">
Nov 03 12:27:15 user nova-compute[74960]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 12:27:15 user nova-compute[74960]:       <source file="/opt/stack/data/nova/instances/7ec0d7c3-a6bd-40a2-997a-5cdbe9436305/disk"/>
Nov 03 12:27:15 user nova-compute[74960]:       <target dev="vda" bus="virtio"/>
Nov 03 12:27:15 user nova-compute[74960]:     </disk>
Nov 03 12:27:15 user nova-compute[74960]:     <interface type="ethernet">
Nov 03 12:27:15 user nova-compute[74960]:       <mac address="fa:16:3e:bb:75:23"/>
Nov 03 12:27:15 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:27:15 user nova-compute[74960]:       <mtu size="1442"/>
Nov 03 12:27:15 user nova-compute[74960]:       <target dev="tap4a8609a8-f7"/>
Nov 03 12:27:15 user nova-compute[74960]:     </interface>
Nov 03 12:27:15 user nova-compute[74960]:     <serial type="pty">
Nov 03 12:27:15 user nova-compute[74960]:       <log file="/opt/stack/data/nova/instances/7ec0d7c3-a6bd-40a2-997a-5cdbe9436305/console.log" append="off"/>
Nov 03 12:27:15 user nova-compute[74960]:     </serial>
Nov 03 12:27:15 user nova-compute[74960]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 12:27:15 user nova-compute[74960]:     <video>
Nov 03 12:27:15 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:27:15 user nova-compute[74960]:     </video>
Nov 03 12:27:15 user nova-compute[74960]:     <rng model="virtio">
Nov 03 12:27:15 user nova-compute[74960]:       <backend model="random">/dev/urandom</backend>
Nov 03 12:27:15 user nova-compute[74960]:     </rng>
Nov 03 12:27:15 user nova-compute[74960]:     <controller type="usb" index="0" model="none"/>
Nov 03 12:27:15 user nova-compute[74960]:     <memballoon model="virtio">
Nov 03 12:27:15 user nova-compute[74960]:       <stats period="10"/>
Nov 03 12:27:15 user nova-compute[74960]:     </memballoon>
Nov 03 12:27:15 user nova-compute[74960]:   </devices>
Nov 03 12:27:15 user nova-compute[74960]: </domain>
Nov 03 12:27:15 user nova-compute[74960]:  {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 12:27:15 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-d2179258-d4de-4fe0-82cc-7109ab4cc2e3 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:27:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-379748673',display_name='tempest-VolumesActionsTest-instance-379748673',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-379748673',id=24,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f91dff8e248b4ca2bedc8631fcaf06f3',ramdisk_id='',reservation_id='r-9y5ax62s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1450410058',owner_user_name='tempest-VolumesActionsTest-1450410058-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:27:14Z,user_data=None,user_id='b10ff362bd8641e184623b5506ec875e',uuid=7ec0d7c3-a6bd-40a2-997a-5cdbe9436305,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4a8609a8-f748-4982-9a03-1650a5433e9c", "address": "fa:16:3e:bb:75:23", "network": {"id": "78afe6eb-a6db-4f0c-a135-32b7775b5e2a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1883110422-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f91dff8e248b4ca2bedc8631fcaf06f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a8609a8-f7", "ovs_interfaceid": "4a8609a8-f748-4982-9a03-1650a5433e9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 12:27:15 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-d2179258-d4de-4fe0-82cc-7109ab4cc2e3 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Converting VIF {"id": "4a8609a8-f748-4982-9a03-1650a5433e9c", "address": "fa:16:3e:bb:75:23", "network": {"id": "78afe6eb-a6db-4f0c-a135-32b7775b5e2a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1883110422-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f91dff8e248b4ca2bedc8631fcaf06f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a8609a8-f7", "ovs_interfaceid": "4a8609a8-f748-4982-9a03-1650a5433e9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:27:15 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-d2179258-d4de-4fe0-82cc-7109ab4cc2e3 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:75:23,bridge_name='br-int',has_traffic_filtering=True,id=4a8609a8-f748-4982-9a03-1650a5433e9c,network=Network(78afe6eb-a6db-4f0c-a135-32b7775b5e2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a8609a8-f7') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:27:15 user nova-compute[74960]: DEBUG os_vif [None req-d2179258-d4de-4fe0-82cc-7109ab4cc2e3 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:75:23,bridge_name='br-int',has_traffic_filtering=True,id=4a8609a8-f748-4982-9a03-1650a5433e9c,network=Network(78afe6eb-a6db-4f0c-a135-32b7775b5e2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a8609a8-f7') {{(pid=74960) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 12:27:15 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:27:15 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:27:15 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 12:27:15 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:27:15 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '913b183f-2b24-5733-8171-b04186cce27b', '_type': 'linux-noop'}}, row=False) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:27:15 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:27:15 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:27:15 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:27:15 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4a8609a8-f7, may_exist=True, interface_attrs={}) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:27:15 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4a8609a8-f7, col_values=(('qos', UUID('74da13c9-0a59-4e49-9cc8-a00889ff5916')),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:27:15 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4a8609a8-f7, col_values=(('external_ids', {'iface-id': '4a8609a8-f748-4982-9a03-1650a5433e9c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bb:75:23', 'vm-uuid': '7ec0d7c3-a6bd-40a2-997a-5cdbe9436305'}),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:27:15 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:27:15 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:27:15 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:27:15 user nova-compute[74960]: INFO os_vif [None req-d2179258-d4de-4fe0-82cc-7109ab4cc2e3 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:75:23,bridge_name='br-int',has_traffic_filtering=True,id=4a8609a8-f748-4982-9a03-1650a5433e9c,network=Network(78afe6eb-a6db-4f0c-a135-32b7775b5e2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a8609a8-f7')
Nov 03 12:27:15 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-d2179258-d4de-4fe0-82cc-7109ab4cc2e3 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] No BDM found with device name vda, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:27:15 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-d2179258-d4de-4fe0-82cc-7109ab4cc2e3 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] No VIF found with MAC fa:16:3e:bb:75:23, not building metadata {{(pid=74960) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 12:27:16 user nova-compute[74960]: DEBUG nova.network.neutron [req-a5f5af7f-fda5-4a57-81e6-fa079a6d2294 req-370d126c-86e2-4c98-9a00-d36f064b0f8c service nova] [instance: 7ec0d7c3-a6bd-40a2-997a-5cdbe9436305] Updated VIF entry in instance network info cache for port 4a8609a8-f748-4982-9a03-1650a5433e9c. {{(pid=74960) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 12:27:16 user nova-compute[74960]: DEBUG nova.network.neutron [req-a5f5af7f-fda5-4a57-81e6-fa079a6d2294 req-370d126c-86e2-4c98-9a00-d36f064b0f8c service nova] [instance: 7ec0d7c3-a6bd-40a2-997a-5cdbe9436305] Updating instance_info_cache with network_info: [{"id": "4a8609a8-f748-4982-9a03-1650a5433e9c", "address": "fa:16:3e:bb:75:23", "network": {"id": "78afe6eb-a6db-4f0c-a135-32b7775b5e2a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1883110422-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f91dff8e248b4ca2bedc8631fcaf06f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a8609a8-f7", "ovs_interfaceid": "4a8609a8-f748-4982-9a03-1650a5433e9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:27:16 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-a5f5af7f-fda5-4a57-81e6-fa079a6d2294 req-370d126c-86e2-4c98-9a00-d36f064b0f8c service nova] Releasing lock "refresh_cache-7ec0d7c3-a6bd-40a2-997a-5cdbe9436305" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:27:17 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:27:17 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:27:17 user nova-compute[74960]: DEBUG nova.compute.manager [req-9b156dcc-d204-464a-bac3-eccaea54fbd3 req-1fbb72ef-8516-49f2-be47-bc752c5fd833 service nova] [instance: 7ec0d7c3-a6bd-40a2-997a-5cdbe9436305] Received event network-vif-plugged-4a8609a8-f748-4982-9a03-1650a5433e9c {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:27:17 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-9b156dcc-d204-464a-bac3-eccaea54fbd3 req-1fbb72ef-8516-49f2-be47-bc752c5fd833 service nova] Acquiring lock "7ec0d7c3-a6bd-40a2-997a-5cdbe9436305-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:27:17 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-9b156dcc-d204-464a-bac3-eccaea54fbd3 req-1fbb72ef-8516-49f2-be47-bc752c5fd833 service nova] Lock "7ec0d7c3-a6bd-40a2-997a-5cdbe9436305-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:27:17 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-9b156dcc-d204-464a-bac3-eccaea54fbd3 req-1fbb72ef-8516-49f2-be47-bc752c5fd833 service nova] Lock "7ec0d7c3-a6bd-40a2-997a-5cdbe9436305-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:27:17 user nova-compute[74960]: DEBUG nova.compute.manager [req-9b156dcc-d204-464a-bac3-eccaea54fbd3 req-1fbb72ef-8516-49f2-be47-bc752c5fd833 service nova] [instance: 7ec0d7c3-a6bd-40a2-997a-5cdbe9436305] No waiting events found dispatching network-vif-plugged-4a8609a8-f748-4982-9a03-1650a5433e9c {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:27:17 user nova-compute[74960]: WARNING nova.compute.manager [req-9b156dcc-d204-464a-bac3-eccaea54fbd3 req-1fbb72ef-8516-49f2-be47-bc752c5fd833 service nova] [instance: 7ec0d7c3-a6bd-40a2-997a-5cdbe9436305] Received unexpected event network-vif-plugged-4a8609a8-f748-4982-9a03-1650a5433e9c for instance with vm_state building and task_state spawning.
Nov 03 12:27:17 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:27:17 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:27:17 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:27:18 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:27:19 user nova-compute[74960]: DEBUG nova.compute.manager [None req-d2179258-d4de-4fe0-82cc-7109ab4cc2e3 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] [instance: 7ec0d7c3-a6bd-40a2-997a-5cdbe9436305] Instance event wait completed in 0 seconds for  {{(pid=74960) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 12:27:19 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-d2179258-d4de-4fe0-82cc-7109ab4cc2e3 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] [instance: 7ec0d7c3-a6bd-40a2-997a-5cdbe9436305] Guest created on hypervisor {{(pid=74960) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 12:27:19 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: 7ec0d7c3-a6bd-40a2-997a-5cdbe9436305] Instance spawned successfully.
Nov 03 12:27:19 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-d2179258-d4de-4fe0-82cc-7109ab4cc2e3 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] [instance: 7ec0d7c3-a6bd-40a2-997a-5cdbe9436305] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 12:27:19 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-d2179258-d4de-4fe0-82cc-7109ab4cc2e3 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] [instance: 7ec0d7c3-a6bd-40a2-997a-5cdbe9436305] Found default for hw_cdrom_bus of ide {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:27:19 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-d2179258-d4de-4fe0-82cc-7109ab4cc2e3 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] [instance: 7ec0d7c3-a6bd-40a2-997a-5cdbe9436305] Found default for hw_disk_bus of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:27:19 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-d2179258-d4de-4fe0-82cc-7109ab4cc2e3 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] [instance: 7ec0d7c3-a6bd-40a2-997a-5cdbe9436305] Found default for hw_input_bus of None {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:27:19 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-d2179258-d4de-4fe0-82cc-7109ab4cc2e3 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] [instance: 7ec0d7c3-a6bd-40a2-997a-5cdbe9436305] Found default for hw_pointer_model of None {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:27:19 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-d2179258-d4de-4fe0-82cc-7109ab4cc2e3 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] [instance: 7ec0d7c3-a6bd-40a2-997a-5cdbe9436305] Found default for hw_video_model of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:27:19 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-d2179258-d4de-4fe0-82cc-7109ab4cc2e3 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] [instance: 7ec0d7c3-a6bd-40a2-997a-5cdbe9436305] Found default for hw_vif_model of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:27:19 user nova-compute[74960]: DEBUG nova.compute.manager [req-9f09c5ca-d9df-408a-8543-ca202fd70ee7 req-848baa3e-9bd0-476e-84d3-3e488571ed17 service nova] [instance: 7ec0d7c3-a6bd-40a2-997a-5cdbe9436305] Received event network-vif-plugged-4a8609a8-f748-4982-9a03-1650a5433e9c {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:27:19 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-9f09c5ca-d9df-408a-8543-ca202fd70ee7 req-848baa3e-9bd0-476e-84d3-3e488571ed17 service nova] Acquiring lock "7ec0d7c3-a6bd-40a2-997a-5cdbe9436305-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:27:19 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-9f09c5ca-d9df-408a-8543-ca202fd70ee7 req-848baa3e-9bd0-476e-84d3-3e488571ed17 service nova] Lock "7ec0d7c3-a6bd-40a2-997a-5cdbe9436305-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:27:19 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-9f09c5ca-d9df-408a-8543-ca202fd70ee7 req-848baa3e-9bd0-476e-84d3-3e488571ed17 service nova] Lock "7ec0d7c3-a6bd-40a2-997a-5cdbe9436305-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:27:19 user nova-compute[74960]: DEBUG nova.compute.manager [req-9f09c5ca-d9df-408a-8543-ca202fd70ee7 req-848baa3e-9bd0-476e-84d3-3e488571ed17 service nova] [instance: 7ec0d7c3-a6bd-40a2-997a-5cdbe9436305] No waiting events found dispatching network-vif-plugged-4a8609a8-f748-4982-9a03-1650a5433e9c {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:27:19 user nova-compute[74960]: WARNING nova.compute.manager [req-9f09c5ca-d9df-408a-8543-ca202fd70ee7 req-848baa3e-9bd0-476e-84d3-3e488571ed17 service nova] [instance: 7ec0d7c3-a6bd-40a2-997a-5cdbe9436305] Received unexpected event network-vif-plugged-4a8609a8-f748-4982-9a03-1650a5433e9c for instance with vm_state building and task_state spawning.
Nov 03 12:27:19 user nova-compute[74960]: INFO nova.compute.manager [None req-d2179258-d4de-4fe0-82cc-7109ab4cc2e3 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] [instance: 7ec0d7c3-a6bd-40a2-997a-5cdbe9436305] Took 5.18 seconds to spawn the instance on the hypervisor.
Nov 03 12:27:19 user nova-compute[74960]: DEBUG nova.compute.manager [None req-d2179258-d4de-4fe0-82cc-7109ab4cc2e3 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] [instance: 7ec0d7c3-a6bd-40a2-997a-5cdbe9436305] Checking state {{(pid=74960) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 12:27:19 user nova-compute[74960]: INFO nova.compute.manager [None req-d2179258-d4de-4fe0-82cc-7109ab4cc2e3 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] [instance: 7ec0d7c3-a6bd-40a2-997a-5cdbe9436305] Took 5.93 seconds to build instance.
Nov 03 12:27:19 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-d2179258-d4de-4fe0-82cc-7109ab4cc2e3 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Lock "7ec0d7c3-a6bd-40a2-997a-5cdbe9436305" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.019s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:27:20 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:27:23 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:27:24 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:27:25 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:27:27 user nova-compute[74960]: DEBUG nova.compute.manager [req-f9424e4e-063c-4e2a-a10f-252ed655df81 req-470e11c7-8c6b-454d-9840-937abdfb3bf2 service nova] [instance: 7a33549f-51ea-42d0-8c8a-67d9c74784fd] Received event network-changed-158f13f7-d1d8-49aa-94e1-86d34a25f75e {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:27:27 user nova-compute[74960]: DEBUG nova.compute.manager [req-f9424e4e-063c-4e2a-a10f-252ed655df81 req-470e11c7-8c6b-454d-9840-937abdfb3bf2 service nova] [instance: 7a33549f-51ea-42d0-8c8a-67d9c74784fd] Refreshing instance network info cache due to event network-changed-158f13f7-d1d8-49aa-94e1-86d34a25f75e. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 12:27:27 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-f9424e4e-063c-4e2a-a10f-252ed655df81 req-470e11c7-8c6b-454d-9840-937abdfb3bf2 service nova] Acquiring lock "refresh_cache-7a33549f-51ea-42d0-8c8a-67d9c74784fd" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:27:27 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-f9424e4e-063c-4e2a-a10f-252ed655df81 req-470e11c7-8c6b-454d-9840-937abdfb3bf2 service nova] Acquired lock "refresh_cache-7a33549f-51ea-42d0-8c8a-67d9c74784fd" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:27:27 user nova-compute[74960]: DEBUG nova.network.neutron [req-f9424e4e-063c-4e2a-a10f-252ed655df81 req-470e11c7-8c6b-454d-9840-937abdfb3bf2 service nova] [instance: 7a33549f-51ea-42d0-8c8a-67d9c74784fd] Refreshing network info cache for port 158f13f7-d1d8-49aa-94e1-86d34a25f75e {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 12:27:27 user nova-compute[74960]: DEBUG nova.network.neutron [req-f9424e4e-063c-4e2a-a10f-252ed655df81 req-470e11c7-8c6b-454d-9840-937abdfb3bf2 service nova] [instance: 7a33549f-51ea-42d0-8c8a-67d9c74784fd] Updated VIF entry in instance network info cache for port 158f13f7-d1d8-49aa-94e1-86d34a25f75e. {{(pid=74960) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 12:27:27 user nova-compute[74960]: DEBUG nova.network.neutron [req-f9424e4e-063c-4e2a-a10f-252ed655df81 req-470e11c7-8c6b-454d-9840-937abdfb3bf2 service nova] [instance: 7a33549f-51ea-42d0-8c8a-67d9c74784fd] Updating instance_info_cache with network_info: [{"id": "158f13f7-d1d8-49aa-94e1-86d34a25f75e", "address": "fa:16:3e:1d:94:c7", "network": {"id": "d311275c-1112-433a-a2ae-7d0e452d825b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1949997511-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef726fdd031e432489ebe9a7b0ddc97f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap158f13f7-d1", "ovs_interfaceid": "158f13f7-d1d8-49aa-94e1-86d34a25f75e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:27:27 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-f9424e4e-063c-4e2a-a10f-252ed655df81 req-470e11c7-8c6b-454d-9840-937abdfb3bf2 service nova] Releasing lock "refresh_cache-7a33549f-51ea-42d0-8c8a-67d9c74784fd" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:27:27 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-a053e801-e0f6-4b81-9a14-8c4d4cc0e703 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Acquiring lock "7a33549f-51ea-42d0-8c8a-67d9c74784fd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:27:27 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-a053e801-e0f6-4b81-9a14-8c4d4cc0e703 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Lock "7a33549f-51ea-42d0-8c8a-67d9c74784fd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:27:27 user nova-compute[74960]: DEBUG nova.objects.instance [None req-a053e801-e0f6-4b81-9a14-8c4d4cc0e703 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Lazy-loading 'flavor' on Instance uuid 7a33549f-51ea-42d0-8c8a-67d9c74784fd {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:27:28 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-a053e801-e0f6-4b81-9a14-8c4d4cc0e703 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Lock "7a33549f-51ea-42d0-8c8a-67d9c74784fd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.048s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:27:28 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:27:28 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-a053e801-e0f6-4b81-9a14-8c4d4cc0e703 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Acquiring lock "7a33549f-51ea-42d0-8c8a-67d9c74784fd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:27:28 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-a053e801-e0f6-4b81-9a14-8c4d4cc0e703 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Lock "7a33549f-51ea-42d0-8c8a-67d9c74784fd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:27:28 user nova-compute[74960]: INFO nova.compute.manager [None req-a053e801-e0f6-4b81-9a14-8c4d4cc0e703 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] [instance: 7a33549f-51ea-42d0-8c8a-67d9c74784fd] Attaching volume 64cd7bb2-1477-431a-b084-4339f203980c to /dev/vdb
Nov 03 12:27:28 user nova-compute[74960]: DEBUG os_brick.utils [None req-a053e801-e0f6-4b81-9a14-8c4d4cc0e703 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:27:28 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:27:28 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:27:28 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[072e6478-d06d-4011-a693-df4743660541]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:75b8e219756\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:27:28 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:27:28 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:27:28 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0394dcf-42f8-4358-80e1-e24fc27c11a0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:27:28 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:27:28 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:27:28 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[0478274f-4669-487e-8810-90502b7e95b8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:27:28 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac4040a9-f5d8-4c5f-8742-7f92ecb61a6f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:27:28 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-a053e801-e0f6-4b81-9a14-8c4d4cc0e703 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Running cmd (subprocess): nvme version {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:27:28 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-a053e801-e0f6-4b81-9a14-8c4d4cc0e703 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] 'nvme version' failed. Not Retrying. {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 12:27:28 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a053e801-e0f6-4b81-9a14-8c4d4cc0e703 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] nvme not present on system {{(pid=74960) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 12:27:28 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:27:28 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 12:27:28 user nova-compute[74960]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 12:27:28 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a695d19-195a-48a5-aac3-9c1ae52bcff2]: (4, '') {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:27:28 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-a053e801-e0f6-4b81-9a14-8c4d4cc0e703 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74960) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 12:27:28 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-a053e801-e0f6-4b81-9a14-8c4d4cc0e703 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74960) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 12:27:28 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-a053e801-e0f6-4b81-9a14-8c4d4cc0e703 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] LIGHTOS: no hostnqn found. {{(pid=74960) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 12:27:28 user nova-compute[74960]: DEBUG os_brick.utils [None req-a053e801-e0f6-4b81-9a14-8c4d4cc0e703 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:75b8e219756', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:27:28 user nova-compute[74960]: DEBUG nova.virt.block_device [None req-a053e801-e0f6-4b81-9a14-8c4d4cc0e703 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] [instance: 7a33549f-51ea-42d0-8c8a-67d9c74784fd] Updating existing volume attachment record: 8bda0801-b282-4b87-9ec8-c73ab49b4278 {{(pid=74960) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 12:27:30 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:27:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:27:35 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:27:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:27:39 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:27:39 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Cleaning up deleted instances {{(pid=74960) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 03 12:27:39 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] There are 0 instances to clean {{(pid=74960) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 03 12:27:40 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:27:41 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:27:43 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:27:43 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:27:43 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:27:44 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:27:45 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:27:47 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:27:47 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Starting heal instance info cache {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 12:27:47 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "refresh_cache-9951fab7-4984-408e-94ca-11eab615ff25" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:27:47 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquired lock "refresh_cache-9951fab7-4984-408e-94ca-11eab615ff25" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:27:47 user nova-compute[74960]: DEBUG nova.network.neutron [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: 9951fab7-4984-408e-94ca-11eab615ff25] Forcefully refreshing network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 12:27:47 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a053e801-e0f6-4b81-9a14-8c4d4cc0e703 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] [instance: 7a33549f-51ea-42d0-8c8a-67d9c74784fd] Calling os-brick to attach iSCSI Volume {{(pid=74960) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 12:27:47 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-a053e801-e0f6-4b81-9a14-8c4d4cc0e703 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9aa420acb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:64cd7bb2-1477-431a-b084-4339f203980c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jCmqxonG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:27:47 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-a053e801-e0f6-4b81-9a14-8c4d4cc0e703 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:27:47 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-a053e801-e0f6-4b81-9a14-8c4d4cc0e703 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:27:47 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-a053e801-e0f6-4b81-9a14-8c4d4cc0e703 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:27:47 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-a053e801-e0f6-4b81-9a14-8c4d4cc0e703 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:27:47 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-a053e801-e0f6-4b81-9a14-8c4d4cc0e703 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64cd7bb2-1477-431a-b084-4339f203980c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:27:47 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-a053e801-e0f6-4b81-9a14-8c4d4cc0e703 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64cd7bb2-1477-431a-b084-4339f203980c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:27:47 user nova-compute[74960]: INFO os_brick.initiator.connectors.iscsi [None req-a053e801-e0f6-4b81-9a14-8c4d4cc0e703 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 12:27:47 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64cd7bb2-1477-431a-b084-4339f203980c -p 172.16.0.220:3260 {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:27:47 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64cd7bb2-1477-431a-b084-4339f203980c -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:27:47 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca0d00ee-5a17-4dd5-bf8b-1bdaea7c4da0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:27:47 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-a053e801-e0f6-4b81-9a14-8c4d4cc0e703 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 12:27:47 user nova-compute[74960]:  {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:27:47 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64cd7bb2-1477-431a-b084-4339f203980c -p 172.16.0.220:3260 --interface default --op new {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:27:47 user nova-compute[74960]: DEBUG nova.network.neutron [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: 9951fab7-4984-408e-94ca-11eab615ff25] Updating instance_info_cache with network_info: [{"id": "5782b039-1492-4364-b1b2-6b27ee06c5ce", "address": "fa:16:3e:55:0b:75", "network": {"id": "d6261390-d9b7-447c-be8e-ff6dd1a367ef", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1772643385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d6fbb72509e44ef8003aa2c58a7cf88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5782b039-14", "ovs_interfaceid": "5782b039-1492-4364-b1b2-6b27ee06c5ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:27:47 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64cd7bb2-1477-431a-b084-4339f203980c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:27:47 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[11521d12-5b22-416a-9b3f-77c40caf1dc5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:64cd7bb2-1477-431a-b084-4339f203980c] added\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:27:47 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-a053e801-e0f6-4b81-9a14-8c4d4cc0e703 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:64cd7bb2-1477-431a-b084-4339f203980c] added
Nov 03 12:27:47 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:27:47 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64cd7bb2-1477-431a-b084-4339f203980c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:27:47 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Releasing lock "refresh_cache-9951fab7-4984-408e-94ca-11eab615ff25" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:27:47 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: 9951fab7-4984-408e-94ca-11eab615ff25] Updated the network info_cache for instance {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 12:27:47 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:27:47 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:27:47 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64cd7bb2-1477-431a-b084-4339f203980c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:27:47 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[82454f4d-af1c-4fb7-b59b-e5e70be7c362]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:27:47 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-a053e801-e0f6-4b81-9a14-8c4d4cc0e703 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:27:47 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64cd7bb2-1477-431a-b084-4339f203980c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:27:47 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:27:47 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:27:47 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:27:47 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Auditing locally available compute resources for user (node: user) {{(pid=74960) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 12:27:47 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64cd7bb2-1477-431a-b084-4339f203980c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:27:47 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4cf1b78-5ab6-478f-ab88-d80123753551]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:27:47 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-a053e801-e0f6-4b81-9a14-8c4d4cc0e703 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:27:47 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64cd7bb2-1477-431a-b084-4339f203980c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jCmqxonG {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:27:47 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64cd7bb2-1477-431a-b084-4339f203980c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jCmqxonG" returned: 0 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:27:47 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a8eed0-8fce-4c00-81c1-94b0b6a3f505]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:27:47 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-a053e801-e0f6-4b81-9a14-8c4d4cc0e703 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jCmqxonG'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:27:47 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64cd7bb2-1477-431a-b084-4339f203980c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:27:47 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64cd7bb2-1477-431a-b084-4339f203980c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:27:47 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[8638e76c-0fd8-4697-b064-3fe27394a03d]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:27:47 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-a053e801-e0f6-4b81-9a14-8c4d4cc0e703 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:27:47 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:27:47 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:27:47 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[e884952a-972c-4c8a-a14a-8cd36c8ccb44]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815 (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:27:47 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-a053e801-e0f6-4b81-9a14-8c4d4cc0e703 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815 (non-flash)
Nov 03 12:27:47 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:27:47 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-a053e801-e0f6-4b81-9a14-8c4d4cc0e703 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815 (non-flash)
Nov 03 12:27:47 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:27:47 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64cd7bb2-1477-431a-b084-4339f203980c -p 172.16.0.220:3260 --login {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:27:48 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64cd7bb2-1477-431a-b084-4339f203980c -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:27:48 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[235535f4-52bf-4605-8ebc-ddcd7c6646e7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:64cd7bb2-1477-431a-b084-4339f203980c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:64cd7bb2-1477-431a-b084-4339f203980c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:27:48 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-a053e801-e0f6-4b81-9a14-8c4d4cc0e703 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:64cd7bb2-1477-431a-b084-4339f203980c, portal: 172.16.0.220,3260]
Nov 03 12:27:48 user nova-compute[74960]: Login to [iface: default, target: iqn.2010-10.org.openstack:64cd7bb2-1477-431a-b084-4339f203980c, portal: 172.16.0.220,3260] successful.
Nov 03 12:27:48 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:27:48 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64cd7bb2-1477-431a-b084-4339f203980c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:27:48 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec0d7c3-a6bd-40a2-997a-5cdbe9436305/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:27:48 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64cd7bb2-1477-431a-b084-4339f203980c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:27:48 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[b91dc8d8-9b12-47e0-ba23-a186f72d4f91]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:27:48 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-a053e801-e0f6-4b81-9a14-8c4d4cc0e703 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:27:48 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:27:48 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:27:48 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:27:48 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d8f4faa-83b1-46a6-8329-82f5f2f33099]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64cd7bb2-1477-431a-b084-4339f203980c (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:27:48 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-a053e801-e0f6-4b81-9a14-8c4d4cc0e703 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815 (non-flash)
Nov 03 12:27:48 user nova-compute[74960]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64cd7bb2-1477-431a-b084-4339f203980c (non-flash)
Nov 03 12:27:48 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:27:48 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-a053e801-e0f6-4b81-9a14-8c4d4cc0e703 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815 (non-flash)
Nov 03 12:27:48 user nova-compute[74960]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64cd7bb2-1477-431a-b084-4339f203980c (non-flash)
Nov 03 12:27:48 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:27:48 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-a053e801-e0f6-4b81-9a14-8c4d4cc0e703 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64cd7bb2-1477-431a-b084-4339f203980c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:27:48 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-a053e801-e0f6-4b81-9a14-8c4d4cc0e703 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Connected to 172.16.0.220:3260 {{(pid=74960) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 12:27:48 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-a053e801-e0f6-4b81-9a14-8c4d4cc0e703 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] HCTL ('33', '-', '-', 0) found on session 17 with lun 0 {{(pid=74960) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 12:27:48 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-a053e801-e0f6-4b81-9a14-8c4d4cc0e703 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74960) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 12:27:48 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:27:48 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:27:48 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[2adbd0d8-cc01-40f3-9f38-1c226a8dadb5]: (4, ('- - 0', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:27:48 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-a053e801-e0f6-4b81-9a14-8c4d4cc0e703 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Searching for a device in session 17 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74960) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 12:27:48 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-a053e801-e0f6-4b81-9a14-8c4d4cc0e703 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:64cd7bb2-1477-431a-b084-4339f203980c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jCmqxonG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74960) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 12:27:48 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec0d7c3-a6bd-40a2-997a-5cdbe9436305/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:27:48 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec0d7c3-a6bd-40a2-997a-5cdbe9436305/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:27:48 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec0d7c3-a6bd-40a2-997a-5cdbe9436305/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:27:48 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9951fab7-4984-408e-94ca-11eab615ff25/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:27:48 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9951fab7-4984-408e-94ca-11eab615ff25/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:27:48 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9951fab7-4984-408e-94ca-11eab615ff25/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:27:48 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9951fab7-4984-408e-94ca-11eab615ff25/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:27:48 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:27:48 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:27:48 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:27:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:27:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7769e3c5-136f-4282-8e3e-224e3a80922c/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:27:49 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-a053e801-e0f6-4b81-9a14-8c4d4cc0e703 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.382s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:27:49 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-a053e801-e0f6-4b81-9a14-8c4d4cc0e703 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] <== connect_volume: return (1385ms) {'type': 'block', 'scsi_wwn': '23364386430653762', 'path': '/dev/sdb'} {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:27:49 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a053e801-e0f6-4b81-9a14-8c4d4cc0e703 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] [instance: 7a33549f-51ea-42d0-8c8a-67d9c74784fd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23364386430653762', 'path': '/dev/sdb'} {{(pid=74960) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 12:27:49 user nova-compute[74960]: DEBUG nova.objects.instance [None req-a053e801-e0f6-4b81-9a14-8c4d4cc0e703 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Lazy-loading 'flavor' on Instance uuid 7a33549f-51ea-42d0-8c8a-67d9c74784fd {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:27:49 user nova-compute[74960]: DEBUG nova.virt.libvirt.guest [None req-a053e801-e0f6-4b81-9a14-8c4d4cc0e703 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] attach device xml: <disk type="block" device="disk">
Nov 03 12:27:49 user nova-compute[74960]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 12:27:49 user nova-compute[74960]:   <source dev="/dev/sdb"/>
Nov 03 12:27:49 user nova-compute[74960]:   <target dev="vdb" bus="virtio"/>
Nov 03 12:27:49 user nova-compute[74960]:   <serial>64cd7bb2-1477-431a-b084-4339f203980c</serial>
Nov 03 12:27:49 user nova-compute[74960]: </disk>
Nov 03 12:27:49 user nova-compute[74960]:  {{(pid=74960) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 03 12:27:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7769e3c5-136f-4282-8e3e-224e3a80922c/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:27:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7769e3c5-136f-4282-8e3e-224e3a80922c/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:27:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7769e3c5-136f-4282-8e3e-224e3a80922c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:27:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be38c803-d97c-4939-9852-e8db1c44bb65/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:27:49 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-a053e801-e0f6-4b81-9a14-8c4d4cc0e703 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] No BDM found with device name vda, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:27:49 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-a053e801-e0f6-4b81-9a14-8c4d4cc0e703 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:27:49 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-a053e801-e0f6-4b81-9a14-8c4d4cc0e703 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] No VIF found with MAC fa:16:3e:1d:94:c7, not building metadata {{(pid=74960) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 12:27:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be38c803-d97c-4939-9852-e8db1c44bb65/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:27:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be38c803-d97c-4939-9852-e8db1c44bb65/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:27:49 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-a053e801-e0f6-4b81-9a14-8c4d4cc0e703 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Lock "7a33549f-51ea-42d0-8c8a-67d9c74784fd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.627s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:27:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be38c803-d97c-4939-9852-e8db1c44bb65/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:27:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fffd1dd7-b8e8-435c-bdfe-6c5001b21daf/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:27:50 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fffd1dd7-b8e8-435c-bdfe-6c5001b21daf/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:27:50 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fffd1dd7-b8e8-435c-bdfe-6c5001b21daf/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:27:50 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fffd1dd7-b8e8-435c-bdfe-6c5001b21daf/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:27:50 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f15f5f-8afa-4d7b-bb45-5887184f9ee5/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:27:50 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f15f5f-8afa-4d7b-bb45-5887184f9ee5/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:27:50 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f15f5f-8afa-4d7b-bb45-5887184f9ee5/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:27:50 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f15f5f-8afa-4d7b-bb45-5887184f9ee5/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:27:50 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f009a400-0576-48a9-82e0-60de8935c498/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:27:50 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:27:50 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f009a400-0576-48a9-82e0-60de8935c498/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:27:50 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f009a400-0576-48a9-82e0-60de8935c498/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:27:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f009a400-0576-48a9-82e0-60de8935c498/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:27:51 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74960) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 12:27:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f009a400-0576-48a9-82e0-60de8935c498/disk.rescue --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:27:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f009a400-0576-48a9-82e0-60de8935c498/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:27:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f009a400-0576-48a9-82e0-60de8935c498/disk.rescue --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:27:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f009a400-0576-48a9-82e0-60de8935c498/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:27:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a33549f-51ea-42d0-8c8a-67d9c74784fd/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:27:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a33549f-51ea-42d0-8c8a-67d9c74784fd/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:27:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a33549f-51ea-42d0-8c8a-67d9c74784fd/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:27:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a33549f-51ea-42d0-8c8a-67d9c74784fd/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:27:51 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74960) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 12:27:52 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:27:52 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:27:52 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Hypervisor/Node resource view: name=user free_ram=7601MB free_disk=24.967456817626953GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74960) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 12:27:52 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:27:52 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:27:52 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 7769e3c5-136f-4282-8e3e-224e3a80922c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:27:52 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance fffd1dd7-b8e8-435c-bdfe-6c5001b21daf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:27:52 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance f009a400-0576-48a9-82e0-60de8935c498 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:27:52 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 9951fab7-4984-408e-94ca-11eab615ff25 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:27:52 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 87f15f5f-8afa-4d7b-bb45-5887184f9ee5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:27:52 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 7a33549f-51ea-42d0-8c8a-67d9c74784fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:27:52 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance be38c803-d97c-4939-9852-e8db1c44bb65 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:27:52 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:27:52 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 7ec0d7c3-a6bd-40a2-997a-5cdbe9436305 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:27:52 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74960) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 12:27:52 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74960) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 12:27:52 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Refreshing inventories for resource provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 03 12:27:52 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Updating ProviderTree inventory for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 03 12:27:52 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Updating inventory in ProviderTree for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 03 12:27:52 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Refreshing aggregate associations for resource provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0, aggregates: None {{(pid=74960) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 03 12:27:52 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Refreshing trait associations for resource provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0, traits: COMPUTE_NODE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE41,HW_CPU_X86_SSSE3,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_DEVICE_TAGGING,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_QXL {{(pid=74960) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 03 12:27:52 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:27:52 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:27:52 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Compute_service record updated for user:user {{(pid=74960) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 12:27:52 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.627s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:27:52 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:27:52 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Cleaning up deleted instances with incomplete migration  {{(pid=74960) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 03 12:27:53 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:27:54 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-8b14542b-e6c3-4d86-87c2-65c3dafe3b33 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Acquiring lock "7a33549f-51ea-42d0-8c8a-67d9c74784fd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:27:54 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-8b14542b-e6c3-4d86-87c2-65c3dafe3b33 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Lock "7a33549f-51ea-42d0-8c8a-67d9c74784fd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:27:54 user nova-compute[74960]: DEBUG nova.objects.instance [None req-8b14542b-e6c3-4d86-87c2-65c3dafe3b33 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Lazy-loading 'flavor' on Instance uuid 7a33549f-51ea-42d0-8c8a-67d9c74784fd {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:27:54 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-8b14542b-e6c3-4d86-87c2-65c3dafe3b33 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Lock "7a33549f-51ea-42d0-8c8a-67d9c74784fd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:27:54 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:27:54 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:27:54 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:27:54 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74960) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 12:27:54 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-8b14542b-e6c3-4d86-87c2-65c3dafe3b33 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Acquiring lock "7a33549f-51ea-42d0-8c8a-67d9c74784fd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:27:54 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-8b14542b-e6c3-4d86-87c2-65c3dafe3b33 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Lock "7a33549f-51ea-42d0-8c8a-67d9c74784fd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:27:54 user nova-compute[74960]: INFO nova.compute.manager [None req-8b14542b-e6c3-4d86-87c2-65c3dafe3b33 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] [instance: 7a33549f-51ea-42d0-8c8a-67d9c74784fd] Attaching volume 9221d517-2219-40f2-bbcb-2c12097148bc to /dev/vdc
Nov 03 12:27:54 user nova-compute[74960]: DEBUG os_brick.utils [None req-8b14542b-e6c3-4d86-87c2-65c3dafe3b33 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:27:54 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:27:54 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:27:54 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[53807c24-9e5a-460d-8af4-be73c0d6fb54]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:75b8e219756\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:27:54 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:27:54 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:27:54 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b1243a7-4e90-4f19-9377-363a5a839c22]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:27:54 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:27:54 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:27:54 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[0522a78f-068d-4809-9bfc-c9917a94bf6e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:27:54 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8ac7e31-e0ad-4580-bc88-1ea7cd43dfaf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:27:54 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-8b14542b-e6c3-4d86-87c2-65c3dafe3b33 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Running cmd (subprocess): nvme version {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:27:54 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-8b14542b-e6c3-4d86-87c2-65c3dafe3b33 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] 'nvme version' failed. Not Retrying. {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 12:27:54 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8b14542b-e6c3-4d86-87c2-65c3dafe3b33 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] nvme not present on system {{(pid=74960) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 12:27:54 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:27:54 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 12:27:54 user nova-compute[74960]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 12:27:54 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed0e318a-7ffc-4809-9660-71e5afbbfaaa]: (4, '') {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:27:54 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-8b14542b-e6c3-4d86-87c2-65c3dafe3b33 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74960) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 12:27:54 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-8b14542b-e6c3-4d86-87c2-65c3dafe3b33 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74960) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 12:27:54 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-8b14542b-e6c3-4d86-87c2-65c3dafe3b33 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] LIGHTOS: no hostnqn found. {{(pid=74960) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 12:27:54 user nova-compute[74960]: DEBUG os_brick.utils [None req-8b14542b-e6c3-4d86-87c2-65c3dafe3b33 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:75b8e219756', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:27:54 user nova-compute[74960]: DEBUG nova.virt.block_device [None req-8b14542b-e6c3-4d86-87c2-65c3dafe3b33 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] [instance: 7a33549f-51ea-42d0-8c8a-67d9c74784fd] Updating existing volume attachment record: d89d382a-c46a-4ace-be48-b11bf5b4f161 {{(pid=74960) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 12:27:55 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:27:57 user nova-compute[74960]: INFO nova.compute.manager [None req-935cc01a-a010-4720-a96b-a81a9fa02638 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] [instance: f009a400-0576-48a9-82e0-60de8935c498] Unrescuing
Nov 03 12:27:57 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-935cc01a-a010-4720-a96b-a81a9fa02638 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Acquiring lock "refresh_cache-f009a400-0576-48a9-82e0-60de8935c498" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:27:57 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-935cc01a-a010-4720-a96b-a81a9fa02638 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Acquired lock "refresh_cache-f009a400-0576-48a9-82e0-60de8935c498" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:27:57 user nova-compute[74960]: DEBUG nova.network.neutron [None req-935cc01a-a010-4720-a96b-a81a9fa02638 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] [instance: f009a400-0576-48a9-82e0-60de8935c498] Building network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 12:27:57 user nova-compute[74960]: DEBUG nova.network.neutron [None req-935cc01a-a010-4720-a96b-a81a9fa02638 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] [instance: f009a400-0576-48a9-82e0-60de8935c498] Updating instance_info_cache with network_info: [{"id": "4b72249c-3aea-415f-83a8-d0498d55674e", "address": "fa:16:3e:81:8a:f6", "network": {"id": "b92f11b0-994f-48b7-be64-02cb782a1f8f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-997339008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d039968e1b97457b8fc21b593af4e1ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b72249c-3a", "ovs_interfaceid": "4b72249c-3aea-415f-83a8-d0498d55674e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:27:57 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-935cc01a-a010-4720-a96b-a81a9fa02638 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Releasing lock "refresh_cache-f009a400-0576-48a9-82e0-60de8935c498" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:27:57 user nova-compute[74960]: DEBUG nova.objects.instance [None req-935cc01a-a010-4720-a96b-a81a9fa02638 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Lazy-loading 'flavor' on Instance uuid f009a400-0576-48a9-82e0-60de8935c498 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:27:57 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:27:57 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:27:57 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:27:57 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:27:58 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:27:58 user nova-compute[74960]: DEBUG nova.compute.manager [req-33a87019-f09b-4559-968c-27a4fe2ae49e req-d751d6bc-d580-49a4-b9f3-69901cea8b55 service nova] [instance: f009a400-0576-48a9-82e0-60de8935c498] Received event network-vif-unplugged-4b72249c-3aea-415f-83a8-d0498d55674e {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:27:58 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-33a87019-f09b-4559-968c-27a4fe2ae49e req-d751d6bc-d580-49a4-b9f3-69901cea8b55 service nova] Acquiring lock "f009a400-0576-48a9-82e0-60de8935c498-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:27:58 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-33a87019-f09b-4559-968c-27a4fe2ae49e req-d751d6bc-d580-49a4-b9f3-69901cea8b55 service nova] Lock "f009a400-0576-48a9-82e0-60de8935c498-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:27:58 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-33a87019-f09b-4559-968c-27a4fe2ae49e req-d751d6bc-d580-49a4-b9f3-69901cea8b55 service nova] Lock "f009a400-0576-48a9-82e0-60de8935c498-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:27:58 user nova-compute[74960]: DEBUG nova.compute.manager [req-33a87019-f09b-4559-968c-27a4fe2ae49e req-d751d6bc-d580-49a4-b9f3-69901cea8b55 service nova] [instance: f009a400-0576-48a9-82e0-60de8935c498] No waiting events found dispatching network-vif-unplugged-4b72249c-3aea-415f-83a8-d0498d55674e {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:27:58 user nova-compute[74960]: WARNING nova.compute.manager [req-33a87019-f09b-4559-968c-27a4fe2ae49e req-d751d6bc-d580-49a4-b9f3-69901cea8b55 service nova] [instance: f009a400-0576-48a9-82e0-60de8935c498] Received unexpected event network-vif-unplugged-4b72249c-3aea-415f-83a8-d0498d55674e for instance with vm_state rescued and task_state unrescuing.
Nov 03 12:27:58 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:27:58 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: f009a400-0576-48a9-82e0-60de8935c498] Instance destroyed successfully.
Nov 03 12:27:59 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:27:59 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:27:59 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:27:59 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:27:59 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:28:00 user nova-compute[74960]: DEBUG nova.compute.manager [req-2db1213d-f0b8-47e7-9b50-49bce111c0b0 req-af0514d4-8849-49a6-8026-9db2c6e6c5f6 service nova] [instance: f009a400-0576-48a9-82e0-60de8935c498] Received event network-vif-plugged-4b72249c-3aea-415f-83a8-d0498d55674e {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:28:00 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-2db1213d-f0b8-47e7-9b50-49bce111c0b0 req-af0514d4-8849-49a6-8026-9db2c6e6c5f6 service nova] Acquiring lock "f009a400-0576-48a9-82e0-60de8935c498-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:28:00 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-2db1213d-f0b8-47e7-9b50-49bce111c0b0 req-af0514d4-8849-49a6-8026-9db2c6e6c5f6 service nova] Lock "f009a400-0576-48a9-82e0-60de8935c498-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:28:00 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-2db1213d-f0b8-47e7-9b50-49bce111c0b0 req-af0514d4-8849-49a6-8026-9db2c6e6c5f6 service nova] Lock "f009a400-0576-48a9-82e0-60de8935c498-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:28:00 user nova-compute[74960]: DEBUG nova.compute.manager [req-2db1213d-f0b8-47e7-9b50-49bce111c0b0 req-af0514d4-8849-49a6-8026-9db2c6e6c5f6 service nova] [instance: f009a400-0576-48a9-82e0-60de8935c498] No waiting events found dispatching network-vif-plugged-4b72249c-3aea-415f-83a8-d0498d55674e {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:28:00 user nova-compute[74960]: WARNING nova.compute.manager [req-2db1213d-f0b8-47e7-9b50-49bce111c0b0 req-af0514d4-8849-49a6-8026-9db2c6e6c5f6 service nova] [instance: f009a400-0576-48a9-82e0-60de8935c498] Received unexpected event network-vif-plugged-4b72249c-3aea-415f-83a8-d0498d55674e for instance with vm_state rescued and task_state unrescuing.
Nov 03 12:28:00 user nova-compute[74960]: DEBUG nova.compute.manager [req-2db1213d-f0b8-47e7-9b50-49bce111c0b0 req-af0514d4-8849-49a6-8026-9db2c6e6c5f6 service nova] [instance: f009a400-0576-48a9-82e0-60de8935c498] Received event network-changed-4b72249c-3aea-415f-83a8-d0498d55674e {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:28:00 user nova-compute[74960]: DEBUG nova.compute.manager [req-2db1213d-f0b8-47e7-9b50-49bce111c0b0 req-af0514d4-8849-49a6-8026-9db2c6e6c5f6 service nova] [instance: f009a400-0576-48a9-82e0-60de8935c498] Refreshing instance network info cache due to event network-changed-4b72249c-3aea-415f-83a8-d0498d55674e. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 12:28:00 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-2db1213d-f0b8-47e7-9b50-49bce111c0b0 req-af0514d4-8849-49a6-8026-9db2c6e6c5f6 service nova] Acquiring lock "refresh_cache-f009a400-0576-48a9-82e0-60de8935c498" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:28:00 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-2db1213d-f0b8-47e7-9b50-49bce111c0b0 req-af0514d4-8849-49a6-8026-9db2c6e6c5f6 service nova] Acquired lock "refresh_cache-f009a400-0576-48a9-82e0-60de8935c498" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:28:00 user nova-compute[74960]: DEBUG nova.network.neutron [req-2db1213d-f0b8-47e7-9b50-49bce111c0b0 req-af0514d4-8849-49a6-8026-9db2c6e6c5f6 service nova] [instance: f009a400-0576-48a9-82e0-60de8935c498] Refreshing network info cache for port 4b72249c-3aea-415f-83a8-d0498d55674e {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 12:28:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:28:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:28:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:28:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:28:01 user nova-compute[74960]: DEBUG nova.network.neutron [req-2db1213d-f0b8-47e7-9b50-49bce111c0b0 req-af0514d4-8849-49a6-8026-9db2c6e6c5f6 service nova] [instance: f009a400-0576-48a9-82e0-60de8935c498] Updated VIF entry in instance network info cache for port 4b72249c-3aea-415f-83a8-d0498d55674e. {{(pid=74960) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 12:28:01 user nova-compute[74960]: DEBUG nova.network.neutron [req-2db1213d-f0b8-47e7-9b50-49bce111c0b0 req-af0514d4-8849-49a6-8026-9db2c6e6c5f6 service nova] [instance: f009a400-0576-48a9-82e0-60de8935c498] Updating instance_info_cache with network_info: [{"id": "4b72249c-3aea-415f-83a8-d0498d55674e", "address": "fa:16:3e:81:8a:f6", "network": {"id": "b92f11b0-994f-48b7-be64-02cb782a1f8f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-997339008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d039968e1b97457b8fc21b593af4e1ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b72249c-3a", "ovs_interfaceid": "4b72249c-3aea-415f-83a8-d0498d55674e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:28:01 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-2db1213d-f0b8-47e7-9b50-49bce111c0b0 req-af0514d4-8849-49a6-8026-9db2c6e6c5f6 service nova] Releasing lock "refresh_cache-f009a400-0576-48a9-82e0-60de8935c498" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:28:01 user nova-compute[74960]: DEBUG nova.compute.manager [req-2db1213d-f0b8-47e7-9b50-49bce111c0b0 req-af0514d4-8849-49a6-8026-9db2c6e6c5f6 service nova] [instance: f009a400-0576-48a9-82e0-60de8935c498] Received event network-changed-4b72249c-3aea-415f-83a8-d0498d55674e {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:28:01 user nova-compute[74960]: DEBUG nova.compute.manager [req-2db1213d-f0b8-47e7-9b50-49bce111c0b0 req-af0514d4-8849-49a6-8026-9db2c6e6c5f6 service nova] [instance: f009a400-0576-48a9-82e0-60de8935c498] Refreshing instance network info cache due to event network-changed-4b72249c-3aea-415f-83a8-d0498d55674e. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 12:28:01 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-2db1213d-f0b8-47e7-9b50-49bce111c0b0 req-af0514d4-8849-49a6-8026-9db2c6e6c5f6 service nova] Acquiring lock "refresh_cache-f009a400-0576-48a9-82e0-60de8935c498" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:28:01 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-2db1213d-f0b8-47e7-9b50-49bce111c0b0 req-af0514d4-8849-49a6-8026-9db2c6e6c5f6 service nova] Acquired lock "refresh_cache-f009a400-0576-48a9-82e0-60de8935c498" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:28:01 user nova-compute[74960]: DEBUG nova.network.neutron [req-2db1213d-f0b8-47e7-9b50-49bce111c0b0 req-af0514d4-8849-49a6-8026-9db2c6e6c5f6 service nova] [instance: f009a400-0576-48a9-82e0-60de8935c498] Refreshing network info cache for port 4b72249c-3aea-415f-83a8-d0498d55674e {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 12:28:01 user nova-compute[74960]: DEBUG nova.network.neutron [req-2db1213d-f0b8-47e7-9b50-49bce111c0b0 req-af0514d4-8849-49a6-8026-9db2c6e6c5f6 service nova] [instance: f009a400-0576-48a9-82e0-60de8935c498] Updated VIF entry in instance network info cache for port 4b72249c-3aea-415f-83a8-d0498d55674e. {{(pid=74960) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 12:28:01 user nova-compute[74960]: DEBUG nova.network.neutron [req-2db1213d-f0b8-47e7-9b50-49bce111c0b0 req-af0514d4-8849-49a6-8026-9db2c6e6c5f6 service nova] [instance: f009a400-0576-48a9-82e0-60de8935c498] Updating instance_info_cache with network_info: [{"id": "4b72249c-3aea-415f-83a8-d0498d55674e", "address": "fa:16:3e:81:8a:f6", "network": {"id": "b92f11b0-994f-48b7-be64-02cb782a1f8f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-997339008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d039968e1b97457b8fc21b593af4e1ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b72249c-3a", "ovs_interfaceid": "4b72249c-3aea-415f-83a8-d0498d55674e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:28:01 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-2db1213d-f0b8-47e7-9b50-49bce111c0b0 req-af0514d4-8849-49a6-8026-9db2c6e6c5f6 service nova] Releasing lock "refresh_cache-f009a400-0576-48a9-82e0-60de8935c498" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:28:01 user nova-compute[74960]: DEBUG nova.compute.manager [req-2db1213d-f0b8-47e7-9b50-49bce111c0b0 req-af0514d4-8849-49a6-8026-9db2c6e6c5f6 service nova] [instance: f009a400-0576-48a9-82e0-60de8935c498] Received event network-vif-plugged-4b72249c-3aea-415f-83a8-d0498d55674e {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:28:01 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-2db1213d-f0b8-47e7-9b50-49bce111c0b0 req-af0514d4-8849-49a6-8026-9db2c6e6c5f6 service nova] Acquiring lock "f009a400-0576-48a9-82e0-60de8935c498-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:28:01 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-2db1213d-f0b8-47e7-9b50-49bce111c0b0 req-af0514d4-8849-49a6-8026-9db2c6e6c5f6 service nova] Lock "f009a400-0576-48a9-82e0-60de8935c498-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:28:01 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-2db1213d-f0b8-47e7-9b50-49bce111c0b0 req-af0514d4-8849-49a6-8026-9db2c6e6c5f6 service nova] Lock "f009a400-0576-48a9-82e0-60de8935c498-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:28:01 user nova-compute[74960]: DEBUG nova.compute.manager [req-2db1213d-f0b8-47e7-9b50-49bce111c0b0 req-af0514d4-8849-49a6-8026-9db2c6e6c5f6 service nova] [instance: f009a400-0576-48a9-82e0-60de8935c498] No waiting events found dispatching network-vif-plugged-4b72249c-3aea-415f-83a8-d0498d55674e {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:28:01 user nova-compute[74960]: WARNING nova.compute.manager [req-2db1213d-f0b8-47e7-9b50-49bce111c0b0 req-af0514d4-8849-49a6-8026-9db2c6e6c5f6 service nova] [instance: f009a400-0576-48a9-82e0-60de8935c498] Received unexpected event network-vif-plugged-4b72249c-3aea-415f-83a8-d0498d55674e for instance with vm_state rescued and task_state unrescuing.
Nov 03 12:28:01 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-5aa4a4bc-3def-422d-84e4-7f633f30bf10 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Acquiring lock "a6199681-f85e-4f55-966b-6ab3f17cd640" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:28:01 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-5aa4a4bc-3def-422d-84e4-7f633f30bf10 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Lock "a6199681-f85e-4f55-966b-6ab3f17cd640" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:28:01 user nova-compute[74960]: DEBUG nova.compute.manager [None req-5aa4a4bc-3def-422d-84e4-7f633f30bf10 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] Starting instance... {{(pid=74960) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 12:28:01 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-5aa4a4bc-3def-422d-84e4-7f633f30bf10 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:28:01 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-5aa4a4bc-3def-422d-84e4-7f633f30bf10 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:28:01 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-5aa4a4bc-3def-422d-84e4-7f633f30bf10 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74960) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 12:28:01 user nova-compute[74960]: INFO nova.compute.claims [None req-5aa4a4bc-3def-422d-84e4-7f633f30bf10 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] Claim successful on node user
Nov 03 12:28:01 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:28:02 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:28:02 user nova-compute[74960]: DEBUG nova.compute.manager [None req-935cc01a-a010-4720-a96b-a81a9fa02638 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] [instance: f009a400-0576-48a9-82e0-60de8935c498] Checking state {{(pid=74960) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 12:28:02 user nova-compute[74960]: DEBUG nova.compute.manager [req-418ceae5-4754-47f2-ba54-e3faa541fdba req-a479c14f-875a-4e67-94ba-38b25e894704 service nova] [instance: f009a400-0576-48a9-82e0-60de8935c498] Received event network-vif-plugged-4b72249c-3aea-415f-83a8-d0498d55674e {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:28:02 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-418ceae5-4754-47f2-ba54-e3faa541fdba req-a479c14f-875a-4e67-94ba-38b25e894704 service nova] Acquiring lock "f009a400-0576-48a9-82e0-60de8935c498-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:28:02 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-418ceae5-4754-47f2-ba54-e3faa541fdba req-a479c14f-875a-4e67-94ba-38b25e894704 service nova] Lock "f009a400-0576-48a9-82e0-60de8935c498-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:28:02 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-418ceae5-4754-47f2-ba54-e3faa541fdba req-a479c14f-875a-4e67-94ba-38b25e894704 service nova] Lock "f009a400-0576-48a9-82e0-60de8935c498-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:28:02 user nova-compute[74960]: DEBUG nova.compute.manager [req-418ceae5-4754-47f2-ba54-e3faa541fdba req-a479c14f-875a-4e67-94ba-38b25e894704 service nova] [instance: f009a400-0576-48a9-82e0-60de8935c498] No waiting events found dispatching network-vif-plugged-4b72249c-3aea-415f-83a8-d0498d55674e {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:28:02 user nova-compute[74960]: WARNING nova.compute.manager [req-418ceae5-4754-47f2-ba54-e3faa541fdba req-a479c14f-875a-4e67-94ba-38b25e894704 service nova] [instance: f009a400-0576-48a9-82e0-60de8935c498] Received unexpected event network-vif-plugged-4b72249c-3aea-415f-83a8-d0498d55674e for instance with vm_state rescued and task_state unrescuing.
Nov 03 12:28:02 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-5aa4a4bc-3def-422d-84e4-7f633f30bf10 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:28:02 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-5aa4a4bc-3def-422d-84e4-7f633f30bf10 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:28:02 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-5aa4a4bc-3def-422d-84e4-7f633f30bf10 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.506s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:28:02 user nova-compute[74960]: DEBUG nova.compute.manager [None req-5aa4a4bc-3def-422d-84e4-7f633f30bf10 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] Start building networks asynchronously for instance. {{(pid=74960) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 12:28:02 user nova-compute[74960]: DEBUG nova.compute.manager [None req-5aa4a4bc-3def-422d-84e4-7f633f30bf10 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] Allocating IP information in the background. {{(pid=74960) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 12:28:02 user nova-compute[74960]: DEBUG nova.network.neutron [None req-5aa4a4bc-3def-422d-84e4-7f633f30bf10 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] allocate_for_instance() {{(pid=74960) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 12:28:02 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-5aa4a4bc-3def-422d-84e4-7f633f30bf10 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 12:28:02 user nova-compute[74960]: DEBUG nova.compute.manager [None req-5aa4a4bc-3def-422d-84e4-7f633f30bf10 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] Start building block device mappings for instance. {{(pid=74960) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 12:28:02 user nova-compute[74960]: INFO nova.virt.block_device [None req-5aa4a4bc-3def-422d-84e4-7f633f30bf10 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] Booting with blank volume at /dev/vda
Nov 03 12:28:02 user nova-compute[74960]: DEBUG nova.policy [None req-5aa4a4bc-3def-422d-84e4-7f633f30bf10 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c473215929044a108c9fc4d6327dfc3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc95d68d5e147e1953c855169b17091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74960) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 12:28:03 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:28:03 user nova-compute[74960]: DEBUG nova.network.neutron [None req-5aa4a4bc-3def-422d-84e4-7f633f30bf10 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] Successfully created port: 40976ae5-5f49-4d8e-abd7-04dc0ce8f319 {{(pid=74960) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 12:28:04 user nova-compute[74960]: DEBUG nova.network.neutron [None req-5aa4a4bc-3def-422d-84e4-7f633f30bf10 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] Successfully updated port: 40976ae5-5f49-4d8e-abd7-04dc0ce8f319 {{(pid=74960) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 12:28:04 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-5aa4a4bc-3def-422d-84e4-7f633f30bf10 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Acquiring lock "refresh_cache-a6199681-f85e-4f55-966b-6ab3f17cd640" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:28:04 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-5aa4a4bc-3def-422d-84e4-7f633f30bf10 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Acquired lock "refresh_cache-a6199681-f85e-4f55-966b-6ab3f17cd640" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:28:04 user nova-compute[74960]: DEBUG nova.network.neutron [None req-5aa4a4bc-3def-422d-84e4-7f633f30bf10 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] Building network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 12:28:04 user nova-compute[74960]: DEBUG nova.network.neutron [None req-5aa4a4bc-3def-422d-84e4-7f633f30bf10 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] Instance cache missing network info. {{(pid=74960) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 12:28:04 user nova-compute[74960]: DEBUG nova.compute.manager [req-4ddad08e-b548-411d-b598-dd46e1385e0d req-854a9c0b-243e-4b24-93bc-0b4d3d75b564 service nova] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] Received event network-changed-40976ae5-5f49-4d8e-abd7-04dc0ce8f319 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:28:04 user nova-compute[74960]: DEBUG nova.compute.manager [req-4ddad08e-b548-411d-b598-dd46e1385e0d req-854a9c0b-243e-4b24-93bc-0b4d3d75b564 service nova] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] Refreshing instance network info cache due to event network-changed-40976ae5-5f49-4d8e-abd7-04dc0ce8f319. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 12:28:04 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-4ddad08e-b548-411d-b598-dd46e1385e0d req-854a9c0b-243e-4b24-93bc-0b4d3d75b564 service nova] Acquiring lock "refresh_cache-a6199681-f85e-4f55-966b-6ab3f17cd640" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:28:05 user nova-compute[74960]: DEBUG nova.network.neutron [None req-5aa4a4bc-3def-422d-84e4-7f633f30bf10 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] Updating instance_info_cache with network_info: [{"id": "40976ae5-5f49-4d8e-abd7-04dc0ce8f319", "address": "fa:16:3e:7c:40:1d", "network": {"id": "dec66832-56d5-4d68-b11f-8e8eed38f045", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-79099436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc95d68d5e147e1953c855169b17091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40976ae5-5f", "ovs_interfaceid": "40976ae5-5f49-4d8e-abd7-04dc0ce8f319", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:28:05 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-5aa4a4bc-3def-422d-84e4-7f633f30bf10 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Releasing lock "refresh_cache-a6199681-f85e-4f55-966b-6ab3f17cd640" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:28:05 user nova-compute[74960]: DEBUG nova.compute.manager [None req-5aa4a4bc-3def-422d-84e4-7f633f30bf10 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] Instance network_info: |[{"id": "40976ae5-5f49-4d8e-abd7-04dc0ce8f319", "address": "fa:16:3e:7c:40:1d", "network": {"id": "dec66832-56d5-4d68-b11f-8e8eed38f045", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-79099436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc95d68d5e147e1953c855169b17091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40976ae5-5f", "ovs_interfaceid": "40976ae5-5f49-4d8e-abd7-04dc0ce8f319", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74960) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 12:28:05 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-4ddad08e-b548-411d-b598-dd46e1385e0d req-854a9c0b-243e-4b24-93bc-0b4d3d75b564 service nova] Acquired lock "refresh_cache-a6199681-f85e-4f55-966b-6ab3f17cd640" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:28:05 user nova-compute[74960]: DEBUG nova.network.neutron [req-4ddad08e-b548-411d-b598-dd46e1385e0d req-854a9c0b-243e-4b24-93bc-0b4d3d75b564 service nova] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] Refreshing network info cache for port 40976ae5-5f49-4d8e-abd7-04dc0ce8f319 {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 12:28:05 user nova-compute[74960]: DEBUG nova.network.neutron [req-4ddad08e-b548-411d-b598-dd46e1385e0d req-854a9c0b-243e-4b24-93bc-0b4d3d75b564 service nova] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] Updated VIF entry in instance network info cache for port 40976ae5-5f49-4d8e-abd7-04dc0ce8f319. {{(pid=74960) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 12:28:05 user nova-compute[74960]: DEBUG nova.network.neutron [req-4ddad08e-b548-411d-b598-dd46e1385e0d req-854a9c0b-243e-4b24-93bc-0b4d3d75b564 service nova] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] Updating instance_info_cache with network_info: [{"id": "40976ae5-5f49-4d8e-abd7-04dc0ce8f319", "address": "fa:16:3e:7c:40:1d", "network": {"id": "dec66832-56d5-4d68-b11f-8e8eed38f045", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-79099436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc95d68d5e147e1953c855169b17091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40976ae5-5f", "ovs_interfaceid": "40976ae5-5f49-4d8e-abd7-04dc0ce8f319", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:28:05 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-4ddad08e-b548-411d-b598-dd46e1385e0d req-854a9c0b-243e-4b24-93bc-0b4d3d75b564 service nova] Releasing lock "refresh_cache-a6199681-f85e-4f55-966b-6ab3f17cd640" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:28:05 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:28:05 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:28:08 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:28:10 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:28:12 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-203047e8-bf74-4576-aa5a-2bf967305798 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Acquiring lock "e6cbb630-254f-4c56-9cf9-47d751c703be" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:28:12 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-203047e8-bf74-4576-aa5a-2bf967305798 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Lock "e6cbb630-254f-4c56-9cf9-47d751c703be" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:28:12 user nova-compute[74960]: INFO nova.compute.manager [None req-203047e8-bf74-4576-aa5a-2bf967305798 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: e6cbb630-254f-4c56-9cf9-47d751c703be] Unshelving
Nov 03 12:28:12 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-203047e8-bf74-4576-aa5a-2bf967305798 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:28:12 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-203047e8-bf74-4576-aa5a-2bf967305798 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:28:12 user nova-compute[74960]: DEBUG nova.objects.instance [None req-203047e8-bf74-4576-aa5a-2bf967305798 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Lazy-loading 'pci_requests' on Instance uuid e6cbb630-254f-4c56-9cf9-47d751c703be {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:28:12 user nova-compute[74960]: DEBUG nova.objects.instance [None req-203047e8-bf74-4576-aa5a-2bf967305798 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Lazy-loading 'numa_topology' on Instance uuid e6cbb630-254f-4c56-9cf9-47d751c703be {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:28:12 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-203047e8-bf74-4576-aa5a-2bf967305798 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74960) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 12:28:12 user nova-compute[74960]: INFO nova.compute.claims [None req-203047e8-bf74-4576-aa5a-2bf967305798 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: e6cbb630-254f-4c56-9cf9-47d751c703be] Claim successful on node user
Nov 03 12:28:13 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-203047e8-bf74-4576-aa5a-2bf967305798 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:28:13 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-203047e8-bf74-4576-aa5a-2bf967305798 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:28:13 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-203047e8-bf74-4576-aa5a-2bf967305798 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.508s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:28:13 user nova-compute[74960]: INFO nova.network.neutron [None req-203047e8-bf74-4576-aa5a-2bf967305798 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: e6cbb630-254f-4c56-9cf9-47d751c703be] Updating port b5f672c1-3298-4c5a-bf4d-7c712e4c5873 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 03 12:28:13 user nova-compute[74960]: DEBUG os_brick.utils [None req-5aa4a4bc-3def-422d-84e4-7f633f30bf10 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:28:13 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:28:13 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:28:13 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aef0046-a03d-4ace-94ee-85adde448f78]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:75b8e219756\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:28:13 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:28:13 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:28:13 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e5b4e23-5ee4-4153-b9c7-8dd8dc140f65]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:28:13 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:28:13 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:28:13 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5934fad-c413-4317-b05b-a27bb87676fe]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:28:13 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[51794483-7936-4fe5-ac1d-490ee6669314]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:28:13 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-5aa4a4bc-3def-422d-84e4-7f633f30bf10 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Running cmd (subprocess): nvme version {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:28:13 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-5aa4a4bc-3def-422d-84e4-7f633f30bf10 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] 'nvme version' failed. Not Retrying. {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 12:28:13 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5aa4a4bc-3def-422d-84e4-7f633f30bf10 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] nvme not present on system {{(pid=74960) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 12:28:13 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:28:13 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 12:28:13 user nova-compute[74960]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 12:28:13 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf8e9315-a78a-463d-a7a5-f6bce26713e7]: (4, '') {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:28:13 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-5aa4a4bc-3def-422d-84e4-7f633f30bf10 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74960) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 12:28:13 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-5aa4a4bc-3def-422d-84e4-7f633f30bf10 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74960) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 12:28:13 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-5aa4a4bc-3def-422d-84e4-7f633f30bf10 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] LIGHTOS: no hostnqn found. {{(pid=74960) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 12:28:13 user nova-compute[74960]: DEBUG os_brick.utils [None req-5aa4a4bc-3def-422d-84e4-7f633f30bf10 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:75b8e219756', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:28:13 user nova-compute[74960]: DEBUG nova.virt.block_device [None req-5aa4a4bc-3def-422d-84e4-7f633f30bf10 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] Updating existing volume attachment record: 14e3fbc0-1650-40e1-8eb6-9cf0dffd093d {{(pid=74960) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 12:28:14 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-203047e8-bf74-4576-aa5a-2bf967305798 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Acquiring lock "refresh_cache-e6cbb630-254f-4c56-9cf9-47d751c703be" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:28:14 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-203047e8-bf74-4576-aa5a-2bf967305798 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Acquired lock "refresh_cache-e6cbb630-254f-4c56-9cf9-47d751c703be" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:28:14 user nova-compute[74960]: DEBUG nova.network.neutron [None req-203047e8-bf74-4576-aa5a-2bf967305798 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: e6cbb630-254f-4c56-9cf9-47d751c703be] Building network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 12:28:14 user nova-compute[74960]: DEBUG nova.compute.manager [req-26460ea0-54d7-4503-ae5b-87867505dff5 req-4a1025cd-e2f5-42c8-9a34-ba70bfc50293 service nova] [instance: e6cbb630-254f-4c56-9cf9-47d751c703be] Received event network-changed-b5f672c1-3298-4c5a-bf4d-7c712e4c5873 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:28:14 user nova-compute[74960]: DEBUG nova.compute.manager [req-26460ea0-54d7-4503-ae5b-87867505dff5 req-4a1025cd-e2f5-42c8-9a34-ba70bfc50293 service nova] [instance: e6cbb630-254f-4c56-9cf9-47d751c703be] Refreshing instance network info cache due to event network-changed-b5f672c1-3298-4c5a-bf4d-7c712e4c5873. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 12:28:14 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-26460ea0-54d7-4503-ae5b-87867505dff5 req-4a1025cd-e2f5-42c8-9a34-ba70bfc50293 service nova] Acquiring lock "refresh_cache-e6cbb630-254f-4c56-9cf9-47d751c703be" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:28:14 user nova-compute[74960]: DEBUG nova.network.neutron [None req-203047e8-bf74-4576-aa5a-2bf967305798 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: e6cbb630-254f-4c56-9cf9-47d751c703be] Updating instance_info_cache with network_info: [{"id": "b5f672c1-3298-4c5a-bf4d-7c712e4c5873", "address": "fa:16:3e:5b:1b:87", "network": {"id": "c03e854d-75a3-4e81-9cdf-f1139841266c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1632999031-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c216dd7629274eafbf0a5968ff2378a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f672c1-32", "ovs_interfaceid": "b5f672c1-3298-4c5a-bf4d-7c712e4c5873", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:28:14 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-203047e8-bf74-4576-aa5a-2bf967305798 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Releasing lock "refresh_cache-e6cbb630-254f-4c56-9cf9-47d751c703be" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:28:14 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-203047e8-bf74-4576-aa5a-2bf967305798 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: e6cbb630-254f-4c56-9cf9-47d751c703be] Creating instance directory {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 12:28:14 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-203047e8-bf74-4576-aa5a-2bf967305798 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: e6cbb630-254f-4c56-9cf9-47d751c703be] Creating image(s)
Nov 03 12:28:14 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-203047e8-bf74-4576-aa5a-2bf967305798 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Acquiring lock "/opt/stack/data/nova/instances/e6cbb630-254f-4c56-9cf9-47d751c703be/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:28:14 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-203047e8-bf74-4576-aa5a-2bf967305798 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Lock "/opt/stack/data/nova/instances/e6cbb630-254f-4c56-9cf9-47d751c703be/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:28:14 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-203047e8-bf74-4576-aa5a-2bf967305798 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Lock "/opt/stack/data/nova/instances/e6cbb630-254f-4c56-9cf9-47d751c703be/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:28:14 user nova-compute[74960]: DEBUG nova.objects.instance [None req-203047e8-bf74-4576-aa5a-2bf967305798 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Lazy-loading 'trusted_certs' on Instance uuid e6cbb630-254f-4c56-9cf9-47d751c703be {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:28:14 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-26460ea0-54d7-4503-ae5b-87867505dff5 req-4a1025cd-e2f5-42c8-9a34-ba70bfc50293 service nova] Acquired lock "refresh_cache-e6cbb630-254f-4c56-9cf9-47d751c703be" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:28:14 user nova-compute[74960]: DEBUG nova.network.neutron [req-26460ea0-54d7-4503-ae5b-87867505dff5 req-4a1025cd-e2f5-42c8-9a34-ba70bfc50293 service nova] [instance: e6cbb630-254f-4c56-9cf9-47d751c703be] Refreshing network info cache for port b5f672c1-3298-4c5a-bf4d-7c712e4c5873 {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 12:28:14 user nova-compute[74960]: DEBUG nova.objects.base [None req-203047e8-bf74-4576-aa5a-2bf967305798 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Object Instance<e6cbb630-254f-4c56-9cf9-47d751c703be> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74960) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 12:28:14 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-203047e8-bf74-4576-aa5a-2bf967305798 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Acquiring lock "88077c15ad6d6301757c88bf53ad916fdacc70f0" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:28:14 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-203047e8-bf74-4576-aa5a-2bf967305798 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Lock "88077c15ad6d6301757c88bf53ad916fdacc70f0" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:28:15 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-203047e8-bf74-4576-aa5a-2bf967305798 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88077c15ad6d6301757c88bf53ad916fdacc70f0.part --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:28:15 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-203047e8-bf74-4576-aa5a-2bf967305798 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88077c15ad6d6301757c88bf53ad916fdacc70f0.part --force-share --output=json" returned: 0 in 0.203s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:28:15 user nova-compute[74960]: DEBUG nova.virt.images [None req-203047e8-bf74-4576-aa5a-2bf967305798 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] 79caf2c3-5132-4c51-9b2e-7761bce2f259 was qcow2, converting to raw {{(pid=74960) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 03 12:28:15 user nova-compute[74960]: DEBUG nova.privsep.utils [None req-203047e8-bf74-4576-aa5a-2bf967305798 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74960) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 03 12:28:15 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-203047e8-bf74-4576-aa5a-2bf967305798 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/88077c15ad6d6301757c88bf53ad916fdacc70f0.part /opt/stack/data/nova/instances/_base/88077c15ad6d6301757c88bf53ad916fdacc70f0.converted {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:28:15 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:28:15 user nova-compute[74960]: DEBUG nova.network.neutron [req-26460ea0-54d7-4503-ae5b-87867505dff5 req-4a1025cd-e2f5-42c8-9a34-ba70bfc50293 service nova] [instance: e6cbb630-254f-4c56-9cf9-47d751c703be] Updated VIF entry in instance network info cache for port b5f672c1-3298-4c5a-bf4d-7c712e4c5873. {{(pid=74960) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 12:28:15 user nova-compute[74960]: DEBUG nova.network.neutron [req-26460ea0-54d7-4503-ae5b-87867505dff5 req-4a1025cd-e2f5-42c8-9a34-ba70bfc50293 service nova] [instance: e6cbb630-254f-4c56-9cf9-47d751c703be] Updating instance_info_cache with network_info: [{"id": "b5f672c1-3298-4c5a-bf4d-7c712e4c5873", "address": "fa:16:3e:5b:1b:87", "network": {"id": "c03e854d-75a3-4e81-9cdf-f1139841266c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1632999031-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c216dd7629274eafbf0a5968ff2378a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f672c1-32", "ovs_interfaceid": "b5f672c1-3298-4c5a-bf4d-7c712e4c5873", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:28:15 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-26460ea0-54d7-4503-ae5b-87867505dff5 req-4a1025cd-e2f5-42c8-9a34-ba70bfc50293 service nova] Releasing lock "refresh_cache-e6cbb630-254f-4c56-9cf9-47d751c703be" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:28:16 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-203047e8-bf74-4576-aa5a-2bf967305798 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/88077c15ad6d6301757c88bf53ad916fdacc70f0.part /opt/stack/data/nova/instances/_base/88077c15ad6d6301757c88bf53ad916fdacc70f0.converted" returned: 0 in 0.641s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:28:16 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-203047e8-bf74-4576-aa5a-2bf967305798 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88077c15ad6d6301757c88bf53ad916fdacc70f0.converted --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:28:16 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-203047e8-bf74-4576-aa5a-2bf967305798 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88077c15ad6d6301757c88bf53ad916fdacc70f0.converted --force-share --output=json" returned: 0 in 0.189s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:28:16 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-203047e8-bf74-4576-aa5a-2bf967305798 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Lock "88077c15ad6d6301757c88bf53ad916fdacc70f0" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.906s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:28:16 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-203047e8-bf74-4576-aa5a-2bf967305798 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88077c15ad6d6301757c88bf53ad916fdacc70f0 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:28:16 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-203047e8-bf74-4576-aa5a-2bf967305798 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88077c15ad6d6301757c88bf53ad916fdacc70f0 --force-share --output=json" returned: 0 in 0.216s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:28:16 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-203047e8-bf74-4576-aa5a-2bf967305798 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Acquiring lock "88077c15ad6d6301757c88bf53ad916fdacc70f0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:28:16 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-203047e8-bf74-4576-aa5a-2bf967305798 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Lock "88077c15ad6d6301757c88bf53ad916fdacc70f0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:28:16 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-203047e8-bf74-4576-aa5a-2bf967305798 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88077c15ad6d6301757c88bf53ad916fdacc70f0 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:28:17 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-203047e8-bf74-4576-aa5a-2bf967305798 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88077c15ad6d6301757c88bf53ad916fdacc70f0 --force-share --output=json" returned: 0 in 0.246s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:28:17 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-203047e8-bf74-4576-aa5a-2bf967305798 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/88077c15ad6d6301757c88bf53ad916fdacc70f0,backing_fmt=raw /opt/stack/data/nova/instances/e6cbb630-254f-4c56-9cf9-47d751c703be/disk 1073741824 {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:28:17 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-203047e8-bf74-4576-aa5a-2bf967305798 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/88077c15ad6d6301757c88bf53ad916fdacc70f0,backing_fmt=raw /opt/stack/data/nova/instances/e6cbb630-254f-4c56-9cf9-47d751c703be/disk 1073741824" returned: 0 in 0.054s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:28:17 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-203047e8-bf74-4576-aa5a-2bf967305798 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Lock "88077c15ad6d6301757c88bf53ad916fdacc70f0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.316s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:28:17 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-203047e8-bf74-4576-aa5a-2bf967305798 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88077c15ad6d6301757c88bf53ad916fdacc70f0 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:28:17 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-203047e8-bf74-4576-aa5a-2bf967305798 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88077c15ad6d6301757c88bf53ad916fdacc70f0 --force-share --output=json" returned: 0 in 0.187s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:28:17 user nova-compute[74960]: DEBUG nova.objects.instance [None req-203047e8-bf74-4576-aa5a-2bf967305798 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Lazy-loading 'migration_context' on Instance uuid e6cbb630-254f-4c56-9cf9-47d751c703be {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:28:17 user nova-compute[74960]: DEBUG nova.objects.base [None req-203047e8-bf74-4576-aa5a-2bf967305798 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Object Instance<e6cbb630-254f-4c56-9cf9-47d751c703be> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74960) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 12:28:17 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-203047e8-bf74-4576-aa5a-2bf967305798 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: e6cbb630-254f-4c56-9cf9-47d751c703be] Rebasing disk image.
Nov 03 12:28:17 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-203047e8-bf74-4576-aa5a-2bf967305798 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:28:17 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-203047e8-bf74-4576-aa5a-2bf967305798 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.185s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:28:17 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-203047e8-bf74-4576-aa5a-2bf967305798 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 -F raw /opt/stack/data/nova/instances/e6cbb630-254f-4c56-9cf9-47d751c703be/disk {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:28:18 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:28:19 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-203047e8-bf74-4576-aa5a-2bf967305798 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 -F raw /opt/stack/data/nova/instances/e6cbb630-254f-4c56-9cf9-47d751c703be/disk" returned: 0 in 2.313s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:28:19 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-203047e8-bf74-4576-aa5a-2bf967305798 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: e6cbb630-254f-4c56-9cf9-47d751c703be] Created local disks {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 12:28:19 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-203047e8-bf74-4576-aa5a-2bf967305798 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: e6cbb630-254f-4c56-9cf9-47d751c703be] Ensure instance console log exists: /opt/stack/data/nova/instances/e6cbb630-254f-4c56-9cf9-47d751c703be/console.log {{(pid=74960) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 12:28:19 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-203047e8-bf74-4576-aa5a-2bf967305798 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:28:19 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-203047e8-bf74-4576-aa5a-2bf967305798 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:28:19 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-203047e8-bf74-4576-aa5a-2bf967305798 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:28:19 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-203047e8-bf74-4576-aa5a-2bf967305798 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: e6cbb630-254f-4c56-9cf9-47d751c703be] Start _get_guest_xml network_info=[{"id": "b5f672c1-3298-4c5a-bf4d-7c712e4c5873", "address": "fa:16:3e:5b:1b:87", "network": {"id": "c03e854d-75a3-4e81-9cdf-f1139841266c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1632999031-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c216dd7629274eafbf0a5968ff2378a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f672c1-32", "ovs_interfaceid": "b5f672c1-3298-4c5a-bf4d-7c712e4c5873", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='66d82bd45e0433651b57901ea495c78d',container_format='bare',created_at=2023-11-03T12:26:19Z,direct_url=<?>,disk_format='qcow2',id=79caf2c3-5132-4c51-9b2e-7761bce2f259,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1644828034-shelved',owner='c216dd7629274eafbf0a5968ff2378a9',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-03T12:26:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'image_id': '549f51ba-ac69-494b-8de1-34635aa2d7cf'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 12:28:19 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-203047e8-bf74-4576-aa5a-2bf967305798 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:28:19 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-203047e8-bf74-4576-aa5a-2bf967305798 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:28:19 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-203047e8-bf74-4576-aa5a-2bf967305798 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 12:28:19 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-203047e8-bf74-4576-aa5a-2bf967305798 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] CPU controller missing on host. {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 12:28:19 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-203047e8-bf74-4576-aa5a-2bf967305798 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 12:28:19 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-203047e8-bf74-4576-aa5a-2bf967305798 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] CPU controller found on host. {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 12:28:19 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-203047e8-bf74-4576-aa5a-2bf967305798 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74960) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 12:28:19 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-203047e8-bf74-4576-aa5a-2bf967305798 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='66d82bd45e0433651b57901ea495c78d',container_format='bare',created_at=2023-11-03T12:26:19Z,direct_url=<?>,disk_format='qcow2',id=79caf2c3-5132-4c51-9b2e-7761bce2f259,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1644828034-shelved',owner='c216dd7629274eafbf0a5968ff2378a9',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-03T12:26:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 12:28:19 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-203047e8-bf74-4576-aa5a-2bf967305798 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Flavor limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 12:28:19 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-203047e8-bf74-4576-aa5a-2bf967305798 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Image limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 12:28:19 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-203047e8-bf74-4576-aa5a-2bf967305798 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Flavor pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 12:28:19 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-203047e8-bf74-4576-aa5a-2bf967305798 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Image pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 12:28:19 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-203047e8-bf74-4576-aa5a-2bf967305798 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 12:28:19 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-203047e8-bf74-4576-aa5a-2bf967305798 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 12:28:19 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-203047e8-bf74-4576-aa5a-2bf967305798 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 12:28:19 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-203047e8-bf74-4576-aa5a-2bf967305798 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Got 1 possible topologies {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 12:28:19 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-203047e8-bf74-4576-aa5a-2bf967305798 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 12:28:19 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-203047e8-bf74-4576-aa5a-2bf967305798 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 12:28:19 user nova-compute[74960]: DEBUG nova.objects.instance [None req-203047e8-bf74-4576-aa5a-2bf967305798 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Lazy-loading 'vcpu_model' on Instance uuid e6cbb630-254f-4c56-9cf9-47d751c703be {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:28:19 user nova-compute[74960]: DEBUG nova.objects.base [None req-203047e8-bf74-4576-aa5a-2bf967305798 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Object Instance<e6cbb630-254f-4c56-9cf9-47d751c703be> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74960) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 12:28:19 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-203047e8-bf74-4576-aa5a-2bf967305798 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-03T12:24:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1644828034',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1644828034',id=19,image_ref='79caf2c3-5132-4c51-9b2e-7761bce2f259',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1090973974',keypairs=<?>,launch_index=0,launched_at=2023-11-03T12:24:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='c216dd7629274eafbf0a5968ff2378a9',ramdisk_id='',reservation_id='r-t48sleg2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-258463843',owner_user_name='tempest-AttachVolumeShelveTestJSON-258463843-project-member',shelved_at='2023-11-03T12:26:24.907044',shelved_host='user',shelved_image_id='79caf2c3-5132-4c51-9b2e-7761bce2f259'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:28:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fae69462930546bdb9cf6e2a11a0df2a',uuid=e6cbb630-254f-4c56-9cf9-47d751c703be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "b5f672c1-3298-4c5a-bf4d-7c712e4c5873", "address": "fa:16:3e:5b:1b:87", "network": {"id": "c03e854d-75a3-4e81-9cdf-f1139841266c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1632999031-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c216dd7629274eafbf0a5968ff2378a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f672c1-32", "ovs_interfaceid": "b5f672c1-3298-4c5a-bf4d-7c712e4c5873", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74960) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 12:28:20 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-203047e8-bf74-4576-aa5a-2bf967305798 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Converting VIF {"id": "b5f672c1-3298-4c5a-bf4d-7c712e4c5873", "address": "fa:16:3e:5b:1b:87", "network": {"id": "c03e854d-75a3-4e81-9cdf-f1139841266c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1632999031-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c216dd7629274eafbf0a5968ff2378a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f672c1-32", "ovs_interfaceid": "b5f672c1-3298-4c5a-bf4d-7c712e4c5873", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:28:20 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-203047e8-bf74-4576-aa5a-2bf967305798 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:1b:87,bridge_name='br-int',has_traffic_filtering=True,id=b5f672c1-3298-4c5a-bf4d-7c712e4c5873,network=Network(c03e854d-75a3-4e81-9cdf-f1139841266c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5f672c1-32') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:28:20 user nova-compute[74960]: DEBUG nova.objects.instance [None req-203047e8-bf74-4576-aa5a-2bf967305798 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Lazy-loading 'pci_devices' on Instance uuid e6cbb630-254f-4c56-9cf9-47d751c703be {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:28:20 user nova-compute[74960]: DEBUG nova.objects.base [None req-203047e8-bf74-4576-aa5a-2bf967305798 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Object Instance<e6cbb630-254f-4c56-9cf9-47d751c703be> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74960) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 12:28:20 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-203047e8-bf74-4576-aa5a-2bf967305798 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: e6cbb630-254f-4c56-9cf9-47d751c703be] End _get_guest_xml xml=<domain type="kvm">
Nov 03 12:28:20 user nova-compute[74960]:   <uuid>e6cbb630-254f-4c56-9cf9-47d751c703be</uuid>
Nov 03 12:28:20 user nova-compute[74960]:   <name>instance-00000013</name>
Nov 03 12:28:20 user nova-compute[74960]:   <memory>524288</memory>
Nov 03 12:28:20 user nova-compute[74960]:   <vcpu>1</vcpu>
Nov 03 12:28:20 user nova-compute[74960]:   <metadata>
Nov 03 12:28:20 user nova-compute[74960]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 12:28:20 user nova-compute[74960]:       <nova:package version="0.0.0"/>
Nov 03 12:28:20 user nova-compute[74960]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1644828034</nova:name>
Nov 03 12:28:20 user nova-compute[74960]:       <nova:creationTime>2023-11-03 12:28:19</nova:creationTime>
Nov 03 12:28:20 user nova-compute[74960]:       <nova:flavor name="m1.tiny">
Nov 03 12:28:20 user nova-compute[74960]:         <nova:memory>512</nova:memory>
Nov 03 12:28:20 user nova-compute[74960]:         <nova:disk>1</nova:disk>
Nov 03 12:28:20 user nova-compute[74960]:         <nova:swap>0</nova:swap>
Nov 03 12:28:20 user nova-compute[74960]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 12:28:20 user nova-compute[74960]:         <nova:vcpus>1</nova:vcpus>
Nov 03 12:28:20 user nova-compute[74960]:       </nova:flavor>
Nov 03 12:28:20 user nova-compute[74960]:       <nova:owner>
Nov 03 12:28:20 user nova-compute[74960]:         <nova:user uuid="fae69462930546bdb9cf6e2a11a0df2a">tempest-AttachVolumeShelveTestJSON-258463843-project-member</nova:user>
Nov 03 12:28:20 user nova-compute[74960]:         <nova:project uuid="c216dd7629274eafbf0a5968ff2378a9">tempest-AttachVolumeShelveTestJSON-258463843</nova:project>
Nov 03 12:28:20 user nova-compute[74960]:       </nova:owner>
Nov 03 12:28:20 user nova-compute[74960]:       <nova:root type="image" uuid="79caf2c3-5132-4c51-9b2e-7761bce2f259"/>
Nov 03 12:28:20 user nova-compute[74960]:       <nova:ports>
Nov 03 12:28:20 user nova-compute[74960]:         <nova:port uuid="b5f672c1-3298-4c5a-bf4d-7c712e4c5873">
Nov 03 12:28:20 user nova-compute[74960]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 03 12:28:20 user nova-compute[74960]:         </nova:port>
Nov 03 12:28:20 user nova-compute[74960]:       </nova:ports>
Nov 03 12:28:20 user nova-compute[74960]:     </nova:instance>
Nov 03 12:28:20 user nova-compute[74960]:   </metadata>
Nov 03 12:28:20 user nova-compute[74960]:   <sysinfo type="smbios">
Nov 03 12:28:20 user nova-compute[74960]:     <system>
Nov 03 12:28:20 user nova-compute[74960]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 12:28:20 user nova-compute[74960]:       <entry name="product">OpenStack Nova</entry>
Nov 03 12:28:20 user nova-compute[74960]:       <entry name="version">0.0.0</entry>
Nov 03 12:28:20 user nova-compute[74960]:       <entry name="serial">e6cbb630-254f-4c56-9cf9-47d751c703be</entry>
Nov 03 12:28:20 user nova-compute[74960]:       <entry name="uuid">e6cbb630-254f-4c56-9cf9-47d751c703be</entry>
Nov 03 12:28:20 user nova-compute[74960]:       <entry name="family">Virtual Machine</entry>
Nov 03 12:28:20 user nova-compute[74960]:     </system>
Nov 03 12:28:20 user nova-compute[74960]:   </sysinfo>
Nov 03 12:28:20 user nova-compute[74960]:   <os>
Nov 03 12:28:20 user nova-compute[74960]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 12:28:20 user nova-compute[74960]:     <boot dev="hd"/>
Nov 03 12:28:20 user nova-compute[74960]:     <smbios mode="sysinfo"/>
Nov 03 12:28:20 user nova-compute[74960]:   </os>
Nov 03 12:28:20 user nova-compute[74960]:   <features>
Nov 03 12:28:20 user nova-compute[74960]:     <acpi/>
Nov 03 12:28:20 user nova-compute[74960]:     <apic/>
Nov 03 12:28:20 user nova-compute[74960]:     <vmcoreinfo/>
Nov 03 12:28:20 user nova-compute[74960]:   </features>
Nov 03 12:28:20 user nova-compute[74960]:   <clock offset="utc">
Nov 03 12:28:20 user nova-compute[74960]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 12:28:20 user nova-compute[74960]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 12:28:20 user nova-compute[74960]:     <timer name="hpet" present="no"/>
Nov 03 12:28:20 user nova-compute[74960]:   </clock>
Nov 03 12:28:20 user nova-compute[74960]:   <cpu mode="custom" match="exact">
Nov 03 12:28:20 user nova-compute[74960]:     <model>Nehalem</model>
Nov 03 12:28:20 user nova-compute[74960]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 12:28:20 user nova-compute[74960]:   </cpu>
Nov 03 12:28:20 user nova-compute[74960]:   <devices>
Nov 03 12:28:20 user nova-compute[74960]:     <disk type="file" device="disk">
Nov 03 12:28:20 user nova-compute[74960]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 12:28:20 user nova-compute[74960]:       <source file="/opt/stack/data/nova/instances/e6cbb630-254f-4c56-9cf9-47d751c703be/disk"/>
Nov 03 12:28:20 user nova-compute[74960]:       <target dev="vda" bus="virtio"/>
Nov 03 12:28:20 user nova-compute[74960]:     </disk>
Nov 03 12:28:20 user nova-compute[74960]:     <interface type="ethernet">
Nov 03 12:28:20 user nova-compute[74960]:       <mac address="fa:16:3e:5b:1b:87"/>
Nov 03 12:28:20 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:28:20 user nova-compute[74960]:       <mtu size="1442"/>
Nov 03 12:28:20 user nova-compute[74960]:       <target dev="tapb5f672c1-32"/>
Nov 03 12:28:20 user nova-compute[74960]:     </interface>
Nov 03 12:28:20 user nova-compute[74960]:     <serial type="pty">
Nov 03 12:28:20 user nova-compute[74960]:       <log file="/opt/stack/data/nova/instances/e6cbb630-254f-4c56-9cf9-47d751c703be/console.log" append="off"/>
Nov 03 12:28:20 user nova-compute[74960]:     </serial>
Nov 03 12:28:20 user nova-compute[74960]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 12:28:20 user nova-compute[74960]:     <video>
Nov 03 12:28:20 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:28:20 user nova-compute[74960]:     </video>
Nov 03 12:28:20 user nova-compute[74960]:     <rng model="virtio">
Nov 03 12:28:20 user nova-compute[74960]:       <backend model="random">/dev/urandom</backend>
Nov 03 12:28:20 user nova-compute[74960]:     </rng>
Nov 03 12:28:20 user nova-compute[74960]:     <controller type="usb" index="0" model="none"/>
Nov 03 12:28:20 user nova-compute[74960]:     <memballoon model="virtio">
Nov 03 12:28:20 user nova-compute[74960]:       <stats period="10"/>
Nov 03 12:28:20 user nova-compute[74960]:     </memballoon>
Nov 03 12:28:20 user nova-compute[74960]:   </devices>
Nov 03 12:28:20 user nova-compute[74960]: </domain>
Nov 03 12:28:20 user nova-compute[74960]:  {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 12:28:20 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-203047e8-bf74-4576-aa5a-2bf967305798 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-03T12:24:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1644828034',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1644828034',id=19,image_ref='79caf2c3-5132-4c51-9b2e-7761bce2f259',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1090973974',keypairs=<?>,launch_index=0,launched_at=2023-11-03T12:24:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='c216dd7629274eafbf0a5968ff2378a9',ramdisk_id='',reservation_id='r-t48sleg2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-258463843',owner_user_name='tempest-AttachVolumeShelveTestJSON-258463843-project-member',shelved_at='2023-11-03T12:26:24.907044',shelved_host='user',shelved_image_id='79caf2c3-5132-4c51-9b2e-7761bce2f259'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:28:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fae69462930546bdb9cf6e2a11a0df2a',uuid=e6cbb630-254f-4c56-9cf9-47d751c703be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "b5f672c1-3298-4c5a-bf4d-7c712e4c5873", "address": "fa:16:3e:5b:1b:87", "network": {"id": "c03e854d-75a3-4e81-9cdf-f1139841266c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1632999031-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c216dd7629274eafbf0a5968ff2378a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f672c1-32", "ovs_interfaceid": "b5f672c1-3298-4c5a-bf4d-7c712e4c5873", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 12:28:20 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-203047e8-bf74-4576-aa5a-2bf967305798 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Converting VIF {"id": "b5f672c1-3298-4c5a-bf4d-7c712e4c5873", "address": "fa:16:3e:5b:1b:87", "network": {"id": "c03e854d-75a3-4e81-9cdf-f1139841266c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1632999031-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c216dd7629274eafbf0a5968ff2378a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f672c1-32", "ovs_interfaceid": "b5f672c1-3298-4c5a-bf4d-7c712e4c5873", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:28:20 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-203047e8-bf74-4576-aa5a-2bf967305798 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:1b:87,bridge_name='br-int',has_traffic_filtering=True,id=b5f672c1-3298-4c5a-bf4d-7c712e4c5873,network=Network(c03e854d-75a3-4e81-9cdf-f1139841266c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5f672c1-32') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:28:20 user nova-compute[74960]: DEBUG os_vif [None req-203047e8-bf74-4576-aa5a-2bf967305798 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:1b:87,bridge_name='br-int',has_traffic_filtering=True,id=b5f672c1-3298-4c5a-bf4d-7c712e4c5873,network=Network(c03e854d-75a3-4e81-9cdf-f1139841266c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5f672c1-32') {{(pid=74960) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 12:28:20 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:28:20 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:28:20 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 12:28:20 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:28:20 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a1a03f82-a9d6-51cb-b8d5-13c2d7eb95c3', '_type': 'linux-noop'}}, row=False) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:28:20 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:28:20 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:28:20 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:28:20 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb5f672c1-32, may_exist=True, interface_attrs={}) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:28:20 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb5f672c1-32, col_values=(('qos', UUID('525f4485-2748-4960-bae1-a8df27d7b9a7')),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:28:20 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb5f672c1-32, col_values=(('external_ids', {'iface-id': 'b5f672c1-3298-4c5a-bf4d-7c712e4c5873', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5b:1b:87', 'vm-uuid': 'e6cbb630-254f-4c56-9cf9-47d751c703be'}),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:28:20 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:28:20 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:28:20 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:28:20 user nova-compute[74960]: INFO os_vif [None req-203047e8-bf74-4576-aa5a-2bf967305798 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:1b:87,bridge_name='br-int',has_traffic_filtering=True,id=b5f672c1-3298-4c5a-bf4d-7c712e4c5873,network=Network(c03e854d-75a3-4e81-9cdf-f1139841266c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5f672c1-32')
Nov 03 12:28:20 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-203047e8-bf74-4576-aa5a-2bf967305798 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] No BDM found with device name vda, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:28:20 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-203047e8-bf74-4576-aa5a-2bf967305798 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] No VIF found with MAC fa:16:3e:5b:1b:87, not building metadata {{(pid=74960) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 12:28:20 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b14542b-e6c3-4d86-87c2-65c3dafe3b33 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] [instance: 7a33549f-51ea-42d0-8c8a-67d9c74784fd] Calling os-brick to attach iSCSI Volume {{(pid=74960) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 12:28:20 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b14542b-e6c3-4d86-87c2-65c3dafe3b33 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9aa420acb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9221d517-2219-40f2-bbcb-2c12097148bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nowxHOYl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:28:20 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-8b14542b-e6c3-4d86-87c2-65c3dafe3b33 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:28:20 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-8b14542b-e6c3-4d86-87c2-65c3dafe3b33 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:28:20 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-8b14542b-e6c3-4d86-87c2-65c3dafe3b33 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:28:20 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-8b14542b-e6c3-4d86-87c2-65c3dafe3b33 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:28:20 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-8b14542b-e6c3-4d86-87c2-65c3dafe3b33 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9221d517-2219-40f2-bbcb-2c12097148bc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:28:20 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-8b14542b-e6c3-4d86-87c2-65c3dafe3b33 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9221d517-2219-40f2-bbcb-2c12097148bc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:28:20 user nova-compute[74960]: INFO os_brick.initiator.connectors.iscsi [None req-8b14542b-e6c3-4d86-87c2-65c3dafe3b33 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 12:28:20 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9221d517-2219-40f2-bbcb-2c12097148bc -p 172.16.0.220:3260 {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:28:20 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9221d517-2219-40f2-bbcb-2c12097148bc -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:28:20 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7446006-6e09-4927-888e-bf5da17d1b53]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:28:20 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b14542b-e6c3-4d86-87c2-65c3dafe3b33 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 12:28:20 user nova-compute[74960]:  {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:28:20 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9221d517-2219-40f2-bbcb-2c12097148bc -p 172.16.0.220:3260 --interface default --op new {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:28:20 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9221d517-2219-40f2-bbcb-2c12097148bc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:28:20 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8caf81d-d289-4ce7-9f61-f0cfe5d4a811]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9221d517-2219-40f2-bbcb-2c12097148bc] added\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:28:20 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b14542b-e6c3-4d86-87c2-65c3dafe3b33 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9221d517-2219-40f2-bbcb-2c12097148bc] added
Nov 03 12:28:20 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:28:20 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9221d517-2219-40f2-bbcb-2c12097148bc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:28:20 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9221d517-2219-40f2-bbcb-2c12097148bc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:28:20 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[b229068e-2561-49ab-a240-6504d4b0eb94]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:28:20 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b14542b-e6c3-4d86-87c2-65c3dafe3b33 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:28:20 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9221d517-2219-40f2-bbcb-2c12097148bc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:28:20 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9221d517-2219-40f2-bbcb-2c12097148bc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:28:20 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[08974150-b002-4a2d-af17-f8670b8d0b58]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:28:20 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b14542b-e6c3-4d86-87c2-65c3dafe3b33 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:28:20 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9221d517-2219-40f2-bbcb-2c12097148bc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nowxHOYl {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:28:20 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9221d517-2219-40f2-bbcb-2c12097148bc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nowxHOYl" returned: 0 in 0.021s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:28:20 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[05642c9b-8657-4fec-b6b9-83b57eb04b03]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:28:20 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b14542b-e6c3-4d86-87c2-65c3dafe3b33 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nowxHOYl'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:28:20 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9221d517-2219-40f2-bbcb-2c12097148bc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:28:20 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9221d517-2219-40f2-bbcb-2c12097148bc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:28:20 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d1a32a7-6394-473b-9f9a-de4d28149f49]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:28:20 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b14542b-e6c3-4d86-87c2-65c3dafe3b33 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:28:20 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:28:20 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:28:20 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a7e35ee-d525-4612-85bb-6c06bf50c577]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64cd7bb2-1477-431a-b084-4339f203980c (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:28:20 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b14542b-e6c3-4d86-87c2-65c3dafe3b33 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815 (non-flash)
Nov 03 12:28:20 user nova-compute[74960]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64cd7bb2-1477-431a-b084-4339f203980c (non-flash)
Nov 03 12:28:20 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:28:20 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b14542b-e6c3-4d86-87c2-65c3dafe3b33 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815 (non-flash)
Nov 03 12:28:20 user nova-compute[74960]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64cd7bb2-1477-431a-b084-4339f203980c (non-flash)
Nov 03 12:28:20 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:28:20 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9221d517-2219-40f2-bbcb-2c12097148bc -p 172.16.0.220:3260 --login {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:28:20 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9221d517-2219-40f2-bbcb-2c12097148bc -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:28:20 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[0585cbe5-d9f7-40c4-91a6-c4dbde863603]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9221d517-2219-40f2-bbcb-2c12097148bc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9221d517-2219-40f2-bbcb-2c12097148bc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:28:20 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b14542b-e6c3-4d86-87c2-65c3dafe3b33 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9221d517-2219-40f2-bbcb-2c12097148bc, portal: 172.16.0.220,3260]
Nov 03 12:28:20 user nova-compute[74960]: Login to [iface: default, target: iqn.2010-10.org.openstack:9221d517-2219-40f2-bbcb-2c12097148bc, portal: 172.16.0.220,3260] successful.
Nov 03 12:28:20 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:28:20 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9221d517-2219-40f2-bbcb-2c12097148bc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:28:20 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9221d517-2219-40f2-bbcb-2c12097148bc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:28:20 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[305caf7b-36d3-4a90-8b3e-3a282810b4a0]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:28:20 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b14542b-e6c3-4d86-87c2-65c3dafe3b33 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:28:20 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:28:20 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:28:20 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[07864c64-b928-4d50-ac7b-4fa232228af2]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64cd7bb2-1477-431a-b084-4339f203980c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9221d517-2219-40f2-bbcb-2c12097148bc (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:28:20 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b14542b-e6c3-4d86-87c2-65c3dafe3b33 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815 (non-flash)
Nov 03 12:28:20 user nova-compute[74960]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64cd7bb2-1477-431a-b084-4339f203980c (non-flash)
Nov 03 12:28:20 user nova-compute[74960]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9221d517-2219-40f2-bbcb-2c12097148bc (non-flash)
Nov 03 12:28:20 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:28:20 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b14542b-e6c3-4d86-87c2-65c3dafe3b33 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815 (non-flash)
Nov 03 12:28:20 user nova-compute[74960]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64cd7bb2-1477-431a-b084-4339f203980c (non-flash)
Nov 03 12:28:20 user nova-compute[74960]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9221d517-2219-40f2-bbcb-2c12097148bc (non-flash)
Nov 03 12:28:20 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:28:20 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-8b14542b-e6c3-4d86-87c2-65c3dafe3b33 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9221d517-2219-40f2-bbcb-2c12097148bc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:28:20 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b14542b-e6c3-4d86-87c2-65c3dafe3b33 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Connected to 172.16.0.220:3260 {{(pid=74960) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 12:28:20 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-8b14542b-e6c3-4d86-87c2-65c3dafe3b33 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] HCTL ('34', '-', '-', 0) found on session 18 with lun 0 {{(pid=74960) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 12:28:20 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-8b14542b-e6c3-4d86-87c2-65c3dafe3b33 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74960) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 12:28:20 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:28:20 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:28:20 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5132028-1bc7-41cb-a22b-238c7b7914e9]: (4, ('- - 0', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:28:20 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-8b14542b-e6c3-4d86-87c2-65c3dafe3b33 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Searching for a device in session 18 and hctl ['34', '*', '*', 0] yield: None {{(pid=74960) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 12:28:21 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-d304d6c4-b626-47eb-bafb-a7d54e5ed97d tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Acquiring lock "be38c803-d97c-4939-9852-e8db1c44bb65" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:28:21 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-d304d6c4-b626-47eb-bafb-a7d54e5ed97d tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Lock "be38c803-d97c-4939-9852-e8db1c44bb65" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:28:21 user nova-compute[74960]: DEBUG nova.objects.instance [None req-d304d6c4-b626-47eb-bafb-a7d54e5ed97d tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Lazy-loading 'flavor' on Instance uuid be38c803-d97c-4939-9852-e8db1c44bb65 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:28:21 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-d304d6c4-b626-47eb-bafb-a7d54e5ed97d tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Lock "be38c803-d97c-4939-9852-e8db1c44bb65" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:28:21 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-d304d6c4-b626-47eb-bafb-a7d54e5ed97d tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Acquiring lock "be38c803-d97c-4939-9852-e8db1c44bb65" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:28:21 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-d304d6c4-b626-47eb-bafb-a7d54e5ed97d tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Lock "be38c803-d97c-4939-9852-e8db1c44bb65" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:28:21 user nova-compute[74960]: INFO nova.compute.manager [None req-d304d6c4-b626-47eb-bafb-a7d54e5ed97d tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] [instance: be38c803-d97c-4939-9852-e8db1c44bb65] Attaching volume f33bebd3-3cc8-4db5-b35e-5d58d4dfe93f to /dev/vdb
Nov 03 12:28:21 user nova-compute[74960]: DEBUG os_brick.utils [None req-d304d6c4-b626-47eb-bafb-a7d54e5ed97d tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:28:21 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:28:21 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:28:21 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a18d3e4-40dc-46e7-9a1e-2009a488e7a6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:75b8e219756\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:28:21 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:28:21 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:28:21 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[4465ef1c-a413-4b34-83f8-dd34559f3805]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:28:21 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:28:21 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:28:21 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[8031ddee-ca98-430c-acd1-3e4310bb3e27]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:28:21 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6d93d57-dc01-4fdb-91ad-67e34f817cb5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:28:21 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-d304d6c4-b626-47eb-bafb-a7d54e5ed97d tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Running cmd (subprocess): nvme version {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:28:21 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-d304d6c4-b626-47eb-bafb-a7d54e5ed97d tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] 'nvme version' failed. Not Retrying. {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 12:28:21 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:28:21 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d304d6c4-b626-47eb-bafb-a7d54e5ed97d tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] nvme not present on system {{(pid=74960) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 12:28:21 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:28:21 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:28:21 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 12:28:21 user nova-compute[74960]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 12:28:21 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8bb1407-90f3-45f5-a474-ca0a0ad8df69]: (4, '') {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:28:21 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-d304d6c4-b626-47eb-bafb-a7d54e5ed97d tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74960) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 12:28:21 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-d304d6c4-b626-47eb-bafb-a7d54e5ed97d tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74960) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 12:28:21 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-d304d6c4-b626-47eb-bafb-a7d54e5ed97d tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] LIGHTOS: no hostnqn found. {{(pid=74960) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 12:28:21 user nova-compute[74960]: DEBUG os_brick.utils [None req-d304d6c4-b626-47eb-bafb-a7d54e5ed97d tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:75b8e219756', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:28:21 user nova-compute[74960]: DEBUG nova.virt.block_device [None req-d304d6c4-b626-47eb-bafb-a7d54e5ed97d tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] [instance: be38c803-d97c-4939-9852-e8db1c44bb65] Updating existing volume attachment record: 9382be75-06cb-472f-b6bb-bb5c39316ee9 {{(pid=74960) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 12:28:21 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:28:21 user nova-compute[74960]: DEBUG nova.compute.manager [req-dbe44696-d2f8-410a-bdc7-e6980dbbc19c req-a161a175-909a-44e0-9aac-013930240b61 service nova] [instance: e6cbb630-254f-4c56-9cf9-47d751c703be] Received event network-vif-plugged-b5f672c1-3298-4c5a-bf4d-7c712e4c5873 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:28:21 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-dbe44696-d2f8-410a-bdc7-e6980dbbc19c req-a161a175-909a-44e0-9aac-013930240b61 service nova] Acquiring lock "e6cbb630-254f-4c56-9cf9-47d751c703be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:28:21 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-dbe44696-d2f8-410a-bdc7-e6980dbbc19c req-a161a175-909a-44e0-9aac-013930240b61 service nova] Lock "e6cbb630-254f-4c56-9cf9-47d751c703be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:28:21 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-dbe44696-d2f8-410a-bdc7-e6980dbbc19c req-a161a175-909a-44e0-9aac-013930240b61 service nova] Lock "e6cbb630-254f-4c56-9cf9-47d751c703be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:28:21 user nova-compute[74960]: DEBUG nova.compute.manager [req-dbe44696-d2f8-410a-bdc7-e6980dbbc19c req-a161a175-909a-44e0-9aac-013930240b61 service nova] [instance: e6cbb630-254f-4c56-9cf9-47d751c703be] No waiting events found dispatching network-vif-plugged-b5f672c1-3298-4c5a-bf4d-7c712e4c5873 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:28:21 user nova-compute[74960]: WARNING nova.compute.manager [req-dbe44696-d2f8-410a-bdc7-e6980dbbc19c req-a161a175-909a-44e0-9aac-013930240b61 service nova] [instance: e6cbb630-254f-4c56-9cf9-47d751c703be] Received unexpected event network-vif-plugged-b5f672c1-3298-4c5a-bf4d-7c712e4c5873 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 03 12:28:21 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-8b14542b-e6c3-4d86-87c2-65c3dafe3b33 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Searching for a device in session 18 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74960) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 12:28:21 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b14542b-e6c3-4d86-87c2-65c3dafe3b33 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:9221d517-2219-40f2-bbcb-2c12097148bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nowxHOYl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74960) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 12:28:21 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-8b14542b-e6c3-4d86-87c2-65c3dafe3b33 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.320s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:28:21 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b14542b-e6c3-4d86-87c2-65c3dafe3b33 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '23331643633623935', 'path': '/dev/sdc'} {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:28:21 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b14542b-e6c3-4d86-87c2-65c3dafe3b33 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] [instance: 7a33549f-51ea-42d0-8c8a-67d9c74784fd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23331643633623935', 'path': '/dev/sdc'} {{(pid=74960) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 12:28:21 user nova-compute[74960]: DEBUG nova.objects.instance [None req-8b14542b-e6c3-4d86-87c2-65c3dafe3b33 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Lazy-loading 'flavor' on Instance uuid 7a33549f-51ea-42d0-8c8a-67d9c74784fd {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:28:21 user nova-compute[74960]: DEBUG nova.virt.libvirt.guest [None req-8b14542b-e6c3-4d86-87c2-65c3dafe3b33 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] attach device xml: <disk type="block" device="disk">
Nov 03 12:28:21 user nova-compute[74960]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 12:28:21 user nova-compute[74960]:   <source dev="/dev/sdc"/>
Nov 03 12:28:21 user nova-compute[74960]:   <target dev="vdc" bus="virtio"/>
Nov 03 12:28:21 user nova-compute[74960]:   <serial>9221d517-2219-40f2-bbcb-2c12097148bc</serial>
Nov 03 12:28:21 user nova-compute[74960]: </disk>
Nov 03 12:28:21 user nova-compute[74960]:  {{(pid=74960) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 03 12:28:22 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-8b14542b-e6c3-4d86-87c2-65c3dafe3b33 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] No BDM found with device name vda, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:28:22 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-8b14542b-e6c3-4d86-87c2-65c3dafe3b33 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:28:22 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-8b14542b-e6c3-4d86-87c2-65c3dafe3b33 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:28:22 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-8b14542b-e6c3-4d86-87c2-65c3dafe3b33 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] No VIF found with MAC fa:16:3e:1d:94:c7, not building metadata {{(pid=74960) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 12:28:22 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:28:22 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:28:22 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-8b14542b-e6c3-4d86-87c2-65c3dafe3b33 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Lock "7a33549f-51ea-42d0-8c8a-67d9c74784fd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 28.150s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:28:23 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:28:23 user nova-compute[74960]: DEBUG nova.compute.manager [req-806b82b5-5933-4ac9-a816-737ef9b2f672 req-0d36c3de-7381-442c-9819-02da8cdaa17e service nova] [instance: e6cbb630-254f-4c56-9cf9-47d751c703be] Received event network-vif-plugged-b5f672c1-3298-4c5a-bf4d-7c712e4c5873 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:28:23 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-806b82b5-5933-4ac9-a816-737ef9b2f672 req-0d36c3de-7381-442c-9819-02da8cdaa17e service nova] Acquiring lock "e6cbb630-254f-4c56-9cf9-47d751c703be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:28:23 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-806b82b5-5933-4ac9-a816-737ef9b2f672 req-0d36c3de-7381-442c-9819-02da8cdaa17e service nova] Lock "e6cbb630-254f-4c56-9cf9-47d751c703be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:28:23 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-806b82b5-5933-4ac9-a816-737ef9b2f672 req-0d36c3de-7381-442c-9819-02da8cdaa17e service nova] Lock "e6cbb630-254f-4c56-9cf9-47d751c703be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:28:23 user nova-compute[74960]: DEBUG nova.compute.manager [req-806b82b5-5933-4ac9-a816-737ef9b2f672 req-0d36c3de-7381-442c-9819-02da8cdaa17e service nova] [instance: e6cbb630-254f-4c56-9cf9-47d751c703be] No waiting events found dispatching network-vif-plugged-b5f672c1-3298-4c5a-bf4d-7c712e4c5873 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:28:23 user nova-compute[74960]: WARNING nova.compute.manager [req-806b82b5-5933-4ac9-a816-737ef9b2f672 req-0d36c3de-7381-442c-9819-02da8cdaa17e service nova] [instance: e6cbb630-254f-4c56-9cf9-47d751c703be] Received unexpected event network-vif-plugged-b5f672c1-3298-4c5a-bf4d-7c712e4c5873 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 03 12:28:24 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-6b6c149c-9182-4f9a-a495-b901be8f24cd tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Acquiring lock "7a33549f-51ea-42d0-8c8a-67d9c74784fd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:28:24 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-6b6c149c-9182-4f9a-a495-b901be8f24cd tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Lock "7a33549f-51ea-42d0-8c8a-67d9c74784fd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:28:24 user nova-compute[74960]: INFO nova.compute.manager [None req-6b6c149c-9182-4f9a-a495-b901be8f24cd tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] [instance: 7a33549f-51ea-42d0-8c8a-67d9c74784fd] Detaching volume 9221d517-2219-40f2-bbcb-2c12097148bc
Nov 03 12:28:24 user nova-compute[74960]: INFO nova.virt.block_device [None req-6b6c149c-9182-4f9a-a495-b901be8f24cd tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] [instance: 7a33549f-51ea-42d0-8c8a-67d9c74784fd] Attempting to driver detach volume 9221d517-2219-40f2-bbcb-2c12097148bc from mountpoint /dev/vdc
Nov 03 12:28:24 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-6b6c149c-9182-4f9a-a495-b901be8f24cd tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Attempting to detach device vdc from instance 7a33549f-51ea-42d0-8c8a-67d9c74784fd from the persistent domain config. {{(pid=74960) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 03 12:28:24 user nova-compute[74960]: DEBUG nova.virt.libvirt.guest [None req-6b6c149c-9182-4f9a-a495-b901be8f24cd tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 12:28:24 user nova-compute[74960]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 12:28:24 user nova-compute[74960]:   <source dev="/dev/sdc"/>
Nov 03 12:28:24 user nova-compute[74960]:   <target dev="vdc" bus="virtio"/>
Nov 03 12:28:24 user nova-compute[74960]:   <serial>9221d517-2219-40f2-bbcb-2c12097148bc</serial>
Nov 03 12:28:24 user nova-compute[74960]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 03 12:28:24 user nova-compute[74960]: </disk>
Nov 03 12:28:24 user nova-compute[74960]:  {{(pid=74960) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 12:28:24 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-6b6c149c-9182-4f9a-a495-b901be8f24cd tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Successfully detached device vdc from instance 7a33549f-51ea-42d0-8c8a-67d9c74784fd from the persistent domain config.
Nov 03 12:28:24 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-6b6c149c-9182-4f9a-a495-b901be8f24cd tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 7a33549f-51ea-42d0-8c8a-67d9c74784fd from the live domain config. {{(pid=74960) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 03 12:28:24 user nova-compute[74960]: DEBUG nova.virt.libvirt.guest [None req-6b6c149c-9182-4f9a-a495-b901be8f24cd tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 12:28:24 user nova-compute[74960]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 12:28:24 user nova-compute[74960]:   <source dev="/dev/sdc"/>
Nov 03 12:28:24 user nova-compute[74960]:   <target dev="vdc" bus="virtio"/>
Nov 03 12:28:24 user nova-compute[74960]:   <serial>9221d517-2219-40f2-bbcb-2c12097148bc</serial>
Nov 03 12:28:24 user nova-compute[74960]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 03 12:28:24 user nova-compute[74960]: </disk>
Nov 03 12:28:24 user nova-compute[74960]:  {{(pid=74960) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 12:28:24 user nova-compute[74960]: DEBUG nova.compute.manager [None req-203047e8-bf74-4576-aa5a-2bf967305798 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: e6cbb630-254f-4c56-9cf9-47d751c703be] Instance event wait completed in 0 seconds for  {{(pid=74960) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 12:28:24 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-203047e8-bf74-4576-aa5a-2bf967305798 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: e6cbb630-254f-4c56-9cf9-47d751c703be] Guest created on hypervisor {{(pid=74960) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 12:28:24 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: e6cbb630-254f-4c56-9cf9-47d751c703be] Instance spawned successfully.
Nov 03 12:28:24 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-6b6c149c-9182-4f9a-a495-b901be8f24cd tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 7a33549f-51ea-42d0-8c8a-67d9c74784fd {{(pid=74960) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 03 12:28:24 user nova-compute[74960]: DEBUG nova.compute.manager [None req-203047e8-bf74-4576-aa5a-2bf967305798 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: e6cbb630-254f-4c56-9cf9-47d751c703be] Checking state {{(pid=74960) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 12:28:24 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-203047e8-bf74-4576-aa5a-2bf967305798 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Lock "e6cbb630-254f-4c56-9cf9-47d751c703be" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 12.307s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:28:25 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:28:28 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:28:30 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:28:30 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c1d0e32e-f83f-4e2e-a5f4-4962091e6938 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Acquiring lock "f009a400-0576-48a9-82e0-60de8935c498" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:28:30 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c1d0e32e-f83f-4e2e-a5f4-4962091e6938 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Lock "f009a400-0576-48a9-82e0-60de8935c498" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:28:30 user nova-compute[74960]: INFO nova.compute.manager [None req-c1d0e32e-f83f-4e2e-a5f4-4962091e6938 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] [instance: f009a400-0576-48a9-82e0-60de8935c498] Detaching volume 9101c521-a24b-4b03-b2b1-d73585222815
Nov 03 12:28:30 user nova-compute[74960]: INFO nova.virt.block_device [None req-c1d0e32e-f83f-4e2e-a5f4-4962091e6938 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] [instance: f009a400-0576-48a9-82e0-60de8935c498] Attempting to driver detach volume 9101c521-a24b-4b03-b2b1-d73585222815 from mountpoint /dev/vdb
Nov 03 12:28:30 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-c1d0e32e-f83f-4e2e-a5f4-4962091e6938 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Attempting to detach device vdb from instance f009a400-0576-48a9-82e0-60de8935c498 from the persistent domain config. {{(pid=74960) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 03 12:28:30 user nova-compute[74960]: DEBUG nova.virt.libvirt.guest [None req-c1d0e32e-f83f-4e2e-a5f4-4962091e6938 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 12:28:30 user nova-compute[74960]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 12:28:30 user nova-compute[74960]:   <source dev="/dev/sdf"/>
Nov 03 12:28:30 user nova-compute[74960]:   <target dev="vdb" bus="virtio"/>
Nov 03 12:28:30 user nova-compute[74960]:   <serial>9101c521-a24b-4b03-b2b1-d73585222815</serial>
Nov 03 12:28:30 user nova-compute[74960]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 12:28:30 user nova-compute[74960]: </disk>
Nov 03 12:28:30 user nova-compute[74960]:  {{(pid=74960) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 12:28:30 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-c1d0e32e-f83f-4e2e-a5f4-4962091e6938 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Successfully detached device vdb from instance f009a400-0576-48a9-82e0-60de8935c498 from the persistent domain config.
Nov 03 12:28:30 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-c1d0e32e-f83f-4e2e-a5f4-4962091e6938 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f009a400-0576-48a9-82e0-60de8935c498 from the live domain config. {{(pid=74960) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 03 12:28:30 user nova-compute[74960]: DEBUG nova.virt.libvirt.guest [None req-c1d0e32e-f83f-4e2e-a5f4-4962091e6938 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 12:28:30 user nova-compute[74960]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 12:28:30 user nova-compute[74960]:   <source dev="/dev/sdf"/>
Nov 03 12:28:30 user nova-compute[74960]:   <target dev="vdb" bus="virtio"/>
Nov 03 12:28:30 user nova-compute[74960]:   <serial>9101c521-a24b-4b03-b2b1-d73585222815</serial>
Nov 03 12:28:30 user nova-compute[74960]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 12:28:30 user nova-compute[74960]: </disk>
Nov 03 12:28:30 user nova-compute[74960]:  {{(pid=74960) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 12:28:31 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-c1d0e32e-f83f-4e2e-a5f4-4962091e6938 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f009a400-0576-48a9-82e0-60de8935c498 {{(pid=74960) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 03 12:28:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:28:35 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:28:35 user nova-compute[74960]: DEBUG nova.compute.manager [None req-5aa4a4bc-3def-422d-84e4-7f633f30bf10 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] Start spawning the instance on the hypervisor. {{(pid=74960) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 12:28:35 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-5aa4a4bc-3def-422d-84e4-7f633f30bf10 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] Creating instance directory {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 12:28:35 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-5aa4a4bc-3def-422d-84e4-7f633f30bf10 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] Creating image(s)
Nov 03 12:28:35 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-5aa4a4bc-3def-422d-84e4-7f633f30bf10 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] Did not create local disks {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 03 12:28:35 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-5aa4a4bc-3def-422d-84e4-7f633f30bf10 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] Ensure instance console log exists: /opt/stack/data/nova/instances/a6199681-f85e-4f55-966b-6ab3f17cd640/console.log {{(pid=74960) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 12:28:35 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-5aa4a4bc-3def-422d-84e4-7f633f30bf10 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:28:35 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-5aa4a4bc-3def-422d-84e4-7f633f30bf10 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:28:35 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-5aa4a4bc-3def-422d-84e4-7f633f30bf10 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:28:35 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-5aa4a4bc-3def-422d-84e4-7f633f30bf10 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] Start _get_guest_xml network_info=[{"id": "40976ae5-5f49-4d8e-abd7-04dc0ce8f319", "address": "fa:16:3e:7c:40:1d", "network": {"id": "dec66832-56d5-4d68-b11f-8e8eed38f045", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-79099436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc95d68d5e147e1953c855169b17091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40976ae5-5f", "ovs_interfaceid": "40976ae5-5f49-4d8e-abd7-04dc0ce8f319", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=549f51ba-ac69-494b-8de1-34635aa2d7cf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='63ee9c80c632442fb0379f47b784bd20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T12:13:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BNDmfTXv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a6199681-f85e-4f55-966b-6ab3f17cd640', 'attached_at': '', 'detached_at': '', 'volume_id': 'ef532415-0078-4fe2-8af5-73cada8b32a2', 'serial': 'ef532415-0078-4fe2-8af5-73cada8b32a2'}, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'device_type': 'disk', 'attachment_id': '14e3fbc0-1650-40e1-8eb6-9cf0dffd093d', 'boot_index': 0, 'guest_format': None, 'volume_type': None} {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 12:28:35 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-5aa4a4bc-3def-422d-84e4-7f633f30bf10 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:28:35 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-5aa4a4bc-3def-422d-84e4-7f633f30bf10 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:28:35 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-5aa4a4bc-3def-422d-84e4-7f633f30bf10 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 12:28:35 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-5aa4a4bc-3def-422d-84e4-7f633f30bf10 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] CPU controller missing on host. {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 12:28:35 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-5aa4a4bc-3def-422d-84e4-7f633f30bf10 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 12:28:35 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-5aa4a4bc-3def-422d-84e4-7f633f30bf10 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] CPU controller found on host. {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 12:28:35 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-5aa4a4bc-3def-422d-84e4-7f633f30bf10 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74960) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 12:28:35 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-5aa4a4bc-3def-422d-84e4-7f633f30bf10 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=549f51ba-ac69-494b-8de1-34635aa2d7cf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='63ee9c80c632442fb0379f47b784bd20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T12:13:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 12:28:35 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-5aa4a4bc-3def-422d-84e4-7f633f30bf10 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Flavor limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 12:28:35 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-5aa4a4bc-3def-422d-84e4-7f633f30bf10 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Image limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 12:28:35 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-5aa4a4bc-3def-422d-84e4-7f633f30bf10 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Flavor pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 12:28:35 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-5aa4a4bc-3def-422d-84e4-7f633f30bf10 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Image pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 12:28:35 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-5aa4a4bc-3def-422d-84e4-7f633f30bf10 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 12:28:35 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-5aa4a4bc-3def-422d-84e4-7f633f30bf10 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 12:28:35 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-5aa4a4bc-3def-422d-84e4-7f633f30bf10 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 12:28:35 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-5aa4a4bc-3def-422d-84e4-7f633f30bf10 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Got 1 possible topologies {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 12:28:35 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-5aa4a4bc-3def-422d-84e4-7f633f30bf10 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 12:28:35 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-5aa4a4bc-3def-422d-84e4-7f633f30bf10 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 12:28:35 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5aa4a4bc-3def-422d-84e4-7f633f30bf10 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] Calling os-brick to attach iSCSI Volume {{(pid=74960) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 12:28:35 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aa4a4bc-3def-422d-84e4-7f633f30bf10 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9aa420acb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BNDmfTXv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:28:35 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-5aa4a4bc-3def-422d-84e4-7f633f30bf10 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:28:35 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-5aa4a4bc-3def-422d-84e4-7f633f30bf10 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:28:35 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-5aa4a4bc-3def-422d-84e4-7f633f30bf10 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:28:35 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-5aa4a4bc-3def-422d-84e4-7f633f30bf10 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:28:35 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-5aa4a4bc-3def-422d-84e4-7f633f30bf10 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:28:35 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-5aa4a4bc-3def-422d-84e4-7f633f30bf10 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:28:35 user nova-compute[74960]: INFO os_brick.initiator.connectors.iscsi [None req-5aa4a4bc-3def-422d-84e4-7f633f30bf10 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 12:28:35 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 -p 172.16.0.220:3260 {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:28:35 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:28:35 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[eacf6990-dced-46e3-836e-41e007b51a45]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:28:35 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aa4a4bc-3def-422d-84e4-7f633f30bf10 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 12:28:35 user nova-compute[74960]:  {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:28:35 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 -p 172.16.0.220:3260 --interface default --op new {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:28:35 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:28:35 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[16f47450-c8d4-416f-b1e5-cbc7d9bee80a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2] added\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:28:35 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aa4a4bc-3def-422d-84e4-7f633f30bf10 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2] added
Nov 03 12:28:35 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:28:35 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:28:35 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:28:35 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbd025f2-170d-4d65-9d59-131b7a80f899]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:28:35 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aa4a4bc-3def-422d-84e4-7f633f30bf10 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:28:35 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:28:35 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:28:35 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4b78310-4948-458d-a338-c7c1deb79e26]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:28:35 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aa4a4bc-3def-422d-84e4-7f633f30bf10 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:28:35 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BNDmfTXv {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:28:35 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BNDmfTXv" returned: 0 in 0.025s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:28:35 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[b17e0a1b-01e5-4f48-b922-0718fda960ac]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:28:35 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aa4a4bc-3def-422d-84e4-7f633f30bf10 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BNDmfTXv'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:28:35 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:28:35 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:28:35 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[f03f82d7-f932-46ac-903e-a5f53d943c8d]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:28:35 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aa4a4bc-3def-422d-84e4-7f633f30bf10 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:28:35 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:28:35 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:28:35 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff8111bd-afe6-4ec9-9902-b42e52c72b41]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64cd7bb2-1477-431a-b084-4339f203980c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9221d517-2219-40f2-bbcb-2c12097148bc (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:28:35 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aa4a4bc-3def-422d-84e4-7f633f30bf10 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815 (non-flash)
Nov 03 12:28:35 user nova-compute[74960]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64cd7bb2-1477-431a-b084-4339f203980c (non-flash)
Nov 03 12:28:35 user nova-compute[74960]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9221d517-2219-40f2-bbcb-2c12097148bc (non-flash)
Nov 03 12:28:35 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:28:35 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aa4a4bc-3def-422d-84e4-7f633f30bf10 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815 (non-flash)
Nov 03 12:28:35 user nova-compute[74960]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64cd7bb2-1477-431a-b084-4339f203980c (non-flash)
Nov 03 12:28:35 user nova-compute[74960]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9221d517-2219-40f2-bbcb-2c12097148bc (non-flash)
Nov 03 12:28:35 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:28:35 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 -p 172.16.0.220:3260 --login {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:28:37 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 -p 172.16.0.220:3260 --login" returned: 0 in 1.073s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:28:37 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[a00dc55d-d812-4b67-b0cf-56426b553bd5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:28:37 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aa4a4bc-3def-422d-84e4-7f633f30bf10 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2, portal: 172.16.0.220,3260]
Nov 03 12:28:37 user nova-compute[74960]: Login to [iface: default, target: iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2, portal: 172.16.0.220,3260] successful.
Nov 03 12:28:37 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:28:37 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:28:37 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:28:37 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ceac33c-a222-472e-b333-9270ad379b1e]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:28:37 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aa4a4bc-3def-422d-84e4-7f633f30bf10 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:28:37 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:28:37 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:28:37 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[aac8fff5-96ea-4bf4-9fd8-1e4cc544fd04]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64cd7bb2-1477-431a-b084-4339f203980c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9221d517-2219-40f2-bbcb-2c12097148bc (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:28:37 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aa4a4bc-3def-422d-84e4-7f633f30bf10 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815 (non-flash)
Nov 03 12:28:37 user nova-compute[74960]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64cd7bb2-1477-431a-b084-4339f203980c (non-flash)
Nov 03 12:28:37 user nova-compute[74960]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9221d517-2219-40f2-bbcb-2c12097148bc (non-flash)
Nov 03 12:28:37 user nova-compute[74960]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:28:37 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:28:37 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aa4a4bc-3def-422d-84e4-7f633f30bf10 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815 (non-flash)
Nov 03 12:28:37 user nova-compute[74960]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64cd7bb2-1477-431a-b084-4339f203980c (non-flash)
Nov 03 12:28:37 user nova-compute[74960]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9221d517-2219-40f2-bbcb-2c12097148bc (non-flash)
Nov 03 12:28:37 user nova-compute[74960]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:28:37 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:28:37 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-5aa4a4bc-3def-422d-84e4-7f633f30bf10 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.331s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:28:37 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aa4a4bc-3def-422d-84e4-7f633f30bf10 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Connected to 172.16.0.220:3260 {{(pid=74960) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 12:28:37 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-5aa4a4bc-3def-422d-84e4-7f633f30bf10 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] HCTL ('35', '-', '-', 0) found on session 19 with lun 0 {{(pid=74960) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 12:28:37 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-5aa4a4bc-3def-422d-84e4-7f633f30bf10 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74960) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 12:28:37 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:28:37 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:28:37 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b204f6d-1e7c-4a57-9ecd-16edb14c3633]: (4, ('- - 0', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:28:37 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-5aa4a4bc-3def-422d-84e4-7f633f30bf10 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Searching for a device in session 19 and hctl ['35', '*', '*', 0] yield: None {{(pid=74960) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 12:28:38 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-5aa4a4bc-3def-422d-84e4-7f633f30bf10 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Searching for a device in session 19 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74960) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 12:28:38 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aa4a4bc-3def-422d-84e4-7f633f30bf10 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BNDmfTXv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74960) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 12:28:38 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-5aa4a4bc-3def-422d-84e4-7f633f30bf10 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.362s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:28:38 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aa4a4bc-3def-422d-84e4-7f633f30bf10 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] <== connect_volume: return (2364ms) {'type': 'block', 'scsi_wwn': '26566333533623662', 'path': '/dev/sdd'} {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:28:38 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5aa4a4bc-3def-422d-84e4-7f633f30bf10 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26566333533623662', 'path': '/dev/sdd'} {{(pid=74960) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 12:28:38 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-5aa4a4bc-3def-422d-84e4-7f633f30bf10 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:28:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-391818015',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-391818015',id=25,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dbc95d68d5e147e1953c855169b17091',ramdisk_id='',reservation_id='r-l1ygoxml',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-195954071',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:28:03Z,user_data=None,user_id='c473215929044a108c9fc4d6327dfc3d',uuid=a6199681-f85e-4f55-966b-6ab3f17cd640,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "40976ae5-5f49-4d8e-abd7-04dc0ce8f319", "address": "fa:16:3e:7c:40:1d", "network": {"id": "dec66832-56d5-4d68-b11f-8e8eed38f045", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-79099436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc95d68d5e147e1953c855169b17091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40976ae5-5f", "ovs_interfaceid": "40976ae5-5f49-4d8e-abd7-04dc0ce8f319", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74960) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 12:28:38 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-5aa4a4bc-3def-422d-84e4-7f633f30bf10 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Converting VIF {"id": "40976ae5-5f49-4d8e-abd7-04dc0ce8f319", "address": "fa:16:3e:7c:40:1d", "network": {"id": "dec66832-56d5-4d68-b11f-8e8eed38f045", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-79099436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc95d68d5e147e1953c855169b17091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40976ae5-5f", "ovs_interfaceid": "40976ae5-5f49-4d8e-abd7-04dc0ce8f319", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:28:38 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-5aa4a4bc-3def-422d-84e4-7f633f30bf10 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:40:1d,bridge_name='br-int',has_traffic_filtering=True,id=40976ae5-5f49-4d8e-abd7-04dc0ce8f319,network=Network(dec66832-56d5-4d68-b11f-8e8eed38f045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40976ae5-5f') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:28:38 user nova-compute[74960]: DEBUG nova.objects.instance [None req-5aa4a4bc-3def-422d-84e4-7f633f30bf10 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Lazy-loading 'pci_devices' on Instance uuid a6199681-f85e-4f55-966b-6ab3f17cd640 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:28:38 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-5aa4a4bc-3def-422d-84e4-7f633f30bf10 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] End _get_guest_xml xml=<domain type="kvm">
Nov 03 12:28:38 user nova-compute[74960]:   <uuid>a6199681-f85e-4f55-966b-6ab3f17cd640</uuid>
Nov 03 12:28:38 user nova-compute[74960]:   <name>instance-00000019</name>
Nov 03 12:28:38 user nova-compute[74960]:   <memory>524288</memory>
Nov 03 12:28:38 user nova-compute[74960]:   <vcpu>1</vcpu>
Nov 03 12:28:38 user nova-compute[74960]:   <metadata>
Nov 03 12:28:38 user nova-compute[74960]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 12:28:38 user nova-compute[74960]:       <nova:package version="0.0.0"/>
Nov 03 12:28:38 user nova-compute[74960]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-391818015</nova:name>
Nov 03 12:28:38 user nova-compute[74960]:       <nova:creationTime>2023-11-03 12:28:35</nova:creationTime>
Nov 03 12:28:38 user nova-compute[74960]:       <nova:flavor name="m1.tiny">
Nov 03 12:28:38 user nova-compute[74960]:         <nova:memory>512</nova:memory>
Nov 03 12:28:38 user nova-compute[74960]:         <nova:disk>1</nova:disk>
Nov 03 12:28:38 user nova-compute[74960]:         <nova:swap>0</nova:swap>
Nov 03 12:28:38 user nova-compute[74960]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 12:28:38 user nova-compute[74960]:         <nova:vcpus>1</nova:vcpus>
Nov 03 12:28:38 user nova-compute[74960]:       </nova:flavor>
Nov 03 12:28:38 user nova-compute[74960]:       <nova:owner>
Nov 03 12:28:38 user nova-compute[74960]:         <nova:user uuid="c473215929044a108c9fc4d6327dfc3d">tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member</nova:user>
Nov 03 12:28:38 user nova-compute[74960]:         <nova:project uuid="dbc95d68d5e147e1953c855169b17091">tempest-ServerBootFromVolumeStableRescueTest-195954071</nova:project>
Nov 03 12:28:38 user nova-compute[74960]:       </nova:owner>
Nov 03 12:28:38 user nova-compute[74960]:       <nova:root type="image" uuid="549f51ba-ac69-494b-8de1-34635aa2d7cf"/>
Nov 03 12:28:38 user nova-compute[74960]:       <nova:ports>
Nov 03 12:28:38 user nova-compute[74960]:         <nova:port uuid="40976ae5-5f49-4d8e-abd7-04dc0ce8f319">
Nov 03 12:28:38 user nova-compute[74960]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 03 12:28:38 user nova-compute[74960]:         </nova:port>
Nov 03 12:28:38 user nova-compute[74960]:       </nova:ports>
Nov 03 12:28:38 user nova-compute[74960]:     </nova:instance>
Nov 03 12:28:38 user nova-compute[74960]:   </metadata>
Nov 03 12:28:38 user nova-compute[74960]:   <sysinfo type="smbios">
Nov 03 12:28:38 user nova-compute[74960]:     <system>
Nov 03 12:28:38 user nova-compute[74960]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 12:28:38 user nova-compute[74960]:       <entry name="product">OpenStack Nova</entry>
Nov 03 12:28:38 user nova-compute[74960]:       <entry name="version">0.0.0</entry>
Nov 03 12:28:38 user nova-compute[74960]:       <entry name="serial">a6199681-f85e-4f55-966b-6ab3f17cd640</entry>
Nov 03 12:28:38 user nova-compute[74960]:       <entry name="uuid">a6199681-f85e-4f55-966b-6ab3f17cd640</entry>
Nov 03 12:28:38 user nova-compute[74960]:       <entry name="family">Virtual Machine</entry>
Nov 03 12:28:38 user nova-compute[74960]:     </system>
Nov 03 12:28:38 user nova-compute[74960]:   </sysinfo>
Nov 03 12:28:38 user nova-compute[74960]:   <os>
Nov 03 12:28:38 user nova-compute[74960]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 12:28:38 user nova-compute[74960]:     <boot dev="hd"/>
Nov 03 12:28:38 user nova-compute[74960]:     <smbios mode="sysinfo"/>
Nov 03 12:28:38 user nova-compute[74960]:   </os>
Nov 03 12:28:38 user nova-compute[74960]:   <features>
Nov 03 12:28:38 user nova-compute[74960]:     <acpi/>
Nov 03 12:28:38 user nova-compute[74960]:     <apic/>
Nov 03 12:28:38 user nova-compute[74960]:     <vmcoreinfo/>
Nov 03 12:28:38 user nova-compute[74960]:   </features>
Nov 03 12:28:38 user nova-compute[74960]:   <clock offset="utc">
Nov 03 12:28:38 user nova-compute[74960]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 12:28:38 user nova-compute[74960]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 12:28:38 user nova-compute[74960]:     <timer name="hpet" present="no"/>
Nov 03 12:28:38 user nova-compute[74960]:   </clock>
Nov 03 12:28:38 user nova-compute[74960]:   <cpu mode="custom" match="exact">
Nov 03 12:28:38 user nova-compute[74960]:     <model>Nehalem</model>
Nov 03 12:28:38 user nova-compute[74960]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 12:28:38 user nova-compute[74960]:   </cpu>
Nov 03 12:28:38 user nova-compute[74960]:   <devices>
Nov 03 12:28:38 user nova-compute[74960]:     <disk type="block" device="disk">
Nov 03 12:28:38 user nova-compute[74960]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 12:28:38 user nova-compute[74960]:       <source dev="/dev/sdd"/>
Nov 03 12:28:38 user nova-compute[74960]:       <target dev="vda" bus="virtio"/>
Nov 03 12:28:38 user nova-compute[74960]:       <serial>ef532415-0078-4fe2-8af5-73cada8b32a2</serial>
Nov 03 12:28:38 user nova-compute[74960]:     </disk>
Nov 03 12:28:38 user nova-compute[74960]:     <interface type="ethernet">
Nov 03 12:28:38 user nova-compute[74960]:       <mac address="fa:16:3e:7c:40:1d"/>
Nov 03 12:28:38 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:28:38 user nova-compute[74960]:       <mtu size="1442"/>
Nov 03 12:28:38 user nova-compute[74960]:       <target dev="tap40976ae5-5f"/>
Nov 03 12:28:38 user nova-compute[74960]:     </interface>
Nov 03 12:28:38 user nova-compute[74960]:     <serial type="pty">
Nov 03 12:28:38 user nova-compute[74960]:       <log file="/opt/stack/data/nova/instances/a6199681-f85e-4f55-966b-6ab3f17cd640/console.log" append="off"/>
Nov 03 12:28:38 user nova-compute[74960]:     </serial>
Nov 03 12:28:38 user nova-compute[74960]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 12:28:38 user nova-compute[74960]:     <video>
Nov 03 12:28:38 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:28:38 user nova-compute[74960]:     </video>
Nov 03 12:28:38 user nova-compute[74960]:     <rng model="virtio">
Nov 03 12:28:38 user nova-compute[74960]:       <backend model="random">/dev/urandom</backend>
Nov 03 12:28:38 user nova-compute[74960]:     </rng>
Nov 03 12:28:38 user nova-compute[74960]:     <controller type="usb" index="0" model="none"/>
Nov 03 12:28:38 user nova-compute[74960]:     <memballoon model="virtio">
Nov 03 12:28:38 user nova-compute[74960]:       <stats period="10"/>
Nov 03 12:28:38 user nova-compute[74960]:     </memballoon>
Nov 03 12:28:38 user nova-compute[74960]:   </devices>
Nov 03 12:28:38 user nova-compute[74960]: </domain>
Nov 03 12:28:38 user nova-compute[74960]:  {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 12:28:38 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-5aa4a4bc-3def-422d-84e4-7f633f30bf10 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:28:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-391818015',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-391818015',id=25,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dbc95d68d5e147e1953c855169b17091',ramdisk_id='',reservation_id='r-l1ygoxml',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-195954071',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:28:03Z,user_data=None,user_id='c473215929044a108c9fc4d6327dfc3d',uuid=a6199681-f85e-4f55-966b-6ab3f17cd640,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "40976ae5-5f49-4d8e-abd7-04dc0ce8f319", "address": "fa:16:3e:7c:40:1d", "network": {"id": "dec66832-56d5-4d68-b11f-8e8eed38f045", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-79099436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc95d68d5e147e1953c855169b17091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40976ae5-5f", "ovs_interfaceid": "40976ae5-5f49-4d8e-abd7-04dc0ce8f319", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 12:28:38 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-5aa4a4bc-3def-422d-84e4-7f633f30bf10 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Converting VIF {"id": "40976ae5-5f49-4d8e-abd7-04dc0ce8f319", "address": "fa:16:3e:7c:40:1d", "network": {"id": "dec66832-56d5-4d68-b11f-8e8eed38f045", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-79099436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc95d68d5e147e1953c855169b17091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40976ae5-5f", "ovs_interfaceid": "40976ae5-5f49-4d8e-abd7-04dc0ce8f319", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:28:38 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-5aa4a4bc-3def-422d-84e4-7f633f30bf10 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:40:1d,bridge_name='br-int',has_traffic_filtering=True,id=40976ae5-5f49-4d8e-abd7-04dc0ce8f319,network=Network(dec66832-56d5-4d68-b11f-8e8eed38f045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40976ae5-5f') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:28:38 user nova-compute[74960]: DEBUG os_vif [None req-5aa4a4bc-3def-422d-84e4-7f633f30bf10 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:40:1d,bridge_name='br-int',has_traffic_filtering=True,id=40976ae5-5f49-4d8e-abd7-04dc0ce8f319,network=Network(dec66832-56d5-4d68-b11f-8e8eed38f045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40976ae5-5f') {{(pid=74960) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 12:28:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:28:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:28:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 12:28:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:28:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '16be9745-d2f3-590d-96a4-a2d7dd79162e', '_type': 'linux-noop'}}, row=False) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:28:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:28:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:28:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:28:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap40976ae5-5f, may_exist=True, interface_attrs={}) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:28:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap40976ae5-5f, col_values=(('qos', UUID('6992b725-dd13-4583-907f-aa75d67af35d')),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:28:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap40976ae5-5f, col_values=(('external_ids', {'iface-id': '40976ae5-5f49-4d8e-abd7-04dc0ce8f319', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7c:40:1d', 'vm-uuid': 'a6199681-f85e-4f55-966b-6ab3f17cd640'}),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:28:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:28:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:28:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:28:38 user nova-compute[74960]: INFO os_vif [None req-5aa4a4bc-3def-422d-84e4-7f633f30bf10 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:40:1d,bridge_name='br-int',has_traffic_filtering=True,id=40976ae5-5f49-4d8e-abd7-04dc0ce8f319,network=Network(dec66832-56d5-4d68-b11f-8e8eed38f045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40976ae5-5f')
Nov 03 12:28:38 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-5aa4a4bc-3def-422d-84e4-7f633f30bf10 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] No BDM found with device name vda, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:28:38 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-5aa4a4bc-3def-422d-84e4-7f633f30bf10 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] No VIF found with MAC fa:16:3e:7c:40:1d, not building metadata {{(pid=74960) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 12:28:39 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:28:39 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:28:39 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:28:39 user nova-compute[74960]: DEBUG nova.compute.manager [req-f1163b5c-557b-406b-8fa2-55863af098f0 req-f02fced3-e6d2-450f-9e2a-24eaafbb3428 service nova] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] Received event network-vif-plugged-40976ae5-5f49-4d8e-abd7-04dc0ce8f319 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:28:39 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-f1163b5c-557b-406b-8fa2-55863af098f0 req-f02fced3-e6d2-450f-9e2a-24eaafbb3428 service nova] Acquiring lock "a6199681-f85e-4f55-966b-6ab3f17cd640-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:28:39 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-f1163b5c-557b-406b-8fa2-55863af098f0 req-f02fced3-e6d2-450f-9e2a-24eaafbb3428 service nova] Lock "a6199681-f85e-4f55-966b-6ab3f17cd640-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:28:39 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-f1163b5c-557b-406b-8fa2-55863af098f0 req-f02fced3-e6d2-450f-9e2a-24eaafbb3428 service nova] Lock "a6199681-f85e-4f55-966b-6ab3f17cd640-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:28:39 user nova-compute[74960]: DEBUG nova.compute.manager [req-f1163b5c-557b-406b-8fa2-55863af098f0 req-f02fced3-e6d2-450f-9e2a-24eaafbb3428 service nova] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] No waiting events found dispatching network-vif-plugged-40976ae5-5f49-4d8e-abd7-04dc0ce8f319 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:28:39 user nova-compute[74960]: WARNING nova.compute.manager [req-f1163b5c-557b-406b-8fa2-55863af098f0 req-f02fced3-e6d2-450f-9e2a-24eaafbb3428 service nova] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] Received unexpected event network-vif-plugged-40976ae5-5f49-4d8e-abd7-04dc0ce8f319 for instance with vm_state building and task_state spawning.
Nov 03 12:28:40 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:28:40 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:28:41 user nova-compute[74960]: DEBUG nova.compute.manager [req-92376ac6-c9ec-4b21-8416-1b873bb4cd49 req-0083c631-a33d-44cc-a876-4ec59c4523b9 service nova] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] Received event network-vif-plugged-40976ae5-5f49-4d8e-abd7-04dc0ce8f319 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:28:41 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-92376ac6-c9ec-4b21-8416-1b873bb4cd49 req-0083c631-a33d-44cc-a876-4ec59c4523b9 service nova] Acquiring lock "a6199681-f85e-4f55-966b-6ab3f17cd640-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:28:41 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-92376ac6-c9ec-4b21-8416-1b873bb4cd49 req-0083c631-a33d-44cc-a876-4ec59c4523b9 service nova] Lock "a6199681-f85e-4f55-966b-6ab3f17cd640-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:28:41 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-92376ac6-c9ec-4b21-8416-1b873bb4cd49 req-0083c631-a33d-44cc-a876-4ec59c4523b9 service nova] Lock "a6199681-f85e-4f55-966b-6ab3f17cd640-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:28:41 user nova-compute[74960]: DEBUG nova.compute.manager [req-92376ac6-c9ec-4b21-8416-1b873bb4cd49 req-0083c631-a33d-44cc-a876-4ec59c4523b9 service nova] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] No waiting events found dispatching network-vif-plugged-40976ae5-5f49-4d8e-abd7-04dc0ce8f319 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:28:41 user nova-compute[74960]: WARNING nova.compute.manager [req-92376ac6-c9ec-4b21-8416-1b873bb4cd49 req-0083c631-a33d-44cc-a876-4ec59c4523b9 service nova] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] Received unexpected event network-vif-plugged-40976ae5-5f49-4d8e-abd7-04dc0ce8f319 for instance with vm_state building and task_state spawning.
Nov 03 12:28:42 user nova-compute[74960]: DEBUG nova.compute.manager [None req-5aa4a4bc-3def-422d-84e4-7f633f30bf10 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] Instance event wait completed in 0 seconds for  {{(pid=74960) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 12:28:42 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-5aa4a4bc-3def-422d-84e4-7f633f30bf10 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] Guest created on hypervisor {{(pid=74960) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 12:28:42 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] Instance spawned successfully.
Nov 03 12:28:42 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-5aa4a4bc-3def-422d-84e4-7f633f30bf10 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 12:28:42 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-5aa4a4bc-3def-422d-84e4-7f633f30bf10 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] Found default for hw_cdrom_bus of ide {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:28:42 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-5aa4a4bc-3def-422d-84e4-7f633f30bf10 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] Found default for hw_disk_bus of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:28:42 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-5aa4a4bc-3def-422d-84e4-7f633f30bf10 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] Found default for hw_input_bus of None {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:28:42 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-5aa4a4bc-3def-422d-84e4-7f633f30bf10 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] Found default for hw_pointer_model of None {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:28:42 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-5aa4a4bc-3def-422d-84e4-7f633f30bf10 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] Found default for hw_video_model of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:28:42 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-5aa4a4bc-3def-422d-84e4-7f633f30bf10 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] Found default for hw_vif_model of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:28:42 user nova-compute[74960]: INFO nova.compute.manager [None req-5aa4a4bc-3def-422d-84e4-7f633f30bf10 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] Took 6.53 seconds to spawn the instance on the hypervisor.
Nov 03 12:28:42 user nova-compute[74960]: DEBUG nova.compute.manager [None req-5aa4a4bc-3def-422d-84e4-7f633f30bf10 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] Checking state {{(pid=74960) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 12:28:42 user nova-compute[74960]: INFO nova.compute.manager [None req-5aa4a4bc-3def-422d-84e4-7f633f30bf10 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] Took 40.39 seconds to build instance.
Nov 03 12:28:42 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-5aa4a4bc-3def-422d-84e4-7f633f30bf10 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Lock "a6199681-f85e-4f55-966b-6ab3f17cd640" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 40.503s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:28:43 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:28:43 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:28:43 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:28:43 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d304d6c4-b626-47eb-bafb-a7d54e5ed97d tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] [instance: be38c803-d97c-4939-9852-e8db1c44bb65] Calling os-brick to attach iSCSI Volume {{(pid=74960) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 12:28:43 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-d304d6c4-b626-47eb-bafb-a7d54e5ed97d tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9aa420acb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f33bebd3-3cc8-4db5-b35e-5d58d4dfe93f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MdxjuwLf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:28:43 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-d304d6c4-b626-47eb-bafb-a7d54e5ed97d tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:28:43 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-d304d6c4-b626-47eb-bafb-a7d54e5ed97d tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:28:43 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-d304d6c4-b626-47eb-bafb-a7d54e5ed97d tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:28:43 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-d304d6c4-b626-47eb-bafb-a7d54e5ed97d tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:28:43 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-d304d6c4-b626-47eb-bafb-a7d54e5ed97d tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f33bebd3-3cc8-4db5-b35e-5d58d4dfe93f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:28:43 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-d304d6c4-b626-47eb-bafb-a7d54e5ed97d tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f33bebd3-3cc8-4db5-b35e-5d58d4dfe93f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:28:43 user nova-compute[74960]: INFO os_brick.initiator.connectors.iscsi [None req-d304d6c4-b626-47eb-bafb-a7d54e5ed97d tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 12:28:43 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f33bebd3-3cc8-4db5-b35e-5d58d4dfe93f -p 172.16.0.220:3260 {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:28:43 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f33bebd3-3cc8-4db5-b35e-5d58d4dfe93f -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:28:43 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c5b6356-a29e-4bc0-82e5-ea9324f41e86]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:28:43 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-d304d6c4-b626-47eb-bafb-a7d54e5ed97d tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 12:28:43 user nova-compute[74960]:  {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:28:43 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f33bebd3-3cc8-4db5-b35e-5d58d4dfe93f -p 172.16.0.220:3260 --interface default --op new {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:28:43 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f33bebd3-3cc8-4db5-b35e-5d58d4dfe93f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:28:43 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e8d6535-eea3-423a-9ba1-b5c84ff0a200]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f33bebd3-3cc8-4db5-b35e-5d58d4dfe93f] added\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:28:43 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-d304d6c4-b626-47eb-bafb-a7d54e5ed97d tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f33bebd3-3cc8-4db5-b35e-5d58d4dfe93f] added
Nov 03 12:28:43 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:28:43 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f33bebd3-3cc8-4db5-b35e-5d58d4dfe93f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:28:43 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f33bebd3-3cc8-4db5-b35e-5d58d4dfe93f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:28:43 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f300c0f-60ae-4dec-8732-8573e6dfb6d3]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:28:43 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-d304d6c4-b626-47eb-bafb-a7d54e5ed97d tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:28:43 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f33bebd3-3cc8-4db5-b35e-5d58d4dfe93f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:28:43 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f33bebd3-3cc8-4db5-b35e-5d58d4dfe93f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:28:43 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[3346d1d6-66fe-4427-9cab-2e946b9e1582]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:28:43 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-d304d6c4-b626-47eb-bafb-a7d54e5ed97d tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:28:43 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f33bebd3-3cc8-4db5-b35e-5d58d4dfe93f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MdxjuwLf {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:28:43 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f33bebd3-3cc8-4db5-b35e-5d58d4dfe93f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MdxjuwLf" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:28:43 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[55e317da-c8cf-45da-9d79-cd03fc5ed8d8]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:28:43 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-d304d6c4-b626-47eb-bafb-a7d54e5ed97d tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MdxjuwLf'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:28:43 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f33bebd3-3cc8-4db5-b35e-5d58d4dfe93f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:28:43 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f33bebd3-3cc8-4db5-b35e-5d58d4dfe93f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:28:43 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fd8770c-897e-4994-8931-da327964d8cb]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:28:43 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-d304d6c4-b626-47eb-bafb-a7d54e5ed97d tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:28:43 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:28:43 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:28:43 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fa51178-3248-4e95-b96b-833129592a76]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64cd7bb2-1477-431a-b084-4339f203980c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9221d517-2219-40f2-bbcb-2c12097148bc (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:28:43 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-d304d6c4-b626-47eb-bafb-a7d54e5ed97d tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815 (non-flash)
Nov 03 12:28:43 user nova-compute[74960]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64cd7bb2-1477-431a-b084-4339f203980c (non-flash)
Nov 03 12:28:43 user nova-compute[74960]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9221d517-2219-40f2-bbcb-2c12097148bc (non-flash)
Nov 03 12:28:43 user nova-compute[74960]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:28:43 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:28:43 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-d304d6c4-b626-47eb-bafb-a7d54e5ed97d tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815 (non-flash)
Nov 03 12:28:43 user nova-compute[74960]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64cd7bb2-1477-431a-b084-4339f203980c (non-flash)
Nov 03 12:28:43 user nova-compute[74960]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9221d517-2219-40f2-bbcb-2c12097148bc (non-flash)
Nov 03 12:28:43 user nova-compute[74960]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:28:43 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:28:43 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f33bebd3-3cc8-4db5-b35e-5d58d4dfe93f -p 172.16.0.220:3260 --login {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:28:43 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f33bebd3-3cc8-4db5-b35e-5d58d4dfe93f -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:28:43 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a1d9302-ba29-4edb-9279-dddecb2e55e2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f33bebd3-3cc8-4db5-b35e-5d58d4dfe93f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f33bebd3-3cc8-4db5-b35e-5d58d4dfe93f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:28:43 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-d304d6c4-b626-47eb-bafb-a7d54e5ed97d tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f33bebd3-3cc8-4db5-b35e-5d58d4dfe93f, portal: 172.16.0.220,3260]
Nov 03 12:28:43 user nova-compute[74960]: Login to [iface: default, target: iqn.2010-10.org.openstack:f33bebd3-3cc8-4db5-b35e-5d58d4dfe93f, portal: 172.16.0.220,3260] successful.
Nov 03 12:28:43 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:28:43 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f33bebd3-3cc8-4db5-b35e-5d58d4dfe93f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:28:43 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f33bebd3-3cc8-4db5-b35e-5d58d4dfe93f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:28:43 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cb01ae1-ee5e-4a55-a106-3c345f1833d5]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:28:43 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-d304d6c4-b626-47eb-bafb-a7d54e5ed97d tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:28:43 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:28:43 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:28:43 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[754d943b-30fd-475a-8abf-1ed0880e7c14]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64cd7bb2-1477-431a-b084-4339f203980c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9221d517-2219-40f2-bbcb-2c12097148bc (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f33bebd3-3cc8-4db5-b35e-5d58d4dfe93f (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:28:43 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-d304d6c4-b626-47eb-bafb-a7d54e5ed97d tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815 (non-flash)
Nov 03 12:28:43 user nova-compute[74960]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64cd7bb2-1477-431a-b084-4339f203980c (non-flash)
Nov 03 12:28:43 user nova-compute[74960]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9221d517-2219-40f2-bbcb-2c12097148bc (non-flash)
Nov 03 12:28:43 user nova-compute[74960]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:28:43 user nova-compute[74960]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f33bebd3-3cc8-4db5-b35e-5d58d4dfe93f (non-flash)
Nov 03 12:28:43 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:28:43 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-d304d6c4-b626-47eb-bafb-a7d54e5ed97d tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815 (non-flash)
Nov 03 12:28:43 user nova-compute[74960]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64cd7bb2-1477-431a-b084-4339f203980c (non-flash)
Nov 03 12:28:43 user nova-compute[74960]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9221d517-2219-40f2-bbcb-2c12097148bc (non-flash)
Nov 03 12:28:43 user nova-compute[74960]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:28:43 user nova-compute[74960]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f33bebd3-3cc8-4db5-b35e-5d58d4dfe93f (non-flash)
Nov 03 12:28:43 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:28:43 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-d304d6c4-b626-47eb-bafb-a7d54e5ed97d tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f33bebd3-3cc8-4db5-b35e-5d58d4dfe93f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:28:43 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-d304d6c4-b626-47eb-bafb-a7d54e5ed97d tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Connected to 172.16.0.220:3260 {{(pid=74960) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 12:28:43 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-d304d6c4-b626-47eb-bafb-a7d54e5ed97d tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] HCTL ('36', '-', '-', 0) found on session 20 with lun 0 {{(pid=74960) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 12:28:43 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-d304d6c4-b626-47eb-bafb-a7d54e5ed97d tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74960) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 12:28:43 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:28:43 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:28:43 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec950a5a-992a-433e-a1aa-5f5e54c5a089]: (4, ('- - 0', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:28:43 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-d304d6c4-b626-47eb-bafb-a7d54e5ed97d tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Searching for a device in session 20 and hctl ['36', '*', '*', 0] yield: None {{(pid=74960) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 12:28:44 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:28:44 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:28:44 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-6b6c149c-9182-4f9a-a495-b901be8f24cd tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 7a33549f-51ea-42d0-8c8a-67d9c74784fd is timed out.
Nov 03 12:28:44 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-6b6c149c-9182-4f9a-a495-b901be8f24cd tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Successfully detached device vdc from instance 7a33549f-51ea-42d0-8c8a-67d9c74784fd from the live domain config.
Nov 03 12:28:44 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b6c149c-9182-4f9a-a495-b901be8f24cd tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] [instance: 7a33549f-51ea-42d0-8c8a-67d9c74784fd] calling os-brick to detach iSCSI Volume {{(pid=74960) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 12:28:44 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b6c149c-9182-4f9a-a495-b901be8f24cd tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9aa420acb0>, {'target_iqn': 'iqn.2010-10.org.openstack:9221d517-2219-40f2-bbcb-2c12097148bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nowxHOYl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:28:44 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-6b6c149c-9182-4f9a-a495-b901be8f24cd tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:28:44 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-6b6c149c-9182-4f9a-a495-b901be8f24cd tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:28:44 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-d304d6c4-b626-47eb-bafb-a7d54e5ed97d tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Searching for a device in session 20 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74960) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 12:28:44 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-d304d6c4-b626-47eb-bafb-a7d54e5ed97d tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:f33bebd3-3cc8-4db5-b35e-5d58d4dfe93f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MdxjuwLf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74960) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 12:28:44 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-d304d6c4-b626-47eb-bafb-a7d54e5ed97d tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:28:44 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-d304d6c4-b626-47eb-bafb-a7d54e5ed97d tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '23261393937353462', 'path': '/dev/sde'} {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:28:44 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d304d6c4-b626-47eb-bafb-a7d54e5ed97d tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] [instance: be38c803-d97c-4939-9852-e8db1c44bb65] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23261393937353462', 'path': '/dev/sde'} {{(pid=74960) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 12:28:44 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-6b6c149c-9182-4f9a-a495-b901be8f24cd tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.376s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:28:44 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:28:44 user nova-compute[74960]: DEBUG nova.objects.instance [None req-d304d6c4-b626-47eb-bafb-a7d54e5ed97d tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Lazy-loading 'flavor' on Instance uuid be38c803-d97c-4939-9852-e8db1c44bb65 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:28:45 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:28:45 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[c441335c-d7f9-4306-be1e-c06d67021029]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f33bebd3-3cc8-4db5-b35e-5d58d4dfe93f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9221d517-2219-40f2-bbcb-2c12097148bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:64cd7bb2-1477-431a-b084-4339f203980c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:28:45 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b6c149c-9182-4f9a-a495-b901be8f24cd tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 12:28:45 user nova-compute[74960]: No targets found.
Nov 03 12:28:45 user nova-compute[74960]: iSNS:
Nov 03 12:28:45 user nova-compute[74960]: No targets found.
Nov 03 12:28:45 user nova-compute[74960]: STATIC:
Nov 03 12:28:45 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:f33bebd3-3cc8-4db5-b35e-5d58d4dfe93f
Nov 03 12:28:45 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:28:45 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:28:45 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:9221d517-2219-40f2-bbcb-2c12097148bc
Nov 03 12:28:45 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:28:45 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:28:45 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:64cd7bb2-1477-431a-b084-4339f203980c
Nov 03 12:28:45 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:28:45 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:28:45 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2
Nov 03 12:28:45 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:28:45 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:28:45 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815
Nov 03 12:28:45 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:28:45 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:28:45 user nova-compute[74960]: FIRMWARE:
Nov 03 12:28:45 user nova-compute[74960]: No targets found.
Nov 03 12:28:45 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:28:45 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b6c149c-9182-4f9a-a495-b901be8f24cd tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 12:28:45 user nova-compute[74960]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 12:28:45 user nova-compute[74960]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74960) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 12:28:45 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b6c149c-9182-4f9a-a495-b901be8f24cd tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9221d517-2219-40f2-bbcb-2c12097148bc', 0)] {{(pid=74960) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 12:28:45 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:28:45 user nova-compute[74960]: DEBUG nova.virt.libvirt.guest [None req-d304d6c4-b626-47eb-bafb-a7d54e5ed97d tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] attach device xml: <disk type="block" device="disk">
Nov 03 12:28:45 user nova-compute[74960]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 12:28:45 user nova-compute[74960]:   <source dev="/dev/sde"/>
Nov 03 12:28:45 user nova-compute[74960]:   <target dev="vdb" bus="virtio"/>
Nov 03 12:28:45 user nova-compute[74960]:   <serial>f33bebd3-3cc8-4db5-b35e-5d58d4dfe93f</serial>
Nov 03 12:28:45 user nova-compute[74960]: </disk>
Nov 03 12:28:45 user nova-compute[74960]:  {{(pid=74960) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 03 12:28:45 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:28:45 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d65272e-c1d6-4a32-b223-fbeba5e6ca8d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64cd7bb2-1477-431a-b084-4339f203980c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9221d517-2219-40f2-bbcb-2c12097148bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f33bebd3-3cc8-4db5-b35e-5d58d4dfe93f\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:28:45 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:28:45 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:28:45 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d7e3290-0d7a-444a-89bc-28862e9a3f0c]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64cd7bb2-1477-431a-b084-4339f203980c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9221d517-2219-40f2-bbcb-2c12097148bc (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f33bebd3-3cc8-4db5-b35e-5d58d4dfe93f (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:28:45 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b6c149c-9182-4f9a-a495-b901be8f24cd tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815 (non-flash)
Nov 03 12:28:45 user nova-compute[74960]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64cd7bb2-1477-431a-b084-4339f203980c (non-flash)
Nov 03 12:28:45 user nova-compute[74960]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9221d517-2219-40f2-bbcb-2c12097148bc (non-flash)
Nov 03 12:28:45 user nova-compute[74960]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:28:45 user nova-compute[74960]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f33bebd3-3cc8-4db5-b35e-5d58d4dfe93f (non-flash)
Nov 03 12:28:45 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:28:45 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b6c149c-9182-4f9a-a495-b901be8f24cd tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815 (non-flash)
Nov 03 12:28:45 user nova-compute[74960]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64cd7bb2-1477-431a-b084-4339f203980c (non-flash)
Nov 03 12:28:45 user nova-compute[74960]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9221d517-2219-40f2-bbcb-2c12097148bc (non-flash)
Nov 03 12:28:45 user nova-compute[74960]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:28:45 user nova-compute[74960]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f33bebd3-3cc8-4db5-b35e-5d58d4dfe93f (non-flash)
Nov 03 12:28:45 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:28:45 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b6c149c-9182-4f9a-a495-b901be8f24cd tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9a8c47eb00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9221d517-2219-40f2-bbcb-2c12097148bc'): ({'sdc'}, set())}) {{(pid=74960) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 12:28:45 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-6b6c149c-9182-4f9a-a495-b901be8f24cd tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Removing single pathed devices sdc {{(pid=74960) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 12:28:45 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:28:45 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:28:45 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[013091ec-57e0-4b52-91a7-594b0649c559]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:28:45 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:28:45 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:28:45 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[1acafcf5-bcf0-4a63-8c7e-ebfe671bb010]: (4, ('ok\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:28:45 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-6b6c149c-9182-4f9a-a495-b901be8f24cd tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Flushing IO for device /dev/sdc {{(pid=74960) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 12:28:45 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:28:45 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:28:45 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[3932afec-17a3-4850-b6d5-b0e122afbd25]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:28:45 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-6b6c149c-9182-4f9a-a495-b901be8f24cd tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74960) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 12:28:45 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:28:45 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:28:45 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[56ad34ad-e4b3-4b6b-abd2-bbe4e05bf388]: (4, ('1', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:28:45 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-6b6c149c-9182-4f9a-a495-b901be8f24cd tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74960) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 12:28:45 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-6b6c149c-9182-4f9a-a495-b901be8f24cd tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] SCSI volumes sdc have been removed. {{(pid=74960) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 12:28:45 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b6c149c-9182-4f9a-a495-b901be8f24cd tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9221d517-2219-40f2-bbcb-2c12097148bc')] {{(pid=74960) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 12:28:45 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9221d517-2219-40f2-bbcb-2c12097148bc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:28:45 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9221d517-2219-40f2-bbcb-2c12097148bc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:28:45 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b844b9c-ad4a-4755-879a-0ae1c2751911]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:28:45 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b6c149c-9182-4f9a-a495-b901be8f24cd tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:28:45 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9221d517-2219-40f2-bbcb-2c12097148bc -p 172.16.0.220:3260 --logout {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:28:45 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9221d517-2219-40f2-bbcb-2c12097148bc -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:28:45 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[35032568-b5f6-4e1b-bfa0-181117826709]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:9221d517-2219-40f2-bbcb-2c12097148bc, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:9221d517-2219-40f2-bbcb-2c12097148bc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:28:45 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b6c149c-9182-4f9a-a495-b901be8f24cd tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:9221d517-2219-40f2-bbcb-2c12097148bc, portal: 172.16.0.220,3260]
Nov 03 12:28:45 user nova-compute[74960]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:9221d517-2219-40f2-bbcb-2c12097148bc, portal: 172.16.0.220,3260] successful.
Nov 03 12:28:45 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:28:45 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9221d517-2219-40f2-bbcb-2c12097148bc -p 172.16.0.220:3260 --op delete {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:28:45 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9221d517-2219-40f2-bbcb-2c12097148bc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:28:45 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[fde23426-9294-4e5c-aae8-738a2e8ea7ed]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:28:45 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b6c149c-9182-4f9a-a495-b901be8f24cd tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:28:45 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-6b6c149c-9182-4f9a-a495-b901be8f24cd tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.370s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:28:45 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b6c149c-9182-4f9a-a495-b901be8f24cd tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] <== disconnect_volume: return (745ms) None {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:28:45 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b6c149c-9182-4f9a-a495-b901be8f24cd tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] [instance: 7a33549f-51ea-42d0-8c8a-67d9c74784fd] Disconnected iSCSI Volume {{(pid=74960) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 12:28:45 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-d304d6c4-b626-47eb-bafb-a7d54e5ed97d tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] No BDM found with device name vda, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:28:45 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-d304d6c4-b626-47eb-bafb-a7d54e5ed97d tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:28:45 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-d304d6c4-b626-47eb-bafb-a7d54e5ed97d tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] No VIF found with MAC fa:16:3e:3f:59:21, not building metadata {{(pid=74960) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 12:28:45 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-d304d6c4-b626-47eb-bafb-a7d54e5ed97d tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Lock "be38c803-d97c-4939-9852-e8db1c44bb65" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.146s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:28:47 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:28:47 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Starting heal instance info cache {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 12:28:47 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Didn't find any instances for network info cache update. {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 03 12:28:47 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:28:48 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:28:48 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:28:48 user nova-compute[74960]: DEBUG nova.compute.manager [req-2f082314-57c8-4154-96ca-cff7b8c48cc4 req-c4a84669-d6d1-400b-9f87-ceeb1155c1c7 service nova] [instance: be38c803-d97c-4939-9852-e8db1c44bb65] Received event network-changed-b70bcefe-a1cc-4f5c-98f6-3d6914d66a9b {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:28:48 user nova-compute[74960]: DEBUG nova.compute.manager [req-2f082314-57c8-4154-96ca-cff7b8c48cc4 req-c4a84669-d6d1-400b-9f87-ceeb1155c1c7 service nova] [instance: be38c803-d97c-4939-9852-e8db1c44bb65] Refreshing instance network info cache due to event network-changed-b70bcefe-a1cc-4f5c-98f6-3d6914d66a9b. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 12:28:48 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-2f082314-57c8-4154-96ca-cff7b8c48cc4 req-c4a84669-d6d1-400b-9f87-ceeb1155c1c7 service nova] Acquiring lock "refresh_cache-be38c803-d97c-4939-9852-e8db1c44bb65" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:28:48 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-2f082314-57c8-4154-96ca-cff7b8c48cc4 req-c4a84669-d6d1-400b-9f87-ceeb1155c1c7 service nova] Acquired lock "refresh_cache-be38c803-d97c-4939-9852-e8db1c44bb65" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:28:48 user nova-compute[74960]: DEBUG nova.network.neutron [req-2f082314-57c8-4154-96ca-cff7b8c48cc4 req-c4a84669-d6d1-400b-9f87-ceeb1155c1c7 service nova] [instance: be38c803-d97c-4939-9852-e8db1c44bb65] Refreshing network info cache for port b70bcefe-a1cc-4f5c-98f6-3d6914d66a9b {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 12:28:49 user nova-compute[74960]: DEBUG nova.objects.instance [None req-6b6c149c-9182-4f9a-a495-b901be8f24cd tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Lazy-loading 'flavor' on Instance uuid 7a33549f-51ea-42d0-8c8a-67d9c74784fd {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:28:49 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-6b6c149c-9182-4f9a-a495-b901be8f24cd tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Lock "7a33549f-51ea-42d0-8c8a-67d9c74784fd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 25.282s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:28:49 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:28:49 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:28:49 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:28:49 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:28:49 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:28:49 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:28:49 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Auditing locally available compute resources for user (node: user) {{(pid=74960) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 12:28:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec0d7c3-a6bd-40a2-997a-5cdbe9436305/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:28:49 user nova-compute[74960]: DEBUG nova.network.neutron [req-2f082314-57c8-4154-96ca-cff7b8c48cc4 req-c4a84669-d6d1-400b-9f87-ceeb1155c1c7 service nova] [instance: be38c803-d97c-4939-9852-e8db1c44bb65] Updated VIF entry in instance network info cache for port b70bcefe-a1cc-4f5c-98f6-3d6914d66a9b. {{(pid=74960) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 12:28:49 user nova-compute[74960]: DEBUG nova.network.neutron [req-2f082314-57c8-4154-96ca-cff7b8c48cc4 req-c4a84669-d6d1-400b-9f87-ceeb1155c1c7 service nova] [instance: be38c803-d97c-4939-9852-e8db1c44bb65] Updating instance_info_cache with network_info: [{"id": "b70bcefe-a1cc-4f5c-98f6-3d6914d66a9b", "address": "fa:16:3e:3f:59:21", "network": {"id": "b3813163-d09b-4c0b-a328-1bbb4c7e2875", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1681555035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d4a374c1c544718887bd75b77a72a3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb70bcefe-a1", "ovs_interfaceid": "b70bcefe-a1cc-4f5c-98f6-3d6914d66a9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:28:49 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-2f082314-57c8-4154-96ca-cff7b8c48cc4 req-c4a84669-d6d1-400b-9f87-ceeb1155c1c7 service nova] Releasing lock "refresh_cache-be38c803-d97c-4939-9852-e8db1c44bb65" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:28:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec0d7c3-a6bd-40a2-997a-5cdbe9436305/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:28:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec0d7c3-a6bd-40a2-997a-5cdbe9436305/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:28:50 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec0d7c3-a6bd-40a2-997a-5cdbe9436305/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:28:50 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9951fab7-4984-408e-94ca-11eab615ff25/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:28:50 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-a9cdab38-9560-4a4d-aee8-6c28a88495a9 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] Acquiring lock "4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:28:50 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-a9cdab38-9560-4a4d-aee8-6c28a88495a9 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] Lock "4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:28:50 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-a9cdab38-9560-4a4d-aee8-6c28a88495a9 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] Acquiring lock "4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:28:50 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-a9cdab38-9560-4a4d-aee8-6c28a88495a9 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] Lock "4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:28:50 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-a9cdab38-9560-4a4d-aee8-6c28a88495a9 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] Lock "4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:28:50 user nova-compute[74960]: INFO nova.compute.manager [None req-a9cdab38-9560-4a4d-aee8-6c28a88495a9 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] [instance: 4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8] Terminating instance
Nov 03 12:28:50 user nova-compute[74960]: DEBUG nova.compute.manager [None req-a9cdab38-9560-4a4d-aee8-6c28a88495a9 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] [instance: 4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8] Start destroying the instance on the hypervisor. {{(pid=74960) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 12:28:50 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:28:50 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9951fab7-4984-408e-94ca-11eab615ff25/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:28:50 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9951fab7-4984-408e-94ca-11eab615ff25/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:28:50 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:28:50 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:28:50 user nova-compute[74960]: DEBUG nova.compute.manager [req-052394bd-28d6-4253-b2ab-996cfe32d40b req-d4e6a6b7-05ff-4dbc-9044-db78e78ac5d0 service nova] [instance: 4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8] Received event network-vif-unplugged-c3166a00-dc11-448b-8d36-fdf64043f186 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:28:50 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-052394bd-28d6-4253-b2ab-996cfe32d40b req-d4e6a6b7-05ff-4dbc-9044-db78e78ac5d0 service nova] Acquiring lock "4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:28:50 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-052394bd-28d6-4253-b2ab-996cfe32d40b req-d4e6a6b7-05ff-4dbc-9044-db78e78ac5d0 service nova] Lock "4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:28:50 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-052394bd-28d6-4253-b2ab-996cfe32d40b req-d4e6a6b7-05ff-4dbc-9044-db78e78ac5d0 service nova] Lock "4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:28:50 user nova-compute[74960]: DEBUG nova.compute.manager [req-052394bd-28d6-4253-b2ab-996cfe32d40b req-d4e6a6b7-05ff-4dbc-9044-db78e78ac5d0 service nova] [instance: 4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8] No waiting events found dispatching network-vif-unplugged-c3166a00-dc11-448b-8d36-fdf64043f186 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:28:50 user nova-compute[74960]: DEBUG nova.compute.manager [req-052394bd-28d6-4253-b2ab-996cfe32d40b req-d4e6a6b7-05ff-4dbc-9044-db78e78ac5d0 service nova] [instance: 4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8] Received event network-vif-unplugged-c3166a00-dc11-448b-8d36-fdf64043f186 for instance with task_state deleting. {{(pid=74960) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 12:28:50 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9951fab7-4984-408e-94ca-11eab615ff25/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:28:50 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:28:50 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:28:50 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:28:50 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: 4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8] Instance destroyed successfully.
Nov 03 12:28:50 user nova-compute[74960]: DEBUG nova.objects.instance [None req-a9cdab38-9560-4a4d-aee8-6c28a88495a9 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] Lazy-loading 'resources' on Instance uuid 4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:28:50 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:28:50 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-a9cdab38-9560-4a4d-aee8-6c28a88495a9 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:26:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-2083477859',display_name='tempest-VolumesNegativeTest-instance-2083477859',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-2083477859',id=23,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-03T12:27:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f4eecbf67d5f42a5bd652c35460c5bdb',ramdisk_id='',reservation_id='r-7xv6egl8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-188495882',owner_user_name='tempest-VolumesNegativeTest-188495882-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T12:27:07Z,user_data=None,user_id='69d2653507ea4a98a65a484fc21c6dbf',uuid=4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c3166a00-dc11-448b-8d36-fdf64043f186", "address": "fa:16:3e:4f:76:01", "network": {"id": "f8cfc91c-2af0-409c-b7cc-8845ec47b4d5", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "63ee9c80c632442fb0379f47b784bd20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3166a00-dc", "ovs_interfaceid": "c3166a00-dc11-448b-8d36-fdf64043f186", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 12:28:50 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-a9cdab38-9560-4a4d-aee8-6c28a88495a9 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] Converting VIF {"id": "c3166a00-dc11-448b-8d36-fdf64043f186", "address": "fa:16:3e:4f:76:01", "network": {"id": "f8cfc91c-2af0-409c-b7cc-8845ec47b4d5", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "63ee9c80c632442fb0379f47b784bd20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3166a00-dc", "ovs_interfaceid": "c3166a00-dc11-448b-8d36-fdf64043f186", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:28:50 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-a9cdab38-9560-4a4d-aee8-6c28a88495a9 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:76:01,bridge_name='br-int',has_traffic_filtering=True,id=c3166a00-dc11-448b-8d36-fdf64043f186,network=Network(f8cfc91c-2af0-409c-b7cc-8845ec47b4d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3166a00-dc') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:28:50 user nova-compute[74960]: DEBUG os_vif [None req-a9cdab38-9560-4a4d-aee8-6c28a88495a9 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:76:01,bridge_name='br-int',has_traffic_filtering=True,id=c3166a00-dc11-448b-8d36-fdf64043f186,network=Network(f8cfc91c-2af0-409c-b7cc-8845ec47b4d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3166a00-dc') {{(pid=74960) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 12:28:50 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:28:50 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc3166a00-dc, bridge=br-int, if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:28:50 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:28:50 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:28:50 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:28:50 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4b4b4136-a0e0-4dda-8296-c8d576d4b0cb) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:28:50 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:28:50 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7769e3c5-136f-4282-8e3e-224e3a80922c/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:28:51 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:28:51 user nova-compute[74960]: INFO os_vif [None req-a9cdab38-9560-4a4d-aee8-6c28a88495a9 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:76:01,bridge_name='br-int',has_traffic_filtering=True,id=c3166a00-dc11-448b-8d36-fdf64043f186,network=Network(f8cfc91c-2af0-409c-b7cc-8845ec47b4d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3166a00-dc')
Nov 03 12:28:51 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-a9cdab38-9560-4a4d-aee8-6c28a88495a9 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] [instance: 4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8] Deleting instance files /opt/stack/data/nova/instances/4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8_del
Nov 03 12:28:51 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-a9cdab38-9560-4a4d-aee8-6c28a88495a9 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] [instance: 4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8] Deletion of /opt/stack/data/nova/instances/4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8_del complete
Nov 03 12:28:51 user nova-compute[74960]: INFO nova.compute.manager [None req-a9cdab38-9560-4a4d-aee8-6c28a88495a9 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] [instance: 4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8] Took 1.01 seconds to destroy the instance on the hypervisor.
Nov 03 12:28:51 user nova-compute[74960]: DEBUG oslo.service.loopingcall [None req-a9cdab38-9560-4a4d-aee8-6c28a88495a9 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74960) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 12:28:51 user nova-compute[74960]: DEBUG nova.compute.manager [-] [instance: 4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8] Deallocating network for instance {{(pid=74960) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 12:28:51 user nova-compute[74960]: DEBUG nova.network.neutron [-] [instance: 4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8] deallocate_for_instance() {{(pid=74960) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 12:28:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7769e3c5-136f-4282-8e3e-224e3a80922c/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:28:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7769e3c5-136f-4282-8e3e-224e3a80922c/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:28:51 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-c1d0e32e-f83f-4e2e-a5f4-4962091e6938 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f009a400-0576-48a9-82e0-60de8935c498 is timed out.
Nov 03 12:28:51 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-c1d0e32e-f83f-4e2e-a5f4-4962091e6938 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Successfully detached device vdb from instance f009a400-0576-48a9-82e0-60de8935c498 from the live domain config.
Nov 03 12:28:51 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1d0e32e-f83f-4e2e-a5f4-4962091e6938 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] [instance: f009a400-0576-48a9-82e0-60de8935c498] calling os-brick to detach iSCSI Volume {{(pid=74960) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 12:28:51 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d0e32e-f83f-4e2e-a5f4-4962091e6938 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9aa420acb0>, {'target_iqn': 'iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QDgJxOCT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:28:51 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-c1d0e32e-f83f-4e2e-a5f4-4962091e6938 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:28:51 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-c1d0e32e-f83f-4e2e-a5f4-4962091e6938 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:28:51 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-c1d0e32e-f83f-4e2e-a5f4-4962091e6938 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:28:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:28:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:28:51 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[c949639a-f14a-4f5a-8ee9-913d31bc8c53]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f33bebd3-3cc8-4db5-b35e-5d58d4dfe93f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:64cd7bb2-1477-431a-b084-4339f203980c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:28:51 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d0e32e-f83f-4e2e-a5f4-4962091e6938 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 12:28:51 user nova-compute[74960]: No targets found.
Nov 03 12:28:51 user nova-compute[74960]: iSNS:
Nov 03 12:28:51 user nova-compute[74960]: No targets found.
Nov 03 12:28:51 user nova-compute[74960]: STATIC:
Nov 03 12:28:51 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:f33bebd3-3cc8-4db5-b35e-5d58d4dfe93f
Nov 03 12:28:51 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:28:51 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:28:51 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:64cd7bb2-1477-431a-b084-4339f203980c
Nov 03 12:28:51 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:28:51 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:28:51 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2
Nov 03 12:28:51 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:28:51 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:28:51 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815
Nov 03 12:28:51 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:28:51 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:28:51 user nova-compute[74960]: FIRMWARE:
Nov 03 12:28:51 user nova-compute[74960]: No targets found.
Nov 03 12:28:51 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:28:51 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d0e32e-f83f-4e2e-a5f4-4962091e6938 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 12:28:51 user nova-compute[74960]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 12:28:51 user nova-compute[74960]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74960) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 12:28:51 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d0e32e-f83f-4e2e-a5f4-4962091e6938 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815', 0)] {{(pid=74960) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 12:28:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:28:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:28:51 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[ced093a5-8739-43a0-8086-8c7bb1a3ae1e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64cd7bb2-1477-431a-b084-4339f203980c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f33bebd3-3cc8-4db5-b35e-5d58d4dfe93f\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:28:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:28:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7769e3c5-136f-4282-8e3e-224e3a80922c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:28:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be38c803-d97c-4939-9852-e8db1c44bb65/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:28:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:28:51 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[78951b4c-e696-4d46-8d99-31b3ca345c49]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64cd7bb2-1477-431a-b084-4339f203980c (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f33bebd3-3cc8-4db5-b35e-5d58d4dfe93f (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:28:51 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d0e32e-f83f-4e2e-a5f4-4962091e6938 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815 (non-flash)
Nov 03 12:28:51 user nova-compute[74960]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64cd7bb2-1477-431a-b084-4339f203980c (non-flash)
Nov 03 12:28:51 user nova-compute[74960]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:28:51 user nova-compute[74960]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f33bebd3-3cc8-4db5-b35e-5d58d4dfe93f (non-flash)
Nov 03 12:28:51 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:28:51 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d0e32e-f83f-4e2e-a5f4-4962091e6938 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815 (non-flash)
Nov 03 12:28:51 user nova-compute[74960]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64cd7bb2-1477-431a-b084-4339f203980c (non-flash)
Nov 03 12:28:51 user nova-compute[74960]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:28:51 user nova-compute[74960]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f33bebd3-3cc8-4db5-b35e-5d58d4dfe93f (non-flash)
Nov 03 12:28:51 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:28:51 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d0e32e-f83f-4e2e-a5f4-4962091e6938 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9aac4fde10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815'): ({'sdf'}, set())}) {{(pid=74960) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 12:28:51 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-c1d0e32e-f83f-4e2e-a5f4-4962091e6938 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Removing single pathed devices sdf {{(pid=74960) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 12:28:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:28:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:28:51 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[81b58855-e0e6-4bd9-a8ca-5b0b2d4beb39]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:28:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:28:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.026s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:28:51 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d2145a-0dba-4ef2-86ec-71062c348d1b]: (4, ('ok\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:28:51 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-c1d0e32e-f83f-4e2e-a5f4-4962091e6938 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Flushing IO for device /dev/sdf {{(pid=74960) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 12:28:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:28:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:28:51 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ed2a0b5-f4d4-46d8-89a9-28da6e1ac334]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:28:51 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-c1d0e32e-f83f-4e2e-a5f4-4962091e6938 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74960) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 12:28:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:28:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.041s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:28:51 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[0efffcb7-9edf-425a-a33e-f26b2eae0daf]: (4, ('1', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:28:51 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-c1d0e32e-f83f-4e2e-a5f4-4962091e6938 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74960) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 12:28:51 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-c1d0e32e-f83f-4e2e-a5f4-4962091e6938 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] SCSI volumes sdf have been removed. {{(pid=74960) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 12:28:51 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d0e32e-f83f-4e2e-a5f4-4962091e6938 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815')] {{(pid=74960) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 12:28:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:28:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:28:51 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[70f9b3de-4281-4a22-8c52-08564f6339cc]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:28:51 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d0e32e-f83f-4e2e-a5f4-4962091e6938 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:28:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815 -p 172.16.0.220:3260 --logout {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:28:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be38c803-d97c-4939-9852-e8db1c44bb65/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:28:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be38c803-d97c-4939-9852-e8db1c44bb65/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:28:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:28:51 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[3af97b13-512c-4579-b425-c372b5ff97f1]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:28:51 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d0e32e-f83f-4e2e-a5f4-4962091e6938 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815, portal: 172.16.0.220,3260]
Nov 03 12:28:51 user nova-compute[74960]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815, portal: 172.16.0.220,3260] successful.
Nov 03 12:28:51 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:28:51 user nova-compute[74960]: DEBUG nova.network.neutron [-] [instance: 4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8] Updating instance_info_cache with network_info: [] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:28:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815 -p 172.16.0.220:3260 --op delete {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:28:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9101c521-a24b-4b03-b2b1-d73585222815 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:28:51 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6c5b3db-2fcc-4121-9e20-ac7a8efa4106]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:28:51 user nova-compute[74960]: INFO nova.compute.manager [-] [instance: 4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8] Took 0.55 seconds to deallocate network for instance.
Nov 03 12:28:51 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d0e32e-f83f-4e2e-a5f4-4962091e6938 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:28:51 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-c1d0e32e-f83f-4e2e-a5f4-4962091e6938 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.386s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:28:51 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d0e32e-f83f-4e2e-a5f4-4962091e6938 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] <== disconnect_volume: return (387ms) None {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:28:51 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1d0e32e-f83f-4e2e-a5f4-4962091e6938 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] [instance: f009a400-0576-48a9-82e0-60de8935c498] Disconnected iSCSI Volume {{(pid=74960) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 12:28:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be38c803-d97c-4939-9852-e8db1c44bb65/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:28:51 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74960) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 12:28:51 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-a9cdab38-9560-4a4d-aee8-6c28a88495a9 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:28:51 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-a9cdab38-9560-4a4d-aee8-6c28a88495a9 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:28:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fffd1dd7-b8e8-435c-bdfe-6c5001b21daf/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:28:52 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fffd1dd7-b8e8-435c-bdfe-6c5001b21daf/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:28:52 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fffd1dd7-b8e8-435c-bdfe-6c5001b21daf/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:28:52 user nova-compute[74960]: DEBUG nova.compute.manager [req-7a1c44c3-99e1-4bcc-a2d1-e7821e0fbdaa req-4914dbb7-4530-4286-8974-08568caaa4f5 service nova] [instance: be38c803-d97c-4939-9852-e8db1c44bb65] Received event network-changed-b70bcefe-a1cc-4f5c-98f6-3d6914d66a9b {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:28:52 user nova-compute[74960]: DEBUG nova.compute.manager [req-7a1c44c3-99e1-4bcc-a2d1-e7821e0fbdaa req-4914dbb7-4530-4286-8974-08568caaa4f5 service nova] [instance: be38c803-d97c-4939-9852-e8db1c44bb65] Refreshing instance network info cache due to event network-changed-b70bcefe-a1cc-4f5c-98f6-3d6914d66a9b. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 12:28:52 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-7a1c44c3-99e1-4bcc-a2d1-e7821e0fbdaa req-4914dbb7-4530-4286-8974-08568caaa4f5 service nova] Acquiring lock "refresh_cache-be38c803-d97c-4939-9852-e8db1c44bb65" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:28:52 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-7a1c44c3-99e1-4bcc-a2d1-e7821e0fbdaa req-4914dbb7-4530-4286-8974-08568caaa4f5 service nova] Acquired lock "refresh_cache-be38c803-d97c-4939-9852-e8db1c44bb65" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:28:52 user nova-compute[74960]: DEBUG nova.network.neutron [req-7a1c44c3-99e1-4bcc-a2d1-e7821e0fbdaa req-4914dbb7-4530-4286-8974-08568caaa4f5 service nova] [instance: be38c803-d97c-4939-9852-e8db1c44bb65] Refreshing network info cache for port b70bcefe-a1cc-4f5c-98f6-3d6914d66a9b {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 12:28:52 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fffd1dd7-b8e8-435c-bdfe-6c5001b21daf/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:28:52 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f15f5f-8afa-4d7b-bb45-5887184f9ee5/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:28:52 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-a9cdab38-9560-4a4d-aee8-6c28a88495a9 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:28:52 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-a9cdab38-9560-4a4d-aee8-6c28a88495a9 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:28:52 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-a9cdab38-9560-4a4d-aee8-6c28a88495a9 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.586s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:28:52 user nova-compute[74960]: INFO nova.scheduler.client.report [None req-a9cdab38-9560-4a4d-aee8-6c28a88495a9 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] Deleted allocations for instance 4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8
Nov 03 12:28:52 user nova-compute[74960]: DEBUG nova.compute.manager [req-92a61b5e-02fd-4401-b705-061205f87a87 req-a6885e3f-6f11-44d6-abcb-ae448ccccece service nova] [instance: 4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8] Received event network-vif-plugged-c3166a00-dc11-448b-8d36-fdf64043f186 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:28:52 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-92a61b5e-02fd-4401-b705-061205f87a87 req-a6885e3f-6f11-44d6-abcb-ae448ccccece service nova] Acquiring lock "4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:28:52 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-92a61b5e-02fd-4401-b705-061205f87a87 req-a6885e3f-6f11-44d6-abcb-ae448ccccece service nova] Lock "4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:28:52 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-92a61b5e-02fd-4401-b705-061205f87a87 req-a6885e3f-6f11-44d6-abcb-ae448ccccece service nova] Lock "4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:28:52 user nova-compute[74960]: DEBUG nova.compute.manager [req-92a61b5e-02fd-4401-b705-061205f87a87 req-a6885e3f-6f11-44d6-abcb-ae448ccccece service nova] [instance: 4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8] No waiting events found dispatching network-vif-plugged-c3166a00-dc11-448b-8d36-fdf64043f186 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:28:52 user nova-compute[74960]: WARNING nova.compute.manager [req-92a61b5e-02fd-4401-b705-061205f87a87 req-a6885e3f-6f11-44d6-abcb-ae448ccccece service nova] [instance: 4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8] Received unexpected event network-vif-plugged-c3166a00-dc11-448b-8d36-fdf64043f186 for instance with vm_state deleted and task_state None.
Nov 03 12:28:52 user nova-compute[74960]: DEBUG nova.compute.manager [req-92a61b5e-02fd-4401-b705-061205f87a87 req-a6885e3f-6f11-44d6-abcb-ae448ccccece service nova] [instance: 4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8] Received event network-vif-deleted-c3166a00-dc11-448b-8d36-fdf64043f186 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:28:52 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f15f5f-8afa-4d7b-bb45-5887184f9ee5/disk --force-share --output=json" returned: 0 in 0.268s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:28:52 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f15f5f-8afa-4d7b-bb45-5887184f9ee5/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:28:52 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-a9cdab38-9560-4a4d-aee8-6c28a88495a9 tempest-VolumesNegativeTest-188495882 tempest-VolumesNegativeTest-188495882-project-member] Lock "4f6e8b51-bf82-4c01-81e6-4bc1136c7ae8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.472s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:28:52 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-8ee74a7b-d665-49fa-8458-78580003a5e9 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Acquiring lock "be38c803-d97c-4939-9852-e8db1c44bb65" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:28:52 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-8ee74a7b-d665-49fa-8458-78580003a5e9 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Lock "be38c803-d97c-4939-9852-e8db1c44bb65" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:28:52 user nova-compute[74960]: INFO nova.compute.manager [None req-8ee74a7b-d665-49fa-8458-78580003a5e9 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] [instance: be38c803-d97c-4939-9852-e8db1c44bb65] Rebooting instance
Nov 03 12:28:52 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f15f5f-8afa-4d7b-bb45-5887184f9ee5/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:28:52 user nova-compute[74960]: DEBUG nova.objects.instance [None req-c1d0e32e-f83f-4e2e-a5f4-4962091e6938 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Lazy-loading 'flavor' on Instance uuid f009a400-0576-48a9-82e0-60de8935c498 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:28:52 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6cbb630-254f-4c56-9cf9-47d751c703be/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:28:52 user nova-compute[74960]: DEBUG nova.network.neutron [req-7a1c44c3-99e1-4bcc-a2d1-e7821e0fbdaa req-4914dbb7-4530-4286-8974-08568caaa4f5 service nova] [instance: be38c803-d97c-4939-9852-e8db1c44bb65] Updated VIF entry in instance network info cache for port b70bcefe-a1cc-4f5c-98f6-3d6914d66a9b. {{(pid=74960) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 12:28:52 user nova-compute[74960]: DEBUG nova.network.neutron [req-7a1c44c3-99e1-4bcc-a2d1-e7821e0fbdaa req-4914dbb7-4530-4286-8974-08568caaa4f5 service nova] [instance: be38c803-d97c-4939-9852-e8db1c44bb65] Updating instance_info_cache with network_info: [{"id": "b70bcefe-a1cc-4f5c-98f6-3d6914d66a9b", "address": "fa:16:3e:3f:59:21", "network": {"id": "b3813163-d09b-4c0b-a328-1bbb4c7e2875", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1681555035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d4a374c1c544718887bd75b77a72a3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb70bcefe-a1", "ovs_interfaceid": "b70bcefe-a1cc-4f5c-98f6-3d6914d66a9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:28:52 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-7a1c44c3-99e1-4bcc-a2d1-e7821e0fbdaa req-4914dbb7-4530-4286-8974-08568caaa4f5 service nova] Releasing lock "refresh_cache-be38c803-d97c-4939-9852-e8db1c44bb65" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:28:52 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c1d0e32e-f83f-4e2e-a5f4-4962091e6938 tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Lock "f009a400-0576-48a9-82e0-60de8935c498" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.190s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:28:52 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-8ee74a7b-d665-49fa-8458-78580003a5e9 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Acquiring lock "refresh_cache-be38c803-d97c-4939-9852-e8db1c44bb65" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:28:52 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-8ee74a7b-d665-49fa-8458-78580003a5e9 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Acquired lock "refresh_cache-be38c803-d97c-4939-9852-e8db1c44bb65" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:28:52 user nova-compute[74960]: DEBUG nova.network.neutron [None req-8ee74a7b-d665-49fa-8458-78580003a5e9 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] [instance: be38c803-d97c-4939-9852-e8db1c44bb65] Building network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 12:28:52 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6cbb630-254f-4c56-9cf9-47d751c703be/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:28:52 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6cbb630-254f-4c56-9cf9-47d751c703be/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:28:53 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:28:53 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6cbb630-254f-4c56-9cf9-47d751c703be/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:28:53 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f009a400-0576-48a9-82e0-60de8935c498/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:28:53 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f009a400-0576-48a9-82e0-60de8935c498/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:28:53 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f009a400-0576-48a9-82e0-60de8935c498/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:28:53 user nova-compute[74960]: DEBUG nova.network.neutron [None req-8ee74a7b-d665-49fa-8458-78580003a5e9 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] [instance: be38c803-d97c-4939-9852-e8db1c44bb65] Updating instance_info_cache with network_info: [{"id": "b70bcefe-a1cc-4f5c-98f6-3d6914d66a9b", "address": "fa:16:3e:3f:59:21", "network": {"id": "b3813163-d09b-4c0b-a328-1bbb4c7e2875", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1681555035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d4a374c1c544718887bd75b77a72a3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb70bcefe-a1", "ovs_interfaceid": "b70bcefe-a1cc-4f5c-98f6-3d6914d66a9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:28:53 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-8ee74a7b-d665-49fa-8458-78580003a5e9 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Releasing lock "refresh_cache-be38c803-d97c-4939-9852-e8db1c44bb65" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:28:53 user nova-compute[74960]: DEBUG nova.compute.manager [None req-8ee74a7b-d665-49fa-8458-78580003a5e9 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] [instance: be38c803-d97c-4939-9852-e8db1c44bb65] Checking state {{(pid=74960) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 12:28:53 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f009a400-0576-48a9-82e0-60de8935c498/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:28:53 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74960) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 12:28:53 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a33549f-51ea-42d0-8c8a-67d9c74784fd/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:28:53 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a33549f-51ea-42d0-8c8a-67d9c74784fd/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:28:53 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a33549f-51ea-42d0-8c8a-67d9c74784fd/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:28:54 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a33549f-51ea-42d0-8c8a-67d9c74784fd/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:28:54 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74960) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 12:28:54 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:28:54 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:28:54 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Hypervisor/Node resource view: name=user free_ram=7425MB free_disk=24.929401397705078GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74960) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 12:28:54 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:28:54 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:28:54 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 7769e3c5-136f-4282-8e3e-224e3a80922c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:28:54 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance fffd1dd7-b8e8-435c-bdfe-6c5001b21daf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:28:54 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance f009a400-0576-48a9-82e0-60de8935c498 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:28:54 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 9951fab7-4984-408e-94ca-11eab615ff25 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:28:54 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 87f15f5f-8afa-4d7b-bb45-5887184f9ee5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:28:54 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 7a33549f-51ea-42d0-8c8a-67d9c74784fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:28:54 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance be38c803-d97c-4939-9852-e8db1c44bb65 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:28:54 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 7ec0d7c3-a6bd-40a2-997a-5cdbe9436305 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:28:54 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance a6199681-f85e-4f55-966b-6ab3f17cd640 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:28:54 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance e6cbb630-254f-4c56-9cf9-47d751c703be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:28:54 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74960) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 12:28:54 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74960) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 12:28:54 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:28:54 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:28:55 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Compute_service record updated for user:user {{(pid=74960) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 12:28:55 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.556s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:28:55 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:28:55 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:28:55 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:28:55 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:28:56 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:28:56 user nova-compute[74960]: DEBUG nova.compute.manager [req-1084412b-47da-4a6e-ab2a-587d7a842876 req-d9670030-fdf9-4b7c-b3a1-0dfb6121ce87 service nova] [instance: be38c803-d97c-4939-9852-e8db1c44bb65] Received event network-vif-unplugged-b70bcefe-a1cc-4f5c-98f6-3d6914d66a9b {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:28:56 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-1084412b-47da-4a6e-ab2a-587d7a842876 req-d9670030-fdf9-4b7c-b3a1-0dfb6121ce87 service nova] Acquiring lock "be38c803-d97c-4939-9852-e8db1c44bb65-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:28:56 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-1084412b-47da-4a6e-ab2a-587d7a842876 req-d9670030-fdf9-4b7c-b3a1-0dfb6121ce87 service nova] Lock "be38c803-d97c-4939-9852-e8db1c44bb65-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:28:56 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-1084412b-47da-4a6e-ab2a-587d7a842876 req-d9670030-fdf9-4b7c-b3a1-0dfb6121ce87 service nova] Lock "be38c803-d97c-4939-9852-e8db1c44bb65-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:28:56 user nova-compute[74960]: DEBUG nova.compute.manager [req-1084412b-47da-4a6e-ab2a-587d7a842876 req-d9670030-fdf9-4b7c-b3a1-0dfb6121ce87 service nova] [instance: be38c803-d97c-4939-9852-e8db1c44bb65] No waiting events found dispatching network-vif-unplugged-b70bcefe-a1cc-4f5c-98f6-3d6914d66a9b {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:28:56 user nova-compute[74960]: WARNING nova.compute.manager [req-1084412b-47da-4a6e-ab2a-587d7a842876 req-d9670030-fdf9-4b7c-b3a1-0dfb6121ce87 service nova] [instance: be38c803-d97c-4939-9852-e8db1c44bb65] Received unexpected event network-vif-unplugged-b70bcefe-a1cc-4f5c-98f6-3d6914d66a9b for instance with vm_state active and task_state reboot_started.
Nov 03 12:28:56 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-8ee74a7b-d665-49fa-8458-78580003a5e9 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] [instance: be38c803-d97c-4939-9852-e8db1c44bb65] Instance shutdown successfully.
Nov 03 12:28:57 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:28:57 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74960) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 12:28:58 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:28:58 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:28:58 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:28:58 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:28:58 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:28:58 user nova-compute[74960]: DEBUG nova.compute.manager [req-9c81d0b3-817a-45dc-9f98-a76d74179bf9 req-491f78ee-1ee2-4117-af34-af7f29354393 service nova] [instance: be38c803-d97c-4939-9852-e8db1c44bb65] Received event network-vif-plugged-b70bcefe-a1cc-4f5c-98f6-3d6914d66a9b {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:28:58 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-9c81d0b3-817a-45dc-9f98-a76d74179bf9 req-491f78ee-1ee2-4117-af34-af7f29354393 service nova] Acquiring lock "be38c803-d97c-4939-9852-e8db1c44bb65-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:28:58 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-9c81d0b3-817a-45dc-9f98-a76d74179bf9 req-491f78ee-1ee2-4117-af34-af7f29354393 service nova] Lock "be38c803-d97c-4939-9852-e8db1c44bb65-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:28:58 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-9c81d0b3-817a-45dc-9f98-a76d74179bf9 req-491f78ee-1ee2-4117-af34-af7f29354393 service nova] Lock "be38c803-d97c-4939-9852-e8db1c44bb65-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:28:58 user nova-compute[74960]: DEBUG nova.compute.manager [req-9c81d0b3-817a-45dc-9f98-a76d74179bf9 req-491f78ee-1ee2-4117-af34-af7f29354393 service nova] [instance: be38c803-d97c-4939-9852-e8db1c44bb65] No waiting events found dispatching network-vif-plugged-b70bcefe-a1cc-4f5c-98f6-3d6914d66a9b {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:28:58 user nova-compute[74960]: WARNING nova.compute.manager [req-9c81d0b3-817a-45dc-9f98-a76d74179bf9 req-491f78ee-1ee2-4117-af34-af7f29354393 service nova] [instance: be38c803-d97c-4939-9852-e8db1c44bb65] Received unexpected event network-vif-plugged-b70bcefe-a1cc-4f5c-98f6-3d6914d66a9b for instance with vm_state active and task_state reboot_started.
Nov 03 12:28:58 user nova-compute[74960]: DEBUG nova.compute.manager [req-9c81d0b3-817a-45dc-9f98-a76d74179bf9 req-491f78ee-1ee2-4117-af34-af7f29354393 service nova] [instance: be38c803-d97c-4939-9852-e8db1c44bb65] Received event network-vif-plugged-b70bcefe-a1cc-4f5c-98f6-3d6914d66a9b {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:28:58 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-9c81d0b3-817a-45dc-9f98-a76d74179bf9 req-491f78ee-1ee2-4117-af34-af7f29354393 service nova] Acquiring lock "be38c803-d97c-4939-9852-e8db1c44bb65-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:28:58 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-9c81d0b3-817a-45dc-9f98-a76d74179bf9 req-491f78ee-1ee2-4117-af34-af7f29354393 service nova] Lock "be38c803-d97c-4939-9852-e8db1c44bb65-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:28:58 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-9c81d0b3-817a-45dc-9f98-a76d74179bf9 req-491f78ee-1ee2-4117-af34-af7f29354393 service nova] Lock "be38c803-d97c-4939-9852-e8db1c44bb65-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:28:58 user nova-compute[74960]: DEBUG nova.compute.manager [req-9c81d0b3-817a-45dc-9f98-a76d74179bf9 req-491f78ee-1ee2-4117-af34-af7f29354393 service nova] [instance: be38c803-d97c-4939-9852-e8db1c44bb65] No waiting events found dispatching network-vif-plugged-b70bcefe-a1cc-4f5c-98f6-3d6914d66a9b {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:28:58 user nova-compute[74960]: WARNING nova.compute.manager [req-9c81d0b3-817a-45dc-9f98-a76d74179bf9 req-491f78ee-1ee2-4117-af34-af7f29354393 service nova] [instance: be38c803-d97c-4939-9852-e8db1c44bb65] Received unexpected event network-vif-plugged-b70bcefe-a1cc-4f5c-98f6-3d6914d66a9b for instance with vm_state active and task_state reboot_started.
Nov 03 12:28:58 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:28:58 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:28:58 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:29:00 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: be38c803-d97c-4939-9852-e8db1c44bb65] Instance running successfully.
Nov 03 12:29:00 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-8ee74a7b-d665-49fa-8458-78580003a5e9 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] [instance: be38c803-d97c-4939-9852-e8db1c44bb65] Instance soft rebooted successfully.
Nov 03 12:29:00 user nova-compute[74960]: DEBUG nova.compute.manager [None req-8ee74a7b-d665-49fa-8458-78580003a5e9 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] [instance: be38c803-d97c-4939-9852-e8db1c44bb65] Checking state {{(pid=74960) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 12:29:00 user nova-compute[74960]: DEBUG nova.compute.manager [req-2337cffc-5def-4eab-9913-77e41334aa26 req-f52630f3-3bd4-4a2f-ab1b-2f6019103a6b service nova] [instance: be38c803-d97c-4939-9852-e8db1c44bb65] Received event network-vif-plugged-b70bcefe-a1cc-4f5c-98f6-3d6914d66a9b {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:29:00 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-2337cffc-5def-4eab-9913-77e41334aa26 req-f52630f3-3bd4-4a2f-ab1b-2f6019103a6b service nova] Acquiring lock "be38c803-d97c-4939-9852-e8db1c44bb65-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:29:00 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-2337cffc-5def-4eab-9913-77e41334aa26 req-f52630f3-3bd4-4a2f-ab1b-2f6019103a6b service nova] Lock "be38c803-d97c-4939-9852-e8db1c44bb65-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:29:00 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-2337cffc-5def-4eab-9913-77e41334aa26 req-f52630f3-3bd4-4a2f-ab1b-2f6019103a6b service nova] Lock "be38c803-d97c-4939-9852-e8db1c44bb65-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:29:00 user nova-compute[74960]: DEBUG nova.compute.manager [req-2337cffc-5def-4eab-9913-77e41334aa26 req-f52630f3-3bd4-4a2f-ab1b-2f6019103a6b service nova] [instance: be38c803-d97c-4939-9852-e8db1c44bb65] No waiting events found dispatching network-vif-plugged-b70bcefe-a1cc-4f5c-98f6-3d6914d66a9b {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:29:00 user nova-compute[74960]: WARNING nova.compute.manager [req-2337cffc-5def-4eab-9913-77e41334aa26 req-f52630f3-3bd4-4a2f-ab1b-2f6019103a6b service nova] [instance: be38c803-d97c-4939-9852-e8db1c44bb65] Received unexpected event network-vif-plugged-b70bcefe-a1cc-4f5c-98f6-3d6914d66a9b for instance with vm_state active and task_state reboot_started.
Nov 03 12:29:00 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-8ee74a7b-d665-49fa-8458-78580003a5e9 tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Lock "be38c803-d97c-4939-9852-e8db1c44bb65" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.607s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:29:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:29:03 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:29:04 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-7cb5aca7-4687-47e2-9631-262f2e3d3766 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Acquiring lock "7ec0d7c3-a6bd-40a2-997a-5cdbe9436305" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:29:04 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-7cb5aca7-4687-47e2-9631-262f2e3d3766 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Lock "7ec0d7c3-a6bd-40a2-997a-5cdbe9436305" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:29:04 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-7cb5aca7-4687-47e2-9631-262f2e3d3766 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Acquiring lock "7ec0d7c3-a6bd-40a2-997a-5cdbe9436305-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:29:04 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-7cb5aca7-4687-47e2-9631-262f2e3d3766 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Lock "7ec0d7c3-a6bd-40a2-997a-5cdbe9436305-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:29:04 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-7cb5aca7-4687-47e2-9631-262f2e3d3766 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Lock "7ec0d7c3-a6bd-40a2-997a-5cdbe9436305-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:29:04 user nova-compute[74960]: INFO nova.compute.manager [None req-7cb5aca7-4687-47e2-9631-262f2e3d3766 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] [instance: 7ec0d7c3-a6bd-40a2-997a-5cdbe9436305] Terminating instance
Nov 03 12:29:04 user nova-compute[74960]: DEBUG nova.compute.manager [None req-7cb5aca7-4687-47e2-9631-262f2e3d3766 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] [instance: 7ec0d7c3-a6bd-40a2-997a-5cdbe9436305] Start destroying the instance on the hypervisor. {{(pid=74960) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 12:29:04 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:29:04 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:29:04 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:29:04 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:29:04 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:29:04 user nova-compute[74960]: DEBUG nova.compute.manager [req-cc7bcb20-1953-4ff7-861d-76e758e9113b req-c1637123-e91c-4500-a11c-a504569fea85 service nova] [instance: 7ec0d7c3-a6bd-40a2-997a-5cdbe9436305] Received event network-vif-unplugged-4a8609a8-f748-4982-9a03-1650a5433e9c {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:29:04 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-cc7bcb20-1953-4ff7-861d-76e758e9113b req-c1637123-e91c-4500-a11c-a504569fea85 service nova] Acquiring lock "7ec0d7c3-a6bd-40a2-997a-5cdbe9436305-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:29:04 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-cc7bcb20-1953-4ff7-861d-76e758e9113b req-c1637123-e91c-4500-a11c-a504569fea85 service nova] Lock "7ec0d7c3-a6bd-40a2-997a-5cdbe9436305-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:29:04 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-cc7bcb20-1953-4ff7-861d-76e758e9113b req-c1637123-e91c-4500-a11c-a504569fea85 service nova] Lock "7ec0d7c3-a6bd-40a2-997a-5cdbe9436305-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:29:04 user nova-compute[74960]: DEBUG nova.compute.manager [req-cc7bcb20-1953-4ff7-861d-76e758e9113b req-c1637123-e91c-4500-a11c-a504569fea85 service nova] [instance: 7ec0d7c3-a6bd-40a2-997a-5cdbe9436305] No waiting events found dispatching network-vif-unplugged-4a8609a8-f748-4982-9a03-1650a5433e9c {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:29:04 user nova-compute[74960]: DEBUG nova.compute.manager [req-cc7bcb20-1953-4ff7-861d-76e758e9113b req-c1637123-e91c-4500-a11c-a504569fea85 service nova] [instance: 7ec0d7c3-a6bd-40a2-997a-5cdbe9436305] Received event network-vif-unplugged-4a8609a8-f748-4982-9a03-1650a5433e9c for instance with task_state deleting. {{(pid=74960) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 12:29:05 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:29:05 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:29:05 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: 7ec0d7c3-a6bd-40a2-997a-5cdbe9436305] Instance destroyed successfully.
Nov 03 12:29:05 user nova-compute[74960]: DEBUG nova.objects.instance [None req-7cb5aca7-4687-47e2-9631-262f2e3d3766 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Lazy-loading 'resources' on Instance uuid 7ec0d7c3-a6bd-40a2-997a-5cdbe9436305 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:29:05 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-7cb5aca7-4687-47e2-9631-262f2e3d3766 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:27:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-379748673',display_name='tempest-VolumesActionsTest-instance-379748673',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-379748673',id=24,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-03T12:27:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f91dff8e248b4ca2bedc8631fcaf06f3',ramdisk_id='',reservation_id='r-9y5ax62s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1450410058',owner_user_name='tempest-VolumesActionsTest-1450410058-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T12:27:19Z,user_data=None,user_id='b10ff362bd8641e184623b5506ec875e',uuid=7ec0d7c3-a6bd-40a2-997a-5cdbe9436305,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4a8609a8-f748-4982-9a03-1650a5433e9c", "address": "fa:16:3e:bb:75:23", "network": {"id": "78afe6eb-a6db-4f0c-a135-32b7775b5e2a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1883110422-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f91dff8e248b4ca2bedc8631fcaf06f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a8609a8-f7", "ovs_interfaceid": "4a8609a8-f748-4982-9a03-1650a5433e9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 12:29:05 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-7cb5aca7-4687-47e2-9631-262f2e3d3766 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Converting VIF {"id": "4a8609a8-f748-4982-9a03-1650a5433e9c", "address": "fa:16:3e:bb:75:23", "network": {"id": "78afe6eb-a6db-4f0c-a135-32b7775b5e2a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1883110422-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f91dff8e248b4ca2bedc8631fcaf06f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a8609a8-f7", "ovs_interfaceid": "4a8609a8-f748-4982-9a03-1650a5433e9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:29:05 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-7cb5aca7-4687-47e2-9631-262f2e3d3766 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:75:23,bridge_name='br-int',has_traffic_filtering=True,id=4a8609a8-f748-4982-9a03-1650a5433e9c,network=Network(78afe6eb-a6db-4f0c-a135-32b7775b5e2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a8609a8-f7') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:29:05 user nova-compute[74960]: DEBUG os_vif [None req-7cb5aca7-4687-47e2-9631-262f2e3d3766 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:75:23,bridge_name='br-int',has_traffic_filtering=True,id=4a8609a8-f748-4982-9a03-1650a5433e9c,network=Network(78afe6eb-a6db-4f0c-a135-32b7775b5e2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a8609a8-f7') {{(pid=74960) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 12:29:05 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:29:05 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4a8609a8-f7, bridge=br-int, if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:29:05 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:29:05 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:29:05 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=74da13c9-0a59-4e49-9cc8-a00889ff5916) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:29:05 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:29:05 user nova-compute[74960]: INFO os_vif [None req-7cb5aca7-4687-47e2-9631-262f2e3d3766 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:75:23,bridge_name='br-int',has_traffic_filtering=True,id=4a8609a8-f748-4982-9a03-1650a5433e9c,network=Network(78afe6eb-a6db-4f0c-a135-32b7775b5e2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a8609a8-f7')
Nov 03 12:29:05 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-7cb5aca7-4687-47e2-9631-262f2e3d3766 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] [instance: 7ec0d7c3-a6bd-40a2-997a-5cdbe9436305] Deleting instance files /opt/stack/data/nova/instances/7ec0d7c3-a6bd-40a2-997a-5cdbe9436305_del
Nov 03 12:29:05 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-7cb5aca7-4687-47e2-9631-262f2e3d3766 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] [instance: 7ec0d7c3-a6bd-40a2-997a-5cdbe9436305] Deletion of /opt/stack/data/nova/instances/7ec0d7c3-a6bd-40a2-997a-5cdbe9436305_del complete
Nov 03 12:29:05 user nova-compute[74960]: INFO nova.compute.manager [None req-7cb5aca7-4687-47e2-9631-262f2e3d3766 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] [instance: 7ec0d7c3-a6bd-40a2-997a-5cdbe9436305] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 03 12:29:05 user nova-compute[74960]: DEBUG oslo.service.loopingcall [None req-7cb5aca7-4687-47e2-9631-262f2e3d3766 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74960) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 12:29:05 user nova-compute[74960]: DEBUG nova.compute.manager [-] [instance: 7ec0d7c3-a6bd-40a2-997a-5cdbe9436305] Deallocating network for instance {{(pid=74960) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 12:29:05 user nova-compute[74960]: DEBUG nova.network.neutron [-] [instance: 7ec0d7c3-a6bd-40a2-997a-5cdbe9436305] deallocate_for_instance() {{(pid=74960) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 12:29:05 user nova-compute[74960]: DEBUG nova.network.neutron [-] [instance: 7ec0d7c3-a6bd-40a2-997a-5cdbe9436305] Updating instance_info_cache with network_info: [] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:29:05 user nova-compute[74960]: INFO nova.compute.manager [-] [instance: 7ec0d7c3-a6bd-40a2-997a-5cdbe9436305] Took 0.42 seconds to deallocate network for instance.
Nov 03 12:29:05 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-7cb5aca7-4687-47e2-9631-262f2e3d3766 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:29:05 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-7cb5aca7-4687-47e2-9631-262f2e3d3766 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:29:06 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-7cb5aca7-4687-47e2-9631-262f2e3d3766 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:29:06 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-7cb5aca7-4687-47e2-9631-262f2e3d3766 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:29:06 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-7cb5aca7-4687-47e2-9631-262f2e3d3766 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.380s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:29:06 user nova-compute[74960]: INFO nova.scheduler.client.report [None req-7cb5aca7-4687-47e2-9631-262f2e3d3766 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Deleted allocations for instance 7ec0d7c3-a6bd-40a2-997a-5cdbe9436305
Nov 03 12:29:06 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-7cb5aca7-4687-47e2-9631-262f2e3d3766 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Lock "7ec0d7c3-a6bd-40a2-997a-5cdbe9436305" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.931s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:29:06 user nova-compute[74960]: DEBUG nova.compute.manager [req-66470a14-72c8-4fce-90d1-1bfadc0345ac req-2cea09f6-5405-4138-8039-86a7290c566f service nova] [instance: 7ec0d7c3-a6bd-40a2-997a-5cdbe9436305] Received event network-vif-plugged-4a8609a8-f748-4982-9a03-1650a5433e9c {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:29:06 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-66470a14-72c8-4fce-90d1-1bfadc0345ac req-2cea09f6-5405-4138-8039-86a7290c566f service nova] Acquiring lock "7ec0d7c3-a6bd-40a2-997a-5cdbe9436305-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:29:06 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-66470a14-72c8-4fce-90d1-1bfadc0345ac req-2cea09f6-5405-4138-8039-86a7290c566f service nova] Lock "7ec0d7c3-a6bd-40a2-997a-5cdbe9436305-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:29:06 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-66470a14-72c8-4fce-90d1-1bfadc0345ac req-2cea09f6-5405-4138-8039-86a7290c566f service nova] Lock "7ec0d7c3-a6bd-40a2-997a-5cdbe9436305-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:29:06 user nova-compute[74960]: DEBUG nova.compute.manager [req-66470a14-72c8-4fce-90d1-1bfadc0345ac req-2cea09f6-5405-4138-8039-86a7290c566f service nova] [instance: 7ec0d7c3-a6bd-40a2-997a-5cdbe9436305] No waiting events found dispatching network-vif-plugged-4a8609a8-f748-4982-9a03-1650a5433e9c {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:29:06 user nova-compute[74960]: WARNING nova.compute.manager [req-66470a14-72c8-4fce-90d1-1bfadc0345ac req-2cea09f6-5405-4138-8039-86a7290c566f service nova] [instance: 7ec0d7c3-a6bd-40a2-997a-5cdbe9436305] Received unexpected event network-vif-plugged-4a8609a8-f748-4982-9a03-1650a5433e9c for instance with vm_state deleted and task_state None.
Nov 03 12:29:06 user nova-compute[74960]: DEBUG nova.compute.manager [req-66470a14-72c8-4fce-90d1-1bfadc0345ac req-2cea09f6-5405-4138-8039-86a7290c566f service nova] [instance: 7ec0d7c3-a6bd-40a2-997a-5cdbe9436305] Received event network-vif-deleted-4a8609a8-f748-4982-9a03-1650a5433e9c {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:29:08 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:29:09 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-e89e5522-989e-4f6b-a951-7538425d76b8 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Acquiring lock "b1f7c162-c891-460a-8f98-3c7d6aeb6c49" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:29:09 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-e89e5522-989e-4f6b-a951-7538425d76b8 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Lock "b1f7c162-c891-460a-8f98-3c7d6aeb6c49" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:29:09 user nova-compute[74960]: DEBUG nova.compute.manager [None req-e89e5522-989e-4f6b-a951-7538425d76b8 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49] Starting instance... {{(pid=74960) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 12:29:09 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-e89e5522-989e-4f6b-a951-7538425d76b8 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:29:09 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-e89e5522-989e-4f6b-a951-7538425d76b8 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:29:09 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-e89e5522-989e-4f6b-a951-7538425d76b8 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74960) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 12:29:09 user nova-compute[74960]: INFO nova.compute.claims [None req-e89e5522-989e-4f6b-a951-7538425d76b8 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49] Claim successful on node user
Nov 03 12:29:10 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:29:10 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-e89e5522-989e-4f6b-a951-7538425d76b8 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:29:10 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-e89e5522-989e-4f6b-a951-7538425d76b8 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:29:10 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-e89e5522-989e-4f6b-a951-7538425d76b8 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.376s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:29:10 user nova-compute[74960]: DEBUG nova.compute.manager [None req-e89e5522-989e-4f6b-a951-7538425d76b8 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49] Start building networks asynchronously for instance. {{(pid=74960) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 12:29:10 user nova-compute[74960]: DEBUG nova.compute.manager [None req-e89e5522-989e-4f6b-a951-7538425d76b8 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49] Allocating IP information in the background. {{(pid=74960) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 12:29:10 user nova-compute[74960]: DEBUG nova.network.neutron [None req-e89e5522-989e-4f6b-a951-7538425d76b8 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49] allocate_for_instance() {{(pid=74960) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 12:29:10 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-e89e5522-989e-4f6b-a951-7538425d76b8 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 12:29:10 user nova-compute[74960]: DEBUG nova.compute.manager [None req-e89e5522-989e-4f6b-a951-7538425d76b8 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49] Start building block device mappings for instance. {{(pid=74960) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 12:29:10 user nova-compute[74960]: INFO nova.virt.block_device [None req-e89e5522-989e-4f6b-a951-7538425d76b8 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49] Booting with volume 2f45e9d6-0169-4a92-8d8c-ee068f12905b at /dev/vda
Nov 03 12:29:10 user nova-compute[74960]: DEBUG nova.policy [None req-e89e5522-989e-4f6b-a951-7538425d76b8 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '60d8d224d7204ede84c09433a3d82d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5320673ee4f0422989a3708915375cdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74960) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 12:29:10 user nova-compute[74960]: DEBUG os_brick.utils [None req-e89e5522-989e-4f6b-a951-7538425d76b8 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:29:10 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:29:10 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:29:10 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2a2fc88-6d0d-4d0f-99eb-3c5dbce4c7fe]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:75b8e219756\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:29:10 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:29:10 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:29:10 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[90c8b73c-5351-4ab9-a92b-651f05b3d476]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:29:10 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:29:10 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:29:10 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd9be5a7-881d-4320-ad97-9b57fa941ade]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:29:10 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[59251306-9f8c-4ec7-90a0-f81fdfbf62fc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:29:10 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-e89e5522-989e-4f6b-a951-7538425d76b8 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Running cmd (subprocess): nvme version {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:29:10 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-e89e5522-989e-4f6b-a951-7538425d76b8 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] 'nvme version' failed. Not Retrying. {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 12:29:10 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e89e5522-989e-4f6b-a951-7538425d76b8 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] nvme not present on system {{(pid=74960) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 12:29:10 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:29:10 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 12:29:10 user nova-compute[74960]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 12:29:10 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[56efbc40-ba32-4f58-aca4-ee1c17e2f9b4]: (4, '') {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:29:10 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-e89e5522-989e-4f6b-a951-7538425d76b8 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74960) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 12:29:10 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-e89e5522-989e-4f6b-a951-7538425d76b8 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74960) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 12:29:10 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-e89e5522-989e-4f6b-a951-7538425d76b8 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] LIGHTOS: no hostnqn found. {{(pid=74960) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 12:29:10 user nova-compute[74960]: DEBUG os_brick.utils [None req-e89e5522-989e-4f6b-a951-7538425d76b8 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:75b8e219756', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:29:10 user nova-compute[74960]: DEBUG nova.virt.block_device [None req-e89e5522-989e-4f6b-a951-7538425d76b8 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49] Updating existing volume attachment record: feaa2203-a6c1-4d52-b44c-d56088376bbb {{(pid=74960) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 12:29:11 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:29:11 user nova-compute[74960]: DEBUG nova.network.neutron [None req-e89e5522-989e-4f6b-a951-7538425d76b8 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49] Successfully created port: 78dc3436-7e47-4513-b5fa-0fd25ab1baf9 {{(pid=74960) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 12:29:12 user nova-compute[74960]: DEBUG nova.network.neutron [None req-e89e5522-989e-4f6b-a951-7538425d76b8 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49] Successfully updated port: 78dc3436-7e47-4513-b5fa-0fd25ab1baf9 {{(pid=74960) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 12:29:12 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-e89e5522-989e-4f6b-a951-7538425d76b8 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Acquiring lock "refresh_cache-b1f7c162-c891-460a-8f98-3c7d6aeb6c49" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:29:12 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-e89e5522-989e-4f6b-a951-7538425d76b8 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Acquired lock "refresh_cache-b1f7c162-c891-460a-8f98-3c7d6aeb6c49" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:29:12 user nova-compute[74960]: DEBUG nova.network.neutron [None req-e89e5522-989e-4f6b-a951-7538425d76b8 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49] Building network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 12:29:12 user nova-compute[74960]: DEBUG nova.compute.manager [req-095d436c-f8b3-49de-b29f-7fd7002fc24b req-e2e63ada-00d9-4a9b-a6f0-5d036cf9fe9a service nova] [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49] Received event network-changed-78dc3436-7e47-4513-b5fa-0fd25ab1baf9 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:29:12 user nova-compute[74960]: DEBUG nova.compute.manager [req-095d436c-f8b3-49de-b29f-7fd7002fc24b req-e2e63ada-00d9-4a9b-a6f0-5d036cf9fe9a service nova] [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49] Refreshing instance network info cache due to event network-changed-78dc3436-7e47-4513-b5fa-0fd25ab1baf9. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 12:29:12 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-095d436c-f8b3-49de-b29f-7fd7002fc24b req-e2e63ada-00d9-4a9b-a6f0-5d036cf9fe9a service nova] Acquiring lock "refresh_cache-b1f7c162-c891-460a-8f98-3c7d6aeb6c49" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:29:12 user nova-compute[74960]: DEBUG nova.network.neutron [None req-e89e5522-989e-4f6b-a951-7538425d76b8 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49] Instance cache missing network info. {{(pid=74960) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 12:29:12 user nova-compute[74960]: DEBUG nova.network.neutron [None req-e89e5522-989e-4f6b-a951-7538425d76b8 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49] Updating instance_info_cache with network_info: [{"id": "78dc3436-7e47-4513-b5fa-0fd25ab1baf9", "address": "fa:16:3e:d5:a8:23", "network": {"id": "9c5fae09-5df5-45a3-b9cd-7ac3763ba878", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1736223258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5320673ee4f0422989a3708915375cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78dc3436-7e", "ovs_interfaceid": "78dc3436-7e47-4513-b5fa-0fd25ab1baf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:29:12 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-e89e5522-989e-4f6b-a951-7538425d76b8 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Releasing lock "refresh_cache-b1f7c162-c891-460a-8f98-3c7d6aeb6c49" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:29:12 user nova-compute[74960]: DEBUG nova.compute.manager [None req-e89e5522-989e-4f6b-a951-7538425d76b8 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49] Instance network_info: |[{"id": "78dc3436-7e47-4513-b5fa-0fd25ab1baf9", "address": "fa:16:3e:d5:a8:23", "network": {"id": "9c5fae09-5df5-45a3-b9cd-7ac3763ba878", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1736223258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5320673ee4f0422989a3708915375cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78dc3436-7e", "ovs_interfaceid": "78dc3436-7e47-4513-b5fa-0fd25ab1baf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74960) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 12:29:12 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-095d436c-f8b3-49de-b29f-7fd7002fc24b req-e2e63ada-00d9-4a9b-a6f0-5d036cf9fe9a service nova] Acquired lock "refresh_cache-b1f7c162-c891-460a-8f98-3c7d6aeb6c49" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:29:12 user nova-compute[74960]: DEBUG nova.network.neutron [req-095d436c-f8b3-49de-b29f-7fd7002fc24b req-e2e63ada-00d9-4a9b-a6f0-5d036cf9fe9a service nova] [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49] Refreshing network info cache for port 78dc3436-7e47-4513-b5fa-0fd25ab1baf9 {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 12:29:13 user nova-compute[74960]: DEBUG nova.network.neutron [req-095d436c-f8b3-49de-b29f-7fd7002fc24b req-e2e63ada-00d9-4a9b-a6f0-5d036cf9fe9a service nova] [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49] Updated VIF entry in instance network info cache for port 78dc3436-7e47-4513-b5fa-0fd25ab1baf9. {{(pid=74960) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 12:29:13 user nova-compute[74960]: DEBUG nova.network.neutron [req-095d436c-f8b3-49de-b29f-7fd7002fc24b req-e2e63ada-00d9-4a9b-a6f0-5d036cf9fe9a service nova] [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49] Updating instance_info_cache with network_info: [{"id": "78dc3436-7e47-4513-b5fa-0fd25ab1baf9", "address": "fa:16:3e:d5:a8:23", "network": {"id": "9c5fae09-5df5-45a3-b9cd-7ac3763ba878", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1736223258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5320673ee4f0422989a3708915375cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78dc3436-7e", "ovs_interfaceid": "78dc3436-7e47-4513-b5fa-0fd25ab1baf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:29:13 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-095d436c-f8b3-49de-b29f-7fd7002fc24b req-e2e63ada-00d9-4a9b-a6f0-5d036cf9fe9a service nova] Releasing lock "refresh_cache-b1f7c162-c891-460a-8f98-3c7d6aeb6c49" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:29:14 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-99af41a2-bdd0-4b96-93f9-f881254f19f8 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Acquiring lock "7a33549f-51ea-42d0-8c8a-67d9c74784fd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:29:14 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-99af41a2-bdd0-4b96-93f9-f881254f19f8 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Lock "7a33549f-51ea-42d0-8c8a-67d9c74784fd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:29:14 user nova-compute[74960]: INFO nova.compute.manager [None req-99af41a2-bdd0-4b96-93f9-f881254f19f8 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] [instance: 7a33549f-51ea-42d0-8c8a-67d9c74784fd] Detaching volume 64cd7bb2-1477-431a-b084-4339f203980c
Nov 03 12:29:14 user nova-compute[74960]: INFO nova.virt.block_device [None req-99af41a2-bdd0-4b96-93f9-f881254f19f8 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] [instance: 7a33549f-51ea-42d0-8c8a-67d9c74784fd] Attempting to driver detach volume 64cd7bb2-1477-431a-b084-4339f203980c from mountpoint /dev/vdb
Nov 03 12:29:14 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-99af41a2-bdd0-4b96-93f9-f881254f19f8 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Attempting to detach device vdb from instance 7a33549f-51ea-42d0-8c8a-67d9c74784fd from the persistent domain config. {{(pid=74960) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 03 12:29:14 user nova-compute[74960]: DEBUG nova.virt.libvirt.guest [None req-99af41a2-bdd0-4b96-93f9-f881254f19f8 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 12:29:14 user nova-compute[74960]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 12:29:14 user nova-compute[74960]:   <source dev="/dev/sdb"/>
Nov 03 12:29:14 user nova-compute[74960]:   <target dev="vdb" bus="virtio"/>
Nov 03 12:29:14 user nova-compute[74960]:   <serial>64cd7bb2-1477-431a-b084-4339f203980c</serial>
Nov 03 12:29:14 user nova-compute[74960]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 12:29:14 user nova-compute[74960]: </disk>
Nov 03 12:29:14 user nova-compute[74960]:  {{(pid=74960) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 12:29:14 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-99af41a2-bdd0-4b96-93f9-f881254f19f8 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Successfully detached device vdb from instance 7a33549f-51ea-42d0-8c8a-67d9c74784fd from the persistent domain config.
Nov 03 12:29:14 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-99af41a2-bdd0-4b96-93f9-f881254f19f8 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7a33549f-51ea-42d0-8c8a-67d9c74784fd from the live domain config. {{(pid=74960) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 03 12:29:14 user nova-compute[74960]: DEBUG nova.virt.libvirt.guest [None req-99af41a2-bdd0-4b96-93f9-f881254f19f8 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 12:29:14 user nova-compute[74960]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 12:29:14 user nova-compute[74960]:   <source dev="/dev/sdb"/>
Nov 03 12:29:14 user nova-compute[74960]:   <target dev="vdb" bus="virtio"/>
Nov 03 12:29:14 user nova-compute[74960]:   <serial>64cd7bb2-1477-431a-b084-4339f203980c</serial>
Nov 03 12:29:14 user nova-compute[74960]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 12:29:14 user nova-compute[74960]: </disk>
Nov 03 12:29:14 user nova-compute[74960]:  {{(pid=74960) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 12:29:15 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-99af41a2-bdd0-4b96-93f9-f881254f19f8 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7a33549f-51ea-42d0-8c8a-67d9c74784fd {{(pid=74960) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 03 12:29:15 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:29:18 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:29:20 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:29:21 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-684b0f17-7135-4dbd-9db2-a5772c4d85ee tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Acquiring lock "f009a400-0576-48a9-82e0-60de8935c498" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:29:21 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-684b0f17-7135-4dbd-9db2-a5772c4d85ee tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Lock "f009a400-0576-48a9-82e0-60de8935c498" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:29:21 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-684b0f17-7135-4dbd-9db2-a5772c4d85ee tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Acquiring lock "f009a400-0576-48a9-82e0-60de8935c498-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:29:21 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-684b0f17-7135-4dbd-9db2-a5772c4d85ee tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Lock "f009a400-0576-48a9-82e0-60de8935c498-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:29:21 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-684b0f17-7135-4dbd-9db2-a5772c4d85ee tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Lock "f009a400-0576-48a9-82e0-60de8935c498-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:29:21 user nova-compute[74960]: INFO nova.compute.manager [None req-684b0f17-7135-4dbd-9db2-a5772c4d85ee tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] [instance: f009a400-0576-48a9-82e0-60de8935c498] Terminating instance
Nov 03 12:29:21 user nova-compute[74960]: DEBUG nova.compute.manager [None req-684b0f17-7135-4dbd-9db2-a5772c4d85ee tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] [instance: f009a400-0576-48a9-82e0-60de8935c498] Start destroying the instance on the hypervisor. {{(pid=74960) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 12:29:21 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:29:21 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:29:21 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:29:21 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:29:21 user nova-compute[74960]: DEBUG nova.compute.manager [req-04eb88b7-a8b6-40c3-b63f-8a3c34a51af3 req-25625343-327b-4693-94cb-30642f61a7e6 service nova] [instance: f009a400-0576-48a9-82e0-60de8935c498] Received event network-vif-unplugged-4b72249c-3aea-415f-83a8-d0498d55674e {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:29:21 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-04eb88b7-a8b6-40c3-b63f-8a3c34a51af3 req-25625343-327b-4693-94cb-30642f61a7e6 service nova] Acquiring lock "f009a400-0576-48a9-82e0-60de8935c498-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:29:21 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-04eb88b7-a8b6-40c3-b63f-8a3c34a51af3 req-25625343-327b-4693-94cb-30642f61a7e6 service nova] Lock "f009a400-0576-48a9-82e0-60de8935c498-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:29:21 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-04eb88b7-a8b6-40c3-b63f-8a3c34a51af3 req-25625343-327b-4693-94cb-30642f61a7e6 service nova] Lock "f009a400-0576-48a9-82e0-60de8935c498-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:29:21 user nova-compute[74960]: DEBUG nova.compute.manager [req-04eb88b7-a8b6-40c3-b63f-8a3c34a51af3 req-25625343-327b-4693-94cb-30642f61a7e6 service nova] [instance: f009a400-0576-48a9-82e0-60de8935c498] No waiting events found dispatching network-vif-unplugged-4b72249c-3aea-415f-83a8-d0498d55674e {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:29:21 user nova-compute[74960]: DEBUG nova.compute.manager [req-04eb88b7-a8b6-40c3-b63f-8a3c34a51af3 req-25625343-327b-4693-94cb-30642f61a7e6 service nova] [instance: f009a400-0576-48a9-82e0-60de8935c498] Received event network-vif-unplugged-4b72249c-3aea-415f-83a8-d0498d55674e for instance with task_state deleting. {{(pid=74960) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 12:29:22 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: f009a400-0576-48a9-82e0-60de8935c498] Instance destroyed successfully.
Nov 03 12:29:22 user nova-compute[74960]: DEBUG nova.objects.instance [None req-684b0f17-7135-4dbd-9db2-a5772c4d85ee tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Lazy-loading 'resources' on Instance uuid f009a400-0576-48a9-82e0-60de8935c498 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:29:22 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-684b0f17-7135-4dbd-9db2-a5772c4d85ee tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:21:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-302715128',display_name='tempest-ServerStableDeviceRescueTest-server-302715128',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-302715128',id=15,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKEJiNHk1MpJMHtnc9xz6UlLngjMhp2MEBhRlDPcSKLcrBwK03cPu7BEeyeirBfTHeIalig4pFBXX2rcKQNvvtYx9QYR4XrIrZ4ChHFhaM/FICjNG5IWTOJ5TxEEBwPkoQ==',key_name='tempest-keypair-1624034761',keypairs=<?>,launch_index=0,launched_at=2023-11-03T12:26:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d039968e1b97457b8fc21b593af4e1ff',ramdisk_id='',reservation_id='r-2awyc6mw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1015453085',owner_user_name='tempest-ServerStableDeviceRescueTest-1015453085-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T12:28:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7080314bc6e400d97bdb4b9bd4071c3',uuid=f009a400-0576-48a9-82e0-60de8935c498,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4b72249c-3aea-415f-83a8-d0498d55674e", "address": "fa:16:3e:81:8a:f6", "network": {"id": "b92f11b0-994f-48b7-be64-02cb782a1f8f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-997339008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d039968e1b97457b8fc21b593af4e1ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b72249c-3a", "ovs_interfaceid": "4b72249c-3aea-415f-83a8-d0498d55674e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 12:29:22 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-684b0f17-7135-4dbd-9db2-a5772c4d85ee tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Converting VIF {"id": "4b72249c-3aea-415f-83a8-d0498d55674e", "address": "fa:16:3e:81:8a:f6", "network": {"id": "b92f11b0-994f-48b7-be64-02cb782a1f8f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-997339008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d039968e1b97457b8fc21b593af4e1ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b72249c-3a", "ovs_interfaceid": "4b72249c-3aea-415f-83a8-d0498d55674e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:29:22 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-684b0f17-7135-4dbd-9db2-a5772c4d85ee tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:81:8a:f6,bridge_name='br-int',has_traffic_filtering=True,id=4b72249c-3aea-415f-83a8-d0498d55674e,network=Network(b92f11b0-994f-48b7-be64-02cb782a1f8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b72249c-3a') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:29:22 user nova-compute[74960]: DEBUG os_vif [None req-684b0f17-7135-4dbd-9db2-a5772c4d85ee tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:8a:f6,bridge_name='br-int',has_traffic_filtering=True,id=4b72249c-3aea-415f-83a8-d0498d55674e,network=Network(b92f11b0-994f-48b7-be64-02cb782a1f8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b72249c-3a') {{(pid=74960) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 12:29:22 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:29:22 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4b72249c-3a, bridge=br-int, if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:29:22 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:29:22 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:29:22 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e7e37123-b2c1-45ba-b9b1-12414338fc38) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:29:22 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:29:22 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:29:22 user nova-compute[74960]: INFO os_vif [None req-684b0f17-7135-4dbd-9db2-a5772c4d85ee tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:8a:f6,bridge_name='br-int',has_traffic_filtering=True,id=4b72249c-3aea-415f-83a8-d0498d55674e,network=Network(b92f11b0-994f-48b7-be64-02cb782a1f8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b72249c-3a')
Nov 03 12:29:22 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-684b0f17-7135-4dbd-9db2-a5772c4d85ee tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] [instance: f009a400-0576-48a9-82e0-60de8935c498] Deleting instance files /opt/stack/data/nova/instances/f009a400-0576-48a9-82e0-60de8935c498_del
Nov 03 12:29:22 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-684b0f17-7135-4dbd-9db2-a5772c4d85ee tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] [instance: f009a400-0576-48a9-82e0-60de8935c498] Deletion of /opt/stack/data/nova/instances/f009a400-0576-48a9-82e0-60de8935c498_del complete
Nov 03 12:29:22 user nova-compute[74960]: INFO nova.compute.manager [None req-684b0f17-7135-4dbd-9db2-a5772c4d85ee tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] [instance: f009a400-0576-48a9-82e0-60de8935c498] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 03 12:29:22 user nova-compute[74960]: DEBUG oslo.service.loopingcall [None req-684b0f17-7135-4dbd-9db2-a5772c4d85ee tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74960) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 12:29:22 user nova-compute[74960]: DEBUG nova.compute.manager [-] [instance: f009a400-0576-48a9-82e0-60de8935c498] Deallocating network for instance {{(pid=74960) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 12:29:22 user nova-compute[74960]: DEBUG nova.network.neutron [-] [instance: f009a400-0576-48a9-82e0-60de8935c498] deallocate_for_instance() {{(pid=74960) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 12:29:23 user nova-compute[74960]: DEBUG nova.network.neutron [-] [instance: f009a400-0576-48a9-82e0-60de8935c498] Updating instance_info_cache with network_info: [] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:29:23 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:29:23 user nova-compute[74960]: INFO nova.compute.manager [-] [instance: f009a400-0576-48a9-82e0-60de8935c498] Took 0.96 seconds to deallocate network for instance.
Nov 03 12:29:23 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-684b0f17-7135-4dbd-9db2-a5772c4d85ee tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:29:23 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-684b0f17-7135-4dbd-9db2-a5772c4d85ee tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:29:23 user nova-compute[74960]: DEBUG nova.compute.manager [req-7a434eb2-7b0c-4bd3-9307-14134c44ad7c req-617a7da8-55a5-4bb5-a16a-7c53fd638757 service nova] [instance: f009a400-0576-48a9-82e0-60de8935c498] Received event network-vif-deleted-4b72249c-3aea-415f-83a8-d0498d55674e {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:29:23 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-684b0f17-7135-4dbd-9db2-a5772c4d85ee tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:29:23 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-684b0f17-7135-4dbd-9db2-a5772c4d85ee tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:29:23 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-684b0f17-7135-4dbd-9db2-a5772c4d85ee tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.335s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:29:23 user nova-compute[74960]: INFO nova.scheduler.client.report [None req-684b0f17-7135-4dbd-9db2-a5772c4d85ee tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Deleted allocations for instance f009a400-0576-48a9-82e0-60de8935c498
Nov 03 12:29:23 user nova-compute[74960]: DEBUG nova.compute.manager [req-ce92eda9-2a72-4b65-9dfb-28206c841af0 req-7cb508af-ca28-4bfd-aa8b-d57fd9ba30e1 service nova] [instance: f009a400-0576-48a9-82e0-60de8935c498] Received event network-vif-plugged-4b72249c-3aea-415f-83a8-d0498d55674e {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:29:23 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-ce92eda9-2a72-4b65-9dfb-28206c841af0 req-7cb508af-ca28-4bfd-aa8b-d57fd9ba30e1 service nova] Acquiring lock "f009a400-0576-48a9-82e0-60de8935c498-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:29:23 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-ce92eda9-2a72-4b65-9dfb-28206c841af0 req-7cb508af-ca28-4bfd-aa8b-d57fd9ba30e1 service nova] Lock "f009a400-0576-48a9-82e0-60de8935c498-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:29:23 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-ce92eda9-2a72-4b65-9dfb-28206c841af0 req-7cb508af-ca28-4bfd-aa8b-d57fd9ba30e1 service nova] Lock "f009a400-0576-48a9-82e0-60de8935c498-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:29:23 user nova-compute[74960]: DEBUG nova.compute.manager [req-ce92eda9-2a72-4b65-9dfb-28206c841af0 req-7cb508af-ca28-4bfd-aa8b-d57fd9ba30e1 service nova] [instance: f009a400-0576-48a9-82e0-60de8935c498] No waiting events found dispatching network-vif-plugged-4b72249c-3aea-415f-83a8-d0498d55674e {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:29:23 user nova-compute[74960]: WARNING nova.compute.manager [req-ce92eda9-2a72-4b65-9dfb-28206c841af0 req-7cb508af-ca28-4bfd-aa8b-d57fd9ba30e1 service nova] [instance: f009a400-0576-48a9-82e0-60de8935c498] Received unexpected event network-vif-plugged-4b72249c-3aea-415f-83a8-d0498d55674e for instance with vm_state deleted and task_state None.
Nov 03 12:29:23 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-684b0f17-7135-4dbd-9db2-a5772c4d85ee tempest-ServerStableDeviceRescueTest-1015453085 tempest-ServerStableDeviceRescueTest-1015453085-project-member] Lock "f009a400-0576-48a9-82e0-60de8935c498" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.397s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:29:27 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:29:28 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:29:31 user nova-compute[74960]: DEBUG nova.compute.manager [None req-e89e5522-989e-4f6b-a951-7538425d76b8 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49] Start spawning the instance on the hypervisor. {{(pid=74960) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 12:29:31 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-e89e5522-989e-4f6b-a951-7538425d76b8 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49] Creating instance directory {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 12:29:31 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-e89e5522-989e-4f6b-a951-7538425d76b8 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49] Creating image(s)
Nov 03 12:29:31 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-e89e5522-989e-4f6b-a951-7538425d76b8 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49] Did not create local disks {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 03 12:29:31 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-e89e5522-989e-4f6b-a951-7538425d76b8 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49] Ensure instance console log exists: /opt/stack/data/nova/instances/b1f7c162-c891-460a-8f98-3c7d6aeb6c49/console.log {{(pid=74960) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 12:29:31 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-e89e5522-989e-4f6b-a951-7538425d76b8 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:29:31 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-e89e5522-989e-4f6b-a951-7538425d76b8 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:29:31 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-e89e5522-989e-4f6b-a951-7538425d76b8 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:29:31 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-e89e5522-989e-4f6b-a951-7538425d76b8 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49] Start _get_guest_xml network_info=[{"id": "78dc3436-7e47-4513-b5fa-0fd25ab1baf9", "address": "fa:16:3e:d5:a8:23", "network": {"id": "9c5fae09-5df5-45a3-b9cd-7ac3763ba878", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1736223258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5320673ee4f0422989a3708915375cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78dc3436-7e", "ovs_interfaceid": "78dc3436-7e47-4513-b5fa-0fd25ab1baf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2f45e9d6-0169-4a92-8d8c-ee068f12905b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IsvCifHn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b1f7c162-c891-460a-8f98-3c7d6aeb6c49', 'attached_at': '', 'detached_at': '', 'volume_id': '2f45e9d6-0169-4a92-8d8c-ee068f12905b', 'serial': '2f45e9d6-0169-4a92-8d8c-ee068f12905b'}, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'device_type': 'disk', 'attachment_id': 'feaa2203-a6c1-4d52-b44c-d56088376bbb', 'boot_index': 0, 'guest_format': None, 'volume_type': None} {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 12:29:31 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-e89e5522-989e-4f6b-a951-7538425d76b8 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:29:31 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-e89e5522-989e-4f6b-a951-7538425d76b8 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:29:31 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-e89e5522-989e-4f6b-a951-7538425d76b8 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 12:29:31 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-e89e5522-989e-4f6b-a951-7538425d76b8 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] CPU controller missing on host. {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 12:29:31 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-e89e5522-989e-4f6b-a951-7538425d76b8 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 12:29:31 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-e89e5522-989e-4f6b-a951-7538425d76b8 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] CPU controller found on host. {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 12:29:31 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-e89e5522-989e-4f6b-a951-7538425d76b8 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74960) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 12:29:31 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-e89e5522-989e-4f6b-a951-7538425d76b8 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 12:29:31 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-e89e5522-989e-4f6b-a951-7538425d76b8 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Flavor limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 12:29:31 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-e89e5522-989e-4f6b-a951-7538425d76b8 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Image limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 12:29:31 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-e89e5522-989e-4f6b-a951-7538425d76b8 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Flavor pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 12:29:31 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-e89e5522-989e-4f6b-a951-7538425d76b8 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Image pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 12:29:31 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-e89e5522-989e-4f6b-a951-7538425d76b8 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 12:29:31 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-e89e5522-989e-4f6b-a951-7538425d76b8 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 12:29:31 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-e89e5522-989e-4f6b-a951-7538425d76b8 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 12:29:31 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-e89e5522-989e-4f6b-a951-7538425d76b8 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Got 1 possible topologies {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 12:29:31 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-e89e5522-989e-4f6b-a951-7538425d76b8 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 12:29:31 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-e89e5522-989e-4f6b-a951-7538425d76b8 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 12:29:31 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e89e5522-989e-4f6b-a951-7538425d76b8 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49] Calling os-brick to attach iSCSI Volume {{(pid=74960) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 12:29:31 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-e89e5522-989e-4f6b-a951-7538425d76b8 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9aa420acb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2f45e9d6-0169-4a92-8d8c-ee068f12905b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IsvCifHn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:29:31 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-e89e5522-989e-4f6b-a951-7538425d76b8 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:29:31 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-e89e5522-989e-4f6b-a951-7538425d76b8 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:29:31 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-e89e5522-989e-4f6b-a951-7538425d76b8 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:29:31 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-e89e5522-989e-4f6b-a951-7538425d76b8 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:29:31 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-e89e5522-989e-4f6b-a951-7538425d76b8 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f45e9d6-0169-4a92-8d8c-ee068f12905b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:29:31 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-e89e5522-989e-4f6b-a951-7538425d76b8 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f45e9d6-0169-4a92-8d8c-ee068f12905b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:29:31 user nova-compute[74960]: INFO os_brick.initiator.connectors.iscsi [None req-e89e5522-989e-4f6b-a951-7538425d76b8 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 12:29:31 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f45e9d6-0169-4a92-8d8c-ee068f12905b -p 172.16.0.220:3260 {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:29:31 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f45e9d6-0169-4a92-8d8c-ee068f12905b -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:29:31 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4e2b0e7-f619-4386-a4a2-75b7bb780c0b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:29:31 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-e89e5522-989e-4f6b-a951-7538425d76b8 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 12:29:31 user nova-compute[74960]:  {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:29:31 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f45e9d6-0169-4a92-8d8c-ee068f12905b -p 172.16.0.220:3260 --interface default --op new {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:29:31 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f45e9d6-0169-4a92-8d8c-ee068f12905b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:29:31 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a33f189-9aa5-4f7a-a37f-c3f9b0276dfb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2f45e9d6-0169-4a92-8d8c-ee068f12905b] added\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:29:31 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-e89e5522-989e-4f6b-a951-7538425d76b8 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2f45e9d6-0169-4a92-8d8c-ee068f12905b] added
Nov 03 12:29:31 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:29:31 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f45e9d6-0169-4a92-8d8c-ee068f12905b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:29:31 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f45e9d6-0169-4a92-8d8c-ee068f12905b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:29:31 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c600289-6a77-4a73-97da-82c8b71a796c]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:29:31 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-e89e5522-989e-4f6b-a951-7538425d76b8 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:29:31 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f45e9d6-0169-4a92-8d8c-ee068f12905b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:29:31 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f45e9d6-0169-4a92-8d8c-ee068f12905b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:29:31 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[72effc7f-6342-4ba9-ba0a-5ff1eadfdc94]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:29:31 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-e89e5522-989e-4f6b-a951-7538425d76b8 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:29:31 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f45e9d6-0169-4a92-8d8c-ee068f12905b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IsvCifHn {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:29:31 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f45e9d6-0169-4a92-8d8c-ee068f12905b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IsvCifHn" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:29:31 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[a282de21-2a4d-4683-b406-11dcbcc9186b]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:29:31 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-e89e5522-989e-4f6b-a951-7538425d76b8 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IsvCifHn'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:29:31 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f45e9d6-0169-4a92-8d8c-ee068f12905b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:29:31 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f45e9d6-0169-4a92-8d8c-ee068f12905b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:29:31 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fbc3f4c-d751-402c-b2a8-825ceb3d49cd]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:29:31 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-e89e5522-989e-4f6b-a951-7538425d76b8 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:29:31 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:29:31 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:29:31 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[e67f3930-3f01-486a-82c6-edca34300148]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64cd7bb2-1477-431a-b084-4339f203980c (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f33bebd3-3cc8-4db5-b35e-5d58d4dfe93f (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:29:31 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-e89e5522-989e-4f6b-a951-7538425d76b8 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64cd7bb2-1477-431a-b084-4339f203980c (non-flash)
Nov 03 12:29:31 user nova-compute[74960]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:29:31 user nova-compute[74960]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f33bebd3-3cc8-4db5-b35e-5d58d4dfe93f (non-flash)
Nov 03 12:29:31 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:29:31 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-e89e5522-989e-4f6b-a951-7538425d76b8 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64cd7bb2-1477-431a-b084-4339f203980c (non-flash)
Nov 03 12:29:31 user nova-compute[74960]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:29:31 user nova-compute[74960]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f33bebd3-3cc8-4db5-b35e-5d58d4dfe93f (non-flash)
Nov 03 12:29:31 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:29:31 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f45e9d6-0169-4a92-8d8c-ee068f12905b -p 172.16.0.220:3260 --login {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:29:31 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f45e9d6-0169-4a92-8d8c-ee068f12905b -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:29:31 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f7aca3-53c3-4cb6-8556-5a3c3dc647ad]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2f45e9d6-0169-4a92-8d8c-ee068f12905b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2f45e9d6-0169-4a92-8d8c-ee068f12905b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:29:31 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-e89e5522-989e-4f6b-a951-7538425d76b8 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2f45e9d6-0169-4a92-8d8c-ee068f12905b, portal: 172.16.0.220,3260]
Nov 03 12:29:31 user nova-compute[74960]: Login to [iface: default, target: iqn.2010-10.org.openstack:2f45e9d6-0169-4a92-8d8c-ee068f12905b, portal: 172.16.0.220,3260] successful.
Nov 03 12:29:31 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:29:31 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f45e9d6-0169-4a92-8d8c-ee068f12905b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:29:31 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f45e9d6-0169-4a92-8d8c-ee068f12905b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:29:31 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[36d11bfb-1b7c-4bc1-adec-ef00e8985ca8]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:29:31 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-e89e5522-989e-4f6b-a951-7538425d76b8 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:29:31 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:29:31 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:29:31 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef0990d0-31a4-4ad7-b3dd-d26f8eb54d90]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64cd7bb2-1477-431a-b084-4339f203980c (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f33bebd3-3cc8-4db5-b35e-5d58d4dfe93f (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f45e9d6-0169-4a92-8d8c-ee068f12905b (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:29:31 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-e89e5522-989e-4f6b-a951-7538425d76b8 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64cd7bb2-1477-431a-b084-4339f203980c (non-flash)
Nov 03 12:29:31 user nova-compute[74960]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:29:31 user nova-compute[74960]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f33bebd3-3cc8-4db5-b35e-5d58d4dfe93f (non-flash)
Nov 03 12:29:31 user nova-compute[74960]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f45e9d6-0169-4a92-8d8c-ee068f12905b (non-flash)
Nov 03 12:29:31 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:29:31 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-e89e5522-989e-4f6b-a951-7538425d76b8 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64cd7bb2-1477-431a-b084-4339f203980c (non-flash)
Nov 03 12:29:31 user nova-compute[74960]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:29:31 user nova-compute[74960]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f33bebd3-3cc8-4db5-b35e-5d58d4dfe93f (non-flash)
Nov 03 12:29:31 user nova-compute[74960]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f45e9d6-0169-4a92-8d8c-ee068f12905b (non-flash)
Nov 03 12:29:31 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:29:31 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-e89e5522-989e-4f6b-a951-7538425d76b8 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f45e9d6-0169-4a92-8d8c-ee068f12905b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:29:31 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-e89e5522-989e-4f6b-a951-7538425d76b8 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Connected to 172.16.0.220:3260 {{(pid=74960) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 12:29:31 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-e89e5522-989e-4f6b-a951-7538425d76b8 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] HCTL ('34', '-', '-', 0) found on session 21 with lun 0 {{(pid=74960) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 12:29:31 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-e89e5522-989e-4f6b-a951-7538425d76b8 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74960) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 12:29:31 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:29:31 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:29:31 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[4580232c-8309-4027-bb8f-123e90062782]: (4, ('- - 0', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:29:31 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-e89e5522-989e-4f6b-a951-7538425d76b8 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Searching for a device in session 21 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74960) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 12:29:31 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-e89e5522-989e-4f6b-a951-7538425d76b8 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:2f45e9d6-0169-4a92-8d8c-ee068f12905b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IsvCifHn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74960) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 12:29:32 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:29:32 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-e89e5522-989e-4f6b-a951-7538425d76b8 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:29:32 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-e89e5522-989e-4f6b-a951-7538425d76b8 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '23566373537653966', 'path': '/dev/sdc'} {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:29:32 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e89e5522-989e-4f6b-a951-7538425d76b8 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23566373537653966', 'path': '/dev/sdc'} {{(pid=74960) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 12:29:32 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-e89e5522-989e-4f6b-a951-7538425d76b8 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:29:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1418707382',display_name='tempest-ServerActionsTestOtherA-server-1418707382',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1418707382',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPAz3yp3EJUzWOfLmandSosNLGmmwlB9ouRsIIfsq3JGgx5t4USdyA4JVa+9y90auzNv5yGmALwIZZVdM/LzHirlYfhZGk/2geYmtQFtCuY7KHcICqsra/ZIlPsAiI2BYw==',key_name='tempest-keypair-1847755946',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5320673ee4f0422989a3708915375cdb',ramdisk_id='',reservation_id='r-nb6ahum2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1651581249',owner_user_name='tempest-ServerActionsTestOtherA-1651581249-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:29:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60d8d224d7204ede84c09433a3d82d0f',uuid=b1f7c162-c891-460a-8f98-3c7d6aeb6c49,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "78dc3436-7e47-4513-b5fa-0fd25ab1baf9", "address": "fa:16:3e:d5:a8:23", "network": {"id": "9c5fae09-5df5-45a3-b9cd-7ac3763ba878", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1736223258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5320673ee4f0422989a3708915375cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78dc3436-7e", "ovs_interfaceid": "78dc3436-7e47-4513-b5fa-0fd25ab1baf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74960) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 12:29:32 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-e89e5522-989e-4f6b-a951-7538425d76b8 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Converting VIF {"id": "78dc3436-7e47-4513-b5fa-0fd25ab1baf9", "address": "fa:16:3e:d5:a8:23", "network": {"id": "9c5fae09-5df5-45a3-b9cd-7ac3763ba878", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1736223258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5320673ee4f0422989a3708915375cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78dc3436-7e", "ovs_interfaceid": "78dc3436-7e47-4513-b5fa-0fd25ab1baf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:29:32 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-e89e5522-989e-4f6b-a951-7538425d76b8 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:a8:23,bridge_name='br-int',has_traffic_filtering=True,id=78dc3436-7e47-4513-b5fa-0fd25ab1baf9,network=Network(9c5fae09-5df5-45a3-b9cd-7ac3763ba878),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78dc3436-7e') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:29:32 user nova-compute[74960]: DEBUG nova.objects.instance [None req-e89e5522-989e-4f6b-a951-7538425d76b8 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Lazy-loading 'pci_devices' on Instance uuid b1f7c162-c891-460a-8f98-3c7d6aeb6c49 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:29:32 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-e89e5522-989e-4f6b-a951-7538425d76b8 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49] End _get_guest_xml xml=<domain type="kvm">
Nov 03 12:29:32 user nova-compute[74960]:   <uuid>b1f7c162-c891-460a-8f98-3c7d6aeb6c49</uuid>
Nov 03 12:29:32 user nova-compute[74960]:   <name>instance-0000001a</name>
Nov 03 12:29:32 user nova-compute[74960]:   <memory>524288</memory>
Nov 03 12:29:32 user nova-compute[74960]:   <vcpu>1</vcpu>
Nov 03 12:29:32 user nova-compute[74960]:   <metadata>
Nov 03 12:29:32 user nova-compute[74960]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 12:29:32 user nova-compute[74960]:       <nova:package version="0.0.0"/>
Nov 03 12:29:32 user nova-compute[74960]:       <nova:name>tempest-ServerActionsTestOtherA-server-1418707382</nova:name>
Nov 03 12:29:32 user nova-compute[74960]:       <nova:creationTime>2023-11-03 12:29:31</nova:creationTime>
Nov 03 12:29:32 user nova-compute[74960]:       <nova:flavor name="m1.tiny">
Nov 03 12:29:32 user nova-compute[74960]:         <nova:memory>512</nova:memory>
Nov 03 12:29:32 user nova-compute[74960]:         <nova:disk>1</nova:disk>
Nov 03 12:29:32 user nova-compute[74960]:         <nova:swap>0</nova:swap>
Nov 03 12:29:32 user nova-compute[74960]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 12:29:32 user nova-compute[74960]:         <nova:vcpus>1</nova:vcpus>
Nov 03 12:29:32 user nova-compute[74960]:       </nova:flavor>
Nov 03 12:29:32 user nova-compute[74960]:       <nova:owner>
Nov 03 12:29:32 user nova-compute[74960]:         <nova:user uuid="60d8d224d7204ede84c09433a3d82d0f">tempest-ServerActionsTestOtherA-1651581249-project-member</nova:user>
Nov 03 12:29:32 user nova-compute[74960]:         <nova:project uuid="5320673ee4f0422989a3708915375cdb">tempest-ServerActionsTestOtherA-1651581249</nova:project>
Nov 03 12:29:32 user nova-compute[74960]:       </nova:owner>
Nov 03 12:29:32 user nova-compute[74960]:       <nova:ports>
Nov 03 12:29:32 user nova-compute[74960]:         <nova:port uuid="78dc3436-7e47-4513-b5fa-0fd25ab1baf9">
Nov 03 12:29:32 user nova-compute[74960]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 03 12:29:32 user nova-compute[74960]:         </nova:port>
Nov 03 12:29:32 user nova-compute[74960]:       </nova:ports>
Nov 03 12:29:32 user nova-compute[74960]:     </nova:instance>
Nov 03 12:29:32 user nova-compute[74960]:   </metadata>
Nov 03 12:29:32 user nova-compute[74960]:   <sysinfo type="smbios">
Nov 03 12:29:32 user nova-compute[74960]:     <system>
Nov 03 12:29:32 user nova-compute[74960]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 12:29:32 user nova-compute[74960]:       <entry name="product">OpenStack Nova</entry>
Nov 03 12:29:32 user nova-compute[74960]:       <entry name="version">0.0.0</entry>
Nov 03 12:29:32 user nova-compute[74960]:       <entry name="serial">b1f7c162-c891-460a-8f98-3c7d6aeb6c49</entry>
Nov 03 12:29:32 user nova-compute[74960]:       <entry name="uuid">b1f7c162-c891-460a-8f98-3c7d6aeb6c49</entry>
Nov 03 12:29:32 user nova-compute[74960]:       <entry name="family">Virtual Machine</entry>
Nov 03 12:29:32 user nova-compute[74960]:     </system>
Nov 03 12:29:32 user nova-compute[74960]:   </sysinfo>
Nov 03 12:29:32 user nova-compute[74960]:   <os>
Nov 03 12:29:32 user nova-compute[74960]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 12:29:32 user nova-compute[74960]:     <boot dev="hd"/>
Nov 03 12:29:32 user nova-compute[74960]:     <smbios mode="sysinfo"/>
Nov 03 12:29:32 user nova-compute[74960]:   </os>
Nov 03 12:29:32 user nova-compute[74960]:   <features>
Nov 03 12:29:32 user nova-compute[74960]:     <acpi/>
Nov 03 12:29:32 user nova-compute[74960]:     <apic/>
Nov 03 12:29:32 user nova-compute[74960]:     <vmcoreinfo/>
Nov 03 12:29:32 user nova-compute[74960]:   </features>
Nov 03 12:29:32 user nova-compute[74960]:   <clock offset="utc">
Nov 03 12:29:32 user nova-compute[74960]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 12:29:32 user nova-compute[74960]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 12:29:32 user nova-compute[74960]:     <timer name="hpet" present="no"/>
Nov 03 12:29:32 user nova-compute[74960]:   </clock>
Nov 03 12:29:32 user nova-compute[74960]:   <cpu mode="custom" match="exact">
Nov 03 12:29:32 user nova-compute[74960]:     <model>Nehalem</model>
Nov 03 12:29:32 user nova-compute[74960]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 12:29:32 user nova-compute[74960]:   </cpu>
Nov 03 12:29:32 user nova-compute[74960]:   <devices>
Nov 03 12:29:32 user nova-compute[74960]:     <disk type="block" device="disk">
Nov 03 12:29:32 user nova-compute[74960]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 12:29:32 user nova-compute[74960]:       <source dev="/dev/sdc"/>
Nov 03 12:29:32 user nova-compute[74960]:       <target dev="vda" bus="virtio"/>
Nov 03 12:29:32 user nova-compute[74960]:       <serial>2f45e9d6-0169-4a92-8d8c-ee068f12905b</serial>
Nov 03 12:29:32 user nova-compute[74960]:     </disk>
Nov 03 12:29:32 user nova-compute[74960]:     <interface type="ethernet">
Nov 03 12:29:32 user nova-compute[74960]:       <mac address="fa:16:3e:d5:a8:23"/>
Nov 03 12:29:32 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:29:32 user nova-compute[74960]:       <mtu size="1442"/>
Nov 03 12:29:32 user nova-compute[74960]:       <target dev="tap78dc3436-7e"/>
Nov 03 12:29:32 user nova-compute[74960]:     </interface>
Nov 03 12:29:32 user nova-compute[74960]:     <serial type="pty">
Nov 03 12:29:32 user nova-compute[74960]:       <log file="/opt/stack/data/nova/instances/b1f7c162-c891-460a-8f98-3c7d6aeb6c49/console.log" append="off"/>
Nov 03 12:29:32 user nova-compute[74960]:     </serial>
Nov 03 12:29:32 user nova-compute[74960]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 12:29:32 user nova-compute[74960]:     <video>
Nov 03 12:29:32 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:29:32 user nova-compute[74960]:     </video>
Nov 03 12:29:32 user nova-compute[74960]:     <rng model="virtio">
Nov 03 12:29:32 user nova-compute[74960]:       <backend model="random">/dev/urandom</backend>
Nov 03 12:29:32 user nova-compute[74960]:     </rng>
Nov 03 12:29:32 user nova-compute[74960]:     <controller type="usb" index="0" model="none"/>
Nov 03 12:29:32 user nova-compute[74960]:     <memballoon model="virtio">
Nov 03 12:29:32 user nova-compute[74960]:       <stats period="10"/>
Nov 03 12:29:32 user nova-compute[74960]:     </memballoon>
Nov 03 12:29:32 user nova-compute[74960]:   </devices>
Nov 03 12:29:32 user nova-compute[74960]: </domain>
Nov 03 12:29:32 user nova-compute[74960]:  {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 12:29:32 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-e89e5522-989e-4f6b-a951-7538425d76b8 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:29:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1418707382',display_name='tempest-ServerActionsTestOtherA-server-1418707382',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1418707382',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPAz3yp3EJUzWOfLmandSosNLGmmwlB9ouRsIIfsq3JGgx5t4USdyA4JVa+9y90auzNv5yGmALwIZZVdM/LzHirlYfhZGk/2geYmtQFtCuY7KHcICqsra/ZIlPsAiI2BYw==',key_name='tempest-keypair-1847755946',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5320673ee4f0422989a3708915375cdb',ramdisk_id='',reservation_id='r-nb6ahum2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1651581249',owner_user_name='tempest-ServerActionsTestOtherA-1651581249-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:29:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60d8d224d7204ede84c09433a3d82d0f',uuid=b1f7c162-c891-460a-8f98-3c7d6aeb6c49,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "78dc3436-7e47-4513-b5fa-0fd25ab1baf9", "address": "fa:16:3e:d5:a8:23", "network": {"id": "9c5fae09-5df5-45a3-b9cd-7ac3763ba878", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1736223258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5320673ee4f0422989a3708915375cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78dc3436-7e", "ovs_interfaceid": "78dc3436-7e47-4513-b5fa-0fd25ab1baf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 12:29:32 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-e89e5522-989e-4f6b-a951-7538425d76b8 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Converting VIF {"id": "78dc3436-7e47-4513-b5fa-0fd25ab1baf9", "address": "fa:16:3e:d5:a8:23", "network": {"id": "9c5fae09-5df5-45a3-b9cd-7ac3763ba878", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1736223258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5320673ee4f0422989a3708915375cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78dc3436-7e", "ovs_interfaceid": "78dc3436-7e47-4513-b5fa-0fd25ab1baf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:29:32 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-e89e5522-989e-4f6b-a951-7538425d76b8 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:a8:23,bridge_name='br-int',has_traffic_filtering=True,id=78dc3436-7e47-4513-b5fa-0fd25ab1baf9,network=Network(9c5fae09-5df5-45a3-b9cd-7ac3763ba878),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78dc3436-7e') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:29:32 user nova-compute[74960]: DEBUG os_vif [None req-e89e5522-989e-4f6b-a951-7538425d76b8 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:a8:23,bridge_name='br-int',has_traffic_filtering=True,id=78dc3436-7e47-4513-b5fa-0fd25ab1baf9,network=Network(9c5fae09-5df5-45a3-b9cd-7ac3763ba878),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78dc3436-7e') {{(pid=74960) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 12:29:32 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:29:32 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:29:32 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 12:29:32 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:29:32 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5139d55b-0d13-52c3-b378-72147b6dfe64', '_type': 'linux-noop'}}, row=False) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:29:32 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:29:32 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:29:32 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:29:32 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap78dc3436-7e, may_exist=True, interface_attrs={}) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:29:32 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap78dc3436-7e, col_values=(('qos', UUID('f6f829fe-918f-4df4-874f-d1bffda482af')),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:29:32 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap78dc3436-7e, col_values=(('external_ids', {'iface-id': '78dc3436-7e47-4513-b5fa-0fd25ab1baf9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d5:a8:23', 'vm-uuid': 'b1f7c162-c891-460a-8f98-3c7d6aeb6c49'}),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:29:32 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:29:32 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:29:32 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:29:32 user nova-compute[74960]: INFO os_vif [None req-e89e5522-989e-4f6b-a951-7538425d76b8 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:a8:23,bridge_name='br-int',has_traffic_filtering=True,id=78dc3436-7e47-4513-b5fa-0fd25ab1baf9,network=Network(9c5fae09-5df5-45a3-b9cd-7ac3763ba878),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78dc3436-7e')
Nov 03 12:29:32 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-e89e5522-989e-4f6b-a951-7538425d76b8 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] No BDM found with device name vda, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:29:32 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-e89e5522-989e-4f6b-a951-7538425d76b8 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] No VIF found with MAC fa:16:3e:d5:a8:23, not building metadata {{(pid=74960) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 12:29:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:29:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:29:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:29:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:29:34 user nova-compute[74960]: DEBUG nova.compute.manager [req-ae441900-6c7c-413e-8bc3-3ae26fb3e0a5 req-38166791-f7da-4e2a-ae0e-a9adeec3baf1 service nova] [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49] Received event network-vif-plugged-78dc3436-7e47-4513-b5fa-0fd25ab1baf9 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:29:34 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-ae441900-6c7c-413e-8bc3-3ae26fb3e0a5 req-38166791-f7da-4e2a-ae0e-a9adeec3baf1 service nova] Acquiring lock "b1f7c162-c891-460a-8f98-3c7d6aeb6c49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:29:34 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-ae441900-6c7c-413e-8bc3-3ae26fb3e0a5 req-38166791-f7da-4e2a-ae0e-a9adeec3baf1 service nova] Lock "b1f7c162-c891-460a-8f98-3c7d6aeb6c49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:29:34 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-ae441900-6c7c-413e-8bc3-3ae26fb3e0a5 req-38166791-f7da-4e2a-ae0e-a9adeec3baf1 service nova] Lock "b1f7c162-c891-460a-8f98-3c7d6aeb6c49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:29:34 user nova-compute[74960]: DEBUG nova.compute.manager [req-ae441900-6c7c-413e-8bc3-3ae26fb3e0a5 req-38166791-f7da-4e2a-ae0e-a9adeec3baf1 service nova] [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49] No waiting events found dispatching network-vif-plugged-78dc3436-7e47-4513-b5fa-0fd25ab1baf9 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:29:34 user nova-compute[74960]: WARNING nova.compute.manager [req-ae441900-6c7c-413e-8bc3-3ae26fb3e0a5 req-38166791-f7da-4e2a-ae0e-a9adeec3baf1 service nova] [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49] Received unexpected event network-vif-plugged-78dc3436-7e47-4513-b5fa-0fd25ab1baf9 for instance with vm_state building and task_state spawning.
Nov 03 12:29:34 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:29:34 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:29:35 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-99af41a2-bdd0-4b96-93f9-f881254f19f8 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7a33549f-51ea-42d0-8c8a-67d9c74784fd is timed out.
Nov 03 12:29:35 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-99af41a2-bdd0-4b96-93f9-f881254f19f8 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Successfully detached device vdb from instance 7a33549f-51ea-42d0-8c8a-67d9c74784fd from the live domain config.
Nov 03 12:29:35 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99af41a2-bdd0-4b96-93f9-f881254f19f8 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] [instance: 7a33549f-51ea-42d0-8c8a-67d9c74784fd] calling os-brick to detach iSCSI Volume {{(pid=74960) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 12:29:35 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-99af41a2-bdd0-4b96-93f9-f881254f19f8 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9aa420acb0>, {'target_iqn': 'iqn.2010-10.org.openstack:64cd7bb2-1477-431a-b084-4339f203980c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jCmqxonG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:29:35 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-99af41a2-bdd0-4b96-93f9-f881254f19f8 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:29:35 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-99af41a2-bdd0-4b96-93f9-f881254f19f8 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:29:35 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-99af41a2-bdd0-4b96-93f9-f881254f19f8 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:29:35 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:29:35 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:29:35 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[d10725af-9300-42ff-a840-401dd5e07d00]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2f45e9d6-0169-4a92-8d8c-ee068f12905b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f33bebd3-3cc8-4db5-b35e-5d58d4dfe93f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:64cd7bb2-1477-431a-b084-4339f203980c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:29:35 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-99af41a2-bdd0-4b96-93f9-f881254f19f8 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 12:29:35 user nova-compute[74960]: No targets found.
Nov 03 12:29:35 user nova-compute[74960]: iSNS:
Nov 03 12:29:35 user nova-compute[74960]: No targets found.
Nov 03 12:29:35 user nova-compute[74960]: STATIC:
Nov 03 12:29:35 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:2f45e9d6-0169-4a92-8d8c-ee068f12905b
Nov 03 12:29:35 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:29:35 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:29:35 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:f33bebd3-3cc8-4db5-b35e-5d58d4dfe93f
Nov 03 12:29:35 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:29:35 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:29:35 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:64cd7bb2-1477-431a-b084-4339f203980c
Nov 03 12:29:35 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:29:35 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:29:35 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2
Nov 03 12:29:35 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:29:35 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:29:35 user nova-compute[74960]: FIRMWARE:
Nov 03 12:29:35 user nova-compute[74960]: No targets found.
Nov 03 12:29:35 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:29:35 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-99af41a2-bdd0-4b96-93f9-f881254f19f8 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 12:29:35 user nova-compute[74960]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 12:29:35 user nova-compute[74960]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74960) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 12:29:35 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-99af41a2-bdd0-4b96-93f9-f881254f19f8 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64cd7bb2-1477-431a-b084-4339f203980c', 0)] {{(pid=74960) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 12:29:35 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:29:35 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:29:35 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[a155ba0b-4f4b-44ba-afc9-2553d0542753]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f45e9d6-0169-4a92-8d8c-ee068f12905b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64cd7bb2-1477-431a-b084-4339f203980c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f33bebd3-3cc8-4db5-b35e-5d58d4dfe93f\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:29:35 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:29:35 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:29:35 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[91d45983-4c2d-4576-b2fe-327908dc6c5b]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64cd7bb2-1477-431a-b084-4339f203980c (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f33bebd3-3cc8-4db5-b35e-5d58d4dfe93f (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f45e9d6-0169-4a92-8d8c-ee068f12905b (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:29:35 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-99af41a2-bdd0-4b96-93f9-f881254f19f8 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64cd7bb2-1477-431a-b084-4339f203980c (non-flash)
Nov 03 12:29:35 user nova-compute[74960]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:29:35 user nova-compute[74960]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f33bebd3-3cc8-4db5-b35e-5d58d4dfe93f (non-flash)
Nov 03 12:29:35 user nova-compute[74960]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f45e9d6-0169-4a92-8d8c-ee068f12905b (non-flash)
Nov 03 12:29:35 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:29:35 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-99af41a2-bdd0-4b96-93f9-f881254f19f8 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64cd7bb2-1477-431a-b084-4339f203980c (non-flash)
Nov 03 12:29:35 user nova-compute[74960]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:29:35 user nova-compute[74960]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f33bebd3-3cc8-4db5-b35e-5d58d4dfe93f (non-flash)
Nov 03 12:29:35 user nova-compute[74960]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f45e9d6-0169-4a92-8d8c-ee068f12905b (non-flash)
Nov 03 12:29:35 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:29:35 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-99af41a2-bdd0-4b96-93f9-f881254f19f8 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9a8c4ee830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64cd7bb2-1477-431a-b084-4339f203980c'): ({'sdb'}, set())}) {{(pid=74960) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 12:29:35 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-99af41a2-bdd0-4b96-93f9-f881254f19f8 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Removing single pathed devices sdb {{(pid=74960) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 12:29:35 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:29:35 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:29:35 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eb4b236-505e-4c6e-8c1c-02282a20d22d]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:29:35 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:29:35 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:29:35 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[beec683b-7852-4654-979a-d8cf0f4b6c50]: (4, ('ok\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:29:35 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-99af41a2-bdd0-4b96-93f9-f881254f19f8 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Flushing IO for device /dev/sdb {{(pid=74960) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 12:29:35 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:29:35 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:29:35 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[0750a973-6b29-400b-85a4-adf026b95f20]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:29:35 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-99af41a2-bdd0-4b96-93f9-f881254f19f8 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74960) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 12:29:35 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:29:35 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.033s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:29:35 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[708f6cb4-85af-42c2-8f80-8ba41fa46ab7]: (4, ('1', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:29:35 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-99af41a2-bdd0-4b96-93f9-f881254f19f8 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74960) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 12:29:35 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-99af41a2-bdd0-4b96-93f9-f881254f19f8 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] SCSI volumes sdb have been removed. {{(pid=74960) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 12:29:35 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-99af41a2-bdd0-4b96-93f9-f881254f19f8 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64cd7bb2-1477-431a-b084-4339f203980c')] {{(pid=74960) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 12:29:35 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64cd7bb2-1477-431a-b084-4339f203980c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:29:35 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64cd7bb2-1477-431a-b084-4339f203980c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:29:35 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[70962561-c5a6-4b4c-a75a-3bafa840c795]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:29:35 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-99af41a2-bdd0-4b96-93f9-f881254f19f8 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:29:35 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64cd7bb2-1477-431a-b084-4339f203980c -p 172.16.0.220:3260 --logout {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:29:35 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64cd7bb2-1477-431a-b084-4339f203980c -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:29:35 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[a659dda5-c940-49de-8ea4-ccbb675769e2]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:64cd7bb2-1477-431a-b084-4339f203980c, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:64cd7bb2-1477-431a-b084-4339f203980c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:29:35 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-99af41a2-bdd0-4b96-93f9-f881254f19f8 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:64cd7bb2-1477-431a-b084-4339f203980c, portal: 172.16.0.220,3260]
Nov 03 12:29:35 user nova-compute[74960]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:64cd7bb2-1477-431a-b084-4339f203980c, portal: 172.16.0.220,3260] successful.
Nov 03 12:29:35 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:29:35 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64cd7bb2-1477-431a-b084-4339f203980c -p 172.16.0.220:3260 --op delete {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:29:35 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64cd7bb2-1477-431a-b084-4339f203980c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:29:35 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3fddc6c-5905-4b2b-8bf2-f4678997e0a9]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:29:35 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-99af41a2-bdd0-4b96-93f9-f881254f19f8 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:29:35 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-99af41a2-bdd0-4b96-93f9-f881254f19f8 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:29:35 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-99af41a2-bdd0-4b96-93f9-f881254f19f8 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] <== disconnect_volume: return (306ms) None {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:29:35 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99af41a2-bdd0-4b96-93f9-f881254f19f8 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] [instance: 7a33549f-51ea-42d0-8c8a-67d9c74784fd] Disconnected iSCSI Volume {{(pid=74960) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 12:29:35 user nova-compute[74960]: DEBUG nova.compute.manager [None req-e89e5522-989e-4f6b-a951-7538425d76b8 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49] Instance event wait completed in 0 seconds for  {{(pid=74960) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 12:29:35 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-e89e5522-989e-4f6b-a951-7538425d76b8 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49] Guest created on hypervisor {{(pid=74960) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 12:29:35 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49] Instance spawned successfully.
Nov 03 12:29:35 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-e89e5522-989e-4f6b-a951-7538425d76b8 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 12:29:35 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-e89e5522-989e-4f6b-a951-7538425d76b8 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49] Found default for hw_cdrom_bus of ide {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:29:35 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-e89e5522-989e-4f6b-a951-7538425d76b8 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49] Found default for hw_disk_bus of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:29:35 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-e89e5522-989e-4f6b-a951-7538425d76b8 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49] Found default for hw_input_bus of None {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:29:35 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-e89e5522-989e-4f6b-a951-7538425d76b8 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49] Found default for hw_pointer_model of None {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:29:35 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-e89e5522-989e-4f6b-a951-7538425d76b8 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49] Found default for hw_video_model of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:29:35 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-e89e5522-989e-4f6b-a951-7538425d76b8 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49] Found default for hw_vif_model of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:29:36 user nova-compute[74960]: INFO nova.compute.manager [None req-e89e5522-989e-4f6b-a951-7538425d76b8 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49] Took 4.89 seconds to spawn the instance on the hypervisor.
Nov 03 12:29:36 user nova-compute[74960]: DEBUG nova.compute.manager [None req-e89e5522-989e-4f6b-a951-7538425d76b8 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49] Checking state {{(pid=74960) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 12:29:36 user nova-compute[74960]: DEBUG nova.compute.manager [req-fed12c67-4811-4d00-a286-359e882b05bc req-7e891d75-dc78-4f00-a2e4-4f2c13f6b6d4 service nova] [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49] Received event network-vif-plugged-78dc3436-7e47-4513-b5fa-0fd25ab1baf9 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:29:36 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-fed12c67-4811-4d00-a286-359e882b05bc req-7e891d75-dc78-4f00-a2e4-4f2c13f6b6d4 service nova] Acquiring lock "b1f7c162-c891-460a-8f98-3c7d6aeb6c49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:29:36 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-fed12c67-4811-4d00-a286-359e882b05bc req-7e891d75-dc78-4f00-a2e4-4f2c13f6b6d4 service nova] Lock "b1f7c162-c891-460a-8f98-3c7d6aeb6c49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:29:36 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-fed12c67-4811-4d00-a286-359e882b05bc req-7e891d75-dc78-4f00-a2e4-4f2c13f6b6d4 service nova] Lock "b1f7c162-c891-460a-8f98-3c7d6aeb6c49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:29:36 user nova-compute[74960]: DEBUG nova.compute.manager [req-fed12c67-4811-4d00-a286-359e882b05bc req-7e891d75-dc78-4f00-a2e4-4f2c13f6b6d4 service nova] [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49] No waiting events found dispatching network-vif-plugged-78dc3436-7e47-4513-b5fa-0fd25ab1baf9 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:29:36 user nova-compute[74960]: WARNING nova.compute.manager [req-fed12c67-4811-4d00-a286-359e882b05bc req-7e891d75-dc78-4f00-a2e4-4f2c13f6b6d4 service nova] [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49] Received unexpected event network-vif-plugged-78dc3436-7e47-4513-b5fa-0fd25ab1baf9 for instance with vm_state building and task_state spawning.
Nov 03 12:29:36 user nova-compute[74960]: INFO nova.compute.manager [None req-e89e5522-989e-4f6b-a951-7538425d76b8 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49] Took 26.39 seconds to build instance.
Nov 03 12:29:36 user nova-compute[74960]: DEBUG nova.objects.instance [None req-99af41a2-bdd0-4b96-93f9-f881254f19f8 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Lazy-loading 'flavor' on Instance uuid 7a33549f-51ea-42d0-8c8a-67d9c74784fd {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:29:36 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-e89e5522-989e-4f6b-a951-7538425d76b8 tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Lock "b1f7c162-c891-460a-8f98-3c7d6aeb6c49" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 26.504s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:29:36 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-99af41a2-bdd0-4b96-93f9-f881254f19f8 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Lock "7a33549f-51ea-42d0-8c8a-67d9c74784fd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.788s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:29:37 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:29:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:29:42 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:29:44 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:29:45 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:29:45 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:29:47 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:29:47 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Starting heal instance info cache {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 12:29:47 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Rebuilding the list of instances to heal {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 03 12:29:47 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "refresh_cache-7769e3c5-136f-4282-8e3e-224e3a80922c" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:29:47 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquired lock "refresh_cache-7769e3c5-136f-4282-8e3e-224e3a80922c" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:29:47 user nova-compute[74960]: DEBUG nova.network.neutron [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: 7769e3c5-136f-4282-8e3e-224e3a80922c] Forcefully refreshing network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 12:29:47 user nova-compute[74960]: DEBUG nova.objects.instance [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lazy-loading 'info_cache' on Instance uuid 7769e3c5-136f-4282-8e3e-224e3a80922c {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:29:47 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:29:48 user nova-compute[74960]: DEBUG nova.network.neutron [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: 7769e3c5-136f-4282-8e3e-224e3a80922c] Updating instance_info_cache with network_info: [{"id": "8fe46c5c-9093-43c4-8b0d-baf325c2e18b", "address": "fa:16:3e:ba:d5:3a", "network": {"id": "9c5fae09-5df5-45a3-b9cd-7ac3763ba878", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1736223258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5320673ee4f0422989a3708915375cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fe46c5c-90", "ovs_interfaceid": "8fe46c5c-9093-43c4-8b0d-baf325c2e18b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:29:48 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Releasing lock "refresh_cache-7769e3c5-136f-4282-8e3e-224e3a80922c" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:29:48 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: 7769e3c5-136f-4282-8e3e-224e3a80922c] Updated the network info_cache for instance {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 12:29:48 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:29:51 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:29:51 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:29:51 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:29:51 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74960) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 12:29:51 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:29:51 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:29:51 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:29:51 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:29:51 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Auditing locally available compute resources for user (node: user) {{(pid=74960) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 12:29:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9951fab7-4984-408e-94ca-11eab615ff25/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:29:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9951fab7-4984-408e-94ca-11eab615ff25/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:29:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9951fab7-4984-408e-94ca-11eab615ff25/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:29:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9951fab7-4984-408e-94ca-11eab615ff25/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:29:51 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74960) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 12:29:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7769e3c5-136f-4282-8e3e-224e3a80922c/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:29:52 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7769e3c5-136f-4282-8e3e-224e3a80922c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:29:52 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7769e3c5-136f-4282-8e3e-224e3a80922c/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:29:52 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7769e3c5-136f-4282-8e3e-224e3a80922c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:29:52 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be38c803-d97c-4939-9852-e8db1c44bb65/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:29:52 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be38c803-d97c-4939-9852-e8db1c44bb65/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:29:52 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be38c803-d97c-4939-9852-e8db1c44bb65/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:29:52 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:29:52 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be38c803-d97c-4939-9852-e8db1c44bb65/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:29:52 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74960) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 12:29:52 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fffd1dd7-b8e8-435c-bdfe-6c5001b21daf/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:29:52 user nova-compute[74960]: INFO nova.compute.manager [None req-b9cd0691-bbdc-44c0-a9cd-401e91fce4fb tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] Rescuing
Nov 03 12:29:52 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-b9cd0691-bbdc-44c0-a9cd-401e91fce4fb tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Acquiring lock "refresh_cache-a6199681-f85e-4f55-966b-6ab3f17cd640" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:29:52 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-b9cd0691-bbdc-44c0-a9cd-401e91fce4fb tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Acquired lock "refresh_cache-a6199681-f85e-4f55-966b-6ab3f17cd640" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:29:52 user nova-compute[74960]: DEBUG nova.network.neutron [None req-b9cd0691-bbdc-44c0-a9cd-401e91fce4fb tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] Building network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 12:29:52 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fffd1dd7-b8e8-435c-bdfe-6c5001b21daf/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:29:52 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fffd1dd7-b8e8-435c-bdfe-6c5001b21daf/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:29:53 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fffd1dd7-b8e8-435c-bdfe-6c5001b21daf/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:29:53 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f15f5f-8afa-4d7b-bb45-5887184f9ee5/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:29:53 user nova-compute[74960]: DEBUG nova.network.neutron [None req-b9cd0691-bbdc-44c0-a9cd-401e91fce4fb tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] Updating instance_info_cache with network_info: [{"id": "40976ae5-5f49-4d8e-abd7-04dc0ce8f319", "address": "fa:16:3e:7c:40:1d", "network": {"id": "dec66832-56d5-4d68-b11f-8e8eed38f045", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-79099436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc95d68d5e147e1953c855169b17091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40976ae5-5f", "ovs_interfaceid": "40976ae5-5f49-4d8e-abd7-04dc0ce8f319", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:29:53 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-b9cd0691-bbdc-44c0-a9cd-401e91fce4fb tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Releasing lock "refresh_cache-a6199681-f85e-4f55-966b-6ab3f17cd640" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:29:53 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:29:53 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f15f5f-8afa-4d7b-bb45-5887184f9ee5/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:29:53 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f15f5f-8afa-4d7b-bb45-5887184f9ee5/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:29:53 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:29:53 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:29:53 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f15f5f-8afa-4d7b-bb45-5887184f9ee5/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:29:53 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6cbb630-254f-4c56-9cf9-47d751c703be/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:29:53 user nova-compute[74960]: DEBUG nova.compute.manager [req-6d078f1b-c3c0-443e-87ca-319ce3b52ae2 req-72ef47eb-914e-434e-8880-4f6fa511cc09 service nova] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] Received event network-vif-unplugged-40976ae5-5f49-4d8e-abd7-04dc0ce8f319 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:29:53 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-6d078f1b-c3c0-443e-87ca-319ce3b52ae2 req-72ef47eb-914e-434e-8880-4f6fa511cc09 service nova] Acquiring lock "a6199681-f85e-4f55-966b-6ab3f17cd640-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:29:53 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-6d078f1b-c3c0-443e-87ca-319ce3b52ae2 req-72ef47eb-914e-434e-8880-4f6fa511cc09 service nova] Lock "a6199681-f85e-4f55-966b-6ab3f17cd640-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:29:53 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-6d078f1b-c3c0-443e-87ca-319ce3b52ae2 req-72ef47eb-914e-434e-8880-4f6fa511cc09 service nova] Lock "a6199681-f85e-4f55-966b-6ab3f17cd640-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:29:53 user nova-compute[74960]: DEBUG nova.compute.manager [req-6d078f1b-c3c0-443e-87ca-319ce3b52ae2 req-72ef47eb-914e-434e-8880-4f6fa511cc09 service nova] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] No waiting events found dispatching network-vif-unplugged-40976ae5-5f49-4d8e-abd7-04dc0ce8f319 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:29:53 user nova-compute[74960]: WARNING nova.compute.manager [req-6d078f1b-c3c0-443e-87ca-319ce3b52ae2 req-72ef47eb-914e-434e-8880-4f6fa511cc09 service nova] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] Received unexpected event network-vif-unplugged-40976ae5-5f49-4d8e-abd7-04dc0ce8f319 for instance with vm_state active and task_state rescuing.
Nov 03 12:29:53 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6cbb630-254f-4c56-9cf9-47d751c703be/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:29:53 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:29:53 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6cbb630-254f-4c56-9cf9-47d751c703be/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:29:53 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:29:53 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6cbb630-254f-4c56-9cf9-47d751c703be/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:29:54 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74960) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 12:29:54 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] Instance destroyed successfully.
Nov 03 12:29:54 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a33549f-51ea-42d0-8c8a-67d9c74784fd/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:29:54 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-b9cd0691-bbdc-44c0-a9cd-401e91fce4fb tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] Attempting a stable device rescue
Nov 03 12:29:54 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-b9cd0691-bbdc-44c0-a9cd-401e91fce4fb tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74960) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 03 12:29:54 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-b9cd0691-bbdc-44c0-a9cd-401e91fce4fb tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] Instance directory exists: not creating {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 03 12:29:54 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-b9cd0691-bbdc-44c0-a9cd-401e91fce4fb tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] Creating image(s)
Nov 03 12:29:54 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-b9cd0691-bbdc-44c0-a9cd-401e91fce4fb tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Acquiring lock "/opt/stack/data/nova/instances/a6199681-f85e-4f55-966b-6ab3f17cd640/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:29:54 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-b9cd0691-bbdc-44c0-a9cd-401e91fce4fb tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Lock "/opt/stack/data/nova/instances/a6199681-f85e-4f55-966b-6ab3f17cd640/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:29:54 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-b9cd0691-bbdc-44c0-a9cd-401e91fce4fb tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Lock "/opt/stack/data/nova/instances/a6199681-f85e-4f55-966b-6ab3f17cd640/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:29:54 user nova-compute[74960]: DEBUG nova.objects.instance [None req-b9cd0691-bbdc-44c0-a9cd-401e91fce4fb tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Lazy-loading 'trusted_certs' on Instance uuid a6199681-f85e-4f55-966b-6ab3f17cd640 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:29:54 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-b9cd0691-bbdc-44c0-a9cd-401e91fce4fb tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Acquiring lock "79688a154c30e83742a9b59c51b2a68a7c95a9b0" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:29:54 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-b9cd0691-bbdc-44c0-a9cd-401e91fce4fb tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Lock "79688a154c30e83742a9b59c51b2a68a7c95a9b0" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:29:54 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a33549f-51ea-42d0-8c8a-67d9c74784fd/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:29:54 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a33549f-51ea-42d0-8c8a-67d9c74784fd/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:29:55 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-b9cd0691-bbdc-44c0-a9cd-401e91fce4fb tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/79688a154c30e83742a9b59c51b2a68a7c95a9b0.part --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:29:55 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a33549f-51ea-42d0-8c8a-67d9c74784fd/disk --force-share --output=json" returned: 0 in 1.075s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:29:55 user nova-compute[74960]: DEBUG nova.compute.manager [req-bb0334df-e89f-402c-8fbf-e91c80c130a1 req-a47f2b56-ebee-4df1-abe5-3e2add3387b1 service nova] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] Received event network-vif-plugged-40976ae5-5f49-4d8e-abd7-04dc0ce8f319 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:29:55 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-bb0334df-e89f-402c-8fbf-e91c80c130a1 req-a47f2b56-ebee-4df1-abe5-3e2add3387b1 service nova] Acquiring lock "a6199681-f85e-4f55-966b-6ab3f17cd640-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:29:55 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-bb0334df-e89f-402c-8fbf-e91c80c130a1 req-a47f2b56-ebee-4df1-abe5-3e2add3387b1 service nova] Lock "a6199681-f85e-4f55-966b-6ab3f17cd640-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:29:55 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-bb0334df-e89f-402c-8fbf-e91c80c130a1 req-a47f2b56-ebee-4df1-abe5-3e2add3387b1 service nova] Lock "a6199681-f85e-4f55-966b-6ab3f17cd640-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:29:55 user nova-compute[74960]: DEBUG nova.compute.manager [req-bb0334df-e89f-402c-8fbf-e91c80c130a1 req-a47f2b56-ebee-4df1-abe5-3e2add3387b1 service nova] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] No waiting events found dispatching network-vif-plugged-40976ae5-5f49-4d8e-abd7-04dc0ce8f319 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:29:55 user nova-compute[74960]: WARNING nova.compute.manager [req-bb0334df-e89f-402c-8fbf-e91c80c130a1 req-a47f2b56-ebee-4df1-abe5-3e2add3387b1 service nova] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] Received unexpected event network-vif-plugged-40976ae5-5f49-4d8e-abd7-04dc0ce8f319 for instance with vm_state active and task_state rescuing.
Nov 03 12:29:55 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-b9cd0691-bbdc-44c0-a9cd-401e91fce4fb tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/79688a154c30e83742a9b59c51b2a68a7c95a9b0.part --force-share --output=json" returned: 0 in 0.535s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:29:55 user nova-compute[74960]: DEBUG nova.virt.images [None req-b9cd0691-bbdc-44c0-a9cd-401e91fce4fb tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] baa68140-f3da-4609-b195-f2d9b2a928ad was qcow2, converting to raw {{(pid=74960) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 03 12:29:55 user nova-compute[74960]: DEBUG nova.privsep.utils [None req-b9cd0691-bbdc-44c0-a9cd-401e91fce4fb tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74960) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 03 12:29:55 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-b9cd0691-bbdc-44c0-a9cd-401e91fce4fb tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/79688a154c30e83742a9b59c51b2a68a7c95a9b0.part /opt/stack/data/nova/instances/_base/79688a154c30e83742a9b59c51b2a68a7c95a9b0.converted {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:29:55 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:29:55 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:29:55 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Hypervisor/Node resource view: name=user free_ram=7774MB free_disk=25.09752655029297GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74960) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 12:29:55 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:29:55 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:29:55 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-cb73ece2-52d7-4fdb-a2ad-7d8c69f18c02 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Acquiring lock "208570e4-1b11-486b-a79e-4b4eafc26af2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:29:55 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-cb73ece2-52d7-4fdb-a2ad-7d8c69f18c02 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Lock "208570e4-1b11-486b-a79e-4b4eafc26af2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:29:55 user nova-compute[74960]: DEBUG nova.compute.manager [None req-cb73ece2-52d7-4fdb-a2ad-7d8c69f18c02 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] [instance: 208570e4-1b11-486b-a79e-4b4eafc26af2] Starting instance... {{(pid=74960) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 12:29:56 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 7769e3c5-136f-4282-8e3e-224e3a80922c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:29:56 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance fffd1dd7-b8e8-435c-bdfe-6c5001b21daf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:29:56 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 9951fab7-4984-408e-94ca-11eab615ff25 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:29:56 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 87f15f5f-8afa-4d7b-bb45-5887184f9ee5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:29:56 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 7a33549f-51ea-42d0-8c8a-67d9c74784fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:29:56 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance be38c803-d97c-4939-9852-e8db1c44bb65 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:29:56 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance a6199681-f85e-4f55-966b-6ab3f17cd640 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:29:56 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance e6cbb630-254f-4c56-9cf9-47d751c703be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:29:56 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance b1f7c162-c891-460a-8f98-3c7d6aeb6c49 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:29:56 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 208570e4-1b11-486b-a79e-4b4eafc26af2 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 03 12:29:56 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74960) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 12:29:56 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74960) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 12:29:56 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-cb73ece2-52d7-4fdb-a2ad-7d8c69f18c02 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:29:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-b9cd0691-bbdc-44c0-a9cd-401e91fce4fb tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/79688a154c30e83742a9b59c51b2a68a7c95a9b0.part /opt/stack/data/nova/instances/_base/79688a154c30e83742a9b59c51b2a68a7c95a9b0.converted" returned: 0 in 0.547s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:29:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-b9cd0691-bbdc-44c0-a9cd-401e91fce4fb tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/79688a154c30e83742a9b59c51b2a68a7c95a9b0.converted --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:29:56 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:29:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-b9cd0691-bbdc-44c0-a9cd-401e91fce4fb tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/79688a154c30e83742a9b59c51b2a68a7c95a9b0.converted --force-share --output=json" returned: 0 in 0.208s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:29:56 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-b9cd0691-bbdc-44c0-a9cd-401e91fce4fb tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Lock "79688a154c30e83742a9b59c51b2a68a7c95a9b0" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.397s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:29:56 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-b9cd0691-bbdc-44c0-a9cd-401e91fce4fb tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Acquiring lock "79688a154c30e83742a9b59c51b2a68a7c95a9b0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:29:56 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-b9cd0691-bbdc-44c0-a9cd-401e91fce4fb tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Lock "79688a154c30e83742a9b59c51b2a68a7c95a9b0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:29:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-b9cd0691-bbdc-44c0-a9cd-401e91fce4fb tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/79688a154c30e83742a9b59c51b2a68a7c95a9b0 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:29:56 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:29:56 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Compute_service record updated for user:user {{(pid=74960) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 12:29:56 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.844s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:29:56 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-cb73ece2-52d7-4fdb-a2ad-7d8c69f18c02 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.552s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:29:56 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-cb73ece2-52d7-4fdb-a2ad-7d8c69f18c02 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74960) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 12:29:56 user nova-compute[74960]: INFO nova.compute.claims [None req-cb73ece2-52d7-4fdb-a2ad-7d8c69f18c02 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] [instance: 208570e4-1b11-486b-a79e-4b4eafc26af2] Claim successful on node user
Nov 03 12:29:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-b9cd0691-bbdc-44c0-a9cd-401e91fce4fb tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/79688a154c30e83742a9b59c51b2a68a7c95a9b0 --force-share --output=json" returned: 0 in 0.189s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:29:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-b9cd0691-bbdc-44c0-a9cd-401e91fce4fb tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/79688a154c30e83742a9b59c51b2a68a7c95a9b0,backing_fmt=raw /opt/stack/data/nova/instances/a6199681-f85e-4f55-966b-6ab3f17cd640/disk.rescue {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:29:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-b9cd0691-bbdc-44c0-a9cd-401e91fce4fb tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/79688a154c30e83742a9b59c51b2a68a7c95a9b0,backing_fmt=raw /opt/stack/data/nova/instances/a6199681-f85e-4f55-966b-6ab3f17cd640/disk.rescue" returned: 0 in 0.055s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:29:56 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-b9cd0691-bbdc-44c0-a9cd-401e91fce4fb tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Lock "79688a154c30e83742a9b59c51b2a68a7c95a9b0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:29:56 user nova-compute[74960]: DEBUG nova.objects.instance [None req-b9cd0691-bbdc-44c0-a9cd-401e91fce4fb tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Lazy-loading 'migration_context' on Instance uuid a6199681-f85e-4f55-966b-6ab3f17cd640 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:29:56 user nova-compute[74960]: DEBUG nova.objects.base [None req-b9cd0691-bbdc-44c0-a9cd-401e91fce4fb tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Object Instance<a6199681-f85e-4f55-966b-6ab3f17cd640> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74960) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 12:29:56 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-b9cd0691-bbdc-44c0-a9cd-401e91fce4fb tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] Created local disks {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 12:29:56 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-b9cd0691-bbdc-44c0-a9cd-401e91fce4fb tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] Start _get_guest_xml network_info=[{"id": "40976ae5-5f49-4d8e-abd7-04dc0ce8f319", "address": "fa:16:3e:7c:40:1d", "network": {"id": "dec66832-56d5-4d68-b11f-8e8eed38f045", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-79099436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-79099436-network", "vif_mac": "fa:16:3e:7c:40:1d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc95d68d5e147e1953c855169b17091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40976ae5-5f", "ovs_interfaceid": "40976ae5-5f49-4d8e-abd7-04dc0ce8f319", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=549f51ba-ac69-494b-8de1-34635aa2d7cf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='63ee9c80c632442fb0379f47b784bd20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T12:13:04Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'baa68140-f3da-4609-b195-f2d9b2a928ad', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BNDmfTXv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': 'a6199681-f85e-4f55-966b-6ab3f17cd640', 'attached_at': '', 'detached_at': '', 'volume_id': 'ef532415-0078-4fe2-8af5-73cada8b32a2', 'serial': 'ef532415-0078-4fe2-8af5-73cada8b32a2'}, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'device_type': 'disk', 'attachment_id': '14e3fbc0-1650-40e1-8eb6-9cf0dffd093d', 'boot_index': 0, 'guest_format': None, 'volume_type': None} {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 12:29:56 user nova-compute[74960]: DEBUG nova.objects.instance [None req-b9cd0691-bbdc-44c0-a9cd-401e91fce4fb tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Lazy-loading 'resources' on Instance uuid a6199681-f85e-4f55-966b-6ab3f17cd640 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:29:56 user nova-compute[74960]: DEBUG nova.objects.base [None req-b9cd0691-bbdc-44c0-a9cd-401e91fce4fb tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Object Instance<a6199681-f85e-4f55-966b-6ab3f17cd640> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74960) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 12:29:56 user nova-compute[74960]: DEBUG nova.objects.instance [None req-b9cd0691-bbdc-44c0-a9cd-401e91fce4fb tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Lazy-loading 'numa_topology' on Instance uuid a6199681-f85e-4f55-966b-6ab3f17cd640 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:29:56 user nova-compute[74960]: DEBUG nova.objects.base [None req-b9cd0691-bbdc-44c0-a9cd-401e91fce4fb tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Object Instance<a6199681-f85e-4f55-966b-6ab3f17cd640> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74960) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 12:29:56 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-b9cd0691-bbdc-44c0-a9cd-401e91fce4fb tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:29:56 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-b9cd0691-bbdc-44c0-a9cd-401e91fce4fb tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:29:56 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-b9cd0691-bbdc-44c0-a9cd-401e91fce4fb tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 12:29:56 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-b9cd0691-bbdc-44c0-a9cd-401e91fce4fb tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] CPU controller missing on host. {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 12:29:56 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-b9cd0691-bbdc-44c0-a9cd-401e91fce4fb tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 12:29:56 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-b9cd0691-bbdc-44c0-a9cd-401e91fce4fb tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] CPU controller found on host. {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 12:29:56 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-b9cd0691-bbdc-44c0-a9cd-401e91fce4fb tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74960) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 12:29:56 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-b9cd0691-bbdc-44c0-a9cd-401e91fce4fb tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=549f51ba-ac69-494b-8de1-34635aa2d7cf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='63ee9c80c632442fb0379f47b784bd20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T12:13:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 12:29:56 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-b9cd0691-bbdc-44c0-a9cd-401e91fce4fb tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Flavor limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 12:29:56 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-b9cd0691-bbdc-44c0-a9cd-401e91fce4fb tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Image limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 12:29:56 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-b9cd0691-bbdc-44c0-a9cd-401e91fce4fb tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Flavor pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 12:29:56 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-b9cd0691-bbdc-44c0-a9cd-401e91fce4fb tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Image pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 12:29:56 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-b9cd0691-bbdc-44c0-a9cd-401e91fce4fb tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 12:29:56 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-b9cd0691-bbdc-44c0-a9cd-401e91fce4fb tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 12:29:56 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-b9cd0691-bbdc-44c0-a9cd-401e91fce4fb tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 12:29:56 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-b9cd0691-bbdc-44c0-a9cd-401e91fce4fb tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Got 1 possible topologies {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 12:29:56 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-b9cd0691-bbdc-44c0-a9cd-401e91fce4fb tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 12:29:56 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-b9cd0691-bbdc-44c0-a9cd-401e91fce4fb tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 12:29:56 user nova-compute[74960]: DEBUG nova.objects.instance [None req-b9cd0691-bbdc-44c0-a9cd-401e91fce4fb tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Lazy-loading 'vcpu_model' on Instance uuid a6199681-f85e-4f55-966b-6ab3f17cd640 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:29:56 user nova-compute[74960]: DEBUG nova.objects.base [None req-b9cd0691-bbdc-44c0-a9cd-401e91fce4fb tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Object Instance<a6199681-f85e-4f55-966b-6ab3f17cd640> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74960) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 12:29:56 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9cd0691-bbdc-44c0-a9cd-401e91fce4fb tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] Calling os-brick to attach iSCSI Volume {{(pid=74960) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 12:29:57 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9cd0691-bbdc-44c0-a9cd-401e91fce4fb tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9aa420acb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BNDmfTXv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:29:57 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-b9cd0691-bbdc-44c0-a9cd-401e91fce4fb tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:29:57 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-b9cd0691-bbdc-44c0-a9cd-401e91fce4fb tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:29:57 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-b9cd0691-bbdc-44c0-a9cd-401e91fce4fb tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:29:57 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-b9cd0691-bbdc-44c0-a9cd-401e91fce4fb tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:29:57 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-b9cd0691-bbdc-44c0-a9cd-401e91fce4fb tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:29:57 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-b9cd0691-bbdc-44c0-a9cd-401e91fce4fb tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:29:57 user nova-compute[74960]: INFO os_brick.initiator.connectors.iscsi [None req-b9cd0691-bbdc-44c0-a9cd-401e91fce4fb tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 12:29:57 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 -p 172.16.0.220:3260 {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:29:57 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:29:57 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa74180e-dc53-4718-8ae9-1d3294a07b29]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = BNDmfTXv\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:29:57 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9cd0691-bbdc-44c0-a9cd-401e91fce4fb tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 03 12:29:57 user nova-compute[74960]: node.name = iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2
Nov 03 12:29:57 user nova-compute[74960]: node.tpgt = -1
Nov 03 12:29:57 user nova-compute[74960]: node.startup = automatic
Nov 03 12:29:57 user nova-compute[74960]: node.leading_login = No
Nov 03 12:29:57 user nova-compute[74960]: iface.iscsi_ifacename = default
Nov 03 12:29:57 user nova-compute[74960]: iface.net_ifacename = <empty>
Nov 03 12:29:57 user nova-compute[74960]: iface.ipaddress = <empty>
Nov 03 12:29:57 user nova-compute[74960]: iface.prefix_len = 0
Nov 03 12:29:57 user nova-compute[74960]: iface.hwaddress = <empty>
Nov 03 12:29:57 user nova-compute[74960]: iface.transport_name = tcp
Nov 03 12:29:57 user nova-compute[74960]: iface.initiatorname = <empty>
Nov 03 12:29:57 user nova-compute[74960]: iface.state = <empty>
Nov 03 12:29:57 user nova-compute[74960]: iface.vlan_id = 0
Nov 03 12:29:57 user nova-compute[74960]: iface.vlan_priority = 0
Nov 03 12:29:57 user nova-compute[74960]: iface.vlan_state = <empty>
Nov 03 12:29:57 user nova-compute[74960]: iface.iface_num = 0
Nov 03 12:29:57 user nova-compute[74960]: iface.mtu = 0
Nov 03 12:29:57 user nova-compute[74960]: iface.port = 0
Nov 03 12:29:57 user nova-compute[74960]: iface.bootproto = <empty>
Nov 03 12:29:57 user nova-compute[74960]: iface.subnet_mask = <empty>
Nov 03 12:29:57 user nova-compute[74960]: iface.gateway = <empty>
Nov 03 12:29:57 user nova-compute[74960]: iface.dhcp_alt_client_id_state = <empty>
Nov 03 12:29:57 user nova-compute[74960]: iface.dhcp_alt_client_id = <empty>
Nov 03 12:29:57 user nova-compute[74960]: iface.dhcp_dns = <empty>
Nov 03 12:29:57 user nova-compute[74960]: iface.dhcp_learn_iqn = <empty>
Nov 03 12:29:57 user nova-compute[74960]: iface.dhcp_req_vendor_id_state = <empty>
Nov 03 12:29:57 user nova-compute[74960]: iface.dhcp_vendor_id_state = <empty>
Nov 03 12:29:57 user nova-compute[74960]: iface.dhcp_vendor_id = <empty>
Nov 03 12:29:57 user nova-compute[74960]: iface.dhcp_slp_da = <empty>
Nov 03 12:29:57 user nova-compute[74960]: iface.fragmentation = <empty>
Nov 03 12:29:57 user nova-compute[74960]: iface.gratuitous_arp = <empty>
Nov 03 12:29:57 user nova-compute[74960]: iface.incoming_forwarding = <empty>
Nov 03 12:29:57 user nova-compute[74960]: iface.tos_state = <empty>
Nov 03 12:29:57 user nova-compute[74960]: iface.tos = 0
Nov 03 12:29:57 user nova-compute[74960]: iface.ttl = 0
Nov 03 12:29:57 user nova-compute[74960]: iface.delayed_ack = <empty>
Nov 03 12:29:57 user nova-compute[74960]: iface.tcp_nagle = <empty>
Nov 03 12:29:57 user nova-compute[74960]: iface.tcp_wsf_state = <empty>
Nov 03 12:29:57 user nova-compute[74960]: iface.tcp_wsf = 0
Nov 03 12:29:57 user nova-compute[74960]: iface.tcp_timer_scale = 0
Nov 03 12:29:57 user nova-compute[74960]: iface.tcp_timestamp = <empty>
Nov 03 12:29:57 user nova-compute[74960]: iface.redirect = <empty>
Nov 03 12:29:57 user nova-compute[74960]: iface.def_task_mgmt_timeout = 0
Nov 03 12:29:57 user nova-compute[74960]: iface.header_digest = <empty>
Nov 03 12:29:57 user nova-compute[74960]: iface.data_digest = <empty>
Nov 03 12:29:57 user nova-compute[74960]: iface.immediate_data = <empty>
Nov 03 12:29:57 user nova-compute[74960]: iface.initial_r2t = <empty>
Nov 03 12:29:57 user nova-compute[74960]: iface.data_seq_inorder = <empty>
Nov 03 12:29:57 user nova-compute[74960]: iface.data_pdu_inorder = <empty>
Nov 03 12:29:57 user nova-compute[74960]: iface.erl = 0
Nov 03 12:29:57 user nova-compute[74960]: iface.max_receive_data_len = 0
Nov 03 12:29:57 user nova-compute[74960]: iface.first_burst_len = 0
Nov 03 12:29:57 user nova-compute[74960]: iface.max_outstanding_r2t = 0
Nov 03 12:29:57 user nova-compute[74960]: iface.max_burst_len = 0
Nov 03 12:29:57 user nova-compute[74960]: iface.chap_auth = <empty>
Nov 03 12:29:57 user nova-compute[74960]: iface.bidi_chap = <empty>
Nov 03 12:29:57 user nova-compute[74960]: iface.strict_login_compliance = <empty>
Nov 03 12:29:57 user nova-compute[74960]: iface.discovery_auth = <empty>
Nov 03 12:29:57 user nova-compute[74960]: iface.discovery_logout = <empty>
Nov 03 12:29:57 user nova-compute[74960]: node.discovery_address = <empty>
Nov 03 12:29:57 user nova-compute[74960]: node.discovery_port = 0
Nov 03 12:29:57 user nova-compute[74960]: node.discovery_type = static
Nov 03 12:29:57 user nova-compute[74960]: node.session.initial_cmdsn = 0
Nov 03 12:29:57 user nova-compute[74960]: node.session.initial_login_retry_max = 8
Nov 03 12:29:57 user nova-compute[74960]: node.session.xmit_thread_priority = -20
Nov 03 12:29:57 user nova-compute[74960]: node.session.cmds_max = 128
Nov 03 12:29:57 user nova-compute[74960]: node.session.queue_depth = 32
Nov 03 12:29:57 user nova-compute[74960]: node.session.nr_sessions = 1
Nov 03 12:29:57 user nova-compute[74960]: node.session.auth.authmethod = CHAP
Nov 03 12:29:57 user nova-compute[74960]: node.session.auth.username = BNDmfTXv
Nov 03 12:29:57 user nova-compute[74960]: node.session.auth.password = ***
Nov 03 12:29:57 user nova-compute[74960]: node.session.auth.username_in = <empty>
Nov 03 12:29:57 user nova-compute[74960]: node.session.auth.password_in = <empty>
Nov 03 12:29:57 user nova-compute[74960]: node.session.auth.chap_algs = MD5
Nov 03 12:29:57 user nova-compute[74960]: node.session.timeo.replacement_timeout = 120
Nov 03 12:29:57 user nova-compute[74960]: node.session.err_timeo.abort_timeout = 15
Nov 03 12:29:57 user nova-compute[74960]: node.session.err_timeo.lu_reset_timeout = 30
Nov 03 12:29:57 user nova-compute[74960]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 03 12:29:57 user nova-compute[74960]: node.session.err_timeo.host_reset_timeout = 60
Nov 03 12:29:57 user nova-compute[74960]: node.session.iscsi.FastAbort = Yes
Nov 03 12:29:57 user nova-compute[74960]: node.session.iscsi.InitialR2T = No
Nov 03 12:29:57 user nova-compute[74960]: node.session.iscsi.ImmediateData = Yes
Nov 03 12:29:57 user nova-compute[74960]: node.session.iscsi.FirstBurstLength = 262144
Nov 03 12:29:57 user nova-compute[74960]: node.session.iscsi.MaxBurstLength = 16776192
Nov 03 12:29:57 user nova-compute[74960]: node.session.iscsi.DefaultTime2Retain = 0
Nov 03 12:29:57 user nova-compute[74960]: node.session.iscsi.DefaultTime2Wait = 2
Nov 03 12:29:57 user nova-compute[74960]: node.session.iscsi.MaxConnections = 1
Nov 03 12:29:57 user nova-compute[74960]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 03 12:29:57 user nova-compute[74960]: node.session.iscsi.ERL = 0
Nov 03 12:29:57 user nova-compute[74960]: node.session.scan = manual
Nov 03 12:29:57 user nova-compute[74960]: node.session.reopen_max = 0
Nov 03 12:29:57 user nova-compute[74960]: node.conn[0].address = 172.16.0.220
Nov 03 12:29:57 user nova-compute[74960]: node.conn[0].port = 3260
Nov 03 12:29:57 user nova-compute[74960]: node.conn[0].startup = manual
Nov 03 12:29:57 user nova-compute[74960]: node.conn[0].tcp.window_size = 524288
Nov 03 12:29:57 user nova-compute[74960]: node.conn[0].tcp.type_of_service = 0
Nov 03 12:29:57 user nova-compute[74960]: node.conn[0].timeo.logout_timeout = 15
Nov 03 12:29:57 user nova-compute[74960]: node.conn[0].timeo.login_timeout = 15
Nov 03 12:29:57 user nova-compute[74960]: node.conn[0].timeo.auth_timeout = 45
Nov 03 12:29:57 user nova-compute[74960]: node.conn[0].timeo.noop_out_interval = 5
Nov 03 12:29:57 user nova-compute[74960]: node.conn[0].timeo.noop_out_timeout = 5
Nov 03 12:29:57 user nova-compute[74960]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 03 12:29:57 user nova-compute[74960]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 03 12:29:57 user nova-compute[74960]: node.conn[0].iscsi.HeaderDigest = None
Nov 03 12:29:57 user nova-compute[74960]: node.conn[0].iscsi.DataDigest = None
Nov 03 12:29:57 user nova-compute[74960]: node.conn[0].iscsi.IFMarker = No
Nov 03 12:29:57 user nova-compute[74960]: node.conn[0].iscsi.OFMarker = No
Nov 03 12:29:57 user nova-compute[74960]: # END RECORD
Nov 03 12:29:57 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:29:57 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:29:57 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:29:57 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[12e04ecf-ec6c-4f48-856c-03ac5e5069b9]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:29:57 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9cd0691-bbdc-44c0-a9cd-401e91fce4fb tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:29:57 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:29:57 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:29:57 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[f86e82bd-9bbb-49c6-b6cc-aca25da8bcbf]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:29:57 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9cd0691-bbdc-44c0-a9cd-401e91fce4fb tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:29:57 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BNDmfTXv {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:29:57 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BNDmfTXv" returned: 0 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:29:57 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddbf5139-3d9c-480b-9d41-eaa10e434c45]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:29:57 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9cd0691-bbdc-44c0-a9cd-401e91fce4fb tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BNDmfTXv'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:29:57 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:29:57 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.033s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:29:57 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[43faebd5-7a4f-458e-8149-890623a6f76b]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:29:57 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9cd0691-bbdc-44c0-a9cd-401e91fce4fb tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:29:57 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:29:57 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:29:57 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[777cc24f-6f6d-453b-b8d8-1eb2c023b4c2]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f33bebd3-3cc8-4db5-b35e-5d58d4dfe93f (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f45e9d6-0169-4a92-8d8c-ee068f12905b (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:29:57 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9cd0691-bbdc-44c0-a9cd-401e91fce4fb tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:29:57 user nova-compute[74960]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f33bebd3-3cc8-4db5-b35e-5d58d4dfe93f (non-flash)
Nov 03 12:29:57 user nova-compute[74960]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f45e9d6-0169-4a92-8d8c-ee068f12905b (non-flash)
Nov 03 12:29:57 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:29:57 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9cd0691-bbdc-44c0-a9cd-401e91fce4fb tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:29:57 user nova-compute[74960]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f33bebd3-3cc8-4db5-b35e-5d58d4dfe93f (non-flash)
Nov 03 12:29:57 user nova-compute[74960]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f45e9d6-0169-4a92-8d8c-ee068f12905b (non-flash)
Nov 03 12:29:57 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:29:57 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-b9cd0691-bbdc-44c0-a9cd-401e91fce4fb tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.173s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:29:57 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9cd0691-bbdc-44c0-a9cd-401e91fce4fb tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Connected to 172.16.0.220:3260 {{(pid=74960) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 12:29:57 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-b9cd0691-bbdc-44c0-a9cd-401e91fce4fb tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] HCTL ('35', '0', '0', 0) found on session 19 with lun 0 {{(pid=74960) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 12:29:57 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-b9cd0691-bbdc-44c0-a9cd-401e91fce4fb tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=74960) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 12:29:57 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:29:57 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:29:57 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbd1ca76-b629-4bb2-9f8f-139a83fb119a]: (4, ('0 0 0', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:29:57 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-b9cd0691-bbdc-44c0-a9cd-401e91fce4fb tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Searching for a device in session 19 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=74960) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 12:29:57 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9cd0691-bbdc-44c0-a9cd-401e91fce4fb tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BNDmfTXv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74960) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 12:29:57 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-b9cd0691-bbdc-44c0-a9cd-401e91fce4fb tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.202s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:29:57 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9cd0691-bbdc-44c0-a9cd-401e91fce4fb tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] <== connect_volume: return (204ms) {'type': 'block', 'scsi_wwn': '26566333533623662', 'path': '/dev/sdd'} {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:29:57 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9cd0691-bbdc-44c0-a9cd-401e91fce4fb tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26566333533623662', 'path': '/dev/sdd'} {{(pid=74960) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 12:29:57 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-b9cd0691-bbdc-44c0-a9cd-401e91fce4fb tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:28:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-391818015',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-391818015',id=25,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-03T12:28:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dbc95d68d5e147e1953c855169b17091',ramdisk_id='',reservation_id='r-l1ygoxml',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-195954071',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:28:42Z,user_data=None,user_id='c473215929044a108c9fc4d6327dfc3d',uuid=a6199681-f85e-4f55-966b-6ab3f17cd640,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "40976ae5-5f49-4d8e-abd7-04dc0ce8f319", "address": "fa:16:3e:7c:40:1d", "network": {"id": "dec66832-56d5-4d68-b11f-8e8eed38f045", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-79099436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-79099436-network", "vif_mac": "fa:16:3e:7c:40:1d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc95d68d5e147e1953c855169b17091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40976ae5-5f", "ovs_interfaceid": "40976ae5-5f49-4d8e-abd7-04dc0ce8f319", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74960) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 12:29:57 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-b9cd0691-bbdc-44c0-a9cd-401e91fce4fb tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Converting VIF {"id": "40976ae5-5f49-4d8e-abd7-04dc0ce8f319", "address": "fa:16:3e:7c:40:1d", "network": {"id": "dec66832-56d5-4d68-b11f-8e8eed38f045", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-79099436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-79099436-network", "vif_mac": "fa:16:3e:7c:40:1d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc95d68d5e147e1953c855169b17091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40976ae5-5f", "ovs_interfaceid": "40976ae5-5f49-4d8e-abd7-04dc0ce8f319", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:29:57 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-b9cd0691-bbdc-44c0-a9cd-401e91fce4fb tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7c:40:1d,bridge_name='br-int',has_traffic_filtering=True,id=40976ae5-5f49-4d8e-abd7-04dc0ce8f319,network=Network(dec66832-56d5-4d68-b11f-8e8eed38f045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40976ae5-5f') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:29:57 user nova-compute[74960]: DEBUG nova.objects.instance [None req-b9cd0691-bbdc-44c0-a9cd-401e91fce4fb tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Lazy-loading 'pci_devices' on Instance uuid a6199681-f85e-4f55-966b-6ab3f17cd640 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:29:57 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-cb73ece2-52d7-4fdb-a2ad-7d8c69f18c02 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:29:57 user nova-compute[74960]: DEBUG nova.objects.base [None req-b9cd0691-bbdc-44c0-a9cd-401e91fce4fb tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Object Instance<a6199681-f85e-4f55-966b-6ab3f17cd640> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74960) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 12:29:57 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-b9cd0691-bbdc-44c0-a9cd-401e91fce4fb tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] End _get_guest_xml xml=<domain type="kvm">
Nov 03 12:29:57 user nova-compute[74960]:   <uuid>a6199681-f85e-4f55-966b-6ab3f17cd640</uuid>
Nov 03 12:29:57 user nova-compute[74960]:   <name>instance-00000019</name>
Nov 03 12:29:57 user nova-compute[74960]:   <memory>524288</memory>
Nov 03 12:29:57 user nova-compute[74960]:   <vcpu>1</vcpu>
Nov 03 12:29:57 user nova-compute[74960]:   <metadata>
Nov 03 12:29:57 user nova-compute[74960]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 12:29:57 user nova-compute[74960]:       <nova:package version="0.0.0"/>
Nov 03 12:29:57 user nova-compute[74960]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-391818015</nova:name>
Nov 03 12:29:57 user nova-compute[74960]:       <nova:creationTime>2023-11-03 12:29:56</nova:creationTime>
Nov 03 12:29:57 user nova-compute[74960]:       <nova:flavor name="m1.tiny">
Nov 03 12:29:57 user nova-compute[74960]:         <nova:memory>512</nova:memory>
Nov 03 12:29:57 user nova-compute[74960]:         <nova:disk>1</nova:disk>
Nov 03 12:29:57 user nova-compute[74960]:         <nova:swap>0</nova:swap>
Nov 03 12:29:57 user nova-compute[74960]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 12:29:57 user nova-compute[74960]:         <nova:vcpus>1</nova:vcpus>
Nov 03 12:29:57 user nova-compute[74960]:       </nova:flavor>
Nov 03 12:29:57 user nova-compute[74960]:       <nova:owner>
Nov 03 12:29:57 user nova-compute[74960]:         <nova:user uuid="c473215929044a108c9fc4d6327dfc3d">tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member</nova:user>
Nov 03 12:29:57 user nova-compute[74960]:         <nova:project uuid="dbc95d68d5e147e1953c855169b17091">tempest-ServerBootFromVolumeStableRescueTest-195954071</nova:project>
Nov 03 12:29:57 user nova-compute[74960]:       </nova:owner>
Nov 03 12:29:57 user nova-compute[74960]:       <nova:root type="image" uuid="549f51ba-ac69-494b-8de1-34635aa2d7cf"/>
Nov 03 12:29:57 user nova-compute[74960]:       <nova:ports>
Nov 03 12:29:57 user nova-compute[74960]:         <nova:port uuid="40976ae5-5f49-4d8e-abd7-04dc0ce8f319">
Nov 03 12:29:57 user nova-compute[74960]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 03 12:29:57 user nova-compute[74960]:         </nova:port>
Nov 03 12:29:57 user nova-compute[74960]:       </nova:ports>
Nov 03 12:29:57 user nova-compute[74960]:     </nova:instance>
Nov 03 12:29:57 user nova-compute[74960]:   </metadata>
Nov 03 12:29:57 user nova-compute[74960]:   <sysinfo type="smbios">
Nov 03 12:29:57 user nova-compute[74960]:     <system>
Nov 03 12:29:57 user nova-compute[74960]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 12:29:57 user nova-compute[74960]:       <entry name="product">OpenStack Nova</entry>
Nov 03 12:29:57 user nova-compute[74960]:       <entry name="version">0.0.0</entry>
Nov 03 12:29:57 user nova-compute[74960]:       <entry name="serial">a6199681-f85e-4f55-966b-6ab3f17cd640</entry>
Nov 03 12:29:57 user nova-compute[74960]:       <entry name="uuid">a6199681-f85e-4f55-966b-6ab3f17cd640</entry>
Nov 03 12:29:57 user nova-compute[74960]:       <entry name="family">Virtual Machine</entry>
Nov 03 12:29:57 user nova-compute[74960]:     </system>
Nov 03 12:29:57 user nova-compute[74960]:   </sysinfo>
Nov 03 12:29:57 user nova-compute[74960]:   <os>
Nov 03 12:29:57 user nova-compute[74960]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 12:29:57 user nova-compute[74960]:     <smbios mode="sysinfo"/>
Nov 03 12:29:57 user nova-compute[74960]:   </os>
Nov 03 12:29:57 user nova-compute[74960]:   <features>
Nov 03 12:29:57 user nova-compute[74960]:     <acpi/>
Nov 03 12:29:57 user nova-compute[74960]:     <apic/>
Nov 03 12:29:57 user nova-compute[74960]:     <vmcoreinfo/>
Nov 03 12:29:57 user nova-compute[74960]:   </features>
Nov 03 12:29:57 user nova-compute[74960]:   <clock offset="utc">
Nov 03 12:29:57 user nova-compute[74960]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 12:29:57 user nova-compute[74960]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 12:29:57 user nova-compute[74960]:     <timer name="hpet" present="no"/>
Nov 03 12:29:57 user nova-compute[74960]:   </clock>
Nov 03 12:29:57 user nova-compute[74960]:   <cpu mode="custom" match="exact">
Nov 03 12:29:57 user nova-compute[74960]:     <model>Nehalem</model>
Nov 03 12:29:57 user nova-compute[74960]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 12:29:57 user nova-compute[74960]:   </cpu>
Nov 03 12:29:57 user nova-compute[74960]:   <devices>
Nov 03 12:29:57 user nova-compute[74960]:     <disk type="block" device="disk">
Nov 03 12:29:57 user nova-compute[74960]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 12:29:57 user nova-compute[74960]:       <source dev="/dev/sdd"/>
Nov 03 12:29:57 user nova-compute[74960]:       <target dev="vda" bus="virtio"/>
Nov 03 12:29:57 user nova-compute[74960]:       <serial>ef532415-0078-4fe2-8af5-73cada8b32a2</serial>
Nov 03 12:29:57 user nova-compute[74960]:     </disk>
Nov 03 12:29:57 user nova-compute[74960]:     <disk type="file" device="disk">
Nov 03 12:29:57 user nova-compute[74960]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 12:29:57 user nova-compute[74960]:       <source file="/opt/stack/data/nova/instances/a6199681-f85e-4f55-966b-6ab3f17cd640/disk.rescue"/>
Nov 03 12:29:57 user nova-compute[74960]:       <target dev="vdb" bus="virtio"/>
Nov 03 12:29:57 user nova-compute[74960]:       <boot order="1"/>
Nov 03 12:29:57 user nova-compute[74960]:     </disk>
Nov 03 12:29:57 user nova-compute[74960]:     <interface type="ethernet">
Nov 03 12:29:57 user nova-compute[74960]:       <mac address="fa:16:3e:7c:40:1d"/>
Nov 03 12:29:57 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:29:57 user nova-compute[74960]:       <mtu size="1442"/>
Nov 03 12:29:57 user nova-compute[74960]:       <target dev="tap40976ae5-5f"/>
Nov 03 12:29:57 user nova-compute[74960]:     </interface>
Nov 03 12:29:57 user nova-compute[74960]:     <serial type="pty">
Nov 03 12:29:57 user nova-compute[74960]:       <log file="/opt/stack/data/nova/instances/a6199681-f85e-4f55-966b-6ab3f17cd640/console.log" append="off"/>
Nov 03 12:29:57 user nova-compute[74960]:     </serial>
Nov 03 12:29:57 user nova-compute[74960]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 12:29:57 user nova-compute[74960]:     <video>
Nov 03 12:29:57 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:29:57 user nova-compute[74960]:     </video>
Nov 03 12:29:57 user nova-compute[74960]:     <rng model="virtio">
Nov 03 12:29:57 user nova-compute[74960]:       <backend model="random">/dev/urandom</backend>
Nov 03 12:29:57 user nova-compute[74960]:     </rng>
Nov 03 12:29:57 user nova-compute[74960]:     <controller type="usb" index="0" model="none"/>
Nov 03 12:29:57 user nova-compute[74960]:     <memballoon model="virtio">
Nov 03 12:29:57 user nova-compute[74960]:       <stats period="10"/>
Nov 03 12:29:57 user nova-compute[74960]:     </memballoon>
Nov 03 12:29:57 user nova-compute[74960]:   </devices>
Nov 03 12:29:57 user nova-compute[74960]: </domain>
Nov 03 12:29:57 user nova-compute[74960]:  {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 12:29:57 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-cb73ece2-52d7-4fdb-a2ad-7d8c69f18c02 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:29:57 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] Instance destroyed successfully.
Nov 03 12:29:57 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-cb73ece2-52d7-4fdb-a2ad-7d8c69f18c02 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.617s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:29:57 user nova-compute[74960]: DEBUG nova.compute.manager [None req-cb73ece2-52d7-4fdb-a2ad-7d8c69f18c02 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] [instance: 208570e4-1b11-486b-a79e-4b4eafc26af2] Start building networks asynchronously for instance. {{(pid=74960) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 12:29:57 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-b9cd0691-bbdc-44c0-a9cd-401e91fce4fb tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] No BDM found with device name vda, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:29:57 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-b9cd0691-bbdc-44c0-a9cd-401e91fce4fb tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:29:57 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-b9cd0691-bbdc-44c0-a9cd-401e91fce4fb tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] No VIF found with MAC fa:16:3e:7c:40:1d, not building metadata {{(pid=74960) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 12:29:57 user nova-compute[74960]: DEBUG nova.compute.manager [None req-cb73ece2-52d7-4fdb-a2ad-7d8c69f18c02 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] [instance: 208570e4-1b11-486b-a79e-4b4eafc26af2] Allocating IP information in the background. {{(pid=74960) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 12:29:57 user nova-compute[74960]: DEBUG nova.network.neutron [None req-cb73ece2-52d7-4fdb-a2ad-7d8c69f18c02 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] [instance: 208570e4-1b11-486b-a79e-4b4eafc26af2] allocate_for_instance() {{(pid=74960) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 12:29:57 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-cb73ece2-52d7-4fdb-a2ad-7d8c69f18c02 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] [instance: 208570e4-1b11-486b-a79e-4b4eafc26af2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 12:29:57 user nova-compute[74960]: DEBUG nova.compute.manager [None req-cb73ece2-52d7-4fdb-a2ad-7d8c69f18c02 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] [instance: 208570e4-1b11-486b-a79e-4b4eafc26af2] Start building block device mappings for instance. {{(pid=74960) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 12:29:57 user nova-compute[74960]: DEBUG nova.policy [None req-cb73ece2-52d7-4fdb-a2ad-7d8c69f18c02 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b10ff362bd8641e184623b5506ec875e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91dff8e248b4ca2bedc8631fcaf06f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74960) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 12:29:57 user nova-compute[74960]: DEBUG nova.compute.manager [None req-cb73ece2-52d7-4fdb-a2ad-7d8c69f18c02 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] [instance: 208570e4-1b11-486b-a79e-4b4eafc26af2] Start spawning the instance on the hypervisor. {{(pid=74960) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 12:29:57 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-cb73ece2-52d7-4fdb-a2ad-7d8c69f18c02 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] [instance: 208570e4-1b11-486b-a79e-4b4eafc26af2] Creating instance directory {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 12:29:57 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-cb73ece2-52d7-4fdb-a2ad-7d8c69f18c02 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] [instance: 208570e4-1b11-486b-a79e-4b4eafc26af2] Creating image(s)
Nov 03 12:29:57 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-cb73ece2-52d7-4fdb-a2ad-7d8c69f18c02 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Acquiring lock "/opt/stack/data/nova/instances/208570e4-1b11-486b-a79e-4b4eafc26af2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:29:57 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-cb73ece2-52d7-4fdb-a2ad-7d8c69f18c02 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Lock "/opt/stack/data/nova/instances/208570e4-1b11-486b-a79e-4b4eafc26af2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:29:57 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-cb73ece2-52d7-4fdb-a2ad-7d8c69f18c02 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Lock "/opt/stack/data/nova/instances/208570e4-1b11-486b-a79e-4b4eafc26af2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:29:57 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-cb73ece2-52d7-4fdb-a2ad-7d8c69f18c02 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:29:57 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:29:57 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-cb73ece2-52d7-4fdb-a2ad-7d8c69f18c02 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.246s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:29:57 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-cb73ece2-52d7-4fdb-a2ad-7d8c69f18c02 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Acquiring lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:29:57 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-cb73ece2-52d7-4fdb-a2ad-7d8c69f18c02 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:29:57 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-cb73ece2-52d7-4fdb-a2ad-7d8c69f18c02 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:29:58 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-cb73ece2-52d7-4fdb-a2ad-7d8c69f18c02 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.207s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:29:58 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-cb73ece2-52d7-4fdb-a2ad-7d8c69f18c02 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910,backing_fmt=raw /opt/stack/data/nova/instances/208570e4-1b11-486b-a79e-4b4eafc26af2/disk 1073741824 {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:29:58 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-cb73ece2-52d7-4fdb-a2ad-7d8c69f18c02 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910,backing_fmt=raw /opt/stack/data/nova/instances/208570e4-1b11-486b-a79e-4b4eafc26af2/disk 1073741824" returned: 0 in 0.067s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:29:58 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-cb73ece2-52d7-4fdb-a2ad-7d8c69f18c02 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.282s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:29:58 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-cb73ece2-52d7-4fdb-a2ad-7d8c69f18c02 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:29:58 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:29:58 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-cb73ece2-52d7-4fdb-a2ad-7d8c69f18c02 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.192s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:29:58 user nova-compute[74960]: DEBUG nova.virt.disk.api [None req-cb73ece2-52d7-4fdb-a2ad-7d8c69f18c02 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Checking if we can resize image /opt/stack/data/nova/instances/208570e4-1b11-486b-a79e-4b4eafc26af2/disk. size=1073741824 {{(pid=74960) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 12:29:58 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-cb73ece2-52d7-4fdb-a2ad-7d8c69f18c02 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/208570e4-1b11-486b-a79e-4b4eafc26af2/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:29:58 user nova-compute[74960]: DEBUG nova.network.neutron [None req-cb73ece2-52d7-4fdb-a2ad-7d8c69f18c02 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] [instance: 208570e4-1b11-486b-a79e-4b4eafc26af2] Successfully created port: ab5d31db-7218-4c01-ba8f-0420e61f4583 {{(pid=74960) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 12:29:58 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-cb73ece2-52d7-4fdb-a2ad-7d8c69f18c02 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/208570e4-1b11-486b-a79e-4b4eafc26af2/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:29:58 user nova-compute[74960]: DEBUG nova.virt.disk.api [None req-cb73ece2-52d7-4fdb-a2ad-7d8c69f18c02 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Cannot resize image /opt/stack/data/nova/instances/208570e4-1b11-486b-a79e-4b4eafc26af2/disk to a smaller size. {{(pid=74960) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 12:29:58 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-cb73ece2-52d7-4fdb-a2ad-7d8c69f18c02 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] [instance: 208570e4-1b11-486b-a79e-4b4eafc26af2] Created local disks {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 12:29:58 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-cb73ece2-52d7-4fdb-a2ad-7d8c69f18c02 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] [instance: 208570e4-1b11-486b-a79e-4b4eafc26af2] Ensure instance console log exists: /opt/stack/data/nova/instances/208570e4-1b11-486b-a79e-4b4eafc26af2/console.log {{(pid=74960) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 12:29:58 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-cb73ece2-52d7-4fdb-a2ad-7d8c69f18c02 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:29:58 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-cb73ece2-52d7-4fdb-a2ad-7d8c69f18c02 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:29:58 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-cb73ece2-52d7-4fdb-a2ad-7d8c69f18c02 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:29:58 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:29:58 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:29:58 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:29:58 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:29:58 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:29:59 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:29:59 user nova-compute[74960]: DEBUG nova.compute.manager [req-e7add831-8da0-4c21-9dbd-d15b70d4b8bd req-1761a8ba-5751-4564-adab-bbae3a32d021 service nova] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] Received event network-vif-plugged-40976ae5-5f49-4d8e-abd7-04dc0ce8f319 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:29:59 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-e7add831-8da0-4c21-9dbd-d15b70d4b8bd req-1761a8ba-5751-4564-adab-bbae3a32d021 service nova] Acquiring lock "a6199681-f85e-4f55-966b-6ab3f17cd640-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:29:59 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-e7add831-8da0-4c21-9dbd-d15b70d4b8bd req-1761a8ba-5751-4564-adab-bbae3a32d021 service nova] Lock "a6199681-f85e-4f55-966b-6ab3f17cd640-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:29:59 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-e7add831-8da0-4c21-9dbd-d15b70d4b8bd req-1761a8ba-5751-4564-adab-bbae3a32d021 service nova] Lock "a6199681-f85e-4f55-966b-6ab3f17cd640-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:29:59 user nova-compute[74960]: DEBUG nova.compute.manager [req-e7add831-8da0-4c21-9dbd-d15b70d4b8bd req-1761a8ba-5751-4564-adab-bbae3a32d021 service nova] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] No waiting events found dispatching network-vif-plugged-40976ae5-5f49-4d8e-abd7-04dc0ce8f319 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:29:59 user nova-compute[74960]: WARNING nova.compute.manager [req-e7add831-8da0-4c21-9dbd-d15b70d4b8bd req-1761a8ba-5751-4564-adab-bbae3a32d021 service nova] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] Received unexpected event network-vif-plugged-40976ae5-5f49-4d8e-abd7-04dc0ce8f319 for instance with vm_state active and task_state rescuing.
Nov 03 12:29:59 user nova-compute[74960]: DEBUG nova.network.neutron [None req-cb73ece2-52d7-4fdb-a2ad-7d8c69f18c02 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] [instance: 208570e4-1b11-486b-a79e-4b4eafc26af2] Successfully updated port: ab5d31db-7218-4c01-ba8f-0420e61f4583 {{(pid=74960) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 12:29:59 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-cb73ece2-52d7-4fdb-a2ad-7d8c69f18c02 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Acquiring lock "refresh_cache-208570e4-1b11-486b-a79e-4b4eafc26af2" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:29:59 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-cb73ece2-52d7-4fdb-a2ad-7d8c69f18c02 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Acquired lock "refresh_cache-208570e4-1b11-486b-a79e-4b4eafc26af2" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:29:59 user nova-compute[74960]: DEBUG nova.network.neutron [None req-cb73ece2-52d7-4fdb-a2ad-7d8c69f18c02 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] [instance: 208570e4-1b11-486b-a79e-4b4eafc26af2] Building network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 12:29:59 user nova-compute[74960]: DEBUG nova.network.neutron [None req-cb73ece2-52d7-4fdb-a2ad-7d8c69f18c02 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] [instance: 208570e4-1b11-486b-a79e-4b4eafc26af2] Instance cache missing network info. {{(pid=74960) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 12:29:59 user nova-compute[74960]: DEBUG nova.network.neutron [None req-cb73ece2-52d7-4fdb-a2ad-7d8c69f18c02 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] [instance: 208570e4-1b11-486b-a79e-4b4eafc26af2] Updating instance_info_cache with network_info: [{"id": "ab5d31db-7218-4c01-ba8f-0420e61f4583", "address": "fa:16:3e:76:6d:bb", "network": {"id": "78afe6eb-a6db-4f0c-a135-32b7775b5e2a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1883110422-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f91dff8e248b4ca2bedc8631fcaf06f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab5d31db-72", "ovs_interfaceid": "ab5d31db-7218-4c01-ba8f-0420e61f4583", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:29:59 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-cb73ece2-52d7-4fdb-a2ad-7d8c69f18c02 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Releasing lock "refresh_cache-208570e4-1b11-486b-a79e-4b4eafc26af2" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:29:59 user nova-compute[74960]: DEBUG nova.compute.manager [None req-cb73ece2-52d7-4fdb-a2ad-7d8c69f18c02 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] [instance: 208570e4-1b11-486b-a79e-4b4eafc26af2] Instance network_info: |[{"id": "ab5d31db-7218-4c01-ba8f-0420e61f4583", "address": "fa:16:3e:76:6d:bb", "network": {"id": "78afe6eb-a6db-4f0c-a135-32b7775b5e2a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1883110422-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f91dff8e248b4ca2bedc8631fcaf06f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab5d31db-72", "ovs_interfaceid": "ab5d31db-7218-4c01-ba8f-0420e61f4583", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74960) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 12:29:59 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-cb73ece2-52d7-4fdb-a2ad-7d8c69f18c02 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] [instance: 208570e4-1b11-486b-a79e-4b4eafc26af2] Start _get_guest_xml network_info=[{"id": "ab5d31db-7218-4c01-ba8f-0420e61f4583", "address": "fa:16:3e:76:6d:bb", "network": {"id": "78afe6eb-a6db-4f0c-a135-32b7775b5e2a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1883110422-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f91dff8e248b4ca2bedc8631fcaf06f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab5d31db-72", "ovs_interfaceid": "ab5d31db-7218-4c01-ba8f-0420e61f4583", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=549f51ba-ac69-494b-8de1-34635aa2d7cf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='63ee9c80c632442fb0379f47b784bd20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T12:13:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'image_id': '549f51ba-ac69-494b-8de1-34635aa2d7cf'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 12:29:59 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-cb73ece2-52d7-4fdb-a2ad-7d8c69f18c02 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:29:59 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-cb73ece2-52d7-4fdb-a2ad-7d8c69f18c02 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:29:59 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-cb73ece2-52d7-4fdb-a2ad-7d8c69f18c02 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 12:29:59 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-cb73ece2-52d7-4fdb-a2ad-7d8c69f18c02 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] CPU controller missing on host. {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 12:29:59 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-cb73ece2-52d7-4fdb-a2ad-7d8c69f18c02 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 12:29:59 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-cb73ece2-52d7-4fdb-a2ad-7d8c69f18c02 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] CPU controller found on host. {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 12:29:59 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-cb73ece2-52d7-4fdb-a2ad-7d8c69f18c02 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74960) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 12:29:59 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-cb73ece2-52d7-4fdb-a2ad-7d8c69f18c02 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=549f51ba-ac69-494b-8de1-34635aa2d7cf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='63ee9c80c632442fb0379f47b784bd20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T12:13:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 12:29:59 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-cb73ece2-52d7-4fdb-a2ad-7d8c69f18c02 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Flavor limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 12:29:59 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-cb73ece2-52d7-4fdb-a2ad-7d8c69f18c02 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Image limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 12:29:59 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-cb73ece2-52d7-4fdb-a2ad-7d8c69f18c02 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Flavor pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 12:29:59 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-cb73ece2-52d7-4fdb-a2ad-7d8c69f18c02 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Image pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 12:29:59 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-cb73ece2-52d7-4fdb-a2ad-7d8c69f18c02 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 12:29:59 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-cb73ece2-52d7-4fdb-a2ad-7d8c69f18c02 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 12:29:59 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-cb73ece2-52d7-4fdb-a2ad-7d8c69f18c02 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 12:29:59 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-cb73ece2-52d7-4fdb-a2ad-7d8c69f18c02 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Got 1 possible topologies {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 12:29:59 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-cb73ece2-52d7-4fdb-a2ad-7d8c69f18c02 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 12:29:59 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-cb73ece2-52d7-4fdb-a2ad-7d8c69f18c02 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 12:30:00 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-cb73ece2-52d7-4fdb-a2ad-7d8c69f18c02 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:29:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1686777373',display_name='tempest-VolumesActionsTest-instance-1686777373',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1686777373',id=27,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f91dff8e248b4ca2bedc8631fcaf06f3',ramdisk_id='',reservation_id='r-rpwz9n0t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1450410058',owner_user_name='tempest-VolumesActionsTest-1450410058-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:29:58Z,user_data=None,user_id='b10ff362bd8641e184623b5506ec875e',uuid=208570e4-1b11-486b-a79e-4b4eafc26af2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ab5d31db-7218-4c01-ba8f-0420e61f4583", "address": "fa:16:3e:76:6d:bb", "network": {"id": "78afe6eb-a6db-4f0c-a135-32b7775b5e2a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1883110422-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f91dff8e248b4ca2bedc8631fcaf06f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab5d31db-72", "ovs_interfaceid": "ab5d31db-7218-4c01-ba8f-0420e61f4583", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74960) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 12:30:00 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-cb73ece2-52d7-4fdb-a2ad-7d8c69f18c02 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Converting VIF {"id": "ab5d31db-7218-4c01-ba8f-0420e61f4583", "address": "fa:16:3e:76:6d:bb", "network": {"id": "78afe6eb-a6db-4f0c-a135-32b7775b5e2a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1883110422-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f91dff8e248b4ca2bedc8631fcaf06f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab5d31db-72", "ovs_interfaceid": "ab5d31db-7218-4c01-ba8f-0420e61f4583", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:30:00 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-cb73ece2-52d7-4fdb-a2ad-7d8c69f18c02 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:6d:bb,bridge_name='br-int',has_traffic_filtering=True,id=ab5d31db-7218-4c01-ba8f-0420e61f4583,network=Network(78afe6eb-a6db-4f0c-a135-32b7775b5e2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab5d31db-72') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:30:00 user nova-compute[74960]: DEBUG nova.objects.instance [None req-cb73ece2-52d7-4fdb-a2ad-7d8c69f18c02 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Lazy-loading 'pci_devices' on Instance uuid 208570e4-1b11-486b-a79e-4b4eafc26af2 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:30:00 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-cb73ece2-52d7-4fdb-a2ad-7d8c69f18c02 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] [instance: 208570e4-1b11-486b-a79e-4b4eafc26af2] End _get_guest_xml xml=<domain type="kvm">
Nov 03 12:30:00 user nova-compute[74960]:   <uuid>208570e4-1b11-486b-a79e-4b4eafc26af2</uuid>
Nov 03 12:30:00 user nova-compute[74960]:   <name>instance-0000001b</name>
Nov 03 12:30:00 user nova-compute[74960]:   <memory>524288</memory>
Nov 03 12:30:00 user nova-compute[74960]:   <vcpu>1</vcpu>
Nov 03 12:30:00 user nova-compute[74960]:   <metadata>
Nov 03 12:30:00 user nova-compute[74960]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 12:30:00 user nova-compute[74960]:       <nova:package version="0.0.0"/>
Nov 03 12:30:00 user nova-compute[74960]:       <nova:name>tempest-VolumesActionsTest-instance-1686777373</nova:name>
Nov 03 12:30:00 user nova-compute[74960]:       <nova:creationTime>2023-11-03 12:29:59</nova:creationTime>
Nov 03 12:30:00 user nova-compute[74960]:       <nova:flavor name="m1.tiny">
Nov 03 12:30:00 user nova-compute[74960]:         <nova:memory>512</nova:memory>
Nov 03 12:30:00 user nova-compute[74960]:         <nova:disk>1</nova:disk>
Nov 03 12:30:00 user nova-compute[74960]:         <nova:swap>0</nova:swap>
Nov 03 12:30:00 user nova-compute[74960]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 12:30:00 user nova-compute[74960]:         <nova:vcpus>1</nova:vcpus>
Nov 03 12:30:00 user nova-compute[74960]:       </nova:flavor>
Nov 03 12:30:00 user nova-compute[74960]:       <nova:owner>
Nov 03 12:30:00 user nova-compute[74960]:         <nova:user uuid="b10ff362bd8641e184623b5506ec875e">tempest-VolumesActionsTest-1450410058-project-member</nova:user>
Nov 03 12:30:00 user nova-compute[74960]:         <nova:project uuid="f91dff8e248b4ca2bedc8631fcaf06f3">tempest-VolumesActionsTest-1450410058</nova:project>
Nov 03 12:30:00 user nova-compute[74960]:       </nova:owner>
Nov 03 12:30:00 user nova-compute[74960]:       <nova:root type="image" uuid="549f51ba-ac69-494b-8de1-34635aa2d7cf"/>
Nov 03 12:30:00 user nova-compute[74960]:       <nova:ports>
Nov 03 12:30:00 user nova-compute[74960]:         <nova:port uuid="ab5d31db-7218-4c01-ba8f-0420e61f4583">
Nov 03 12:30:00 user nova-compute[74960]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 03 12:30:00 user nova-compute[74960]:         </nova:port>
Nov 03 12:30:00 user nova-compute[74960]:       </nova:ports>
Nov 03 12:30:00 user nova-compute[74960]:     </nova:instance>
Nov 03 12:30:00 user nova-compute[74960]:   </metadata>
Nov 03 12:30:00 user nova-compute[74960]:   <sysinfo type="smbios">
Nov 03 12:30:00 user nova-compute[74960]:     <system>
Nov 03 12:30:00 user nova-compute[74960]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 12:30:00 user nova-compute[74960]:       <entry name="product">OpenStack Nova</entry>
Nov 03 12:30:00 user nova-compute[74960]:       <entry name="version">0.0.0</entry>
Nov 03 12:30:00 user nova-compute[74960]:       <entry name="serial">208570e4-1b11-486b-a79e-4b4eafc26af2</entry>
Nov 03 12:30:00 user nova-compute[74960]:       <entry name="uuid">208570e4-1b11-486b-a79e-4b4eafc26af2</entry>
Nov 03 12:30:00 user nova-compute[74960]:       <entry name="family">Virtual Machine</entry>
Nov 03 12:30:00 user nova-compute[74960]:     </system>
Nov 03 12:30:00 user nova-compute[74960]:   </sysinfo>
Nov 03 12:30:00 user nova-compute[74960]:   <os>
Nov 03 12:30:00 user nova-compute[74960]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 12:30:00 user nova-compute[74960]:     <boot dev="hd"/>
Nov 03 12:30:00 user nova-compute[74960]:     <smbios mode="sysinfo"/>
Nov 03 12:30:00 user nova-compute[74960]:   </os>
Nov 03 12:30:00 user nova-compute[74960]:   <features>
Nov 03 12:30:00 user nova-compute[74960]:     <acpi/>
Nov 03 12:30:00 user nova-compute[74960]:     <apic/>
Nov 03 12:30:00 user nova-compute[74960]:     <vmcoreinfo/>
Nov 03 12:30:00 user nova-compute[74960]:   </features>
Nov 03 12:30:00 user nova-compute[74960]:   <clock offset="utc">
Nov 03 12:30:00 user nova-compute[74960]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 12:30:00 user nova-compute[74960]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 12:30:00 user nova-compute[74960]:     <timer name="hpet" present="no"/>
Nov 03 12:30:00 user nova-compute[74960]:   </clock>
Nov 03 12:30:00 user nova-compute[74960]:   <cpu mode="custom" match="exact">
Nov 03 12:30:00 user nova-compute[74960]:     <model>Nehalem</model>
Nov 03 12:30:00 user nova-compute[74960]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 12:30:00 user nova-compute[74960]:   </cpu>
Nov 03 12:30:00 user nova-compute[74960]:   <devices>
Nov 03 12:30:00 user nova-compute[74960]:     <disk type="file" device="disk">
Nov 03 12:30:00 user nova-compute[74960]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 12:30:00 user nova-compute[74960]:       <source file="/opt/stack/data/nova/instances/208570e4-1b11-486b-a79e-4b4eafc26af2/disk"/>
Nov 03 12:30:00 user nova-compute[74960]:       <target dev="vda" bus="virtio"/>
Nov 03 12:30:00 user nova-compute[74960]:     </disk>
Nov 03 12:30:00 user nova-compute[74960]:     <interface type="ethernet">
Nov 03 12:30:00 user nova-compute[74960]:       <mac address="fa:16:3e:76:6d:bb"/>
Nov 03 12:30:00 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:30:00 user nova-compute[74960]:       <mtu size="1442"/>
Nov 03 12:30:00 user nova-compute[74960]:       <target dev="tapab5d31db-72"/>
Nov 03 12:30:00 user nova-compute[74960]:     </interface>
Nov 03 12:30:00 user nova-compute[74960]:     <serial type="pty">
Nov 03 12:30:00 user nova-compute[74960]:       <log file="/opt/stack/data/nova/instances/208570e4-1b11-486b-a79e-4b4eafc26af2/console.log" append="off"/>
Nov 03 12:30:00 user nova-compute[74960]:     </serial>
Nov 03 12:30:00 user nova-compute[74960]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 12:30:00 user nova-compute[74960]:     <video>
Nov 03 12:30:00 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:30:00 user nova-compute[74960]:     </video>
Nov 03 12:30:00 user nova-compute[74960]:     <rng model="virtio">
Nov 03 12:30:00 user nova-compute[74960]:       <backend model="random">/dev/urandom</backend>
Nov 03 12:30:00 user nova-compute[74960]:     </rng>
Nov 03 12:30:00 user nova-compute[74960]:     <controller type="usb" index="0" model="none"/>
Nov 03 12:30:00 user nova-compute[74960]:     <memballoon model="virtio">
Nov 03 12:30:00 user nova-compute[74960]:       <stats period="10"/>
Nov 03 12:30:00 user nova-compute[74960]:     </memballoon>
Nov 03 12:30:00 user nova-compute[74960]:   </devices>
Nov 03 12:30:00 user nova-compute[74960]: </domain>
Nov 03 12:30:00 user nova-compute[74960]:  {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 12:30:00 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-cb73ece2-52d7-4fdb-a2ad-7d8c69f18c02 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:29:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1686777373',display_name='tempest-VolumesActionsTest-instance-1686777373',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1686777373',id=27,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f91dff8e248b4ca2bedc8631fcaf06f3',ramdisk_id='',reservation_id='r-rpwz9n0t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1450410058',owner_user_name='tempest-VolumesActionsTest-1450410058-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:29:58Z,user_data=None,user_id='b10ff362bd8641e184623b5506ec875e',uuid=208570e4-1b11-486b-a79e-4b4eafc26af2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ab5d31db-7218-4c01-ba8f-0420e61f4583", "address": "fa:16:3e:76:6d:bb", "network": {"id": "78afe6eb-a6db-4f0c-a135-32b7775b5e2a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1883110422-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f91dff8e248b4ca2bedc8631fcaf06f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab5d31db-72", "ovs_interfaceid": "ab5d31db-7218-4c01-ba8f-0420e61f4583", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 12:30:00 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-cb73ece2-52d7-4fdb-a2ad-7d8c69f18c02 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Converting VIF {"id": "ab5d31db-7218-4c01-ba8f-0420e61f4583", "address": "fa:16:3e:76:6d:bb", "network": {"id": "78afe6eb-a6db-4f0c-a135-32b7775b5e2a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1883110422-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f91dff8e248b4ca2bedc8631fcaf06f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab5d31db-72", "ovs_interfaceid": "ab5d31db-7218-4c01-ba8f-0420e61f4583", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:30:00 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-cb73ece2-52d7-4fdb-a2ad-7d8c69f18c02 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:6d:bb,bridge_name='br-int',has_traffic_filtering=True,id=ab5d31db-7218-4c01-ba8f-0420e61f4583,network=Network(78afe6eb-a6db-4f0c-a135-32b7775b5e2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab5d31db-72') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:30:00 user nova-compute[74960]: DEBUG os_vif [None req-cb73ece2-52d7-4fdb-a2ad-7d8c69f18c02 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:6d:bb,bridge_name='br-int',has_traffic_filtering=True,id=ab5d31db-7218-4c01-ba8f-0420e61f4583,network=Network(78afe6eb-a6db-4f0c-a135-32b7775b5e2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab5d31db-72') {{(pid=74960) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 12:30:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:30:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:30:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 12:30:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:30:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'be7f8ba1-4ba9-5c70-b8d7-cebe4934dc81', '_type': 'linux-noop'}}, row=False) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:30:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:30:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:30:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:30:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapab5d31db-72, may_exist=True, interface_attrs={}) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:30:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapab5d31db-72, col_values=(('qos', UUID('a4c067e1-2820-4968-b222-54553e3eadf5')),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:30:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapab5d31db-72, col_values=(('external_ids', {'iface-id': 'ab5d31db-7218-4c01-ba8f-0420e61f4583', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:76:6d:bb', 'vm-uuid': '208570e4-1b11-486b-a79e-4b4eafc26af2'}),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:30:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:30:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:30:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:30:00 user nova-compute[74960]: INFO os_vif [None req-cb73ece2-52d7-4fdb-a2ad-7d8c69f18c02 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:6d:bb,bridge_name='br-int',has_traffic_filtering=True,id=ab5d31db-7218-4c01-ba8f-0420e61f4583,network=Network(78afe6eb-a6db-4f0c-a135-32b7775b5e2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab5d31db-72')
Nov 03 12:30:00 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-cb73ece2-52d7-4fdb-a2ad-7d8c69f18c02 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] No BDM found with device name vda, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:30:00 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-cb73ece2-52d7-4fdb-a2ad-7d8c69f18c02 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] No VIF found with MAC fa:16:3e:76:6d:bb, not building metadata {{(pid=74960) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 12:30:01 user nova-compute[74960]: DEBUG nova.compute.manager [None req-b9cd0691-bbdc-44c0-a9cd-401e91fce4fb tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] Checking state {{(pid=74960) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 12:30:01 user nova-compute[74960]: DEBUG nova.compute.manager [req-35f45de4-e1a7-444d-9712-227ac6873a5b req-70b34d82-27c9-40fd-88b4-71bdd17f8446 service nova] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] Received event network-vif-plugged-40976ae5-5f49-4d8e-abd7-04dc0ce8f319 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:30:01 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-35f45de4-e1a7-444d-9712-227ac6873a5b req-70b34d82-27c9-40fd-88b4-71bdd17f8446 service nova] Acquiring lock "a6199681-f85e-4f55-966b-6ab3f17cd640-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:30:01 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-35f45de4-e1a7-444d-9712-227ac6873a5b req-70b34d82-27c9-40fd-88b4-71bdd17f8446 service nova] Lock "a6199681-f85e-4f55-966b-6ab3f17cd640-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:30:01 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-35f45de4-e1a7-444d-9712-227ac6873a5b req-70b34d82-27c9-40fd-88b4-71bdd17f8446 service nova] Lock "a6199681-f85e-4f55-966b-6ab3f17cd640-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:30:01 user nova-compute[74960]: DEBUG nova.compute.manager [req-35f45de4-e1a7-444d-9712-227ac6873a5b req-70b34d82-27c9-40fd-88b4-71bdd17f8446 service nova] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] No waiting events found dispatching network-vif-plugged-40976ae5-5f49-4d8e-abd7-04dc0ce8f319 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:30:01 user nova-compute[74960]: WARNING nova.compute.manager [req-35f45de4-e1a7-444d-9712-227ac6873a5b req-70b34d82-27c9-40fd-88b4-71bdd17f8446 service nova] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] Received unexpected event network-vif-plugged-40976ae5-5f49-4d8e-abd7-04dc0ce8f319 for instance with vm_state rescued and task_state None.
Nov 03 12:30:01 user nova-compute[74960]: DEBUG nova.compute.manager [req-35f45de4-e1a7-444d-9712-227ac6873a5b req-70b34d82-27c9-40fd-88b4-71bdd17f8446 service nova] [instance: 208570e4-1b11-486b-a79e-4b4eafc26af2] Received event network-changed-ab5d31db-7218-4c01-ba8f-0420e61f4583 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:30:01 user nova-compute[74960]: DEBUG nova.compute.manager [req-35f45de4-e1a7-444d-9712-227ac6873a5b req-70b34d82-27c9-40fd-88b4-71bdd17f8446 service nova] [instance: 208570e4-1b11-486b-a79e-4b4eafc26af2] Refreshing instance network info cache due to event network-changed-ab5d31db-7218-4c01-ba8f-0420e61f4583. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 12:30:01 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-35f45de4-e1a7-444d-9712-227ac6873a5b req-70b34d82-27c9-40fd-88b4-71bdd17f8446 service nova] Acquiring lock "refresh_cache-208570e4-1b11-486b-a79e-4b4eafc26af2" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:30:01 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-35f45de4-e1a7-444d-9712-227ac6873a5b req-70b34d82-27c9-40fd-88b4-71bdd17f8446 service nova] Acquired lock "refresh_cache-208570e4-1b11-486b-a79e-4b4eafc26af2" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:30:01 user nova-compute[74960]: DEBUG nova.network.neutron [req-35f45de4-e1a7-444d-9712-227ac6873a5b req-70b34d82-27c9-40fd-88b4-71bdd17f8446 service nova] [instance: 208570e4-1b11-486b-a79e-4b4eafc26af2] Refreshing network info cache for port ab5d31db-7218-4c01-ba8f-0420e61f4583 {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 12:30:01 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:30:01 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:30:01 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:30:01 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:30:01 user nova-compute[74960]: DEBUG nova.network.neutron [req-35f45de4-e1a7-444d-9712-227ac6873a5b req-70b34d82-27c9-40fd-88b4-71bdd17f8446 service nova] [instance: 208570e4-1b11-486b-a79e-4b4eafc26af2] Updated VIF entry in instance network info cache for port ab5d31db-7218-4c01-ba8f-0420e61f4583. {{(pid=74960) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 12:30:01 user nova-compute[74960]: DEBUG nova.network.neutron [req-35f45de4-e1a7-444d-9712-227ac6873a5b req-70b34d82-27c9-40fd-88b4-71bdd17f8446 service nova] [instance: 208570e4-1b11-486b-a79e-4b4eafc26af2] Updating instance_info_cache with network_info: [{"id": "ab5d31db-7218-4c01-ba8f-0420e61f4583", "address": "fa:16:3e:76:6d:bb", "network": {"id": "78afe6eb-a6db-4f0c-a135-32b7775b5e2a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1883110422-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f91dff8e248b4ca2bedc8631fcaf06f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab5d31db-72", "ovs_interfaceid": "ab5d31db-7218-4c01-ba8f-0420e61f4583", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:30:01 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-35f45de4-e1a7-444d-9712-227ac6873a5b req-70b34d82-27c9-40fd-88b4-71bdd17f8446 service nova] Releasing lock "refresh_cache-208570e4-1b11-486b-a79e-4b4eafc26af2" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:30:02 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:30:02 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:30:02 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:30:02 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:30:02 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-0cf0f810-7d9f-4e0c-aff4-4a0d849167f4 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Acquiring lock "e6cbb630-254f-4c56-9cf9-47d751c703be" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:30:02 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-0cf0f810-7d9f-4e0c-aff4-4a0d849167f4 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Lock "e6cbb630-254f-4c56-9cf9-47d751c703be" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:30:02 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-0cf0f810-7d9f-4e0c-aff4-4a0d849167f4 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Acquiring lock "e6cbb630-254f-4c56-9cf9-47d751c703be-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:30:02 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-0cf0f810-7d9f-4e0c-aff4-4a0d849167f4 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Lock "e6cbb630-254f-4c56-9cf9-47d751c703be-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:30:02 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-0cf0f810-7d9f-4e0c-aff4-4a0d849167f4 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Lock "e6cbb630-254f-4c56-9cf9-47d751c703be-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:30:02 user nova-compute[74960]: INFO nova.compute.manager [None req-0cf0f810-7d9f-4e0c-aff4-4a0d849167f4 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: e6cbb630-254f-4c56-9cf9-47d751c703be] Terminating instance
Nov 03 12:30:02 user nova-compute[74960]: DEBUG nova.compute.manager [None req-0cf0f810-7d9f-4e0c-aff4-4a0d849167f4 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: e6cbb630-254f-4c56-9cf9-47d751c703be] Start destroying the instance on the hypervisor. {{(pid=74960) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 12:30:02 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:30:02 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:30:02 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:30:02 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:30:03 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:30:03 user nova-compute[74960]: DEBUG nova.compute.manager [req-077c110e-ec89-45a9-9a2a-a90ddd6c5eab req-11d628e1-c39c-43e0-9e44-b43fcc33acfc service nova] [instance: 208570e4-1b11-486b-a79e-4b4eafc26af2] Received event network-vif-plugged-ab5d31db-7218-4c01-ba8f-0420e61f4583 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:30:03 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-077c110e-ec89-45a9-9a2a-a90ddd6c5eab req-11d628e1-c39c-43e0-9e44-b43fcc33acfc service nova] Acquiring lock "208570e4-1b11-486b-a79e-4b4eafc26af2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:30:03 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-077c110e-ec89-45a9-9a2a-a90ddd6c5eab req-11d628e1-c39c-43e0-9e44-b43fcc33acfc service nova] Lock "208570e4-1b11-486b-a79e-4b4eafc26af2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:30:03 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-077c110e-ec89-45a9-9a2a-a90ddd6c5eab req-11d628e1-c39c-43e0-9e44-b43fcc33acfc service nova] Lock "208570e4-1b11-486b-a79e-4b4eafc26af2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:30:03 user nova-compute[74960]: DEBUG nova.compute.manager [req-077c110e-ec89-45a9-9a2a-a90ddd6c5eab req-11d628e1-c39c-43e0-9e44-b43fcc33acfc service nova] [instance: 208570e4-1b11-486b-a79e-4b4eafc26af2] No waiting events found dispatching network-vif-plugged-ab5d31db-7218-4c01-ba8f-0420e61f4583 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:30:03 user nova-compute[74960]: WARNING nova.compute.manager [req-077c110e-ec89-45a9-9a2a-a90ddd6c5eab req-11d628e1-c39c-43e0-9e44-b43fcc33acfc service nova] [instance: 208570e4-1b11-486b-a79e-4b4eafc26af2] Received unexpected event network-vif-plugged-ab5d31db-7218-4c01-ba8f-0420e61f4583 for instance with vm_state building and task_state spawning.
Nov 03 12:30:03 user nova-compute[74960]: DEBUG nova.compute.manager [req-077c110e-ec89-45a9-9a2a-a90ddd6c5eab req-11d628e1-c39c-43e0-9e44-b43fcc33acfc service nova] [instance: 208570e4-1b11-486b-a79e-4b4eafc26af2] Received event network-vif-plugged-ab5d31db-7218-4c01-ba8f-0420e61f4583 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:30:03 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-077c110e-ec89-45a9-9a2a-a90ddd6c5eab req-11d628e1-c39c-43e0-9e44-b43fcc33acfc service nova] Acquiring lock "208570e4-1b11-486b-a79e-4b4eafc26af2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:30:03 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-077c110e-ec89-45a9-9a2a-a90ddd6c5eab req-11d628e1-c39c-43e0-9e44-b43fcc33acfc service nova] Lock "208570e4-1b11-486b-a79e-4b4eafc26af2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:30:03 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-077c110e-ec89-45a9-9a2a-a90ddd6c5eab req-11d628e1-c39c-43e0-9e44-b43fcc33acfc service nova] Lock "208570e4-1b11-486b-a79e-4b4eafc26af2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:30:03 user nova-compute[74960]: DEBUG nova.compute.manager [req-077c110e-ec89-45a9-9a2a-a90ddd6c5eab req-11d628e1-c39c-43e0-9e44-b43fcc33acfc service nova] [instance: 208570e4-1b11-486b-a79e-4b4eafc26af2] No waiting events found dispatching network-vif-plugged-ab5d31db-7218-4c01-ba8f-0420e61f4583 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:30:03 user nova-compute[74960]: WARNING nova.compute.manager [req-077c110e-ec89-45a9-9a2a-a90ddd6c5eab req-11d628e1-c39c-43e0-9e44-b43fcc33acfc service nova] [instance: 208570e4-1b11-486b-a79e-4b4eafc26af2] Received unexpected event network-vif-plugged-ab5d31db-7218-4c01-ba8f-0420e61f4583 for instance with vm_state building and task_state spawning.
Nov 03 12:30:03 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: e6cbb630-254f-4c56-9cf9-47d751c703be] Instance destroyed successfully.
Nov 03 12:30:03 user nova-compute[74960]: DEBUG nova.objects.instance [None req-0cf0f810-7d9f-4e0c-aff4-4a0d849167f4 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Lazy-loading 'resources' on Instance uuid e6cbb630-254f-4c56-9cf9-47d751c703be {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:30:03 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-0cf0f810-7d9f-4e0c-aff4-4a0d849167f4 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-03T12:24:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1644828034',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1644828034',id=19,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBByEuco6vUpQ1yRzD8+T3c8kNK+AQMUFF0dlFJOn3loibIfbxPBaNP5PcdHo8YH4HcBd16j2Mx3GJQr5JshLcaNKXedxYhHHkaVLhD0FOSjY4W2miuaoDcU64srC5P9Ncg==',key_name='tempest-keypair-1090973974',keypairs=<?>,launch_index=0,launched_at=2023-11-03T12:28:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c216dd7629274eafbf0a5968ff2378a9',ramdisk_id='',reservation_id='r-t48sleg2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-258463843',owner_user_name='tempest-AttachVolumeShelveTestJSON-258463843-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T12:28:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fae69462930546bdb9cf6e2a11a0df2a',uuid=e6cbb630-254f-4c56-9cf9-47d751c703be,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b5f672c1-3298-4c5a-bf4d-7c712e4c5873", "address": "fa:16:3e:5b:1b:87", "network": {"id": "c03e854d-75a3-4e81-9cdf-f1139841266c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1632999031-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c216dd7629274eafbf0a5968ff2378a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f672c1-32", "ovs_interfaceid": "b5f672c1-3298-4c5a-bf4d-7c712e4c5873", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 12:30:03 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-0cf0f810-7d9f-4e0c-aff4-4a0d849167f4 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Converting VIF {"id": "b5f672c1-3298-4c5a-bf4d-7c712e4c5873", "address": "fa:16:3e:5b:1b:87", "network": {"id": "c03e854d-75a3-4e81-9cdf-f1139841266c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1632999031-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c216dd7629274eafbf0a5968ff2378a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f672c1-32", "ovs_interfaceid": "b5f672c1-3298-4c5a-bf4d-7c712e4c5873", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:30:03 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-0cf0f810-7d9f-4e0c-aff4-4a0d849167f4 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:1b:87,bridge_name='br-int',has_traffic_filtering=True,id=b5f672c1-3298-4c5a-bf4d-7c712e4c5873,network=Network(c03e854d-75a3-4e81-9cdf-f1139841266c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5f672c1-32') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:30:03 user nova-compute[74960]: DEBUG os_vif [None req-0cf0f810-7d9f-4e0c-aff4-4a0d849167f4 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:1b:87,bridge_name='br-int',has_traffic_filtering=True,id=b5f672c1-3298-4c5a-bf4d-7c712e4c5873,network=Network(c03e854d-75a3-4e81-9cdf-f1139841266c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5f672c1-32') {{(pid=74960) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 12:30:03 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:30:03 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb5f672c1-32, bridge=br-int, if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:30:03 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:30:03 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:30:03 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:30:03 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=525f4485-2748-4960-bae1-a8df27d7b9a7) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:30:03 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:30:03 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:30:03 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:30:03 user nova-compute[74960]: INFO os_vif [None req-0cf0f810-7d9f-4e0c-aff4-4a0d849167f4 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:1b:87,bridge_name='br-int',has_traffic_filtering=True,id=b5f672c1-3298-4c5a-bf4d-7c712e4c5873,network=Network(c03e854d-75a3-4e81-9cdf-f1139841266c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5f672c1-32')
Nov 03 12:30:03 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-0cf0f810-7d9f-4e0c-aff4-4a0d849167f4 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: e6cbb630-254f-4c56-9cf9-47d751c703be] Deleting instance files /opt/stack/data/nova/instances/e6cbb630-254f-4c56-9cf9-47d751c703be_del
Nov 03 12:30:03 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-0cf0f810-7d9f-4e0c-aff4-4a0d849167f4 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: e6cbb630-254f-4c56-9cf9-47d751c703be] Deletion of /opt/stack/data/nova/instances/e6cbb630-254f-4c56-9cf9-47d751c703be_del complete
Nov 03 12:30:03 user nova-compute[74960]: DEBUG nova.compute.manager [req-c298954f-a09c-44fd-a9de-d9ffba810def req-d904b625-2099-4bc0-80b2-f3f742fb224b service nova] [instance: e6cbb630-254f-4c56-9cf9-47d751c703be] Received event network-vif-unplugged-b5f672c1-3298-4c5a-bf4d-7c712e4c5873 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:30:03 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-c298954f-a09c-44fd-a9de-d9ffba810def req-d904b625-2099-4bc0-80b2-f3f742fb224b service nova] Acquiring lock "e6cbb630-254f-4c56-9cf9-47d751c703be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:30:03 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-c298954f-a09c-44fd-a9de-d9ffba810def req-d904b625-2099-4bc0-80b2-f3f742fb224b service nova] Lock "e6cbb630-254f-4c56-9cf9-47d751c703be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:30:03 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-c298954f-a09c-44fd-a9de-d9ffba810def req-d904b625-2099-4bc0-80b2-f3f742fb224b service nova] Lock "e6cbb630-254f-4c56-9cf9-47d751c703be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:30:03 user nova-compute[74960]: DEBUG nova.compute.manager [req-c298954f-a09c-44fd-a9de-d9ffba810def req-d904b625-2099-4bc0-80b2-f3f742fb224b service nova] [instance: e6cbb630-254f-4c56-9cf9-47d751c703be] No waiting events found dispatching network-vif-unplugged-b5f672c1-3298-4c5a-bf4d-7c712e4c5873 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:30:03 user nova-compute[74960]: DEBUG nova.compute.manager [req-c298954f-a09c-44fd-a9de-d9ffba810def req-d904b625-2099-4bc0-80b2-f3f742fb224b service nova] [instance: e6cbb630-254f-4c56-9cf9-47d751c703be] Received event network-vif-unplugged-b5f672c1-3298-4c5a-bf4d-7c712e4c5873 for instance with task_state deleting. {{(pid=74960) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 12:30:03 user nova-compute[74960]: INFO nova.compute.manager [None req-0cf0f810-7d9f-4e0c-aff4-4a0d849167f4 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] [instance: e6cbb630-254f-4c56-9cf9-47d751c703be] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 03 12:30:03 user nova-compute[74960]: DEBUG oslo.service.loopingcall [None req-0cf0f810-7d9f-4e0c-aff4-4a0d849167f4 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74960) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 12:30:03 user nova-compute[74960]: DEBUG nova.compute.manager [-] [instance: e6cbb630-254f-4c56-9cf9-47d751c703be] Deallocating network for instance {{(pid=74960) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 12:30:03 user nova-compute[74960]: DEBUG nova.network.neutron [-] [instance: e6cbb630-254f-4c56-9cf9-47d751c703be] deallocate_for_instance() {{(pid=74960) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 12:30:04 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:30:04 user nova-compute[74960]: DEBUG nova.compute.manager [None req-cb73ece2-52d7-4fdb-a2ad-7d8c69f18c02 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] [instance: 208570e4-1b11-486b-a79e-4b4eafc26af2] Instance event wait completed in 0 seconds for  {{(pid=74960) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 12:30:04 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-cb73ece2-52d7-4fdb-a2ad-7d8c69f18c02 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] [instance: 208570e4-1b11-486b-a79e-4b4eafc26af2] Guest created on hypervisor {{(pid=74960) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 12:30:04 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: 208570e4-1b11-486b-a79e-4b4eafc26af2] Instance spawned successfully.
Nov 03 12:30:04 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-cb73ece2-52d7-4fdb-a2ad-7d8c69f18c02 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] [instance: 208570e4-1b11-486b-a79e-4b4eafc26af2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 12:30:04 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-cb73ece2-52d7-4fdb-a2ad-7d8c69f18c02 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] [instance: 208570e4-1b11-486b-a79e-4b4eafc26af2] Found default for hw_cdrom_bus of ide {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:30:04 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-cb73ece2-52d7-4fdb-a2ad-7d8c69f18c02 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] [instance: 208570e4-1b11-486b-a79e-4b4eafc26af2] Found default for hw_disk_bus of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:30:04 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-cb73ece2-52d7-4fdb-a2ad-7d8c69f18c02 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] [instance: 208570e4-1b11-486b-a79e-4b4eafc26af2] Found default for hw_input_bus of None {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:30:04 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-cb73ece2-52d7-4fdb-a2ad-7d8c69f18c02 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] [instance: 208570e4-1b11-486b-a79e-4b4eafc26af2] Found default for hw_pointer_model of None {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:30:04 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-cb73ece2-52d7-4fdb-a2ad-7d8c69f18c02 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] [instance: 208570e4-1b11-486b-a79e-4b4eafc26af2] Found default for hw_video_model of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:30:04 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-cb73ece2-52d7-4fdb-a2ad-7d8c69f18c02 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] [instance: 208570e4-1b11-486b-a79e-4b4eafc26af2] Found default for hw_vif_model of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:30:04 user nova-compute[74960]: INFO nova.compute.manager [None req-cb73ece2-52d7-4fdb-a2ad-7d8c69f18c02 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] [instance: 208570e4-1b11-486b-a79e-4b4eafc26af2] Took 6.82 seconds to spawn the instance on the hypervisor.
Nov 03 12:30:04 user nova-compute[74960]: DEBUG nova.compute.manager [None req-cb73ece2-52d7-4fdb-a2ad-7d8c69f18c02 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] [instance: 208570e4-1b11-486b-a79e-4b4eafc26af2] Checking state {{(pid=74960) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 12:30:04 user nova-compute[74960]: INFO nova.compute.manager [None req-cb73ece2-52d7-4fdb-a2ad-7d8c69f18c02 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] [instance: 208570e4-1b11-486b-a79e-4b4eafc26af2] Took 8.42 seconds to build instance.
Nov 03 12:30:04 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-cb73ece2-52d7-4fdb-a2ad-7d8c69f18c02 tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Lock "208570e4-1b11-486b-a79e-4b4eafc26af2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.639s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:30:04 user nova-compute[74960]: DEBUG nova.network.neutron [-] [instance: e6cbb630-254f-4c56-9cf9-47d751c703be] Updating instance_info_cache with network_info: [] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:30:04 user nova-compute[74960]: INFO nova.compute.manager [-] [instance: e6cbb630-254f-4c56-9cf9-47d751c703be] Took 1.33 seconds to deallocate network for instance.
Nov 03 12:30:05 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-0cf0f810-7d9f-4e0c-aff4-4a0d849167f4 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:30:05 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-0cf0f810-7d9f-4e0c-aff4-4a0d849167f4 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:30:05 user nova-compute[74960]: DEBUG nova.compute.manager [req-209c6bcd-12ef-4697-afe6-d45907ab857a req-6d5b62ac-5a86-40b9-942a-6ff1c5ba2c15 service nova] [instance: e6cbb630-254f-4c56-9cf9-47d751c703be] Received event network-vif-deleted-b5f672c1-3298-4c5a-bf4d-7c712e4c5873 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:30:05 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-0cf0f810-7d9f-4e0c-aff4-4a0d849167f4 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:30:05 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-0cf0f810-7d9f-4e0c-aff4-4a0d849167f4 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:30:05 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-0cf0f810-7d9f-4e0c-aff4-4a0d849167f4 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.560s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:30:05 user nova-compute[74960]: DEBUG nova.compute.manager [req-7244a6fe-1382-435e-a7f3-4666cdcf1583 req-9dae6fa0-6bfb-4b60-9c31-eeb1f5a7f6e4 service nova] [instance: e6cbb630-254f-4c56-9cf9-47d751c703be] Received event network-vif-plugged-b5f672c1-3298-4c5a-bf4d-7c712e4c5873 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:30:05 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-7244a6fe-1382-435e-a7f3-4666cdcf1583 req-9dae6fa0-6bfb-4b60-9c31-eeb1f5a7f6e4 service nova] Acquiring lock "e6cbb630-254f-4c56-9cf9-47d751c703be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:30:05 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-7244a6fe-1382-435e-a7f3-4666cdcf1583 req-9dae6fa0-6bfb-4b60-9c31-eeb1f5a7f6e4 service nova] Lock "e6cbb630-254f-4c56-9cf9-47d751c703be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:30:05 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-7244a6fe-1382-435e-a7f3-4666cdcf1583 req-9dae6fa0-6bfb-4b60-9c31-eeb1f5a7f6e4 service nova] Lock "e6cbb630-254f-4c56-9cf9-47d751c703be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:30:05 user nova-compute[74960]: DEBUG nova.compute.manager [req-7244a6fe-1382-435e-a7f3-4666cdcf1583 req-9dae6fa0-6bfb-4b60-9c31-eeb1f5a7f6e4 service nova] [instance: e6cbb630-254f-4c56-9cf9-47d751c703be] No waiting events found dispatching network-vif-plugged-b5f672c1-3298-4c5a-bf4d-7c712e4c5873 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:30:05 user nova-compute[74960]: WARNING nova.compute.manager [req-7244a6fe-1382-435e-a7f3-4666cdcf1583 req-9dae6fa0-6bfb-4b60-9c31-eeb1f5a7f6e4 service nova] [instance: e6cbb630-254f-4c56-9cf9-47d751c703be] Received unexpected event network-vif-plugged-b5f672c1-3298-4c5a-bf4d-7c712e4c5873 for instance with vm_state deleted and task_state None.
Nov 03 12:30:05 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-f5cf9b2c-88f6-486f-bdd1-cf967458b1c2 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Acquiring lock "7a33549f-51ea-42d0-8c8a-67d9c74784fd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:30:05 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-f5cf9b2c-88f6-486f-bdd1-cf967458b1c2 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Lock "7a33549f-51ea-42d0-8c8a-67d9c74784fd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:30:05 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-f5cf9b2c-88f6-486f-bdd1-cf967458b1c2 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Acquiring lock "7a33549f-51ea-42d0-8c8a-67d9c74784fd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:30:05 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-f5cf9b2c-88f6-486f-bdd1-cf967458b1c2 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Lock "7a33549f-51ea-42d0-8c8a-67d9c74784fd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:30:05 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-f5cf9b2c-88f6-486f-bdd1-cf967458b1c2 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Lock "7a33549f-51ea-42d0-8c8a-67d9c74784fd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:30:05 user nova-compute[74960]: INFO nova.compute.manager [None req-f5cf9b2c-88f6-486f-bdd1-cf967458b1c2 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] [instance: 7a33549f-51ea-42d0-8c8a-67d9c74784fd] Terminating instance
Nov 03 12:30:05 user nova-compute[74960]: DEBUG nova.compute.manager [None req-f5cf9b2c-88f6-486f-bdd1-cf967458b1c2 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] [instance: 7a33549f-51ea-42d0-8c8a-67d9c74784fd] Start destroying the instance on the hypervisor. {{(pid=74960) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 12:30:05 user nova-compute[74960]: INFO nova.scheduler.client.report [None req-0cf0f810-7d9f-4e0c-aff4-4a0d849167f4 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Deleted allocations for instance e6cbb630-254f-4c56-9cf9-47d751c703be
Nov 03 12:30:05 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:30:05 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:30:05 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:30:05 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-0cf0f810-7d9f-4e0c-aff4-4a0d849167f4 tempest-AttachVolumeShelveTestJSON-258463843 tempest-AttachVolumeShelveTestJSON-258463843-project-member] Lock "e6cbb630-254f-4c56-9cf9-47d751c703be" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.081s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:30:05 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:30:06 user nova-compute[74960]: DEBUG nova.compute.manager [req-337b8832-d480-424c-b351-27f55dd701e2 req-5fd9f2ab-7e28-4046-b86d-c0d5c93a38fb service nova] [instance: 7a33549f-51ea-42d0-8c8a-67d9c74784fd] Received event network-vif-unplugged-158f13f7-d1d8-49aa-94e1-86d34a25f75e {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:30:06 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-337b8832-d480-424c-b351-27f55dd701e2 req-5fd9f2ab-7e28-4046-b86d-c0d5c93a38fb service nova] Acquiring lock "7a33549f-51ea-42d0-8c8a-67d9c74784fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:30:06 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-337b8832-d480-424c-b351-27f55dd701e2 req-5fd9f2ab-7e28-4046-b86d-c0d5c93a38fb service nova] Lock "7a33549f-51ea-42d0-8c8a-67d9c74784fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:30:06 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-337b8832-d480-424c-b351-27f55dd701e2 req-5fd9f2ab-7e28-4046-b86d-c0d5c93a38fb service nova] Lock "7a33549f-51ea-42d0-8c8a-67d9c74784fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:30:06 user nova-compute[74960]: DEBUG nova.compute.manager [req-337b8832-d480-424c-b351-27f55dd701e2 req-5fd9f2ab-7e28-4046-b86d-c0d5c93a38fb service nova] [instance: 7a33549f-51ea-42d0-8c8a-67d9c74784fd] No waiting events found dispatching network-vif-unplugged-158f13f7-d1d8-49aa-94e1-86d34a25f75e {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:30:06 user nova-compute[74960]: DEBUG nova.compute.manager [req-337b8832-d480-424c-b351-27f55dd701e2 req-5fd9f2ab-7e28-4046-b86d-c0d5c93a38fb service nova] [instance: 7a33549f-51ea-42d0-8c8a-67d9c74784fd] Received event network-vif-unplugged-158f13f7-d1d8-49aa-94e1-86d34a25f75e for instance with task_state deleting. {{(pid=74960) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 12:30:06 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: 7a33549f-51ea-42d0-8c8a-67d9c74784fd] Instance destroyed successfully.
Nov 03 12:30:06 user nova-compute[74960]: DEBUG nova.objects.instance [None req-f5cf9b2c-88f6-486f-bdd1-cf967458b1c2 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Lazy-loading 'resources' on Instance uuid 7a33549f-51ea-42d0-8c8a-67d9c74784fd {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:30:06 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-f5cf9b2c-88f6-486f-bdd1-cf967458b1c2 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:25:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-944804881',display_name='tempest-TestServerVolumeAttachmentScenario-server-944804881',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-944804881',id=21,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP9hTP9Rn5S3uup79Imaa70Le/FY0pvmyj+fPRkzHKeBrHQvbFUbePNk6boUMNbSHGFM4JP22LalfBLwcgreE38zI4RAzwqFTyB1g7kqP9kilVEk/fAA27qCcIAWsxCjyQ==',key_name='tempest-keypair-1217467644',keypairs=<?>,launch_index=0,launched_at=2023-11-03T12:25:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ef726fdd031e432489ebe9a7b0ddc97f',ramdisk_id='',reservation_id='r-ro4vbnru',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1974523773',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1974523773-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T12:25:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='15d7b1f66fd542abbadfcb9ccb888a5a',uuid=7a33549f-51ea-42d0-8c8a-67d9c74784fd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "158f13f7-d1d8-49aa-94e1-86d34a25f75e", "address": "fa:16:3e:1d:94:c7", "network": {"id": "d311275c-1112-433a-a2ae-7d0e452d825b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1949997511-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef726fdd031e432489ebe9a7b0ddc97f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap158f13f7-d1", "ovs_interfaceid": "158f13f7-d1d8-49aa-94e1-86d34a25f75e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 12:30:06 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-f5cf9b2c-88f6-486f-bdd1-cf967458b1c2 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Converting VIF {"id": "158f13f7-d1d8-49aa-94e1-86d34a25f75e", "address": "fa:16:3e:1d:94:c7", "network": {"id": "d311275c-1112-433a-a2ae-7d0e452d825b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1949997511-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef726fdd031e432489ebe9a7b0ddc97f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap158f13f7-d1", "ovs_interfaceid": "158f13f7-d1d8-49aa-94e1-86d34a25f75e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:30:06 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-f5cf9b2c-88f6-486f-bdd1-cf967458b1c2 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1d:94:c7,bridge_name='br-int',has_traffic_filtering=True,id=158f13f7-d1d8-49aa-94e1-86d34a25f75e,network=Network(d311275c-1112-433a-a2ae-7d0e452d825b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap158f13f7-d1') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:30:06 user nova-compute[74960]: DEBUG os_vif [None req-f5cf9b2c-88f6-486f-bdd1-cf967458b1c2 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1d:94:c7,bridge_name='br-int',has_traffic_filtering=True,id=158f13f7-d1d8-49aa-94e1-86d34a25f75e,network=Network(d311275c-1112-433a-a2ae-7d0e452d825b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap158f13f7-d1') {{(pid=74960) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 12:30:06 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:30:06 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap158f13f7-d1, bridge=br-int, if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:30:06 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:30:06 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:30:06 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:30:06 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a955c54f-06a9-4850-866a-2a66468290f9) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:30:06 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:30:06 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:30:06 user nova-compute[74960]: INFO os_vif [None req-f5cf9b2c-88f6-486f-bdd1-cf967458b1c2 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1d:94:c7,bridge_name='br-int',has_traffic_filtering=True,id=158f13f7-d1d8-49aa-94e1-86d34a25f75e,network=Network(d311275c-1112-433a-a2ae-7d0e452d825b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap158f13f7-d1')
Nov 03 12:30:06 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-f5cf9b2c-88f6-486f-bdd1-cf967458b1c2 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] [instance: 7a33549f-51ea-42d0-8c8a-67d9c74784fd] Deleting instance files /opt/stack/data/nova/instances/7a33549f-51ea-42d0-8c8a-67d9c74784fd_del
Nov 03 12:30:06 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-f5cf9b2c-88f6-486f-bdd1-cf967458b1c2 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] [instance: 7a33549f-51ea-42d0-8c8a-67d9c74784fd] Deletion of /opt/stack/data/nova/instances/7a33549f-51ea-42d0-8c8a-67d9c74784fd_del complete
Nov 03 12:30:06 user nova-compute[74960]: INFO nova.compute.manager [None req-f5cf9b2c-88f6-486f-bdd1-cf967458b1c2 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] [instance: 7a33549f-51ea-42d0-8c8a-67d9c74784fd] Took 1.00 seconds to destroy the instance on the hypervisor.
Nov 03 12:30:06 user nova-compute[74960]: DEBUG oslo.service.loopingcall [None req-f5cf9b2c-88f6-486f-bdd1-cf967458b1c2 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74960) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 12:30:06 user nova-compute[74960]: DEBUG nova.compute.manager [-] [instance: 7a33549f-51ea-42d0-8c8a-67d9c74784fd] Deallocating network for instance {{(pid=74960) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 12:30:06 user nova-compute[74960]: DEBUG nova.network.neutron [-] [instance: 7a33549f-51ea-42d0-8c8a-67d9c74784fd] deallocate_for_instance() {{(pid=74960) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 12:30:06 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:30:07 user nova-compute[74960]: DEBUG nova.network.neutron [-] [instance: 7a33549f-51ea-42d0-8c8a-67d9c74784fd] Updating instance_info_cache with network_info: [] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:30:07 user nova-compute[74960]: INFO nova.compute.manager [-] [instance: 7a33549f-51ea-42d0-8c8a-67d9c74784fd] Took 1.28 seconds to deallocate network for instance.
Nov 03 12:30:07 user nova-compute[74960]: DEBUG nova.compute.manager [req-b0cf3c8c-0d46-4d68-92a3-99cb4aec4621 req-a6ad957a-2a60-49ba-b493-0fe549083055 service nova] [instance: 7a33549f-51ea-42d0-8c8a-67d9c74784fd] Received event network-vif-deleted-158f13f7-d1d8-49aa-94e1-86d34a25f75e {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:30:08 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-f5cf9b2c-88f6-486f-bdd1-cf967458b1c2 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:30:08 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-f5cf9b2c-88f6-486f-bdd1-cf967458b1c2 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:30:08 user nova-compute[74960]: DEBUG nova.compute.manager [req-4b5f1038-e1ce-4acc-b2f8-337fa4af597f req-0f792f4c-793e-4a44-ae14-819f80aa06f4 service nova] [instance: 7a33549f-51ea-42d0-8c8a-67d9c74784fd] Received event network-vif-plugged-158f13f7-d1d8-49aa-94e1-86d34a25f75e {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:30:08 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-4b5f1038-e1ce-4acc-b2f8-337fa4af597f req-0f792f4c-793e-4a44-ae14-819f80aa06f4 service nova] Acquiring lock "7a33549f-51ea-42d0-8c8a-67d9c74784fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:30:08 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-4b5f1038-e1ce-4acc-b2f8-337fa4af597f req-0f792f4c-793e-4a44-ae14-819f80aa06f4 service nova] Lock "7a33549f-51ea-42d0-8c8a-67d9c74784fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:30:08 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-4b5f1038-e1ce-4acc-b2f8-337fa4af597f req-0f792f4c-793e-4a44-ae14-819f80aa06f4 service nova] Lock "7a33549f-51ea-42d0-8c8a-67d9c74784fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:30:08 user nova-compute[74960]: DEBUG nova.compute.manager [req-4b5f1038-e1ce-4acc-b2f8-337fa4af597f req-0f792f4c-793e-4a44-ae14-819f80aa06f4 service nova] [instance: 7a33549f-51ea-42d0-8c8a-67d9c74784fd] No waiting events found dispatching network-vif-plugged-158f13f7-d1d8-49aa-94e1-86d34a25f75e {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:30:08 user nova-compute[74960]: WARNING nova.compute.manager [req-4b5f1038-e1ce-4acc-b2f8-337fa4af597f req-0f792f4c-793e-4a44-ae14-819f80aa06f4 service nova] [instance: 7a33549f-51ea-42d0-8c8a-67d9c74784fd] Received unexpected event network-vif-plugged-158f13f7-d1d8-49aa-94e1-86d34a25f75e for instance with vm_state deleted and task_state None.
Nov 03 12:30:08 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:30:08 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-f5cf9b2c-88f6-486f-bdd1-cf967458b1c2 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:30:08 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-f5cf9b2c-88f6-486f-bdd1-cf967458b1c2 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:30:08 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-f5cf9b2c-88f6-486f-bdd1-cf967458b1c2 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.506s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:30:08 user nova-compute[74960]: INFO nova.scheduler.client.report [None req-f5cf9b2c-88f6-486f-bdd1-cf967458b1c2 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Deleted allocations for instance 7a33549f-51ea-42d0-8c8a-67d9c74784fd
Nov 03 12:30:08 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-f5cf9b2c-88f6-486f-bdd1-cf967458b1c2 tempest-TestServerVolumeAttachmentScenario-1974523773 tempest-TestServerVolumeAttachmentScenario-1974523773-project-member] Lock "7a33549f-51ea-42d0-8c8a-67d9c74784fd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.022s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:30:11 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:30:11 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:30:13 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:30:14 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:30:16 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:30:18 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:30:21 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:30:23 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:30:26 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:30:26 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:30:28 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:30:31 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:30:32 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:30:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:30:34 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:30:36 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:30:37 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-6b489aaf-c9da-45a7-814e-3910acad87fa tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Acquiring lock "5b7b95c0-3726-4a1c-a384-ec91abf75225" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:30:37 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-6b489aaf-c9da-45a7-814e-3910acad87fa tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Lock "5b7b95c0-3726-4a1c-a384-ec91abf75225" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:30:37 user nova-compute[74960]: DEBUG nova.compute.manager [None req-6b489aaf-c9da-45a7-814e-3910acad87fa tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] Starting instance... {{(pid=74960) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 12:30:37 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-6b489aaf-c9da-45a7-814e-3910acad87fa tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:30:37 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-6b489aaf-c9da-45a7-814e-3910acad87fa tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:30:37 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-6b489aaf-c9da-45a7-814e-3910acad87fa tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74960) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 12:30:37 user nova-compute[74960]: INFO nova.compute.claims [None req-6b489aaf-c9da-45a7-814e-3910acad87fa tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] Claim successful on node user
Nov 03 12:30:37 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-6b489aaf-c9da-45a7-814e-3910acad87fa tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:30:37 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-6b489aaf-c9da-45a7-814e-3910acad87fa tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:30:37 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-6b489aaf-c9da-45a7-814e-3910acad87fa tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.444s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:30:37 user nova-compute[74960]: DEBUG nova.compute.manager [None req-6b489aaf-c9da-45a7-814e-3910acad87fa tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] Start building networks asynchronously for instance. {{(pid=74960) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 12:30:37 user nova-compute[74960]: DEBUG nova.compute.manager [None req-6b489aaf-c9da-45a7-814e-3910acad87fa tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] Allocating IP information in the background. {{(pid=74960) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 12:30:37 user nova-compute[74960]: DEBUG nova.network.neutron [None req-6b489aaf-c9da-45a7-814e-3910acad87fa tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] allocate_for_instance() {{(pid=74960) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 12:30:37 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-6b489aaf-c9da-45a7-814e-3910acad87fa tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 12:30:37 user nova-compute[74960]: DEBUG nova.compute.manager [None req-6b489aaf-c9da-45a7-814e-3910acad87fa tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] Start building block device mappings for instance. {{(pid=74960) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 12:30:37 user nova-compute[74960]: DEBUG nova.policy [None req-6b489aaf-c9da-45a7-814e-3910acad87fa tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8c599d8677454b60b9434689322a6de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9160afcfdb74ba2aad7bc79e628e96f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74960) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 12:30:37 user nova-compute[74960]: DEBUG nova.compute.manager [None req-6b489aaf-c9da-45a7-814e-3910acad87fa tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] Start spawning the instance on the hypervisor. {{(pid=74960) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 12:30:37 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-6b489aaf-c9da-45a7-814e-3910acad87fa tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] Creating instance directory {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 12:30:37 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-6b489aaf-c9da-45a7-814e-3910acad87fa tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] Creating image(s)
Nov 03 12:30:37 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-6b489aaf-c9da-45a7-814e-3910acad87fa tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Acquiring lock "/opt/stack/data/nova/instances/5b7b95c0-3726-4a1c-a384-ec91abf75225/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:30:37 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-6b489aaf-c9da-45a7-814e-3910acad87fa tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Lock "/opt/stack/data/nova/instances/5b7b95c0-3726-4a1c-a384-ec91abf75225/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:30:37 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-6b489aaf-c9da-45a7-814e-3910acad87fa tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Lock "/opt/stack/data/nova/instances/5b7b95c0-3726-4a1c-a384-ec91abf75225/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:30:37 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-6b489aaf-c9da-45a7-814e-3910acad87fa tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:30:38 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-6b489aaf-c9da-45a7-814e-3910acad87fa tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.179s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:30:38 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-6b489aaf-c9da-45a7-814e-3910acad87fa tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Acquiring lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:30:38 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-6b489aaf-c9da-45a7-814e-3910acad87fa tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:30:38 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-6b489aaf-c9da-45a7-814e-3910acad87fa tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:30:38 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-6b489aaf-c9da-45a7-814e-3910acad87fa tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.177s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:30:38 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-6b489aaf-c9da-45a7-814e-3910acad87fa tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910,backing_fmt=raw /opt/stack/data/nova/instances/5b7b95c0-3726-4a1c-a384-ec91abf75225/disk 1073741824 {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:30:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:30:38 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-6b489aaf-c9da-45a7-814e-3910acad87fa tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910,backing_fmt=raw /opt/stack/data/nova/instances/5b7b95c0-3726-4a1c-a384-ec91abf75225/disk 1073741824" returned: 0 in 0.052s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:30:38 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-6b489aaf-c9da-45a7-814e-3910acad87fa tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:30:38 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-6b489aaf-c9da-45a7-814e-3910acad87fa tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:30:38 user nova-compute[74960]: DEBUG nova.network.neutron [None req-6b489aaf-c9da-45a7-814e-3910acad87fa tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] Successfully created port: 091cbb89-dd8a-448e-963a-3dbcafde6bb1 {{(pid=74960) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 12:30:38 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-6b489aaf-c9da-45a7-814e-3910acad87fa tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.192s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:30:38 user nova-compute[74960]: DEBUG nova.virt.disk.api [None req-6b489aaf-c9da-45a7-814e-3910acad87fa tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5b7b95c0-3726-4a1c-a384-ec91abf75225/disk. size=1073741824 {{(pid=74960) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 12:30:38 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-6b489aaf-c9da-45a7-814e-3910acad87fa tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7b95c0-3726-4a1c-a384-ec91abf75225/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:30:38 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-6b489aaf-c9da-45a7-814e-3910acad87fa tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7b95c0-3726-4a1c-a384-ec91abf75225/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:30:38 user nova-compute[74960]: DEBUG nova.virt.disk.api [None req-6b489aaf-c9da-45a7-814e-3910acad87fa tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Cannot resize image /opt/stack/data/nova/instances/5b7b95c0-3726-4a1c-a384-ec91abf75225/disk to a smaller size. {{(pid=74960) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 12:30:38 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-6b489aaf-c9da-45a7-814e-3910acad87fa tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] Created local disks {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 12:30:38 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-6b489aaf-c9da-45a7-814e-3910acad87fa tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] Ensure instance console log exists: /opt/stack/data/nova/instances/5b7b95c0-3726-4a1c-a384-ec91abf75225/console.log {{(pid=74960) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 12:30:38 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-6b489aaf-c9da-45a7-814e-3910acad87fa tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:30:38 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-6b489aaf-c9da-45a7-814e-3910acad87fa tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:30:38 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-6b489aaf-c9da-45a7-814e-3910acad87fa tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:30:39 user nova-compute[74960]: DEBUG nova.network.neutron [None req-6b489aaf-c9da-45a7-814e-3910acad87fa tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] Successfully updated port: 091cbb89-dd8a-448e-963a-3dbcafde6bb1 {{(pid=74960) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 12:30:39 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-6b489aaf-c9da-45a7-814e-3910acad87fa tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Acquiring lock "refresh_cache-5b7b95c0-3726-4a1c-a384-ec91abf75225" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:30:39 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-6b489aaf-c9da-45a7-814e-3910acad87fa tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Acquired lock "refresh_cache-5b7b95c0-3726-4a1c-a384-ec91abf75225" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:30:39 user nova-compute[74960]: DEBUG nova.network.neutron [None req-6b489aaf-c9da-45a7-814e-3910acad87fa tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] Building network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 12:30:39 user nova-compute[74960]: DEBUG nova.compute.manager [req-1dd83e36-34f8-4dbc-95a0-c0174448bb90 req-f6f8afe6-5ea2-4c5a-87cd-8f7596e64ad8 service nova] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] Received event network-changed-091cbb89-dd8a-448e-963a-3dbcafde6bb1 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:30:39 user nova-compute[74960]: DEBUG nova.compute.manager [req-1dd83e36-34f8-4dbc-95a0-c0174448bb90 req-f6f8afe6-5ea2-4c5a-87cd-8f7596e64ad8 service nova] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] Refreshing instance network info cache due to event network-changed-091cbb89-dd8a-448e-963a-3dbcafde6bb1. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 12:30:39 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-1dd83e36-34f8-4dbc-95a0-c0174448bb90 req-f6f8afe6-5ea2-4c5a-87cd-8f7596e64ad8 service nova] Acquiring lock "refresh_cache-5b7b95c0-3726-4a1c-a384-ec91abf75225" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:30:39 user nova-compute[74960]: DEBUG nova.network.neutron [None req-6b489aaf-c9da-45a7-814e-3910acad87fa tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] Instance cache missing network info. {{(pid=74960) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 12:30:40 user nova-compute[74960]: DEBUG nova.network.neutron [None req-6b489aaf-c9da-45a7-814e-3910acad87fa tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] Updating instance_info_cache with network_info: [{"id": "091cbb89-dd8a-448e-963a-3dbcafde6bb1", "address": "fa:16:3e:cc:a5:1b", "network": {"id": "3eaeac55-9eb7-4301-b5a7-d13735656d8e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-826950903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9160afcfdb74ba2aad7bc79e628e96f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap091cbb89-dd", "ovs_interfaceid": "091cbb89-dd8a-448e-963a-3dbcafde6bb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:30:40 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-6b489aaf-c9da-45a7-814e-3910acad87fa tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Releasing lock "refresh_cache-5b7b95c0-3726-4a1c-a384-ec91abf75225" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:30:40 user nova-compute[74960]: DEBUG nova.compute.manager [None req-6b489aaf-c9da-45a7-814e-3910acad87fa tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] Instance network_info: |[{"id": "091cbb89-dd8a-448e-963a-3dbcafde6bb1", "address": "fa:16:3e:cc:a5:1b", "network": {"id": "3eaeac55-9eb7-4301-b5a7-d13735656d8e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-826950903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9160afcfdb74ba2aad7bc79e628e96f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap091cbb89-dd", "ovs_interfaceid": "091cbb89-dd8a-448e-963a-3dbcafde6bb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74960) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 12:30:40 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-1dd83e36-34f8-4dbc-95a0-c0174448bb90 req-f6f8afe6-5ea2-4c5a-87cd-8f7596e64ad8 service nova] Acquired lock "refresh_cache-5b7b95c0-3726-4a1c-a384-ec91abf75225" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:30:40 user nova-compute[74960]: DEBUG nova.network.neutron [req-1dd83e36-34f8-4dbc-95a0-c0174448bb90 req-f6f8afe6-5ea2-4c5a-87cd-8f7596e64ad8 service nova] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] Refreshing network info cache for port 091cbb89-dd8a-448e-963a-3dbcafde6bb1 {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 12:30:40 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-6b489aaf-c9da-45a7-814e-3910acad87fa tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] Start _get_guest_xml network_info=[{"id": "091cbb89-dd8a-448e-963a-3dbcafde6bb1", "address": "fa:16:3e:cc:a5:1b", "network": {"id": "3eaeac55-9eb7-4301-b5a7-d13735656d8e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-826950903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9160afcfdb74ba2aad7bc79e628e96f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap091cbb89-dd", "ovs_interfaceid": "091cbb89-dd8a-448e-963a-3dbcafde6bb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=549f51ba-ac69-494b-8de1-34635aa2d7cf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='63ee9c80c632442fb0379f47b784bd20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T12:13:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'image_id': '549f51ba-ac69-494b-8de1-34635aa2d7cf'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 12:30:40 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-6b489aaf-c9da-45a7-814e-3910acad87fa tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:30:40 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-6b489aaf-c9da-45a7-814e-3910acad87fa tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:30:40 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-6b489aaf-c9da-45a7-814e-3910acad87fa tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 12:30:40 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-6b489aaf-c9da-45a7-814e-3910acad87fa tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] CPU controller missing on host. {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 12:30:40 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-6b489aaf-c9da-45a7-814e-3910acad87fa tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 12:30:40 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-6b489aaf-c9da-45a7-814e-3910acad87fa tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] CPU controller found on host. {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 12:30:40 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-6b489aaf-c9da-45a7-814e-3910acad87fa tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74960) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 12:30:40 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-6b489aaf-c9da-45a7-814e-3910acad87fa tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=549f51ba-ac69-494b-8de1-34635aa2d7cf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='63ee9c80c632442fb0379f47b784bd20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T12:13:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 12:30:40 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-6b489aaf-c9da-45a7-814e-3910acad87fa tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Flavor limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 12:30:40 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-6b489aaf-c9da-45a7-814e-3910acad87fa tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Image limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 12:30:40 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-6b489aaf-c9da-45a7-814e-3910acad87fa tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Flavor pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 12:30:40 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-6b489aaf-c9da-45a7-814e-3910acad87fa tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Image pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 12:30:40 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-6b489aaf-c9da-45a7-814e-3910acad87fa tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 12:30:40 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-6b489aaf-c9da-45a7-814e-3910acad87fa tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 12:30:40 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-6b489aaf-c9da-45a7-814e-3910acad87fa tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 12:30:40 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-6b489aaf-c9da-45a7-814e-3910acad87fa tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Got 1 possible topologies {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 12:30:40 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-6b489aaf-c9da-45a7-814e-3910acad87fa tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 12:30:40 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-6b489aaf-c9da-45a7-814e-3910acad87fa tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 12:30:40 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-6b489aaf-c9da-45a7-814e-3910acad87fa tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:30:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-666638080',display_name='tempest-AttachVolumeTestJSON-server-666638080',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-666638080',id=28,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIQ2G2kW7RG3ei1U+rVcmbI+Ton8kNiQZeMxqXkABUJCy9iuRMgTZBhGnWGCs6R7DHln/91d5py8pZC0KUaGy+7UnlGfb1FgAKzTpiPtdr0uDnrIs+6hQLHu9y+wv2TiKg==',key_name='tempest-keypair-691388173',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a9160afcfdb74ba2aad7bc79e628e96f',ramdisk_id='',reservation_id='r-na1kxuhs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-847320603',owner_user_name='tempest-AttachVolumeTestJSON-847320603-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:30:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c599d8677454b60b9434689322a6de2',uuid=5b7b95c0-3726-4a1c-a384-ec91abf75225,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "091cbb89-dd8a-448e-963a-3dbcafde6bb1", "address": "fa:16:3e:cc:a5:1b", "network": {"id": "3eaeac55-9eb7-4301-b5a7-d13735656d8e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-826950903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9160afcfdb74ba2aad7bc79e628e96f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap091cbb89-dd", "ovs_interfaceid": "091cbb89-dd8a-448e-963a-3dbcafde6bb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74960) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 12:30:40 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-6b489aaf-c9da-45a7-814e-3910acad87fa tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Converting VIF {"id": "091cbb89-dd8a-448e-963a-3dbcafde6bb1", "address": "fa:16:3e:cc:a5:1b", "network": {"id": "3eaeac55-9eb7-4301-b5a7-d13735656d8e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-826950903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9160afcfdb74ba2aad7bc79e628e96f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap091cbb89-dd", "ovs_interfaceid": "091cbb89-dd8a-448e-963a-3dbcafde6bb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:30:40 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-6b489aaf-c9da-45a7-814e-3910acad87fa tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:a5:1b,bridge_name='br-int',has_traffic_filtering=True,id=091cbb89-dd8a-448e-963a-3dbcafde6bb1,network=Network(3eaeac55-9eb7-4301-b5a7-d13735656d8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap091cbb89-dd') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:30:40 user nova-compute[74960]: DEBUG nova.objects.instance [None req-6b489aaf-c9da-45a7-814e-3910acad87fa tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Lazy-loading 'pci_devices' on Instance uuid 5b7b95c0-3726-4a1c-a384-ec91abf75225 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:30:40 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-6b489aaf-c9da-45a7-814e-3910acad87fa tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] End _get_guest_xml xml=<domain type="kvm">
Nov 03 12:30:40 user nova-compute[74960]:   <uuid>5b7b95c0-3726-4a1c-a384-ec91abf75225</uuid>
Nov 03 12:30:40 user nova-compute[74960]:   <name>instance-0000001c</name>
Nov 03 12:30:40 user nova-compute[74960]:   <memory>524288</memory>
Nov 03 12:30:40 user nova-compute[74960]:   <vcpu>1</vcpu>
Nov 03 12:30:40 user nova-compute[74960]:   <metadata>
Nov 03 12:30:40 user nova-compute[74960]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 12:30:40 user nova-compute[74960]:       <nova:package version="0.0.0"/>
Nov 03 12:30:40 user nova-compute[74960]:       <nova:name>tempest-AttachVolumeTestJSON-server-666638080</nova:name>
Nov 03 12:30:40 user nova-compute[74960]:       <nova:creationTime>2023-11-03 12:30:40</nova:creationTime>
Nov 03 12:30:40 user nova-compute[74960]:       <nova:flavor name="m1.tiny">
Nov 03 12:30:40 user nova-compute[74960]:         <nova:memory>512</nova:memory>
Nov 03 12:30:40 user nova-compute[74960]:         <nova:disk>1</nova:disk>
Nov 03 12:30:40 user nova-compute[74960]:         <nova:swap>0</nova:swap>
Nov 03 12:30:40 user nova-compute[74960]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 12:30:40 user nova-compute[74960]:         <nova:vcpus>1</nova:vcpus>
Nov 03 12:30:40 user nova-compute[74960]:       </nova:flavor>
Nov 03 12:30:40 user nova-compute[74960]:       <nova:owner>
Nov 03 12:30:40 user nova-compute[74960]:         <nova:user uuid="8c599d8677454b60b9434689322a6de2">tempest-AttachVolumeTestJSON-847320603-project-member</nova:user>
Nov 03 12:30:40 user nova-compute[74960]:         <nova:project uuid="a9160afcfdb74ba2aad7bc79e628e96f">tempest-AttachVolumeTestJSON-847320603</nova:project>
Nov 03 12:30:40 user nova-compute[74960]:       </nova:owner>
Nov 03 12:30:40 user nova-compute[74960]:       <nova:root type="image" uuid="549f51ba-ac69-494b-8de1-34635aa2d7cf"/>
Nov 03 12:30:40 user nova-compute[74960]:       <nova:ports>
Nov 03 12:30:40 user nova-compute[74960]:         <nova:port uuid="091cbb89-dd8a-448e-963a-3dbcafde6bb1">
Nov 03 12:30:40 user nova-compute[74960]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 03 12:30:40 user nova-compute[74960]:         </nova:port>
Nov 03 12:30:40 user nova-compute[74960]:       </nova:ports>
Nov 03 12:30:40 user nova-compute[74960]:     </nova:instance>
Nov 03 12:30:40 user nova-compute[74960]:   </metadata>
Nov 03 12:30:40 user nova-compute[74960]:   <sysinfo type="smbios">
Nov 03 12:30:40 user nova-compute[74960]:     <system>
Nov 03 12:30:40 user nova-compute[74960]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 12:30:40 user nova-compute[74960]:       <entry name="product">OpenStack Nova</entry>
Nov 03 12:30:40 user nova-compute[74960]:       <entry name="version">0.0.0</entry>
Nov 03 12:30:40 user nova-compute[74960]:       <entry name="serial">5b7b95c0-3726-4a1c-a384-ec91abf75225</entry>
Nov 03 12:30:40 user nova-compute[74960]:       <entry name="uuid">5b7b95c0-3726-4a1c-a384-ec91abf75225</entry>
Nov 03 12:30:40 user nova-compute[74960]:       <entry name="family">Virtual Machine</entry>
Nov 03 12:30:40 user nova-compute[74960]:     </system>
Nov 03 12:30:40 user nova-compute[74960]:   </sysinfo>
Nov 03 12:30:40 user nova-compute[74960]:   <os>
Nov 03 12:30:40 user nova-compute[74960]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 12:30:40 user nova-compute[74960]:     <boot dev="hd"/>
Nov 03 12:30:40 user nova-compute[74960]:     <smbios mode="sysinfo"/>
Nov 03 12:30:40 user nova-compute[74960]:   </os>
Nov 03 12:30:40 user nova-compute[74960]:   <features>
Nov 03 12:30:40 user nova-compute[74960]:     <acpi/>
Nov 03 12:30:40 user nova-compute[74960]:     <apic/>
Nov 03 12:30:40 user nova-compute[74960]:     <vmcoreinfo/>
Nov 03 12:30:40 user nova-compute[74960]:   </features>
Nov 03 12:30:40 user nova-compute[74960]:   <clock offset="utc">
Nov 03 12:30:40 user nova-compute[74960]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 12:30:40 user nova-compute[74960]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 12:30:40 user nova-compute[74960]:     <timer name="hpet" present="no"/>
Nov 03 12:30:40 user nova-compute[74960]:   </clock>
Nov 03 12:30:40 user nova-compute[74960]:   <cpu mode="custom" match="exact">
Nov 03 12:30:40 user nova-compute[74960]:     <model>Nehalem</model>
Nov 03 12:30:40 user nova-compute[74960]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 12:30:40 user nova-compute[74960]:   </cpu>
Nov 03 12:30:40 user nova-compute[74960]:   <devices>
Nov 03 12:30:40 user nova-compute[74960]:     <disk type="file" device="disk">
Nov 03 12:30:40 user nova-compute[74960]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 12:30:40 user nova-compute[74960]:       <source file="/opt/stack/data/nova/instances/5b7b95c0-3726-4a1c-a384-ec91abf75225/disk"/>
Nov 03 12:30:40 user nova-compute[74960]:       <target dev="vda" bus="virtio"/>
Nov 03 12:30:40 user nova-compute[74960]:     </disk>
Nov 03 12:30:40 user nova-compute[74960]:     <interface type="ethernet">
Nov 03 12:30:40 user nova-compute[74960]:       <mac address="fa:16:3e:cc:a5:1b"/>
Nov 03 12:30:40 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:30:40 user nova-compute[74960]:       <mtu size="1442"/>
Nov 03 12:30:40 user nova-compute[74960]:       <target dev="tap091cbb89-dd"/>
Nov 03 12:30:40 user nova-compute[74960]:     </interface>
Nov 03 12:30:40 user nova-compute[74960]:     <serial type="pty">
Nov 03 12:30:40 user nova-compute[74960]:       <log file="/opt/stack/data/nova/instances/5b7b95c0-3726-4a1c-a384-ec91abf75225/console.log" append="off"/>
Nov 03 12:30:40 user nova-compute[74960]:     </serial>
Nov 03 12:30:40 user nova-compute[74960]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 12:30:40 user nova-compute[74960]:     <video>
Nov 03 12:30:40 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:30:40 user nova-compute[74960]:     </video>
Nov 03 12:30:40 user nova-compute[74960]:     <rng model="virtio">
Nov 03 12:30:40 user nova-compute[74960]:       <backend model="random">/dev/urandom</backend>
Nov 03 12:30:40 user nova-compute[74960]:     </rng>
Nov 03 12:30:40 user nova-compute[74960]:     <controller type="usb" index="0" model="none"/>
Nov 03 12:30:40 user nova-compute[74960]:     <memballoon model="virtio">
Nov 03 12:30:40 user nova-compute[74960]:       <stats period="10"/>
Nov 03 12:30:40 user nova-compute[74960]:     </memballoon>
Nov 03 12:30:40 user nova-compute[74960]:   </devices>
Nov 03 12:30:40 user nova-compute[74960]: </domain>
Nov 03 12:30:40 user nova-compute[74960]:  {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 12:30:40 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-6b489aaf-c9da-45a7-814e-3910acad87fa tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:30:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-666638080',display_name='tempest-AttachVolumeTestJSON-server-666638080',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-666638080',id=28,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIQ2G2kW7RG3ei1U+rVcmbI+Ton8kNiQZeMxqXkABUJCy9iuRMgTZBhGnWGCs6R7DHln/91d5py8pZC0KUaGy+7UnlGfb1FgAKzTpiPtdr0uDnrIs+6hQLHu9y+wv2TiKg==',key_name='tempest-keypair-691388173',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a9160afcfdb74ba2aad7bc79e628e96f',ramdisk_id='',reservation_id='r-na1kxuhs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-847320603',owner_user_name='tempest-AttachVolumeTestJSON-847320603-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:30:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c599d8677454b60b9434689322a6de2',uuid=5b7b95c0-3726-4a1c-a384-ec91abf75225,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "091cbb89-dd8a-448e-963a-3dbcafde6bb1", "address": "fa:16:3e:cc:a5:1b", "network": {"id": "3eaeac55-9eb7-4301-b5a7-d13735656d8e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-826950903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9160afcfdb74ba2aad7bc79e628e96f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap091cbb89-dd", "ovs_interfaceid": "091cbb89-dd8a-448e-963a-3dbcafde6bb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 12:30:40 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-6b489aaf-c9da-45a7-814e-3910acad87fa tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Converting VIF {"id": "091cbb89-dd8a-448e-963a-3dbcafde6bb1", "address": "fa:16:3e:cc:a5:1b", "network": {"id": "3eaeac55-9eb7-4301-b5a7-d13735656d8e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-826950903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9160afcfdb74ba2aad7bc79e628e96f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap091cbb89-dd", "ovs_interfaceid": "091cbb89-dd8a-448e-963a-3dbcafde6bb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:30:40 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-6b489aaf-c9da-45a7-814e-3910acad87fa tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:a5:1b,bridge_name='br-int',has_traffic_filtering=True,id=091cbb89-dd8a-448e-963a-3dbcafde6bb1,network=Network(3eaeac55-9eb7-4301-b5a7-d13735656d8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap091cbb89-dd') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:30:40 user nova-compute[74960]: DEBUG os_vif [None req-6b489aaf-c9da-45a7-814e-3910acad87fa tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:a5:1b,bridge_name='br-int',has_traffic_filtering=True,id=091cbb89-dd8a-448e-963a-3dbcafde6bb1,network=Network(3eaeac55-9eb7-4301-b5a7-d13735656d8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap091cbb89-dd') {{(pid=74960) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 12:30:40 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:30:40 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:30:40 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 12:30:40 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:30:40 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd1f60e77-fecd-575c-9f11-876b6007512b', '_type': 'linux-noop'}}, row=False) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:30:40 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:30:40 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:30:40 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:30:40 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap091cbb89-dd, may_exist=True, interface_attrs={}) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:30:40 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap091cbb89-dd, col_values=(('qos', UUID('154ae01c-2119-4e07-b294-e119910c7349')),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:30:40 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap091cbb89-dd, col_values=(('external_ids', {'iface-id': '091cbb89-dd8a-448e-963a-3dbcafde6bb1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cc:a5:1b', 'vm-uuid': '5b7b95c0-3726-4a1c-a384-ec91abf75225'}),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:30:40 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:30:40 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:30:40 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:30:40 user nova-compute[74960]: INFO os_vif [None req-6b489aaf-c9da-45a7-814e-3910acad87fa tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:a5:1b,bridge_name='br-int',has_traffic_filtering=True,id=091cbb89-dd8a-448e-963a-3dbcafde6bb1,network=Network(3eaeac55-9eb7-4301-b5a7-d13735656d8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap091cbb89-dd')
Nov 03 12:30:40 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-6b489aaf-c9da-45a7-814e-3910acad87fa tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] No BDM found with device name vda, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:30:40 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-6b489aaf-c9da-45a7-814e-3910acad87fa tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] No VIF found with MAC fa:16:3e:cc:a5:1b, not building metadata {{(pid=74960) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 12:30:40 user nova-compute[74960]: DEBUG nova.network.neutron [req-1dd83e36-34f8-4dbc-95a0-c0174448bb90 req-f6f8afe6-5ea2-4c5a-87cd-8f7596e64ad8 service nova] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] Updated VIF entry in instance network info cache for port 091cbb89-dd8a-448e-963a-3dbcafde6bb1. {{(pid=74960) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 12:30:40 user nova-compute[74960]: DEBUG nova.network.neutron [req-1dd83e36-34f8-4dbc-95a0-c0174448bb90 req-f6f8afe6-5ea2-4c5a-87cd-8f7596e64ad8 service nova] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] Updating instance_info_cache with network_info: [{"id": "091cbb89-dd8a-448e-963a-3dbcafde6bb1", "address": "fa:16:3e:cc:a5:1b", "network": {"id": "3eaeac55-9eb7-4301-b5a7-d13735656d8e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-826950903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9160afcfdb74ba2aad7bc79e628e96f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap091cbb89-dd", "ovs_interfaceid": "091cbb89-dd8a-448e-963a-3dbcafde6bb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:30:40 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-1dd83e36-34f8-4dbc-95a0-c0174448bb90 req-f6f8afe6-5ea2-4c5a-87cd-8f7596e64ad8 service nova] Releasing lock "refresh_cache-5b7b95c0-3726-4a1c-a384-ec91abf75225" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:30:41 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:30:41 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:30:41 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:30:42 user nova-compute[74960]: DEBUG nova.compute.manager [req-62d6c36d-401a-4dd4-8033-0b959f00c8d4 req-f3d9bdbd-ba51-424b-959d-ef3659c79834 service nova] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] Received event network-vif-plugged-091cbb89-dd8a-448e-963a-3dbcafde6bb1 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:30:42 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-62d6c36d-401a-4dd4-8033-0b959f00c8d4 req-f3d9bdbd-ba51-424b-959d-ef3659c79834 service nova] Acquiring lock "5b7b95c0-3726-4a1c-a384-ec91abf75225-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:30:42 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-62d6c36d-401a-4dd4-8033-0b959f00c8d4 req-f3d9bdbd-ba51-424b-959d-ef3659c79834 service nova] Lock "5b7b95c0-3726-4a1c-a384-ec91abf75225-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:30:42 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-62d6c36d-401a-4dd4-8033-0b959f00c8d4 req-f3d9bdbd-ba51-424b-959d-ef3659c79834 service nova] Lock "5b7b95c0-3726-4a1c-a384-ec91abf75225-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:30:42 user nova-compute[74960]: DEBUG nova.compute.manager [req-62d6c36d-401a-4dd4-8033-0b959f00c8d4 req-f3d9bdbd-ba51-424b-959d-ef3659c79834 service nova] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] No waiting events found dispatching network-vif-plugged-091cbb89-dd8a-448e-963a-3dbcafde6bb1 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:30:42 user nova-compute[74960]: WARNING nova.compute.manager [req-62d6c36d-401a-4dd4-8033-0b959f00c8d4 req-f3d9bdbd-ba51-424b-959d-ef3659c79834 service nova] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] Received unexpected event network-vif-plugged-091cbb89-dd8a-448e-963a-3dbcafde6bb1 for instance with vm_state building and task_state spawning.
Nov 03 12:30:42 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:30:42 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:30:42 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:30:42 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:30:43 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:30:43 user nova-compute[74960]: DEBUG nova.compute.manager [None req-6b489aaf-c9da-45a7-814e-3910acad87fa tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] Instance event wait completed in 0 seconds for  {{(pid=74960) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 12:30:43 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-6b489aaf-c9da-45a7-814e-3910acad87fa tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] Guest created on hypervisor {{(pid=74960) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 12:30:43 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] Instance spawned successfully.
Nov 03 12:30:43 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-6b489aaf-c9da-45a7-814e-3910acad87fa tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 12:30:43 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-6b489aaf-c9da-45a7-814e-3910acad87fa tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] Found default for hw_cdrom_bus of ide {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:30:43 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-6b489aaf-c9da-45a7-814e-3910acad87fa tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] Found default for hw_disk_bus of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:30:43 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-6b489aaf-c9da-45a7-814e-3910acad87fa tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] Found default for hw_input_bus of None {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:30:43 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-6b489aaf-c9da-45a7-814e-3910acad87fa tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] Found default for hw_pointer_model of None {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:30:43 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-6b489aaf-c9da-45a7-814e-3910acad87fa tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] Found default for hw_video_model of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:30:43 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-6b489aaf-c9da-45a7-814e-3910acad87fa tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] Found default for hw_vif_model of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:30:44 user nova-compute[74960]: INFO nova.compute.manager [None req-6b489aaf-c9da-45a7-814e-3910acad87fa tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] Took 6.12 seconds to spawn the instance on the hypervisor.
Nov 03 12:30:44 user nova-compute[74960]: DEBUG nova.compute.manager [None req-6b489aaf-c9da-45a7-814e-3910acad87fa tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] Checking state {{(pid=74960) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 12:30:44 user nova-compute[74960]: DEBUG nova.compute.manager [req-76002eba-2e0e-4bb0-9f66-132bec00e174 req-be7c2342-be45-4d0e-a3ed-91966288a651 service nova] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] Received event network-vif-plugged-091cbb89-dd8a-448e-963a-3dbcafde6bb1 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:30:44 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-76002eba-2e0e-4bb0-9f66-132bec00e174 req-be7c2342-be45-4d0e-a3ed-91966288a651 service nova] Acquiring lock "5b7b95c0-3726-4a1c-a384-ec91abf75225-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:30:44 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-76002eba-2e0e-4bb0-9f66-132bec00e174 req-be7c2342-be45-4d0e-a3ed-91966288a651 service nova] Lock "5b7b95c0-3726-4a1c-a384-ec91abf75225-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:30:44 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-76002eba-2e0e-4bb0-9f66-132bec00e174 req-be7c2342-be45-4d0e-a3ed-91966288a651 service nova] Lock "5b7b95c0-3726-4a1c-a384-ec91abf75225-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:30:44 user nova-compute[74960]: DEBUG nova.compute.manager [req-76002eba-2e0e-4bb0-9f66-132bec00e174 req-be7c2342-be45-4d0e-a3ed-91966288a651 service nova] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] No waiting events found dispatching network-vif-plugged-091cbb89-dd8a-448e-963a-3dbcafde6bb1 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:30:44 user nova-compute[74960]: WARNING nova.compute.manager [req-76002eba-2e0e-4bb0-9f66-132bec00e174 req-be7c2342-be45-4d0e-a3ed-91966288a651 service nova] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] Received unexpected event network-vif-plugged-091cbb89-dd8a-448e-963a-3dbcafde6bb1 for instance with vm_state building and task_state spawning.
Nov 03 12:30:44 user nova-compute[74960]: INFO nova.compute.manager [None req-6b489aaf-c9da-45a7-814e-3910acad87fa tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] Took 6.99 seconds to build instance.
Nov 03 12:30:44 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-6b489aaf-c9da-45a7-814e-3910acad87fa tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Lock "5b7b95c0-3726-4a1c-a384-ec91abf75225" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.106s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:30:44 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c46805c4-90f4-497c-94cb-b8756153f42f tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Acquiring lock "fffd1dd7-b8e8-435c-bdfe-6c5001b21daf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:30:44 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c46805c4-90f4-497c-94cb-b8756153f42f tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Lock "fffd1dd7-b8e8-435c-bdfe-6c5001b21daf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:30:44 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c46805c4-90f4-497c-94cb-b8756153f42f tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Acquiring lock "fffd1dd7-b8e8-435c-bdfe-6c5001b21daf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:30:44 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c46805c4-90f4-497c-94cb-b8756153f42f tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Lock "fffd1dd7-b8e8-435c-bdfe-6c5001b21daf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:30:44 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c46805c4-90f4-497c-94cb-b8756153f42f tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Lock "fffd1dd7-b8e8-435c-bdfe-6c5001b21daf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:30:44 user nova-compute[74960]: INFO nova.compute.manager [None req-c46805c4-90f4-497c-94cb-b8756153f42f tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] [instance: fffd1dd7-b8e8-435c-bdfe-6c5001b21daf] Terminating instance
Nov 03 12:30:44 user nova-compute[74960]: DEBUG nova.compute.manager [None req-c46805c4-90f4-497c-94cb-b8756153f42f tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] [instance: fffd1dd7-b8e8-435c-bdfe-6c5001b21daf] Start destroying the instance on the hypervisor. {{(pid=74960) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 12:30:44 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:30:44 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:30:44 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:30:44 user nova-compute[74960]: DEBUG nova.compute.manager [req-7013285a-f466-4889-b671-045e90ceeaba req-6c1d593f-e137-4b81-96f8-1ae214ccc15d service nova] [instance: be38c803-d97c-4939-9852-e8db1c44bb65] Received event network-changed-b70bcefe-a1cc-4f5c-98f6-3d6914d66a9b {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:30:44 user nova-compute[74960]: DEBUG nova.compute.manager [req-7013285a-f466-4889-b671-045e90ceeaba req-6c1d593f-e137-4b81-96f8-1ae214ccc15d service nova] [instance: be38c803-d97c-4939-9852-e8db1c44bb65] Refreshing instance network info cache due to event network-changed-b70bcefe-a1cc-4f5c-98f6-3d6914d66a9b. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 12:30:44 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-7013285a-f466-4889-b671-045e90ceeaba req-6c1d593f-e137-4b81-96f8-1ae214ccc15d service nova] Acquiring lock "refresh_cache-be38c803-d97c-4939-9852-e8db1c44bb65" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:30:44 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-7013285a-f466-4889-b671-045e90ceeaba req-6c1d593f-e137-4b81-96f8-1ae214ccc15d service nova] Acquired lock "refresh_cache-be38c803-d97c-4939-9852-e8db1c44bb65" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:30:44 user nova-compute[74960]: DEBUG nova.network.neutron [req-7013285a-f466-4889-b671-045e90ceeaba req-6c1d593f-e137-4b81-96f8-1ae214ccc15d service nova] [instance: be38c803-d97c-4939-9852-e8db1c44bb65] Refreshing network info cache for port b70bcefe-a1cc-4f5c-98f6-3d6914d66a9b {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 12:30:44 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:30:44 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:30:45 user nova-compute[74960]: DEBUG nova.compute.manager [req-c79fb453-c83d-4ee6-8479-894660dcc131 req-7b866cff-f8e8-4436-b171-6f882c19234a service nova] [instance: fffd1dd7-b8e8-435c-bdfe-6c5001b21daf] Received event network-vif-unplugged-51edd11b-19e3-40e1-a3a8-56485553eebb {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:30:45 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-c79fb453-c83d-4ee6-8479-894660dcc131 req-7b866cff-f8e8-4436-b171-6f882c19234a service nova] Acquiring lock "fffd1dd7-b8e8-435c-bdfe-6c5001b21daf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:30:45 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-c79fb453-c83d-4ee6-8479-894660dcc131 req-7b866cff-f8e8-4436-b171-6f882c19234a service nova] Lock "fffd1dd7-b8e8-435c-bdfe-6c5001b21daf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:30:45 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-c79fb453-c83d-4ee6-8479-894660dcc131 req-7b866cff-f8e8-4436-b171-6f882c19234a service nova] Lock "fffd1dd7-b8e8-435c-bdfe-6c5001b21daf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:30:45 user nova-compute[74960]: DEBUG nova.compute.manager [req-c79fb453-c83d-4ee6-8479-894660dcc131 req-7b866cff-f8e8-4436-b171-6f882c19234a service nova] [instance: fffd1dd7-b8e8-435c-bdfe-6c5001b21daf] No waiting events found dispatching network-vif-unplugged-51edd11b-19e3-40e1-a3a8-56485553eebb {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:30:45 user nova-compute[74960]: DEBUG nova.compute.manager [req-c79fb453-c83d-4ee6-8479-894660dcc131 req-7b866cff-f8e8-4436-b171-6f882c19234a service nova] [instance: fffd1dd7-b8e8-435c-bdfe-6c5001b21daf] Received event network-vif-unplugged-51edd11b-19e3-40e1-a3a8-56485553eebb for instance with task_state deleting. {{(pid=74960) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 12:30:45 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:30:45 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:30:45 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:30:45 user nova-compute[74960]: DEBUG nova.network.neutron [req-7013285a-f466-4889-b671-045e90ceeaba req-6c1d593f-e137-4b81-96f8-1ae214ccc15d service nova] [instance: be38c803-d97c-4939-9852-e8db1c44bb65] Updated VIF entry in instance network info cache for port b70bcefe-a1cc-4f5c-98f6-3d6914d66a9b. {{(pid=74960) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 12:30:45 user nova-compute[74960]: DEBUG nova.network.neutron [req-7013285a-f466-4889-b671-045e90ceeaba req-6c1d593f-e137-4b81-96f8-1ae214ccc15d service nova] [instance: be38c803-d97c-4939-9852-e8db1c44bb65] Updating instance_info_cache with network_info: [{"id": "b70bcefe-a1cc-4f5c-98f6-3d6914d66a9b", "address": "fa:16:3e:3f:59:21", "network": {"id": "b3813163-d09b-4c0b-a328-1bbb4c7e2875", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1681555035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d4a374c1c544718887bd75b77a72a3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb70bcefe-a1", "ovs_interfaceid": "b70bcefe-a1cc-4f5c-98f6-3d6914d66a9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:30:45 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-7013285a-f466-4889-b671-045e90ceeaba req-6c1d593f-e137-4b81-96f8-1ae214ccc15d service nova] Releasing lock "refresh_cache-be38c803-d97c-4939-9852-e8db1c44bb65" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:30:45 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: fffd1dd7-b8e8-435c-bdfe-6c5001b21daf] Instance destroyed successfully.
Nov 03 12:30:45 user nova-compute[74960]: DEBUG nova.objects.instance [None req-c46805c4-90f4-497c-94cb-b8756153f42f tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Lazy-loading 'resources' on Instance uuid fffd1dd7-b8e8-435c-bdfe-6c5001b21daf {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:30:45 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-c46805c4-90f4-497c-94cb-b8756153f42f tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:20:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-930355115',display_name='tempest-ServersNegativeTestJSON-server-930355115',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-930355115',id=14,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-03T12:21:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e379e295cf984ca6bf5d84a60e56382d',ramdisk_id='',reservation_id='r-w0xth1rj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-802200730',owner_user_name='tempest-ServersNegativeTestJSON-802200730-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T12:21:04Z,user_data=None,user_id='7a13ec06392c4ce5a81491a35a8d50d8',uuid=fffd1dd7-b8e8-435c-bdfe-6c5001b21daf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "51edd11b-19e3-40e1-a3a8-56485553eebb", "address": "fa:16:3e:f5:df:89", "network": {"id": "3a8a59cd-8076-41af-b566-9fc45a07a1df", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1235385625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e379e295cf984ca6bf5d84a60e56382d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51edd11b-19", "ovs_interfaceid": "51edd11b-19e3-40e1-a3a8-56485553eebb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 12:30:45 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-c46805c4-90f4-497c-94cb-b8756153f42f tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Converting VIF {"id": "51edd11b-19e3-40e1-a3a8-56485553eebb", "address": "fa:16:3e:f5:df:89", "network": {"id": "3a8a59cd-8076-41af-b566-9fc45a07a1df", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1235385625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e379e295cf984ca6bf5d84a60e56382d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51edd11b-19", "ovs_interfaceid": "51edd11b-19e3-40e1-a3a8-56485553eebb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:30:45 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-c46805c4-90f4-497c-94cb-b8756153f42f tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f5:df:89,bridge_name='br-int',has_traffic_filtering=True,id=51edd11b-19e3-40e1-a3a8-56485553eebb,network=Network(3a8a59cd-8076-41af-b566-9fc45a07a1df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51edd11b-19') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:30:45 user nova-compute[74960]: DEBUG os_vif [None req-c46805c4-90f4-497c-94cb-b8756153f42f tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:df:89,bridge_name='br-int',has_traffic_filtering=True,id=51edd11b-19e3-40e1-a3a8-56485553eebb,network=Network(3a8a59cd-8076-41af-b566-9fc45a07a1df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51edd11b-19') {{(pid=74960) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 12:30:45 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:30:45 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap51edd11b-19, bridge=br-int, if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:30:45 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:30:45 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:30:45 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:30:45 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=eda5f976-1fc4-48bb-9894-fefe52ab9baa) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:30:45 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:30:45 user nova-compute[74960]: INFO os_vif [None req-c46805c4-90f4-497c-94cb-b8756153f42f tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:df:89,bridge_name='br-int',has_traffic_filtering=True,id=51edd11b-19e3-40e1-a3a8-56485553eebb,network=Network(3a8a59cd-8076-41af-b566-9fc45a07a1df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51edd11b-19')
Nov 03 12:30:45 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-c46805c4-90f4-497c-94cb-b8756153f42f tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] [instance: fffd1dd7-b8e8-435c-bdfe-6c5001b21daf] Deleting instance files /opt/stack/data/nova/instances/fffd1dd7-b8e8-435c-bdfe-6c5001b21daf_del
Nov 03 12:30:45 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-c46805c4-90f4-497c-94cb-b8756153f42f tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] [instance: fffd1dd7-b8e8-435c-bdfe-6c5001b21daf] Deletion of /opt/stack/data/nova/instances/fffd1dd7-b8e8-435c-bdfe-6c5001b21daf_del complete
Nov 03 12:30:45 user nova-compute[74960]: INFO nova.compute.manager [None req-c46805c4-90f4-497c-94cb-b8756153f42f tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] [instance: fffd1dd7-b8e8-435c-bdfe-6c5001b21daf] Took 0.98 seconds to destroy the instance on the hypervisor.
Nov 03 12:30:45 user nova-compute[74960]: DEBUG oslo.service.loopingcall [None req-c46805c4-90f4-497c-94cb-b8756153f42f tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74960) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 12:30:45 user nova-compute[74960]: DEBUG nova.compute.manager [-] [instance: fffd1dd7-b8e8-435c-bdfe-6c5001b21daf] Deallocating network for instance {{(pid=74960) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 12:30:45 user nova-compute[74960]: DEBUG nova.network.neutron [-] [instance: fffd1dd7-b8e8-435c-bdfe-6c5001b21daf] deallocate_for_instance() {{(pid=74960) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 12:30:46 user nova-compute[74960]: DEBUG nova.network.neutron [-] [instance: fffd1dd7-b8e8-435c-bdfe-6c5001b21daf] Updating instance_info_cache with network_info: [] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:30:46 user nova-compute[74960]: INFO nova.compute.manager [-] [instance: fffd1dd7-b8e8-435c-bdfe-6c5001b21daf] Took 0.53 seconds to deallocate network for instance.
Nov 03 12:30:46 user nova-compute[74960]: DEBUG nova.compute.manager [req-8de1dc4e-a6b3-4b8a-bf6e-81abb18fbb22 req-306264c4-b752-40dc-9b0f-9567eecbf77a service nova] [instance: fffd1dd7-b8e8-435c-bdfe-6c5001b21daf] Received event network-vif-deleted-51edd11b-19e3-40e1-a3a8-56485553eebb {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:30:46 user nova-compute[74960]: INFO nova.compute.manager [req-8de1dc4e-a6b3-4b8a-bf6e-81abb18fbb22 req-306264c4-b752-40dc-9b0f-9567eecbf77a service nova] [instance: fffd1dd7-b8e8-435c-bdfe-6c5001b21daf] Neutron deleted interface 51edd11b-19e3-40e1-a3a8-56485553eebb; detaching it from the instance and deleting it from the info cache
Nov 03 12:30:46 user nova-compute[74960]: DEBUG nova.network.neutron [req-8de1dc4e-a6b3-4b8a-bf6e-81abb18fbb22 req-306264c4-b752-40dc-9b0f-9567eecbf77a service nova] [instance: fffd1dd7-b8e8-435c-bdfe-6c5001b21daf] Updating instance_info_cache with network_info: [] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:30:46 user nova-compute[74960]: DEBUG nova.compute.manager [req-8de1dc4e-a6b3-4b8a-bf6e-81abb18fbb22 req-306264c4-b752-40dc-9b0f-9567eecbf77a service nova] [instance: fffd1dd7-b8e8-435c-bdfe-6c5001b21daf] Detach interface failed, port_id=51edd11b-19e3-40e1-a3a8-56485553eebb, reason: Instance fffd1dd7-b8e8-435c-bdfe-6c5001b21daf could not be found. {{(pid=74960) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 03 12:30:46 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c46805c4-90f4-497c-94cb-b8756153f42f tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:30:46 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c46805c4-90f4-497c-94cb-b8756153f42f tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:30:46 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-4b161e12-3dd5-41e1-baee-e35f35d9c01e tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Acquiring lock "be38c803-d97c-4939-9852-e8db1c44bb65" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:30:46 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-4b161e12-3dd5-41e1-baee-e35f35d9c01e tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Lock "be38c803-d97c-4939-9852-e8db1c44bb65" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:30:46 user nova-compute[74960]: INFO nova.compute.manager [None req-4b161e12-3dd5-41e1-baee-e35f35d9c01e tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] [instance: be38c803-d97c-4939-9852-e8db1c44bb65] Detaching volume f33bebd3-3cc8-4db5-b35e-5d58d4dfe93f
Nov 03 12:30:46 user nova-compute[74960]: INFO nova.virt.block_device [None req-4b161e12-3dd5-41e1-baee-e35f35d9c01e tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] [instance: be38c803-d97c-4939-9852-e8db1c44bb65] Attempting to driver detach volume f33bebd3-3cc8-4db5-b35e-5d58d4dfe93f from mountpoint /dev/vdb
Nov 03 12:30:46 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-4b161e12-3dd5-41e1-baee-e35f35d9c01e tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Attempting to detach device vdb from instance be38c803-d97c-4939-9852-e8db1c44bb65 from the persistent domain config. {{(pid=74960) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 03 12:30:46 user nova-compute[74960]: DEBUG nova.virt.libvirt.guest [None req-4b161e12-3dd5-41e1-baee-e35f35d9c01e tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 12:30:46 user nova-compute[74960]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 12:30:46 user nova-compute[74960]:   <source dev="/dev/sde"/>
Nov 03 12:30:46 user nova-compute[74960]:   <target dev="vdb" bus="virtio"/>
Nov 03 12:30:46 user nova-compute[74960]:   <serial>f33bebd3-3cc8-4db5-b35e-5d58d4dfe93f</serial>
Nov 03 12:30:46 user nova-compute[74960]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 12:30:46 user nova-compute[74960]: </disk>
Nov 03 12:30:46 user nova-compute[74960]:  {{(pid=74960) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 12:30:46 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-4b161e12-3dd5-41e1-baee-e35f35d9c01e tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Successfully detached device vdb from instance be38c803-d97c-4939-9852-e8db1c44bb65 from the persistent domain config.
Nov 03 12:30:46 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-4b161e12-3dd5-41e1-baee-e35f35d9c01e tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance be38c803-d97c-4939-9852-e8db1c44bb65 from the live domain config. {{(pid=74960) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 03 12:30:46 user nova-compute[74960]: DEBUG nova.virt.libvirt.guest [None req-4b161e12-3dd5-41e1-baee-e35f35d9c01e tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 12:30:46 user nova-compute[74960]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 12:30:46 user nova-compute[74960]:   <source dev="/dev/sde"/>
Nov 03 12:30:46 user nova-compute[74960]:   <target dev="vdb" bus="virtio"/>
Nov 03 12:30:46 user nova-compute[74960]:   <serial>f33bebd3-3cc8-4db5-b35e-5d58d4dfe93f</serial>
Nov 03 12:30:46 user nova-compute[74960]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 12:30:46 user nova-compute[74960]: </disk>
Nov 03 12:30:46 user nova-compute[74960]:  {{(pid=74960) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 12:30:47 user nova-compute[74960]: DEBUG nova.compute.manager [req-1c948a5e-1610-40a6-a59a-f790853629fe req-2f69a3c8-3139-456c-bd01-758ec0565268 service nova] [instance: be38c803-d97c-4939-9852-e8db1c44bb65] Received event network-changed-b70bcefe-a1cc-4f5c-98f6-3d6914d66a9b {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:30:47 user nova-compute[74960]: DEBUG nova.compute.manager [req-1c948a5e-1610-40a6-a59a-f790853629fe req-2f69a3c8-3139-456c-bd01-758ec0565268 service nova] [instance: be38c803-d97c-4939-9852-e8db1c44bb65] Refreshing instance network info cache due to event network-changed-b70bcefe-a1cc-4f5c-98f6-3d6914d66a9b. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 12:30:47 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-1c948a5e-1610-40a6-a59a-f790853629fe req-2f69a3c8-3139-456c-bd01-758ec0565268 service nova] Acquiring lock "refresh_cache-be38c803-d97c-4939-9852-e8db1c44bb65" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:30:47 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-1c948a5e-1610-40a6-a59a-f790853629fe req-2f69a3c8-3139-456c-bd01-758ec0565268 service nova] Acquired lock "refresh_cache-be38c803-d97c-4939-9852-e8db1c44bb65" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:30:47 user nova-compute[74960]: DEBUG nova.network.neutron [req-1c948a5e-1610-40a6-a59a-f790853629fe req-2f69a3c8-3139-456c-bd01-758ec0565268 service nova] [instance: be38c803-d97c-4939-9852-e8db1c44bb65] Refreshing network info cache for port b70bcefe-a1cc-4f5c-98f6-3d6914d66a9b {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 12:30:47 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-c46805c4-90f4-497c-94cb-b8756153f42f tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:30:47 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-c46805c4-90f4-497c-94cb-b8756153f42f tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:30:47 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c46805c4-90f4-497c-94cb-b8756153f42f tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.747s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:30:47 user nova-compute[74960]: INFO nova.scheduler.client.report [None req-c46805c4-90f4-497c-94cb-b8756153f42f tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Deleted allocations for instance fffd1dd7-b8e8-435c-bdfe-6c5001b21daf
Nov 03 12:30:47 user nova-compute[74960]: DEBUG nova.compute.manager [req-649594c9-ab0d-4d7e-ae3c-a0c340119fba req-aaa15b45-e787-4069-bb72-5cfdbf8be9b5 service nova] [instance: fffd1dd7-b8e8-435c-bdfe-6c5001b21daf] Received event network-vif-plugged-51edd11b-19e3-40e1-a3a8-56485553eebb {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:30:47 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-649594c9-ab0d-4d7e-ae3c-a0c340119fba req-aaa15b45-e787-4069-bb72-5cfdbf8be9b5 service nova] Acquiring lock "fffd1dd7-b8e8-435c-bdfe-6c5001b21daf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:30:47 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-649594c9-ab0d-4d7e-ae3c-a0c340119fba req-aaa15b45-e787-4069-bb72-5cfdbf8be9b5 service nova] Lock "fffd1dd7-b8e8-435c-bdfe-6c5001b21daf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:30:47 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-649594c9-ab0d-4d7e-ae3c-a0c340119fba req-aaa15b45-e787-4069-bb72-5cfdbf8be9b5 service nova] Lock "fffd1dd7-b8e8-435c-bdfe-6c5001b21daf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:30:47 user nova-compute[74960]: DEBUG nova.compute.manager [req-649594c9-ab0d-4d7e-ae3c-a0c340119fba req-aaa15b45-e787-4069-bb72-5cfdbf8be9b5 service nova] [instance: fffd1dd7-b8e8-435c-bdfe-6c5001b21daf] No waiting events found dispatching network-vif-plugged-51edd11b-19e3-40e1-a3a8-56485553eebb {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:30:47 user nova-compute[74960]: WARNING nova.compute.manager [req-649594c9-ab0d-4d7e-ae3c-a0c340119fba req-aaa15b45-e787-4069-bb72-5cfdbf8be9b5 service nova] [instance: fffd1dd7-b8e8-435c-bdfe-6c5001b21daf] Received unexpected event network-vif-plugged-51edd11b-19e3-40e1-a3a8-56485553eebb for instance with vm_state deleted and task_state None.
Nov 03 12:30:47 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c46805c4-90f4-497c-94cb-b8756153f42f tempest-ServersNegativeTestJSON-802200730 tempest-ServersNegativeTestJSON-802200730-project-member] Lock "fffd1dd7-b8e8-435c-bdfe-6c5001b21daf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.546s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:30:47 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-4b161e12-3dd5-41e1-baee-e35f35d9c01e tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance be38c803-d97c-4939-9852-e8db1c44bb65 {{(pid=74960) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 03 12:30:47 user nova-compute[74960]: DEBUG nova.network.neutron [req-1c948a5e-1610-40a6-a59a-f790853629fe req-2f69a3c8-3139-456c-bd01-758ec0565268 service nova] [instance: be38c803-d97c-4939-9852-e8db1c44bb65] Updated VIF entry in instance network info cache for port b70bcefe-a1cc-4f5c-98f6-3d6914d66a9b. {{(pid=74960) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 12:30:47 user nova-compute[74960]: DEBUG nova.network.neutron [req-1c948a5e-1610-40a6-a59a-f790853629fe req-2f69a3c8-3139-456c-bd01-758ec0565268 service nova] [instance: be38c803-d97c-4939-9852-e8db1c44bb65] Updating instance_info_cache with network_info: [{"id": "b70bcefe-a1cc-4f5c-98f6-3d6914d66a9b", "address": "fa:16:3e:3f:59:21", "network": {"id": "b3813163-d09b-4c0b-a328-1bbb4c7e2875", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1681555035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d4a374c1c544718887bd75b77a72a3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb70bcefe-a1", "ovs_interfaceid": "b70bcefe-a1cc-4f5c-98f6-3d6914d66a9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:30:47 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-1c948a5e-1610-40a6-a59a-f790853629fe req-2f69a3c8-3139-456c-bd01-758ec0565268 service nova] Releasing lock "refresh_cache-be38c803-d97c-4939-9852-e8db1c44bb65" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:30:48 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:30:50 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:30:50 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:30:50 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:30:50 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Starting heal instance info cache {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 12:30:50 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "refresh_cache-9951fab7-4984-408e-94ca-11eab615ff25" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:30:50 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquired lock "refresh_cache-9951fab7-4984-408e-94ca-11eab615ff25" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:30:50 user nova-compute[74960]: DEBUG nova.network.neutron [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: 9951fab7-4984-408e-94ca-11eab615ff25] Forcefully refreshing network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 12:30:51 user nova-compute[74960]: DEBUG nova.network.neutron [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: 9951fab7-4984-408e-94ca-11eab615ff25] Updating instance_info_cache with network_info: [{"id": "5782b039-1492-4364-b1b2-6b27ee06c5ce", "address": "fa:16:3e:55:0b:75", "network": {"id": "d6261390-d9b7-447c-be8e-ff6dd1a367ef", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1772643385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d6fbb72509e44ef8003aa2c58a7cf88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5782b039-14", "ovs_interfaceid": "5782b039-1492-4364-b1b2-6b27ee06c5ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:30:51 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Releasing lock "refresh_cache-9951fab7-4984-408e-94ca-11eab615ff25" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:30:51 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: 9951fab7-4984-408e-94ca-11eab615ff25] Updated the network info_cache for instance {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 12:30:51 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:30:51 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:30:51 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:30:51 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:30:51 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:30:51 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:30:51 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:30:51 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Auditing locally available compute resources for user (node: user) {{(pid=74960) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 12:30:51 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-62cc715e-be75-4682-8376-db88971339c1 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Acquiring lock "5dc6cb24-fe58-4e36-bd7f-a67a804a98e1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:30:51 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-62cc715e-be75-4682-8376-db88971339c1 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Lock "5dc6cb24-fe58-4e36-bd7f-a67a804a98e1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:30:51 user nova-compute[74960]: DEBUG nova.compute.manager [None req-62cc715e-be75-4682-8376-db88971339c1 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] Starting instance... {{(pid=74960) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 12:30:51 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-62cc715e-be75-4682-8376-db88971339c1 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:30:51 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-62cc715e-be75-4682-8376-db88971339c1 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:30:51 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-62cc715e-be75-4682-8376-db88971339c1 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74960) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 12:30:51 user nova-compute[74960]: INFO nova.compute.claims [None req-62cc715e-be75-4682-8376-db88971339c1 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] Claim successful on node user
Nov 03 12:30:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9951fab7-4984-408e-94ca-11eab615ff25/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:30:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9951fab7-4984-408e-94ca-11eab615ff25/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:30:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9951fab7-4984-408e-94ca-11eab615ff25/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:30:52 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9951fab7-4984-408e-94ca-11eab615ff25/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:30:52 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74960) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 12:30:52 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7769e3c5-136f-4282-8e3e-224e3a80922c/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:30:52 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-62cc715e-be75-4682-8376-db88971339c1 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:30:52 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-62cc715e-be75-4682-8376-db88971339c1 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:30:52 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-62cc715e-be75-4682-8376-db88971339c1 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.612s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:30:52 user nova-compute[74960]: DEBUG nova.compute.manager [None req-62cc715e-be75-4682-8376-db88971339c1 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] Start building networks asynchronously for instance. {{(pid=74960) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 12:30:52 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7769e3c5-136f-4282-8e3e-224e3a80922c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:30:52 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7769e3c5-136f-4282-8e3e-224e3a80922c/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:30:52 user nova-compute[74960]: DEBUG nova.compute.manager [None req-62cc715e-be75-4682-8376-db88971339c1 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] Allocating IP information in the background. {{(pid=74960) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 12:30:52 user nova-compute[74960]: DEBUG nova.network.neutron [None req-62cc715e-be75-4682-8376-db88971339c1 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] allocate_for_instance() {{(pid=74960) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 12:30:52 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-62cc715e-be75-4682-8376-db88971339c1 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 12:30:52 user nova-compute[74960]: DEBUG nova.compute.manager [None req-62cc715e-be75-4682-8376-db88971339c1 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] Start building block device mappings for instance. {{(pid=74960) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 12:30:52 user nova-compute[74960]: INFO nova.virt.block_device [None req-62cc715e-be75-4682-8376-db88971339c1 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] Booting with volume fa4cf8d2-7542-4bcf-840d-5ccc3401a797 at /dev/vda
Nov 03 12:30:52 user nova-compute[74960]: DEBUG nova.policy [None req-62cc715e-be75-4682-8376-db88971339c1 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0e7c95f83f104c0697236508cd538c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b44956ba8ca42f29fda6a18ef9fb198', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74960) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 12:30:52 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7769e3c5-136f-4282-8e3e-224e3a80922c/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:30:52 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be38c803-d97c-4939-9852-e8db1c44bb65/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:30:52 user nova-compute[74960]: DEBUG os_brick.utils [None req-62cc715e-be75-4682-8376-db88971339c1 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:30:52 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:30:52 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:30:52 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[d68ca766-7877-4bf8-b3e7-94f093889704]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:75b8e219756\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:30:52 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:30:52 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:30:52 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4031d91-27e3-4c62-8edf-798e10726f0c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:30:52 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:30:52 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:30:52 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[de49690e-3add-47fb-9c21-7e3693c7f8fd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:30:52 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f662107-22a4-4884-b327-4ff7a5544550]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:30:52 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-62cc715e-be75-4682-8376-db88971339c1 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Running cmd (subprocess): nvme version {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:30:52 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-62cc715e-be75-4682-8376-db88971339c1 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] 'nvme version' failed. Not Retrying. {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 12:30:52 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.nvmeof [None req-62cc715e-be75-4682-8376-db88971339c1 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] nvme not present on system {{(pid=74960) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 12:30:52 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:30:52 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 12:30:52 user nova-compute[74960]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 12:30:52 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[598eb8e2-c18b-4e5f-ba3b-a13875e84b4d]: (4, '') {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:30:52 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-62cc715e-be75-4682-8376-db88971339c1 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74960) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 12:30:52 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-62cc715e-be75-4682-8376-db88971339c1 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74960) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 12:30:52 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-62cc715e-be75-4682-8376-db88971339c1 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] LIGHTOS: no hostnqn found. {{(pid=74960) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 12:30:52 user nova-compute[74960]: DEBUG os_brick.utils [None req-62cc715e-be75-4682-8376-db88971339c1 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:75b8e219756', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:30:52 user nova-compute[74960]: DEBUG nova.virt.block_device [None req-62cc715e-be75-4682-8376-db88971339c1 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] Updating existing volume attachment record: 81662349-55ee-4c47-b25a-182d1f64030d {{(pid=74960) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 12:30:52 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be38c803-d97c-4939-9852-e8db1c44bb65/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:30:52 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be38c803-d97c-4939-9852-e8db1c44bb65/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:30:52 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be38c803-d97c-4939-9852-e8db1c44bb65/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:30:52 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f15f5f-8afa-4d7b-bb45-5887184f9ee5/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:30:53 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f15f5f-8afa-4d7b-bb45-5887184f9ee5/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:30:53 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f15f5f-8afa-4d7b-bb45-5887184f9ee5/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:30:53 user nova-compute[74960]: DEBUG nova.network.neutron [None req-62cc715e-be75-4682-8376-db88971339c1 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] Successfully created port: fe22f17b-b60c-465a-9079-e9c008004741 {{(pid=74960) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 12:30:53 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f15f5f-8afa-4d7b-bb45-5887184f9ee5/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:30:53 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7b95c0-3726-4a1c-a384-ec91abf75225/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:30:53 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7b95c0-3726-4a1c-a384-ec91abf75225/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:30:53 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7b95c0-3726-4a1c-a384-ec91abf75225/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:30:53 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7b95c0-3726-4a1c-a384-ec91abf75225/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:30:53 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/208570e4-1b11-486b-a79e-4b4eafc26af2/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:30:53 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-ef971d9b-9923-4957-97bf-3440a794881f tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] Acquiring lock "9951fab7-4984-408e-94ca-11eab615ff25" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:30:53 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-ef971d9b-9923-4957-97bf-3440a794881f tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] Lock "9951fab7-4984-408e-94ca-11eab615ff25" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:30:53 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-ef971d9b-9923-4957-97bf-3440a794881f tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] Acquiring lock "9951fab7-4984-408e-94ca-11eab615ff25-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:30:53 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-ef971d9b-9923-4957-97bf-3440a794881f tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] Lock "9951fab7-4984-408e-94ca-11eab615ff25-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:30:53 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-ef971d9b-9923-4957-97bf-3440a794881f tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] Lock "9951fab7-4984-408e-94ca-11eab615ff25-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:30:53 user nova-compute[74960]: INFO nova.compute.manager [None req-ef971d9b-9923-4957-97bf-3440a794881f tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] [instance: 9951fab7-4984-408e-94ca-11eab615ff25] Terminating instance
Nov 03 12:30:53 user nova-compute[74960]: DEBUG nova.compute.manager [None req-ef971d9b-9923-4957-97bf-3440a794881f tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] [instance: 9951fab7-4984-408e-94ca-11eab615ff25] Start destroying the instance on the hypervisor. {{(pid=74960) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 12:30:54 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:30:54 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/208570e4-1b11-486b-a79e-4b4eafc26af2/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:30:54 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/208570e4-1b11-486b-a79e-4b4eafc26af2/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:30:54 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:30:54 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:30:54 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/208570e4-1b11-486b-a79e-4b4eafc26af2/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:30:54 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74960) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 12:30:54 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6199681-f85e-4f55-966b-6ab3f17cd640/disk.rescue --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:30:54 user nova-compute[74960]: DEBUG nova.network.neutron [None req-62cc715e-be75-4682-8376-db88971339c1 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] Successfully updated port: fe22f17b-b60c-465a-9079-e9c008004741 {{(pid=74960) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 12:30:54 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-62cc715e-be75-4682-8376-db88971339c1 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Acquiring lock "refresh_cache-5dc6cb24-fe58-4e36-bd7f-a67a804a98e1" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:30:54 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-62cc715e-be75-4682-8376-db88971339c1 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Acquired lock "refresh_cache-5dc6cb24-fe58-4e36-bd7f-a67a804a98e1" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:30:54 user nova-compute[74960]: DEBUG nova.network.neutron [None req-62cc715e-be75-4682-8376-db88971339c1 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] Building network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 12:30:54 user nova-compute[74960]: DEBUG nova.compute.manager [req-a8657e88-2a71-4fed-bf8b-66ba875d5a32 req-e408e79e-7a39-4ba4-b53f-9c3ac562d4e6 service nova] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] Received event network-changed-fe22f17b-b60c-465a-9079-e9c008004741 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:30:54 user nova-compute[74960]: DEBUG nova.compute.manager [req-a8657e88-2a71-4fed-bf8b-66ba875d5a32 req-e408e79e-7a39-4ba4-b53f-9c3ac562d4e6 service nova] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] Refreshing instance network info cache due to event network-changed-fe22f17b-b60c-465a-9079-e9c008004741. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 12:30:54 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-a8657e88-2a71-4fed-bf8b-66ba875d5a32 req-e408e79e-7a39-4ba4-b53f-9c3ac562d4e6 service nova] Acquiring lock "refresh_cache-5dc6cb24-fe58-4e36-bd7f-a67a804a98e1" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:30:54 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6199681-f85e-4f55-966b-6ab3f17cd640/disk.rescue --force-share --output=json" returned: 0 in 0.244s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:30:54 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6199681-f85e-4f55-966b-6ab3f17cd640/disk.rescue --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:30:54 user nova-compute[74960]: DEBUG nova.network.neutron [None req-62cc715e-be75-4682-8376-db88971339c1 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] Instance cache missing network info. {{(pid=74960) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 12:30:54 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6199681-f85e-4f55-966b-6ab3f17cd640/disk.rescue --force-share --output=json" returned: 0 in 0.212s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:30:54 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: 9951fab7-4984-408e-94ca-11eab615ff25] Instance destroyed successfully.
Nov 03 12:30:54 user nova-compute[74960]: DEBUG nova.objects.instance [None req-ef971d9b-9923-4957-97bf-3440a794881f tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] Lazy-loading 'resources' on Instance uuid 9951fab7-4984-408e-94ca-11eab615ff25 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:30:55 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-ef971d9b-9923-4957-97bf-3440a794881f tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:22:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1411680818',display_name='tempest-ServerActionsTestOtherB-server-1411680818',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1411680818',id=16,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAK9ohWIt15s7ldudGsT8XlofULtoWzMK5SA+58BffvylMEp5GxogzaE69P+WSGeZ5KRHEilG/VwxeQ6fbT98lYIbTEwG2MJa8koMYFjXVA2bTTbOJr39ehW4vit7EZ+IA==',key_name='tempest-keypair-355656543',keypairs=<?>,launch_index=0,launched_at=2023-11-03T12:22:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6d6fbb72509e44ef8003aa2c58a7cf88',ramdisk_id='',reservation_id='r-6npj51bk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-2007370068',owner_user_name='tempest-ServerActionsTestOtherB-2007370068-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T12:22:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8eba5211db3d4634ac9e265997343895',uuid=9951fab7-4984-408e-94ca-11eab615ff25,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5782b039-1492-4364-b1b2-6b27ee06c5ce", "address": "fa:16:3e:55:0b:75", "network": {"id": "d6261390-d9b7-447c-be8e-ff6dd1a367ef", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1772643385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d6fbb72509e44ef8003aa2c58a7cf88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5782b039-14", "ovs_interfaceid": "5782b039-1492-4364-b1b2-6b27ee06c5ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 12:30:55 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-ef971d9b-9923-4957-97bf-3440a794881f tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] Converting VIF {"id": "5782b039-1492-4364-b1b2-6b27ee06c5ce", "address": "fa:16:3e:55:0b:75", "network": {"id": "d6261390-d9b7-447c-be8e-ff6dd1a367ef", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1772643385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d6fbb72509e44ef8003aa2c58a7cf88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5782b039-14", "ovs_interfaceid": "5782b039-1492-4364-b1b2-6b27ee06c5ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:30:55 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-ef971d9b-9923-4957-97bf-3440a794881f tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:55:0b:75,bridge_name='br-int',has_traffic_filtering=True,id=5782b039-1492-4364-b1b2-6b27ee06c5ce,network=Network(d6261390-d9b7-447c-be8e-ff6dd1a367ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5782b039-14') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:30:55 user nova-compute[74960]: DEBUG os_vif [None req-ef971d9b-9923-4957-97bf-3440a794881f tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:55:0b:75,bridge_name='br-int',has_traffic_filtering=True,id=5782b039-1492-4364-b1b2-6b27ee06c5ce,network=Network(d6261390-d9b7-447c-be8e-ff6dd1a367ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5782b039-14') {{(pid=74960) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 12:30:55 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:30:55 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5782b039-14, bridge=br-int, if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:30:55 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:30:55 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:30:55 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:30:55 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a9e1cd6d-1079-4d8c-bb44-2fb01cb8b673) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:30:55 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:30:55 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:30:55 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:30:55 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:30:55 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Hypervisor/Node resource view: name=user free_ram=7663MB free_disk=25.041934967041016GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74960) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 12:30:55 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:30:55 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:30:55 user nova-compute[74960]: INFO os_vif [None req-ef971d9b-9923-4957-97bf-3440a794881f tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:55:0b:75,bridge_name='br-int',has_traffic_filtering=True,id=5782b039-1492-4364-b1b2-6b27ee06c5ce,network=Network(d6261390-d9b7-447c-be8e-ff6dd1a367ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5782b039-14')
Nov 03 12:30:55 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-ef971d9b-9923-4957-97bf-3440a794881f tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] [instance: 9951fab7-4984-408e-94ca-11eab615ff25] Deleting instance files /opt/stack/data/nova/instances/9951fab7-4984-408e-94ca-11eab615ff25_del
Nov 03 12:30:55 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-ef971d9b-9923-4957-97bf-3440a794881f tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] [instance: 9951fab7-4984-408e-94ca-11eab615ff25] Deletion of /opt/stack/data/nova/instances/9951fab7-4984-408e-94ca-11eab615ff25_del complete
Nov 03 12:30:55 user nova-compute[74960]: DEBUG nova.network.neutron [None req-62cc715e-be75-4682-8376-db88971339c1 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] Updating instance_info_cache with network_info: [{"id": "fe22f17b-b60c-465a-9079-e9c008004741", "address": "fa:16:3e:cd:e4:ff", "network": {"id": "a356b90b-cf10-4b3f-802a-aa2656c5588b", "bridge": "br-int", "label": "tempest-TestShelveInstance-1788680557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b44956ba8ca42f29fda6a18ef9fb198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe22f17b-b6", "ovs_interfaceid": "fe22f17b-b60c-465a-9079-e9c008004741", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:30:55 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-62cc715e-be75-4682-8376-db88971339c1 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Releasing lock "refresh_cache-5dc6cb24-fe58-4e36-bd7f-a67a804a98e1" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:30:55 user nova-compute[74960]: DEBUG nova.compute.manager [None req-62cc715e-be75-4682-8376-db88971339c1 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] Instance network_info: |[{"id": "fe22f17b-b60c-465a-9079-e9c008004741", "address": "fa:16:3e:cd:e4:ff", "network": {"id": "a356b90b-cf10-4b3f-802a-aa2656c5588b", "bridge": "br-int", "label": "tempest-TestShelveInstance-1788680557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b44956ba8ca42f29fda6a18ef9fb198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe22f17b-b6", "ovs_interfaceid": "fe22f17b-b60c-465a-9079-e9c008004741", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74960) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 12:30:55 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-a8657e88-2a71-4fed-bf8b-66ba875d5a32 req-e408e79e-7a39-4ba4-b53f-9c3ac562d4e6 service nova] Acquired lock "refresh_cache-5dc6cb24-fe58-4e36-bd7f-a67a804a98e1" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:30:55 user nova-compute[74960]: DEBUG nova.network.neutron [req-a8657e88-2a71-4fed-bf8b-66ba875d5a32 req-e408e79e-7a39-4ba4-b53f-9c3ac562d4e6 service nova] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] Refreshing network info cache for port fe22f17b-b60c-465a-9079-e9c008004741 {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 12:30:55 user nova-compute[74960]: INFO nova.compute.manager [None req-ef971d9b-9923-4957-97bf-3440a794881f tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] [instance: 9951fab7-4984-408e-94ca-11eab615ff25] Took 1.53 seconds to destroy the instance on the hypervisor.
Nov 03 12:30:55 user nova-compute[74960]: DEBUG oslo.service.loopingcall [None req-ef971d9b-9923-4957-97bf-3440a794881f tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74960) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 12:30:55 user nova-compute[74960]: DEBUG nova.compute.manager [-] [instance: 9951fab7-4984-408e-94ca-11eab615ff25] Deallocating network for instance {{(pid=74960) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 12:30:55 user nova-compute[74960]: DEBUG nova.network.neutron [-] [instance: 9951fab7-4984-408e-94ca-11eab615ff25] deallocate_for_instance() {{(pid=74960) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 12:30:55 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 7769e3c5-136f-4282-8e3e-224e3a80922c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:30:55 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 9951fab7-4984-408e-94ca-11eab615ff25 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:30:55 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 87f15f5f-8afa-4d7b-bb45-5887184f9ee5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:30:55 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance be38c803-d97c-4939-9852-e8db1c44bb65 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:30:55 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance a6199681-f85e-4f55-966b-6ab3f17cd640 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:30:55 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance b1f7c162-c891-460a-8f98-3c7d6aeb6c49 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:30:55 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 208570e4-1b11-486b-a79e-4b4eafc26af2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:30:55 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 5b7b95c0-3726-4a1c-a384-ec91abf75225 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:30:55 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:30:55 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74960) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 12:30:55 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74960) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 12:30:55 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:30:55 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:30:55 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Compute_service record updated for user:user {{(pid=74960) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 12:30:55 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.584s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:30:55 user nova-compute[74960]: DEBUG nova.network.neutron [req-a8657e88-2a71-4fed-bf8b-66ba875d5a32 req-e408e79e-7a39-4ba4-b53f-9c3ac562d4e6 service nova] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] Updated VIF entry in instance network info cache for port fe22f17b-b60c-465a-9079-e9c008004741. {{(pid=74960) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 12:30:55 user nova-compute[74960]: DEBUG nova.network.neutron [req-a8657e88-2a71-4fed-bf8b-66ba875d5a32 req-e408e79e-7a39-4ba4-b53f-9c3ac562d4e6 service nova] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] Updating instance_info_cache with network_info: [{"id": "fe22f17b-b60c-465a-9079-e9c008004741", "address": "fa:16:3e:cd:e4:ff", "network": {"id": "a356b90b-cf10-4b3f-802a-aa2656c5588b", "bridge": "br-int", "label": "tempest-TestShelveInstance-1788680557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b44956ba8ca42f29fda6a18ef9fb198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe22f17b-b6", "ovs_interfaceid": "fe22f17b-b60c-465a-9079-e9c008004741", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:30:55 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-a8657e88-2a71-4fed-bf8b-66ba875d5a32 req-e408e79e-7a39-4ba4-b53f-9c3ac562d4e6 service nova] Releasing lock "refresh_cache-5dc6cb24-fe58-4e36-bd7f-a67a804a98e1" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:30:56 user nova-compute[74960]: DEBUG nova.network.neutron [-] [instance: 9951fab7-4984-408e-94ca-11eab615ff25] Updating instance_info_cache with network_info: [] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:30:56 user nova-compute[74960]: INFO nova.compute.manager [-] [instance: 9951fab7-4984-408e-94ca-11eab615ff25] Took 0.85 seconds to deallocate network for instance.
Nov 03 12:30:56 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-ef971d9b-9923-4957-97bf-3440a794881f tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:30:56 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-ef971d9b-9923-4957-97bf-3440a794881f tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:30:56 user nova-compute[74960]: DEBUG nova.compute.manager [req-9bb9825c-b3b1-46d2-a3ac-fe06e071359c req-e69346c5-a71a-4d2f-a9ed-8e309a590507 service nova] [instance: 9951fab7-4984-408e-94ca-11eab615ff25] Received event network-vif-unplugged-5782b039-1492-4364-b1b2-6b27ee06c5ce {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:30:56 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-9bb9825c-b3b1-46d2-a3ac-fe06e071359c req-e69346c5-a71a-4d2f-a9ed-8e309a590507 service nova] Acquiring lock "9951fab7-4984-408e-94ca-11eab615ff25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:30:56 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-9bb9825c-b3b1-46d2-a3ac-fe06e071359c req-e69346c5-a71a-4d2f-a9ed-8e309a590507 service nova] Lock "9951fab7-4984-408e-94ca-11eab615ff25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:30:56 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-9bb9825c-b3b1-46d2-a3ac-fe06e071359c req-e69346c5-a71a-4d2f-a9ed-8e309a590507 service nova] Lock "9951fab7-4984-408e-94ca-11eab615ff25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:30:56 user nova-compute[74960]: DEBUG nova.compute.manager [req-9bb9825c-b3b1-46d2-a3ac-fe06e071359c req-e69346c5-a71a-4d2f-a9ed-8e309a590507 service nova] [instance: 9951fab7-4984-408e-94ca-11eab615ff25] No waiting events found dispatching network-vif-unplugged-5782b039-1492-4364-b1b2-6b27ee06c5ce {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:30:56 user nova-compute[74960]: WARNING nova.compute.manager [req-9bb9825c-b3b1-46d2-a3ac-fe06e071359c req-e69346c5-a71a-4d2f-a9ed-8e309a590507 service nova] [instance: 9951fab7-4984-408e-94ca-11eab615ff25] Received unexpected event network-vif-unplugged-5782b039-1492-4364-b1b2-6b27ee06c5ce for instance with vm_state deleted and task_state None.
Nov 03 12:30:56 user nova-compute[74960]: DEBUG nova.compute.manager [req-9bb9825c-b3b1-46d2-a3ac-fe06e071359c req-e69346c5-a71a-4d2f-a9ed-8e309a590507 service nova] [instance: 9951fab7-4984-408e-94ca-11eab615ff25] Received event network-vif-plugged-5782b039-1492-4364-b1b2-6b27ee06c5ce {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:30:56 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-9bb9825c-b3b1-46d2-a3ac-fe06e071359c req-e69346c5-a71a-4d2f-a9ed-8e309a590507 service nova] Acquiring lock "9951fab7-4984-408e-94ca-11eab615ff25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:30:56 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-9bb9825c-b3b1-46d2-a3ac-fe06e071359c req-e69346c5-a71a-4d2f-a9ed-8e309a590507 service nova] Lock "9951fab7-4984-408e-94ca-11eab615ff25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:30:56 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-9bb9825c-b3b1-46d2-a3ac-fe06e071359c req-e69346c5-a71a-4d2f-a9ed-8e309a590507 service nova] Lock "9951fab7-4984-408e-94ca-11eab615ff25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:30:56 user nova-compute[74960]: DEBUG nova.compute.manager [req-9bb9825c-b3b1-46d2-a3ac-fe06e071359c req-e69346c5-a71a-4d2f-a9ed-8e309a590507 service nova] [instance: 9951fab7-4984-408e-94ca-11eab615ff25] No waiting events found dispatching network-vif-plugged-5782b039-1492-4364-b1b2-6b27ee06c5ce {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:30:56 user nova-compute[74960]: WARNING nova.compute.manager [req-9bb9825c-b3b1-46d2-a3ac-fe06e071359c req-e69346c5-a71a-4d2f-a9ed-8e309a590507 service nova] [instance: 9951fab7-4984-408e-94ca-11eab615ff25] Received unexpected event network-vif-plugged-5782b039-1492-4364-b1b2-6b27ee06c5ce for instance with vm_state deleted and task_state None.
Nov 03 12:30:56 user nova-compute[74960]: DEBUG nova.compute.manager [req-9bb9825c-b3b1-46d2-a3ac-fe06e071359c req-e69346c5-a71a-4d2f-a9ed-8e309a590507 service nova] [instance: 9951fab7-4984-408e-94ca-11eab615ff25] Received event network-vif-deleted-5782b039-1492-4364-b1b2-6b27ee06c5ce {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:30:56 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-ef971d9b-9923-4957-97bf-3440a794881f tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:30:56 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-ef971d9b-9923-4957-97bf-3440a794881f tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:30:56 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-ef971d9b-9923-4957-97bf-3440a794881f tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.340s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:30:56 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:30:56 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:30:56 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:30:56 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74960) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 12:30:56 user nova-compute[74960]: INFO nova.scheduler.client.report [None req-ef971d9b-9923-4957-97bf-3440a794881f tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] Deleted allocations for instance 9951fab7-4984-408e-94ca-11eab615ff25
Nov 03 12:30:56 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-ef971d9b-9923-4957-97bf-3440a794881f tempest-ServerActionsTestOtherB-2007370068 tempest-ServerActionsTestOtherB-2007370068-project-member] Lock "9951fab7-4984-408e-94ca-11eab615ff25" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.949s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:30:58 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:30:58 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:31:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:31:01 user nova-compute[74960]: DEBUG nova.compute.manager [req-b71d53ac-4305-4894-83cf-38fe2907ded7 req-c30879ce-aec0-43aa-91ce-a2defab341dc service nova] [instance: 7769e3c5-136f-4282-8e3e-224e3a80922c] Received event network-changed-8fe46c5c-9093-43c4-8b0d-baf325c2e18b {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:31:01 user nova-compute[74960]: DEBUG nova.compute.manager [req-b71d53ac-4305-4894-83cf-38fe2907ded7 req-c30879ce-aec0-43aa-91ce-a2defab341dc service nova] [instance: 7769e3c5-136f-4282-8e3e-224e3a80922c] Refreshing instance network info cache due to event network-changed-8fe46c5c-9093-43c4-8b0d-baf325c2e18b. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 12:31:01 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-b71d53ac-4305-4894-83cf-38fe2907ded7 req-c30879ce-aec0-43aa-91ce-a2defab341dc service nova] Acquiring lock "refresh_cache-7769e3c5-136f-4282-8e3e-224e3a80922c" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:31:01 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-b71d53ac-4305-4894-83cf-38fe2907ded7 req-c30879ce-aec0-43aa-91ce-a2defab341dc service nova] Acquired lock "refresh_cache-7769e3c5-136f-4282-8e3e-224e3a80922c" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:31:01 user nova-compute[74960]: DEBUG nova.network.neutron [req-b71d53ac-4305-4894-83cf-38fe2907ded7 req-c30879ce-aec0-43aa-91ce-a2defab341dc service nova] [instance: 7769e3c5-136f-4282-8e3e-224e3a80922c] Refreshing network info cache for port 8fe46c5c-9093-43c4-8b0d-baf325c2e18b {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 12:31:02 user nova-compute[74960]: DEBUG nova.network.neutron [req-b71d53ac-4305-4894-83cf-38fe2907ded7 req-c30879ce-aec0-43aa-91ce-a2defab341dc service nova] [instance: 7769e3c5-136f-4282-8e3e-224e3a80922c] Updated VIF entry in instance network info cache for port 8fe46c5c-9093-43c4-8b0d-baf325c2e18b. {{(pid=74960) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 12:31:02 user nova-compute[74960]: DEBUG nova.network.neutron [req-b71d53ac-4305-4894-83cf-38fe2907ded7 req-c30879ce-aec0-43aa-91ce-a2defab341dc service nova] [instance: 7769e3c5-136f-4282-8e3e-224e3a80922c] Updating instance_info_cache with network_info: [{"id": "8fe46c5c-9093-43c4-8b0d-baf325c2e18b", "address": "fa:16:3e:ba:d5:3a", "network": {"id": "9c5fae09-5df5-45a3-b9cd-7ac3763ba878", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1736223258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5320673ee4f0422989a3708915375cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fe46c5c-90", "ovs_interfaceid": "8fe46c5c-9093-43c4-8b0d-baf325c2e18b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:31:02 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-b71d53ac-4305-4894-83cf-38fe2907ded7 req-c30879ce-aec0-43aa-91ce-a2defab341dc service nova] Releasing lock "refresh_cache-7769e3c5-136f-4282-8e3e-224e3a80922c" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:31:03 user nova-compute[74960]: DEBUG nova.compute.manager [None req-2b6635dd-9cf7-4934-b518-97770075d6ee tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49] Stashing vm_state: active {{(pid=74960) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 03 12:31:03 user nova-compute[74960]: DEBUG nova.compute.manager [req-c380deb7-3df5-4205-a9b4-91a2c6584ad6 req-254bfa4e-8b22-4759-850c-2b1c08651429 service nova] [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49] Received event network-changed-78dc3436-7e47-4513-b5fa-0fd25ab1baf9 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:31:03 user nova-compute[74960]: DEBUG nova.compute.manager [req-c380deb7-3df5-4205-a9b4-91a2c6584ad6 req-254bfa4e-8b22-4759-850c-2b1c08651429 service nova] [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49] Refreshing instance network info cache due to event network-changed-78dc3436-7e47-4513-b5fa-0fd25ab1baf9. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 12:31:03 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-c380deb7-3df5-4205-a9b4-91a2c6584ad6 req-254bfa4e-8b22-4759-850c-2b1c08651429 service nova] Acquiring lock "refresh_cache-b1f7c162-c891-460a-8f98-3c7d6aeb6c49" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:31:03 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-c380deb7-3df5-4205-a9b4-91a2c6584ad6 req-254bfa4e-8b22-4759-850c-2b1c08651429 service nova] Acquired lock "refresh_cache-b1f7c162-c891-460a-8f98-3c7d6aeb6c49" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:31:03 user nova-compute[74960]: DEBUG nova.network.neutron [req-c380deb7-3df5-4205-a9b4-91a2c6584ad6 req-254bfa4e-8b22-4759-850c-2b1c08651429 service nova] [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49] Refreshing network info cache for port 78dc3436-7e47-4513-b5fa-0fd25ab1baf9 {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 12:31:03 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-2b6635dd-9cf7-4934-b518-97770075d6ee tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:31:03 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-2b6635dd-9cf7-4934-b518-97770075d6ee tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:31:03 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:31:03 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-2b6635dd-9cf7-4934-b518-97770075d6ee tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74960) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 12:31:03 user nova-compute[74960]: INFO nova.compute.claims [None req-2b6635dd-9cf7-4934-b518-97770075d6ee tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49] Claim successful on node user
Nov 03 12:31:03 user nova-compute[74960]: INFO nova.compute.resource_tracker [None req-2b6635dd-9cf7-4934-b518-97770075d6ee tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49] Updating resource usage from migration 4e8b66c8-feb8-4c01-a89e-fd5c22b15658
Nov 03 12:31:03 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-2b6635dd-9cf7-4934-b518-97770075d6ee tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:31:03 user nova-compute[74960]: DEBUG nova.network.neutron [req-c380deb7-3df5-4205-a9b4-91a2c6584ad6 req-254bfa4e-8b22-4759-850c-2b1c08651429 service nova] [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49] Updated VIF entry in instance network info cache for port 78dc3436-7e47-4513-b5fa-0fd25ab1baf9. {{(pid=74960) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 12:31:03 user nova-compute[74960]: DEBUG nova.network.neutron [req-c380deb7-3df5-4205-a9b4-91a2c6584ad6 req-254bfa4e-8b22-4759-850c-2b1c08651429 service nova] [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49] Updating instance_info_cache with network_info: [{"id": "78dc3436-7e47-4513-b5fa-0fd25ab1baf9", "address": "fa:16:3e:d5:a8:23", "network": {"id": "9c5fae09-5df5-45a3-b9cd-7ac3763ba878", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1736223258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5320673ee4f0422989a3708915375cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78dc3436-7e", "ovs_interfaceid": "78dc3436-7e47-4513-b5fa-0fd25ab1baf9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:31:03 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-2b6635dd-9cf7-4934-b518-97770075d6ee tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:31:03 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-c380deb7-3df5-4205-a9b4-91a2c6584ad6 req-254bfa4e-8b22-4759-850c-2b1c08651429 service nova] Releasing lock "refresh_cache-b1f7c162-c891-460a-8f98-3c7d6aeb6c49" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:31:03 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-2b6635dd-9cf7-4934-b518-97770075d6ee tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.425s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:31:03 user nova-compute[74960]: INFO nova.compute.manager [None req-2b6635dd-9cf7-4934-b518-97770075d6ee tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49] Migrating
Nov 03 12:31:03 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-2b6635dd-9cf7-4934-b518-97770075d6ee tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:31:03 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-2b6635dd-9cf7-4934-b518-97770075d6ee tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Acquired lock "compute-rpcapi-router" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:31:03 user nova-compute[74960]: INFO nova.compute.rpcapi [None req-2b6635dd-9cf7-4934-b518-97770075d6ee tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Nov 03 12:31:03 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-2b6635dd-9cf7-4934-b518-97770075d6ee tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Releasing lock "compute-rpcapi-router" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:31:03 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-2b6635dd-9cf7-4934-b518-97770075d6ee tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Acquiring lock "refresh_cache-b1f7c162-c891-460a-8f98-3c7d6aeb6c49" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:31:03 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-2b6635dd-9cf7-4934-b518-97770075d6ee tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Acquired lock "refresh_cache-b1f7c162-c891-460a-8f98-3c7d6aeb6c49" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:31:03 user nova-compute[74960]: DEBUG nova.network.neutron [None req-2b6635dd-9cf7-4934-b518-97770075d6ee tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49] Building network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 12:31:04 user nova-compute[74960]: DEBUG nova.network.neutron [None req-2b6635dd-9cf7-4934-b518-97770075d6ee tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49] Updating instance_info_cache with network_info: [{"id": "78dc3436-7e47-4513-b5fa-0fd25ab1baf9", "address": "fa:16:3e:d5:a8:23", "network": {"id": "9c5fae09-5df5-45a3-b9cd-7ac3763ba878", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1736223258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5320673ee4f0422989a3708915375cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78dc3436-7e", "ovs_interfaceid": "78dc3436-7e47-4513-b5fa-0fd25ab1baf9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:31:04 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-2b6635dd-9cf7-4934-b518-97770075d6ee tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Releasing lock "refresh_cache-b1f7c162-c891-460a-8f98-3c7d6aeb6c49" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:31:04 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-2b6635dd-9cf7-4934-b518-97770075d6ee tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49] Starting migrate_disk_and_power_off {{(pid=74960) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 03 12:31:04 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:31:04 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:31:04 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:31:04 user nova-compute[74960]: DEBUG nova.compute.manager [req-3dd69b56-5f52-43d4-87eb-79e2171a6d2a req-8d50d517-56e0-4b5c-93cd-673444a20b40 service nova] [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49] Received event network-vif-unplugged-78dc3436-7e47-4513-b5fa-0fd25ab1baf9 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:31:04 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-3dd69b56-5f52-43d4-87eb-79e2171a6d2a req-8d50d517-56e0-4b5c-93cd-673444a20b40 service nova] Acquiring lock "b1f7c162-c891-460a-8f98-3c7d6aeb6c49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:31:04 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-3dd69b56-5f52-43d4-87eb-79e2171a6d2a req-8d50d517-56e0-4b5c-93cd-673444a20b40 service nova] Lock "b1f7c162-c891-460a-8f98-3c7d6aeb6c49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:31:04 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-3dd69b56-5f52-43d4-87eb-79e2171a6d2a req-8d50d517-56e0-4b5c-93cd-673444a20b40 service nova] Lock "b1f7c162-c891-460a-8f98-3c7d6aeb6c49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:31:04 user nova-compute[74960]: DEBUG nova.compute.manager [req-3dd69b56-5f52-43d4-87eb-79e2171a6d2a req-8d50d517-56e0-4b5c-93cd-673444a20b40 service nova] [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49] No waiting events found dispatching network-vif-unplugged-78dc3436-7e47-4513-b5fa-0fd25ab1baf9 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:31:04 user nova-compute[74960]: WARNING nova.compute.manager [req-3dd69b56-5f52-43d4-87eb-79e2171a6d2a req-8d50d517-56e0-4b5c-93cd-673444a20b40 service nova] [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49] Received unexpected event network-vif-unplugged-78dc3436-7e47-4513-b5fa-0fd25ab1baf9 for instance with vm_state active and task_state resize_migrating.
Nov 03 12:31:04 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:31:05 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:31:05 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49] Instance destroyed successfully.
Nov 03 12:31:05 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-2b6635dd-9cf7-4934-b518-97770075d6ee tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:29:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1418707382',display_name='tempest-ServerActionsTestOtherA-server-1418707382',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1418707382',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPAz3yp3EJUzWOfLmandSosNLGmmwlB9ouRsIIfsq3JGgx5t4USdyA4JVa+9y90auzNv5yGmALwIZZVdM/LzHirlYfhZGk/2geYmtQFtCuY7KHcICqsra/ZIlPsAiI2BYw==',key_name='tempest-keypair-1847755946',keypairs=<?>,launch_index=0,launched_at=2023-11-03T12:29:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5320673ee4f0422989a3708915375cdb',ramdisk_id='',reservation_id='r-nb6ahum2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1651581249',owner_user_name='tempest-ServerActionsTestOtherA-1651581249-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:31:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60d8d224d7204ede84c09433a3d82d0f',uuid=b1f7c162-c891-460a-8f98-3c7d6aeb6c49,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "78dc3436-7e47-4513-b5fa-0fd25ab1baf9", "address": "fa:16:3e:d5:a8:23", "network": {"id": "9c5fae09-5df5-45a3-b9cd-7ac3763ba878", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1736223258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1736223258-network", "vif_mac": "fa:16:3e:d5:a8:23"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5320673ee4f0422989a3708915375cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78dc3436-7e", "ovs_interfaceid": "78dc3436-7e47-4513-b5fa-0fd25ab1baf9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 12:31:05 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-2b6635dd-9cf7-4934-b518-97770075d6ee tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Converting VIF {"id": "78dc3436-7e47-4513-b5fa-0fd25ab1baf9", "address": "fa:16:3e:d5:a8:23", "network": {"id": "9c5fae09-5df5-45a3-b9cd-7ac3763ba878", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1736223258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1736223258-network", "vif_mac": "fa:16:3e:d5:a8:23"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5320673ee4f0422989a3708915375cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78dc3436-7e", "ovs_interfaceid": "78dc3436-7e47-4513-b5fa-0fd25ab1baf9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:31:05 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-2b6635dd-9cf7-4934-b518-97770075d6ee tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d5:a8:23,bridge_name='br-int',has_traffic_filtering=True,id=78dc3436-7e47-4513-b5fa-0fd25ab1baf9,network=Network(9c5fae09-5df5-45a3-b9cd-7ac3763ba878),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78dc3436-7e') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:31:05 user nova-compute[74960]: DEBUG os_vif [None req-2b6635dd-9cf7-4934-b518-97770075d6ee tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:a8:23,bridge_name='br-int',has_traffic_filtering=True,id=78dc3436-7e47-4513-b5fa-0fd25ab1baf9,network=Network(9c5fae09-5df5-45a3-b9cd-7ac3763ba878),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78dc3436-7e') {{(pid=74960) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 12:31:05 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:31:05 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap78dc3436-7e, bridge=br-int, if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:31:05 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:31:05 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:31:05 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:31:05 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f6f829fe-918f-4df4-874f-d1bffda482af) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:31:05 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:31:05 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:31:05 user nova-compute[74960]: INFO os_vif [None req-2b6635dd-9cf7-4934-b518-97770075d6ee tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:a8:23,bridge_name='br-int',has_traffic_filtering=True,id=78dc3436-7e47-4513-b5fa-0fd25ab1baf9,network=Network(9c5fae09-5df5-45a3-b9cd-7ac3763ba878),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78dc3436-7e')
Nov 03 12:31:05 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b6635dd-9cf7-4934-b518-97770075d6ee tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49] calling os-brick to detach iSCSI Volume {{(pid=74960) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 12:31:05 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b6635dd-9cf7-4934-b518-97770075d6ee tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9aa420acb0>, {'target_iqn': 'iqn.2010-10.org.openstack:2f45e9d6-0169-4a92-8d8c-ee068f12905b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IsvCifHn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:31:05 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-2b6635dd-9cf7-4934-b518-97770075d6ee tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:31:05 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-2b6635dd-9cf7-4934-b518-97770075d6ee tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:31:05 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-2b6635dd-9cf7-4934-b518-97770075d6ee tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:31:05 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:31:05 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:31:05 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ab4b3d0-83fc-4e1e-bb59-0ea2383d7632]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2f45e9d6-0169-4a92-8d8c-ee068f12905b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f33bebd3-3cc8-4db5-b35e-5d58d4dfe93f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:31:05 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b6635dd-9cf7-4934-b518-97770075d6ee tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 12:31:05 user nova-compute[74960]: No targets found.
Nov 03 12:31:05 user nova-compute[74960]: iSNS:
Nov 03 12:31:05 user nova-compute[74960]: No targets found.
Nov 03 12:31:05 user nova-compute[74960]: STATIC:
Nov 03 12:31:05 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:2f45e9d6-0169-4a92-8d8c-ee068f12905b
Nov 03 12:31:05 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:31:05 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:31:05 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:f33bebd3-3cc8-4db5-b35e-5d58d4dfe93f
Nov 03 12:31:05 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:31:05 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:31:05 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2
Nov 03 12:31:05 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:31:05 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:31:05 user nova-compute[74960]: FIRMWARE:
Nov 03 12:31:05 user nova-compute[74960]: No targets found.
Nov 03 12:31:05 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:31:05 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b6635dd-9cf7-4934-b518-97770075d6ee tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 12:31:05 user nova-compute[74960]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 12:31:05 user nova-compute[74960]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74960) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 12:31:05 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b6635dd-9cf7-4934-b518-97770075d6ee tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f45e9d6-0169-4a92-8d8c-ee068f12905b', 0)] {{(pid=74960) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 12:31:05 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:31:05 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:31:05 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[5218de12-c311-4091-ba99-beda0081b74e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f45e9d6-0169-4a92-8d8c-ee068f12905b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f33bebd3-3cc8-4db5-b35e-5d58d4dfe93f\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:31:05 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:31:05 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:31:05 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac147d8e-61ba-4e81-8119-2a657813fc39]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f33bebd3-3cc8-4db5-b35e-5d58d4dfe93f (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f45e9d6-0169-4a92-8d8c-ee068f12905b (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:31:05 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b6635dd-9cf7-4934-b518-97770075d6ee tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:31:05 user nova-compute[74960]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f33bebd3-3cc8-4db5-b35e-5d58d4dfe93f (non-flash)
Nov 03 12:31:05 user nova-compute[74960]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f45e9d6-0169-4a92-8d8c-ee068f12905b (non-flash)
Nov 03 12:31:05 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:31:05 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b6635dd-9cf7-4934-b518-97770075d6ee tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:31:05 user nova-compute[74960]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f33bebd3-3cc8-4db5-b35e-5d58d4dfe93f (non-flash)
Nov 03 12:31:05 user nova-compute[74960]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f45e9d6-0169-4a92-8d8c-ee068f12905b (non-flash)
Nov 03 12:31:05 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:31:05 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b6635dd-9cf7-4934-b518-97770075d6ee tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9a8c5efeb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f45e9d6-0169-4a92-8d8c-ee068f12905b'): ({'sdc'}, set())}) {{(pid=74960) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 12:31:05 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-2b6635dd-9cf7-4934-b518-97770075d6ee tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Removing single pathed devices sdc {{(pid=74960) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 12:31:05 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:31:05 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:31:05 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[31a99dac-66ae-439b-a702-3fd354fcb6eb]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:31:05 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:31:05 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:31:05 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2b9baed-c0be-4b3f-b1fa-7ac90eae472d]: (4, ('ok\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:31:05 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-2b6635dd-9cf7-4934-b518-97770075d6ee tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Flushing IO for device /dev/sdc {{(pid=74960) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 12:31:05 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:31:05 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:31:05 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[b53d818a-db9c-49c4-8fd3-cc1976e34c67]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:31:05 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-2b6635dd-9cf7-4934-b518-97770075d6ee tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74960) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 12:31:05 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:31:05 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:31:05 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8e98508-09ba-4abf-87aa-7ee537c7108f]: (4, ('1', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:31:05 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-2b6635dd-9cf7-4934-b518-97770075d6ee tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74960) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 12:31:05 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-2b6635dd-9cf7-4934-b518-97770075d6ee tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] SCSI volumes sdc have been removed. {{(pid=74960) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 12:31:05 user nova-compute[74960]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO6be1a38e-5f757e9f8c53c480', '/dev/disk/by-id/scsi-23566373537653966', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_6be1a38e') {{(pid=86167) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 03 12:31:05 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d55172-0a10-4bb2-848d-091519cbee26]: (4, None) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:31:05 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b6635dd-9cf7-4934-b518-97770075d6ee tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f45e9d6-0169-4a92-8d8c-ee068f12905b')] {{(pid=74960) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 12:31:05 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f45e9d6-0169-4a92-8d8c-ee068f12905b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:31:05 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f45e9d6-0169-4a92-8d8c-ee068f12905b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:31:05 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[d53e01d4-8bbd-42a6-86ea-df68a9cee558]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:31:05 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b6635dd-9cf7-4934-b518-97770075d6ee tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:31:05 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f45e9d6-0169-4a92-8d8c-ee068f12905b -p 172.16.0.220:3260 --logout {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:31:05 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f45e9d6-0169-4a92-8d8c-ee068f12905b -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:31:05 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1cb0123-4900-4088-81f6-59abbf773b3a]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:2f45e9d6-0169-4a92-8d8c-ee068f12905b, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:2f45e9d6-0169-4a92-8d8c-ee068f12905b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:31:05 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b6635dd-9cf7-4934-b518-97770075d6ee tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:2f45e9d6-0169-4a92-8d8c-ee068f12905b, portal: 172.16.0.220,3260]
Nov 03 12:31:05 user nova-compute[74960]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:2f45e9d6-0169-4a92-8d8c-ee068f12905b, portal: 172.16.0.220,3260] successful.
Nov 03 12:31:05 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:31:05 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f45e9d6-0169-4a92-8d8c-ee068f12905b -p 172.16.0.220:3260 --op delete {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:31:05 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f45e9d6-0169-4a92-8d8c-ee068f12905b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:31:05 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9d644d1-cd7d-4fd4-9e22-6da0a4c282cb]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:31:05 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b6635dd-9cf7-4934-b518-97770075d6ee tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:31:05 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-2b6635dd-9cf7-4934-b518-97770075d6ee tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:31:05 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b6635dd-9cf7-4934-b518-97770075d6ee tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] <== disconnect_volume: return (318ms) None {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:31:05 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b6635dd-9cf7-4934-b518-97770075d6ee tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49] Disconnected iSCSI Volume {{(pid=74960) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 12:31:05 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-2b6635dd-9cf7-4934-b518-97770075d6ee tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74960) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 12:31:06 user nova-compute[74960]: DEBUG nova.compute.manager [req-3d299d32-35e6-4f13-9e47-2349fa284004 req-80de781c-e661-4b4e-b6a5-6b301fa65881 service nova] [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49] Received event network-vif-plugged-78dc3436-7e47-4513-b5fa-0fd25ab1baf9 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:31:06 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-3d299d32-35e6-4f13-9e47-2349fa284004 req-80de781c-e661-4b4e-b6a5-6b301fa65881 service nova] Acquiring lock "b1f7c162-c891-460a-8f98-3c7d6aeb6c49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:31:06 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-3d299d32-35e6-4f13-9e47-2349fa284004 req-80de781c-e661-4b4e-b6a5-6b301fa65881 service nova] Lock "b1f7c162-c891-460a-8f98-3c7d6aeb6c49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:31:06 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-3d299d32-35e6-4f13-9e47-2349fa284004 req-80de781c-e661-4b4e-b6a5-6b301fa65881 service nova] Lock "b1f7c162-c891-460a-8f98-3c7d6aeb6c49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:31:06 user nova-compute[74960]: DEBUG nova.compute.manager [req-3d299d32-35e6-4f13-9e47-2349fa284004 req-80de781c-e661-4b4e-b6a5-6b301fa65881 service nova] [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49] No waiting events found dispatching network-vif-plugged-78dc3436-7e47-4513-b5fa-0fd25ab1baf9 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:31:06 user nova-compute[74960]: WARNING nova.compute.manager [req-3d299d32-35e6-4f13-9e47-2349fa284004 req-80de781c-e661-4b4e-b6a5-6b301fa65881 service nova] [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49] Received unexpected event network-vif-plugged-78dc3436-7e47-4513-b5fa-0fd25ab1baf9 for instance with vm_state active and task_state resize_migrating.
Nov 03 12:31:07 user nova-compute[74960]: DEBUG nova.network.neutron [None req-2b6635dd-9cf7-4934-b518-97770075d6ee tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49] Port 78dc3436-7e47-4513-b5fa-0fd25ab1baf9 binding to destination host user is already ACTIVE {{(pid=74960) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 03 12:31:07 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-2b6635dd-9cf7-4934-b518-97770075d6ee tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Acquiring lock "b1f7c162-c891-460a-8f98-3c7d6aeb6c49-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:31:07 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-2b6635dd-9cf7-4934-b518-97770075d6ee tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Lock "b1f7c162-c891-460a-8f98-3c7d6aeb6c49-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:31:07 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-2b6635dd-9cf7-4934-b518-97770075d6ee tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Lock "b1f7c162-c891-460a-8f98-3c7d6aeb6c49-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:31:07 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-2b6635dd-9cf7-4934-b518-97770075d6ee tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Acquiring lock "refresh_cache-b1f7c162-c891-460a-8f98-3c7d6aeb6c49" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:31:07 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-2b6635dd-9cf7-4934-b518-97770075d6ee tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Acquired lock "refresh_cache-b1f7c162-c891-460a-8f98-3c7d6aeb6c49" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:31:07 user nova-compute[74960]: DEBUG nova.network.neutron [None req-2b6635dd-9cf7-4934-b518-97770075d6ee tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49] Building network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 12:31:07 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-4b161e12-3dd5-41e1-baee-e35f35d9c01e tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance be38c803-d97c-4939-9852-e8db1c44bb65 is timed out.
Nov 03 12:31:07 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-4b161e12-3dd5-41e1-baee-e35f35d9c01e tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Successfully detached device vdb from instance be38c803-d97c-4939-9852-e8db1c44bb65 from the live domain config.
Nov 03 12:31:07 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b161e12-3dd5-41e1-baee-e35f35d9c01e tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] [instance: be38c803-d97c-4939-9852-e8db1c44bb65] calling os-brick to detach iSCSI Volume {{(pid=74960) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 12:31:07 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b161e12-3dd5-41e1-baee-e35f35d9c01e tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9aa420acb0>, {'target_iqn': 'iqn.2010-10.org.openstack:f33bebd3-3cc8-4db5-b35e-5d58d4dfe93f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MdxjuwLf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:31:07 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-4b161e12-3dd5-41e1-baee-e35f35d9c01e tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:31:07 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-4b161e12-3dd5-41e1-baee-e35f35d9c01e tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:31:07 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-4b161e12-3dd5-41e1-baee-e35f35d9c01e tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:31:07 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:31:07 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:31:07 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[1494e13c-eb13-4610-ba71-d467210b07d7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f33bebd3-3cc8-4db5-b35e-5d58d4dfe93f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:31:07 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b161e12-3dd5-41e1-baee-e35f35d9c01e tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 12:31:07 user nova-compute[74960]: No targets found.
Nov 03 12:31:07 user nova-compute[74960]: iSNS:
Nov 03 12:31:07 user nova-compute[74960]: No targets found.
Nov 03 12:31:07 user nova-compute[74960]: STATIC:
Nov 03 12:31:07 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:f33bebd3-3cc8-4db5-b35e-5d58d4dfe93f
Nov 03 12:31:07 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:31:07 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:31:07 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2
Nov 03 12:31:07 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:31:07 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:31:07 user nova-compute[74960]: FIRMWARE:
Nov 03 12:31:07 user nova-compute[74960]: No targets found.
Nov 03 12:31:07 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:31:07 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b161e12-3dd5-41e1-baee-e35f35d9c01e tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 12:31:07 user nova-compute[74960]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 12:31:07 user nova-compute[74960]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74960) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 12:31:07 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b161e12-3dd5-41e1-baee-e35f35d9c01e tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f33bebd3-3cc8-4db5-b35e-5d58d4dfe93f', 0)] {{(pid=74960) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 12:31:07 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:31:07 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:31:07 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[cec9e61b-20ef-4e57-8b30-50891e7daddf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f33bebd3-3cc8-4db5-b35e-5d58d4dfe93f\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:31:07 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:31:07 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:31:07 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[7908e133-1ad2-43d6-b676-6a55a10cc257]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f33bebd3-3cc8-4db5-b35e-5d58d4dfe93f (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:31:07 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b161e12-3dd5-41e1-baee-e35f35d9c01e tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:31:07 user nova-compute[74960]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f33bebd3-3cc8-4db5-b35e-5d58d4dfe93f (non-flash)
Nov 03 12:31:07 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:31:07 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b161e12-3dd5-41e1-baee-e35f35d9c01e tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:31:07 user nova-compute[74960]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f33bebd3-3cc8-4db5-b35e-5d58d4dfe93f (non-flash)
Nov 03 12:31:07 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:31:07 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b161e12-3dd5-41e1-baee-e35f35d9c01e tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9a8c4efd00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f33bebd3-3cc8-4db5-b35e-5d58d4dfe93f'): ({'sde'}, set())}) {{(pid=74960) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 12:31:07 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-4b161e12-3dd5-41e1-baee-e35f35d9c01e tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Removing single pathed devices sde {{(pid=74960) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 12:31:07 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:31:07 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:31:07 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8d6c219-cc69-4c04-93ee-759773e8d30f]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:31:07 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:31:07 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:31:07 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a31ca76-c697-4923-b399-c768c6cc3119]: (4, ('ok\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:31:07 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-4b161e12-3dd5-41e1-baee-e35f35d9c01e tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Flushing IO for device /dev/sde {{(pid=74960) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 12:31:07 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:31:07 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:31:07 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[9196afed-ca2c-4ebe-a88c-9ba7fd6381c7]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:31:07 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-4b161e12-3dd5-41e1-baee-e35f35d9c01e tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74960) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 12:31:07 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:31:07 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.037s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:31:07 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[c888272b-6256-4303-b2dc-097e630bbea8]: (4, ('1', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:31:07 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-4b161e12-3dd5-41e1-baee-e35f35d9c01e tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74960) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 12:31:07 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-4b161e12-3dd5-41e1-baee-e35f35d9c01e tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] SCSI volumes sde have been removed. {{(pid=74960) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 12:31:07 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b161e12-3dd5-41e1-baee-e35f35d9c01e tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f33bebd3-3cc8-4db5-b35e-5d58d4dfe93f')] {{(pid=74960) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 12:31:07 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f33bebd3-3cc8-4db5-b35e-5d58d4dfe93f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:31:07 user nova-compute[74960]: DEBUG nova.network.neutron [None req-2b6635dd-9cf7-4934-b518-97770075d6ee tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49] Updating instance_info_cache with network_info: [{"id": "78dc3436-7e47-4513-b5fa-0fd25ab1baf9", "address": "fa:16:3e:d5:a8:23", "network": {"id": "9c5fae09-5df5-45a3-b9cd-7ac3763ba878", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1736223258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5320673ee4f0422989a3708915375cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78dc3436-7e", "ovs_interfaceid": "78dc3436-7e47-4513-b5fa-0fd25ab1baf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:31:07 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f33bebd3-3cc8-4db5-b35e-5d58d4dfe93f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:31:07 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[dae9b3b4-470d-4091-b561-1bb964a69fa4]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:31:07 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b161e12-3dd5-41e1-baee-e35f35d9c01e tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:31:07 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f33bebd3-3cc8-4db5-b35e-5d58d4dfe93f -p 172.16.0.220:3260 --logout {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:31:07 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-2b6635dd-9cf7-4934-b518-97770075d6ee tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Releasing lock "refresh_cache-b1f7c162-c891-460a-8f98-3c7d6aeb6c49" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:31:07 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f33bebd3-3cc8-4db5-b35e-5d58d4dfe93f -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:31:07 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[e77c55e4-70be-48ea-a24d-e81c21831c02]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:f33bebd3-3cc8-4db5-b35e-5d58d4dfe93f, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:f33bebd3-3cc8-4db5-b35e-5d58d4dfe93f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:31:07 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b161e12-3dd5-41e1-baee-e35f35d9c01e tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:f33bebd3-3cc8-4db5-b35e-5d58d4dfe93f, portal: 172.16.0.220,3260]
Nov 03 12:31:07 user nova-compute[74960]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:f33bebd3-3cc8-4db5-b35e-5d58d4dfe93f, portal: 172.16.0.220,3260] successful.
Nov 03 12:31:07 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:31:07 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f33bebd3-3cc8-4db5-b35e-5d58d4dfe93f -p 172.16.0.220:3260 --op delete {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:31:07 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f33bebd3-3cc8-4db5-b35e-5d58d4dfe93f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:31:07 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd969b0a-0418-427f-a484-ecb0dca1f822]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:31:07 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b161e12-3dd5-41e1-baee-e35f35d9c01e tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:31:07 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-4b161e12-3dd5-41e1-baee-e35f35d9c01e tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:31:07 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b161e12-3dd5-41e1-baee-e35f35d9c01e tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] <== disconnect_volume: return (300ms) None {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:31:07 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b161e12-3dd5-41e1-baee-e35f35d9c01e tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] [instance: be38c803-d97c-4939-9852-e8db1c44bb65] Disconnected iSCSI Volume {{(pid=74960) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 12:31:07 user nova-compute[74960]: DEBUG os_brick.utils [None req-2b6635dd-9cf7-4934-b518-97770075d6ee tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:31:07 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:31:07 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:31:07 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b95982f-595b-42c3-874b-7e410be3750c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:75b8e219756\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:31:07 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:31:07 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:31:07 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[c735f582-be14-4a13-9a08-e07811ec7f75]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:31:07 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:31:07 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:31:07 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf9e3fdb-4e2b-444b-8254-71c521f185b4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:31:07 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[1241d2ff-5237-4823-bacd-0255cc467e30]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:31:07 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-2b6635dd-9cf7-4934-b518-97770075d6ee tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Running cmd (subprocess): nvme version {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:31:08 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-2b6635dd-9cf7-4934-b518-97770075d6ee tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] 'nvme version' failed. Not Retrying. {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 12:31:08 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2b6635dd-9cf7-4934-b518-97770075d6ee tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] nvme not present on system {{(pid=74960) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 12:31:08 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:31:08 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 12:31:08 user nova-compute[74960]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 12:31:08 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[223c8c24-2a50-4a2f-aca6-370eaa2f643e]: (4, '') {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:31:08 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-2b6635dd-9cf7-4934-b518-97770075d6ee tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74960) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 12:31:08 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-2b6635dd-9cf7-4934-b518-97770075d6ee tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74960) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 12:31:08 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-2b6635dd-9cf7-4934-b518-97770075d6ee tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] LIGHTOS: no hostnqn found. {{(pid=74960) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 12:31:08 user nova-compute[74960]: DEBUG os_brick.utils [None req-2b6635dd-9cf7-4934-b518-97770075d6ee tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:75b8e219756', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:31:08 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:31:08 user nova-compute[74960]: ERROR nova.volume.cinder [None req-2b6635dd-9cf7-4934-b518-97770075d6ee tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Update attachment failed for attachment e2b50a44-b795-4432-a60a-63b4c79d26d5. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-c102628b-906f-4e48-95bd-67b3eb766625) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-c102628b-906f-4e48-95bd-67b3eb766625)
Nov 03 12:31:08 user nova-compute[74960]: ERROR nova.compute.manager [None req-2b6635dd-9cf7-4934-b518-97770075d6ee tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49] Setting instance vm_state to ERROR: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-c102628b-906f-4e48-95bd-67b3eb766625)
Nov 03 12:31:08 user nova-compute[74960]: ERROR nova.compute.manager [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49] Traceback (most recent call last):
Nov 03 12:31:08 user nova-compute[74960]: ERROR nova.compute.manager [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49]   File "/opt/stack/nova/nova/compute/manager.py", line 10846, in _error_out_instance_on_exception
Nov 03 12:31:08 user nova-compute[74960]: ERROR nova.compute.manager [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49]     yield
Nov 03 12:31:08 user nova-compute[74960]: ERROR nova.compute.manager [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49]   File "/opt/stack/nova/nova/compute/manager.py", line 6378, in _finish_resize_helper
Nov 03 12:31:08 user nova-compute[74960]: ERROR nova.compute.manager [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49]     network_info = self._finish_resize(context, instance, migration,
Nov 03 12:31:08 user nova-compute[74960]: ERROR nova.compute.manager [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49]   File "/opt/stack/nova/nova/compute/manager.py", line 6282, in _finish_resize
Nov 03 12:31:08 user nova-compute[74960]: ERROR nova.compute.manager [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49]     self._update_volume_attachments(context, instance, bdms)
Nov 03 12:31:08 user nova-compute[74960]: ERROR nova.compute.manager [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49]   File "/opt/stack/nova/nova/compute/manager.py", line 6212, in _update_volume_attachments
Nov 03 12:31:08 user nova-compute[74960]: ERROR nova.compute.manager [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49]     self.volume_api.attachment_update(
Nov 03 12:31:08 user nova-compute[74960]: ERROR nova.compute.manager [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 03 12:31:08 user nova-compute[74960]: ERROR nova.compute.manager [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49]     res = method(self, ctx, *args, **kwargs)
Nov 03 12:31:08 user nova-compute[74960]: ERROR nova.compute.manager [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 03 12:31:08 user nova-compute[74960]: ERROR nova.compute.manager [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 03 12:31:08 user nova-compute[74960]: ERROR nova.compute.manager [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 03 12:31:08 user nova-compute[74960]: ERROR nova.compute.manager [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49]     with excutils.save_and_reraise_exception():
Nov 03 12:31:08 user nova-compute[74960]: ERROR nova.compute.manager [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 03 12:31:08 user nova-compute[74960]: ERROR nova.compute.manager [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49]     self.force_reraise()
Nov 03 12:31:08 user nova-compute[74960]: ERROR nova.compute.manager [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 03 12:31:08 user nova-compute[74960]: ERROR nova.compute.manager [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49]     raise self.value
Nov 03 12:31:08 user nova-compute[74960]: ERROR nova.compute.manager [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 03 12:31:08 user nova-compute[74960]: ERROR nova.compute.manager [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49]     context, '3.44', skip_version_check=True).attachments.update(
Nov 03 12:31:08 user nova-compute[74960]: ERROR nova.compute.manager [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 03 12:31:08 user nova-compute[74960]: ERROR nova.compute.manager [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49]     return method.func(obj, *args, **kwargs)
Nov 03 12:31:08 user nova-compute[74960]: ERROR nova.compute.manager [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 03 12:31:08 user nova-compute[74960]: ERROR nova.compute.manager [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49]     resp = self._update('/attachments/%s' % id, body)
Nov 03 12:31:08 user nova-compute[74960]: ERROR nova.compute.manager [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 03 12:31:08 user nova-compute[74960]: ERROR nova.compute.manager [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 03 12:31:08 user nova-compute[74960]: ERROR nova.compute.manager [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 03 12:31:08 user nova-compute[74960]: ERROR nova.compute.manager [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49]     return self._cs_request(url, 'PUT', **kwargs)
Nov 03 12:31:08 user nova-compute[74960]: ERROR nova.compute.manager [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 03 12:31:08 user nova-compute[74960]: ERROR nova.compute.manager [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49]     return self.request(url, method, **kwargs)
Nov 03 12:31:08 user nova-compute[74960]: ERROR nova.compute.manager [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 03 12:31:08 user nova-compute[74960]: ERROR nova.compute.manager [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49]     raise exceptions.from_response(resp, body)
Nov 03 12:31:08 user nova-compute[74960]: ERROR nova.compute.manager [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-c102628b-906f-4e48-95bd-67b3eb766625)
Nov 03 12:31:08 user nova-compute[74960]: ERROR nova.compute.manager [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49] 
Nov 03 12:31:08 user nova-compute[74960]: DEBUG nova.objects.instance [None req-4b161e12-3dd5-41e1-baee-e35f35d9c01e tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Lazy-loading 'flavor' on Instance uuid be38c803-d97c-4939-9852-e8db1c44bb65 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:31:08 user nova-compute[74960]: INFO nova.compute.manager [None req-2b6635dd-9cf7-4934-b518-97770075d6ee tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49] Deleting allocations for old flavor on source node user after finish_resize failure. You may be able to recover the instance by hard rebooting it.
Nov 03 12:31:09 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-4b161e12-3dd5-41e1-baee-e35f35d9c01e tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Lock "be38c803-d97c-4939-9852-e8db1c44bb65" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.572s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:31:09 user nova-compute[74960]: INFO nova.scheduler.client.report [None req-2b6635dd-9cf7-4934-b518-97770075d6ee tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Deleted allocation for migration 4e8b66c8-feb8-4c01-a89e-fd5c22b15658
Nov 03 12:31:09 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-2b6635dd-9cf7-4934-b518-97770075d6ee tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:31:09 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-2b6635dd-9cf7-4934-b518-97770075d6ee tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:31:09 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-2b6635dd-9cf7-4934-b518-97770075d6ee tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:31:09 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-2b6635dd-9cf7-4934-b518-97770075d6ee tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:31:09 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-2b6635dd-9cf7-4934-b518-97770075d6ee tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.287s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:31:09 user nova-compute[74960]: INFO nova.compute.manager [None req-2b6635dd-9cf7-4934-b518-97770075d6ee tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49] Successfully reverted task state from resize_finish on failure for instance.
Nov 03 12:31:09 user nova-compute[74960]: ERROR oslo_messaging.rpc.server [None req-2b6635dd-9cf7-4934-b518-97770075d6ee tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-c102628b-906f-4e48-95bd-67b3eb766625)
Nov 03 12:31:09 user nova-compute[74960]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 03 12:31:09 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 03 12:31:09 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 03 12:31:09 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 03 12:31:09 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 03 12:31:09 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 03 12:31:09 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 03 12:31:09 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 03 12:31:09 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 03 12:31:09 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 03 12:31:09 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 03 12:31:09 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 03 12:31:09 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 03 12:31:09 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 03 12:31:09 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 03 12:31:09 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 166, in decorated_function
Nov 03 12:31:09 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 03 12:31:09 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 03 12:31:09 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 03 12:31:09 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 03 12:31:09 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 03 12:31:09 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 157, in decorated_function
Nov 03 12:31:09 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 03 12:31:09 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Nov 03 12:31:09 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 03 12:31:09 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 145, in decorated_function
Nov 03 12:31:09 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 03 12:31:09 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Nov 03 12:31:09 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 03 12:31:09 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 03 12:31:09 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 03 12:31:09 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 03 12:31:09 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 03 12:31:09 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Nov 03 12:31:09 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 03 12:31:09 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 6348, in finish_resize
Nov 03 12:31:09 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 03 12:31:09 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 03 12:31:09 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 03 12:31:09 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 03 12:31:09 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 03 12:31:09 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 6345, in finish_resize
Nov 03 12:31:09 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     self._finish_resize_helper(context, disk_info, image, instance,
Nov 03 12:31:09 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 6378, in _finish_resize_helper
Nov 03 12:31:09 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     network_info = self._finish_resize(context, instance, migration,
Nov 03 12:31:09 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 6282, in _finish_resize
Nov 03 12:31:09 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     self._update_volume_attachments(context, instance, bdms)
Nov 03 12:31:09 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 6212, in _update_volume_attachments
Nov 03 12:31:09 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     self.volume_api.attachment_update(
Nov 03 12:31:09 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 03 12:31:09 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Nov 03 12:31:09 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 03 12:31:09 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 03 12:31:09 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 03 12:31:09 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 03 12:31:09 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 03 12:31:09 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 03 12:31:09 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 03 12:31:09 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 03 12:31:09 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 03 12:31:09 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Nov 03 12:31:09 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 03 12:31:09 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Nov 03 12:31:09 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 03 12:31:09 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Nov 03 12:31:09 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 03 12:31:09 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 03 12:31:09 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 03 12:31:09 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Nov 03 12:31:09 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 03 12:31:09 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Nov 03 12:31:09 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 03 12:31:09 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Nov 03 12:31:09 user nova-compute[74960]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-c102628b-906f-4e48-95bd-67b3eb766625)
Nov 03 12:31:09 user nova-compute[74960]: ERROR oslo_messaging.rpc.server 
Nov 03 12:31:10 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:31:13 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:31:15 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:31:18 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:31:20 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:31:20 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:31:21 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:31:24 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:31:25 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:31:30 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:31:30 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:31:31 user nova-compute[74960]: DEBUG nova.compute.manager [None req-62cc715e-be75-4682-8376-db88971339c1 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] Start spawning the instance on the hypervisor. {{(pid=74960) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 12:31:31 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-62cc715e-be75-4682-8376-db88971339c1 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] Creating instance directory {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 12:31:31 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-62cc715e-be75-4682-8376-db88971339c1 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] Creating image(s)
Nov 03 12:31:31 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-62cc715e-be75-4682-8376-db88971339c1 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] Did not create local disks {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 03 12:31:31 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-62cc715e-be75-4682-8376-db88971339c1 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] Ensure instance console log exists: /opt/stack/data/nova/instances/5dc6cb24-fe58-4e36-bd7f-a67a804a98e1/console.log {{(pid=74960) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 12:31:31 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-62cc715e-be75-4682-8376-db88971339c1 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:31:31 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-62cc715e-be75-4682-8376-db88971339c1 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:31:31 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-62cc715e-be75-4682-8376-db88971339c1 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:31:31 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-62cc715e-be75-4682-8376-db88971339c1 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] Start _get_guest_xml network_info=[{"id": "fe22f17b-b60c-465a-9079-e9c008004741", "address": "fa:16:3e:cd:e4:ff", "network": {"id": "a356b90b-cf10-4b3f-802a-aa2656c5588b", "bridge": "br-int", "label": "tempest-TestShelveInstance-1788680557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b44956ba8ca42f29fda6a18ef9fb198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe22f17b-b6", "ovs_interfaceid": "fe22f17b-b60c-465a-9079-e9c008004741", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sPdXleCb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5dc6cb24-fe58-4e36-bd7f-a67a804a98e1', 'attached_at': '', 'detached_at': '', 'volume_id': 'fa4cf8d2-7542-4bcf-840d-5ccc3401a797', 'serial': 'fa4cf8d2-7542-4bcf-840d-5ccc3401a797'}, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'device_type': 'disk', 'attachment_id': '81662349-55ee-4c47-b25a-182d1f64030d', 'boot_index': 0, 'guest_format': None, 'volume_type': None} {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 12:31:31 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-62cc715e-be75-4682-8376-db88971339c1 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:31:31 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-62cc715e-be75-4682-8376-db88971339c1 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:31:31 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-62cc715e-be75-4682-8376-db88971339c1 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 12:31:31 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-62cc715e-be75-4682-8376-db88971339c1 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] CPU controller missing on host. {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 12:31:31 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-62cc715e-be75-4682-8376-db88971339c1 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 12:31:31 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-62cc715e-be75-4682-8376-db88971339c1 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] CPU controller found on host. {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 12:31:31 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-62cc715e-be75-4682-8376-db88971339c1 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74960) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 12:31:31 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-62cc715e-be75-4682-8376-db88971339c1 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 12:31:31 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-62cc715e-be75-4682-8376-db88971339c1 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Flavor limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 12:31:31 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-62cc715e-be75-4682-8376-db88971339c1 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Image limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 12:31:31 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-62cc715e-be75-4682-8376-db88971339c1 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Flavor pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 12:31:31 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-62cc715e-be75-4682-8376-db88971339c1 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Image pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 12:31:31 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-62cc715e-be75-4682-8376-db88971339c1 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 12:31:31 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-62cc715e-be75-4682-8376-db88971339c1 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 12:31:31 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-62cc715e-be75-4682-8376-db88971339c1 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 12:31:31 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-62cc715e-be75-4682-8376-db88971339c1 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Got 1 possible topologies {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 12:31:31 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-62cc715e-be75-4682-8376-db88971339c1 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 12:31:31 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-62cc715e-be75-4682-8376-db88971339c1 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 12:31:31 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62cc715e-be75-4682-8376-db88971339c1 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] Calling os-brick to attach iSCSI Volume {{(pid=74960) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 12:31:31 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-62cc715e-be75-4682-8376-db88971339c1 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9aa420acb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sPdXleCb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:31:31 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-62cc715e-be75-4682-8376-db88971339c1 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:31:31 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-62cc715e-be75-4682-8376-db88971339c1 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:31:31 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-62cc715e-be75-4682-8376-db88971339c1 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:31:31 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-62cc715e-be75-4682-8376-db88971339c1 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:31:31 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-62cc715e-be75-4682-8376-db88971339c1 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:31:31 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-62cc715e-be75-4682-8376-db88971339c1 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:31:31 user nova-compute[74960]: INFO os_brick.initiator.connectors.iscsi [None req-62cc715e-be75-4682-8376-db88971339c1 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 12:31:31 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797 -p 172.16.0.220:3260 {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:31:31 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:31:31 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[11bbe38b-a0c0-4384-ad8b-1b7b408a557d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:31:31 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-62cc715e-be75-4682-8376-db88971339c1 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 12:31:31 user nova-compute[74960]:  {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:31:31 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797 -p 172.16.0.220:3260 --interface default --op new {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:31:31 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:31:31 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0004598-0f85-4b07-bbfb-7281634c85b8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797] added\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:31:31 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-62cc715e-be75-4682-8376-db88971339c1 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797] added
Nov 03 12:31:31 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:31:31 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:31:31 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:31:31 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8e7b349-e7c1-4875-971c-829244d8b276]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:31:31 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-62cc715e-be75-4682-8376-db88971339c1 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:31:31 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:31:31 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:31:31 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0874e2d-06db-41b2-b9c9-bbfbc294607d]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:31:31 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-62cc715e-be75-4682-8376-db88971339c1 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:31:31 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sPdXleCb {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:31:31 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sPdXleCb" returned: 0 in 0.024s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:31:31 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1fc4b7c-3831-463f-a5e4-14eaed04e0c6]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:31:31 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-62cc715e-be75-4682-8376-db88971339c1 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sPdXleCb'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:31:31 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:31:31 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:31:31 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[3215c59a-0267-4675-b68d-ea5729c19374]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:31:31 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-62cc715e-be75-4682-8376-db88971339c1 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:31:31 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:31:31 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:31:31 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec1bda31-3667-4c22-9c29-8e2d7e58960c]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:31:31 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-62cc715e-be75-4682-8376-db88971339c1 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:31:31 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:31:31 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-62cc715e-be75-4682-8376-db88971339c1 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:31:31 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:31:31 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797 -p 172.16.0.220:3260 --login {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:31:31 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:31:31 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[e38836a0-b534-4c6a-a9d5-d35e5574114f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:31:31 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-62cc715e-be75-4682-8376-db88971339c1 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797, portal: 172.16.0.220,3260]
Nov 03 12:31:31 user nova-compute[74960]: Login to [iface: default, target: iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797, portal: 172.16.0.220,3260] successful.
Nov 03 12:31:31 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:31:31 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:31:31 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:31:31 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[46e17ee8-a5a5-4633-9107-a9c552effd1d]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:31:31 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-62cc715e-be75-4682-8376-db88971339c1 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:31:31 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:31:31 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:31:31 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[49cafbd4-582c-4d64-90ff-192115db82c1]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797 (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:31:31 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-62cc715e-be75-4682-8376-db88971339c1 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:31:31 user nova-compute[74960]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797 (non-flash)
Nov 03 12:31:31 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:31:31 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-62cc715e-be75-4682-8376-db88971339c1 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:31:31 user nova-compute[74960]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797 (non-flash)
Nov 03 12:31:31 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:31:31 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-62cc715e-be75-4682-8376-db88971339c1 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:31:31 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-62cc715e-be75-4682-8376-db88971339c1 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Connected to 172.16.0.220:3260 {{(pid=74960) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 12:31:31 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-62cc715e-be75-4682-8376-db88971339c1 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] HCTL ('33', '-', '-', 0) found on session 22 with lun 0 {{(pid=74960) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 12:31:31 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-62cc715e-be75-4682-8376-db88971339c1 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74960) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 12:31:31 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:31:31 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:31:31 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb597e11-8728-4396-827c-e76ef6ececcd]: (4, ('- - 0', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:31:31 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-62cc715e-be75-4682-8376-db88971339c1 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Searching for a device in session 22 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74960) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 12:31:31 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-62cc715e-be75-4682-8376-db88971339c1 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sPdXleCb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74960) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 12:31:32 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-62cc715e-be75-4682-8376-db88971339c1 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:31:32 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-62cc715e-be75-4682-8376-db88971339c1 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] <== connect_volume: return (1333ms) {'type': 'block', 'scsi_wwn': '26331373239393364', 'path': '/dev/sdb'} {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:31:32 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62cc715e-be75-4682-8376-db88971339c1 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26331373239393364', 'path': '/dev/sdb'} {{(pid=74960) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 12:31:32 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-62cc715e-be75-4682-8376-db88971339c1 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:30:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1397605353',display_name='tempest-TestShelveInstance-server-1397605353',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1397605353',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHFekLWMbWYWoCQaCK9+hxX9ibPEk05TiHGhuFvRfX8RGTVqWkQB1RSDB+6j4GE33fwbvqMtRoW6yWncOnXHVCLVY/+dhav0Db70nMOqH3hrUcyPCb8MFc4JJJomwnEGlA==',key_name='tempest-TestShelveInstance-208551886',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3b44956ba8ca42f29fda6a18ef9fb198',ramdisk_id='',reservation_id='r-ait87mp2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1884052938',owner_user_name='tempest-TestShelveInstance-1884052938-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:30:53Z,user_data=None,user_id='0e7c95f83f104c0697236508cd538c3e',uuid=5dc6cb24-fe58-4e36-bd7f-a67a804a98e1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe22f17b-b60c-465a-9079-e9c008004741", "address": "fa:16:3e:cd:e4:ff", "network": {"id": "a356b90b-cf10-4b3f-802a-aa2656c5588b", "bridge": "br-int", "label": "tempest-TestShelveInstance-1788680557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b44956ba8ca42f29fda6a18ef9fb198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe22f17b-b6", "ovs_interfaceid": "fe22f17b-b60c-465a-9079-e9c008004741", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74960) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 12:31:32 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-62cc715e-be75-4682-8376-db88971339c1 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Converting VIF {"id": "fe22f17b-b60c-465a-9079-e9c008004741", "address": "fa:16:3e:cd:e4:ff", "network": {"id": "a356b90b-cf10-4b3f-802a-aa2656c5588b", "bridge": "br-int", "label": "tempest-TestShelveInstance-1788680557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b44956ba8ca42f29fda6a18ef9fb198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe22f17b-b6", "ovs_interfaceid": "fe22f17b-b60c-465a-9079-e9c008004741", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:31:32 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-62cc715e-be75-4682-8376-db88971339c1 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:e4:ff,bridge_name='br-int',has_traffic_filtering=True,id=fe22f17b-b60c-465a-9079-e9c008004741,network=Network(a356b90b-cf10-4b3f-802a-aa2656c5588b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe22f17b-b6') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:31:32 user nova-compute[74960]: DEBUG nova.objects.instance [None req-62cc715e-be75-4682-8376-db88971339c1 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Lazy-loading 'pci_devices' on Instance uuid 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:31:32 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-62cc715e-be75-4682-8376-db88971339c1 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] End _get_guest_xml xml=<domain type="kvm">
Nov 03 12:31:32 user nova-compute[74960]:   <uuid>5dc6cb24-fe58-4e36-bd7f-a67a804a98e1</uuid>
Nov 03 12:31:32 user nova-compute[74960]:   <name>instance-0000001d</name>
Nov 03 12:31:32 user nova-compute[74960]:   <memory>524288</memory>
Nov 03 12:31:32 user nova-compute[74960]:   <vcpu>1</vcpu>
Nov 03 12:31:32 user nova-compute[74960]:   <metadata>
Nov 03 12:31:32 user nova-compute[74960]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 12:31:32 user nova-compute[74960]:       <nova:package version="0.0.0"/>
Nov 03 12:31:32 user nova-compute[74960]:       <nova:name>tempest-TestShelveInstance-server-1397605353</nova:name>
Nov 03 12:31:32 user nova-compute[74960]:       <nova:creationTime>2023-11-03 12:31:31</nova:creationTime>
Nov 03 12:31:32 user nova-compute[74960]:       <nova:flavor name="m1.tiny">
Nov 03 12:31:32 user nova-compute[74960]:         <nova:memory>512</nova:memory>
Nov 03 12:31:32 user nova-compute[74960]:         <nova:disk>1</nova:disk>
Nov 03 12:31:32 user nova-compute[74960]:         <nova:swap>0</nova:swap>
Nov 03 12:31:32 user nova-compute[74960]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 12:31:32 user nova-compute[74960]:         <nova:vcpus>1</nova:vcpus>
Nov 03 12:31:32 user nova-compute[74960]:       </nova:flavor>
Nov 03 12:31:32 user nova-compute[74960]:       <nova:owner>
Nov 03 12:31:32 user nova-compute[74960]:         <nova:user uuid="0e7c95f83f104c0697236508cd538c3e">tempest-TestShelveInstance-1884052938-project-member</nova:user>
Nov 03 12:31:32 user nova-compute[74960]:         <nova:project uuid="3b44956ba8ca42f29fda6a18ef9fb198">tempest-TestShelveInstance-1884052938</nova:project>
Nov 03 12:31:32 user nova-compute[74960]:       </nova:owner>
Nov 03 12:31:32 user nova-compute[74960]:       <nova:ports>
Nov 03 12:31:32 user nova-compute[74960]:         <nova:port uuid="fe22f17b-b60c-465a-9079-e9c008004741">
Nov 03 12:31:32 user nova-compute[74960]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 03 12:31:32 user nova-compute[74960]:         </nova:port>
Nov 03 12:31:32 user nova-compute[74960]:       </nova:ports>
Nov 03 12:31:32 user nova-compute[74960]:     </nova:instance>
Nov 03 12:31:32 user nova-compute[74960]:   </metadata>
Nov 03 12:31:32 user nova-compute[74960]:   <sysinfo type="smbios">
Nov 03 12:31:32 user nova-compute[74960]:     <system>
Nov 03 12:31:32 user nova-compute[74960]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 12:31:32 user nova-compute[74960]:       <entry name="product">OpenStack Nova</entry>
Nov 03 12:31:32 user nova-compute[74960]:       <entry name="version">0.0.0</entry>
Nov 03 12:31:32 user nova-compute[74960]:       <entry name="serial">5dc6cb24-fe58-4e36-bd7f-a67a804a98e1</entry>
Nov 03 12:31:32 user nova-compute[74960]:       <entry name="uuid">5dc6cb24-fe58-4e36-bd7f-a67a804a98e1</entry>
Nov 03 12:31:32 user nova-compute[74960]:       <entry name="family">Virtual Machine</entry>
Nov 03 12:31:32 user nova-compute[74960]:     </system>
Nov 03 12:31:32 user nova-compute[74960]:   </sysinfo>
Nov 03 12:31:32 user nova-compute[74960]:   <os>
Nov 03 12:31:32 user nova-compute[74960]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 12:31:32 user nova-compute[74960]:     <boot dev="hd"/>
Nov 03 12:31:32 user nova-compute[74960]:     <smbios mode="sysinfo"/>
Nov 03 12:31:32 user nova-compute[74960]:   </os>
Nov 03 12:31:32 user nova-compute[74960]:   <features>
Nov 03 12:31:32 user nova-compute[74960]:     <acpi/>
Nov 03 12:31:32 user nova-compute[74960]:     <apic/>
Nov 03 12:31:32 user nova-compute[74960]:     <vmcoreinfo/>
Nov 03 12:31:32 user nova-compute[74960]:   </features>
Nov 03 12:31:32 user nova-compute[74960]:   <clock offset="utc">
Nov 03 12:31:32 user nova-compute[74960]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 12:31:32 user nova-compute[74960]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 12:31:32 user nova-compute[74960]:     <timer name="hpet" present="no"/>
Nov 03 12:31:32 user nova-compute[74960]:   </clock>
Nov 03 12:31:32 user nova-compute[74960]:   <cpu mode="custom" match="exact">
Nov 03 12:31:32 user nova-compute[74960]:     <model>Nehalem</model>
Nov 03 12:31:32 user nova-compute[74960]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 12:31:32 user nova-compute[74960]:   </cpu>
Nov 03 12:31:32 user nova-compute[74960]:   <devices>
Nov 03 12:31:32 user nova-compute[74960]:     <disk type="block" device="disk">
Nov 03 12:31:32 user nova-compute[74960]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 12:31:32 user nova-compute[74960]:       <source dev="/dev/sdb"/>
Nov 03 12:31:32 user nova-compute[74960]:       <target dev="vda" bus="virtio"/>
Nov 03 12:31:32 user nova-compute[74960]:       <serial>fa4cf8d2-7542-4bcf-840d-5ccc3401a797</serial>
Nov 03 12:31:32 user nova-compute[74960]:     </disk>
Nov 03 12:31:32 user nova-compute[74960]:     <interface type="ethernet">
Nov 03 12:31:32 user nova-compute[74960]:       <mac address="fa:16:3e:cd:e4:ff"/>
Nov 03 12:31:32 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:31:32 user nova-compute[74960]:       <mtu size="1442"/>
Nov 03 12:31:32 user nova-compute[74960]:       <target dev="tapfe22f17b-b6"/>
Nov 03 12:31:32 user nova-compute[74960]:     </interface>
Nov 03 12:31:32 user nova-compute[74960]:     <serial type="pty">
Nov 03 12:31:32 user nova-compute[74960]:       <log file="/opt/stack/data/nova/instances/5dc6cb24-fe58-4e36-bd7f-a67a804a98e1/console.log" append="off"/>
Nov 03 12:31:32 user nova-compute[74960]:     </serial>
Nov 03 12:31:32 user nova-compute[74960]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 12:31:32 user nova-compute[74960]:     <video>
Nov 03 12:31:32 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:31:32 user nova-compute[74960]:     </video>
Nov 03 12:31:32 user nova-compute[74960]:     <rng model="virtio">
Nov 03 12:31:32 user nova-compute[74960]:       <backend model="random">/dev/urandom</backend>
Nov 03 12:31:32 user nova-compute[74960]:     </rng>
Nov 03 12:31:32 user nova-compute[74960]:     <controller type="usb" index="0" model="none"/>
Nov 03 12:31:32 user nova-compute[74960]:     <memballoon model="virtio">
Nov 03 12:31:32 user nova-compute[74960]:       <stats period="10"/>
Nov 03 12:31:32 user nova-compute[74960]:     </memballoon>
Nov 03 12:31:32 user nova-compute[74960]:   </devices>
Nov 03 12:31:32 user nova-compute[74960]: </domain>
Nov 03 12:31:32 user nova-compute[74960]:  {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 12:31:32 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-62cc715e-be75-4682-8376-db88971339c1 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:30:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1397605353',display_name='tempest-TestShelveInstance-server-1397605353',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1397605353',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHFekLWMbWYWoCQaCK9+hxX9ibPEk05TiHGhuFvRfX8RGTVqWkQB1RSDB+6j4GE33fwbvqMtRoW6yWncOnXHVCLVY/+dhav0Db70nMOqH3hrUcyPCb8MFc4JJJomwnEGlA==',key_name='tempest-TestShelveInstance-208551886',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3b44956ba8ca42f29fda6a18ef9fb198',ramdisk_id='',reservation_id='r-ait87mp2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1884052938',owner_user_name='tempest-TestShelveInstance-1884052938-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:30:53Z,user_data=None,user_id='0e7c95f83f104c0697236508cd538c3e',uuid=5dc6cb24-fe58-4e36-bd7f-a67a804a98e1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe22f17b-b60c-465a-9079-e9c008004741", "address": "fa:16:3e:cd:e4:ff", "network": {"id": "a356b90b-cf10-4b3f-802a-aa2656c5588b", "bridge": "br-int", "label": "tempest-TestShelveInstance-1788680557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b44956ba8ca42f29fda6a18ef9fb198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe22f17b-b6", "ovs_interfaceid": "fe22f17b-b60c-465a-9079-e9c008004741", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 12:31:32 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-62cc715e-be75-4682-8376-db88971339c1 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Converting VIF {"id": "fe22f17b-b60c-465a-9079-e9c008004741", "address": "fa:16:3e:cd:e4:ff", "network": {"id": "a356b90b-cf10-4b3f-802a-aa2656c5588b", "bridge": "br-int", "label": "tempest-TestShelveInstance-1788680557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b44956ba8ca42f29fda6a18ef9fb198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe22f17b-b6", "ovs_interfaceid": "fe22f17b-b60c-465a-9079-e9c008004741", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:31:32 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-62cc715e-be75-4682-8376-db88971339c1 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:e4:ff,bridge_name='br-int',has_traffic_filtering=True,id=fe22f17b-b60c-465a-9079-e9c008004741,network=Network(a356b90b-cf10-4b3f-802a-aa2656c5588b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe22f17b-b6') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:31:32 user nova-compute[74960]: DEBUG os_vif [None req-62cc715e-be75-4682-8376-db88971339c1 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:e4:ff,bridge_name='br-int',has_traffic_filtering=True,id=fe22f17b-b60c-465a-9079-e9c008004741,network=Network(a356b90b-cf10-4b3f-802a-aa2656c5588b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe22f17b-b6') {{(pid=74960) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 12:31:32 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:31:32 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:31:32 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 12:31:32 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:31:32 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b061b02d-01dc-5c6f-8490-fcbc052be9b0', '_type': 'linux-noop'}}, row=False) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:31:32 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:31:32 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:31:32 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:31:32 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfe22f17b-b6, may_exist=True, interface_attrs={}) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:31:32 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfe22f17b-b6, col_values=(('qos', UUID('7e13a9c3-1832-4ff7-be07-d0ea52d369b7')),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:31:32 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfe22f17b-b6, col_values=(('external_ids', {'iface-id': 'fe22f17b-b60c-465a-9079-e9c008004741', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cd:e4:ff', 'vm-uuid': '5dc6cb24-fe58-4e36-bd7f-a67a804a98e1'}),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:31:32 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:31:32 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:31:32 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:31:32 user nova-compute[74960]: INFO os_vif [None req-62cc715e-be75-4682-8376-db88971339c1 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:e4:ff,bridge_name='br-int',has_traffic_filtering=True,id=fe22f17b-b60c-465a-9079-e9c008004741,network=Network(a356b90b-cf10-4b3f-802a-aa2656c5588b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe22f17b-b6')
Nov 03 12:31:32 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-62cc715e-be75-4682-8376-db88971339c1 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] No BDM found with device name vda, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:31:32 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-62cc715e-be75-4682-8376-db88971339c1 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] No VIF found with MAC fa:16:3e:cd:e4:ff, not building metadata {{(pid=74960) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 12:31:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:31:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:31:34 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:31:34 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:31:34 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:31:34 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:31:34 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:31:34 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:31:34 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:31:36 user nova-compute[74960]: DEBUG nova.compute.manager [None req-62cc715e-be75-4682-8376-db88971339c1 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] Instance event wait completed in 0 seconds for  {{(pid=74960) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 12:31:36 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-62cc715e-be75-4682-8376-db88971339c1 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] Guest created on hypervisor {{(pid=74960) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 12:31:36 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] Instance spawned successfully.
Nov 03 12:31:36 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-62cc715e-be75-4682-8376-db88971339c1 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 12:31:36 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-62cc715e-be75-4682-8376-db88971339c1 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] Found default for hw_cdrom_bus of ide {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:31:36 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-62cc715e-be75-4682-8376-db88971339c1 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] Found default for hw_disk_bus of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:31:36 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-62cc715e-be75-4682-8376-db88971339c1 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] Found default for hw_input_bus of None {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:31:36 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-62cc715e-be75-4682-8376-db88971339c1 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] Found default for hw_pointer_model of None {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:31:36 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-62cc715e-be75-4682-8376-db88971339c1 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] Found default for hw_video_model of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:31:36 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-62cc715e-be75-4682-8376-db88971339c1 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] Found default for hw_vif_model of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:31:36 user nova-compute[74960]: INFO nova.compute.manager [None req-62cc715e-be75-4682-8376-db88971339c1 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] Took 5.11 seconds to spawn the instance on the hypervisor.
Nov 03 12:31:36 user nova-compute[74960]: DEBUG nova.compute.manager [None req-62cc715e-be75-4682-8376-db88971339c1 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] Checking state {{(pid=74960) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 12:31:36 user nova-compute[74960]: INFO nova.compute.manager [None req-62cc715e-be75-4682-8376-db88971339c1 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] Took 44.81 seconds to build instance.
Nov 03 12:31:36 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-62cc715e-be75-4682-8376-db88971339c1 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Lock "5dc6cb24-fe58-4e36-bd7f-a67a804a98e1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 44.942s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:31:37 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:31:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:31:38 user nova-compute[74960]: DEBUG nova.compute.manager [req-0af62d6d-f088-4a72-83df-314cc4a06825 req-b00eaf59-a3ec-4100-b938-e9444a0df808 service nova] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] Received event network-vif-plugged-fe22f17b-b60c-465a-9079-e9c008004741 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:31:38 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-0af62d6d-f088-4a72-83df-314cc4a06825 req-b00eaf59-a3ec-4100-b938-e9444a0df808 service nova] Acquiring lock "5dc6cb24-fe58-4e36-bd7f-a67a804a98e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:31:38 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-0af62d6d-f088-4a72-83df-314cc4a06825 req-b00eaf59-a3ec-4100-b938-e9444a0df808 service nova] Lock "5dc6cb24-fe58-4e36-bd7f-a67a804a98e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:31:38 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-0af62d6d-f088-4a72-83df-314cc4a06825 req-b00eaf59-a3ec-4100-b938-e9444a0df808 service nova] Lock "5dc6cb24-fe58-4e36-bd7f-a67a804a98e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:31:38 user nova-compute[74960]: DEBUG nova.compute.manager [req-0af62d6d-f088-4a72-83df-314cc4a06825 req-b00eaf59-a3ec-4100-b938-e9444a0df808 service nova] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] No waiting events found dispatching network-vif-plugged-fe22f17b-b60c-465a-9079-e9c008004741 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:31:38 user nova-compute[74960]: WARNING nova.compute.manager [req-0af62d6d-f088-4a72-83df-314cc4a06825 req-b00eaf59-a3ec-4100-b938-e9444a0df808 service nova] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] Received unexpected event network-vif-plugged-fe22f17b-b60c-465a-9079-e9c008004741 for instance with vm_state active and task_state None.
Nov 03 12:31:39 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:31:39 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:31:40 user nova-compute[74960]: DEBUG nova.compute.manager [req-4efb9709-b56e-41ef-af04-4fad2e4ff097 req-1cf96791-cda9-4e3d-b230-4cda2651a90b service nova] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] Received event network-vif-plugged-fe22f17b-b60c-465a-9079-e9c008004741 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:31:40 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-4efb9709-b56e-41ef-af04-4fad2e4ff097 req-1cf96791-cda9-4e3d-b230-4cda2651a90b service nova] Acquiring lock "5dc6cb24-fe58-4e36-bd7f-a67a804a98e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:31:40 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-4efb9709-b56e-41ef-af04-4fad2e4ff097 req-1cf96791-cda9-4e3d-b230-4cda2651a90b service nova] Lock "5dc6cb24-fe58-4e36-bd7f-a67a804a98e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:31:40 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-4efb9709-b56e-41ef-af04-4fad2e4ff097 req-1cf96791-cda9-4e3d-b230-4cda2651a90b service nova] Lock "5dc6cb24-fe58-4e36-bd7f-a67a804a98e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:31:40 user nova-compute[74960]: DEBUG nova.compute.manager [req-4efb9709-b56e-41ef-af04-4fad2e4ff097 req-1cf96791-cda9-4e3d-b230-4cda2651a90b service nova] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] No waiting events found dispatching network-vif-plugged-fe22f17b-b60c-465a-9079-e9c008004741 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:31:40 user nova-compute[74960]: WARNING nova.compute.manager [req-4efb9709-b56e-41ef-af04-4fad2e4ff097 req-1cf96791-cda9-4e3d-b230-4cda2651a90b service nova] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] Received unexpected event network-vif-plugged-fe22f17b-b60c-465a-9079-e9c008004741 for instance with vm_state active and task_state None.
Nov 03 12:31:42 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:31:43 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:31:43 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:31:43 user nova-compute[74960]: INFO nova.compute.manager [None req-c6d59363-dc8c-4f54-875e-3312a26a8b51 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] Unrescuing
Nov 03 12:31:43 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c6d59363-dc8c-4f54-875e-3312a26a8b51 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Acquiring lock "refresh_cache-a6199681-f85e-4f55-966b-6ab3f17cd640" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:31:43 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c6d59363-dc8c-4f54-875e-3312a26a8b51 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Acquired lock "refresh_cache-a6199681-f85e-4f55-966b-6ab3f17cd640" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:31:43 user nova-compute[74960]: DEBUG nova.network.neutron [None req-c6d59363-dc8c-4f54-875e-3312a26a8b51 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] Building network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 12:31:44 user nova-compute[74960]: DEBUG nova.network.neutron [None req-c6d59363-dc8c-4f54-875e-3312a26a8b51 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] Updating instance_info_cache with network_info: [{"id": "40976ae5-5f49-4d8e-abd7-04dc0ce8f319", "address": "fa:16:3e:7c:40:1d", "network": {"id": "dec66832-56d5-4d68-b11f-8e8eed38f045", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-79099436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc95d68d5e147e1953c855169b17091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40976ae5-5f", "ovs_interfaceid": "40976ae5-5f49-4d8e-abd7-04dc0ce8f319", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:31:44 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c6d59363-dc8c-4f54-875e-3312a26a8b51 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Releasing lock "refresh_cache-a6199681-f85e-4f55-966b-6ab3f17cd640" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:31:44 user nova-compute[74960]: DEBUG nova.objects.instance [None req-c6d59363-dc8c-4f54-875e-3312a26a8b51 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Lazy-loading 'flavor' on Instance uuid a6199681-f85e-4f55-966b-6ab3f17cd640 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:31:45 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:31:45 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:31:45 user nova-compute[74960]: DEBUG nova.compute.manager [req-929d44e4-3759-4c1f-809c-66d09b0c7f66 req-27f87eed-a396-48d9-aeb3-7c98e0adbe2f service nova] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] Received event network-vif-unplugged-40976ae5-5f49-4d8e-abd7-04dc0ce8f319 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:31:45 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-929d44e4-3759-4c1f-809c-66d09b0c7f66 req-27f87eed-a396-48d9-aeb3-7c98e0adbe2f service nova] Acquiring lock "a6199681-f85e-4f55-966b-6ab3f17cd640-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:31:45 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-929d44e4-3759-4c1f-809c-66d09b0c7f66 req-27f87eed-a396-48d9-aeb3-7c98e0adbe2f service nova] Lock "a6199681-f85e-4f55-966b-6ab3f17cd640-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:31:45 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-929d44e4-3759-4c1f-809c-66d09b0c7f66 req-27f87eed-a396-48d9-aeb3-7c98e0adbe2f service nova] Lock "a6199681-f85e-4f55-966b-6ab3f17cd640-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:31:45 user nova-compute[74960]: DEBUG nova.compute.manager [req-929d44e4-3759-4c1f-809c-66d09b0c7f66 req-27f87eed-a396-48d9-aeb3-7c98e0adbe2f service nova] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] No waiting events found dispatching network-vif-unplugged-40976ae5-5f49-4d8e-abd7-04dc0ce8f319 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:31:45 user nova-compute[74960]: WARNING nova.compute.manager [req-929d44e4-3759-4c1f-809c-66d09b0c7f66 req-27f87eed-a396-48d9-aeb3-7c98e0adbe2f service nova] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] Received unexpected event network-vif-unplugged-40976ae5-5f49-4d8e-abd7-04dc0ce8f319 for instance with vm_state rescued and task_state unrescuing.
Nov 03 12:31:45 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:31:45 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:31:45 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] Instance destroyed successfully.
Nov 03 12:31:47 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-67940e2c-a90a-414f-81dc-e65803b2444b tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Acquiring lock "208570e4-1b11-486b-a79e-4b4eafc26af2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:31:47 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-67940e2c-a90a-414f-81dc-e65803b2444b tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Lock "208570e4-1b11-486b-a79e-4b4eafc26af2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:31:47 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-67940e2c-a90a-414f-81dc-e65803b2444b tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Acquiring lock "208570e4-1b11-486b-a79e-4b4eafc26af2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:31:47 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-67940e2c-a90a-414f-81dc-e65803b2444b tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Lock "208570e4-1b11-486b-a79e-4b4eafc26af2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:31:47 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-67940e2c-a90a-414f-81dc-e65803b2444b tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Lock "208570e4-1b11-486b-a79e-4b4eafc26af2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:31:47 user nova-compute[74960]: INFO nova.compute.manager [None req-67940e2c-a90a-414f-81dc-e65803b2444b tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] [instance: 208570e4-1b11-486b-a79e-4b4eafc26af2] Terminating instance
Nov 03 12:31:47 user nova-compute[74960]: DEBUG nova.compute.manager [None req-67940e2c-a90a-414f-81dc-e65803b2444b tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] [instance: 208570e4-1b11-486b-a79e-4b4eafc26af2] Start destroying the instance on the hypervisor. {{(pid=74960) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 12:31:47 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:31:47 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:31:47 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:31:47 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:31:47 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:31:47 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:31:47 user nova-compute[74960]: DEBUG nova.compute.manager [req-3d317116-d5df-40e0-bf9f-39743b54ecab req-e3c95dc9-17b9-4811-b912-fa4d0aa4c1ed service nova] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] Received event network-vif-plugged-40976ae5-5f49-4d8e-abd7-04dc0ce8f319 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:31:47 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-3d317116-d5df-40e0-bf9f-39743b54ecab req-e3c95dc9-17b9-4811-b912-fa4d0aa4c1ed service nova] Acquiring lock "a6199681-f85e-4f55-966b-6ab3f17cd640-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:31:47 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-3d317116-d5df-40e0-bf9f-39743b54ecab req-e3c95dc9-17b9-4811-b912-fa4d0aa4c1ed service nova] Lock "a6199681-f85e-4f55-966b-6ab3f17cd640-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:31:47 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-3d317116-d5df-40e0-bf9f-39743b54ecab req-e3c95dc9-17b9-4811-b912-fa4d0aa4c1ed service nova] Lock "a6199681-f85e-4f55-966b-6ab3f17cd640-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:31:47 user nova-compute[74960]: DEBUG nova.compute.manager [req-3d317116-d5df-40e0-bf9f-39743b54ecab req-e3c95dc9-17b9-4811-b912-fa4d0aa4c1ed service nova] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] No waiting events found dispatching network-vif-plugged-40976ae5-5f49-4d8e-abd7-04dc0ce8f319 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:31:47 user nova-compute[74960]: WARNING nova.compute.manager [req-3d317116-d5df-40e0-bf9f-39743b54ecab req-e3c95dc9-17b9-4811-b912-fa4d0aa4c1ed service nova] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] Received unexpected event network-vif-plugged-40976ae5-5f49-4d8e-abd7-04dc0ce8f319 for instance with vm_state rescued and task_state unrescuing.
Nov 03 12:31:47 user nova-compute[74960]: DEBUG nova.compute.manager [req-3d317116-d5df-40e0-bf9f-39743b54ecab req-e3c95dc9-17b9-4811-b912-fa4d0aa4c1ed service nova] [instance: 208570e4-1b11-486b-a79e-4b4eafc26af2] Received event network-vif-unplugged-ab5d31db-7218-4c01-ba8f-0420e61f4583 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:31:47 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-3d317116-d5df-40e0-bf9f-39743b54ecab req-e3c95dc9-17b9-4811-b912-fa4d0aa4c1ed service nova] Acquiring lock "208570e4-1b11-486b-a79e-4b4eafc26af2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:31:47 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-3d317116-d5df-40e0-bf9f-39743b54ecab req-e3c95dc9-17b9-4811-b912-fa4d0aa4c1ed service nova] Lock "208570e4-1b11-486b-a79e-4b4eafc26af2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:31:47 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-3d317116-d5df-40e0-bf9f-39743b54ecab req-e3c95dc9-17b9-4811-b912-fa4d0aa4c1ed service nova] Lock "208570e4-1b11-486b-a79e-4b4eafc26af2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:31:47 user nova-compute[74960]: DEBUG nova.compute.manager [req-3d317116-d5df-40e0-bf9f-39743b54ecab req-e3c95dc9-17b9-4811-b912-fa4d0aa4c1ed service nova] [instance: 208570e4-1b11-486b-a79e-4b4eafc26af2] No waiting events found dispatching network-vif-unplugged-ab5d31db-7218-4c01-ba8f-0420e61f4583 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:31:47 user nova-compute[74960]: DEBUG nova.compute.manager [req-3d317116-d5df-40e0-bf9f-39743b54ecab req-e3c95dc9-17b9-4811-b912-fa4d0aa4c1ed service nova] [instance: 208570e4-1b11-486b-a79e-4b4eafc26af2] Received event network-vif-unplugged-ab5d31db-7218-4c01-ba8f-0420e61f4583 for instance with task_state deleting. {{(pid=74960) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 12:31:47 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:31:47 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:31:47 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:31:47 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:31:47 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:31:47 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:31:47 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:31:47 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:31:47 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:31:47 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:31:48 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: 208570e4-1b11-486b-a79e-4b4eafc26af2] Instance destroyed successfully.
Nov 03 12:31:48 user nova-compute[74960]: DEBUG nova.objects.instance [None req-67940e2c-a90a-414f-81dc-e65803b2444b tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Lazy-loading 'resources' on Instance uuid 208570e4-1b11-486b-a79e-4b4eafc26af2 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:31:48 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-67940e2c-a90a-414f-81dc-e65803b2444b tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:29:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1686777373',display_name='tempest-VolumesActionsTest-instance-1686777373',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1686777373',id=27,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-03T12:30:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f91dff8e248b4ca2bedc8631fcaf06f3',ramdisk_id='',reservation_id='r-rpwz9n0t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1450410058',owner_user_name='tempest-VolumesActionsTest-1450410058-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T12:30:04Z,user_data=None,user_id='b10ff362bd8641e184623b5506ec875e',uuid=208570e4-1b11-486b-a79e-4b4eafc26af2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ab5d31db-7218-4c01-ba8f-0420e61f4583", "address": "fa:16:3e:76:6d:bb", "network": {"id": "78afe6eb-a6db-4f0c-a135-32b7775b5e2a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1883110422-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f91dff8e248b4ca2bedc8631fcaf06f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab5d31db-72", "ovs_interfaceid": "ab5d31db-7218-4c01-ba8f-0420e61f4583", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 12:31:48 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-67940e2c-a90a-414f-81dc-e65803b2444b tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Converting VIF {"id": "ab5d31db-7218-4c01-ba8f-0420e61f4583", "address": "fa:16:3e:76:6d:bb", "network": {"id": "78afe6eb-a6db-4f0c-a135-32b7775b5e2a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1883110422-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f91dff8e248b4ca2bedc8631fcaf06f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab5d31db-72", "ovs_interfaceid": "ab5d31db-7218-4c01-ba8f-0420e61f4583", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:31:48 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-67940e2c-a90a-414f-81dc-e65803b2444b tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:6d:bb,bridge_name='br-int',has_traffic_filtering=True,id=ab5d31db-7218-4c01-ba8f-0420e61f4583,network=Network(78afe6eb-a6db-4f0c-a135-32b7775b5e2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab5d31db-72') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:31:48 user nova-compute[74960]: DEBUG os_vif [None req-67940e2c-a90a-414f-81dc-e65803b2444b tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:6d:bb,bridge_name='br-int',has_traffic_filtering=True,id=ab5d31db-7218-4c01-ba8f-0420e61f4583,network=Network(78afe6eb-a6db-4f0c-a135-32b7775b5e2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab5d31db-72') {{(pid=74960) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 12:31:48 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:31:48 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapab5d31db-72, bridge=br-int, if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:31:48 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:31:48 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:31:48 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:31:48 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a4c067e1-2820-4968-b222-54553e3eadf5) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:31:48 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:31:48 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:31:48 user nova-compute[74960]: INFO os_vif [None req-67940e2c-a90a-414f-81dc-e65803b2444b tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:6d:bb,bridge_name='br-int',has_traffic_filtering=True,id=ab5d31db-7218-4c01-ba8f-0420e61f4583,network=Network(78afe6eb-a6db-4f0c-a135-32b7775b5e2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab5d31db-72')
Nov 03 12:31:48 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-67940e2c-a90a-414f-81dc-e65803b2444b tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] [instance: 208570e4-1b11-486b-a79e-4b4eafc26af2] Deleting instance files /opt/stack/data/nova/instances/208570e4-1b11-486b-a79e-4b4eafc26af2_del
Nov 03 12:31:48 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-67940e2c-a90a-414f-81dc-e65803b2444b tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] [instance: 208570e4-1b11-486b-a79e-4b4eafc26af2] Deletion of /opt/stack/data/nova/instances/208570e4-1b11-486b-a79e-4b4eafc26af2_del complete
Nov 03 12:31:48 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:31:48 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Starting heal instance info cache {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 12:31:48 user nova-compute[74960]: INFO nova.compute.manager [None req-67940e2c-a90a-414f-81dc-e65803b2444b tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] [instance: 208570e4-1b11-486b-a79e-4b4eafc26af2] Took 1.43 seconds to destroy the instance on the hypervisor.
Nov 03 12:31:48 user nova-compute[74960]: DEBUG oslo.service.loopingcall [None req-67940e2c-a90a-414f-81dc-e65803b2444b tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74960) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 12:31:48 user nova-compute[74960]: DEBUG nova.compute.manager [-] [instance: 208570e4-1b11-486b-a79e-4b4eafc26af2] Deallocating network for instance {{(pid=74960) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 12:31:48 user nova-compute[74960]: DEBUG nova.network.neutron [-] [instance: 208570e4-1b11-486b-a79e-4b4eafc26af2] deallocate_for_instance() {{(pid=74960) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 12:31:48 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:31:48 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:31:48 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:31:48 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:31:48 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "refresh_cache-87f15f5f-8afa-4d7b-bb45-5887184f9ee5" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:31:48 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquired lock "refresh_cache-87f15f5f-8afa-4d7b-bb45-5887184f9ee5" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:31:48 user nova-compute[74960]: DEBUG nova.network.neutron [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: 87f15f5f-8afa-4d7b-bb45-5887184f9ee5] Forcefully refreshing network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 12:31:48 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c996dee0-3982-473e-aff0-ae3e52068a4a tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Acquiring lock "be38c803-d97c-4939-9852-e8db1c44bb65" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:31:48 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c996dee0-3982-473e-aff0-ae3e52068a4a tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Lock "be38c803-d97c-4939-9852-e8db1c44bb65" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:31:48 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c996dee0-3982-473e-aff0-ae3e52068a4a tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Acquiring lock "be38c803-d97c-4939-9852-e8db1c44bb65-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:31:48 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c996dee0-3982-473e-aff0-ae3e52068a4a tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Lock "be38c803-d97c-4939-9852-e8db1c44bb65-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:31:48 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c996dee0-3982-473e-aff0-ae3e52068a4a tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Lock "be38c803-d97c-4939-9852-e8db1c44bb65-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:31:48 user nova-compute[74960]: INFO nova.compute.manager [None req-c996dee0-3982-473e-aff0-ae3e52068a4a tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] [instance: be38c803-d97c-4939-9852-e8db1c44bb65] Terminating instance
Nov 03 12:31:48 user nova-compute[74960]: DEBUG nova.compute.manager [None req-c996dee0-3982-473e-aff0-ae3e52068a4a tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] [instance: be38c803-d97c-4939-9852-e8db1c44bb65] Start destroying the instance on the hypervisor. {{(pid=74960) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 12:31:49 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:31:49 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:31:49 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:31:49 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:31:49 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:31:49 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:31:49 user nova-compute[74960]: DEBUG nova.compute.manager [req-c24e0079-6d4e-43ab-9a0b-19201370042f req-dcc1169a-e9b7-4b09-8890-bf233a412461 service nova] [instance: 208570e4-1b11-486b-a79e-4b4eafc26af2] Received event network-vif-plugged-ab5d31db-7218-4c01-ba8f-0420e61f4583 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:31:49 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-c24e0079-6d4e-43ab-9a0b-19201370042f req-dcc1169a-e9b7-4b09-8890-bf233a412461 service nova] Acquiring lock "208570e4-1b11-486b-a79e-4b4eafc26af2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:31:49 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-c24e0079-6d4e-43ab-9a0b-19201370042f req-dcc1169a-e9b7-4b09-8890-bf233a412461 service nova] Lock "208570e4-1b11-486b-a79e-4b4eafc26af2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:31:49 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-c24e0079-6d4e-43ab-9a0b-19201370042f req-dcc1169a-e9b7-4b09-8890-bf233a412461 service nova] Lock "208570e4-1b11-486b-a79e-4b4eafc26af2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:31:49 user nova-compute[74960]: DEBUG nova.compute.manager [req-c24e0079-6d4e-43ab-9a0b-19201370042f req-dcc1169a-e9b7-4b09-8890-bf233a412461 service nova] [instance: 208570e4-1b11-486b-a79e-4b4eafc26af2] No waiting events found dispatching network-vif-plugged-ab5d31db-7218-4c01-ba8f-0420e61f4583 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:31:49 user nova-compute[74960]: WARNING nova.compute.manager [req-c24e0079-6d4e-43ab-9a0b-19201370042f req-dcc1169a-e9b7-4b09-8890-bf233a412461 service nova] [instance: 208570e4-1b11-486b-a79e-4b4eafc26af2] Received unexpected event network-vif-plugged-ab5d31db-7218-4c01-ba8f-0420e61f4583 for instance with vm_state active and task_state deleting.
Nov 03 12:31:49 user nova-compute[74960]: DEBUG nova.compute.manager [req-c24e0079-6d4e-43ab-9a0b-19201370042f req-dcc1169a-e9b7-4b09-8890-bf233a412461 service nova] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] Received event network-vif-plugged-40976ae5-5f49-4d8e-abd7-04dc0ce8f319 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:31:49 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-c24e0079-6d4e-43ab-9a0b-19201370042f req-dcc1169a-e9b7-4b09-8890-bf233a412461 service nova] Acquiring lock "a6199681-f85e-4f55-966b-6ab3f17cd640-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:31:49 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-c24e0079-6d4e-43ab-9a0b-19201370042f req-dcc1169a-e9b7-4b09-8890-bf233a412461 service nova] Lock "a6199681-f85e-4f55-966b-6ab3f17cd640-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:31:49 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-c24e0079-6d4e-43ab-9a0b-19201370042f req-dcc1169a-e9b7-4b09-8890-bf233a412461 service nova] Lock "a6199681-f85e-4f55-966b-6ab3f17cd640-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:31:49 user nova-compute[74960]: DEBUG nova.compute.manager [req-c24e0079-6d4e-43ab-9a0b-19201370042f req-dcc1169a-e9b7-4b09-8890-bf233a412461 service nova] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] No waiting events found dispatching network-vif-plugged-40976ae5-5f49-4d8e-abd7-04dc0ce8f319 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:31:49 user nova-compute[74960]: WARNING nova.compute.manager [req-c24e0079-6d4e-43ab-9a0b-19201370042f req-dcc1169a-e9b7-4b09-8890-bf233a412461 service nova] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] Received unexpected event network-vif-plugged-40976ae5-5f49-4d8e-abd7-04dc0ce8f319 for instance with vm_state rescued and task_state unrescuing.
Nov 03 12:31:49 user nova-compute[74960]: DEBUG nova.compute.manager [req-c24e0079-6d4e-43ab-9a0b-19201370042f req-dcc1169a-e9b7-4b09-8890-bf233a412461 service nova] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] Received event network-vif-plugged-40976ae5-5f49-4d8e-abd7-04dc0ce8f319 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:31:49 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-c24e0079-6d4e-43ab-9a0b-19201370042f req-dcc1169a-e9b7-4b09-8890-bf233a412461 service nova] Acquiring lock "a6199681-f85e-4f55-966b-6ab3f17cd640-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:31:49 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-c24e0079-6d4e-43ab-9a0b-19201370042f req-dcc1169a-e9b7-4b09-8890-bf233a412461 service nova] Lock "a6199681-f85e-4f55-966b-6ab3f17cd640-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:31:49 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-c24e0079-6d4e-43ab-9a0b-19201370042f req-dcc1169a-e9b7-4b09-8890-bf233a412461 service nova] Lock "a6199681-f85e-4f55-966b-6ab3f17cd640-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:31:49 user nova-compute[74960]: DEBUG nova.compute.manager [req-c24e0079-6d4e-43ab-9a0b-19201370042f req-dcc1169a-e9b7-4b09-8890-bf233a412461 service nova] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] No waiting events found dispatching network-vif-plugged-40976ae5-5f49-4d8e-abd7-04dc0ce8f319 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:31:49 user nova-compute[74960]: WARNING nova.compute.manager [req-c24e0079-6d4e-43ab-9a0b-19201370042f req-dcc1169a-e9b7-4b09-8890-bf233a412461 service nova] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] Received unexpected event network-vif-plugged-40976ae5-5f49-4d8e-abd7-04dc0ce8f319 for instance with vm_state rescued and task_state unrescuing.
Nov 03 12:31:49 user nova-compute[74960]: DEBUG nova.compute.manager [req-83c5b106-a46d-45c6-93ea-e88156de4542 req-6a12b867-52fd-4b43-95e3-01668f278d23 service nova] [instance: be38c803-d97c-4939-9852-e8db1c44bb65] Received event network-vif-unplugged-b70bcefe-a1cc-4f5c-98f6-3d6914d66a9b {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:31:49 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-83c5b106-a46d-45c6-93ea-e88156de4542 req-6a12b867-52fd-4b43-95e3-01668f278d23 service nova] Acquiring lock "be38c803-d97c-4939-9852-e8db1c44bb65-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:31:49 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-83c5b106-a46d-45c6-93ea-e88156de4542 req-6a12b867-52fd-4b43-95e3-01668f278d23 service nova] Lock "be38c803-d97c-4939-9852-e8db1c44bb65-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:31:49 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-83c5b106-a46d-45c6-93ea-e88156de4542 req-6a12b867-52fd-4b43-95e3-01668f278d23 service nova] Lock "be38c803-d97c-4939-9852-e8db1c44bb65-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:31:49 user nova-compute[74960]: DEBUG nova.compute.manager [req-83c5b106-a46d-45c6-93ea-e88156de4542 req-6a12b867-52fd-4b43-95e3-01668f278d23 service nova] [instance: be38c803-d97c-4939-9852-e8db1c44bb65] No waiting events found dispatching network-vif-unplugged-b70bcefe-a1cc-4f5c-98f6-3d6914d66a9b {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:31:49 user nova-compute[74960]: DEBUG nova.compute.manager [req-83c5b106-a46d-45c6-93ea-e88156de4542 req-6a12b867-52fd-4b43-95e3-01668f278d23 service nova] [instance: be38c803-d97c-4939-9852-e8db1c44bb65] Received event network-vif-unplugged-b70bcefe-a1cc-4f5c-98f6-3d6914d66a9b for instance with task_state deleting. {{(pid=74960) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 12:31:49 user nova-compute[74960]: DEBUG nova.network.neutron [-] [instance: 208570e4-1b11-486b-a79e-4b4eafc26af2] Updating instance_info_cache with network_info: [] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:31:49 user nova-compute[74960]: INFO nova.compute.manager [-] [instance: 208570e4-1b11-486b-a79e-4b4eafc26af2] Took 1.26 seconds to deallocate network for instance.
Nov 03 12:31:49 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: be38c803-d97c-4939-9852-e8db1c44bb65] Instance destroyed successfully.
Nov 03 12:31:49 user nova-compute[74960]: DEBUG nova.objects.instance [None req-c996dee0-3982-473e-aff0-ae3e52068a4a tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Lazy-loading 'resources' on Instance uuid be38c803-d97c-4939-9852-e8db1c44bb65 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:31:49 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-c996dee0-3982-473e-aff0-ae3e52068a4a tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:26:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1085803212',display_name='tempest-TestMinimumBasicScenario-server-1085803212',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1085803212',id=22,image_ref='fb9c8513-58b6-4564-a720-c65a023a5977',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJyvc843+/PbK161410wXm+upnPhpb+kaHvjFoC5mB+vplUJNwSiHz6MEOZaIfZMr/BVqOZF9VNBe4y4XXUpwhvUlOjeq2DLlkq8xy5NZbFAMIKTFs1bBhh11b2OsO2jjQ==',key_name='tempest-TestMinimumBasicScenario-859556410',keypairs=<?>,launch_index=0,launched_at=2023-11-03T12:26:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9d4a374c1c544718887bd75b77a72a3a',ramdisk_id='',reservation_id='r-vhqahztr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fb9c8513-58b6-4564-a720-c65a023a5977',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-585836766',owner_user_name='tempest-TestMinimumBasicScenario-585836766-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T12:29:00Z,user_data=None,user_id='1c9880db5b784aadaeba7492523df5e8',uuid=be38c803-d97c-4939-9852-e8db1c44bb65,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b70bcefe-a1cc-4f5c-98f6-3d6914d66a9b", "address": "fa:16:3e:3f:59:21", "network": {"id": "b3813163-d09b-4c0b-a328-1bbb4c7e2875", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1681555035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d4a374c1c544718887bd75b77a72a3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb70bcefe-a1", "ovs_interfaceid": "b70bcefe-a1cc-4f5c-98f6-3d6914d66a9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 12:31:49 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-c996dee0-3982-473e-aff0-ae3e52068a4a tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Converting VIF {"id": "b70bcefe-a1cc-4f5c-98f6-3d6914d66a9b", "address": "fa:16:3e:3f:59:21", "network": {"id": "b3813163-d09b-4c0b-a328-1bbb4c7e2875", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1681555035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d4a374c1c544718887bd75b77a72a3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb70bcefe-a1", "ovs_interfaceid": "b70bcefe-a1cc-4f5c-98f6-3d6914d66a9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:31:49 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-c996dee0-3982-473e-aff0-ae3e52068a4a tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3f:59:21,bridge_name='br-int',has_traffic_filtering=True,id=b70bcefe-a1cc-4f5c-98f6-3d6914d66a9b,network=Network(b3813163-d09b-4c0b-a328-1bbb4c7e2875),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb70bcefe-a1') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:31:49 user nova-compute[74960]: DEBUG os_vif [None req-c996dee0-3982-473e-aff0-ae3e52068a4a tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3f:59:21,bridge_name='br-int',has_traffic_filtering=True,id=b70bcefe-a1cc-4f5c-98f6-3d6914d66a9b,network=Network(b3813163-d09b-4c0b-a328-1bbb4c7e2875),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb70bcefe-a1') {{(pid=74960) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 12:31:49 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:31:49 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb70bcefe-a1, bridge=br-int, if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:31:49 user nova-compute[74960]: DEBUG nova.network.neutron [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: 87f15f5f-8afa-4d7b-bb45-5887184f9ee5] Updating instance_info_cache with network_info: [{"id": "4a12f8bf-1920-4e7a-afec-9b716b73ff63", "address": "fa:16:3e:be:f4:7d", "network": {"id": "dec66832-56d5-4d68-b11f-8e8eed38f045", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-79099436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc95d68d5e147e1953c855169b17091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a12f8bf-19", "ovs_interfaceid": "4a12f8bf-1920-4e7a-afec-9b716b73ff63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:31:49 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:31:49 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:31:49 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:31:49 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=01afa5ea-65d9-4296-ac6f-f499fff2d990) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:31:49 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:31:49 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-67940e2c-a90a-414f-81dc-e65803b2444b tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:31:49 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-67940e2c-a90a-414f-81dc-e65803b2444b tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:31:49 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:31:49 user nova-compute[74960]: INFO os_vif [None req-c996dee0-3982-473e-aff0-ae3e52068a4a tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3f:59:21,bridge_name='br-int',has_traffic_filtering=True,id=b70bcefe-a1cc-4f5c-98f6-3d6914d66a9b,network=Network(b3813163-d09b-4c0b-a328-1bbb4c7e2875),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb70bcefe-a1')
Nov 03 12:31:49 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-c996dee0-3982-473e-aff0-ae3e52068a4a tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] [instance: be38c803-d97c-4939-9852-e8db1c44bb65] Deleting instance files /opt/stack/data/nova/instances/be38c803-d97c-4939-9852-e8db1c44bb65_del
Nov 03 12:31:49 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-c996dee0-3982-473e-aff0-ae3e52068a4a tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] [instance: be38c803-d97c-4939-9852-e8db1c44bb65] Deletion of /opt/stack/data/nova/instances/be38c803-d97c-4939-9852-e8db1c44bb65_del complete
Nov 03 12:31:49 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Releasing lock "refresh_cache-87f15f5f-8afa-4d7b-bb45-5887184f9ee5" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:31:49 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: 87f15f5f-8afa-4d7b-bb45-5887184f9ee5] Updated the network info_cache for instance {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 12:31:49 user nova-compute[74960]: INFO nova.compute.manager [None req-c996dee0-3982-473e-aff0-ae3e52068a4a tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] [instance: be38c803-d97c-4939-9852-e8db1c44bb65] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 03 12:31:49 user nova-compute[74960]: DEBUG oslo.service.loopingcall [None req-c996dee0-3982-473e-aff0-ae3e52068a4a tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74960) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 12:31:49 user nova-compute[74960]: DEBUG nova.compute.manager [-] [instance: be38c803-d97c-4939-9852-e8db1c44bb65] Deallocating network for instance {{(pid=74960) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 12:31:49 user nova-compute[74960]: DEBUG nova.network.neutron [-] [instance: be38c803-d97c-4939-9852-e8db1c44bb65] deallocate_for_instance() {{(pid=74960) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 12:31:50 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-67940e2c-a90a-414f-81dc-e65803b2444b tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:31:50 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-67940e2c-a90a-414f-81dc-e65803b2444b tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:31:50 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-67940e2c-a90a-414f-81dc-e65803b2444b tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.532s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:31:50 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:31:50 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:31:50 user nova-compute[74960]: INFO nova.scheduler.client.report [None req-67940e2c-a90a-414f-81dc-e65803b2444b tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Deleted allocations for instance 208570e4-1b11-486b-a79e-4b4eafc26af2
Nov 03 12:31:50 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-67940e2c-a90a-414f-81dc-e65803b2444b tempest-VolumesActionsTest-1450410058 tempest-VolumesActionsTest-1450410058-project-member] Lock "208570e4-1b11-486b-a79e-4b4eafc26af2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.703s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:31:50 user nova-compute[74960]: DEBUG nova.compute.manager [None req-c6d59363-dc8c-4f54-875e-3312a26a8b51 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] Checking state {{(pid=74960) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 12:31:50 user nova-compute[74960]: DEBUG nova.network.neutron [-] [instance: be38c803-d97c-4939-9852-e8db1c44bb65] Updating instance_info_cache with network_info: [] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:31:51 user nova-compute[74960]: INFO nova.compute.manager [-] [instance: be38c803-d97c-4939-9852-e8db1c44bb65] Took 1.13 seconds to deallocate network for instance.
Nov 03 12:31:51 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c996dee0-3982-473e-aff0-ae3e52068a4a tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:31:51 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c996dee0-3982-473e-aff0-ae3e52068a4a tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:31:51 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-fdb0185f-e8f5-47a4-a9eb-3180fad87c8a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Acquiring lock "35e02c80-f626-4918-93f1-6b9a7f778c7a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:31:51 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-fdb0185f-e8f5-47a4-a9eb-3180fad87c8a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Lock "35e02c80-f626-4918-93f1-6b9a7f778c7a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:31:51 user nova-compute[74960]: DEBUG nova.compute.manager [req-7d0bde3b-c89f-4b60-902c-aa247510e508 req-0b4ce2bf-67c5-4cae-a768-8e73b62cdb34 service nova] [instance: 208570e4-1b11-486b-a79e-4b4eafc26af2] Received event network-vif-deleted-ab5d31db-7218-4c01-ba8f-0420e61f4583 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:31:51 user nova-compute[74960]: DEBUG nova.compute.manager [req-7d0bde3b-c89f-4b60-902c-aa247510e508 req-0b4ce2bf-67c5-4cae-a768-8e73b62cdb34 service nova] [instance: be38c803-d97c-4939-9852-e8db1c44bb65] Received event network-vif-plugged-b70bcefe-a1cc-4f5c-98f6-3d6914d66a9b {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:31:51 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-7d0bde3b-c89f-4b60-902c-aa247510e508 req-0b4ce2bf-67c5-4cae-a768-8e73b62cdb34 service nova] Acquiring lock "be38c803-d97c-4939-9852-e8db1c44bb65-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:31:51 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-7d0bde3b-c89f-4b60-902c-aa247510e508 req-0b4ce2bf-67c5-4cae-a768-8e73b62cdb34 service nova] Lock "be38c803-d97c-4939-9852-e8db1c44bb65-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:31:51 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-7d0bde3b-c89f-4b60-902c-aa247510e508 req-0b4ce2bf-67c5-4cae-a768-8e73b62cdb34 service nova] Lock "be38c803-d97c-4939-9852-e8db1c44bb65-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:31:51 user nova-compute[74960]: DEBUG nova.compute.manager [req-7d0bde3b-c89f-4b60-902c-aa247510e508 req-0b4ce2bf-67c5-4cae-a768-8e73b62cdb34 service nova] [instance: be38c803-d97c-4939-9852-e8db1c44bb65] No waiting events found dispatching network-vif-plugged-b70bcefe-a1cc-4f5c-98f6-3d6914d66a9b {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:31:51 user nova-compute[74960]: WARNING nova.compute.manager [req-7d0bde3b-c89f-4b60-902c-aa247510e508 req-0b4ce2bf-67c5-4cae-a768-8e73b62cdb34 service nova] [instance: be38c803-d97c-4939-9852-e8db1c44bb65] Received unexpected event network-vif-plugged-b70bcefe-a1cc-4f5c-98f6-3d6914d66a9b for instance with vm_state deleted and task_state None.
Nov 03 12:31:51 user nova-compute[74960]: DEBUG nova.compute.manager [req-b065611e-7c72-4f8d-be54-f5a9c803163d req-e85df163-62db-42a1-b7c1-73795db90fc6 service nova] [instance: be38c803-d97c-4939-9852-e8db1c44bb65] Received event network-vif-deleted-b70bcefe-a1cc-4f5c-98f6-3d6914d66a9b {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:31:51 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-c996dee0-3982-473e-aff0-ae3e52068a4a tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:31:51 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-c996dee0-3982-473e-aff0-ae3e52068a4a tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:31:51 user nova-compute[74960]: DEBUG nova.compute.manager [None req-fdb0185f-e8f5-47a4-a9eb-3180fad87c8a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a] Starting instance... {{(pid=74960) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 12:31:51 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c996dee0-3982-473e-aff0-ae3e52068a4a tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.626s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:31:51 user nova-compute[74960]: INFO nova.scheduler.client.report [None req-c996dee0-3982-473e-aff0-ae3e52068a4a tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Deleted allocations for instance be38c803-d97c-4939-9852-e8db1c44bb65
Nov 03 12:31:51 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-fdb0185f-e8f5-47a4-a9eb-3180fad87c8a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:31:51 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-fdb0185f-e8f5-47a4-a9eb-3180fad87c8a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:31:51 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-fdb0185f-e8f5-47a4-a9eb-3180fad87c8a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74960) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 12:31:51 user nova-compute[74960]: INFO nova.compute.claims [None req-fdb0185f-e8f5-47a4-a9eb-3180fad87c8a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a] Claim successful on node user
Nov 03 12:31:52 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c996dee0-3982-473e-aff0-ae3e52068a4a tempest-TestMinimumBasicScenario-585836766 tempest-TestMinimumBasicScenario-585836766-project-member] Lock "be38c803-d97c-4939-9852-e8db1c44bb65" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.207s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:31:52 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-fdb0185f-e8f5-47a4-a9eb-3180fad87c8a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:31:52 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:31:52 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-fdb0185f-e8f5-47a4-a9eb-3180fad87c8a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:31:52 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:31:52 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-fdb0185f-e8f5-47a4-a9eb-3180fad87c8a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.493s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:31:52 user nova-compute[74960]: DEBUG nova.compute.manager [None req-fdb0185f-e8f5-47a4-a9eb-3180fad87c8a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a] Start building networks asynchronously for instance. {{(pid=74960) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 12:31:52 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.040s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:31:52 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:31:52 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Auditing locally available compute resources for user (node: user) {{(pid=74960) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 12:31:52 user nova-compute[74960]: DEBUG nova.compute.manager [None req-fdb0185f-e8f5-47a4-a9eb-3180fad87c8a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a] Allocating IP information in the background. {{(pid=74960) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 12:31:52 user nova-compute[74960]: DEBUG nova.network.neutron [None req-fdb0185f-e8f5-47a4-a9eb-3180fad87c8a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a] allocate_for_instance() {{(pid=74960) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 12:31:52 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-fdb0185f-e8f5-47a4-a9eb-3180fad87c8a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 12:31:52 user nova-compute[74960]: DEBUG nova.compute.manager [None req-fdb0185f-e8f5-47a4-a9eb-3180fad87c8a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a] Start building block device mappings for instance. {{(pid=74960) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 12:31:52 user nova-compute[74960]: DEBUG nova.policy [None req-fdb0185f-e8f5-47a4-a9eb-3180fad87c8a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1f8cac126fe247829404265038cd2608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a32002934044bfad2e4d84bc1b04ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74960) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 12:31:52 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74960) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 12:31:52 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7769e3c5-136f-4282-8e3e-224e3a80922c/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:31:52 user nova-compute[74960]: DEBUG nova.compute.manager [None req-fdb0185f-e8f5-47a4-a9eb-3180fad87c8a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a] Start spawning the instance on the hypervisor. {{(pid=74960) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 12:31:52 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-fdb0185f-e8f5-47a4-a9eb-3180fad87c8a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a] Creating instance directory {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 12:31:52 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-fdb0185f-e8f5-47a4-a9eb-3180fad87c8a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a] Creating image(s)
Nov 03 12:31:53 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-fdb0185f-e8f5-47a4-a9eb-3180fad87c8a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Acquiring lock "/opt/stack/data/nova/instances/35e02c80-f626-4918-93f1-6b9a7f778c7a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:31:53 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-fdb0185f-e8f5-47a4-a9eb-3180fad87c8a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Lock "/opt/stack/data/nova/instances/35e02c80-f626-4918-93f1-6b9a7f778c7a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:31:53 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-fdb0185f-e8f5-47a4-a9eb-3180fad87c8a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Lock "/opt/stack/data/nova/instances/35e02c80-f626-4918-93f1-6b9a7f778c7a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:31:53 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-fdb0185f-e8f5-47a4-a9eb-3180fad87c8a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:31:53 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7769e3c5-136f-4282-8e3e-224e3a80922c/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:31:53 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7769e3c5-136f-4282-8e3e-224e3a80922c/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:31:53 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-fdb0185f-e8f5-47a4-a9eb-3180fad87c8a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.176s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:31:53 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-fdb0185f-e8f5-47a4-a9eb-3180fad87c8a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Acquiring lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:31:53 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-fdb0185f-e8f5-47a4-a9eb-3180fad87c8a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:31:53 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-fdb0185f-e8f5-47a4-a9eb-3180fad87c8a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:31:53 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7769e3c5-136f-4282-8e3e-224e3a80922c/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:31:53 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f15f5f-8afa-4d7b-bb45-5887184f9ee5/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:31:53 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:31:53 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-fdb0185f-e8f5-47a4-a9eb-3180fad87c8a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.234s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:31:53 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-fdb0185f-e8f5-47a4-a9eb-3180fad87c8a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910,backing_fmt=raw /opt/stack/data/nova/instances/35e02c80-f626-4918-93f1-6b9a7f778c7a/disk 1073741824 {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:31:53 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f15f5f-8afa-4d7b-bb45-5887184f9ee5/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:31:53 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f15f5f-8afa-4d7b-bb45-5887184f9ee5/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:31:53 user nova-compute[74960]: DEBUG nova.network.neutron [None req-fdb0185f-e8f5-47a4-a9eb-3180fad87c8a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a] Successfully created port: 4a3a2b1f-db29-441d-9bf9-7f429760ae05 {{(pid=74960) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 12:31:53 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-fdb0185f-e8f5-47a4-a9eb-3180fad87c8a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910,backing_fmt=raw /opt/stack/data/nova/instances/35e02c80-f626-4918-93f1-6b9a7f778c7a/disk 1073741824" returned: 0 in 0.112s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:31:53 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-fdb0185f-e8f5-47a4-a9eb-3180fad87c8a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.350s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:31:53 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-fdb0185f-e8f5-47a4-a9eb-3180fad87c8a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:31:53 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f15f5f-8afa-4d7b-bb45-5887184f9ee5/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:31:53 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7b95c0-3726-4a1c-a384-ec91abf75225/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:31:53 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-fdb0185f-e8f5-47a4-a9eb-3180fad87c8a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.255s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:31:53 user nova-compute[74960]: DEBUG nova.virt.disk.api [None req-fdb0185f-e8f5-47a4-a9eb-3180fad87c8a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Checking if we can resize image /opt/stack/data/nova/instances/35e02c80-f626-4918-93f1-6b9a7f778c7a/disk. size=1073741824 {{(pid=74960) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 12:31:53 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-fdb0185f-e8f5-47a4-a9eb-3180fad87c8a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e02c80-f626-4918-93f1-6b9a7f778c7a/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:31:53 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7b95c0-3726-4a1c-a384-ec91abf75225/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:31:53 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7b95c0-3726-4a1c-a384-ec91abf75225/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:31:54 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-fdb0185f-e8f5-47a4-a9eb-3180fad87c8a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e02c80-f626-4918-93f1-6b9a7f778c7a/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:31:54 user nova-compute[74960]: DEBUG nova.virt.disk.api [None req-fdb0185f-e8f5-47a4-a9eb-3180fad87c8a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Cannot resize image /opt/stack/data/nova/instances/35e02c80-f626-4918-93f1-6b9a7f778c7a/disk to a smaller size. {{(pid=74960) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 12:31:54 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-fdb0185f-e8f5-47a4-a9eb-3180fad87c8a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a] Created local disks {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 12:31:54 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-fdb0185f-e8f5-47a4-a9eb-3180fad87c8a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a] Ensure instance console log exists: /opt/stack/data/nova/instances/35e02c80-f626-4918-93f1-6b9a7f778c7a/console.log {{(pid=74960) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 12:31:54 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-fdb0185f-e8f5-47a4-a9eb-3180fad87c8a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:31:54 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-fdb0185f-e8f5-47a4-a9eb-3180fad87c8a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:31:54 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-fdb0185f-e8f5-47a4-a9eb-3180fad87c8a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:31:54 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7b95c0-3726-4a1c-a384-ec91abf75225/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:31:54 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74960) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 12:31:54 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74960) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 12:31:54 user nova-compute[74960]: DEBUG nova.network.neutron [None req-fdb0185f-e8f5-47a4-a9eb-3180fad87c8a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a] Successfully updated port: 4a3a2b1f-db29-441d-9bf9-7f429760ae05 {{(pid=74960) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 12:31:54 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:31:54 user nova-compute[74960]: DEBUG nova.compute.manager [req-c4fd131a-096a-4e49-b3f5-eb52bec7ac20 req-0efa7edd-4ef3-427a-8a99-d7bdf0bd54af service nova] [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a] Received event network-changed-4a3a2b1f-db29-441d-9bf9-7f429760ae05 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:31:54 user nova-compute[74960]: DEBUG nova.compute.manager [req-c4fd131a-096a-4e49-b3f5-eb52bec7ac20 req-0efa7edd-4ef3-427a-8a99-d7bdf0bd54af service nova] [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a] Refreshing instance network info cache due to event network-changed-4a3a2b1f-db29-441d-9bf9-7f429760ae05. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 12:31:54 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-c4fd131a-096a-4e49-b3f5-eb52bec7ac20 req-0efa7edd-4ef3-427a-8a99-d7bdf0bd54af service nova] Acquiring lock "refresh_cache-35e02c80-f626-4918-93f1-6b9a7f778c7a" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:31:54 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-c4fd131a-096a-4e49-b3f5-eb52bec7ac20 req-0efa7edd-4ef3-427a-8a99-d7bdf0bd54af service nova] Acquired lock "refresh_cache-35e02c80-f626-4918-93f1-6b9a7f778c7a" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:31:54 user nova-compute[74960]: DEBUG nova.network.neutron [req-c4fd131a-096a-4e49-b3f5-eb52bec7ac20 req-0efa7edd-4ef3-427a-8a99-d7bdf0bd54af service nova] [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a] Refreshing network info cache for port 4a3a2b1f-db29-441d-9bf9-7f429760ae05 {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 12:31:54 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-fdb0185f-e8f5-47a4-a9eb-3180fad87c8a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Acquiring lock "refresh_cache-35e02c80-f626-4918-93f1-6b9a7f778c7a" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:31:54 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:31:54 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:31:54 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Hypervisor/Node resource view: name=user free_ram=8032MB free_disk=25.0831298828125GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74960) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 12:31:54 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:31:54 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:31:54 user nova-compute[74960]: DEBUG nova.network.neutron [req-c4fd131a-096a-4e49-b3f5-eb52bec7ac20 req-0efa7edd-4ef3-427a-8a99-d7bdf0bd54af service nova] [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a] Instance cache missing network info. {{(pid=74960) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 12:31:55 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Applying migration context for instance b1f7c162-c891-460a-8f98-3c7d6aeb6c49 as it has an incoming, in-progress migration 4e8b66c8-feb8-4c01-a89e-fd5c22b15658. Migration status is error {{(pid=74960) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 03 12:31:55 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49] Skipping migration as instance is neither resizing nor live-migrating. {{(pid=74960) _update_usage_from_migrations /opt/stack/nova/nova/compute/resource_tracker.py:1563}}
Nov 03 12:31:55 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 7769e3c5-136f-4282-8e3e-224e3a80922c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:31:55 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 87f15f5f-8afa-4d7b-bb45-5887184f9ee5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:31:55 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance a6199681-f85e-4f55-966b-6ab3f17cd640 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:31:55 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 5b7b95c0-3726-4a1c-a384-ec91abf75225 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:31:55 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:31:55 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance b1f7c162-c891-460a-8f98-3c7d6aeb6c49 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:31:55 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 35e02c80-f626-4918-93f1-6b9a7f778c7a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:31:55 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74960) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 12:31:55 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74960) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 12:31:55 user nova-compute[74960]: DEBUG nova.network.neutron [req-c4fd131a-096a-4e49-b3f5-eb52bec7ac20 req-0efa7edd-4ef3-427a-8a99-d7bdf0bd54af service nova] [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a] Updating instance_info_cache with network_info: [] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:31:55 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:31:55 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-c4fd131a-096a-4e49-b3f5-eb52bec7ac20 req-0efa7edd-4ef3-427a-8a99-d7bdf0bd54af service nova] Releasing lock "refresh_cache-35e02c80-f626-4918-93f1-6b9a7f778c7a" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:31:55 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-fdb0185f-e8f5-47a4-a9eb-3180fad87c8a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Acquired lock "refresh_cache-35e02c80-f626-4918-93f1-6b9a7f778c7a" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:31:55 user nova-compute[74960]: DEBUG nova.network.neutron [None req-fdb0185f-e8f5-47a4-a9eb-3180fad87c8a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a] Building network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 12:31:55 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:31:55 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Compute_service record updated for user:user {{(pid=74960) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 12:31:55 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.425s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:31:55 user nova-compute[74960]: DEBUG nova.network.neutron [None req-fdb0185f-e8f5-47a4-a9eb-3180fad87c8a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a] Instance cache missing network info. {{(pid=74960) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 12:31:55 user nova-compute[74960]: DEBUG nova.network.neutron [None req-fdb0185f-e8f5-47a4-a9eb-3180fad87c8a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a] Updating instance_info_cache with network_info: [{"id": "4a3a2b1f-db29-441d-9bf9-7f429760ae05", "address": "fa:16:3e:26:d9:9a", "network": {"id": "40aa546e-b586-43f8-bfe3-99c3822fb320", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1884215412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68a32002934044bfad2e4d84bc1b04ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a3a2b1f-db", "ovs_interfaceid": "4a3a2b1f-db29-441d-9bf9-7f429760ae05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:31:55 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-fdb0185f-e8f5-47a4-a9eb-3180fad87c8a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Releasing lock "refresh_cache-35e02c80-f626-4918-93f1-6b9a7f778c7a" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:31:55 user nova-compute[74960]: DEBUG nova.compute.manager [None req-fdb0185f-e8f5-47a4-a9eb-3180fad87c8a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a] Instance network_info: |[{"id": "4a3a2b1f-db29-441d-9bf9-7f429760ae05", "address": "fa:16:3e:26:d9:9a", "network": {"id": "40aa546e-b586-43f8-bfe3-99c3822fb320", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1884215412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68a32002934044bfad2e4d84bc1b04ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a3a2b1f-db", "ovs_interfaceid": "4a3a2b1f-db29-441d-9bf9-7f429760ae05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74960) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 12:31:55 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-fdb0185f-e8f5-47a4-a9eb-3180fad87c8a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a] Start _get_guest_xml network_info=[{"id": "4a3a2b1f-db29-441d-9bf9-7f429760ae05", "address": "fa:16:3e:26:d9:9a", "network": {"id": "40aa546e-b586-43f8-bfe3-99c3822fb320", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1884215412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68a32002934044bfad2e4d84bc1b04ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a3a2b1f-db", "ovs_interfaceid": "4a3a2b1f-db29-441d-9bf9-7f429760ae05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=549f51ba-ac69-494b-8de1-34635aa2d7cf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='63ee9c80c632442fb0379f47b784bd20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T12:13:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'image_id': '549f51ba-ac69-494b-8de1-34635aa2d7cf'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 12:31:55 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-fdb0185f-e8f5-47a4-a9eb-3180fad87c8a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:31:55 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-fdb0185f-e8f5-47a4-a9eb-3180fad87c8a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:31:55 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-fdb0185f-e8f5-47a4-a9eb-3180fad87c8a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 12:31:55 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-fdb0185f-e8f5-47a4-a9eb-3180fad87c8a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] CPU controller missing on host. {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 12:31:55 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-fdb0185f-e8f5-47a4-a9eb-3180fad87c8a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 12:31:55 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-fdb0185f-e8f5-47a4-a9eb-3180fad87c8a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] CPU controller found on host. {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 12:31:55 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-fdb0185f-e8f5-47a4-a9eb-3180fad87c8a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74960) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 12:31:55 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-fdb0185f-e8f5-47a4-a9eb-3180fad87c8a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=549f51ba-ac69-494b-8de1-34635aa2d7cf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='63ee9c80c632442fb0379f47b784bd20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T12:13:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 12:31:55 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-fdb0185f-e8f5-47a4-a9eb-3180fad87c8a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Flavor limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 12:31:55 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-fdb0185f-e8f5-47a4-a9eb-3180fad87c8a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Image limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 12:31:55 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-fdb0185f-e8f5-47a4-a9eb-3180fad87c8a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Flavor pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 12:31:55 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-fdb0185f-e8f5-47a4-a9eb-3180fad87c8a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Image pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 12:31:55 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-fdb0185f-e8f5-47a4-a9eb-3180fad87c8a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 12:31:55 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-fdb0185f-e8f5-47a4-a9eb-3180fad87c8a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 12:31:55 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-fdb0185f-e8f5-47a4-a9eb-3180fad87c8a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 12:31:55 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-fdb0185f-e8f5-47a4-a9eb-3180fad87c8a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Got 1 possible topologies {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 12:31:55 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-fdb0185f-e8f5-47a4-a9eb-3180fad87c8a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 12:31:55 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-fdb0185f-e8f5-47a4-a9eb-3180fad87c8a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 12:31:55 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-fdb0185f-e8f5-47a4-a9eb-3180fad87c8a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:31:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1204616755',display_name='tempest-SnapshotDataIntegrityTests-server-1204616755',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1204616755',id=30,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA4Jmc6vxGmD+FIEny2/bl3nhg3cePb1r82d0CansePy/fKHfJbKeqOY+gqa40mFuFg144lW0d7DELGynXX6lCpAYv3wYVIdNjMT2D6N0Jcar3O1z7lnyYFUqxDHBYLzrA==',key_name='tempest-keypair-656749056',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='68a32002934044bfad2e4d84bc1b04ed',ramdisk_id='',reservation_id='r-05bwiepr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1334789549',owner_user_name='tempest-SnapshotDataIntegrityTests-1334789549-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:31:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f8cac126fe247829404265038cd2608',uuid=35e02c80-f626-4918-93f1-6b9a7f778c7a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4a3a2b1f-db29-441d-9bf9-7f429760ae05", "address": "fa:16:3e:26:d9:9a", "network": {"id": "40aa546e-b586-43f8-bfe3-99c3822fb320", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1884215412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68a32002934044bfad2e4d84bc1b04ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a3a2b1f-db", "ovs_interfaceid": "4a3a2b1f-db29-441d-9bf9-7f429760ae05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74960) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 12:31:55 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-fdb0185f-e8f5-47a4-a9eb-3180fad87c8a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Converting VIF {"id": "4a3a2b1f-db29-441d-9bf9-7f429760ae05", "address": "fa:16:3e:26:d9:9a", "network": {"id": "40aa546e-b586-43f8-bfe3-99c3822fb320", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1884215412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68a32002934044bfad2e4d84bc1b04ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a3a2b1f-db", "ovs_interfaceid": "4a3a2b1f-db29-441d-9bf9-7f429760ae05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:31:55 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-fdb0185f-e8f5-47a4-a9eb-3180fad87c8a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:d9:9a,bridge_name='br-int',has_traffic_filtering=True,id=4a3a2b1f-db29-441d-9bf9-7f429760ae05,network=Network(40aa546e-b586-43f8-bfe3-99c3822fb320),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a3a2b1f-db') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:31:55 user nova-compute[74960]: DEBUG nova.objects.instance [None req-fdb0185f-e8f5-47a4-a9eb-3180fad87c8a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Lazy-loading 'pci_devices' on Instance uuid 35e02c80-f626-4918-93f1-6b9a7f778c7a {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:31:55 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-fdb0185f-e8f5-47a4-a9eb-3180fad87c8a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a] End _get_guest_xml xml=<domain type="kvm">
Nov 03 12:31:55 user nova-compute[74960]:   <uuid>35e02c80-f626-4918-93f1-6b9a7f778c7a</uuid>
Nov 03 12:31:55 user nova-compute[74960]:   <name>instance-0000001e</name>
Nov 03 12:31:55 user nova-compute[74960]:   <memory>524288</memory>
Nov 03 12:31:55 user nova-compute[74960]:   <vcpu>1</vcpu>
Nov 03 12:31:55 user nova-compute[74960]:   <metadata>
Nov 03 12:31:55 user nova-compute[74960]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 12:31:55 user nova-compute[74960]:       <nova:package version="0.0.0"/>
Nov 03 12:31:55 user nova-compute[74960]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1204616755</nova:name>
Nov 03 12:31:55 user nova-compute[74960]:       <nova:creationTime>2023-11-03 12:31:55</nova:creationTime>
Nov 03 12:31:55 user nova-compute[74960]:       <nova:flavor name="m1.tiny">
Nov 03 12:31:55 user nova-compute[74960]:         <nova:memory>512</nova:memory>
Nov 03 12:31:55 user nova-compute[74960]:         <nova:disk>1</nova:disk>
Nov 03 12:31:55 user nova-compute[74960]:         <nova:swap>0</nova:swap>
Nov 03 12:31:55 user nova-compute[74960]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 12:31:55 user nova-compute[74960]:         <nova:vcpus>1</nova:vcpus>
Nov 03 12:31:55 user nova-compute[74960]:       </nova:flavor>
Nov 03 12:31:55 user nova-compute[74960]:       <nova:owner>
Nov 03 12:31:55 user nova-compute[74960]:         <nova:user uuid="1f8cac126fe247829404265038cd2608">tempest-SnapshotDataIntegrityTests-1334789549-project-member</nova:user>
Nov 03 12:31:55 user nova-compute[74960]:         <nova:project uuid="68a32002934044bfad2e4d84bc1b04ed">tempest-SnapshotDataIntegrityTests-1334789549</nova:project>
Nov 03 12:31:55 user nova-compute[74960]:       </nova:owner>
Nov 03 12:31:55 user nova-compute[74960]:       <nova:root type="image" uuid="549f51ba-ac69-494b-8de1-34635aa2d7cf"/>
Nov 03 12:31:55 user nova-compute[74960]:       <nova:ports>
Nov 03 12:31:55 user nova-compute[74960]:         <nova:port uuid="4a3a2b1f-db29-441d-9bf9-7f429760ae05">
Nov 03 12:31:55 user nova-compute[74960]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 03 12:31:55 user nova-compute[74960]:         </nova:port>
Nov 03 12:31:55 user nova-compute[74960]:       </nova:ports>
Nov 03 12:31:55 user nova-compute[74960]:     </nova:instance>
Nov 03 12:31:55 user nova-compute[74960]:   </metadata>
Nov 03 12:31:55 user nova-compute[74960]:   <sysinfo type="smbios">
Nov 03 12:31:55 user nova-compute[74960]:     <system>
Nov 03 12:31:55 user nova-compute[74960]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 12:31:55 user nova-compute[74960]:       <entry name="product">OpenStack Nova</entry>
Nov 03 12:31:55 user nova-compute[74960]:       <entry name="version">0.0.0</entry>
Nov 03 12:31:55 user nova-compute[74960]:       <entry name="serial">35e02c80-f626-4918-93f1-6b9a7f778c7a</entry>
Nov 03 12:31:55 user nova-compute[74960]:       <entry name="uuid">35e02c80-f626-4918-93f1-6b9a7f778c7a</entry>
Nov 03 12:31:55 user nova-compute[74960]:       <entry name="family">Virtual Machine</entry>
Nov 03 12:31:55 user nova-compute[74960]:     </system>
Nov 03 12:31:55 user nova-compute[74960]:   </sysinfo>
Nov 03 12:31:55 user nova-compute[74960]:   <os>
Nov 03 12:31:55 user nova-compute[74960]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 12:31:55 user nova-compute[74960]:     <boot dev="hd"/>
Nov 03 12:31:55 user nova-compute[74960]:     <smbios mode="sysinfo"/>
Nov 03 12:31:55 user nova-compute[74960]:   </os>
Nov 03 12:31:55 user nova-compute[74960]:   <features>
Nov 03 12:31:55 user nova-compute[74960]:     <acpi/>
Nov 03 12:31:55 user nova-compute[74960]:     <apic/>
Nov 03 12:31:55 user nova-compute[74960]:     <vmcoreinfo/>
Nov 03 12:31:55 user nova-compute[74960]:   </features>
Nov 03 12:31:55 user nova-compute[74960]:   <clock offset="utc">
Nov 03 12:31:55 user nova-compute[74960]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 12:31:55 user nova-compute[74960]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 12:31:55 user nova-compute[74960]:     <timer name="hpet" present="no"/>
Nov 03 12:31:55 user nova-compute[74960]:   </clock>
Nov 03 12:31:55 user nova-compute[74960]:   <cpu mode="custom" match="exact">
Nov 03 12:31:55 user nova-compute[74960]:     <model>Nehalem</model>
Nov 03 12:31:55 user nova-compute[74960]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 12:31:55 user nova-compute[74960]:   </cpu>
Nov 03 12:31:55 user nova-compute[74960]:   <devices>
Nov 03 12:31:55 user nova-compute[74960]:     <disk type="file" device="disk">
Nov 03 12:31:55 user nova-compute[74960]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 12:31:55 user nova-compute[74960]:       <source file="/opt/stack/data/nova/instances/35e02c80-f626-4918-93f1-6b9a7f778c7a/disk"/>
Nov 03 12:31:55 user nova-compute[74960]:       <target dev="vda" bus="virtio"/>
Nov 03 12:31:55 user nova-compute[74960]:     </disk>
Nov 03 12:31:55 user nova-compute[74960]:     <interface type="ethernet">
Nov 03 12:31:55 user nova-compute[74960]:       <mac address="fa:16:3e:26:d9:9a"/>
Nov 03 12:31:55 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:31:55 user nova-compute[74960]:       <mtu size="1442"/>
Nov 03 12:31:55 user nova-compute[74960]:       <target dev="tap4a3a2b1f-db"/>
Nov 03 12:31:55 user nova-compute[74960]:     </interface>
Nov 03 12:31:55 user nova-compute[74960]:     <serial type="pty">
Nov 03 12:31:55 user nova-compute[74960]:       <log file="/opt/stack/data/nova/instances/35e02c80-f626-4918-93f1-6b9a7f778c7a/console.log" append="off"/>
Nov 03 12:31:55 user nova-compute[74960]:     </serial>
Nov 03 12:31:55 user nova-compute[74960]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 12:31:55 user nova-compute[74960]:     <video>
Nov 03 12:31:55 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:31:55 user nova-compute[74960]:     </video>
Nov 03 12:31:55 user nova-compute[74960]:     <rng model="virtio">
Nov 03 12:31:55 user nova-compute[74960]:       <backend model="random">/dev/urandom</backend>
Nov 03 12:31:55 user nova-compute[74960]:     </rng>
Nov 03 12:31:55 user nova-compute[74960]:     <controller type="usb" index="0" model="none"/>
Nov 03 12:31:55 user nova-compute[74960]:     <memballoon model="virtio">
Nov 03 12:31:55 user nova-compute[74960]:       <stats period="10"/>
Nov 03 12:31:55 user nova-compute[74960]:     </memballoon>
Nov 03 12:31:55 user nova-compute[74960]:   </devices>
Nov 03 12:31:55 user nova-compute[74960]: </domain>
Nov 03 12:31:55 user nova-compute[74960]:  {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 12:31:55 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-fdb0185f-e8f5-47a4-a9eb-3180fad87c8a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:31:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1204616755',display_name='tempest-SnapshotDataIntegrityTests-server-1204616755',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1204616755',id=30,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA4Jmc6vxGmD+FIEny2/bl3nhg3cePb1r82d0CansePy/fKHfJbKeqOY+gqa40mFuFg144lW0d7DELGynXX6lCpAYv3wYVIdNjMT2D6N0Jcar3O1z7lnyYFUqxDHBYLzrA==',key_name='tempest-keypair-656749056',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='68a32002934044bfad2e4d84bc1b04ed',ramdisk_id='',reservation_id='r-05bwiepr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1334789549',owner_user_name='tempest-SnapshotDataIntegrityTests-1334789549-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:31:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f8cac126fe247829404265038cd2608',uuid=35e02c80-f626-4918-93f1-6b9a7f778c7a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4a3a2b1f-db29-441d-9bf9-7f429760ae05", "address": "fa:16:3e:26:d9:9a", "network": {"id": "40aa546e-b586-43f8-bfe3-99c3822fb320", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1884215412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68a32002934044bfad2e4d84bc1b04ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a3a2b1f-db", "ovs_interfaceid": "4a3a2b1f-db29-441d-9bf9-7f429760ae05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 12:31:55 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-fdb0185f-e8f5-47a4-a9eb-3180fad87c8a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Converting VIF {"id": "4a3a2b1f-db29-441d-9bf9-7f429760ae05", "address": "fa:16:3e:26:d9:9a", "network": {"id": "40aa546e-b586-43f8-bfe3-99c3822fb320", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1884215412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68a32002934044bfad2e4d84bc1b04ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a3a2b1f-db", "ovs_interfaceid": "4a3a2b1f-db29-441d-9bf9-7f429760ae05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:31:55 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-fdb0185f-e8f5-47a4-a9eb-3180fad87c8a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:d9:9a,bridge_name='br-int',has_traffic_filtering=True,id=4a3a2b1f-db29-441d-9bf9-7f429760ae05,network=Network(40aa546e-b586-43f8-bfe3-99c3822fb320),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a3a2b1f-db') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:31:55 user nova-compute[74960]: DEBUG os_vif [None req-fdb0185f-e8f5-47a4-a9eb-3180fad87c8a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:d9:9a,bridge_name='br-int',has_traffic_filtering=True,id=4a3a2b1f-db29-441d-9bf9-7f429760ae05,network=Network(40aa546e-b586-43f8-bfe3-99c3822fb320),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a3a2b1f-db') {{(pid=74960) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 12:31:55 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:31:55 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:31:55 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 12:31:55 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:31:55 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ef1755dd-c00d-509d-8ee9-af2566c1c36a', '_type': 'linux-noop'}}, row=False) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:31:55 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:31:55 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:31:55 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:31:55 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4a3a2b1f-db, may_exist=True, interface_attrs={}) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:31:55 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4a3a2b1f-db, col_values=(('qos', UUID('5f20ca09-049e-4a1d-b2f7-a8dd480939d0')),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:31:55 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4a3a2b1f-db, col_values=(('external_ids', {'iface-id': '4a3a2b1f-db29-441d-9bf9-7f429760ae05', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:26:d9:9a', 'vm-uuid': '35e02c80-f626-4918-93f1-6b9a7f778c7a'}),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:31:55 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:31:55 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:31:55 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:31:55 user nova-compute[74960]: INFO os_vif [None req-fdb0185f-e8f5-47a4-a9eb-3180fad87c8a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:d9:9a,bridge_name='br-int',has_traffic_filtering=True,id=4a3a2b1f-db29-441d-9bf9-7f429760ae05,network=Network(40aa546e-b586-43f8-bfe3-99c3822fb320),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a3a2b1f-db')
Nov 03 12:31:55 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-fdb0185f-e8f5-47a4-a9eb-3180fad87c8a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] No BDM found with device name vda, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:31:55 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-fdb0185f-e8f5-47a4-a9eb-3180fad87c8a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] No VIF found with MAC fa:16:3e:26:d9:9a, not building metadata {{(pid=74960) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 12:31:56 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:31:56 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:31:56 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:31:56 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74960) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 12:31:57 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:31:57 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:31:57 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:31:57 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:31:57 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:31:58 user nova-compute[74960]: DEBUG nova.compute.manager [req-806dd1a3-384e-4486-98dc-16b01bda55e0 req-b60be3d0-6f02-4642-9b88-b0f2b0ba4537 service nova] [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a] Received event network-vif-plugged-4a3a2b1f-db29-441d-9bf9-7f429760ae05 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:31:58 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-806dd1a3-384e-4486-98dc-16b01bda55e0 req-b60be3d0-6f02-4642-9b88-b0f2b0ba4537 service nova] Acquiring lock "35e02c80-f626-4918-93f1-6b9a7f778c7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:31:58 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-806dd1a3-384e-4486-98dc-16b01bda55e0 req-b60be3d0-6f02-4642-9b88-b0f2b0ba4537 service nova] Lock "35e02c80-f626-4918-93f1-6b9a7f778c7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:31:58 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-806dd1a3-384e-4486-98dc-16b01bda55e0 req-b60be3d0-6f02-4642-9b88-b0f2b0ba4537 service nova] Lock "35e02c80-f626-4918-93f1-6b9a7f778c7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:31:58 user nova-compute[74960]: DEBUG nova.compute.manager [req-806dd1a3-384e-4486-98dc-16b01bda55e0 req-b60be3d0-6f02-4642-9b88-b0f2b0ba4537 service nova] [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a] No waiting events found dispatching network-vif-plugged-4a3a2b1f-db29-441d-9bf9-7f429760ae05 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:31:58 user nova-compute[74960]: WARNING nova.compute.manager [req-806dd1a3-384e-4486-98dc-16b01bda55e0 req-b60be3d0-6f02-4642-9b88-b0f2b0ba4537 service nova] [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a] Received unexpected event network-vif-plugged-4a3a2b1f-db29-441d-9bf9-7f429760ae05 for instance with vm_state building and task_state spawning.
Nov 03 12:31:58 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:31:59 user nova-compute[74960]: DEBUG nova.compute.manager [None req-fdb0185f-e8f5-47a4-a9eb-3180fad87c8a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a] Instance event wait completed in 0 seconds for  {{(pid=74960) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 12:31:59 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-fdb0185f-e8f5-47a4-a9eb-3180fad87c8a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a] Guest created on hypervisor {{(pid=74960) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 12:31:59 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a] Instance spawned successfully.
Nov 03 12:31:59 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-fdb0185f-e8f5-47a4-a9eb-3180fad87c8a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 12:31:59 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-fdb0185f-e8f5-47a4-a9eb-3180fad87c8a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a] Found default for hw_cdrom_bus of ide {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:31:59 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-fdb0185f-e8f5-47a4-a9eb-3180fad87c8a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a] Found default for hw_disk_bus of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:31:59 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-fdb0185f-e8f5-47a4-a9eb-3180fad87c8a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a] Found default for hw_input_bus of None {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:31:59 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-fdb0185f-e8f5-47a4-a9eb-3180fad87c8a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a] Found default for hw_pointer_model of None {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:31:59 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-fdb0185f-e8f5-47a4-a9eb-3180fad87c8a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a] Found default for hw_video_model of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:31:59 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-fdb0185f-e8f5-47a4-a9eb-3180fad87c8a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a] Found default for hw_vif_model of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:31:59 user nova-compute[74960]: INFO nova.compute.manager [None req-fdb0185f-e8f5-47a4-a9eb-3180fad87c8a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a] Took 6.86 seconds to spawn the instance on the hypervisor.
Nov 03 12:31:59 user nova-compute[74960]: DEBUG nova.compute.manager [None req-fdb0185f-e8f5-47a4-a9eb-3180fad87c8a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a] Checking state {{(pid=74960) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 12:31:59 user nova-compute[74960]: INFO nova.compute.manager [None req-fdb0185f-e8f5-47a4-a9eb-3180fad87c8a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a] Took 8.06 seconds to build instance.
Nov 03 12:31:59 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-fdb0185f-e8f5-47a4-a9eb-3180fad87c8a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Lock "35e02c80-f626-4918-93f1-6b9a7f778c7a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.536s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:32:00 user nova-compute[74960]: DEBUG nova.compute.manager [req-1c9fe04a-dd73-45c7-ba3b-89a78cac2ca4 req-d12c2ab5-b0a3-4ff9-9f00-a068fec3f568 service nova] [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a] Received event network-vif-plugged-4a3a2b1f-db29-441d-9bf9-7f429760ae05 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:32:00 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-1c9fe04a-dd73-45c7-ba3b-89a78cac2ca4 req-d12c2ab5-b0a3-4ff9-9f00-a068fec3f568 service nova] Acquiring lock "35e02c80-f626-4918-93f1-6b9a7f778c7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:32:00 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-1c9fe04a-dd73-45c7-ba3b-89a78cac2ca4 req-d12c2ab5-b0a3-4ff9-9f00-a068fec3f568 service nova] Lock "35e02c80-f626-4918-93f1-6b9a7f778c7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:32:00 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-1c9fe04a-dd73-45c7-ba3b-89a78cac2ca4 req-d12c2ab5-b0a3-4ff9-9f00-a068fec3f568 service nova] Lock "35e02c80-f626-4918-93f1-6b9a7f778c7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:32:00 user nova-compute[74960]: DEBUG nova.compute.manager [req-1c9fe04a-dd73-45c7-ba3b-89a78cac2ca4 req-d12c2ab5-b0a3-4ff9-9f00-a068fec3f568 service nova] [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a] No waiting events found dispatching network-vif-plugged-4a3a2b1f-db29-441d-9bf9-7f429760ae05 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:32:00 user nova-compute[74960]: WARNING nova.compute.manager [req-1c9fe04a-dd73-45c7-ba3b-89a78cac2ca4 req-d12c2ab5-b0a3-4ff9-9f00-a068fec3f568 service nova] [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a] Received unexpected event network-vif-plugged-4a3a2b1f-db29-441d-9bf9-7f429760ae05 for instance with vm_state active and task_state None.
Nov 03 12:32:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:32:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:32:02 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c11d6552-66e0-4fc9-b77e-3e44334be59c tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Acquiring lock "47eb8ddf-590f-4ffa-87c8-377cf1ee0f67" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:32:02 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c11d6552-66e0-4fc9-b77e-3e44334be59c tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Lock "47eb8ddf-590f-4ffa-87c8-377cf1ee0f67" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:32:02 user nova-compute[74960]: DEBUG nova.compute.manager [None req-c11d6552-66e0-4fc9-b77e-3e44334be59c tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67] Starting instance... {{(pid=74960) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 12:32:02 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c11d6552-66e0-4fc9-b77e-3e44334be59c tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:32:02 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c11d6552-66e0-4fc9-b77e-3e44334be59c tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:32:02 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-c11d6552-66e0-4fc9-b77e-3e44334be59c tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74960) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 12:32:02 user nova-compute[74960]: INFO nova.compute.claims [None req-c11d6552-66e0-4fc9-b77e-3e44334be59c tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67] Claim successful on node user
Nov 03 12:32:02 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-c11d6552-66e0-4fc9-b77e-3e44334be59c tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:32:02 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-c11d6552-66e0-4fc9-b77e-3e44334be59c tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:32:02 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c11d6552-66e0-4fc9-b77e-3e44334be59c tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.396s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:32:02 user nova-compute[74960]: DEBUG nova.compute.manager [None req-c11d6552-66e0-4fc9-b77e-3e44334be59c tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67] Start building networks asynchronously for instance. {{(pid=74960) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 12:32:03 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-02b12688-c175-44ff-b6ff-81c3f525e79a tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Acquiring lock "b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:32:03 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-02b12688-c175-44ff-b6ff-81c3f525e79a tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Lock "b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:32:03 user nova-compute[74960]: DEBUG nova.compute.manager [None req-02b12688-c175-44ff-b6ff-81c3f525e79a tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d] Starting instance... {{(pid=74960) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 12:32:03 user nova-compute[74960]: DEBUG nova.compute.manager [None req-c11d6552-66e0-4fc9-b77e-3e44334be59c tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67] Allocating IP information in the background. {{(pid=74960) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 12:32:03 user nova-compute[74960]: DEBUG nova.network.neutron [None req-c11d6552-66e0-4fc9-b77e-3e44334be59c tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67] allocate_for_instance() {{(pid=74960) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 12:32:03 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-c11d6552-66e0-4fc9-b77e-3e44334be59c tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 12:32:03 user nova-compute[74960]: DEBUG nova.compute.manager [None req-c11d6552-66e0-4fc9-b77e-3e44334be59c tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67] Start building block device mappings for instance. {{(pid=74960) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 12:32:03 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-02b12688-c175-44ff-b6ff-81c3f525e79a tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:32:03 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-02b12688-c175-44ff-b6ff-81c3f525e79a tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:32:03 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-02b12688-c175-44ff-b6ff-81c3f525e79a tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74960) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 12:32:03 user nova-compute[74960]: INFO nova.compute.claims [None req-02b12688-c175-44ff-b6ff-81c3f525e79a tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d] Claim successful on node user
Nov 03 12:32:03 user nova-compute[74960]: DEBUG nova.policy [None req-c11d6552-66e0-4fc9-b77e-3e44334be59c tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '82a995b6307c4ba0b4cf8d5ede286a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434ce6c4b77342299a17e547a14e3918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74960) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 12:32:03 user nova-compute[74960]: DEBUG nova.compute.manager [None req-c11d6552-66e0-4fc9-b77e-3e44334be59c tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67] Start spawning the instance on the hypervisor. {{(pid=74960) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 12:32:03 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-c11d6552-66e0-4fc9-b77e-3e44334be59c tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67] Creating instance directory {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 12:32:03 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-c11d6552-66e0-4fc9-b77e-3e44334be59c tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67] Creating image(s)
Nov 03 12:32:03 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c11d6552-66e0-4fc9-b77e-3e44334be59c tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Acquiring lock "/opt/stack/data/nova/instances/47eb8ddf-590f-4ffa-87c8-377cf1ee0f67/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:32:03 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c11d6552-66e0-4fc9-b77e-3e44334be59c tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Lock "/opt/stack/data/nova/instances/47eb8ddf-590f-4ffa-87c8-377cf1ee0f67/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:32:03 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c11d6552-66e0-4fc9-b77e-3e44334be59c tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Lock "/opt/stack/data/nova/instances/47eb8ddf-590f-4ffa-87c8-377cf1ee0f67/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:32:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-c11d6552-66e0-4fc9-b77e-3e44334be59c tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:32:03 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:32:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-c11d6552-66e0-4fc9-b77e-3e44334be59c tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.197s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:32:03 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c11d6552-66e0-4fc9-b77e-3e44334be59c tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Acquiring lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:32:03 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c11d6552-66e0-4fc9-b77e-3e44334be59c tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:32:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-c11d6552-66e0-4fc9-b77e-3e44334be59c tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:32:03 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-02b12688-c175-44ff-b6ff-81c3f525e79a tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:32:03 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-02b12688-c175-44ff-b6ff-81c3f525e79a tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:32:03 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-02b12688-c175-44ff-b6ff-81c3f525e79a tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.529s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:32:03 user nova-compute[74960]: DEBUG nova.compute.manager [None req-02b12688-c175-44ff-b6ff-81c3f525e79a tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d] Start building networks asynchronously for instance. {{(pid=74960) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 12:32:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-c11d6552-66e0-4fc9-b77e-3e44334be59c tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.210s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:32:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-c11d6552-66e0-4fc9-b77e-3e44334be59c tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910,backing_fmt=raw /opt/stack/data/nova/instances/47eb8ddf-590f-4ffa-87c8-377cf1ee0f67/disk 1073741824 {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:32:03 user nova-compute[74960]: DEBUG nova.compute.manager [None req-02b12688-c175-44ff-b6ff-81c3f525e79a tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d] Allocating IP information in the background. {{(pid=74960) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 12:32:03 user nova-compute[74960]: DEBUG nova.network.neutron [None req-02b12688-c175-44ff-b6ff-81c3f525e79a tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d] allocate_for_instance() {{(pid=74960) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 12:32:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-c11d6552-66e0-4fc9-b77e-3e44334be59c tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910,backing_fmt=raw /opt/stack/data/nova/instances/47eb8ddf-590f-4ffa-87c8-377cf1ee0f67/disk 1073741824" returned: 0 in 0.076s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:32:03 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c11d6552-66e0-4fc9-b77e-3e44334be59c tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.290s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:32:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-c11d6552-66e0-4fc9-b77e-3e44334be59c tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:32:03 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-02b12688-c175-44ff-b6ff-81c3f525e79a tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 12:32:03 user nova-compute[74960]: DEBUG nova.compute.manager [None req-02b12688-c175-44ff-b6ff-81c3f525e79a tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d] Start building block device mappings for instance. {{(pid=74960) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 12:32:03 user nova-compute[74960]: DEBUG nova.network.neutron [None req-c11d6552-66e0-4fc9-b77e-3e44334be59c tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67] Successfully created port: 844c85e9-5021-433d-9f93-530ec193e265 {{(pid=74960) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 12:32:03 user nova-compute[74960]: DEBUG nova.policy [None req-02b12688-c175-44ff-b6ff-81c3f525e79a tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '82a995b6307c4ba0b4cf8d5ede286a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434ce6c4b77342299a17e547a14e3918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74960) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 12:32:03 user nova-compute[74960]: DEBUG nova.compute.manager [None req-02b12688-c175-44ff-b6ff-81c3f525e79a tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d] Start spawning the instance on the hypervisor. {{(pid=74960) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 12:32:03 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-02b12688-c175-44ff-b6ff-81c3f525e79a tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d] Creating instance directory {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 12:32:03 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-02b12688-c175-44ff-b6ff-81c3f525e79a tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d] Creating image(s)
Nov 03 12:32:03 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-02b12688-c175-44ff-b6ff-81c3f525e79a tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Acquiring lock "/opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:32:03 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-02b12688-c175-44ff-b6ff-81c3f525e79a tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Lock "/opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:32:03 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-02b12688-c175-44ff-b6ff-81c3f525e79a tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Lock "/opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:32:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-02b12688-c175-44ff-b6ff-81c3f525e79a tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:32:04 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-c11d6552-66e0-4fc9-b77e-3e44334be59c tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.239s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:32:04 user nova-compute[74960]: DEBUG nova.virt.disk.api [None req-c11d6552-66e0-4fc9-b77e-3e44334be59c tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Checking if we can resize image /opt/stack/data/nova/instances/47eb8ddf-590f-4ffa-87c8-377cf1ee0f67/disk. size=1073741824 {{(pid=74960) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 12:32:04 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-c11d6552-66e0-4fc9-b77e-3e44334be59c tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47eb8ddf-590f-4ffa-87c8-377cf1ee0f67/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:32:04 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-02b12688-c175-44ff-b6ff-81c3f525e79a tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.187s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:32:04 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-02b12688-c175-44ff-b6ff-81c3f525e79a tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Acquiring lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:32:04 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-02b12688-c175-44ff-b6ff-81c3f525e79a tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:32:04 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-02b12688-c175-44ff-b6ff-81c3f525e79a tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:32:04 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-c11d6552-66e0-4fc9-b77e-3e44334be59c tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47eb8ddf-590f-4ffa-87c8-377cf1ee0f67/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:32:04 user nova-compute[74960]: DEBUG nova.virt.disk.api [None req-c11d6552-66e0-4fc9-b77e-3e44334be59c tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Cannot resize image /opt/stack/data/nova/instances/47eb8ddf-590f-4ffa-87c8-377cf1ee0f67/disk to a smaller size. {{(pid=74960) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 12:32:04 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-c11d6552-66e0-4fc9-b77e-3e44334be59c tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67] Created local disks {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 12:32:04 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-c11d6552-66e0-4fc9-b77e-3e44334be59c tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67] Ensure instance console log exists: /opt/stack/data/nova/instances/47eb8ddf-590f-4ffa-87c8-377cf1ee0f67/console.log {{(pid=74960) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 12:32:04 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c11d6552-66e0-4fc9-b77e-3e44334be59c tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:32:04 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c11d6552-66e0-4fc9-b77e-3e44334be59c tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:32:04 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c11d6552-66e0-4fc9-b77e-3e44334be59c tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:32:04 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-02b12688-c175-44ff-b6ff-81c3f525e79a tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.181s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:32:04 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-02b12688-c175-44ff-b6ff-81c3f525e79a tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910,backing_fmt=raw /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk 1073741824 {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:32:04 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-02b12688-c175-44ff-b6ff-81c3f525e79a tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910,backing_fmt=raw /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk 1073741824" returned: 0 in 0.080s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:32:04 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-02b12688-c175-44ff-b6ff-81c3f525e79a tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.277s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:32:04 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-02b12688-c175-44ff-b6ff-81c3f525e79a tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:32:04 user nova-compute[74960]: DEBUG nova.network.neutron [None req-c11d6552-66e0-4fc9-b77e-3e44334be59c tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67] Successfully updated port: 844c85e9-5021-433d-9f93-530ec193e265 {{(pid=74960) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 12:32:04 user nova-compute[74960]: DEBUG nova.network.neutron [None req-02b12688-c175-44ff-b6ff-81c3f525e79a tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d] Successfully created port: b0f443c5-8a12-41fd-9275-81b88b3c08fd {{(pid=74960) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 12:32:04 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c11d6552-66e0-4fc9-b77e-3e44334be59c tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Acquiring lock "refresh_cache-47eb8ddf-590f-4ffa-87c8-377cf1ee0f67" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:32:04 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c11d6552-66e0-4fc9-b77e-3e44334be59c tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Acquired lock "refresh_cache-47eb8ddf-590f-4ffa-87c8-377cf1ee0f67" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:32:04 user nova-compute[74960]: DEBUG nova.network.neutron [None req-c11d6552-66e0-4fc9-b77e-3e44334be59c tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67] Building network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 12:32:04 user nova-compute[74960]: DEBUG nova.compute.manager [req-223effdc-f722-430a-ba27-955b11c86f13 req-f7c92c1c-5cc1-4932-863f-353bc1e140b8 service nova] [instance: 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67] Received event network-changed-844c85e9-5021-433d-9f93-530ec193e265 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:32:04 user nova-compute[74960]: DEBUG nova.compute.manager [req-223effdc-f722-430a-ba27-955b11c86f13 req-f7c92c1c-5cc1-4932-863f-353bc1e140b8 service nova] [instance: 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67] Refreshing instance network info cache due to event network-changed-844c85e9-5021-433d-9f93-530ec193e265. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 12:32:04 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-223effdc-f722-430a-ba27-955b11c86f13 req-f7c92c1c-5cc1-4932-863f-353bc1e140b8 service nova] Acquiring lock "refresh_cache-47eb8ddf-590f-4ffa-87c8-377cf1ee0f67" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:32:04 user nova-compute[74960]: DEBUG nova.network.neutron [None req-c11d6552-66e0-4fc9-b77e-3e44334be59c tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67] Instance cache missing network info. {{(pid=74960) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 12:32:04 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-02b12688-c175-44ff-b6ff-81c3f525e79a tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.267s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:32:04 user nova-compute[74960]: DEBUG nova.virt.disk.api [None req-02b12688-c175-44ff-b6ff-81c3f525e79a tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk. size=1073741824 {{(pid=74960) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 12:32:04 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-02b12688-c175-44ff-b6ff-81c3f525e79a tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:32:04 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-02b12688-c175-44ff-b6ff-81c3f525e79a tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:32:04 user nova-compute[74960]: DEBUG nova.virt.disk.api [None req-02b12688-c175-44ff-b6ff-81c3f525e79a tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Cannot resize image /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk to a smaller size. {{(pid=74960) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 12:32:04 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-02b12688-c175-44ff-b6ff-81c3f525e79a tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d] Created local disks {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 12:32:04 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-02b12688-c175-44ff-b6ff-81c3f525e79a tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d] Ensure instance console log exists: /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/console.log {{(pid=74960) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 12:32:04 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-02b12688-c175-44ff-b6ff-81c3f525e79a tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:32:04 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-02b12688-c175-44ff-b6ff-81c3f525e79a tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:32:04 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-02b12688-c175-44ff-b6ff-81c3f525e79a tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:32:04 user nova-compute[74960]: DEBUG nova.network.neutron [None req-c11d6552-66e0-4fc9-b77e-3e44334be59c tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67] Updating instance_info_cache with network_info: [{"id": "844c85e9-5021-433d-9f93-530ec193e265", "address": "fa:16:3e:69:d8:32", "network": {"id": "9a9a848a-80be-4281-8554-8e28744073b3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1579909169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "434ce6c4b77342299a17e547a14e3918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap844c85e9-50", "ovs_interfaceid": "844c85e9-5021-433d-9f93-530ec193e265", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:32:04 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c11d6552-66e0-4fc9-b77e-3e44334be59c tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Releasing lock "refresh_cache-47eb8ddf-590f-4ffa-87c8-377cf1ee0f67" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:32:04 user nova-compute[74960]: DEBUG nova.compute.manager [None req-c11d6552-66e0-4fc9-b77e-3e44334be59c tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67] Instance network_info: |[{"id": "844c85e9-5021-433d-9f93-530ec193e265", "address": "fa:16:3e:69:d8:32", "network": {"id": "9a9a848a-80be-4281-8554-8e28744073b3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1579909169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "434ce6c4b77342299a17e547a14e3918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap844c85e9-50", "ovs_interfaceid": "844c85e9-5021-433d-9f93-530ec193e265", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74960) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 12:32:04 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-223effdc-f722-430a-ba27-955b11c86f13 req-f7c92c1c-5cc1-4932-863f-353bc1e140b8 service nova] Acquired lock "refresh_cache-47eb8ddf-590f-4ffa-87c8-377cf1ee0f67" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:32:04 user nova-compute[74960]: DEBUG nova.network.neutron [req-223effdc-f722-430a-ba27-955b11c86f13 req-f7c92c1c-5cc1-4932-863f-353bc1e140b8 service nova] [instance: 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67] Refreshing network info cache for port 844c85e9-5021-433d-9f93-530ec193e265 {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 12:32:04 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-c11d6552-66e0-4fc9-b77e-3e44334be59c tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67] Start _get_guest_xml network_info=[{"id": "844c85e9-5021-433d-9f93-530ec193e265", "address": "fa:16:3e:69:d8:32", "network": {"id": "9a9a848a-80be-4281-8554-8e28744073b3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1579909169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "434ce6c4b77342299a17e547a14e3918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap844c85e9-50", "ovs_interfaceid": "844c85e9-5021-433d-9f93-530ec193e265", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=549f51ba-ac69-494b-8de1-34635aa2d7cf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='63ee9c80c632442fb0379f47b784bd20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T12:13:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'image_id': '549f51ba-ac69-494b-8de1-34635aa2d7cf'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 12:32:05 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-c11d6552-66e0-4fc9-b77e-3e44334be59c tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:32:05 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-c11d6552-66e0-4fc9-b77e-3e44334be59c tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:32:05 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-c11d6552-66e0-4fc9-b77e-3e44334be59c tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 12:32:05 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-c11d6552-66e0-4fc9-b77e-3e44334be59c tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] CPU controller missing on host. {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 12:32:05 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-c11d6552-66e0-4fc9-b77e-3e44334be59c tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 12:32:05 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-c11d6552-66e0-4fc9-b77e-3e44334be59c tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] CPU controller found on host. {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 12:32:05 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-c11d6552-66e0-4fc9-b77e-3e44334be59c tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74960) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 12:32:05 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-c11d6552-66e0-4fc9-b77e-3e44334be59c tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=549f51ba-ac69-494b-8de1-34635aa2d7cf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='63ee9c80c632442fb0379f47b784bd20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T12:13:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 12:32:05 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-c11d6552-66e0-4fc9-b77e-3e44334be59c tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Flavor limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 12:32:05 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-c11d6552-66e0-4fc9-b77e-3e44334be59c tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Image limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 12:32:05 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-c11d6552-66e0-4fc9-b77e-3e44334be59c tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Flavor pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 12:32:05 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-c11d6552-66e0-4fc9-b77e-3e44334be59c tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Image pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 12:32:05 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-c11d6552-66e0-4fc9-b77e-3e44334be59c tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 12:32:05 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-c11d6552-66e0-4fc9-b77e-3e44334be59c tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 12:32:05 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-c11d6552-66e0-4fc9-b77e-3e44334be59c tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 12:32:05 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-c11d6552-66e0-4fc9-b77e-3e44334be59c tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Got 1 possible topologies {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 12:32:05 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-c11d6552-66e0-4fc9-b77e-3e44334be59c tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 12:32:05 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-c11d6552-66e0-4fc9-b77e-3e44334be59c tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 12:32:05 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-c11d6552-66e0-4fc9-b77e-3e44334be59c tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:32:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-12909418',display_name='tempest-ServerRescueNegativeTestJSON-server-12909418',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-12909418',id=31,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='434ce6c4b77342299a17e547a14e3918',ramdisk_id='',reservation_id='r-wi42y0oc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1678469488',owner_user_name='tempest-ServerRescueNegativeTestJSON-1678469488-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:32:03Z,user_data=None,user_id='82a995b6307c4ba0b4cf8d5ede286a6c',uuid=47eb8ddf-590f-4ffa-87c8-377cf1ee0f67,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "844c85e9-5021-433d-9f93-530ec193e265", "address": "fa:16:3e:69:d8:32", "network": {"id": "9a9a848a-80be-4281-8554-8e28744073b3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1579909169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "434ce6c4b77342299a17e547a14e3918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap844c85e9-50", "ovs_interfaceid": "844c85e9-5021-433d-9f93-530ec193e265", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74960) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 12:32:05 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-c11d6552-66e0-4fc9-b77e-3e44334be59c tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Converting VIF {"id": "844c85e9-5021-433d-9f93-530ec193e265", "address": "fa:16:3e:69:d8:32", "network": {"id": "9a9a848a-80be-4281-8554-8e28744073b3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1579909169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "434ce6c4b77342299a17e547a14e3918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap844c85e9-50", "ovs_interfaceid": "844c85e9-5021-433d-9f93-530ec193e265", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:32:05 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-c11d6552-66e0-4fc9-b77e-3e44334be59c tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:d8:32,bridge_name='br-int',has_traffic_filtering=True,id=844c85e9-5021-433d-9f93-530ec193e265,network=Network(9a9a848a-80be-4281-8554-8e28744073b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap844c85e9-50') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:32:05 user nova-compute[74960]: DEBUG nova.objects.instance [None req-c11d6552-66e0-4fc9-b77e-3e44334be59c tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Lazy-loading 'pci_devices' on Instance uuid 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:32:05 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-c11d6552-66e0-4fc9-b77e-3e44334be59c tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67] End _get_guest_xml xml=<domain type="kvm">
Nov 03 12:32:05 user nova-compute[74960]:   <uuid>47eb8ddf-590f-4ffa-87c8-377cf1ee0f67</uuid>
Nov 03 12:32:05 user nova-compute[74960]:   <name>instance-0000001f</name>
Nov 03 12:32:05 user nova-compute[74960]:   <memory>524288</memory>
Nov 03 12:32:05 user nova-compute[74960]:   <vcpu>1</vcpu>
Nov 03 12:32:05 user nova-compute[74960]:   <metadata>
Nov 03 12:32:05 user nova-compute[74960]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 12:32:05 user nova-compute[74960]:       <nova:package version="0.0.0"/>
Nov 03 12:32:05 user nova-compute[74960]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-12909418</nova:name>
Nov 03 12:32:05 user nova-compute[74960]:       <nova:creationTime>2023-11-03 12:32:05</nova:creationTime>
Nov 03 12:32:05 user nova-compute[74960]:       <nova:flavor name="m1.tiny">
Nov 03 12:32:05 user nova-compute[74960]:         <nova:memory>512</nova:memory>
Nov 03 12:32:05 user nova-compute[74960]:         <nova:disk>1</nova:disk>
Nov 03 12:32:05 user nova-compute[74960]:         <nova:swap>0</nova:swap>
Nov 03 12:32:05 user nova-compute[74960]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 12:32:05 user nova-compute[74960]:         <nova:vcpus>1</nova:vcpus>
Nov 03 12:32:05 user nova-compute[74960]:       </nova:flavor>
Nov 03 12:32:05 user nova-compute[74960]:       <nova:owner>
Nov 03 12:32:05 user nova-compute[74960]:         <nova:user uuid="82a995b6307c4ba0b4cf8d5ede286a6c">tempest-ServerRescueNegativeTestJSON-1678469488-project-member</nova:user>
Nov 03 12:32:05 user nova-compute[74960]:         <nova:project uuid="434ce6c4b77342299a17e547a14e3918">tempest-ServerRescueNegativeTestJSON-1678469488</nova:project>
Nov 03 12:32:05 user nova-compute[74960]:       </nova:owner>
Nov 03 12:32:05 user nova-compute[74960]:       <nova:root type="image" uuid="549f51ba-ac69-494b-8de1-34635aa2d7cf"/>
Nov 03 12:32:05 user nova-compute[74960]:       <nova:ports>
Nov 03 12:32:05 user nova-compute[74960]:         <nova:port uuid="844c85e9-5021-433d-9f93-530ec193e265">
Nov 03 12:32:05 user nova-compute[74960]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 03 12:32:05 user nova-compute[74960]:         </nova:port>
Nov 03 12:32:05 user nova-compute[74960]:       </nova:ports>
Nov 03 12:32:05 user nova-compute[74960]:     </nova:instance>
Nov 03 12:32:05 user nova-compute[74960]:   </metadata>
Nov 03 12:32:05 user nova-compute[74960]:   <sysinfo type="smbios">
Nov 03 12:32:05 user nova-compute[74960]:     <system>
Nov 03 12:32:05 user nova-compute[74960]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 12:32:05 user nova-compute[74960]:       <entry name="product">OpenStack Nova</entry>
Nov 03 12:32:05 user nova-compute[74960]:       <entry name="version">0.0.0</entry>
Nov 03 12:32:05 user nova-compute[74960]:       <entry name="serial">47eb8ddf-590f-4ffa-87c8-377cf1ee0f67</entry>
Nov 03 12:32:05 user nova-compute[74960]:       <entry name="uuid">47eb8ddf-590f-4ffa-87c8-377cf1ee0f67</entry>
Nov 03 12:32:05 user nova-compute[74960]:       <entry name="family">Virtual Machine</entry>
Nov 03 12:32:05 user nova-compute[74960]:     </system>
Nov 03 12:32:05 user nova-compute[74960]:   </sysinfo>
Nov 03 12:32:05 user nova-compute[74960]:   <os>
Nov 03 12:32:05 user nova-compute[74960]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 12:32:05 user nova-compute[74960]:     <boot dev="hd"/>
Nov 03 12:32:05 user nova-compute[74960]:     <smbios mode="sysinfo"/>
Nov 03 12:32:05 user nova-compute[74960]:   </os>
Nov 03 12:32:05 user nova-compute[74960]:   <features>
Nov 03 12:32:05 user nova-compute[74960]:     <acpi/>
Nov 03 12:32:05 user nova-compute[74960]:     <apic/>
Nov 03 12:32:05 user nova-compute[74960]:     <vmcoreinfo/>
Nov 03 12:32:05 user nova-compute[74960]:   </features>
Nov 03 12:32:05 user nova-compute[74960]:   <clock offset="utc">
Nov 03 12:32:05 user nova-compute[74960]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 12:32:05 user nova-compute[74960]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 12:32:05 user nova-compute[74960]:     <timer name="hpet" present="no"/>
Nov 03 12:32:05 user nova-compute[74960]:   </clock>
Nov 03 12:32:05 user nova-compute[74960]:   <cpu mode="custom" match="exact">
Nov 03 12:32:05 user nova-compute[74960]:     <model>Nehalem</model>
Nov 03 12:32:05 user nova-compute[74960]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 12:32:05 user nova-compute[74960]:   </cpu>
Nov 03 12:32:05 user nova-compute[74960]:   <devices>
Nov 03 12:32:05 user nova-compute[74960]:     <disk type="file" device="disk">
Nov 03 12:32:05 user nova-compute[74960]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 12:32:05 user nova-compute[74960]:       <source file="/opt/stack/data/nova/instances/47eb8ddf-590f-4ffa-87c8-377cf1ee0f67/disk"/>
Nov 03 12:32:05 user nova-compute[74960]:       <target dev="vda" bus="virtio"/>
Nov 03 12:32:05 user nova-compute[74960]:     </disk>
Nov 03 12:32:05 user nova-compute[74960]:     <interface type="ethernet">
Nov 03 12:32:05 user nova-compute[74960]:       <mac address="fa:16:3e:69:d8:32"/>
Nov 03 12:32:05 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:32:05 user nova-compute[74960]:       <mtu size="1442"/>
Nov 03 12:32:05 user nova-compute[74960]:       <target dev="tap844c85e9-50"/>
Nov 03 12:32:05 user nova-compute[74960]:     </interface>
Nov 03 12:32:05 user nova-compute[74960]:     <serial type="pty">
Nov 03 12:32:05 user nova-compute[74960]:       <log file="/opt/stack/data/nova/instances/47eb8ddf-590f-4ffa-87c8-377cf1ee0f67/console.log" append="off"/>
Nov 03 12:32:05 user nova-compute[74960]:     </serial>
Nov 03 12:32:05 user nova-compute[74960]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 12:32:05 user nova-compute[74960]:     <video>
Nov 03 12:32:05 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:32:05 user nova-compute[74960]:     </video>
Nov 03 12:32:05 user nova-compute[74960]:     <rng model="virtio">
Nov 03 12:32:05 user nova-compute[74960]:       <backend model="random">/dev/urandom</backend>
Nov 03 12:32:05 user nova-compute[74960]:     </rng>
Nov 03 12:32:05 user nova-compute[74960]:     <controller type="usb" index="0" model="none"/>
Nov 03 12:32:05 user nova-compute[74960]:     <memballoon model="virtio">
Nov 03 12:32:05 user nova-compute[74960]:       <stats period="10"/>
Nov 03 12:32:05 user nova-compute[74960]:     </memballoon>
Nov 03 12:32:05 user nova-compute[74960]:   </devices>
Nov 03 12:32:05 user nova-compute[74960]: </domain>
Nov 03 12:32:05 user nova-compute[74960]:  {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 12:32:05 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-c11d6552-66e0-4fc9-b77e-3e44334be59c tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:32:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-12909418',display_name='tempest-ServerRescueNegativeTestJSON-server-12909418',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-12909418',id=31,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='434ce6c4b77342299a17e547a14e3918',ramdisk_id='',reservation_id='r-wi42y0oc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1678469488',owner_user_name='tempest-ServerRescueNegativeTestJSON-1678469488-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:32:03Z,user_data=None,user_id='82a995b6307c4ba0b4cf8d5ede286a6c',uuid=47eb8ddf-590f-4ffa-87c8-377cf1ee0f67,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "844c85e9-5021-433d-9f93-530ec193e265", "address": "fa:16:3e:69:d8:32", "network": {"id": "9a9a848a-80be-4281-8554-8e28744073b3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1579909169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "434ce6c4b77342299a17e547a14e3918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap844c85e9-50", "ovs_interfaceid": "844c85e9-5021-433d-9f93-530ec193e265", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 12:32:05 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-c11d6552-66e0-4fc9-b77e-3e44334be59c tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Converting VIF {"id": "844c85e9-5021-433d-9f93-530ec193e265", "address": "fa:16:3e:69:d8:32", "network": {"id": "9a9a848a-80be-4281-8554-8e28744073b3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1579909169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "434ce6c4b77342299a17e547a14e3918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap844c85e9-50", "ovs_interfaceid": "844c85e9-5021-433d-9f93-530ec193e265", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:32:05 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-c11d6552-66e0-4fc9-b77e-3e44334be59c tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:d8:32,bridge_name='br-int',has_traffic_filtering=True,id=844c85e9-5021-433d-9f93-530ec193e265,network=Network(9a9a848a-80be-4281-8554-8e28744073b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap844c85e9-50') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:32:05 user nova-compute[74960]: DEBUG os_vif [None req-c11d6552-66e0-4fc9-b77e-3e44334be59c tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:d8:32,bridge_name='br-int',has_traffic_filtering=True,id=844c85e9-5021-433d-9f93-530ec193e265,network=Network(9a9a848a-80be-4281-8554-8e28744073b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap844c85e9-50') {{(pid=74960) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 12:32:05 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:32:05 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:32:05 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 12:32:05 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:32:05 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '439bea2b-14ef-5b18-9e8d-abf8235871b0', '_type': 'linux-noop'}}, row=False) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:32:05 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:32:05 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:32:05 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:32:05 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap844c85e9-50, may_exist=True, interface_attrs={}) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:32:05 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap844c85e9-50, col_values=(('qos', UUID('d53c2036-cfa6-4ff8-92b8-28086128e470')),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:32:05 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap844c85e9-50, col_values=(('external_ids', {'iface-id': '844c85e9-5021-433d-9f93-530ec193e265', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:69:d8:32', 'vm-uuid': '47eb8ddf-590f-4ffa-87c8-377cf1ee0f67'}),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:32:05 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:32:05 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:32:05 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:32:05 user nova-compute[74960]: INFO os_vif [None req-c11d6552-66e0-4fc9-b77e-3e44334be59c tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:d8:32,bridge_name='br-int',has_traffic_filtering=True,id=844c85e9-5021-433d-9f93-530ec193e265,network=Network(9a9a848a-80be-4281-8554-8e28744073b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap844c85e9-50')
Nov 03 12:32:05 user nova-compute[74960]: DEBUG nova.network.neutron [None req-02b12688-c175-44ff-b6ff-81c3f525e79a tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d] Successfully updated port: b0f443c5-8a12-41fd-9275-81b88b3c08fd {{(pid=74960) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 12:32:05 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-02b12688-c175-44ff-b6ff-81c3f525e79a tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Acquiring lock "refresh_cache-b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:32:05 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-02b12688-c175-44ff-b6ff-81c3f525e79a tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Acquired lock "refresh_cache-b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:32:05 user nova-compute[74960]: DEBUG nova.network.neutron [None req-02b12688-c175-44ff-b6ff-81c3f525e79a tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d] Building network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 12:32:05 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-c11d6552-66e0-4fc9-b77e-3e44334be59c tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] No BDM found with device name vda, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:32:05 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-c11d6552-66e0-4fc9-b77e-3e44334be59c tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] No VIF found with MAC fa:16:3e:69:d8:32, not building metadata {{(pid=74960) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 12:32:05 user nova-compute[74960]: DEBUG nova.network.neutron [None req-02b12688-c175-44ff-b6ff-81c3f525e79a tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d] Instance cache missing network info. {{(pid=74960) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 12:32:05 user nova-compute[74960]: DEBUG nova.compute.manager [req-7f9a5e8c-7c91-45da-a5f1-cf431425be93 req-d010c68d-fc50-4276-8fad-ecaea8d7f214 service nova] [instance: b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d] Received event network-changed-b0f443c5-8a12-41fd-9275-81b88b3c08fd {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:32:05 user nova-compute[74960]: DEBUG nova.compute.manager [req-7f9a5e8c-7c91-45da-a5f1-cf431425be93 req-d010c68d-fc50-4276-8fad-ecaea8d7f214 service nova] [instance: b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d] Refreshing instance network info cache due to event network-changed-b0f443c5-8a12-41fd-9275-81b88b3c08fd. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 12:32:05 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-7f9a5e8c-7c91-45da-a5f1-cf431425be93 req-d010c68d-fc50-4276-8fad-ecaea8d7f214 service nova] Acquiring lock "refresh_cache-b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:32:05 user nova-compute[74960]: DEBUG nova.network.neutron [req-223effdc-f722-430a-ba27-955b11c86f13 req-f7c92c1c-5cc1-4932-863f-353bc1e140b8 service nova] [instance: 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67] Updated VIF entry in instance network info cache for port 844c85e9-5021-433d-9f93-530ec193e265. {{(pid=74960) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 12:32:05 user nova-compute[74960]: DEBUG nova.network.neutron [req-223effdc-f722-430a-ba27-955b11c86f13 req-f7c92c1c-5cc1-4932-863f-353bc1e140b8 service nova] [instance: 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67] Updating instance_info_cache with network_info: [{"id": "844c85e9-5021-433d-9f93-530ec193e265", "address": "fa:16:3e:69:d8:32", "network": {"id": "9a9a848a-80be-4281-8554-8e28744073b3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1579909169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "434ce6c4b77342299a17e547a14e3918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap844c85e9-50", "ovs_interfaceid": "844c85e9-5021-433d-9f93-530ec193e265", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:32:05 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-223effdc-f722-430a-ba27-955b11c86f13 req-f7c92c1c-5cc1-4932-863f-353bc1e140b8 service nova] Releasing lock "refresh_cache-47eb8ddf-590f-4ffa-87c8-377cf1ee0f67" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:32:05 user nova-compute[74960]: DEBUG nova.network.neutron [None req-02b12688-c175-44ff-b6ff-81c3f525e79a tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d] Updating instance_info_cache with network_info: [{"id": "b0f443c5-8a12-41fd-9275-81b88b3c08fd", "address": "fa:16:3e:68:31:70", "network": {"id": "9a9a848a-80be-4281-8554-8e28744073b3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1579909169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "434ce6c4b77342299a17e547a14e3918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0f443c5-8a", "ovs_interfaceid": "b0f443c5-8a12-41fd-9275-81b88b3c08fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:32:05 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-02b12688-c175-44ff-b6ff-81c3f525e79a tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Releasing lock "refresh_cache-b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:32:05 user nova-compute[74960]: DEBUG nova.compute.manager [None req-02b12688-c175-44ff-b6ff-81c3f525e79a tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d] Instance network_info: |[{"id": "b0f443c5-8a12-41fd-9275-81b88b3c08fd", "address": "fa:16:3e:68:31:70", "network": {"id": "9a9a848a-80be-4281-8554-8e28744073b3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1579909169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "434ce6c4b77342299a17e547a14e3918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0f443c5-8a", "ovs_interfaceid": "b0f443c5-8a12-41fd-9275-81b88b3c08fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74960) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 12:32:05 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-7f9a5e8c-7c91-45da-a5f1-cf431425be93 req-d010c68d-fc50-4276-8fad-ecaea8d7f214 service nova] Acquired lock "refresh_cache-b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:32:05 user nova-compute[74960]: DEBUG nova.network.neutron [req-7f9a5e8c-7c91-45da-a5f1-cf431425be93 req-d010c68d-fc50-4276-8fad-ecaea8d7f214 service nova] [instance: b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d] Refreshing network info cache for port b0f443c5-8a12-41fd-9275-81b88b3c08fd {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 12:32:05 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-02b12688-c175-44ff-b6ff-81c3f525e79a tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d] Start _get_guest_xml network_info=[{"id": "b0f443c5-8a12-41fd-9275-81b88b3c08fd", "address": "fa:16:3e:68:31:70", "network": {"id": "9a9a848a-80be-4281-8554-8e28744073b3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1579909169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "434ce6c4b77342299a17e547a14e3918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0f443c5-8a", "ovs_interfaceid": "b0f443c5-8a12-41fd-9275-81b88b3c08fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=549f51ba-ac69-494b-8de1-34635aa2d7cf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='63ee9c80c632442fb0379f47b784bd20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T12:13:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'image_id': '549f51ba-ac69-494b-8de1-34635aa2d7cf'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 12:32:05 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-02b12688-c175-44ff-b6ff-81c3f525e79a tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:32:05 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-02b12688-c175-44ff-b6ff-81c3f525e79a tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:32:05 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-02b12688-c175-44ff-b6ff-81c3f525e79a tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 12:32:05 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-02b12688-c175-44ff-b6ff-81c3f525e79a tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] CPU controller missing on host. {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 12:32:05 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-02b12688-c175-44ff-b6ff-81c3f525e79a tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 12:32:05 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-02b12688-c175-44ff-b6ff-81c3f525e79a tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] CPU controller found on host. {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 12:32:05 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-02b12688-c175-44ff-b6ff-81c3f525e79a tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74960) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 12:32:05 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-02b12688-c175-44ff-b6ff-81c3f525e79a tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=549f51ba-ac69-494b-8de1-34635aa2d7cf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='63ee9c80c632442fb0379f47b784bd20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T12:13:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 12:32:05 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-02b12688-c175-44ff-b6ff-81c3f525e79a tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Flavor limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 12:32:05 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-02b12688-c175-44ff-b6ff-81c3f525e79a tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Image limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 12:32:05 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-02b12688-c175-44ff-b6ff-81c3f525e79a tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Flavor pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 12:32:05 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-02b12688-c175-44ff-b6ff-81c3f525e79a tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Image pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 12:32:05 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-02b12688-c175-44ff-b6ff-81c3f525e79a tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 12:32:05 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-02b12688-c175-44ff-b6ff-81c3f525e79a tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 12:32:05 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-02b12688-c175-44ff-b6ff-81c3f525e79a tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 12:32:05 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-02b12688-c175-44ff-b6ff-81c3f525e79a tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Got 1 possible topologies {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 12:32:05 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-02b12688-c175-44ff-b6ff-81c3f525e79a tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 12:32:05 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-02b12688-c175-44ff-b6ff-81c3f525e79a tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 12:32:05 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-02b12688-c175-44ff-b6ff-81c3f525e79a tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:32:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1585096232',display_name='tempest-ServerRescueNegativeTestJSON-server-1585096232',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1585096232',id=32,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='434ce6c4b77342299a17e547a14e3918',ramdisk_id='',reservation_id='r-qfzcokmy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1678469488',owner_user_name='tempest-ServerRescueNegativeTestJSON-1678469488-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:32:04Z,user_data=None,user_id='82a995b6307c4ba0b4cf8d5ede286a6c',uuid=b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b0f443c5-8a12-41fd-9275-81b88b3c08fd", "address": "fa:16:3e:68:31:70", "network": {"id": "9a9a848a-80be-4281-8554-8e28744073b3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1579909169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "434ce6c4b77342299a17e547a14e3918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0f443c5-8a", "ovs_interfaceid": "b0f443c5-8a12-41fd-9275-81b88b3c08fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74960) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 12:32:05 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-02b12688-c175-44ff-b6ff-81c3f525e79a tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Converting VIF {"id": "b0f443c5-8a12-41fd-9275-81b88b3c08fd", "address": "fa:16:3e:68:31:70", "network": {"id": "9a9a848a-80be-4281-8554-8e28744073b3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1579909169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "434ce6c4b77342299a17e547a14e3918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0f443c5-8a", "ovs_interfaceid": "b0f443c5-8a12-41fd-9275-81b88b3c08fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:32:05 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-02b12688-c175-44ff-b6ff-81c3f525e79a tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:31:70,bridge_name='br-int',has_traffic_filtering=True,id=b0f443c5-8a12-41fd-9275-81b88b3c08fd,network=Network(9a9a848a-80be-4281-8554-8e28744073b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0f443c5-8a') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:32:05 user nova-compute[74960]: DEBUG nova.objects.instance [None req-02b12688-c175-44ff-b6ff-81c3f525e79a tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Lazy-loading 'pci_devices' on Instance uuid b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:32:05 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-02b12688-c175-44ff-b6ff-81c3f525e79a tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d] End _get_guest_xml xml=<domain type="kvm">
Nov 03 12:32:05 user nova-compute[74960]:   <uuid>b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d</uuid>
Nov 03 12:32:05 user nova-compute[74960]:   <name>instance-00000020</name>
Nov 03 12:32:05 user nova-compute[74960]:   <memory>524288</memory>
Nov 03 12:32:05 user nova-compute[74960]:   <vcpu>1</vcpu>
Nov 03 12:32:05 user nova-compute[74960]:   <metadata>
Nov 03 12:32:05 user nova-compute[74960]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 12:32:05 user nova-compute[74960]:       <nova:package version="0.0.0"/>
Nov 03 12:32:05 user nova-compute[74960]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1585096232</nova:name>
Nov 03 12:32:05 user nova-compute[74960]:       <nova:creationTime>2023-11-03 12:32:05</nova:creationTime>
Nov 03 12:32:05 user nova-compute[74960]:       <nova:flavor name="m1.tiny">
Nov 03 12:32:05 user nova-compute[74960]:         <nova:memory>512</nova:memory>
Nov 03 12:32:05 user nova-compute[74960]:         <nova:disk>1</nova:disk>
Nov 03 12:32:05 user nova-compute[74960]:         <nova:swap>0</nova:swap>
Nov 03 12:32:05 user nova-compute[74960]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 12:32:05 user nova-compute[74960]:         <nova:vcpus>1</nova:vcpus>
Nov 03 12:32:05 user nova-compute[74960]:       </nova:flavor>
Nov 03 12:32:05 user nova-compute[74960]:       <nova:owner>
Nov 03 12:32:05 user nova-compute[74960]:         <nova:user uuid="82a995b6307c4ba0b4cf8d5ede286a6c">tempest-ServerRescueNegativeTestJSON-1678469488-project-member</nova:user>
Nov 03 12:32:05 user nova-compute[74960]:         <nova:project uuid="434ce6c4b77342299a17e547a14e3918">tempest-ServerRescueNegativeTestJSON-1678469488</nova:project>
Nov 03 12:32:05 user nova-compute[74960]:       </nova:owner>
Nov 03 12:32:05 user nova-compute[74960]:       <nova:root type="image" uuid="549f51ba-ac69-494b-8de1-34635aa2d7cf"/>
Nov 03 12:32:05 user nova-compute[74960]:       <nova:ports>
Nov 03 12:32:05 user nova-compute[74960]:         <nova:port uuid="b0f443c5-8a12-41fd-9275-81b88b3c08fd">
Nov 03 12:32:05 user nova-compute[74960]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 03 12:32:05 user nova-compute[74960]:         </nova:port>
Nov 03 12:32:05 user nova-compute[74960]:       </nova:ports>
Nov 03 12:32:05 user nova-compute[74960]:     </nova:instance>
Nov 03 12:32:05 user nova-compute[74960]:   </metadata>
Nov 03 12:32:05 user nova-compute[74960]:   <sysinfo type="smbios">
Nov 03 12:32:05 user nova-compute[74960]:     <system>
Nov 03 12:32:05 user nova-compute[74960]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 12:32:05 user nova-compute[74960]:       <entry name="product">OpenStack Nova</entry>
Nov 03 12:32:05 user nova-compute[74960]:       <entry name="version">0.0.0</entry>
Nov 03 12:32:05 user nova-compute[74960]:       <entry name="serial">b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d</entry>
Nov 03 12:32:05 user nova-compute[74960]:       <entry name="uuid">b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d</entry>
Nov 03 12:32:05 user nova-compute[74960]:       <entry name="family">Virtual Machine</entry>
Nov 03 12:32:05 user nova-compute[74960]:     </system>
Nov 03 12:32:05 user nova-compute[74960]:   </sysinfo>
Nov 03 12:32:05 user nova-compute[74960]:   <os>
Nov 03 12:32:05 user nova-compute[74960]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 12:32:05 user nova-compute[74960]:     <boot dev="hd"/>
Nov 03 12:32:05 user nova-compute[74960]:     <smbios mode="sysinfo"/>
Nov 03 12:32:05 user nova-compute[74960]:   </os>
Nov 03 12:32:05 user nova-compute[74960]:   <features>
Nov 03 12:32:05 user nova-compute[74960]:     <acpi/>
Nov 03 12:32:05 user nova-compute[74960]:     <apic/>
Nov 03 12:32:05 user nova-compute[74960]:     <vmcoreinfo/>
Nov 03 12:32:05 user nova-compute[74960]:   </features>
Nov 03 12:32:05 user nova-compute[74960]:   <clock offset="utc">
Nov 03 12:32:05 user nova-compute[74960]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 12:32:05 user nova-compute[74960]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 12:32:05 user nova-compute[74960]:     <timer name="hpet" present="no"/>
Nov 03 12:32:05 user nova-compute[74960]:   </clock>
Nov 03 12:32:05 user nova-compute[74960]:   <cpu mode="custom" match="exact">
Nov 03 12:32:05 user nova-compute[74960]:     <model>Nehalem</model>
Nov 03 12:32:05 user nova-compute[74960]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 12:32:05 user nova-compute[74960]:   </cpu>
Nov 03 12:32:05 user nova-compute[74960]:   <devices>
Nov 03 12:32:05 user nova-compute[74960]:     <disk type="file" device="disk">
Nov 03 12:32:05 user nova-compute[74960]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 12:32:05 user nova-compute[74960]:       <source file="/opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk"/>
Nov 03 12:32:05 user nova-compute[74960]:       <target dev="vda" bus="virtio"/>
Nov 03 12:32:05 user nova-compute[74960]:     </disk>
Nov 03 12:32:05 user nova-compute[74960]:     <interface type="ethernet">
Nov 03 12:32:05 user nova-compute[74960]:       <mac address="fa:16:3e:68:31:70"/>
Nov 03 12:32:05 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:32:05 user nova-compute[74960]:       <mtu size="1442"/>
Nov 03 12:32:05 user nova-compute[74960]:       <target dev="tapb0f443c5-8a"/>
Nov 03 12:32:05 user nova-compute[74960]:     </interface>
Nov 03 12:32:05 user nova-compute[74960]:     <serial type="pty">
Nov 03 12:32:05 user nova-compute[74960]:       <log file="/opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/console.log" append="off"/>
Nov 03 12:32:05 user nova-compute[74960]:     </serial>
Nov 03 12:32:05 user nova-compute[74960]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 12:32:05 user nova-compute[74960]:     <video>
Nov 03 12:32:05 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:32:05 user nova-compute[74960]:     </video>
Nov 03 12:32:05 user nova-compute[74960]:     <rng model="virtio">
Nov 03 12:32:05 user nova-compute[74960]:       <backend model="random">/dev/urandom</backend>
Nov 03 12:32:05 user nova-compute[74960]:     </rng>
Nov 03 12:32:05 user nova-compute[74960]:     <controller type="usb" index="0" model="none"/>
Nov 03 12:32:05 user nova-compute[74960]:     <memballoon model="virtio">
Nov 03 12:32:05 user nova-compute[74960]:       <stats period="10"/>
Nov 03 12:32:05 user nova-compute[74960]:     </memballoon>
Nov 03 12:32:05 user nova-compute[74960]:   </devices>
Nov 03 12:32:05 user nova-compute[74960]: </domain>
Nov 03 12:32:05 user nova-compute[74960]:  {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 12:32:05 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-02b12688-c175-44ff-b6ff-81c3f525e79a tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:32:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1585096232',display_name='tempest-ServerRescueNegativeTestJSON-server-1585096232',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1585096232',id=32,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='434ce6c4b77342299a17e547a14e3918',ramdisk_id='',reservation_id='r-qfzcokmy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1678469488',owner_user_name='tempest-ServerRescueNegativeTestJSON-1678469488-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:32:04Z,user_data=None,user_id='82a995b6307c4ba0b4cf8d5ede286a6c',uuid=b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b0f443c5-8a12-41fd-9275-81b88b3c08fd", "address": "fa:16:3e:68:31:70", "network": {"id": "9a9a848a-80be-4281-8554-8e28744073b3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1579909169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "434ce6c4b77342299a17e547a14e3918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0f443c5-8a", "ovs_interfaceid": "b0f443c5-8a12-41fd-9275-81b88b3c08fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 12:32:05 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-02b12688-c175-44ff-b6ff-81c3f525e79a tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Converting VIF {"id": "b0f443c5-8a12-41fd-9275-81b88b3c08fd", "address": "fa:16:3e:68:31:70", "network": {"id": "9a9a848a-80be-4281-8554-8e28744073b3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1579909169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "434ce6c4b77342299a17e547a14e3918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0f443c5-8a", "ovs_interfaceid": "b0f443c5-8a12-41fd-9275-81b88b3c08fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:32:05 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-02b12688-c175-44ff-b6ff-81c3f525e79a tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:31:70,bridge_name='br-int',has_traffic_filtering=True,id=b0f443c5-8a12-41fd-9275-81b88b3c08fd,network=Network(9a9a848a-80be-4281-8554-8e28744073b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0f443c5-8a') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:32:05 user nova-compute[74960]: DEBUG os_vif [None req-02b12688-c175-44ff-b6ff-81c3f525e79a tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:31:70,bridge_name='br-int',has_traffic_filtering=True,id=b0f443c5-8a12-41fd-9275-81b88b3c08fd,network=Network(9a9a848a-80be-4281-8554-8e28744073b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0f443c5-8a') {{(pid=74960) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 12:32:05 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:32:05 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:32:05 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 12:32:05 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:32:05 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e89d643a-21a9-55ef-89ee-a2233fa1f031', '_type': 'linux-noop'}}, row=False) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:32:05 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:32:05 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:32:05 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:32:05 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:32:05 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb0f443c5-8a, may_exist=True, interface_attrs={}) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:32:05 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb0f443c5-8a, col_values=(('qos', UUID('fb4c27e8-594e-474b-87e6-f6f56f926402')),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:32:05 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb0f443c5-8a, col_values=(('external_ids', {'iface-id': 'b0f443c5-8a12-41fd-9275-81b88b3c08fd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:68:31:70', 'vm-uuid': 'b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d'}),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:32:05 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:32:05 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:32:05 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:32:05 user nova-compute[74960]: INFO os_vif [None req-02b12688-c175-44ff-b6ff-81c3f525e79a tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:31:70,bridge_name='br-int',has_traffic_filtering=True,id=b0f443c5-8a12-41fd-9275-81b88b3c08fd,network=Network(9a9a848a-80be-4281-8554-8e28744073b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0f443c5-8a')
Nov 03 12:32:05 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-02b12688-c175-44ff-b6ff-81c3f525e79a tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] No BDM found with device name vda, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:32:05 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-02b12688-c175-44ff-b6ff-81c3f525e79a tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] No VIF found with MAC fa:16:3e:68:31:70, not building metadata {{(pid=74960) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 12:32:06 user nova-compute[74960]: DEBUG nova.network.neutron [req-7f9a5e8c-7c91-45da-a5f1-cf431425be93 req-d010c68d-fc50-4276-8fad-ecaea8d7f214 service nova] [instance: b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d] Updated VIF entry in instance network info cache for port b0f443c5-8a12-41fd-9275-81b88b3c08fd. {{(pid=74960) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 12:32:06 user nova-compute[74960]: DEBUG nova.network.neutron [req-7f9a5e8c-7c91-45da-a5f1-cf431425be93 req-d010c68d-fc50-4276-8fad-ecaea8d7f214 service nova] [instance: b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d] Updating instance_info_cache with network_info: [{"id": "b0f443c5-8a12-41fd-9275-81b88b3c08fd", "address": "fa:16:3e:68:31:70", "network": {"id": "9a9a848a-80be-4281-8554-8e28744073b3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1579909169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "434ce6c4b77342299a17e547a14e3918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0f443c5-8a", "ovs_interfaceid": "b0f443c5-8a12-41fd-9275-81b88b3c08fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:32:06 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-7f9a5e8c-7c91-45da-a5f1-cf431425be93 req-d010c68d-fc50-4276-8fad-ecaea8d7f214 service nova] Releasing lock "refresh_cache-b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:32:07 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:32:07 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:32:07 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:32:07 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:32:07 user nova-compute[74960]: DEBUG nova.compute.manager [req-01ce38b3-3a1f-4d0e-8f12-deb84f5f0991 req-a53587de-dc32-49f3-af9e-24a3e0e3ceff service nova] [instance: 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67] Received event network-vif-plugged-844c85e9-5021-433d-9f93-530ec193e265 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:32:07 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-01ce38b3-3a1f-4d0e-8f12-deb84f5f0991 req-a53587de-dc32-49f3-af9e-24a3e0e3ceff service nova] Acquiring lock "47eb8ddf-590f-4ffa-87c8-377cf1ee0f67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:32:07 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-01ce38b3-3a1f-4d0e-8f12-deb84f5f0991 req-a53587de-dc32-49f3-af9e-24a3e0e3ceff service nova] Lock "47eb8ddf-590f-4ffa-87c8-377cf1ee0f67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:32:07 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-01ce38b3-3a1f-4d0e-8f12-deb84f5f0991 req-a53587de-dc32-49f3-af9e-24a3e0e3ceff service nova] Lock "47eb8ddf-590f-4ffa-87c8-377cf1ee0f67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:32:07 user nova-compute[74960]: DEBUG nova.compute.manager [req-01ce38b3-3a1f-4d0e-8f12-deb84f5f0991 req-a53587de-dc32-49f3-af9e-24a3e0e3ceff service nova] [instance: 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67] No waiting events found dispatching network-vif-plugged-844c85e9-5021-433d-9f93-530ec193e265 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:32:07 user nova-compute[74960]: WARNING nova.compute.manager [req-01ce38b3-3a1f-4d0e-8f12-deb84f5f0991 req-a53587de-dc32-49f3-af9e-24a3e0e3ceff service nova] [instance: 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67] Received unexpected event network-vif-plugged-844c85e9-5021-433d-9f93-530ec193e265 for instance with vm_state building and task_state spawning.
Nov 03 12:32:07 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:32:07 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:32:07 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:32:08 user nova-compute[74960]: DEBUG nova.compute.manager [req-bb9f92ba-2ebd-43cf-b99f-10914d21c6aa req-04c7b4f4-968c-4160-84f1-92bd3cae3216 service nova] [instance: b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d] Received event network-vif-plugged-b0f443c5-8a12-41fd-9275-81b88b3c08fd {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:32:08 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-bb9f92ba-2ebd-43cf-b99f-10914d21c6aa req-04c7b4f4-968c-4160-84f1-92bd3cae3216 service nova] Acquiring lock "b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:32:08 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-bb9f92ba-2ebd-43cf-b99f-10914d21c6aa req-04c7b4f4-968c-4160-84f1-92bd3cae3216 service nova] Lock "b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:32:08 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-bb9f92ba-2ebd-43cf-b99f-10914d21c6aa req-04c7b4f4-968c-4160-84f1-92bd3cae3216 service nova] Lock "b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:32:08 user nova-compute[74960]: DEBUG nova.compute.manager [req-bb9f92ba-2ebd-43cf-b99f-10914d21c6aa req-04c7b4f4-968c-4160-84f1-92bd3cae3216 service nova] [instance: b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d] No waiting events found dispatching network-vif-plugged-b0f443c5-8a12-41fd-9275-81b88b3c08fd {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:32:08 user nova-compute[74960]: WARNING nova.compute.manager [req-bb9f92ba-2ebd-43cf-b99f-10914d21c6aa req-04c7b4f4-968c-4160-84f1-92bd3cae3216 service nova] [instance: b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d] Received unexpected event network-vif-plugged-b0f443c5-8a12-41fd-9275-81b88b3c08fd for instance with vm_state building and task_state spawning.
Nov 03 12:32:08 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:32:08 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:32:08 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:32:08 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:32:08 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:32:08 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:32:08 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:32:09 user nova-compute[74960]: DEBUG nova.compute.manager [req-0a7ec074-fddf-439f-aafa-f2a3e2091e69 req-ae568805-a1d1-4b04-a8e0-19b951d3fe7e service nova] [instance: 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67] Received event network-vif-plugged-844c85e9-5021-433d-9f93-530ec193e265 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:32:09 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-0a7ec074-fddf-439f-aafa-f2a3e2091e69 req-ae568805-a1d1-4b04-a8e0-19b951d3fe7e service nova] Acquiring lock "47eb8ddf-590f-4ffa-87c8-377cf1ee0f67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:32:09 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-0a7ec074-fddf-439f-aafa-f2a3e2091e69 req-ae568805-a1d1-4b04-a8e0-19b951d3fe7e service nova] Lock "47eb8ddf-590f-4ffa-87c8-377cf1ee0f67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:32:09 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-0a7ec074-fddf-439f-aafa-f2a3e2091e69 req-ae568805-a1d1-4b04-a8e0-19b951d3fe7e service nova] Lock "47eb8ddf-590f-4ffa-87c8-377cf1ee0f67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:32:09 user nova-compute[74960]: DEBUG nova.compute.manager [req-0a7ec074-fddf-439f-aafa-f2a3e2091e69 req-ae568805-a1d1-4b04-a8e0-19b951d3fe7e service nova] [instance: 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67] No waiting events found dispatching network-vif-plugged-844c85e9-5021-433d-9f93-530ec193e265 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:32:09 user nova-compute[74960]: WARNING nova.compute.manager [req-0a7ec074-fddf-439f-aafa-f2a3e2091e69 req-ae568805-a1d1-4b04-a8e0-19b951d3fe7e service nova] [instance: 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67] Received unexpected event network-vif-plugged-844c85e9-5021-433d-9f93-530ec193e265 for instance with vm_state building and task_state spawning.
Nov 03 12:32:10 user nova-compute[74960]: DEBUG nova.compute.manager [req-6c5c8719-20d9-4f18-aaae-412fc7a48a86 req-f97d27df-69c6-4cb9-99a8-addbde51488a service nova] [instance: b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d] Received event network-vif-plugged-b0f443c5-8a12-41fd-9275-81b88b3c08fd {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:32:10 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-6c5c8719-20d9-4f18-aaae-412fc7a48a86 req-f97d27df-69c6-4cb9-99a8-addbde51488a service nova] Acquiring lock "b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:32:10 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-6c5c8719-20d9-4f18-aaae-412fc7a48a86 req-f97d27df-69c6-4cb9-99a8-addbde51488a service nova] Lock "b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:32:10 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-6c5c8719-20d9-4f18-aaae-412fc7a48a86 req-f97d27df-69c6-4cb9-99a8-addbde51488a service nova] Lock "b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:32:10 user nova-compute[74960]: DEBUG nova.compute.manager [req-6c5c8719-20d9-4f18-aaae-412fc7a48a86 req-f97d27df-69c6-4cb9-99a8-addbde51488a service nova] [instance: b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d] No waiting events found dispatching network-vif-plugged-b0f443c5-8a12-41fd-9275-81b88b3c08fd {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:32:10 user nova-compute[74960]: WARNING nova.compute.manager [req-6c5c8719-20d9-4f18-aaae-412fc7a48a86 req-f97d27df-69c6-4cb9-99a8-addbde51488a service nova] [instance: b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d] Received unexpected event network-vif-plugged-b0f443c5-8a12-41fd-9275-81b88b3c08fd for instance with vm_state building and task_state spawning.
Nov 03 12:32:10 user nova-compute[74960]: DEBUG nova.compute.manager [None req-c11d6552-66e0-4fc9-b77e-3e44334be59c tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67] Instance event wait completed in 0 seconds for  {{(pid=74960) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 12:32:10 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-c11d6552-66e0-4fc9-b77e-3e44334be59c tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67] Guest created on hypervisor {{(pid=74960) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 12:32:10 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67] Instance spawned successfully.
Nov 03 12:32:10 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-c11d6552-66e0-4fc9-b77e-3e44334be59c tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 12:32:10 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-c11d6552-66e0-4fc9-b77e-3e44334be59c tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67] Found default for hw_cdrom_bus of ide {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:32:10 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-c11d6552-66e0-4fc9-b77e-3e44334be59c tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67] Found default for hw_disk_bus of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:32:10 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-c11d6552-66e0-4fc9-b77e-3e44334be59c tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67] Found default for hw_input_bus of None {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:32:10 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-c11d6552-66e0-4fc9-b77e-3e44334be59c tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67] Found default for hw_pointer_model of None {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:32:10 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-c11d6552-66e0-4fc9-b77e-3e44334be59c tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67] Found default for hw_video_model of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:32:10 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-c11d6552-66e0-4fc9-b77e-3e44334be59c tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67] Found default for hw_vif_model of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:32:10 user nova-compute[74960]: INFO nova.compute.manager [None req-c11d6552-66e0-4fc9-b77e-3e44334be59c tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67] Took 7.30 seconds to spawn the instance on the hypervisor.
Nov 03 12:32:10 user nova-compute[74960]: DEBUG nova.compute.manager [None req-c11d6552-66e0-4fc9-b77e-3e44334be59c tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67] Checking state {{(pid=74960) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 12:32:10 user nova-compute[74960]: DEBUG nova.compute.manager [None req-02b12688-c175-44ff-b6ff-81c3f525e79a tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d] Instance event wait completed in 0 seconds for  {{(pid=74960) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 12:32:10 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-02b12688-c175-44ff-b6ff-81c3f525e79a tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d] Guest created on hypervisor {{(pid=74960) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 12:32:10 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d] Instance spawned successfully.
Nov 03 12:32:10 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-02b12688-c175-44ff-b6ff-81c3f525e79a tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 12:32:10 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-02b12688-c175-44ff-b6ff-81c3f525e79a tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d] Found default for hw_cdrom_bus of ide {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:32:10 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-02b12688-c175-44ff-b6ff-81c3f525e79a tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d] Found default for hw_disk_bus of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:32:10 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-02b12688-c175-44ff-b6ff-81c3f525e79a tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d] Found default for hw_input_bus of None {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:32:10 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-02b12688-c175-44ff-b6ff-81c3f525e79a tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d] Found default for hw_pointer_model of None {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:32:10 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-02b12688-c175-44ff-b6ff-81c3f525e79a tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d] Found default for hw_video_model of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:32:10 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-02b12688-c175-44ff-b6ff-81c3f525e79a tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d] Found default for hw_vif_model of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:32:10 user nova-compute[74960]: INFO nova.compute.manager [None req-c11d6552-66e0-4fc9-b77e-3e44334be59c tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67] Took 8.16 seconds to build instance.
Nov 03 12:32:10 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c11d6552-66e0-4fc9-b77e-3e44334be59c tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Lock "47eb8ddf-590f-4ffa-87c8-377cf1ee0f67" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.257s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:32:10 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:32:10 user nova-compute[74960]: INFO nova.compute.manager [None req-02b12688-c175-44ff-b6ff-81c3f525e79a tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d] Took 6.83 seconds to spawn the instance on the hypervisor.
Nov 03 12:32:10 user nova-compute[74960]: DEBUG nova.compute.manager [None req-02b12688-c175-44ff-b6ff-81c3f525e79a tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d] Checking state {{(pid=74960) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 12:32:10 user nova-compute[74960]: INFO nova.compute.manager [None req-02b12688-c175-44ff-b6ff-81c3f525e79a tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d] Took 7.78 seconds to build instance.
Nov 03 12:32:10 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-02b12688-c175-44ff-b6ff-81c3f525e79a tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Lock "b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.887s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:32:13 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:32:15 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:32:18 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:32:20 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:32:23 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:32:25 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:32:28 user nova-compute[74960]: DEBUG nova.compute.manager [req-6cfb46b3-9c47-4e7e-9dc0-8759dc50000a req-e417341e-d29d-4eb5-89eb-87d08f650415 service nova] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] Received event network-changed-091cbb89-dd8a-448e-963a-3dbcafde6bb1 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:32:28 user nova-compute[74960]: DEBUG nova.compute.manager [req-6cfb46b3-9c47-4e7e-9dc0-8759dc50000a req-e417341e-d29d-4eb5-89eb-87d08f650415 service nova] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] Refreshing instance network info cache due to event network-changed-091cbb89-dd8a-448e-963a-3dbcafde6bb1. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 12:32:28 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-6cfb46b3-9c47-4e7e-9dc0-8759dc50000a req-e417341e-d29d-4eb5-89eb-87d08f650415 service nova] Acquiring lock "refresh_cache-5b7b95c0-3726-4a1c-a384-ec91abf75225" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:32:28 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-6cfb46b3-9c47-4e7e-9dc0-8759dc50000a req-e417341e-d29d-4eb5-89eb-87d08f650415 service nova] Acquired lock "refresh_cache-5b7b95c0-3726-4a1c-a384-ec91abf75225" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:32:28 user nova-compute[74960]: DEBUG nova.network.neutron [req-6cfb46b3-9c47-4e7e-9dc0-8759dc50000a req-e417341e-d29d-4eb5-89eb-87d08f650415 service nova] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] Refreshing network info cache for port 091cbb89-dd8a-448e-963a-3dbcafde6bb1 {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 12:32:28 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:32:28 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:32:29 user nova-compute[74960]: DEBUG nova.network.neutron [req-6cfb46b3-9c47-4e7e-9dc0-8759dc50000a req-e417341e-d29d-4eb5-89eb-87d08f650415 service nova] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] Updated VIF entry in instance network info cache for port 091cbb89-dd8a-448e-963a-3dbcafde6bb1. {{(pid=74960) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 12:32:29 user nova-compute[74960]: DEBUG nova.network.neutron [req-6cfb46b3-9c47-4e7e-9dc0-8759dc50000a req-e417341e-d29d-4eb5-89eb-87d08f650415 service nova] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] Updating instance_info_cache with network_info: [{"id": "091cbb89-dd8a-448e-963a-3dbcafde6bb1", "address": "fa:16:3e:cc:a5:1b", "network": {"id": "3eaeac55-9eb7-4301-b5a7-d13735656d8e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-826950903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9160afcfdb74ba2aad7bc79e628e96f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap091cbb89-dd", "ovs_interfaceid": "091cbb89-dd8a-448e-963a-3dbcafde6bb1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:32:29 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-6cfb46b3-9c47-4e7e-9dc0-8759dc50000a req-e417341e-d29d-4eb5-89eb-87d08f650415 service nova] Releasing lock "refresh_cache-5b7b95c0-3726-4a1c-a384-ec91abf75225" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:32:30 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:32:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:32:35 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:32:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:32:40 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:32:42 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:32:42 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:32:43 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:32:43 user nova-compute[74960]: DEBUG nova.compute.manager [req-ea54e56c-4d38-4a10-99c7-3e2223f62788 req-605a4763-bedb-4569-8ef3-f9436e4924fa service nova] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] Received event network-changed-fe22f17b-b60c-465a-9079-e9c008004741 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:32:43 user nova-compute[74960]: DEBUG nova.compute.manager [req-ea54e56c-4d38-4a10-99c7-3e2223f62788 req-605a4763-bedb-4569-8ef3-f9436e4924fa service nova] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] Refreshing instance network info cache due to event network-changed-fe22f17b-b60c-465a-9079-e9c008004741. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 12:32:43 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-ea54e56c-4d38-4a10-99c7-3e2223f62788 req-605a4763-bedb-4569-8ef3-f9436e4924fa service nova] Acquiring lock "refresh_cache-5dc6cb24-fe58-4e36-bd7f-a67a804a98e1" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:32:43 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-ea54e56c-4d38-4a10-99c7-3e2223f62788 req-605a4763-bedb-4569-8ef3-f9436e4924fa service nova] Acquired lock "refresh_cache-5dc6cb24-fe58-4e36-bd7f-a67a804a98e1" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:32:43 user nova-compute[74960]: DEBUG nova.network.neutron [req-ea54e56c-4d38-4a10-99c7-3e2223f62788 req-605a4763-bedb-4569-8ef3-f9436e4924fa service nova] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] Refreshing network info cache for port fe22f17b-b60c-465a-9079-e9c008004741 {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 12:32:44 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-9ceadb04-054e-401f-a631-b062dd873fd4 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Acquiring lock "5dc6cb24-fe58-4e36-bd7f-a67a804a98e1" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:32:44 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-9ceadb04-054e-401f-a631-b062dd873fd4 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Lock "5dc6cb24-fe58-4e36-bd7f-a67a804a98e1" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:32:44 user nova-compute[74960]: INFO nova.compute.manager [None req-9ceadb04-054e-401f-a631-b062dd873fd4 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] Shelve offloading
Nov 03 12:32:44 user nova-compute[74960]: DEBUG nova.network.neutron [req-ea54e56c-4d38-4a10-99c7-3e2223f62788 req-605a4763-bedb-4569-8ef3-f9436e4924fa service nova] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] Updated VIF entry in instance network info cache for port fe22f17b-b60c-465a-9079-e9c008004741. {{(pid=74960) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 12:32:44 user nova-compute[74960]: DEBUG nova.network.neutron [req-ea54e56c-4d38-4a10-99c7-3e2223f62788 req-605a4763-bedb-4569-8ef3-f9436e4924fa service nova] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] Updating instance_info_cache with network_info: [{"id": "fe22f17b-b60c-465a-9079-e9c008004741", "address": "fa:16:3e:cd:e4:ff", "network": {"id": "a356b90b-cf10-4b3f-802a-aa2656c5588b", "bridge": "br-int", "label": "tempest-TestShelveInstance-1788680557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b44956ba8ca42f29fda6a18ef9fb198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe22f17b-b6", "ovs_interfaceid": "fe22f17b-b60c-465a-9079-e9c008004741", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:32:44 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-ea54e56c-4d38-4a10-99c7-3e2223f62788 req-605a4763-bedb-4569-8ef3-f9436e4924fa service nova] Releasing lock "refresh_cache-5dc6cb24-fe58-4e36-bd7f-a67a804a98e1" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:32:44 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:32:44 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:32:44 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:32:44 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:32:44 user nova-compute[74960]: DEBUG nova.compute.manager [req-8aa88d45-61bf-4ee3-9019-4c926deb9800 req-d2dd5a66-aa3d-47fc-89c5-4b0ba7a4d211 service nova] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] Received event network-vif-unplugged-fe22f17b-b60c-465a-9079-e9c008004741 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:32:44 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-8aa88d45-61bf-4ee3-9019-4c926deb9800 req-d2dd5a66-aa3d-47fc-89c5-4b0ba7a4d211 service nova] Acquiring lock "5dc6cb24-fe58-4e36-bd7f-a67a804a98e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:32:44 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-8aa88d45-61bf-4ee3-9019-4c926deb9800 req-d2dd5a66-aa3d-47fc-89c5-4b0ba7a4d211 service nova] Lock "5dc6cb24-fe58-4e36-bd7f-a67a804a98e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:32:44 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-8aa88d45-61bf-4ee3-9019-4c926deb9800 req-d2dd5a66-aa3d-47fc-89c5-4b0ba7a4d211 service nova] Lock "5dc6cb24-fe58-4e36-bd7f-a67a804a98e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:32:44 user nova-compute[74960]: DEBUG nova.compute.manager [req-8aa88d45-61bf-4ee3-9019-4c926deb9800 req-d2dd5a66-aa3d-47fc-89c5-4b0ba7a4d211 service nova] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] No waiting events found dispatching network-vif-unplugged-fe22f17b-b60c-465a-9079-e9c008004741 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:32:44 user nova-compute[74960]: WARNING nova.compute.manager [req-8aa88d45-61bf-4ee3-9019-4c926deb9800 req-d2dd5a66-aa3d-47fc-89c5-4b0ba7a4d211 service nova] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] Received unexpected event network-vif-unplugged-fe22f17b-b60c-465a-9079-e9c008004741 for instance with vm_state active and task_state shelving.
Nov 03 12:32:45 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:32:45 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:32:45 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] Instance destroyed successfully.
Nov 03 12:32:45 user nova-compute[74960]: DEBUG nova.compute.manager [None req-9ceadb04-054e-401f-a631-b062dd873fd4 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] Checking state {{(pid=74960) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 12:32:45 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-9ceadb04-054e-401f-a631-b062dd873fd4 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Acquiring lock "refresh_cache-5dc6cb24-fe58-4e36-bd7f-a67a804a98e1" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:32:45 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-9ceadb04-054e-401f-a631-b062dd873fd4 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Acquired lock "refresh_cache-5dc6cb24-fe58-4e36-bd7f-a67a804a98e1" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:32:45 user nova-compute[74960]: DEBUG nova.network.neutron [None req-9ceadb04-054e-401f-a631-b062dd873fd4 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] Building network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 12:32:45 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:32:45 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-583245e8-8add-4bff-8655-2ff091247151 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Acquiring lock "5b7b95c0-3726-4a1c-a384-ec91abf75225" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:32:45 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-583245e8-8add-4bff-8655-2ff091247151 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Lock "5b7b95c0-3726-4a1c-a384-ec91abf75225" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:32:45 user nova-compute[74960]: DEBUG nova.objects.instance [None req-583245e8-8add-4bff-8655-2ff091247151 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Lazy-loading 'flavor' on Instance uuid 5b7b95c0-3726-4a1c-a384-ec91abf75225 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:32:45 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-583245e8-8add-4bff-8655-2ff091247151 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Lock "5b7b95c0-3726-4a1c-a384-ec91abf75225" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:32:46 user nova-compute[74960]: DEBUG nova.network.neutron [None req-9ceadb04-054e-401f-a631-b062dd873fd4 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] Updating instance_info_cache with network_info: [{"id": "fe22f17b-b60c-465a-9079-e9c008004741", "address": "fa:16:3e:cd:e4:ff", "network": {"id": "a356b90b-cf10-4b3f-802a-aa2656c5588b", "bridge": "br-int", "label": "tempest-TestShelveInstance-1788680557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b44956ba8ca42f29fda6a18ef9fb198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe22f17b-b6", "ovs_interfaceid": "fe22f17b-b60c-465a-9079-e9c008004741", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:32:46 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-9ceadb04-054e-401f-a631-b062dd873fd4 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Releasing lock "refresh_cache-5dc6cb24-fe58-4e36-bd7f-a67a804a98e1" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:32:46 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-583245e8-8add-4bff-8655-2ff091247151 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Acquiring lock "5b7b95c0-3726-4a1c-a384-ec91abf75225" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:32:46 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-583245e8-8add-4bff-8655-2ff091247151 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Lock "5b7b95c0-3726-4a1c-a384-ec91abf75225" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:32:46 user nova-compute[74960]: INFO nova.compute.manager [None req-583245e8-8add-4bff-8655-2ff091247151 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] Attaching volume c0a0a661-c547-4364-8552-3d6497281515 to /dev/vdb
Nov 03 12:32:46 user nova-compute[74960]: DEBUG os_brick.utils [None req-583245e8-8add-4bff-8655-2ff091247151 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:32:46 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:32:46 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:32:46 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cfde854-affa-4a99-93e6-6b57ab868920]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:75b8e219756\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:32:46 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:32:46 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:32:46 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4777886-8ead-4c44-bff8-0d5c9a02477d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:32:46 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:32:46 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:32:46 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b9212d2-2ff7-4508-8a6a-d437f6d615b5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:32:46 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a30278d-6ed5-4ab7-9471-8f83ea7b998a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:32:46 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-583245e8-8add-4bff-8655-2ff091247151 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Running cmd (subprocess): nvme version {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:32:46 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-583245e8-8add-4bff-8655-2ff091247151 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] 'nvme version' failed. Not Retrying. {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 12:32:46 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.nvmeof [None req-583245e8-8add-4bff-8655-2ff091247151 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] nvme not present on system {{(pid=74960) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 12:32:46 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:32:46 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 12:32:46 user nova-compute[74960]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 12:32:46 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c5ba936-5cd4-45c1-9412-2b0aa8582983]: (4, '') {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:32:46 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-583245e8-8add-4bff-8655-2ff091247151 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74960) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 12:32:46 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-583245e8-8add-4bff-8655-2ff091247151 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74960) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 12:32:46 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-583245e8-8add-4bff-8655-2ff091247151 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] LIGHTOS: no hostnqn found. {{(pid=74960) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 12:32:46 user nova-compute[74960]: DEBUG os_brick.utils [None req-583245e8-8add-4bff-8655-2ff091247151 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:75b8e219756', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:32:46 user nova-compute[74960]: DEBUG nova.virt.block_device [None req-583245e8-8add-4bff-8655-2ff091247151 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] Updating existing volume attachment record: d0c67dcd-fd4b-46a9-a30d-96ccdfebf885 {{(pid=74960) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 12:32:47 user nova-compute[74960]: DEBUG nova.compute.manager [req-01d62eea-d646-47c8-a27f-3e76ea2c3d8e req-92f1dbba-eda3-4d8a-98a4-900ac42fe11c service nova] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] Received event network-vif-plugged-fe22f17b-b60c-465a-9079-e9c008004741 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:32:47 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-01d62eea-d646-47c8-a27f-3e76ea2c3d8e req-92f1dbba-eda3-4d8a-98a4-900ac42fe11c service nova] Acquiring lock "5dc6cb24-fe58-4e36-bd7f-a67a804a98e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:32:47 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-01d62eea-d646-47c8-a27f-3e76ea2c3d8e req-92f1dbba-eda3-4d8a-98a4-900ac42fe11c service nova] Lock "5dc6cb24-fe58-4e36-bd7f-a67a804a98e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:32:47 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-01d62eea-d646-47c8-a27f-3e76ea2c3d8e req-92f1dbba-eda3-4d8a-98a4-900ac42fe11c service nova] Lock "5dc6cb24-fe58-4e36-bd7f-a67a804a98e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:32:47 user nova-compute[74960]: DEBUG nova.compute.manager [req-01d62eea-d646-47c8-a27f-3e76ea2c3d8e req-92f1dbba-eda3-4d8a-98a4-900ac42fe11c service nova] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] No waiting events found dispatching network-vif-plugged-fe22f17b-b60c-465a-9079-e9c008004741 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:32:47 user nova-compute[74960]: WARNING nova.compute.manager [req-01d62eea-d646-47c8-a27f-3e76ea2c3d8e req-92f1dbba-eda3-4d8a-98a4-900ac42fe11c service nova] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] Received unexpected event network-vif-plugged-fe22f17b-b60c-465a-9079-e9c008004741 for instance with vm_state active and task_state shelving.
Nov 03 12:32:47 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] Instance destroyed successfully.
Nov 03 12:32:47 user nova-compute[74960]: DEBUG nova.objects.instance [None req-9ceadb04-054e-401f-a631-b062dd873fd4 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Lazy-loading 'resources' on Instance uuid 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:32:47 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-9ceadb04-054e-401f-a631-b062dd873fd4 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:30:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1397605353',display_name='tempest-TestShelveInstance-server-1397605353',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1397605353',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHFekLWMbWYWoCQaCK9+hxX9ibPEk05TiHGhuFvRfX8RGTVqWkQB1RSDB+6j4GE33fwbvqMtRoW6yWncOnXHVCLVY/+dhav0Db70nMOqH3hrUcyPCb8MFc4JJJomwnEGlA==',key_name='tempest-TestShelveInstance-208551886',keypairs=<?>,launch_index=0,launched_at=2023-11-03T12:31:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3b44956ba8ca42f29fda6a18ef9fb198',ramdisk_id='',reservation_id='r-ait87mp2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1884052938',owner_user_name='tempest-TestShelveInstance-1884052938-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T12:31:36Z,user_data=None,user_id='0e7c95f83f104c0697236508cd538c3e',uuid=5dc6cb24-fe58-4e36-bd7f-a67a804a98e1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fe22f17b-b60c-465a-9079-e9c008004741", "address": "fa:16:3e:cd:e4:ff", "network": {"id": "a356b90b-cf10-4b3f-802a-aa2656c5588b", "bridge": "br-int", "label": "tempest-TestShelveInstance-1788680557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b44956ba8ca42f29fda6a18ef9fb198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe22f17b-b6", "ovs_interfaceid": "fe22f17b-b60c-465a-9079-e9c008004741", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 12:32:47 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-9ceadb04-054e-401f-a631-b062dd873fd4 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Converting VIF {"id": "fe22f17b-b60c-465a-9079-e9c008004741", "address": "fa:16:3e:cd:e4:ff", "network": {"id": "a356b90b-cf10-4b3f-802a-aa2656c5588b", "bridge": "br-int", "label": "tempest-TestShelveInstance-1788680557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b44956ba8ca42f29fda6a18ef9fb198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe22f17b-b6", "ovs_interfaceid": "fe22f17b-b60c-465a-9079-e9c008004741", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:32:47 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-9ceadb04-054e-401f-a631-b062dd873fd4 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:e4:ff,bridge_name='br-int',has_traffic_filtering=True,id=fe22f17b-b60c-465a-9079-e9c008004741,network=Network(a356b90b-cf10-4b3f-802a-aa2656c5588b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe22f17b-b6') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:32:47 user nova-compute[74960]: DEBUG os_vif [None req-9ceadb04-054e-401f-a631-b062dd873fd4 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:e4:ff,bridge_name='br-int',has_traffic_filtering=True,id=fe22f17b-b60c-465a-9079-e9c008004741,network=Network(a356b90b-cf10-4b3f-802a-aa2656c5588b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe22f17b-b6') {{(pid=74960) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 12:32:47 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:32:47 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfe22f17b-b6, bridge=br-int, if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:32:47 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:32:47 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:32:47 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:32:47 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7e13a9c3-1832-4ff7-be07-d0ea52d369b7) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:32:47 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:32:47 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:32:47 user nova-compute[74960]: INFO os_vif [None req-9ceadb04-054e-401f-a631-b062dd873fd4 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:e4:ff,bridge_name='br-int',has_traffic_filtering=True,id=fe22f17b-b60c-465a-9079-e9c008004741,network=Network(a356b90b-cf10-4b3f-802a-aa2656c5588b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe22f17b-b6')
Nov 03 12:32:47 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ceadb04-054e-401f-a631-b062dd873fd4 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] calling os-brick to detach iSCSI Volume {{(pid=74960) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 12:32:47 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ceadb04-054e-401f-a631-b062dd873fd4 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9aa420acb0>, {'target_iqn': 'iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sPdXleCb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:32:47 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-9ceadb04-054e-401f-a631-b062dd873fd4 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:32:47 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-9ceadb04-054e-401f-a631-b062dd873fd4 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:32:47 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-9ceadb04-054e-401f-a631-b062dd873fd4 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:32:47 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:32:47 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:32:47 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[c04ce3d8-f620-49a9-ae02-a16959647c82]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:32:47 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ceadb04-054e-401f-a631-b062dd873fd4 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 12:32:47 user nova-compute[74960]: No targets found.
Nov 03 12:32:47 user nova-compute[74960]: iSNS:
Nov 03 12:32:47 user nova-compute[74960]: No targets found.
Nov 03 12:32:47 user nova-compute[74960]: STATIC:
Nov 03 12:32:47 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797
Nov 03 12:32:47 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:32:47 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:32:47 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2
Nov 03 12:32:47 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:32:47 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:32:47 user nova-compute[74960]: FIRMWARE:
Nov 03 12:32:47 user nova-compute[74960]: No targets found.
Nov 03 12:32:47 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:32:47 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ceadb04-054e-401f-a631-b062dd873fd4 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 12:32:47 user nova-compute[74960]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 12:32:47 user nova-compute[74960]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74960) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 12:32:47 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ceadb04-054e-401f-a631-b062dd873fd4 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797', 0)] {{(pid=74960) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 12:32:47 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:32:47 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:32:47 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[145256fc-73b4-4961-9c28-c4bea624e32d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:32:47 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:32:47 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:32:47 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[a819a9e7-014e-4da5-a478-36fc7575ff99]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797 (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:32:47 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ceadb04-054e-401f-a631-b062dd873fd4 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:32:47 user nova-compute[74960]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797 (non-flash)
Nov 03 12:32:47 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:32:47 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ceadb04-054e-401f-a631-b062dd873fd4 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:32:47 user nova-compute[74960]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797 (non-flash)
Nov 03 12:32:47 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:32:47 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ceadb04-054e-401f-a631-b062dd873fd4 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9a8c5eef80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797'): ({'sdb'}, set())}) {{(pid=74960) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 12:32:47 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-9ceadb04-054e-401f-a631-b062dd873fd4 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Removing single pathed devices sdb {{(pid=74960) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 12:32:47 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:32:47 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:32:47 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[29dc3f4c-5100-4d0d-bb3a-a6bb53a03cc8]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:32:47 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:32:47 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:32:47 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.028s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:32:47 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[93720ac9-45b6-4bde-8318-2cd805b8843f]: (4, ('ok\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:32:47 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-9ceadb04-054e-401f-a631-b062dd873fd4 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Flushing IO for device /dev/sdb {{(pid=74960) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 12:32:47 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:32:47 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:32:47 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b7f3091-c090-4220-8d4f-0ebfbc375281]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:32:47 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-9ceadb04-054e-401f-a631-b062dd873fd4 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74960) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 12:32:47 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:32:47 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:32:47 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6bba2c2-bf71-445d-925a-f5c94b80de4b]: (4, ('1', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:32:47 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-9ceadb04-054e-401f-a631-b062dd873fd4 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74960) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 12:32:47 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-9ceadb04-054e-401f-a631-b062dd873fd4 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] SCSI volumes sdb have been removed. {{(pid=74960) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 12:32:47 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ceadb04-054e-401f-a631-b062dd873fd4 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797')] {{(pid=74960) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 12:32:47 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:32:47 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:32:47 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:32:47 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d0d9489-6957-4266-be58-324c8e1c4735]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:32:47 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ceadb04-054e-401f-a631-b062dd873fd4 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:32:47 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797 -p 172.16.0.220:3260 --logout {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:32:47 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:32:47 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c8bd196-5724-454e-b470-b4d90df49c29]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:32:47 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ceadb04-054e-401f-a631-b062dd873fd4 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797, portal: 172.16.0.220,3260]
Nov 03 12:32:47 user nova-compute[74960]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797, portal: 172.16.0.220,3260] successful.
Nov 03 12:32:47 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:32:47 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797 -p 172.16.0.220:3260 --op delete {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:32:47 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:32:47 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce20a02a-2988-430b-8cfe-ecee78883f44]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:32:47 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ceadb04-054e-401f-a631-b062dd873fd4 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:32:47 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-9ceadb04-054e-401f-a631-b062dd873fd4 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:32:47 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ceadb04-054e-401f-a631-b062dd873fd4 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] <== disconnect_volume: return (335ms) None {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:32:47 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ceadb04-054e-401f-a631-b062dd873fd4 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] Disconnected iSCSI Volume {{(pid=74960) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 12:32:47 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-9ceadb04-054e-401f-a631-b062dd873fd4 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] Deleting instance files /opt/stack/data/nova/instances/5dc6cb24-fe58-4e36-bd7f-a67a804a98e1_del
Nov 03 12:32:47 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-9ceadb04-054e-401f-a631-b062dd873fd4 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] Deletion of /opt/stack/data/nova/instances/5dc6cb24-fe58-4e36-bd7f-a67a804a98e1_del complete
Nov 03 12:32:48 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:32:48 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:32:48 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Starting heal instance info cache {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 12:32:48 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:32:48 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "refresh_cache-a6199681-f85e-4f55-966b-6ab3f17cd640" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:32:48 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquired lock "refresh_cache-a6199681-f85e-4f55-966b-6ab3f17cd640" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:32:48 user nova-compute[74960]: DEBUG nova.network.neutron [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] Forcefully refreshing network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 12:32:48 user nova-compute[74960]: INFO nova.scheduler.client.report [None req-9ceadb04-054e-401f-a631-b062dd873fd4 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Deleted allocations for instance 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1
Nov 03 12:32:49 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-9ceadb04-054e-401f-a631-b062dd873fd4 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:32:49 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-9ceadb04-054e-401f-a631-b062dd873fd4 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:32:49 user nova-compute[74960]: DEBUG nova.objects.instance [None req-9ceadb04-054e-401f-a631-b062dd873fd4 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Lazy-loading 'numa_topology' on Instance uuid 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:32:49 user nova-compute[74960]: DEBUG nova.objects.base [None req-9ceadb04-054e-401f-a631-b062dd873fd4 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Object Instance<5dc6cb24-fe58-4e36-bd7f-a67a804a98e1> lazy-loaded attributes: resources,numa_topology {{(pid=74960) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 12:32:49 user nova-compute[74960]: DEBUG nova.compute.manager [req-cefbb3f9-e6b4-463d-bc44-8ce4dcbd869e req-4e084432-472a-42a4-a8d8-9b30b61e31dd service nova] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] Received event network-changed-fe22f17b-b60c-465a-9079-e9c008004741 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:32:49 user nova-compute[74960]: DEBUG nova.compute.manager [req-cefbb3f9-e6b4-463d-bc44-8ce4dcbd869e req-4e084432-472a-42a4-a8d8-9b30b61e31dd service nova] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] Refreshing instance network info cache due to event network-changed-fe22f17b-b60c-465a-9079-e9c008004741. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 12:32:49 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-cefbb3f9-e6b4-463d-bc44-8ce4dcbd869e req-4e084432-472a-42a4-a8d8-9b30b61e31dd service nova] Acquiring lock "refresh_cache-5dc6cb24-fe58-4e36-bd7f-a67a804a98e1" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:32:49 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-cefbb3f9-e6b4-463d-bc44-8ce4dcbd869e req-4e084432-472a-42a4-a8d8-9b30b61e31dd service nova] Acquired lock "refresh_cache-5dc6cb24-fe58-4e36-bd7f-a67a804a98e1" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:32:49 user nova-compute[74960]: DEBUG nova.network.neutron [req-cefbb3f9-e6b4-463d-bc44-8ce4dcbd869e req-4e084432-472a-42a4-a8d8-9b30b61e31dd service nova] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] Refreshing network info cache for port fe22f17b-b60c-465a-9079-e9c008004741 {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 12:32:49 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-9ceadb04-054e-401f-a631-b062dd873fd4 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:32:49 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-9ceadb04-054e-401f-a631-b062dd873fd4 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:32:49 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-9ceadb04-054e-401f-a631-b062dd873fd4 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.416s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:32:49 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-9ceadb04-054e-401f-a631-b062dd873fd4 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Lock "5dc6cb24-fe58-4e36-bd7f-a67a804a98e1" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 4.949s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:32:49 user nova-compute[74960]: DEBUG nova.network.neutron [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] Updating instance_info_cache with network_info: [{"id": "40976ae5-5f49-4d8e-abd7-04dc0ce8f319", "address": "fa:16:3e:7c:40:1d", "network": {"id": "dec66832-56d5-4d68-b11f-8e8eed38f045", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-79099436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc95d68d5e147e1953c855169b17091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40976ae5-5f", "ovs_interfaceid": "40976ae5-5f49-4d8e-abd7-04dc0ce8f319", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:32:49 user nova-compute[74960]: DEBUG nova.network.neutron [req-cefbb3f9-e6b4-463d-bc44-8ce4dcbd869e req-4e084432-472a-42a4-a8d8-9b30b61e31dd service nova] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] Updated VIF entry in instance network info cache for port fe22f17b-b60c-465a-9079-e9c008004741. {{(pid=74960) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 12:32:49 user nova-compute[74960]: DEBUG nova.network.neutron [req-cefbb3f9-e6b4-463d-bc44-8ce4dcbd869e req-4e084432-472a-42a4-a8d8-9b30b61e31dd service nova] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] Updating instance_info_cache with network_info: [{"id": "fe22f17b-b60c-465a-9079-e9c008004741", "address": "fa:16:3e:cd:e4:ff", "network": {"id": "a356b90b-cf10-4b3f-802a-aa2656c5588b", "bridge": null, "label": "tempest-TestShelveInstance-1788680557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b44956ba8ca42f29fda6a18ef9fb198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapfe22f17b-b6", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:32:49 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Releasing lock "refresh_cache-a6199681-f85e-4f55-966b-6ab3f17cd640" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:32:49 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] Updated the network info_cache for instance {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 12:32:49 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:32:49 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:32:49 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Cleaning up deleted instances {{(pid=74960) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 03 12:32:49 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] There are 0 instances to clean {{(pid=74960) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 03 12:32:49 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-cefbb3f9-e6b4-463d-bc44-8ce4dcbd869e req-4e084432-472a-42a4-a8d8-9b30b61e31dd service nova] Releasing lock "refresh_cache-5dc6cb24-fe58-4e36-bd7f-a67a804a98e1" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:32:50 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:32:51 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:32:51 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:32:52 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:32:53 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:32:53 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74960) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 12:32:53 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:32:53 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:32:53 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:32:53 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:32:53 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:32:53 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Auditing locally available compute resources for user (node: user) {{(pid=74960) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 12:32:53 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f15f5f-8afa-4d7b-bb45-5887184f9ee5/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:32:53 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f15f5f-8afa-4d7b-bb45-5887184f9ee5/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:32:53 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f15f5f-8afa-4d7b-bb45-5887184f9ee5/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:32:53 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-76e9fde9-b882-404a-acea-d9d09982b88b tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Acquiring lock "b1f7c162-c891-460a-8f98-3c7d6aeb6c49" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:32:53 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-76e9fde9-b882-404a-acea-d9d09982b88b tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Lock "b1f7c162-c891-460a-8f98-3c7d6aeb6c49" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:32:54 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-76e9fde9-b882-404a-acea-d9d09982b88b tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Acquiring lock "b1f7c162-c891-460a-8f98-3c7d6aeb6c49-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:32:54 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-76e9fde9-b882-404a-acea-d9d09982b88b tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Lock "b1f7c162-c891-460a-8f98-3c7d6aeb6c49-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:32:54 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-76e9fde9-b882-404a-acea-d9d09982b88b tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Lock "b1f7c162-c891-460a-8f98-3c7d6aeb6c49-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:32:54 user nova-compute[74960]: INFO nova.compute.manager [None req-76e9fde9-b882-404a-acea-d9d09982b88b tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49] Terminating instance
Nov 03 12:32:54 user nova-compute[74960]: DEBUG nova.compute.manager [None req-76e9fde9-b882-404a-acea-d9d09982b88b tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49] Start destroying the instance on the hypervisor. {{(pid=74960) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 12:32:54 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49] Instance destroyed successfully.
Nov 03 12:32:54 user nova-compute[74960]: DEBUG nova.objects.instance [None req-76e9fde9-b882-404a-acea-d9d09982b88b tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Lazy-loading 'resources' on Instance uuid b1f7c162-c891-460a-8f98-3c7d6aeb6c49 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:32:54 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-76e9fde9-b882-404a-acea-d9d09982b88b tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:29:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1418707382',display_name='tempest-ServerActionsTestOtherA-server-1418707382',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1418707382',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPAz3yp3EJUzWOfLmandSosNLGmmwlB9ouRsIIfsq3JGgx5t4USdyA4JVa+9y90auzNv5yGmALwIZZVdM/LzHirlYfhZGk/2geYmtQFtCuY7KHcICqsra/ZIlPsAiI2BYw==',key_name='tempest-keypair-1847755946',keypairs=<?>,launch_index=0,launched_at=2023-11-03T12:29:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5320673ee4f0422989a3708915375cdb',ramdisk_id='',reservation_id='r-nb6ahum2',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1651581249',owner_user_name='tempest-ServerActionsTestOtherA-1651581249-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T12:31:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60d8d224d7204ede84c09433a3d82d0f',uuid=b1f7c162-c891-460a-8f98-3c7d6aeb6c49,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='error') vif={"id": "78dc3436-7e47-4513-b5fa-0fd25ab1baf9", "address": "fa:16:3e:d5:a8:23", "network": {"id": "9c5fae09-5df5-45a3-b9cd-7ac3763ba878", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1736223258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5320673ee4f0422989a3708915375cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78dc3436-7e", "ovs_interfaceid": "78dc3436-7e47-4513-b5fa-0fd25ab1baf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 12:32:54 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-76e9fde9-b882-404a-acea-d9d09982b88b tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Converting VIF {"id": "78dc3436-7e47-4513-b5fa-0fd25ab1baf9", "address": "fa:16:3e:d5:a8:23", "network": {"id": "9c5fae09-5df5-45a3-b9cd-7ac3763ba878", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1736223258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5320673ee4f0422989a3708915375cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78dc3436-7e", "ovs_interfaceid": "78dc3436-7e47-4513-b5fa-0fd25ab1baf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:32:54 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-76e9fde9-b882-404a-acea-d9d09982b88b tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:a8:23,bridge_name='br-int',has_traffic_filtering=True,id=78dc3436-7e47-4513-b5fa-0fd25ab1baf9,network=Network(9c5fae09-5df5-45a3-b9cd-7ac3763ba878),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78dc3436-7e') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:32:54 user nova-compute[74960]: DEBUG os_vif [None req-76e9fde9-b882-404a-acea-d9d09982b88b tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:a8:23,bridge_name='br-int',has_traffic_filtering=True,id=78dc3436-7e47-4513-b5fa-0fd25ab1baf9,network=Network(9c5fae09-5df5-45a3-b9cd-7ac3763ba878),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78dc3436-7e') {{(pid=74960) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 12:32:54 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:32:54 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap78dc3436-7e, bridge=br-int, if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:32:54 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 12:32:54 user nova-compute[74960]: INFO os_vif [None req-76e9fde9-b882-404a-acea-d9d09982b88b tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:a8:23,bridge_name='br-int',has_traffic_filtering=True,id=78dc3436-7e47-4513-b5fa-0fd25ab1baf9,network=Network(9c5fae09-5df5-45a3-b9cd-7ac3763ba878),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78dc3436-7e')
Nov 03 12:32:54 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f15f5f-8afa-4d7b-bb45-5887184f9ee5/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:32:54 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76e9fde9-b882-404a-acea-d9d09982b88b tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49] calling os-brick to detach iSCSI Volume {{(pid=74960) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 12:32:54 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-76e9fde9-b882-404a-acea-d9d09982b88b tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9aa420acb0>, {'target_iqn': 'iqn.2010-10.org.openstack:2f45e9d6-0169-4a92-8d8c-ee068f12905b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IsvCifHn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:32:54 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-76e9fde9-b882-404a-acea-d9d09982b88b tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:32:54 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-76e9fde9-b882-404a-acea-d9d09982b88b tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:32:54 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-76e9fde9-b882-404a-acea-d9d09982b88b tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:32:54 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:32:54 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47eb8ddf-590f-4ffa-87c8-377cf1ee0f67/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:32:54 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:32:54 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[13b546c0-401d-4e29-b83e-55c366971ccf]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:32:54 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-76e9fde9-b882-404a-acea-d9d09982b88b tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 12:32:54 user nova-compute[74960]: No targets found.
Nov 03 12:32:54 user nova-compute[74960]: iSNS:
Nov 03 12:32:54 user nova-compute[74960]: No targets found.
Nov 03 12:32:54 user nova-compute[74960]: STATIC:
Nov 03 12:32:54 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2
Nov 03 12:32:54 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:32:54 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:32:54 user nova-compute[74960]: FIRMWARE:
Nov 03 12:32:54 user nova-compute[74960]: No targets found.
Nov 03 12:32:54 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:32:54 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-76e9fde9-b882-404a-acea-d9d09982b88b tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 12:32:54 user nova-compute[74960]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 12:32:54 user nova-compute[74960]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74960) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 12:32:54 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-76e9fde9-b882-404a-acea-d9d09982b88b tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f45e9d6-0169-4a92-8d8c-ee068f12905b', 0)] {{(pid=74960) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 12:32:54 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:32:54 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:32:54 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcb38b63-56a9-4d5e-9211-2bbb9dbb67be]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:32:54 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:32:54 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:32:54 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[59675793-c040-4302-bdf1-2cf4013d2899]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:32:54 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-76e9fde9-b882-404a-acea-d9d09982b88b tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:32:54 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:32:54 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-76e9fde9-b882-404a-acea-d9d09982b88b tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:32:54 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:32:54 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-76e9fde9-b882-404a-acea-d9d09982b88b tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9aac4fe290>, {}) {{(pid=74960) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 12:32:54 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-76e9fde9-b882-404a-acea-d9d09982b88b tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Disconnecting from: [] {{(pid=74960) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 12:32:54 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-76e9fde9-b882-404a-acea-d9d09982b88b tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.107s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:32:54 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-76e9fde9-b882-404a-acea-d9d09982b88b tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] <== disconnect_volume: return (109ms) None {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:32:54 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76e9fde9-b882-404a-acea-d9d09982b88b tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49] Disconnected iSCSI Volume {{(pid=74960) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 12:32:54 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-76e9fde9-b882-404a-acea-d9d09982b88b tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49] Deletion of /opt/stack/data/nova/instances/b1f7c162-c891-460a-8f98-3c7d6aeb6c49_resize failed
Nov 03 12:32:54 user nova-compute[74960]: INFO nova.compute.manager [None req-76e9fde9-b882-404a-acea-d9d09982b88b tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49] Took 0.27 seconds to destroy the instance on the hypervisor.
Nov 03 12:32:54 user nova-compute[74960]: DEBUG oslo.service.loopingcall [None req-76e9fde9-b882-404a-acea-d9d09982b88b tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74960) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 12:32:54 user nova-compute[74960]: DEBUG nova.compute.manager [-] [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49] Deallocating network for instance {{(pid=74960) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 12:32:54 user nova-compute[74960]: DEBUG nova.network.neutron [-] [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49] deallocate_for_instance() {{(pid=74960) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 12:32:54 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47eb8ddf-590f-4ffa-87c8-377cf1ee0f67/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:32:54 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47eb8ddf-590f-4ffa-87c8-377cf1ee0f67/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:32:54 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47eb8ddf-590f-4ffa-87c8-377cf1ee0f67/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:32:54 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Error from libvirt while getting description of instance-0000001a: [Error Code 42] Domain not found: no domain with matching uuid 'b1f7c162-c891-460a-8f98-3c7d6aeb6c49' (instance-0000001a): libvirt.libvirtError: Domain not found: no domain with matching uuid 'b1f7c162-c891-460a-8f98-3c7d6aeb6c49' (instance-0000001a)
Nov 03 12:32:54 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7769e3c5-136f-4282-8e3e-224e3a80922c/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:32:54 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7769e3c5-136f-4282-8e3e-224e3a80922c/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:32:54 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7769e3c5-136f-4282-8e3e-224e3a80922c/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:32:55 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7769e3c5-136f-4282-8e3e-224e3a80922c/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:32:55 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e02c80-f626-4918-93f1-6b9a7f778c7a/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:32:55 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e02c80-f626-4918-93f1-6b9a7f778c7a/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:32:55 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e02c80-f626-4918-93f1-6b9a7f778c7a/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:32:55 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e02c80-f626-4918-93f1-6b9a7f778c7a/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:32:55 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:32:55 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:32:55 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:32:55 user nova-compute[74960]: DEBUG nova.network.neutron [-] [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49] Updating instance_info_cache with network_info: [] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:32:55 user nova-compute[74960]: INFO nova.compute.manager [-] [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49] Took 1.59 seconds to deallocate network for instance.
Nov 03 12:32:55 user nova-compute[74960]: DEBUG nova.compute.manager [req-c39187c2-fe5f-4f08-89fe-7dbd941e8aaf req-b8290e25-58ad-4093-bd8a-e7ffb9cfb8a9 service nova] [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49] Received event network-vif-deleted-78dc3436-7e47-4513-b5fa-0fd25ab1baf9 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:32:55 user nova-compute[74960]: INFO nova.compute.manager [req-c39187c2-fe5f-4f08-89fe-7dbd941e8aaf req-b8290e25-58ad-4093-bd8a-e7ffb9cfb8a9 service nova] [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49] Neutron deleted interface 78dc3436-7e47-4513-b5fa-0fd25ab1baf9; detaching it from the instance and deleting it from the info cache
Nov 03 12:32:55 user nova-compute[74960]: DEBUG nova.network.neutron [req-c39187c2-fe5f-4f08-89fe-7dbd941e8aaf req-b8290e25-58ad-4093-bd8a-e7ffb9cfb8a9 service nova] [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49] Updating instance_info_cache with network_info: [] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:32:55 user nova-compute[74960]: DEBUG nova.compute.manager [req-c39187c2-fe5f-4f08-89fe-7dbd941e8aaf req-b8290e25-58ad-4093-bd8a-e7ffb9cfb8a9 service nova] [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49] Detach interface failed, port_id=78dc3436-7e47-4513-b5fa-0fd25ab1baf9, reason: Instance b1f7c162-c891-460a-8f98-3c7d6aeb6c49 could not be found. {{(pid=74960) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 03 12:32:55 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:32:55 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7b95c0-3726-4a1c-a384-ec91abf75225/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:32:55 user nova-compute[74960]: INFO nova.compute.manager [None req-76e9fde9-b882-404a-acea-d9d09982b88b tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49] Took 0.10 seconds to detach 1 volumes for instance.
Nov 03 12:32:56 user nova-compute[74960]: DEBUG nova.compute.manager [None req-76e9fde9-b882-404a-acea-d9d09982b88b tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49] Deleting volume: 2f45e9d6-0169-4a92-8d8c-ee068f12905b {{(pid=74960) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 03 12:32:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7b95c0-3726-4a1c-a384-ec91abf75225/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:32:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7b95c0-3726-4a1c-a384-ec91abf75225/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:32:56 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-76e9fde9-b882-404a-acea-d9d09982b88b tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:32:56 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-76e9fde9-b882-404a-acea-d9d09982b88b tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:32:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7b95c0-3726-4a1c-a384-ec91abf75225/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:32:56 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74960) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 12:32:57 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:32:57 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-76e9fde9-b882-404a-acea-d9d09982b88b tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Refreshing inventories for resource provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 03 12:32:57 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:32:57 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:32:57 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Hypervisor/Node resource view: name=user free_ram=7789MB free_disk=25.02283477783203GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74960) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 12:32:57 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:32:57 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-76e9fde9-b882-404a-acea-d9d09982b88b tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Updating ProviderTree inventory for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 03 12:32:57 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-76e9fde9-b882-404a-acea-d9d09982b88b tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Updating inventory in ProviderTree for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 03 12:32:57 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-76e9fde9-b882-404a-acea-d9d09982b88b tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Refreshing aggregate associations for resource provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0, aggregates: None {{(pid=74960) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 03 12:32:57 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-76e9fde9-b882-404a-acea-d9d09982b88b tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Refreshing trait associations for resource provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0, traits: COMPUTE_NODE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE41,HW_CPU_X86_SSSE3,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_DEVICE_TAGGING,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_QXL {{(pid=74960) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 03 12:32:57 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:32:57 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:32:57 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-76e9fde9-b882-404a-acea-d9d09982b88b tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:32:57 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-76e9fde9-b882-404a-acea-d9d09982b88b tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:32:57 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-76e9fde9-b882-404a-acea-d9d09982b88b tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.412s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:32:57 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.490s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:32:57 user nova-compute[74960]: INFO nova.scheduler.client.report [None req-76e9fde9-b882-404a-acea-d9d09982b88b tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Deleted allocations for instance b1f7c162-c891-460a-8f98-3c7d6aeb6c49
Nov 03 12:32:57 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Applying migration context for instance b1f7c162-c891-460a-8f98-3c7d6aeb6c49 as it has an incoming, in-progress migration 4e8b66c8-feb8-4c01-a89e-fd5c22b15658. Migration status is error {{(pid=74960) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 03 12:32:57 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49] Skipping migration as instance is neither resizing nor live-migrating. {{(pid=74960) _update_usage_from_migrations /opt/stack/nova/nova/compute/resource_tracker.py:1563}}
Nov 03 12:32:57 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-76e9fde9-b882-404a-acea-d9d09982b88b tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Lock "b1f7c162-c891-460a-8f98-3c7d6aeb6c49" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.792s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:32:57 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 7769e3c5-136f-4282-8e3e-224e3a80922c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:32:57 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 87f15f5f-8afa-4d7b-bb45-5887184f9ee5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:32:57 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance a6199681-f85e-4f55-966b-6ab3f17cd640 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:32:57 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 5b7b95c0-3726-4a1c-a384-ec91abf75225 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:32:57 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 35e02c80-f626-4918-93f1-6b9a7f778c7a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:32:57 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:32:57 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:32:57 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74960) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 12:32:57 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74960) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 12:32:58 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:32:58 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:32:58 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Compute_service record updated for user:user {{(pid=74960) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 12:32:58 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.483s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:32:58 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:32:59 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:33:00 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:33:00 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:33:00 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:33:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:33:01 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:33:01 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Cleaning up deleted instances with incomplete migration  {{(pid=74960) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 03 12:33:02 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:33:03 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:33:03 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-e83f860d-49cd-4ddd-bba1-9a84e6af37e3 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] Acquiring lock "9c447082-b59b-4c8e-8fa0-bf6599a84e91" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:33:03 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-e83f860d-49cd-4ddd-bba1-9a84e6af37e3 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] Lock "9c447082-b59b-4c8e-8fa0-bf6599a84e91" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:33:03 user nova-compute[74960]: DEBUG nova.compute.manager [None req-e83f860d-49cd-4ddd-bba1-9a84e6af37e3 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] [instance: 9c447082-b59b-4c8e-8fa0-bf6599a84e91] Starting instance... {{(pid=74960) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 12:33:03 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-e83f860d-49cd-4ddd-bba1-9a84e6af37e3 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:33:03 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-e83f860d-49cd-4ddd-bba1-9a84e6af37e3 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:33:03 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-e83f860d-49cd-4ddd-bba1-9a84e6af37e3 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74960) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 12:33:03 user nova-compute[74960]: INFO nova.compute.claims [None req-e83f860d-49cd-4ddd-bba1-9a84e6af37e3 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] [instance: 9c447082-b59b-4c8e-8fa0-bf6599a84e91] Claim successful on node user
Nov 03 12:33:04 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-e83f860d-49cd-4ddd-bba1-9a84e6af37e3 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:33:04 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-e83f860d-49cd-4ddd-bba1-9a84e6af37e3 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:33:04 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-e83f860d-49cd-4ddd-bba1-9a84e6af37e3 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.396s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:33:04 user nova-compute[74960]: DEBUG nova.compute.manager [None req-e83f860d-49cd-4ddd-bba1-9a84e6af37e3 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] [instance: 9c447082-b59b-4c8e-8fa0-bf6599a84e91] Start building networks asynchronously for instance. {{(pid=74960) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 12:33:04 user nova-compute[74960]: DEBUG nova.compute.manager [None req-e83f860d-49cd-4ddd-bba1-9a84e6af37e3 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] [instance: 9c447082-b59b-4c8e-8fa0-bf6599a84e91] Allocating IP information in the background. {{(pid=74960) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 12:33:04 user nova-compute[74960]: DEBUG nova.network.neutron [None req-e83f860d-49cd-4ddd-bba1-9a84e6af37e3 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] [instance: 9c447082-b59b-4c8e-8fa0-bf6599a84e91] allocate_for_instance() {{(pid=74960) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 12:33:04 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-e83f860d-49cd-4ddd-bba1-9a84e6af37e3 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] [instance: 9c447082-b59b-4c8e-8fa0-bf6599a84e91] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 12:33:04 user nova-compute[74960]: DEBUG nova.compute.manager [None req-e83f860d-49cd-4ddd-bba1-9a84e6af37e3 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] [instance: 9c447082-b59b-4c8e-8fa0-bf6599a84e91] Start building block device mappings for instance. {{(pid=74960) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 12:33:04 user nova-compute[74960]: DEBUG nova.policy [None req-e83f860d-49cd-4ddd-bba1-9a84e6af37e3 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '801107e2c6aa4cc79ffe0127c1f437de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff357804ee44063bce5f36ad836d71d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74960) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 12:33:04 user nova-compute[74960]: DEBUG nova.compute.manager [None req-e83f860d-49cd-4ddd-bba1-9a84e6af37e3 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] [instance: 9c447082-b59b-4c8e-8fa0-bf6599a84e91] Start spawning the instance on the hypervisor. {{(pid=74960) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 12:33:04 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-e83f860d-49cd-4ddd-bba1-9a84e6af37e3 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] [instance: 9c447082-b59b-4c8e-8fa0-bf6599a84e91] Creating instance directory {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 12:33:04 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-e83f860d-49cd-4ddd-bba1-9a84e6af37e3 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] [instance: 9c447082-b59b-4c8e-8fa0-bf6599a84e91] Creating image(s)
Nov 03 12:33:04 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-e83f860d-49cd-4ddd-bba1-9a84e6af37e3 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] Acquiring lock "/opt/stack/data/nova/instances/9c447082-b59b-4c8e-8fa0-bf6599a84e91/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:33:04 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-e83f860d-49cd-4ddd-bba1-9a84e6af37e3 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] Lock "/opt/stack/data/nova/instances/9c447082-b59b-4c8e-8fa0-bf6599a84e91/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:33:04 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-e83f860d-49cd-4ddd-bba1-9a84e6af37e3 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] Lock "/opt/stack/data/nova/instances/9c447082-b59b-4c8e-8fa0-bf6599a84e91/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:33:04 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-e83f860d-49cd-4ddd-bba1-9a84e6af37e3 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:33:04 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-e83f860d-49cd-4ddd-bba1-9a84e6af37e3 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.196s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:33:04 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-e83f860d-49cd-4ddd-bba1-9a84e6af37e3 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] Acquiring lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:33:04 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-e83f860d-49cd-4ddd-bba1-9a84e6af37e3 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] Lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:33:04 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-e83f860d-49cd-4ddd-bba1-9a84e6af37e3 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:33:04 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-e83f860d-49cd-4ddd-bba1-9a84e6af37e3 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.222s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:33:04 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-e83f860d-49cd-4ddd-bba1-9a84e6af37e3 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910,backing_fmt=raw /opt/stack/data/nova/instances/9c447082-b59b-4c8e-8fa0-bf6599a84e91/disk 1073741824 {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:33:04 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-e83f860d-49cd-4ddd-bba1-9a84e6af37e3 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910,backing_fmt=raw /opt/stack/data/nova/instances/9c447082-b59b-4c8e-8fa0-bf6599a84e91/disk 1073741824" returned: 0 in 0.053s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:33:04 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-e83f860d-49cd-4ddd-bba1-9a84e6af37e3 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] Lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.282s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:33:04 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-e83f860d-49cd-4ddd-bba1-9a84e6af37e3 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:33:05 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-e83f860d-49cd-4ddd-bba1-9a84e6af37e3 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.182s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:33:05 user nova-compute[74960]: DEBUG nova.virt.disk.api [None req-e83f860d-49cd-4ddd-bba1-9a84e6af37e3 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9c447082-b59b-4c8e-8fa0-bf6599a84e91/disk. size=1073741824 {{(pid=74960) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 12:33:05 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-e83f860d-49cd-4ddd-bba1-9a84e6af37e3 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c447082-b59b-4c8e-8fa0-bf6599a84e91/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:33:05 user nova-compute[74960]: DEBUG nova.network.neutron [None req-e83f860d-49cd-4ddd-bba1-9a84e6af37e3 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] [instance: 9c447082-b59b-4c8e-8fa0-bf6599a84e91] Successfully created port: d08c2ee9-364d-4a04-a7de-2e45049473a8 {{(pid=74960) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 12:33:05 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-e83f860d-49cd-4ddd-bba1-9a84e6af37e3 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c447082-b59b-4c8e-8fa0-bf6599a84e91/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:33:05 user nova-compute[74960]: DEBUG nova.virt.disk.api [None req-e83f860d-49cd-4ddd-bba1-9a84e6af37e3 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] Cannot resize image /opt/stack/data/nova/instances/9c447082-b59b-4c8e-8fa0-bf6599a84e91/disk to a smaller size. {{(pid=74960) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 12:33:05 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-e83f860d-49cd-4ddd-bba1-9a84e6af37e3 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] [instance: 9c447082-b59b-4c8e-8fa0-bf6599a84e91] Created local disks {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 12:33:05 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-e83f860d-49cd-4ddd-bba1-9a84e6af37e3 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] [instance: 9c447082-b59b-4c8e-8fa0-bf6599a84e91] Ensure instance console log exists: /opt/stack/data/nova/instances/9c447082-b59b-4c8e-8fa0-bf6599a84e91/console.log {{(pid=74960) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 12:33:05 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-e83f860d-49cd-4ddd-bba1-9a84e6af37e3 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:33:05 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-e83f860d-49cd-4ddd-bba1-9a84e6af37e3 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:33:05 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-e83f860d-49cd-4ddd-bba1-9a84e6af37e3 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:33:05 user nova-compute[74960]: DEBUG nova.network.neutron [None req-e83f860d-49cd-4ddd-bba1-9a84e6af37e3 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] [instance: 9c447082-b59b-4c8e-8fa0-bf6599a84e91] Successfully updated port: d08c2ee9-364d-4a04-a7de-2e45049473a8 {{(pid=74960) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 12:33:05 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-e83f860d-49cd-4ddd-bba1-9a84e6af37e3 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] Acquiring lock "refresh_cache-9c447082-b59b-4c8e-8fa0-bf6599a84e91" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:33:05 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-e83f860d-49cd-4ddd-bba1-9a84e6af37e3 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] Acquired lock "refresh_cache-9c447082-b59b-4c8e-8fa0-bf6599a84e91" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:33:05 user nova-compute[74960]: DEBUG nova.network.neutron [None req-e83f860d-49cd-4ddd-bba1-9a84e6af37e3 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] [instance: 9c447082-b59b-4c8e-8fa0-bf6599a84e91] Building network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 12:33:06 user nova-compute[74960]: DEBUG nova.network.neutron [None req-e83f860d-49cd-4ddd-bba1-9a84e6af37e3 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] [instance: 9c447082-b59b-4c8e-8fa0-bf6599a84e91] Instance cache missing network info. {{(pid=74960) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 12:33:06 user nova-compute[74960]: DEBUG nova.compute.manager [req-cac567a5-fbd8-4322-9705-28906ef898a4 req-fd0d3a9c-24a2-4423-9342-9f192dc00e14 service nova] [instance: 9c447082-b59b-4c8e-8fa0-bf6599a84e91] Received event network-changed-d08c2ee9-364d-4a04-a7de-2e45049473a8 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:33:06 user nova-compute[74960]: DEBUG nova.compute.manager [req-cac567a5-fbd8-4322-9705-28906ef898a4 req-fd0d3a9c-24a2-4423-9342-9f192dc00e14 service nova] [instance: 9c447082-b59b-4c8e-8fa0-bf6599a84e91] Refreshing instance network info cache due to event network-changed-d08c2ee9-364d-4a04-a7de-2e45049473a8. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 12:33:06 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-cac567a5-fbd8-4322-9705-28906ef898a4 req-fd0d3a9c-24a2-4423-9342-9f192dc00e14 service nova] Acquiring lock "refresh_cache-9c447082-b59b-4c8e-8fa0-bf6599a84e91" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:33:06 user nova-compute[74960]: DEBUG nova.network.neutron [None req-e83f860d-49cd-4ddd-bba1-9a84e6af37e3 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] [instance: 9c447082-b59b-4c8e-8fa0-bf6599a84e91] Updating instance_info_cache with network_info: [{"id": "d08c2ee9-364d-4a04-a7de-2e45049473a8", "address": "fa:16:3e:fd:9d:36", "network": {"id": "1acaa882-f931-44d0-b9d0-17ed988e4e8b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1021854594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ff357804ee44063bce5f36ad836d71d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd08c2ee9-36", "ovs_interfaceid": "d08c2ee9-364d-4a04-a7de-2e45049473a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:33:06 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-e83f860d-49cd-4ddd-bba1-9a84e6af37e3 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] Releasing lock "refresh_cache-9c447082-b59b-4c8e-8fa0-bf6599a84e91" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:33:06 user nova-compute[74960]: DEBUG nova.compute.manager [None req-e83f860d-49cd-4ddd-bba1-9a84e6af37e3 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] [instance: 9c447082-b59b-4c8e-8fa0-bf6599a84e91] Instance network_info: |[{"id": "d08c2ee9-364d-4a04-a7de-2e45049473a8", "address": "fa:16:3e:fd:9d:36", "network": {"id": "1acaa882-f931-44d0-b9d0-17ed988e4e8b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1021854594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ff357804ee44063bce5f36ad836d71d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd08c2ee9-36", "ovs_interfaceid": "d08c2ee9-364d-4a04-a7de-2e45049473a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74960) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 12:33:06 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-cac567a5-fbd8-4322-9705-28906ef898a4 req-fd0d3a9c-24a2-4423-9342-9f192dc00e14 service nova] Acquired lock "refresh_cache-9c447082-b59b-4c8e-8fa0-bf6599a84e91" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:33:06 user nova-compute[74960]: DEBUG nova.network.neutron [req-cac567a5-fbd8-4322-9705-28906ef898a4 req-fd0d3a9c-24a2-4423-9342-9f192dc00e14 service nova] [instance: 9c447082-b59b-4c8e-8fa0-bf6599a84e91] Refreshing network info cache for port d08c2ee9-364d-4a04-a7de-2e45049473a8 {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 12:33:06 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-e83f860d-49cd-4ddd-bba1-9a84e6af37e3 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] [instance: 9c447082-b59b-4c8e-8fa0-bf6599a84e91] Start _get_guest_xml network_info=[{"id": "d08c2ee9-364d-4a04-a7de-2e45049473a8", "address": "fa:16:3e:fd:9d:36", "network": {"id": "1acaa882-f931-44d0-b9d0-17ed988e4e8b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1021854594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ff357804ee44063bce5f36ad836d71d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd08c2ee9-36", "ovs_interfaceid": "d08c2ee9-364d-4a04-a7de-2e45049473a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=549f51ba-ac69-494b-8de1-34635aa2d7cf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='63ee9c80c632442fb0379f47b784bd20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T12:13:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'image_id': '549f51ba-ac69-494b-8de1-34635aa2d7cf'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 12:33:06 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-e83f860d-49cd-4ddd-bba1-9a84e6af37e3 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:33:06 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-e83f860d-49cd-4ddd-bba1-9a84e6af37e3 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:33:06 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-e83f860d-49cd-4ddd-bba1-9a84e6af37e3 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 12:33:06 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-e83f860d-49cd-4ddd-bba1-9a84e6af37e3 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] CPU controller missing on host. {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 12:33:06 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-e83f860d-49cd-4ddd-bba1-9a84e6af37e3 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 12:33:06 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-e83f860d-49cd-4ddd-bba1-9a84e6af37e3 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] CPU controller found on host. {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 12:33:06 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-e83f860d-49cd-4ddd-bba1-9a84e6af37e3 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74960) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 12:33:06 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-e83f860d-49cd-4ddd-bba1-9a84e6af37e3 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=549f51ba-ac69-494b-8de1-34635aa2d7cf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='63ee9c80c632442fb0379f47b784bd20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T12:13:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 12:33:06 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-e83f860d-49cd-4ddd-bba1-9a84e6af37e3 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] Flavor limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 12:33:06 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-e83f860d-49cd-4ddd-bba1-9a84e6af37e3 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] Image limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 12:33:06 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-e83f860d-49cd-4ddd-bba1-9a84e6af37e3 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] Flavor pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 12:33:06 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-e83f860d-49cd-4ddd-bba1-9a84e6af37e3 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] Image pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 12:33:06 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-e83f860d-49cd-4ddd-bba1-9a84e6af37e3 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 12:33:06 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-e83f860d-49cd-4ddd-bba1-9a84e6af37e3 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 12:33:06 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-e83f860d-49cd-4ddd-bba1-9a84e6af37e3 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 12:33:06 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-e83f860d-49cd-4ddd-bba1-9a84e6af37e3 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] Got 1 possible topologies {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 12:33:06 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-e83f860d-49cd-4ddd-bba1-9a84e6af37e3 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 12:33:06 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-e83f860d-49cd-4ddd-bba1-9a84e6af37e3 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 12:33:06 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-e83f860d-49cd-4ddd-bba1-9a84e6af37e3 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:33:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1428352861',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1428352861',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1428352',id=33,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN8v59hYd2ehUTvDYy0c/DZL4XOF1gEIx5mkFnOsVYBXSeNZpVJg7swiGnKfYNeOwSyat8knUkINhbcT2K4wweaTmiP2hMlled1QvQUSBBicgkHLtjMazw59akS0IWOpPQ==',key_name='tempest-keypair-865672496',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ff357804ee44063bce5f36ad836d71d',ramdisk_id='',reservation_id='r-slml0fv7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-691169955',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:33:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='801107e2c6aa4cc79ffe0127c1f437de',uuid=9c447082-b59b-4c8e-8fa0-bf6599a84e91,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d08c2ee9-364d-4a04-a7de-2e45049473a8", "address": "fa:16:3e:fd:9d:36", "network": {"id": "1acaa882-f931-44d0-b9d0-17ed988e4e8b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1021854594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ff357804ee44063bce5f36ad836d71d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd08c2ee9-36", "ovs_interfaceid": "d08c2ee9-364d-4a04-a7de-2e45049473a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74960) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 12:33:06 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-e83f860d-49cd-4ddd-bba1-9a84e6af37e3 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] Converting VIF {"id": "d08c2ee9-364d-4a04-a7de-2e45049473a8", "address": "fa:16:3e:fd:9d:36", "network": {"id": "1acaa882-f931-44d0-b9d0-17ed988e4e8b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1021854594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ff357804ee44063bce5f36ad836d71d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd08c2ee9-36", "ovs_interfaceid": "d08c2ee9-364d-4a04-a7de-2e45049473a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:33:06 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-e83f860d-49cd-4ddd-bba1-9a84e6af37e3 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:9d:36,bridge_name='br-int',has_traffic_filtering=True,id=d08c2ee9-364d-4a04-a7de-2e45049473a8,network=Network(1acaa882-f931-44d0-b9d0-17ed988e4e8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd08c2ee9-36') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:33:06 user nova-compute[74960]: DEBUG nova.objects.instance [None req-e83f860d-49cd-4ddd-bba1-9a84e6af37e3 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] Lazy-loading 'pci_devices' on Instance uuid 9c447082-b59b-4c8e-8fa0-bf6599a84e91 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:33:06 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-e83f860d-49cd-4ddd-bba1-9a84e6af37e3 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] [instance: 9c447082-b59b-4c8e-8fa0-bf6599a84e91] End _get_guest_xml xml=<domain type="kvm">
Nov 03 12:33:06 user nova-compute[74960]:   <uuid>9c447082-b59b-4c8e-8fa0-bf6599a84e91</uuid>
Nov 03 12:33:06 user nova-compute[74960]:   <name>instance-00000021</name>
Nov 03 12:33:06 user nova-compute[74960]:   <memory>524288</memory>
Nov 03 12:33:06 user nova-compute[74960]:   <vcpu>1</vcpu>
Nov 03 12:33:06 user nova-compute[74960]:   <metadata>
Nov 03 12:33:06 user nova-compute[74960]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 12:33:06 user nova-compute[74960]:       <nova:package version="0.0.0"/>
Nov 03 12:33:06 user nova-compute[74960]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1428352861</nova:name>
Nov 03 12:33:06 user nova-compute[74960]:       <nova:creationTime>2023-11-03 12:33:06</nova:creationTime>
Nov 03 12:33:06 user nova-compute[74960]:       <nova:flavor name="m1.tiny">
Nov 03 12:33:06 user nova-compute[74960]:         <nova:memory>512</nova:memory>
Nov 03 12:33:06 user nova-compute[74960]:         <nova:disk>1</nova:disk>
Nov 03 12:33:06 user nova-compute[74960]:         <nova:swap>0</nova:swap>
Nov 03 12:33:06 user nova-compute[74960]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 12:33:06 user nova-compute[74960]:         <nova:vcpus>1</nova:vcpus>
Nov 03 12:33:06 user nova-compute[74960]:       </nova:flavor>
Nov 03 12:33:06 user nova-compute[74960]:       <nova:owner>
Nov 03 12:33:06 user nova-compute[74960]:         <nova:user uuid="801107e2c6aa4cc79ffe0127c1f437de">tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member</nova:user>
Nov 03 12:33:06 user nova-compute[74960]:         <nova:project uuid="2ff357804ee44063bce5f36ad836d71d">tempest-TestServerVolumeAttachScenarioOldVersion-691169955</nova:project>
Nov 03 12:33:06 user nova-compute[74960]:       </nova:owner>
Nov 03 12:33:06 user nova-compute[74960]:       <nova:root type="image" uuid="549f51ba-ac69-494b-8de1-34635aa2d7cf"/>
Nov 03 12:33:06 user nova-compute[74960]:       <nova:ports>
Nov 03 12:33:06 user nova-compute[74960]:         <nova:port uuid="d08c2ee9-364d-4a04-a7de-2e45049473a8">
Nov 03 12:33:06 user nova-compute[74960]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 03 12:33:06 user nova-compute[74960]:         </nova:port>
Nov 03 12:33:06 user nova-compute[74960]:       </nova:ports>
Nov 03 12:33:06 user nova-compute[74960]:     </nova:instance>
Nov 03 12:33:06 user nova-compute[74960]:   </metadata>
Nov 03 12:33:06 user nova-compute[74960]:   <sysinfo type="smbios">
Nov 03 12:33:06 user nova-compute[74960]:     <system>
Nov 03 12:33:06 user nova-compute[74960]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 12:33:06 user nova-compute[74960]:       <entry name="product">OpenStack Nova</entry>
Nov 03 12:33:06 user nova-compute[74960]:       <entry name="version">0.0.0</entry>
Nov 03 12:33:06 user nova-compute[74960]:       <entry name="serial">9c447082-b59b-4c8e-8fa0-bf6599a84e91</entry>
Nov 03 12:33:06 user nova-compute[74960]:       <entry name="uuid">9c447082-b59b-4c8e-8fa0-bf6599a84e91</entry>
Nov 03 12:33:06 user nova-compute[74960]:       <entry name="family">Virtual Machine</entry>
Nov 03 12:33:06 user nova-compute[74960]:     </system>
Nov 03 12:33:06 user nova-compute[74960]:   </sysinfo>
Nov 03 12:33:06 user nova-compute[74960]:   <os>
Nov 03 12:33:06 user nova-compute[74960]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 12:33:06 user nova-compute[74960]:     <boot dev="hd"/>
Nov 03 12:33:06 user nova-compute[74960]:     <smbios mode="sysinfo"/>
Nov 03 12:33:06 user nova-compute[74960]:   </os>
Nov 03 12:33:06 user nova-compute[74960]:   <features>
Nov 03 12:33:06 user nova-compute[74960]:     <acpi/>
Nov 03 12:33:06 user nova-compute[74960]:     <apic/>
Nov 03 12:33:06 user nova-compute[74960]:     <vmcoreinfo/>
Nov 03 12:33:06 user nova-compute[74960]:   </features>
Nov 03 12:33:06 user nova-compute[74960]:   <clock offset="utc">
Nov 03 12:33:06 user nova-compute[74960]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 12:33:06 user nova-compute[74960]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 12:33:06 user nova-compute[74960]:     <timer name="hpet" present="no"/>
Nov 03 12:33:06 user nova-compute[74960]:   </clock>
Nov 03 12:33:06 user nova-compute[74960]:   <cpu mode="custom" match="exact">
Nov 03 12:33:06 user nova-compute[74960]:     <model>Nehalem</model>
Nov 03 12:33:06 user nova-compute[74960]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 12:33:06 user nova-compute[74960]:   </cpu>
Nov 03 12:33:06 user nova-compute[74960]:   <devices>
Nov 03 12:33:06 user nova-compute[74960]:     <disk type="file" device="disk">
Nov 03 12:33:06 user nova-compute[74960]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 12:33:06 user nova-compute[74960]:       <source file="/opt/stack/data/nova/instances/9c447082-b59b-4c8e-8fa0-bf6599a84e91/disk"/>
Nov 03 12:33:06 user nova-compute[74960]:       <target dev="vda" bus="virtio"/>
Nov 03 12:33:06 user nova-compute[74960]:     </disk>
Nov 03 12:33:06 user nova-compute[74960]:     <interface type="ethernet">
Nov 03 12:33:06 user nova-compute[74960]:       <mac address="fa:16:3e:fd:9d:36"/>
Nov 03 12:33:06 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:33:06 user nova-compute[74960]:       <mtu size="1442"/>
Nov 03 12:33:06 user nova-compute[74960]:       <target dev="tapd08c2ee9-36"/>
Nov 03 12:33:06 user nova-compute[74960]:     </interface>
Nov 03 12:33:06 user nova-compute[74960]:     <serial type="pty">
Nov 03 12:33:06 user nova-compute[74960]:       <log file="/opt/stack/data/nova/instances/9c447082-b59b-4c8e-8fa0-bf6599a84e91/console.log" append="off"/>
Nov 03 12:33:06 user nova-compute[74960]:     </serial>
Nov 03 12:33:06 user nova-compute[74960]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 12:33:06 user nova-compute[74960]:     <video>
Nov 03 12:33:06 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:33:06 user nova-compute[74960]:     </video>
Nov 03 12:33:06 user nova-compute[74960]:     <rng model="virtio">
Nov 03 12:33:06 user nova-compute[74960]:       <backend model="random">/dev/urandom</backend>
Nov 03 12:33:06 user nova-compute[74960]:     </rng>
Nov 03 12:33:06 user nova-compute[74960]:     <controller type="usb" index="0" model="none"/>
Nov 03 12:33:06 user nova-compute[74960]:     <memballoon model="virtio">
Nov 03 12:33:06 user nova-compute[74960]:       <stats period="10"/>
Nov 03 12:33:06 user nova-compute[74960]:     </memballoon>
Nov 03 12:33:06 user nova-compute[74960]:   </devices>
Nov 03 12:33:06 user nova-compute[74960]: </domain>
Nov 03 12:33:06 user nova-compute[74960]:  {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 12:33:06 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-e83f860d-49cd-4ddd-bba1-9a84e6af37e3 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:33:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1428352861',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1428352861',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1428352',id=33,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN8v59hYd2ehUTvDYy0c/DZL4XOF1gEIx5mkFnOsVYBXSeNZpVJg7swiGnKfYNeOwSyat8knUkINhbcT2K4wweaTmiP2hMlled1QvQUSBBicgkHLtjMazw59akS0IWOpPQ==',key_name='tempest-keypair-865672496',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ff357804ee44063bce5f36ad836d71d',ramdisk_id='',reservation_id='r-slml0fv7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-691169955',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:33:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='801107e2c6aa4cc79ffe0127c1f437de',uuid=9c447082-b59b-4c8e-8fa0-bf6599a84e91,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d08c2ee9-364d-4a04-a7de-2e45049473a8", "address": "fa:16:3e:fd:9d:36", "network": {"id": "1acaa882-f931-44d0-b9d0-17ed988e4e8b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1021854594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ff357804ee44063bce5f36ad836d71d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd08c2ee9-36", "ovs_interfaceid": "d08c2ee9-364d-4a04-a7de-2e45049473a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 12:33:06 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-e83f860d-49cd-4ddd-bba1-9a84e6af37e3 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] Converting VIF {"id": "d08c2ee9-364d-4a04-a7de-2e45049473a8", "address": "fa:16:3e:fd:9d:36", "network": {"id": "1acaa882-f931-44d0-b9d0-17ed988e4e8b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1021854594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ff357804ee44063bce5f36ad836d71d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd08c2ee9-36", "ovs_interfaceid": "d08c2ee9-364d-4a04-a7de-2e45049473a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:33:06 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-e83f860d-49cd-4ddd-bba1-9a84e6af37e3 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:9d:36,bridge_name='br-int',has_traffic_filtering=True,id=d08c2ee9-364d-4a04-a7de-2e45049473a8,network=Network(1acaa882-f931-44d0-b9d0-17ed988e4e8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd08c2ee9-36') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:33:06 user nova-compute[74960]: DEBUG os_vif [None req-e83f860d-49cd-4ddd-bba1-9a84e6af37e3 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:9d:36,bridge_name='br-int',has_traffic_filtering=True,id=d08c2ee9-364d-4a04-a7de-2e45049473a8,network=Network(1acaa882-f931-44d0-b9d0-17ed988e4e8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd08c2ee9-36') {{(pid=74960) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 12:33:06 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:33:06 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:33:06 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 12:33:06 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:33:06 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a3c36bce-0c95-5a6e-a0c0-35c241ae3480', '_type': 'linux-noop'}}, row=False) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:33:06 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:33:06 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:33:06 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:33:06 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd08c2ee9-36, may_exist=True, interface_attrs={}) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:33:06 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd08c2ee9-36, col_values=(('qos', UUID('3e07043c-653c-4ea4-a8ba-e8ca66a78ac8')),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:33:06 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd08c2ee9-36, col_values=(('external_ids', {'iface-id': 'd08c2ee9-364d-4a04-a7de-2e45049473a8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fd:9d:36', 'vm-uuid': '9c447082-b59b-4c8e-8fa0-bf6599a84e91'}),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:33:06 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:33:06 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:33:06 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:33:06 user nova-compute[74960]: INFO os_vif [None req-e83f860d-49cd-4ddd-bba1-9a84e6af37e3 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:9d:36,bridge_name='br-int',has_traffic_filtering=True,id=d08c2ee9-364d-4a04-a7de-2e45049473a8,network=Network(1acaa882-f931-44d0-b9d0-17ed988e4e8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd08c2ee9-36')
Nov 03 12:33:06 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-e83f860d-49cd-4ddd-bba1-9a84e6af37e3 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] No BDM found with device name vda, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:33:06 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-e83f860d-49cd-4ddd-bba1-9a84e6af37e3 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] No VIF found with MAC fa:16:3e:fd:9d:36, not building metadata {{(pid=74960) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 12:33:06 user nova-compute[74960]: DEBUG nova.network.neutron [req-cac567a5-fbd8-4322-9705-28906ef898a4 req-fd0d3a9c-24a2-4423-9342-9f192dc00e14 service nova] [instance: 9c447082-b59b-4c8e-8fa0-bf6599a84e91] Updated VIF entry in instance network info cache for port d08c2ee9-364d-4a04-a7de-2e45049473a8. {{(pid=74960) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 12:33:06 user nova-compute[74960]: DEBUG nova.network.neutron [req-cac567a5-fbd8-4322-9705-28906ef898a4 req-fd0d3a9c-24a2-4423-9342-9f192dc00e14 service nova] [instance: 9c447082-b59b-4c8e-8fa0-bf6599a84e91] Updating instance_info_cache with network_info: [{"id": "d08c2ee9-364d-4a04-a7de-2e45049473a8", "address": "fa:16:3e:fd:9d:36", "network": {"id": "1acaa882-f931-44d0-b9d0-17ed988e4e8b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1021854594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ff357804ee44063bce5f36ad836d71d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd08c2ee9-36", "ovs_interfaceid": "d08c2ee9-364d-4a04-a7de-2e45049473a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:33:06 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-cac567a5-fbd8-4322-9705-28906ef898a4 req-fd0d3a9c-24a2-4423-9342-9f192dc00e14 service nova] Releasing lock "refresh_cache-9c447082-b59b-4c8e-8fa0-bf6599a84e91" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:33:07 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:33:07 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:33:07 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:33:08 user nova-compute[74960]: DEBUG nova.compute.manager [req-cd17b44c-0ee0-47a5-b407-266baf819614 req-baaf60aa-1bc1-4a51-abca-70565a454b40 service nova] [instance: 9c447082-b59b-4c8e-8fa0-bf6599a84e91] Received event network-vif-plugged-d08c2ee9-364d-4a04-a7de-2e45049473a8 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:33:08 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-cd17b44c-0ee0-47a5-b407-266baf819614 req-baaf60aa-1bc1-4a51-abca-70565a454b40 service nova] Acquiring lock "9c447082-b59b-4c8e-8fa0-bf6599a84e91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:33:08 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-cd17b44c-0ee0-47a5-b407-266baf819614 req-baaf60aa-1bc1-4a51-abca-70565a454b40 service nova] Lock "9c447082-b59b-4c8e-8fa0-bf6599a84e91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:33:08 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-cd17b44c-0ee0-47a5-b407-266baf819614 req-baaf60aa-1bc1-4a51-abca-70565a454b40 service nova] Lock "9c447082-b59b-4c8e-8fa0-bf6599a84e91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:33:08 user nova-compute[74960]: DEBUG nova.compute.manager [req-cd17b44c-0ee0-47a5-b407-266baf819614 req-baaf60aa-1bc1-4a51-abca-70565a454b40 service nova] [instance: 9c447082-b59b-4c8e-8fa0-bf6599a84e91] No waiting events found dispatching network-vif-plugged-d08c2ee9-364d-4a04-a7de-2e45049473a8 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:33:08 user nova-compute[74960]: WARNING nova.compute.manager [req-cd17b44c-0ee0-47a5-b407-266baf819614 req-baaf60aa-1bc1-4a51-abca-70565a454b40 service nova] [instance: 9c447082-b59b-4c8e-8fa0-bf6599a84e91] Received unexpected event network-vif-plugged-d08c2ee9-364d-4a04-a7de-2e45049473a8 for instance with vm_state building and task_state spawning.
Nov 03 12:33:08 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:33:08 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:33:08 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:33:08 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:33:08 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:33:10 user nova-compute[74960]: DEBUG nova.compute.manager [req-fc5bc85a-df88-4123-927d-0888ccbb8950 req-8404ff89-4693-4b2a-88ad-a720f16a1bf9 service nova] [instance: 9c447082-b59b-4c8e-8fa0-bf6599a84e91] Received event network-vif-plugged-d08c2ee9-364d-4a04-a7de-2e45049473a8 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:33:10 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-fc5bc85a-df88-4123-927d-0888ccbb8950 req-8404ff89-4693-4b2a-88ad-a720f16a1bf9 service nova] Acquiring lock "9c447082-b59b-4c8e-8fa0-bf6599a84e91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:33:10 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-fc5bc85a-df88-4123-927d-0888ccbb8950 req-8404ff89-4693-4b2a-88ad-a720f16a1bf9 service nova] Lock "9c447082-b59b-4c8e-8fa0-bf6599a84e91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:33:10 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-fc5bc85a-df88-4123-927d-0888ccbb8950 req-8404ff89-4693-4b2a-88ad-a720f16a1bf9 service nova] Lock "9c447082-b59b-4c8e-8fa0-bf6599a84e91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:33:10 user nova-compute[74960]: DEBUG nova.compute.manager [req-fc5bc85a-df88-4123-927d-0888ccbb8950 req-8404ff89-4693-4b2a-88ad-a720f16a1bf9 service nova] [instance: 9c447082-b59b-4c8e-8fa0-bf6599a84e91] No waiting events found dispatching network-vif-plugged-d08c2ee9-364d-4a04-a7de-2e45049473a8 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:33:10 user nova-compute[74960]: WARNING nova.compute.manager [req-fc5bc85a-df88-4123-927d-0888ccbb8950 req-8404ff89-4693-4b2a-88ad-a720f16a1bf9 service nova] [instance: 9c447082-b59b-4c8e-8fa0-bf6599a84e91] Received unexpected event network-vif-plugged-d08c2ee9-364d-4a04-a7de-2e45049473a8 for instance with vm_state building and task_state spawning.
Nov 03 12:33:10 user nova-compute[74960]: DEBUG nova.compute.manager [None req-e83f860d-49cd-4ddd-bba1-9a84e6af37e3 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] [instance: 9c447082-b59b-4c8e-8fa0-bf6599a84e91] Instance event wait completed in 0 seconds for  {{(pid=74960) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 12:33:10 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-e83f860d-49cd-4ddd-bba1-9a84e6af37e3 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] [instance: 9c447082-b59b-4c8e-8fa0-bf6599a84e91] Guest created on hypervisor {{(pid=74960) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 12:33:10 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: 9c447082-b59b-4c8e-8fa0-bf6599a84e91] Instance spawned successfully.
Nov 03 12:33:10 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-e83f860d-49cd-4ddd-bba1-9a84e6af37e3 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] [instance: 9c447082-b59b-4c8e-8fa0-bf6599a84e91] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 12:33:10 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-e83f860d-49cd-4ddd-bba1-9a84e6af37e3 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] [instance: 9c447082-b59b-4c8e-8fa0-bf6599a84e91] Found default for hw_cdrom_bus of ide {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:33:10 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-e83f860d-49cd-4ddd-bba1-9a84e6af37e3 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] [instance: 9c447082-b59b-4c8e-8fa0-bf6599a84e91] Found default for hw_disk_bus of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:33:10 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-e83f860d-49cd-4ddd-bba1-9a84e6af37e3 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] [instance: 9c447082-b59b-4c8e-8fa0-bf6599a84e91] Found default for hw_input_bus of None {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:33:10 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-e83f860d-49cd-4ddd-bba1-9a84e6af37e3 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] [instance: 9c447082-b59b-4c8e-8fa0-bf6599a84e91] Found default for hw_pointer_model of None {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:33:10 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-e83f860d-49cd-4ddd-bba1-9a84e6af37e3 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] [instance: 9c447082-b59b-4c8e-8fa0-bf6599a84e91] Found default for hw_video_model of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:33:10 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-e83f860d-49cd-4ddd-bba1-9a84e6af37e3 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] [instance: 9c447082-b59b-4c8e-8fa0-bf6599a84e91] Found default for hw_vif_model of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:33:10 user nova-compute[74960]: INFO nova.compute.manager [None req-e83f860d-49cd-4ddd-bba1-9a84e6af37e3 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] [instance: 9c447082-b59b-4c8e-8fa0-bf6599a84e91] Took 5.97 seconds to spawn the instance on the hypervisor.
Nov 03 12:33:10 user nova-compute[74960]: DEBUG nova.compute.manager [None req-e83f860d-49cd-4ddd-bba1-9a84e6af37e3 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] [instance: 9c447082-b59b-4c8e-8fa0-bf6599a84e91] Checking state {{(pid=74960) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 12:33:10 user nova-compute[74960]: INFO nova.compute.manager [None req-e83f860d-49cd-4ddd-bba1-9a84e6af37e3 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] [instance: 9c447082-b59b-4c8e-8fa0-bf6599a84e91] Took 6.77 seconds to build instance.
Nov 03 12:33:10 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-e83f860d-49cd-4ddd-bba1-9a84e6af37e3 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] Lock "9c447082-b59b-4c8e-8fa0-bf6599a84e91" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.861s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:33:11 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:33:13 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:33:16 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:33:18 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:33:21 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:33:23 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:33:26 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:33:27 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-583245e8-8add-4bff-8655-2ff091247151 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] Calling os-brick to attach iSCSI Volume {{(pid=74960) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 12:33:27 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-583245e8-8add-4bff-8655-2ff091247151 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9aa420acb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lbqIoMWN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:33:27 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-583245e8-8add-4bff-8655-2ff091247151 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:33:27 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-583245e8-8add-4bff-8655-2ff091247151 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:33:27 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-583245e8-8add-4bff-8655-2ff091247151 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:33:27 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-583245e8-8add-4bff-8655-2ff091247151 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:33:27 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-583245e8-8add-4bff-8655-2ff091247151 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:33:27 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-583245e8-8add-4bff-8655-2ff091247151 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:33:27 user nova-compute[74960]: INFO os_brick.initiator.connectors.iscsi [None req-583245e8-8add-4bff-8655-2ff091247151 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 12:33:27 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 -p 172.16.0.220:3260 {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:33:27 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:33:27 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[f25e57e4-0d29-43f2-8e77-e2f680f977e1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:33:27 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-583245e8-8add-4bff-8655-2ff091247151 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 12:33:27 user nova-compute[74960]:  {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:33:27 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 -p 172.16.0.220:3260 --interface default --op new {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:33:27 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:33:27 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c1021a6-c12f-4ff9-883e-bac10c1b7f76]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515] added\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:33:27 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-583245e8-8add-4bff-8655-2ff091247151 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515] added
Nov 03 12:33:27 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:33:27 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:33:27 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:33:27 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[b28046ef-8faf-40e8-bfdd-37d80b8cae8e]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:33:27 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-583245e8-8add-4bff-8655-2ff091247151 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:33:27 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:33:27 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:33:27 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[99a026bd-06c3-41a3-8427-12af3fdf2fcc]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:33:27 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-583245e8-8add-4bff-8655-2ff091247151 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:33:27 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lbqIoMWN {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:33:27 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lbqIoMWN" returned: 0 in 0.020s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:33:27 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf74a9d9-5732-4335-81b8-2f562a046aff]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:33:27 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-583245e8-8add-4bff-8655-2ff091247151 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lbqIoMWN'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:33:27 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:33:27 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:33:27 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[9006e359-12f9-4ef7-8372-25b9739acc0d]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:33:27 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-583245e8-8add-4bff-8655-2ff091247151 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:33:27 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:33:27 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:33:27 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[095acaef-3ecd-405f-bf35-c6e77b34b1c3]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb4978fa-4c83-46f3-a221-af5ff8c25a1e (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:33:27 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-583245e8-8add-4bff-8655-2ff091247151 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:33:27 user nova-compute[74960]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb4978fa-4c83-46f3-a221-af5ff8c25a1e (non-flash)
Nov 03 12:33:27 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:33:27 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-583245e8-8add-4bff-8655-2ff091247151 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:33:27 user nova-compute[74960]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb4978fa-4c83-46f3-a221-af5ff8c25a1e (non-flash)
Nov 03 12:33:27 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:33:27 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 -p 172.16.0.220:3260 --login {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:33:27 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:33:27 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[70d492aa-2654-4290-93e0-0e096c963a09]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:33:27 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-583245e8-8add-4bff-8655-2ff091247151 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515, portal: 172.16.0.220,3260]
Nov 03 12:33:27 user nova-compute[74960]: Login to [iface: default, target: iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515, portal: 172.16.0.220,3260] successful.
Nov 03 12:33:27 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:33:27 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:33:27 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:33:27 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[152bb4ba-88f1-4307-b5ce-bcf5feb821de]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:33:27 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-583245e8-8add-4bff-8655-2ff091247151 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:33:27 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:33:27 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:33:27 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[687acdf0-94c0-4c67-a826-3ba4cd9d383e]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb4978fa-4c83-46f3-a221-af5ff8c25a1e (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:33:27 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-583245e8-8add-4bff-8655-2ff091247151 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:33:27 user nova-compute[74960]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb4978fa-4c83-46f3-a221-af5ff8c25a1e (non-flash)
Nov 03 12:33:27 user nova-compute[74960]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 (non-flash)
Nov 03 12:33:27 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:33:27 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-583245e8-8add-4bff-8655-2ff091247151 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:33:27 user nova-compute[74960]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb4978fa-4c83-46f3-a221-af5ff8c25a1e (non-flash)
Nov 03 12:33:27 user nova-compute[74960]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 (non-flash)
Nov 03 12:33:27 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:33:27 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-583245e8-8add-4bff-8655-2ff091247151 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:33:27 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-583245e8-8add-4bff-8655-2ff091247151 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Connected to 172.16.0.220:3260 {{(pid=74960) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 12:33:27 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-583245e8-8add-4bff-8655-2ff091247151 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] HCTL ('34', '-', '-', 0) found on session 24 with lun 0 {{(pid=74960) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 12:33:27 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-583245e8-8add-4bff-8655-2ff091247151 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74960) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 12:33:27 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:33:27 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:33:27 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[dafd7532-7403-4533-bce9-43a60b11bf56]: (4, ('- - 0', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:33:27 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-583245e8-8add-4bff-8655-2ff091247151 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Searching for a device in session 24 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74960) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 12:33:27 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-583245e8-8add-4bff-8655-2ff091247151 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lbqIoMWN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74960) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 12:33:28 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-583245e8-8add-4bff-8655-2ff091247151 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:33:28 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-583245e8-8add-4bff-8655-2ff091247151 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '23637383138393830', 'path': '/dev/sdc'} {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:33:28 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-583245e8-8add-4bff-8655-2ff091247151 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23637383138393830', 'path': '/dev/sdc'} {{(pid=74960) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 12:33:28 user nova-compute[74960]: DEBUG nova.objects.instance [None req-583245e8-8add-4bff-8655-2ff091247151 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Lazy-loading 'flavor' on Instance uuid 5b7b95c0-3726-4a1c-a384-ec91abf75225 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:33:28 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:33:28 user nova-compute[74960]: DEBUG nova.virt.libvirt.guest [None req-583245e8-8add-4bff-8655-2ff091247151 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] attach device xml: <disk type="block" device="disk">
Nov 03 12:33:28 user nova-compute[74960]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 12:33:28 user nova-compute[74960]:   <source dev="/dev/sdc"/>
Nov 03 12:33:28 user nova-compute[74960]:   <target dev="vdb" bus="virtio"/>
Nov 03 12:33:28 user nova-compute[74960]:   <serial>c0a0a661-c547-4364-8552-3d6497281515</serial>
Nov 03 12:33:28 user nova-compute[74960]: </disk>
Nov 03 12:33:28 user nova-compute[74960]:  {{(pid=74960) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 03 12:33:28 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-583245e8-8add-4bff-8655-2ff091247151 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] No BDM found with device name vda, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:33:28 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-583245e8-8add-4bff-8655-2ff091247151 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:33:28 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-583245e8-8add-4bff-8655-2ff091247151 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] No VIF found with MAC fa:16:3e:cc:a5:1b, not building metadata {{(pid=74960) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 12:33:29 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-583245e8-8add-4bff-8655-2ff091247151 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Lock "5b7b95c0-3726-4a1c-a384-ec91abf75225" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 43.043s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:33:29 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:33:29 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-d488fe7d-6a7b-46e5-aad6-8d38852c1ed6 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Acquiring lock "5b7b95c0-3726-4a1c-a384-ec91abf75225" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:33:29 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-d488fe7d-6a7b-46e5-aad6-8d38852c1ed6 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Lock "5b7b95c0-3726-4a1c-a384-ec91abf75225" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:33:29 user nova-compute[74960]: DEBUG nova.compute.manager [None req-d488fe7d-6a7b-46e5-aad6-8d38852c1ed6 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] Checking state {{(pid=74960) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 12:33:29 user nova-compute[74960]: DEBUG nova.compute.manager [None req-d488fe7d-6a7b-46e5-aad6-8d38852c1ed6 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74960) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 03 12:33:29 user nova-compute[74960]: DEBUG nova.objects.instance [None req-d488fe7d-6a7b-46e5-aad6-8d38852c1ed6 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Lazy-loading 'flavor' on Instance uuid 5b7b95c0-3726-4a1c-a384-ec91abf75225 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:33:29 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:33:29 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:33:29 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:33:29 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:33:30 user nova-compute[74960]: DEBUG nova.compute.manager [req-7ee96297-3a5e-451f-a977-5f5c793ba675 req-a5bcfa68-9f3a-4fe7-9946-09ee063b8cf1 service nova] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] Received event network-vif-unplugged-091cbb89-dd8a-448e-963a-3dbcafde6bb1 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:33:30 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-7ee96297-3a5e-451f-a977-5f5c793ba675 req-a5bcfa68-9f3a-4fe7-9946-09ee063b8cf1 service nova] Acquiring lock "5b7b95c0-3726-4a1c-a384-ec91abf75225-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:33:30 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-7ee96297-3a5e-451f-a977-5f5c793ba675 req-a5bcfa68-9f3a-4fe7-9946-09ee063b8cf1 service nova] Lock "5b7b95c0-3726-4a1c-a384-ec91abf75225-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:33:30 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-7ee96297-3a5e-451f-a977-5f5c793ba675 req-a5bcfa68-9f3a-4fe7-9946-09ee063b8cf1 service nova] Lock "5b7b95c0-3726-4a1c-a384-ec91abf75225-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:33:30 user nova-compute[74960]: DEBUG nova.compute.manager [req-7ee96297-3a5e-451f-a977-5f5c793ba675 req-a5bcfa68-9f3a-4fe7-9946-09ee063b8cf1 service nova] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] No waiting events found dispatching network-vif-unplugged-091cbb89-dd8a-448e-963a-3dbcafde6bb1 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:33:30 user nova-compute[74960]: WARNING nova.compute.manager [req-7ee96297-3a5e-451f-a977-5f5c793ba675 req-a5bcfa68-9f3a-4fe7-9946-09ee063b8cf1 service nova] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] Received unexpected event network-vif-unplugged-091cbb89-dd8a-448e-963a-3dbcafde6bb1 for instance with vm_state active and task_state powering-off.
Nov 03 12:33:30 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:33:30 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:33:30 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:33:30 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] Instance destroyed successfully.
Nov 03 12:33:30 user nova-compute[74960]: DEBUG nova.compute.manager [None req-d488fe7d-6a7b-46e5-aad6-8d38852c1ed6 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] Checking state {{(pid=74960) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 12:33:30 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:33:30 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-d488fe7d-6a7b-46e5-aad6-8d38852c1ed6 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Lock "5b7b95c0-3726-4a1c-a384-ec91abf75225" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.037s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:33:31 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:33:31 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:33:31 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:33:31 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:33:31 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:33:31 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:33:31 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:33:31 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:33:32 user nova-compute[74960]: DEBUG nova.compute.manager [req-084fd3ec-9747-410f-ac37-2e5a6fe10c6d req-f0168c19-58eb-47fb-a4e6-e3d9fd18f834 service nova] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] Received event network-vif-plugged-091cbb89-dd8a-448e-963a-3dbcafde6bb1 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:33:32 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-084fd3ec-9747-410f-ac37-2e5a6fe10c6d req-f0168c19-58eb-47fb-a4e6-e3d9fd18f834 service nova] Acquiring lock "5b7b95c0-3726-4a1c-a384-ec91abf75225-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:33:32 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-084fd3ec-9747-410f-ac37-2e5a6fe10c6d req-f0168c19-58eb-47fb-a4e6-e3d9fd18f834 service nova] Lock "5b7b95c0-3726-4a1c-a384-ec91abf75225-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:33:32 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-084fd3ec-9747-410f-ac37-2e5a6fe10c6d req-f0168c19-58eb-47fb-a4e6-e3d9fd18f834 service nova] Lock "5b7b95c0-3726-4a1c-a384-ec91abf75225-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:33:32 user nova-compute[74960]: DEBUG nova.compute.manager [req-084fd3ec-9747-410f-ac37-2e5a6fe10c6d req-f0168c19-58eb-47fb-a4e6-e3d9fd18f834 service nova] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] No waiting events found dispatching network-vif-plugged-091cbb89-dd8a-448e-963a-3dbcafde6bb1 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:33:32 user nova-compute[74960]: WARNING nova.compute.manager [req-084fd3ec-9747-410f-ac37-2e5a6fe10c6d req-f0168c19-58eb-47fb-a4e6-e3d9fd18f834 service nova] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] Received unexpected event network-vif-plugged-091cbb89-dd8a-448e-963a-3dbcafde6bb1 for instance with vm_state stopped and task_state None.
Nov 03 12:33:32 user nova-compute[74960]: DEBUG nova.compute.manager [req-084fd3ec-9747-410f-ac37-2e5a6fe10c6d req-f0168c19-58eb-47fb-a4e6-e3d9fd18f834 service nova] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] Received event network-vif-plugged-091cbb89-dd8a-448e-963a-3dbcafde6bb1 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:33:32 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-084fd3ec-9747-410f-ac37-2e5a6fe10c6d req-f0168c19-58eb-47fb-a4e6-e3d9fd18f834 service nova] Acquiring lock "5b7b95c0-3726-4a1c-a384-ec91abf75225-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:33:32 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-084fd3ec-9747-410f-ac37-2e5a6fe10c6d req-f0168c19-58eb-47fb-a4e6-e3d9fd18f834 service nova] Lock "5b7b95c0-3726-4a1c-a384-ec91abf75225-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:33:32 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-084fd3ec-9747-410f-ac37-2e5a6fe10c6d req-f0168c19-58eb-47fb-a4e6-e3d9fd18f834 service nova] Lock "5b7b95c0-3726-4a1c-a384-ec91abf75225-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:33:32 user nova-compute[74960]: DEBUG nova.compute.manager [req-084fd3ec-9747-410f-ac37-2e5a6fe10c6d req-f0168c19-58eb-47fb-a4e6-e3d9fd18f834 service nova] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] No waiting events found dispatching network-vif-plugged-091cbb89-dd8a-448e-963a-3dbcafde6bb1 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:33:32 user nova-compute[74960]: WARNING nova.compute.manager [req-084fd3ec-9747-410f-ac37-2e5a6fe10c6d req-f0168c19-58eb-47fb-a4e6-e3d9fd18f834 service nova] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] Received unexpected event network-vif-plugged-091cbb89-dd8a-448e-963a-3dbcafde6bb1 for instance with vm_state stopped and task_state None.
Nov 03 12:33:32 user nova-compute[74960]: DEBUG nova.compute.manager [req-084fd3ec-9747-410f-ac37-2e5a6fe10c6d req-f0168c19-58eb-47fb-a4e6-e3d9fd18f834 service nova] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] Received event network-vif-plugged-091cbb89-dd8a-448e-963a-3dbcafde6bb1 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:33:32 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-084fd3ec-9747-410f-ac37-2e5a6fe10c6d req-f0168c19-58eb-47fb-a4e6-e3d9fd18f834 service nova] Acquiring lock "5b7b95c0-3726-4a1c-a384-ec91abf75225-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:33:32 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-084fd3ec-9747-410f-ac37-2e5a6fe10c6d req-f0168c19-58eb-47fb-a4e6-e3d9fd18f834 service nova] Lock "5b7b95c0-3726-4a1c-a384-ec91abf75225-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:33:32 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-084fd3ec-9747-410f-ac37-2e5a6fe10c6d req-f0168c19-58eb-47fb-a4e6-e3d9fd18f834 service nova] Lock "5b7b95c0-3726-4a1c-a384-ec91abf75225-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:33:32 user nova-compute[74960]: DEBUG nova.compute.manager [req-084fd3ec-9747-410f-ac37-2e5a6fe10c6d req-f0168c19-58eb-47fb-a4e6-e3d9fd18f834 service nova] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] No waiting events found dispatching network-vif-plugged-091cbb89-dd8a-448e-963a-3dbcafde6bb1 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:33:32 user nova-compute[74960]: WARNING nova.compute.manager [req-084fd3ec-9747-410f-ac37-2e5a6fe10c6d req-f0168c19-58eb-47fb-a4e6-e3d9fd18f834 service nova] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] Received unexpected event network-vif-plugged-091cbb89-dd8a-448e-963a-3dbcafde6bb1 for instance with vm_state stopped and task_state None.
Nov 03 12:33:32 user nova-compute[74960]: DEBUG nova.compute.manager [req-084fd3ec-9747-410f-ac37-2e5a6fe10c6d req-f0168c19-58eb-47fb-a4e6-e3d9fd18f834 service nova] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] Received event network-vif-unplugged-091cbb89-dd8a-448e-963a-3dbcafde6bb1 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:33:32 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-084fd3ec-9747-410f-ac37-2e5a6fe10c6d req-f0168c19-58eb-47fb-a4e6-e3d9fd18f834 service nova] Acquiring lock "5b7b95c0-3726-4a1c-a384-ec91abf75225-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:33:32 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-084fd3ec-9747-410f-ac37-2e5a6fe10c6d req-f0168c19-58eb-47fb-a4e6-e3d9fd18f834 service nova] Lock "5b7b95c0-3726-4a1c-a384-ec91abf75225-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:33:32 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-084fd3ec-9747-410f-ac37-2e5a6fe10c6d req-f0168c19-58eb-47fb-a4e6-e3d9fd18f834 service nova] Lock "5b7b95c0-3726-4a1c-a384-ec91abf75225-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:33:32 user nova-compute[74960]: DEBUG nova.compute.manager [req-084fd3ec-9747-410f-ac37-2e5a6fe10c6d req-f0168c19-58eb-47fb-a4e6-e3d9fd18f834 service nova] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] No waiting events found dispatching network-vif-unplugged-091cbb89-dd8a-448e-963a-3dbcafde6bb1 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:33:32 user nova-compute[74960]: WARNING nova.compute.manager [req-084fd3ec-9747-410f-ac37-2e5a6fe10c6d req-f0168c19-58eb-47fb-a4e6-e3d9fd18f834 service nova] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] Received unexpected event network-vif-unplugged-091cbb89-dd8a-448e-963a-3dbcafde6bb1 for instance with vm_state stopped and task_state None.
Nov 03 12:33:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:33:33 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-0f16dee6-cabb-4921-9bcc-84da28c9692b tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Acquiring lock "12ae6707-c1c6-4bc2-a409-67cea64fc2c3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:33:33 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-0f16dee6-cabb-4921-9bcc-84da28c9692b tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Lock "12ae6707-c1c6-4bc2-a409-67cea64fc2c3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:33:33 user nova-compute[74960]: DEBUG nova.compute.manager [None req-0f16dee6-cabb-4921-9bcc-84da28c9692b tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] [instance: 12ae6707-c1c6-4bc2-a409-67cea64fc2c3] Starting instance... {{(pid=74960) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 12:33:34 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-0f16dee6-cabb-4921-9bcc-84da28c9692b tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:33:34 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-0f16dee6-cabb-4921-9bcc-84da28c9692b tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:33:34 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-0f16dee6-cabb-4921-9bcc-84da28c9692b tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74960) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 12:33:34 user nova-compute[74960]: INFO nova.compute.claims [None req-0f16dee6-cabb-4921-9bcc-84da28c9692b tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] [instance: 12ae6707-c1c6-4bc2-a409-67cea64fc2c3] Claim successful on node user
Nov 03 12:33:34 user nova-compute[74960]: DEBUG nova.compute.manager [req-44289de3-82f5-4aa1-ada6-be5773dc6861 req-a042e79c-54fd-4f28-9400-714bb4bccf29 service nova] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] Received event network-vif-plugged-091cbb89-dd8a-448e-963a-3dbcafde6bb1 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:33:34 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-44289de3-82f5-4aa1-ada6-be5773dc6861 req-a042e79c-54fd-4f28-9400-714bb4bccf29 service nova] Acquiring lock "5b7b95c0-3726-4a1c-a384-ec91abf75225-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:33:34 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-44289de3-82f5-4aa1-ada6-be5773dc6861 req-a042e79c-54fd-4f28-9400-714bb4bccf29 service nova] Lock "5b7b95c0-3726-4a1c-a384-ec91abf75225-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:33:34 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-44289de3-82f5-4aa1-ada6-be5773dc6861 req-a042e79c-54fd-4f28-9400-714bb4bccf29 service nova] Lock "5b7b95c0-3726-4a1c-a384-ec91abf75225-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:33:34 user nova-compute[74960]: DEBUG nova.compute.manager [req-44289de3-82f5-4aa1-ada6-be5773dc6861 req-a042e79c-54fd-4f28-9400-714bb4bccf29 service nova] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] No waiting events found dispatching network-vif-plugged-091cbb89-dd8a-448e-963a-3dbcafde6bb1 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:33:34 user nova-compute[74960]: WARNING nova.compute.manager [req-44289de3-82f5-4aa1-ada6-be5773dc6861 req-a042e79c-54fd-4f28-9400-714bb4bccf29 service nova] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] Received unexpected event network-vif-plugged-091cbb89-dd8a-448e-963a-3dbcafde6bb1 for instance with vm_state stopped and task_state None.
Nov 03 12:33:35 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-0f16dee6-cabb-4921-9bcc-84da28c9692b tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:33:35 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-0f16dee6-cabb-4921-9bcc-84da28c9692b tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:33:35 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-0f16dee6-cabb-4921-9bcc-84da28c9692b tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.239s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:33:35 user nova-compute[74960]: DEBUG nova.compute.manager [None req-0f16dee6-cabb-4921-9bcc-84da28c9692b tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] [instance: 12ae6707-c1c6-4bc2-a409-67cea64fc2c3] Start building networks asynchronously for instance. {{(pid=74960) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 12:33:35 user nova-compute[74960]: DEBUG nova.compute.manager [None req-0f16dee6-cabb-4921-9bcc-84da28c9692b tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] [instance: 12ae6707-c1c6-4bc2-a409-67cea64fc2c3] Allocating IP information in the background. {{(pid=74960) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 12:33:35 user nova-compute[74960]: DEBUG nova.network.neutron [None req-0f16dee6-cabb-4921-9bcc-84da28c9692b tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] [instance: 12ae6707-c1c6-4bc2-a409-67cea64fc2c3] allocate_for_instance() {{(pid=74960) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 12:33:35 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-0f16dee6-cabb-4921-9bcc-84da28c9692b tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] [instance: 12ae6707-c1c6-4bc2-a409-67cea64fc2c3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 12:33:35 user nova-compute[74960]: DEBUG nova.compute.manager [None req-0f16dee6-cabb-4921-9bcc-84da28c9692b tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] [instance: 12ae6707-c1c6-4bc2-a409-67cea64fc2c3] Start building block device mappings for instance. {{(pid=74960) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 12:33:35 user nova-compute[74960]: DEBUG nova.policy [None req-0f16dee6-cabb-4921-9bcc-84da28c9692b tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5b5fbd2703e241afb720be4680301751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa134687c74460fb5a59dd3ddece671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74960) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 12:33:36 user nova-compute[74960]: DEBUG nova.compute.manager [None req-0f16dee6-cabb-4921-9bcc-84da28c9692b tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] [instance: 12ae6707-c1c6-4bc2-a409-67cea64fc2c3] Start spawning the instance on the hypervisor. {{(pid=74960) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 12:33:36 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-0f16dee6-cabb-4921-9bcc-84da28c9692b tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] [instance: 12ae6707-c1c6-4bc2-a409-67cea64fc2c3] Creating instance directory {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 12:33:36 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-0f16dee6-cabb-4921-9bcc-84da28c9692b tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] [instance: 12ae6707-c1c6-4bc2-a409-67cea64fc2c3] Creating image(s)
Nov 03 12:33:36 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-0f16dee6-cabb-4921-9bcc-84da28c9692b tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Acquiring lock "/opt/stack/data/nova/instances/12ae6707-c1c6-4bc2-a409-67cea64fc2c3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:33:36 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-0f16dee6-cabb-4921-9bcc-84da28c9692b tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Lock "/opt/stack/data/nova/instances/12ae6707-c1c6-4bc2-a409-67cea64fc2c3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:33:36 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-0f16dee6-cabb-4921-9bcc-84da28c9692b tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Lock "/opt/stack/data/nova/instances/12ae6707-c1c6-4bc2-a409-67cea64fc2c3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:33:36 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-0f16dee6-cabb-4921-9bcc-84da28c9692b tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:33:36 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-0f16dee6-cabb-4921-9bcc-84da28c9692b tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.237s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:33:36 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-0f16dee6-cabb-4921-9bcc-84da28c9692b tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Acquiring lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:33:36 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-0f16dee6-cabb-4921-9bcc-84da28c9692b tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:33:36 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-0f16dee6-cabb-4921-9bcc-84da28c9692b tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:33:36 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:33:36 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-0f16dee6-cabb-4921-9bcc-84da28c9692b tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.227s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:33:36 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-0f16dee6-cabb-4921-9bcc-84da28c9692b tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910,backing_fmt=raw /opt/stack/data/nova/instances/12ae6707-c1c6-4bc2-a409-67cea64fc2c3/disk 1073741824 {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:33:36 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-0f16dee6-cabb-4921-9bcc-84da28c9692b tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910,backing_fmt=raw /opt/stack/data/nova/instances/12ae6707-c1c6-4bc2-a409-67cea64fc2c3/disk 1073741824" returned: 0 in 0.048s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:33:36 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-0f16dee6-cabb-4921-9bcc-84da28c9692b tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.282s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:33:36 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-0f16dee6-cabb-4921-9bcc-84da28c9692b tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:33:36 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-f064e8cb-2312-47eb-bb46-a489263c46c2 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Acquiring lock "b7606a55-d5c3-4ba8-b499-f3c70813f151" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:33:36 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-f064e8cb-2312-47eb-bb46-a489263c46c2 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Lock "b7606a55-d5c3-4ba8-b499-f3c70813f151" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:33:36 user nova-compute[74960]: DEBUG nova.compute.manager [None req-f064e8cb-2312-47eb-bb46-a489263c46c2 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: b7606a55-d5c3-4ba8-b499-f3c70813f151] Starting instance... {{(pid=74960) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 12:33:36 user nova-compute[74960]: DEBUG nova.network.neutron [None req-0f16dee6-cabb-4921-9bcc-84da28c9692b tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] [instance: 12ae6707-c1c6-4bc2-a409-67cea64fc2c3] Successfully created port: 356b6bc6-6335-476f-948e-7bc8bc4fc88c {{(pid=74960) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 12:33:36 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-0f16dee6-cabb-4921-9bcc-84da28c9692b tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.239s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:33:36 user nova-compute[74960]: DEBUG nova.virt.disk.api [None req-0f16dee6-cabb-4921-9bcc-84da28c9692b tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Checking if we can resize image /opt/stack/data/nova/instances/12ae6707-c1c6-4bc2-a409-67cea64fc2c3/disk. size=1073741824 {{(pid=74960) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 12:33:36 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-0f16dee6-cabb-4921-9bcc-84da28c9692b tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12ae6707-c1c6-4bc2-a409-67cea64fc2c3/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:33:36 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-f064e8cb-2312-47eb-bb46-a489263c46c2 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:33:36 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-f064e8cb-2312-47eb-bb46-a489263c46c2 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:33:36 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-f064e8cb-2312-47eb-bb46-a489263c46c2 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74960) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 12:33:36 user nova-compute[74960]: INFO nova.compute.claims [None req-f064e8cb-2312-47eb-bb46-a489263c46c2 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: b7606a55-d5c3-4ba8-b499-f3c70813f151] Claim successful on node user
Nov 03 12:33:37 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-0f16dee6-cabb-4921-9bcc-84da28c9692b tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12ae6707-c1c6-4bc2-a409-67cea64fc2c3/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:33:37 user nova-compute[74960]: DEBUG nova.virt.disk.api [None req-0f16dee6-cabb-4921-9bcc-84da28c9692b tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Cannot resize image /opt/stack/data/nova/instances/12ae6707-c1c6-4bc2-a409-67cea64fc2c3/disk to a smaller size. {{(pid=74960) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 12:33:37 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-0f16dee6-cabb-4921-9bcc-84da28c9692b tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] [instance: 12ae6707-c1c6-4bc2-a409-67cea64fc2c3] Created local disks {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 12:33:37 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-0f16dee6-cabb-4921-9bcc-84da28c9692b tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] [instance: 12ae6707-c1c6-4bc2-a409-67cea64fc2c3] Ensure instance console log exists: /opt/stack/data/nova/instances/12ae6707-c1c6-4bc2-a409-67cea64fc2c3/console.log {{(pid=74960) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 12:33:37 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-0f16dee6-cabb-4921-9bcc-84da28c9692b tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:33:37 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-0f16dee6-cabb-4921-9bcc-84da28c9692b tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:33:37 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-0f16dee6-cabb-4921-9bcc-84da28c9692b tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:33:37 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-f064e8cb-2312-47eb-bb46-a489263c46c2 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:33:37 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-f064e8cb-2312-47eb-bb46-a489263c46c2 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:33:37 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-f064e8cb-2312-47eb-bb46-a489263c46c2 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.495s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:33:37 user nova-compute[74960]: DEBUG nova.compute.manager [None req-f064e8cb-2312-47eb-bb46-a489263c46c2 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: b7606a55-d5c3-4ba8-b499-f3c70813f151] Start building networks asynchronously for instance. {{(pid=74960) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 12:33:37 user nova-compute[74960]: DEBUG nova.compute.manager [None req-f064e8cb-2312-47eb-bb46-a489263c46c2 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: b7606a55-d5c3-4ba8-b499-f3c70813f151] Allocating IP information in the background. {{(pid=74960) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 12:33:37 user nova-compute[74960]: DEBUG nova.network.neutron [None req-f064e8cb-2312-47eb-bb46-a489263c46c2 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: b7606a55-d5c3-4ba8-b499-f3c70813f151] allocate_for_instance() {{(pid=74960) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 12:33:37 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-f064e8cb-2312-47eb-bb46-a489263c46c2 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: b7606a55-d5c3-4ba8-b499-f3c70813f151] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 12:33:37 user nova-compute[74960]: DEBUG nova.compute.manager [None req-f064e8cb-2312-47eb-bb46-a489263c46c2 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: b7606a55-d5c3-4ba8-b499-f3c70813f151] Start building block device mappings for instance. {{(pid=74960) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 12:33:37 user nova-compute[74960]: DEBUG nova.network.neutron [None req-0f16dee6-cabb-4921-9bcc-84da28c9692b tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] [instance: 12ae6707-c1c6-4bc2-a409-67cea64fc2c3] Successfully updated port: 356b6bc6-6335-476f-948e-7bc8bc4fc88c {{(pid=74960) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 12:33:37 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-0f16dee6-cabb-4921-9bcc-84da28c9692b tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Acquiring lock "refresh_cache-12ae6707-c1c6-4bc2-a409-67cea64fc2c3" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:33:37 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-0f16dee6-cabb-4921-9bcc-84da28c9692b tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Acquired lock "refresh_cache-12ae6707-c1c6-4bc2-a409-67cea64fc2c3" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:33:37 user nova-compute[74960]: DEBUG nova.network.neutron [None req-0f16dee6-cabb-4921-9bcc-84da28c9692b tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] [instance: 12ae6707-c1c6-4bc2-a409-67cea64fc2c3] Building network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 12:33:37 user nova-compute[74960]: DEBUG nova.compute.manager [req-c81b3729-6ea5-42f8-80b2-a3675b656f76 req-a0e174b6-8bb1-420f-918d-ebdc084acead service nova] [instance: 12ae6707-c1c6-4bc2-a409-67cea64fc2c3] Received event network-changed-356b6bc6-6335-476f-948e-7bc8bc4fc88c {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:33:37 user nova-compute[74960]: DEBUG nova.compute.manager [req-c81b3729-6ea5-42f8-80b2-a3675b656f76 req-a0e174b6-8bb1-420f-918d-ebdc084acead service nova] [instance: 12ae6707-c1c6-4bc2-a409-67cea64fc2c3] Refreshing instance network info cache due to event network-changed-356b6bc6-6335-476f-948e-7bc8bc4fc88c. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 12:33:37 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-c81b3729-6ea5-42f8-80b2-a3675b656f76 req-a0e174b6-8bb1-420f-918d-ebdc084acead service nova] Acquiring lock "refresh_cache-12ae6707-c1c6-4bc2-a409-67cea64fc2c3" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:33:37 user nova-compute[74960]: DEBUG nova.policy [None req-f064e8cb-2312-47eb-bb46-a489263c46c2 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c473215929044a108c9fc4d6327dfc3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc95d68d5e147e1953c855169b17091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74960) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 12:33:37 user nova-compute[74960]: DEBUG nova.network.neutron [None req-0f16dee6-cabb-4921-9bcc-84da28c9692b tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] [instance: 12ae6707-c1c6-4bc2-a409-67cea64fc2c3] Instance cache missing network info. {{(pid=74960) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 12:33:37 user nova-compute[74960]: DEBUG nova.compute.manager [None req-f064e8cb-2312-47eb-bb46-a489263c46c2 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: b7606a55-d5c3-4ba8-b499-f3c70813f151] Start spawning the instance on the hypervisor. {{(pid=74960) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 12:33:37 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-f064e8cb-2312-47eb-bb46-a489263c46c2 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: b7606a55-d5c3-4ba8-b499-f3c70813f151] Creating instance directory {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 12:33:37 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-f064e8cb-2312-47eb-bb46-a489263c46c2 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: b7606a55-d5c3-4ba8-b499-f3c70813f151] Creating image(s)
Nov 03 12:33:37 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-f064e8cb-2312-47eb-bb46-a489263c46c2 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Acquiring lock "/opt/stack/data/nova/instances/b7606a55-d5c3-4ba8-b499-f3c70813f151/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:33:37 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-f064e8cb-2312-47eb-bb46-a489263c46c2 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Lock "/opt/stack/data/nova/instances/b7606a55-d5c3-4ba8-b499-f3c70813f151/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:33:37 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-f064e8cb-2312-47eb-bb46-a489263c46c2 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Lock "/opt/stack/data/nova/instances/b7606a55-d5c3-4ba8-b499-f3c70813f151/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:33:37 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-f064e8cb-2312-47eb-bb46-a489263c46c2 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:33:37 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-f064e8cb-2312-47eb-bb46-a489263c46c2 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.219s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:33:37 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-f064e8cb-2312-47eb-bb46-a489263c46c2 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Acquiring lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:33:37 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-f064e8cb-2312-47eb-bb46-a489263c46c2 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:33:37 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-f064e8cb-2312-47eb-bb46-a489263c46c2 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:33:37 user nova-compute[74960]: DEBUG nova.network.neutron [None req-0f16dee6-cabb-4921-9bcc-84da28c9692b tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] [instance: 12ae6707-c1c6-4bc2-a409-67cea64fc2c3] Updating instance_info_cache with network_info: [{"id": "356b6bc6-6335-476f-948e-7bc8bc4fc88c", "address": "fa:16:3e:d7:40:80", "network": {"id": "82ebe97c-a056-4ac2-9644-ea315bf9a4b1", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1024050438-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efa134687c74460fb5a59dd3ddece671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap356b6bc6-63", "ovs_interfaceid": "356b6bc6-6335-476f-948e-7bc8bc4fc88c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:33:37 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-0f16dee6-cabb-4921-9bcc-84da28c9692b tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Releasing lock "refresh_cache-12ae6707-c1c6-4bc2-a409-67cea64fc2c3" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:33:37 user nova-compute[74960]: DEBUG nova.compute.manager [None req-0f16dee6-cabb-4921-9bcc-84da28c9692b tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] [instance: 12ae6707-c1c6-4bc2-a409-67cea64fc2c3] Instance network_info: |[{"id": "356b6bc6-6335-476f-948e-7bc8bc4fc88c", "address": "fa:16:3e:d7:40:80", "network": {"id": "82ebe97c-a056-4ac2-9644-ea315bf9a4b1", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1024050438-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efa134687c74460fb5a59dd3ddece671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap356b6bc6-63", "ovs_interfaceid": "356b6bc6-6335-476f-948e-7bc8bc4fc88c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74960) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 12:33:37 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-c81b3729-6ea5-42f8-80b2-a3675b656f76 req-a0e174b6-8bb1-420f-918d-ebdc084acead service nova] Acquired lock "refresh_cache-12ae6707-c1c6-4bc2-a409-67cea64fc2c3" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:33:37 user nova-compute[74960]: DEBUG nova.network.neutron [req-c81b3729-6ea5-42f8-80b2-a3675b656f76 req-a0e174b6-8bb1-420f-918d-ebdc084acead service nova] [instance: 12ae6707-c1c6-4bc2-a409-67cea64fc2c3] Refreshing network info cache for port 356b6bc6-6335-476f-948e-7bc8bc4fc88c {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 12:33:37 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-0f16dee6-cabb-4921-9bcc-84da28c9692b tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] [instance: 12ae6707-c1c6-4bc2-a409-67cea64fc2c3] Start _get_guest_xml network_info=[{"id": "356b6bc6-6335-476f-948e-7bc8bc4fc88c", "address": "fa:16:3e:d7:40:80", "network": {"id": "82ebe97c-a056-4ac2-9644-ea315bf9a4b1", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1024050438-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efa134687c74460fb5a59dd3ddece671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap356b6bc6-63", "ovs_interfaceid": "356b6bc6-6335-476f-948e-7bc8bc4fc88c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=549f51ba-ac69-494b-8de1-34635aa2d7cf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='63ee9c80c632442fb0379f47b784bd20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T12:13:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'image_id': '549f51ba-ac69-494b-8de1-34635aa2d7cf'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 12:33:38 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-0f16dee6-cabb-4921-9bcc-84da28c9692b tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:33:38 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-0f16dee6-cabb-4921-9bcc-84da28c9692b tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:33:38 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-0f16dee6-cabb-4921-9bcc-84da28c9692b tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 12:33:38 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-0f16dee6-cabb-4921-9bcc-84da28c9692b tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] CPU controller missing on host. {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 12:33:38 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-0f16dee6-cabb-4921-9bcc-84da28c9692b tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 12:33:38 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-0f16dee6-cabb-4921-9bcc-84da28c9692b tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] CPU controller found on host. {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 12:33:38 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-0f16dee6-cabb-4921-9bcc-84da28c9692b tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74960) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 12:33:38 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-0f16dee6-cabb-4921-9bcc-84da28c9692b tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=549f51ba-ac69-494b-8de1-34635aa2d7cf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='63ee9c80c632442fb0379f47b784bd20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T12:13:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 12:33:38 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-0f16dee6-cabb-4921-9bcc-84da28c9692b tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Flavor limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 12:33:38 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-0f16dee6-cabb-4921-9bcc-84da28c9692b tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Image limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 12:33:38 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-0f16dee6-cabb-4921-9bcc-84da28c9692b tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Flavor pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 12:33:38 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-0f16dee6-cabb-4921-9bcc-84da28c9692b tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Image pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 12:33:38 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-0f16dee6-cabb-4921-9bcc-84da28c9692b tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 12:33:38 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-0f16dee6-cabb-4921-9bcc-84da28c9692b tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 12:33:38 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-0f16dee6-cabb-4921-9bcc-84da28c9692b tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 12:33:38 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-0f16dee6-cabb-4921-9bcc-84da28c9692b tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Got 1 possible topologies {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 12:33:38 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-0f16dee6-cabb-4921-9bcc-84da28c9692b tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 12:33:38 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-0f16dee6-cabb-4921-9bcc-84da28c9692b tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 12:33:38 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-0f16dee6-cabb-4921-9bcc-84da28c9692b tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:33:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-763194758',display_name='tempest-VolumesSnapshotTestJSON-instance-763194758',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-763194758',id=34,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJErDah/iWWznsurVF8MVa4A/B4DpHy0yvVfrFAJrbm4OGQ5lRTx5u2rIeV78O2wMCwZJFJqJnAYfPGnicZBscmt0zG76mKOxqsuJbUc6S4Rs2Nr3msLQgPow++ETR44jw==',key_name='tempest-keypair-1601541259',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='efa134687c74460fb5a59dd3ddece671',ramdisk_id='',reservation_id='r-e83p82ny',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1639372533',owner_user_name='tempest-VolumesSnapshotTestJSON-1639372533-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:33:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b5fbd2703e241afb720be4680301751',uuid=12ae6707-c1c6-4bc2-a409-67cea64fc2c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "356b6bc6-6335-476f-948e-7bc8bc4fc88c", "address": "fa:16:3e:d7:40:80", "network": {"id": "82ebe97c-a056-4ac2-9644-ea315bf9a4b1", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1024050438-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efa134687c74460fb5a59dd3ddece671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap356b6bc6-63", "ovs_interfaceid": "356b6bc6-6335-476f-948e-7bc8bc4fc88c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74960) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 12:33:38 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-0f16dee6-cabb-4921-9bcc-84da28c9692b tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Converting VIF {"id": "356b6bc6-6335-476f-948e-7bc8bc4fc88c", "address": "fa:16:3e:d7:40:80", "network": {"id": "82ebe97c-a056-4ac2-9644-ea315bf9a4b1", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1024050438-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efa134687c74460fb5a59dd3ddece671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap356b6bc6-63", "ovs_interfaceid": "356b6bc6-6335-476f-948e-7bc8bc4fc88c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:33:38 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-0f16dee6-cabb-4921-9bcc-84da28c9692b tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:40:80,bridge_name='br-int',has_traffic_filtering=True,id=356b6bc6-6335-476f-948e-7bc8bc4fc88c,network=Network(82ebe97c-a056-4ac2-9644-ea315bf9a4b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap356b6bc6-63') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:33:38 user nova-compute[74960]: DEBUG nova.objects.instance [None req-0f16dee6-cabb-4921-9bcc-84da28c9692b tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Lazy-loading 'pci_devices' on Instance uuid 12ae6707-c1c6-4bc2-a409-67cea64fc2c3 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:33:38 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-0f16dee6-cabb-4921-9bcc-84da28c9692b tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] [instance: 12ae6707-c1c6-4bc2-a409-67cea64fc2c3] End _get_guest_xml xml=<domain type="kvm">
Nov 03 12:33:38 user nova-compute[74960]:   <uuid>12ae6707-c1c6-4bc2-a409-67cea64fc2c3</uuid>
Nov 03 12:33:38 user nova-compute[74960]:   <name>instance-00000022</name>
Nov 03 12:33:38 user nova-compute[74960]:   <memory>524288</memory>
Nov 03 12:33:38 user nova-compute[74960]:   <vcpu>1</vcpu>
Nov 03 12:33:38 user nova-compute[74960]:   <metadata>
Nov 03 12:33:38 user nova-compute[74960]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 12:33:38 user nova-compute[74960]:       <nova:package version="0.0.0"/>
Nov 03 12:33:38 user nova-compute[74960]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-763194758</nova:name>
Nov 03 12:33:38 user nova-compute[74960]:       <nova:creationTime>2023-11-03 12:33:38</nova:creationTime>
Nov 03 12:33:38 user nova-compute[74960]:       <nova:flavor name="m1.tiny">
Nov 03 12:33:38 user nova-compute[74960]:         <nova:memory>512</nova:memory>
Nov 03 12:33:38 user nova-compute[74960]:         <nova:disk>1</nova:disk>
Nov 03 12:33:38 user nova-compute[74960]:         <nova:swap>0</nova:swap>
Nov 03 12:33:38 user nova-compute[74960]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 12:33:38 user nova-compute[74960]:         <nova:vcpus>1</nova:vcpus>
Nov 03 12:33:38 user nova-compute[74960]:       </nova:flavor>
Nov 03 12:33:38 user nova-compute[74960]:       <nova:owner>
Nov 03 12:33:38 user nova-compute[74960]:         <nova:user uuid="5b5fbd2703e241afb720be4680301751">tempest-VolumesSnapshotTestJSON-1639372533-project-member</nova:user>
Nov 03 12:33:38 user nova-compute[74960]:         <nova:project uuid="efa134687c74460fb5a59dd3ddece671">tempest-VolumesSnapshotTestJSON-1639372533</nova:project>
Nov 03 12:33:38 user nova-compute[74960]:       </nova:owner>
Nov 03 12:33:38 user nova-compute[74960]:       <nova:root type="image" uuid="549f51ba-ac69-494b-8de1-34635aa2d7cf"/>
Nov 03 12:33:38 user nova-compute[74960]:       <nova:ports>
Nov 03 12:33:38 user nova-compute[74960]:         <nova:port uuid="356b6bc6-6335-476f-948e-7bc8bc4fc88c">
Nov 03 12:33:38 user nova-compute[74960]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 03 12:33:38 user nova-compute[74960]:         </nova:port>
Nov 03 12:33:38 user nova-compute[74960]:       </nova:ports>
Nov 03 12:33:38 user nova-compute[74960]:     </nova:instance>
Nov 03 12:33:38 user nova-compute[74960]:   </metadata>
Nov 03 12:33:38 user nova-compute[74960]:   <sysinfo type="smbios">
Nov 03 12:33:38 user nova-compute[74960]:     <system>
Nov 03 12:33:38 user nova-compute[74960]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 12:33:38 user nova-compute[74960]:       <entry name="product">OpenStack Nova</entry>
Nov 03 12:33:38 user nova-compute[74960]:       <entry name="version">0.0.0</entry>
Nov 03 12:33:38 user nova-compute[74960]:       <entry name="serial">12ae6707-c1c6-4bc2-a409-67cea64fc2c3</entry>
Nov 03 12:33:38 user nova-compute[74960]:       <entry name="uuid">12ae6707-c1c6-4bc2-a409-67cea64fc2c3</entry>
Nov 03 12:33:38 user nova-compute[74960]:       <entry name="family">Virtual Machine</entry>
Nov 03 12:33:38 user nova-compute[74960]:     </system>
Nov 03 12:33:38 user nova-compute[74960]:   </sysinfo>
Nov 03 12:33:38 user nova-compute[74960]:   <os>
Nov 03 12:33:38 user nova-compute[74960]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 12:33:38 user nova-compute[74960]:     <boot dev="hd"/>
Nov 03 12:33:38 user nova-compute[74960]:     <smbios mode="sysinfo"/>
Nov 03 12:33:38 user nova-compute[74960]:   </os>
Nov 03 12:33:38 user nova-compute[74960]:   <features>
Nov 03 12:33:38 user nova-compute[74960]:     <acpi/>
Nov 03 12:33:38 user nova-compute[74960]:     <apic/>
Nov 03 12:33:38 user nova-compute[74960]:     <vmcoreinfo/>
Nov 03 12:33:38 user nova-compute[74960]:   </features>
Nov 03 12:33:38 user nova-compute[74960]:   <clock offset="utc">
Nov 03 12:33:38 user nova-compute[74960]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 12:33:38 user nova-compute[74960]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 12:33:38 user nova-compute[74960]:     <timer name="hpet" present="no"/>
Nov 03 12:33:38 user nova-compute[74960]:   </clock>
Nov 03 12:33:38 user nova-compute[74960]:   <cpu mode="custom" match="exact">
Nov 03 12:33:38 user nova-compute[74960]:     <model>Nehalem</model>
Nov 03 12:33:38 user nova-compute[74960]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 12:33:38 user nova-compute[74960]:   </cpu>
Nov 03 12:33:38 user nova-compute[74960]:   <devices>
Nov 03 12:33:38 user nova-compute[74960]:     <disk type="file" device="disk">
Nov 03 12:33:38 user nova-compute[74960]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 12:33:38 user nova-compute[74960]:       <source file="/opt/stack/data/nova/instances/12ae6707-c1c6-4bc2-a409-67cea64fc2c3/disk"/>
Nov 03 12:33:38 user nova-compute[74960]:       <target dev="vda" bus="virtio"/>
Nov 03 12:33:38 user nova-compute[74960]:     </disk>
Nov 03 12:33:38 user nova-compute[74960]:     <interface type="ethernet">
Nov 03 12:33:38 user nova-compute[74960]:       <mac address="fa:16:3e:d7:40:80"/>
Nov 03 12:33:38 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:33:38 user nova-compute[74960]:       <mtu size="1442"/>
Nov 03 12:33:38 user nova-compute[74960]:       <target dev="tap356b6bc6-63"/>
Nov 03 12:33:38 user nova-compute[74960]:     </interface>
Nov 03 12:33:38 user nova-compute[74960]:     <serial type="pty">
Nov 03 12:33:38 user nova-compute[74960]:       <log file="/opt/stack/data/nova/instances/12ae6707-c1c6-4bc2-a409-67cea64fc2c3/console.log" append="off"/>
Nov 03 12:33:38 user nova-compute[74960]:     </serial>
Nov 03 12:33:38 user nova-compute[74960]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 12:33:38 user nova-compute[74960]:     <video>
Nov 03 12:33:38 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:33:38 user nova-compute[74960]:     </video>
Nov 03 12:33:38 user nova-compute[74960]:     <rng model="virtio">
Nov 03 12:33:38 user nova-compute[74960]:       <backend model="random">/dev/urandom</backend>
Nov 03 12:33:38 user nova-compute[74960]:     </rng>
Nov 03 12:33:38 user nova-compute[74960]:     <controller type="usb" index="0" model="none"/>
Nov 03 12:33:38 user nova-compute[74960]:     <memballoon model="virtio">
Nov 03 12:33:38 user nova-compute[74960]:       <stats period="10"/>
Nov 03 12:33:38 user nova-compute[74960]:     </memballoon>
Nov 03 12:33:38 user nova-compute[74960]:   </devices>
Nov 03 12:33:38 user nova-compute[74960]: </domain>
Nov 03 12:33:38 user nova-compute[74960]:  {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 12:33:38 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-0f16dee6-cabb-4921-9bcc-84da28c9692b tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:33:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-763194758',display_name='tempest-VolumesSnapshotTestJSON-instance-763194758',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-763194758',id=34,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJErDah/iWWznsurVF8MVa4A/B4DpHy0yvVfrFAJrbm4OGQ5lRTx5u2rIeV78O2wMCwZJFJqJnAYfPGnicZBscmt0zG76mKOxqsuJbUc6S4Rs2Nr3msLQgPow++ETR44jw==',key_name='tempest-keypair-1601541259',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='efa134687c74460fb5a59dd3ddece671',ramdisk_id='',reservation_id='r-e83p82ny',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1639372533',owner_user_name='tempest-VolumesSnapshotTestJSON-1639372533-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:33:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b5fbd2703e241afb720be4680301751',uuid=12ae6707-c1c6-4bc2-a409-67cea64fc2c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "356b6bc6-6335-476f-948e-7bc8bc4fc88c", "address": "fa:16:3e:d7:40:80", "network": {"id": "82ebe97c-a056-4ac2-9644-ea315bf9a4b1", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1024050438-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efa134687c74460fb5a59dd3ddece671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap356b6bc6-63", "ovs_interfaceid": "356b6bc6-6335-476f-948e-7bc8bc4fc88c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 12:33:38 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-0f16dee6-cabb-4921-9bcc-84da28c9692b tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Converting VIF {"id": "356b6bc6-6335-476f-948e-7bc8bc4fc88c", "address": "fa:16:3e:d7:40:80", "network": {"id": "82ebe97c-a056-4ac2-9644-ea315bf9a4b1", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1024050438-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efa134687c74460fb5a59dd3ddece671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap356b6bc6-63", "ovs_interfaceid": "356b6bc6-6335-476f-948e-7bc8bc4fc88c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:33:38 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-0f16dee6-cabb-4921-9bcc-84da28c9692b tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:40:80,bridge_name='br-int',has_traffic_filtering=True,id=356b6bc6-6335-476f-948e-7bc8bc4fc88c,network=Network(82ebe97c-a056-4ac2-9644-ea315bf9a4b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap356b6bc6-63') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:33:38 user nova-compute[74960]: DEBUG os_vif [None req-0f16dee6-cabb-4921-9bcc-84da28c9692b tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:40:80,bridge_name='br-int',has_traffic_filtering=True,id=356b6bc6-6335-476f-948e-7bc8bc4fc88c,network=Network(82ebe97c-a056-4ac2-9644-ea315bf9a4b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap356b6bc6-63') {{(pid=74960) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 12:33:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:33:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:33:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 12:33:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:33:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9781369d-f2e3-572e-a22b-0c9e09bc53f5', '_type': 'linux-noop'}}, row=False) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:33:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:33:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:33:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:33:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:33:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap356b6bc6-63, may_exist=True, interface_attrs={}) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:33:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap356b6bc6-63, col_values=(('qos', UUID('72f23780-06a6-43a0-9b41-50affa2d8be4')),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:33:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap356b6bc6-63, col_values=(('external_ids', {'iface-id': '356b6bc6-6335-476f-948e-7bc8bc4fc88c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d7:40:80', 'vm-uuid': '12ae6707-c1c6-4bc2-a409-67cea64fc2c3'}),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:33:38 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-f064e8cb-2312-47eb-bb46-a489263c46c2 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.260s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:33:38 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-f064e8cb-2312-47eb-bb46-a489263c46c2 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910,backing_fmt=raw /opt/stack/data/nova/instances/b7606a55-d5c3-4ba8-b499-f3c70813f151/disk 1073741824 {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:33:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:33:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:33:38 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-f064e8cb-2312-47eb-bb46-a489263c46c2 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910,backing_fmt=raw /opt/stack/data/nova/instances/b7606a55-d5c3-4ba8-b499-f3c70813f151/disk 1073741824" returned: 0 in 0.083s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:33:38 user nova-compute[74960]: INFO os_vif [None req-0f16dee6-cabb-4921-9bcc-84da28c9692b tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:40:80,bridge_name='br-int',has_traffic_filtering=True,id=356b6bc6-6335-476f-948e-7bc8bc4fc88c,network=Network(82ebe97c-a056-4ac2-9644-ea315bf9a4b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap356b6bc6-63')
Nov 03 12:33:38 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-f064e8cb-2312-47eb-bb46-a489263c46c2 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.352s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:33:38 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-f064e8cb-2312-47eb-bb46-a489263c46c2 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:33:38 user nova-compute[74960]: DEBUG nova.network.neutron [None req-f064e8cb-2312-47eb-bb46-a489263c46c2 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: b7606a55-d5c3-4ba8-b499-f3c70813f151] Successfully created port: 1c3fd855-b339-4f79-b36c-8e89b6fcc190 {{(pid=74960) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 12:33:38 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-0f16dee6-cabb-4921-9bcc-84da28c9692b tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] No BDM found with device name vda, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:33:38 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-0f16dee6-cabb-4921-9bcc-84da28c9692b tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] No VIF found with MAC fa:16:3e:d7:40:80, not building metadata {{(pid=74960) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 12:33:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:33:38 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-f064e8cb-2312-47eb-bb46-a489263c46c2 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.276s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:33:38 user nova-compute[74960]: DEBUG nova.virt.disk.api [None req-f064e8cb-2312-47eb-bb46-a489263c46c2 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b7606a55-d5c3-4ba8-b499-f3c70813f151/disk. size=1073741824 {{(pid=74960) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 12:33:38 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-f064e8cb-2312-47eb-bb46-a489263c46c2 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7606a55-d5c3-4ba8-b499-f3c70813f151/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:33:38 user nova-compute[74960]: DEBUG nova.network.neutron [req-c81b3729-6ea5-42f8-80b2-a3675b656f76 req-a0e174b6-8bb1-420f-918d-ebdc084acead service nova] [instance: 12ae6707-c1c6-4bc2-a409-67cea64fc2c3] Updated VIF entry in instance network info cache for port 356b6bc6-6335-476f-948e-7bc8bc4fc88c. {{(pid=74960) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 12:33:38 user nova-compute[74960]: DEBUG nova.network.neutron [req-c81b3729-6ea5-42f8-80b2-a3675b656f76 req-a0e174b6-8bb1-420f-918d-ebdc084acead service nova] [instance: 12ae6707-c1c6-4bc2-a409-67cea64fc2c3] Updating instance_info_cache with network_info: [{"id": "356b6bc6-6335-476f-948e-7bc8bc4fc88c", "address": "fa:16:3e:d7:40:80", "network": {"id": "82ebe97c-a056-4ac2-9644-ea315bf9a4b1", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1024050438-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efa134687c74460fb5a59dd3ddece671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap356b6bc6-63", "ovs_interfaceid": "356b6bc6-6335-476f-948e-7bc8bc4fc88c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:33:38 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-c81b3729-6ea5-42f8-80b2-a3675b656f76 req-a0e174b6-8bb1-420f-918d-ebdc084acead service nova] Releasing lock "refresh_cache-12ae6707-c1c6-4bc2-a409-67cea64fc2c3" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:33:38 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-f064e8cb-2312-47eb-bb46-a489263c46c2 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7606a55-d5c3-4ba8-b499-f3c70813f151/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:33:38 user nova-compute[74960]: DEBUG nova.virt.disk.api [None req-f064e8cb-2312-47eb-bb46-a489263c46c2 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Cannot resize image /opt/stack/data/nova/instances/b7606a55-d5c3-4ba8-b499-f3c70813f151/disk to a smaller size. {{(pid=74960) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 12:33:38 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-f064e8cb-2312-47eb-bb46-a489263c46c2 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: b7606a55-d5c3-4ba8-b499-f3c70813f151] Created local disks {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 12:33:38 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-f064e8cb-2312-47eb-bb46-a489263c46c2 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: b7606a55-d5c3-4ba8-b499-f3c70813f151] Ensure instance console log exists: /opt/stack/data/nova/instances/b7606a55-d5c3-4ba8-b499-f3c70813f151/console.log {{(pid=74960) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 12:33:38 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-f064e8cb-2312-47eb-bb46-a489263c46c2 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:33:38 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-f064e8cb-2312-47eb-bb46-a489263c46c2 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:33:38 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-f064e8cb-2312-47eb-bb46-a489263c46c2 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:33:38 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._sync_power_states {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:33:39 user nova-compute[74960]: DEBUG nova.network.neutron [None req-f064e8cb-2312-47eb-bb46-a489263c46c2 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: b7606a55-d5c3-4ba8-b499-f3c70813f151] Successfully updated port: 1c3fd855-b339-4f79-b36c-8e89b6fcc190 {{(pid=74960) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 12:33:39 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-f064e8cb-2312-47eb-bb46-a489263c46c2 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Acquiring lock "refresh_cache-b7606a55-d5c3-4ba8-b499-f3c70813f151" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:33:39 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-f064e8cb-2312-47eb-bb46-a489263c46c2 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Acquired lock "refresh_cache-b7606a55-d5c3-4ba8-b499-f3c70813f151" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:33:39 user nova-compute[74960]: DEBUG nova.network.neutron [None req-f064e8cb-2312-47eb-bb46-a489263c46c2 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: b7606a55-d5c3-4ba8-b499-f3c70813f151] Building network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 12:33:39 user nova-compute[74960]: DEBUG nova.compute.manager [req-cd9b092d-6b02-47cf-b3d9-f2162b8ac2bc req-19da190e-9186-4a31-9045-8976420b91b3 service nova] [instance: b7606a55-d5c3-4ba8-b499-f3c70813f151] Received event network-changed-1c3fd855-b339-4f79-b36c-8e89b6fcc190 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:33:39 user nova-compute[74960]: DEBUG nova.compute.manager [req-cd9b092d-6b02-47cf-b3d9-f2162b8ac2bc req-19da190e-9186-4a31-9045-8976420b91b3 service nova] [instance: b7606a55-d5c3-4ba8-b499-f3c70813f151] Refreshing instance network info cache due to event network-changed-1c3fd855-b339-4f79-b36c-8e89b6fcc190. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 12:33:39 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-cd9b092d-6b02-47cf-b3d9-f2162b8ac2bc req-19da190e-9186-4a31-9045-8976420b91b3 service nova] Acquiring lock "refresh_cache-b7606a55-d5c3-4ba8-b499-f3c70813f151" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:33:39 user nova-compute[74960]: DEBUG nova.network.neutron [None req-f064e8cb-2312-47eb-bb46-a489263c46c2 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: b7606a55-d5c3-4ba8-b499-f3c70813f151] Instance cache missing network info. {{(pid=74960) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 12:33:39 user nova-compute[74960]: DEBUG nova.network.neutron [None req-f064e8cb-2312-47eb-bb46-a489263c46c2 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: b7606a55-d5c3-4ba8-b499-f3c70813f151] Updating instance_info_cache with network_info: [{"id": "1c3fd855-b339-4f79-b36c-8e89b6fcc190", "address": "fa:16:3e:4c:62:cc", "network": {"id": "dec66832-56d5-4d68-b11f-8e8eed38f045", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-79099436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc95d68d5e147e1953c855169b17091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c3fd855-b3", "ovs_interfaceid": "1c3fd855-b339-4f79-b36c-8e89b6fcc190", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:33:39 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-f064e8cb-2312-47eb-bb46-a489263c46c2 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Releasing lock "refresh_cache-b7606a55-d5c3-4ba8-b499-f3c70813f151" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:33:39 user nova-compute[74960]: DEBUG nova.compute.manager [None req-f064e8cb-2312-47eb-bb46-a489263c46c2 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: b7606a55-d5c3-4ba8-b499-f3c70813f151] Instance network_info: |[{"id": "1c3fd855-b339-4f79-b36c-8e89b6fcc190", "address": "fa:16:3e:4c:62:cc", "network": {"id": "dec66832-56d5-4d68-b11f-8e8eed38f045", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-79099436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc95d68d5e147e1953c855169b17091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c3fd855-b3", "ovs_interfaceid": "1c3fd855-b339-4f79-b36c-8e89b6fcc190", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74960) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 12:33:39 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-cd9b092d-6b02-47cf-b3d9-f2162b8ac2bc req-19da190e-9186-4a31-9045-8976420b91b3 service nova] Acquired lock "refresh_cache-b7606a55-d5c3-4ba8-b499-f3c70813f151" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:33:39 user nova-compute[74960]: DEBUG nova.network.neutron [req-cd9b092d-6b02-47cf-b3d9-f2162b8ac2bc req-19da190e-9186-4a31-9045-8976420b91b3 service nova] [instance: b7606a55-d5c3-4ba8-b499-f3c70813f151] Refreshing network info cache for port 1c3fd855-b339-4f79-b36c-8e89b6fcc190 {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 12:33:39 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-f064e8cb-2312-47eb-bb46-a489263c46c2 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: b7606a55-d5c3-4ba8-b499-f3c70813f151] Start _get_guest_xml network_info=[{"id": "1c3fd855-b339-4f79-b36c-8e89b6fcc190", "address": "fa:16:3e:4c:62:cc", "network": {"id": "dec66832-56d5-4d68-b11f-8e8eed38f045", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-79099436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc95d68d5e147e1953c855169b17091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c3fd855-b3", "ovs_interfaceid": "1c3fd855-b339-4f79-b36c-8e89b6fcc190", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=549f51ba-ac69-494b-8de1-34635aa2d7cf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='63ee9c80c632442fb0379f47b784bd20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T12:13:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'image_id': '549f51ba-ac69-494b-8de1-34635aa2d7cf'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 12:33:39 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-f064e8cb-2312-47eb-bb46-a489263c46c2 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:33:39 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-f064e8cb-2312-47eb-bb46-a489263c46c2 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:33:39 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-f064e8cb-2312-47eb-bb46-a489263c46c2 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 12:33:39 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-f064e8cb-2312-47eb-bb46-a489263c46c2 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] CPU controller missing on host. {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 12:33:39 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-f064e8cb-2312-47eb-bb46-a489263c46c2 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 12:33:39 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-f064e8cb-2312-47eb-bb46-a489263c46c2 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] CPU controller found on host. {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 12:33:39 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-f064e8cb-2312-47eb-bb46-a489263c46c2 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74960) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 12:33:39 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-f064e8cb-2312-47eb-bb46-a489263c46c2 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=549f51ba-ac69-494b-8de1-34635aa2d7cf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='63ee9c80c632442fb0379f47b784bd20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T12:13:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 12:33:39 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-f064e8cb-2312-47eb-bb46-a489263c46c2 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Flavor limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 12:33:39 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-f064e8cb-2312-47eb-bb46-a489263c46c2 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Image limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 12:33:39 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-f064e8cb-2312-47eb-bb46-a489263c46c2 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Flavor pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 12:33:39 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-f064e8cb-2312-47eb-bb46-a489263c46c2 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Image pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 12:33:39 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-f064e8cb-2312-47eb-bb46-a489263c46c2 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 12:33:39 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-f064e8cb-2312-47eb-bb46-a489263c46c2 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 12:33:39 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-f064e8cb-2312-47eb-bb46-a489263c46c2 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 12:33:39 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-f064e8cb-2312-47eb-bb46-a489263c46c2 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Got 1 possible topologies {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 12:33:39 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-f064e8cb-2312-47eb-bb46-a489263c46c2 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 12:33:39 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-f064e8cb-2312-47eb-bb46-a489263c46c2 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 12:33:39 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-f064e8cb-2312-47eb-bb46-a489263c46c2 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:33:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1974704989',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1974704989',id=35,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dbc95d68d5e147e1953c855169b17091',ramdisk_id='',reservation_id='r-tqku4ipl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-195954071',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:33:38Z,user_data=None,user_id='c473215929044a108c9fc4d6327dfc3d',uuid=b7606a55-d5c3-4ba8-b499-f3c70813f151,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1c3fd855-b339-4f79-b36c-8e89b6fcc190", "address": "fa:16:3e:4c:62:cc", "network": {"id": "dec66832-56d5-4d68-b11f-8e8eed38f045", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-79099436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc95d68d5e147e1953c855169b17091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c3fd855-b3", "ovs_interfaceid": "1c3fd855-b339-4f79-b36c-8e89b6fcc190", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74960) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 12:33:39 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-f064e8cb-2312-47eb-bb46-a489263c46c2 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Converting VIF {"id": "1c3fd855-b339-4f79-b36c-8e89b6fcc190", "address": "fa:16:3e:4c:62:cc", "network": {"id": "dec66832-56d5-4d68-b11f-8e8eed38f045", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-79099436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc95d68d5e147e1953c855169b17091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c3fd855-b3", "ovs_interfaceid": "1c3fd855-b339-4f79-b36c-8e89b6fcc190", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:33:39 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-f064e8cb-2312-47eb-bb46-a489263c46c2 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:62:cc,bridge_name='br-int',has_traffic_filtering=True,id=1c3fd855-b339-4f79-b36c-8e89b6fcc190,network=Network(dec66832-56d5-4d68-b11f-8e8eed38f045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c3fd855-b3') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:33:39 user nova-compute[74960]: DEBUG nova.objects.instance [None req-f064e8cb-2312-47eb-bb46-a489263c46c2 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Lazy-loading 'pci_devices' on Instance uuid b7606a55-d5c3-4ba8-b499-f3c70813f151 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:33:39 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:33:39 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-f064e8cb-2312-47eb-bb46-a489263c46c2 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: b7606a55-d5c3-4ba8-b499-f3c70813f151] End _get_guest_xml xml=<domain type="kvm">
Nov 03 12:33:39 user nova-compute[74960]:   <uuid>b7606a55-d5c3-4ba8-b499-f3c70813f151</uuid>
Nov 03 12:33:39 user nova-compute[74960]:   <name>instance-00000023</name>
Nov 03 12:33:39 user nova-compute[74960]:   <memory>524288</memory>
Nov 03 12:33:39 user nova-compute[74960]:   <vcpu>1</vcpu>
Nov 03 12:33:39 user nova-compute[74960]:   <metadata>
Nov 03 12:33:39 user nova-compute[74960]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 12:33:39 user nova-compute[74960]:       <nova:package version="0.0.0"/>
Nov 03 12:33:39 user nova-compute[74960]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1974704989</nova:name>
Nov 03 12:33:39 user nova-compute[74960]:       <nova:creationTime>2023-11-03 12:33:39</nova:creationTime>
Nov 03 12:33:39 user nova-compute[74960]:       <nova:flavor name="m1.tiny">
Nov 03 12:33:39 user nova-compute[74960]:         <nova:memory>512</nova:memory>
Nov 03 12:33:39 user nova-compute[74960]:         <nova:disk>1</nova:disk>
Nov 03 12:33:39 user nova-compute[74960]:         <nova:swap>0</nova:swap>
Nov 03 12:33:39 user nova-compute[74960]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 12:33:39 user nova-compute[74960]:         <nova:vcpus>1</nova:vcpus>
Nov 03 12:33:39 user nova-compute[74960]:       </nova:flavor>
Nov 03 12:33:39 user nova-compute[74960]:       <nova:owner>
Nov 03 12:33:39 user nova-compute[74960]:         <nova:user uuid="c473215929044a108c9fc4d6327dfc3d">tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member</nova:user>
Nov 03 12:33:39 user nova-compute[74960]:         <nova:project uuid="dbc95d68d5e147e1953c855169b17091">tempest-ServerBootFromVolumeStableRescueTest-195954071</nova:project>
Nov 03 12:33:39 user nova-compute[74960]:       </nova:owner>
Nov 03 12:33:39 user nova-compute[74960]:       <nova:root type="image" uuid="549f51ba-ac69-494b-8de1-34635aa2d7cf"/>
Nov 03 12:33:39 user nova-compute[74960]:       <nova:ports>
Nov 03 12:33:39 user nova-compute[74960]:         <nova:port uuid="1c3fd855-b339-4f79-b36c-8e89b6fcc190">
Nov 03 12:33:39 user nova-compute[74960]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 03 12:33:39 user nova-compute[74960]:         </nova:port>
Nov 03 12:33:39 user nova-compute[74960]:       </nova:ports>
Nov 03 12:33:39 user nova-compute[74960]:     </nova:instance>
Nov 03 12:33:39 user nova-compute[74960]:   </metadata>
Nov 03 12:33:39 user nova-compute[74960]:   <sysinfo type="smbios">
Nov 03 12:33:39 user nova-compute[74960]:     <system>
Nov 03 12:33:39 user nova-compute[74960]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 12:33:39 user nova-compute[74960]:       <entry name="product">OpenStack Nova</entry>
Nov 03 12:33:39 user nova-compute[74960]:       <entry name="version">0.0.0</entry>
Nov 03 12:33:39 user nova-compute[74960]:       <entry name="serial">b7606a55-d5c3-4ba8-b499-f3c70813f151</entry>
Nov 03 12:33:39 user nova-compute[74960]:       <entry name="uuid">b7606a55-d5c3-4ba8-b499-f3c70813f151</entry>
Nov 03 12:33:39 user nova-compute[74960]:       <entry name="family">Virtual Machine</entry>
Nov 03 12:33:39 user nova-compute[74960]:     </system>
Nov 03 12:33:39 user nova-compute[74960]:   </sysinfo>
Nov 03 12:33:39 user nova-compute[74960]:   <os>
Nov 03 12:33:39 user nova-compute[74960]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 12:33:39 user nova-compute[74960]:     <boot dev="hd"/>
Nov 03 12:33:39 user nova-compute[74960]:     <smbios mode="sysinfo"/>
Nov 03 12:33:39 user nova-compute[74960]:   </os>
Nov 03 12:33:39 user nova-compute[74960]:   <features>
Nov 03 12:33:39 user nova-compute[74960]:     <acpi/>
Nov 03 12:33:39 user nova-compute[74960]:     <apic/>
Nov 03 12:33:39 user nova-compute[74960]:     <vmcoreinfo/>
Nov 03 12:33:39 user nova-compute[74960]:   </features>
Nov 03 12:33:39 user nova-compute[74960]:   <clock offset="utc">
Nov 03 12:33:39 user nova-compute[74960]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 12:33:39 user nova-compute[74960]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 12:33:39 user nova-compute[74960]:     <timer name="hpet" present="no"/>
Nov 03 12:33:39 user nova-compute[74960]:   </clock>
Nov 03 12:33:39 user nova-compute[74960]:   <cpu mode="custom" match="exact">
Nov 03 12:33:39 user nova-compute[74960]:     <model>Nehalem</model>
Nov 03 12:33:39 user nova-compute[74960]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 12:33:39 user nova-compute[74960]:   </cpu>
Nov 03 12:33:39 user nova-compute[74960]:   <devices>
Nov 03 12:33:39 user nova-compute[74960]:     <disk type="file" device="disk">
Nov 03 12:33:39 user nova-compute[74960]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 12:33:39 user nova-compute[74960]:       <source file="/opt/stack/data/nova/instances/b7606a55-d5c3-4ba8-b499-f3c70813f151/disk"/>
Nov 03 12:33:39 user nova-compute[74960]:       <target dev="vda" bus="virtio"/>
Nov 03 12:33:39 user nova-compute[74960]:     </disk>
Nov 03 12:33:39 user nova-compute[74960]:     <interface type="ethernet">
Nov 03 12:33:39 user nova-compute[74960]:       <mac address="fa:16:3e:4c:62:cc"/>
Nov 03 12:33:39 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:33:39 user nova-compute[74960]:       <mtu size="1442"/>
Nov 03 12:33:39 user nova-compute[74960]:       <target dev="tap1c3fd855-b3"/>
Nov 03 12:33:39 user nova-compute[74960]:     </interface>
Nov 03 12:33:39 user nova-compute[74960]:     <serial type="pty">
Nov 03 12:33:39 user nova-compute[74960]:       <log file="/opt/stack/data/nova/instances/b7606a55-d5c3-4ba8-b499-f3c70813f151/console.log" append="off"/>
Nov 03 12:33:39 user nova-compute[74960]:     </serial>
Nov 03 12:33:39 user nova-compute[74960]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 12:33:39 user nova-compute[74960]:     <video>
Nov 03 12:33:39 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:33:39 user nova-compute[74960]:     </video>
Nov 03 12:33:39 user nova-compute[74960]:     <rng model="virtio">
Nov 03 12:33:39 user nova-compute[74960]:       <backend model="random">/dev/urandom</backend>
Nov 03 12:33:39 user nova-compute[74960]:     </rng>
Nov 03 12:33:39 user nova-compute[74960]:     <controller type="usb" index="0" model="none"/>
Nov 03 12:33:39 user nova-compute[74960]:     <memballoon model="virtio">
Nov 03 12:33:39 user nova-compute[74960]:       <stats period="10"/>
Nov 03 12:33:39 user nova-compute[74960]:     </memballoon>
Nov 03 12:33:39 user nova-compute[74960]:   </devices>
Nov 03 12:33:39 user nova-compute[74960]: </domain>
Nov 03 12:33:39 user nova-compute[74960]:  {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 12:33:39 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-f064e8cb-2312-47eb-bb46-a489263c46c2 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:33:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1974704989',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1974704989',id=35,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dbc95d68d5e147e1953c855169b17091',ramdisk_id='',reservation_id='r-tqku4ipl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-195954071',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:33:38Z,user_data=None,user_id='c473215929044a108c9fc4d6327dfc3d',uuid=b7606a55-d5c3-4ba8-b499-f3c70813f151,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1c3fd855-b339-4f79-b36c-8e89b6fcc190", "address": "fa:16:3e:4c:62:cc", "network": {"id": "dec66832-56d5-4d68-b11f-8e8eed38f045", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-79099436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc95d68d5e147e1953c855169b17091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c3fd855-b3", "ovs_interfaceid": "1c3fd855-b339-4f79-b36c-8e89b6fcc190", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 12:33:39 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-f064e8cb-2312-47eb-bb46-a489263c46c2 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Converting VIF {"id": "1c3fd855-b339-4f79-b36c-8e89b6fcc190", "address": "fa:16:3e:4c:62:cc", "network": {"id": "dec66832-56d5-4d68-b11f-8e8eed38f045", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-79099436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc95d68d5e147e1953c855169b17091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c3fd855-b3", "ovs_interfaceid": "1c3fd855-b339-4f79-b36c-8e89b6fcc190", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:33:39 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-f064e8cb-2312-47eb-bb46-a489263c46c2 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:62:cc,bridge_name='br-int',has_traffic_filtering=True,id=1c3fd855-b339-4f79-b36c-8e89b6fcc190,network=Network(dec66832-56d5-4d68-b11f-8e8eed38f045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c3fd855-b3') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:33:39 user nova-compute[74960]: DEBUG os_vif [None req-f064e8cb-2312-47eb-bb46-a489263c46c2 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:62:cc,bridge_name='br-int',has_traffic_filtering=True,id=1c3fd855-b339-4f79-b36c-8e89b6fcc190,network=Network(dec66832-56d5-4d68-b11f-8e8eed38f045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c3fd855-b3') {{(pid=74960) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 12:33:39 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:33:39 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:33:39 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 12:33:39 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:33:39 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dd31aaec-cf36-5967-b097-e27faf31de91', '_type': 'linux-noop'}}, row=False) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:33:39 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:33:39 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:33:39 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:33:39 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:33:39 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:33:39 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:33:39 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1c3fd855-b3, may_exist=True, interface_attrs={}) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:33:39 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1c3fd855-b3, col_values=(('qos', UUID('506932bb-f289-45bb-a0ca-b9718f2ae049')),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:33:39 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1c3fd855-b3, col_values=(('external_ids', {'iface-id': '1c3fd855-b339-4f79-b36c-8e89b6fcc190', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4c:62:cc', 'vm-uuid': 'b7606a55-d5c3-4ba8-b499-f3c70813f151'}),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:33:39 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:33:39 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:33:39 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:33:39 user nova-compute[74960]: INFO os_vif [None req-f064e8cb-2312-47eb-bb46-a489263c46c2 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:62:cc,bridge_name='br-int',has_traffic_filtering=True,id=1c3fd855-b339-4f79-b36c-8e89b6fcc190,network=Network(dec66832-56d5-4d68-b11f-8e8eed38f045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c3fd855-b3')
Nov 03 12:33:39 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-f064e8cb-2312-47eb-bb46-a489263c46c2 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] No BDM found with device name vda, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:33:39 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-f064e8cb-2312-47eb-bb46-a489263c46c2 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] No VIF found with MAC fa:16:3e:4c:62:cc, not building metadata {{(pid=74960) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 12:33:40 user nova-compute[74960]: DEBUG nova.compute.manager [req-d54cacf0-8b44-479f-9056-1e3d85fd921f req-4cd46078-a89b-4851-8f3c-50032c08f1df service nova] [instance: 12ae6707-c1c6-4bc2-a409-67cea64fc2c3] Received event network-vif-plugged-356b6bc6-6335-476f-948e-7bc8bc4fc88c {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:33:40 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-d54cacf0-8b44-479f-9056-1e3d85fd921f req-4cd46078-a89b-4851-8f3c-50032c08f1df service nova] Acquiring lock "12ae6707-c1c6-4bc2-a409-67cea64fc2c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:33:40 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-d54cacf0-8b44-479f-9056-1e3d85fd921f req-4cd46078-a89b-4851-8f3c-50032c08f1df service nova] Lock "12ae6707-c1c6-4bc2-a409-67cea64fc2c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:33:40 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-d54cacf0-8b44-479f-9056-1e3d85fd921f req-4cd46078-a89b-4851-8f3c-50032c08f1df service nova] Lock "12ae6707-c1c6-4bc2-a409-67cea64fc2c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:33:40 user nova-compute[74960]: DEBUG nova.compute.manager [req-d54cacf0-8b44-479f-9056-1e3d85fd921f req-4cd46078-a89b-4851-8f3c-50032c08f1df service nova] [instance: 12ae6707-c1c6-4bc2-a409-67cea64fc2c3] No waiting events found dispatching network-vif-plugged-356b6bc6-6335-476f-948e-7bc8bc4fc88c {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:33:40 user nova-compute[74960]: WARNING nova.compute.manager [req-d54cacf0-8b44-479f-9056-1e3d85fd921f req-4cd46078-a89b-4851-8f3c-50032c08f1df service nova] [instance: 12ae6707-c1c6-4bc2-a409-67cea64fc2c3] Received unexpected event network-vif-plugged-356b6bc6-6335-476f-948e-7bc8bc4fc88c for instance with vm_state building and task_state spawning.
Nov 03 12:33:40 user nova-compute[74960]: DEBUG nova.network.neutron [req-cd9b092d-6b02-47cf-b3d9-f2162b8ac2bc req-19da190e-9186-4a31-9045-8976420b91b3 service nova] [instance: b7606a55-d5c3-4ba8-b499-f3c70813f151] Updated VIF entry in instance network info cache for port 1c3fd855-b339-4f79-b36c-8e89b6fcc190. {{(pid=74960) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 12:33:40 user nova-compute[74960]: DEBUG nova.network.neutron [req-cd9b092d-6b02-47cf-b3d9-f2162b8ac2bc req-19da190e-9186-4a31-9045-8976420b91b3 service nova] [instance: b7606a55-d5c3-4ba8-b499-f3c70813f151] Updating instance_info_cache with network_info: [{"id": "1c3fd855-b339-4f79-b36c-8e89b6fcc190", "address": "fa:16:3e:4c:62:cc", "network": {"id": "dec66832-56d5-4d68-b11f-8e8eed38f045", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-79099436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc95d68d5e147e1953c855169b17091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c3fd855-b3", "ovs_interfaceid": "1c3fd855-b339-4f79-b36c-8e89b6fcc190", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:33:40 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-cd9b092d-6b02-47cf-b3d9-f2162b8ac2bc req-19da190e-9186-4a31-9045-8976420b91b3 service nova] Releasing lock "refresh_cache-b7606a55-d5c3-4ba8-b499-f3c70813f151" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:33:40 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:33:40 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:33:40 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:33:40 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:33:41 user nova-compute[74960]: WARNING nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] While synchronizing instance power states, found 10 instances in the database and 9 instances on the hypervisor.
Nov 03 12:33:41 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Triggering sync for uuid 7769e3c5-136f-4282-8e3e-224e3a80922c {{(pid=74960) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 12:33:41 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Triggering sync for uuid 87f15f5f-8afa-4d7b-bb45-5887184f9ee5 {{(pid=74960) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 12:33:41 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Triggering sync for uuid a6199681-f85e-4f55-966b-6ab3f17cd640 {{(pid=74960) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 12:33:41 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Triggering sync for uuid 5b7b95c0-3726-4a1c-a384-ec91abf75225 {{(pid=74960) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 12:33:41 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Triggering sync for uuid 35e02c80-f626-4918-93f1-6b9a7f778c7a {{(pid=74960) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 12:33:41 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Triggering sync for uuid 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67 {{(pid=74960) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 12:33:41 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Triggering sync for uuid b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d {{(pid=74960) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 12:33:41 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Triggering sync for uuid 9c447082-b59b-4c8e-8fa0-bf6599a84e91 {{(pid=74960) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 12:33:41 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Triggering sync for uuid 12ae6707-c1c6-4bc2-a409-67cea64fc2c3 {{(pid=74960) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 12:33:41 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Triggering sync for uuid b7606a55-d5c3-4ba8-b499-f3c70813f151 {{(pid=74960) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 12:33:41 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "7769e3c5-136f-4282-8e3e-224e3a80922c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:33:41 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "7769e3c5-136f-4282-8e3e-224e3a80922c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:33:41 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "87f15f5f-8afa-4d7b-bb45-5887184f9ee5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:33:41 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "87f15f5f-8afa-4d7b-bb45-5887184f9ee5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:33:41 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "a6199681-f85e-4f55-966b-6ab3f17cd640" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:33:41 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "a6199681-f85e-4f55-966b-6ab3f17cd640" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:33:41 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "5b7b95c0-3726-4a1c-a384-ec91abf75225" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:33:41 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "5b7b95c0-3726-4a1c-a384-ec91abf75225" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:33:41 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "35e02c80-f626-4918-93f1-6b9a7f778c7a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:33:41 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "35e02c80-f626-4918-93f1-6b9a7f778c7a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:33:41 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "47eb8ddf-590f-4ffa-87c8-377cf1ee0f67" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:33:41 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "47eb8ddf-590f-4ffa-87c8-377cf1ee0f67" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:33:41 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:33:41 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.003s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:33:41 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "9c447082-b59b-4c8e-8fa0-bf6599a84e91" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:33:41 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "9c447082-b59b-4c8e-8fa0-bf6599a84e91" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:33:41 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "12ae6707-c1c6-4bc2-a409-67cea64fc2c3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:33:41 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "b7606a55-d5c3-4ba8-b499-f3c70813f151" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:33:41 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:33:41 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "7769e3c5-136f-4282-8e3e-224e3a80922c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.073s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:33:41 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:33:41 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "a6199681-f85e-4f55-966b-6ab3f17cd640" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.082s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:33:41 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "87f15f5f-8afa-4d7b-bb45-5887184f9ee5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.084s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:33:41 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "35e02c80-f626-4918-93f1-6b9a7f778c7a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.112s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:33:41 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "47eb8ddf-590f-4ffa-87c8-377cf1ee0f67" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.129s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:33:41 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "5b7b95c0-3726-4a1c-a384-ec91abf75225" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.153s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:33:41 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "9c447082-b59b-4c8e-8fa0-bf6599a84e91" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.151s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:33:41 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.159s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:33:41 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:33:41 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:33:42 user nova-compute[74960]: DEBUG nova.compute.manager [req-ba730381-f56d-4b33-ab8c-e0e5e35e9b05 req-0ca3da77-c82b-493f-a1b5-bffe47653db0 service nova] [instance: 12ae6707-c1c6-4bc2-a409-67cea64fc2c3] Received event network-vif-plugged-356b6bc6-6335-476f-948e-7bc8bc4fc88c {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:33:42 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-ba730381-f56d-4b33-ab8c-e0e5e35e9b05 req-0ca3da77-c82b-493f-a1b5-bffe47653db0 service nova] Acquiring lock "12ae6707-c1c6-4bc2-a409-67cea64fc2c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:33:42 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-ba730381-f56d-4b33-ab8c-e0e5e35e9b05 req-0ca3da77-c82b-493f-a1b5-bffe47653db0 service nova] Lock "12ae6707-c1c6-4bc2-a409-67cea64fc2c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:33:42 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-ba730381-f56d-4b33-ab8c-e0e5e35e9b05 req-0ca3da77-c82b-493f-a1b5-bffe47653db0 service nova] Lock "12ae6707-c1c6-4bc2-a409-67cea64fc2c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:33:42 user nova-compute[74960]: DEBUG nova.compute.manager [req-ba730381-f56d-4b33-ab8c-e0e5e35e9b05 req-0ca3da77-c82b-493f-a1b5-bffe47653db0 service nova] [instance: 12ae6707-c1c6-4bc2-a409-67cea64fc2c3] No waiting events found dispatching network-vif-plugged-356b6bc6-6335-476f-948e-7bc8bc4fc88c {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:33:42 user nova-compute[74960]: WARNING nova.compute.manager [req-ba730381-f56d-4b33-ab8c-e0e5e35e9b05 req-0ca3da77-c82b-493f-a1b5-bffe47653db0 service nova] [instance: 12ae6707-c1c6-4bc2-a409-67cea64fc2c3] Received unexpected event network-vif-plugged-356b6bc6-6335-476f-948e-7bc8bc4fc88c for instance with vm_state building and task_state spawning.
Nov 03 12:33:42 user nova-compute[74960]: DEBUG nova.compute.manager [req-ba730381-f56d-4b33-ab8c-e0e5e35e9b05 req-0ca3da77-c82b-493f-a1b5-bffe47653db0 service nova] [instance: b7606a55-d5c3-4ba8-b499-f3c70813f151] Received event network-vif-plugged-1c3fd855-b339-4f79-b36c-8e89b6fcc190 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:33:42 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-ba730381-f56d-4b33-ab8c-e0e5e35e9b05 req-0ca3da77-c82b-493f-a1b5-bffe47653db0 service nova] Acquiring lock "b7606a55-d5c3-4ba8-b499-f3c70813f151-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:33:42 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-ba730381-f56d-4b33-ab8c-e0e5e35e9b05 req-0ca3da77-c82b-493f-a1b5-bffe47653db0 service nova] Lock "b7606a55-d5c3-4ba8-b499-f3c70813f151-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:33:42 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-ba730381-f56d-4b33-ab8c-e0e5e35e9b05 req-0ca3da77-c82b-493f-a1b5-bffe47653db0 service nova] Lock "b7606a55-d5c3-4ba8-b499-f3c70813f151-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:33:42 user nova-compute[74960]: DEBUG nova.compute.manager [req-ba730381-f56d-4b33-ab8c-e0e5e35e9b05 req-0ca3da77-c82b-493f-a1b5-bffe47653db0 service nova] [instance: b7606a55-d5c3-4ba8-b499-f3c70813f151] No waiting events found dispatching network-vif-plugged-1c3fd855-b339-4f79-b36c-8e89b6fcc190 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:33:42 user nova-compute[74960]: WARNING nova.compute.manager [req-ba730381-f56d-4b33-ab8c-e0e5e35e9b05 req-0ca3da77-c82b-493f-a1b5-bffe47653db0 service nova] [instance: b7606a55-d5c3-4ba8-b499-f3c70813f151] Received unexpected event network-vif-plugged-1c3fd855-b339-4f79-b36c-8e89b6fcc190 for instance with vm_state building and task_state spawning.
Nov 03 12:33:43 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:33:44 user nova-compute[74960]: DEBUG nova.compute.manager [req-40684833-5c17-4f16-850c-da27033a64b9 req-a782c9f3-f266-4e41-989b-40fa9443f88a service nova] [instance: b7606a55-d5c3-4ba8-b499-f3c70813f151] Received event network-vif-plugged-1c3fd855-b339-4f79-b36c-8e89b6fcc190 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:33:44 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-40684833-5c17-4f16-850c-da27033a64b9 req-a782c9f3-f266-4e41-989b-40fa9443f88a service nova] Acquiring lock "b7606a55-d5c3-4ba8-b499-f3c70813f151-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:33:44 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-40684833-5c17-4f16-850c-da27033a64b9 req-a782c9f3-f266-4e41-989b-40fa9443f88a service nova] Lock "b7606a55-d5c3-4ba8-b499-f3c70813f151-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:33:44 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-40684833-5c17-4f16-850c-da27033a64b9 req-a782c9f3-f266-4e41-989b-40fa9443f88a service nova] Lock "b7606a55-d5c3-4ba8-b499-f3c70813f151-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:33:44 user nova-compute[74960]: DEBUG nova.compute.manager [req-40684833-5c17-4f16-850c-da27033a64b9 req-a782c9f3-f266-4e41-989b-40fa9443f88a service nova] [instance: b7606a55-d5c3-4ba8-b499-f3c70813f151] No waiting events found dispatching network-vif-plugged-1c3fd855-b339-4f79-b36c-8e89b6fcc190 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:33:44 user nova-compute[74960]: WARNING nova.compute.manager [req-40684833-5c17-4f16-850c-da27033a64b9 req-a782c9f3-f266-4e41-989b-40fa9443f88a service nova] [instance: b7606a55-d5c3-4ba8-b499-f3c70813f151] Received unexpected event network-vif-plugged-1c3fd855-b339-4f79-b36c-8e89b6fcc190 for instance with vm_state building and task_state spawning.
Nov 03 12:33:44 user nova-compute[74960]: DEBUG nova.compute.manager [req-40684833-5c17-4f16-850c-da27033a64b9 req-a782c9f3-f266-4e41-989b-40fa9443f88a service nova] [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a] Received event network-changed-4a3a2b1f-db29-441d-9bf9-7f429760ae05 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:33:44 user nova-compute[74960]: DEBUG nova.compute.manager [req-40684833-5c17-4f16-850c-da27033a64b9 req-a782c9f3-f266-4e41-989b-40fa9443f88a service nova] [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a] Refreshing instance network info cache due to event network-changed-4a3a2b1f-db29-441d-9bf9-7f429760ae05. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 12:33:44 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-40684833-5c17-4f16-850c-da27033a64b9 req-a782c9f3-f266-4e41-989b-40fa9443f88a service nova] Acquiring lock "refresh_cache-35e02c80-f626-4918-93f1-6b9a7f778c7a" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:33:44 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-40684833-5c17-4f16-850c-da27033a64b9 req-a782c9f3-f266-4e41-989b-40fa9443f88a service nova] Acquired lock "refresh_cache-35e02c80-f626-4918-93f1-6b9a7f778c7a" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:33:44 user nova-compute[74960]: DEBUG nova.network.neutron [req-40684833-5c17-4f16-850c-da27033a64b9 req-a782c9f3-f266-4e41-989b-40fa9443f88a service nova] [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a] Refreshing network info cache for port 4a3a2b1f-db29-441d-9bf9-7f429760ae05 {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 12:33:44 user nova-compute[74960]: DEBUG nova.compute.manager [None req-0f16dee6-cabb-4921-9bcc-84da28c9692b tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] [instance: 12ae6707-c1c6-4bc2-a409-67cea64fc2c3] Instance event wait completed in 0 seconds for  {{(pid=74960) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 12:33:44 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-0f16dee6-cabb-4921-9bcc-84da28c9692b tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] [instance: 12ae6707-c1c6-4bc2-a409-67cea64fc2c3] Guest created on hypervisor {{(pid=74960) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 12:33:44 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: 12ae6707-c1c6-4bc2-a409-67cea64fc2c3] Instance spawned successfully.
Nov 03 12:33:44 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-0f16dee6-cabb-4921-9bcc-84da28c9692b tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] [instance: 12ae6707-c1c6-4bc2-a409-67cea64fc2c3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 12:33:44 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-0f16dee6-cabb-4921-9bcc-84da28c9692b tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] [instance: 12ae6707-c1c6-4bc2-a409-67cea64fc2c3] Found default for hw_cdrom_bus of ide {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:33:44 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-0f16dee6-cabb-4921-9bcc-84da28c9692b tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] [instance: 12ae6707-c1c6-4bc2-a409-67cea64fc2c3] Found default for hw_disk_bus of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:33:44 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-0f16dee6-cabb-4921-9bcc-84da28c9692b tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] [instance: 12ae6707-c1c6-4bc2-a409-67cea64fc2c3] Found default for hw_input_bus of None {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:33:44 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-0f16dee6-cabb-4921-9bcc-84da28c9692b tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] [instance: 12ae6707-c1c6-4bc2-a409-67cea64fc2c3] Found default for hw_pointer_model of None {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:33:44 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-0f16dee6-cabb-4921-9bcc-84da28c9692b tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] [instance: 12ae6707-c1c6-4bc2-a409-67cea64fc2c3] Found default for hw_video_model of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:33:44 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-0f16dee6-cabb-4921-9bcc-84da28c9692b tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] [instance: 12ae6707-c1c6-4bc2-a409-67cea64fc2c3] Found default for hw_vif_model of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:33:44 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:33:45 user nova-compute[74960]: DEBUG nova.network.neutron [req-40684833-5c17-4f16-850c-da27033a64b9 req-a782c9f3-f266-4e41-989b-40fa9443f88a service nova] [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a] Updated VIF entry in instance network info cache for port 4a3a2b1f-db29-441d-9bf9-7f429760ae05. {{(pid=74960) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 12:33:45 user nova-compute[74960]: DEBUG nova.network.neutron [req-40684833-5c17-4f16-850c-da27033a64b9 req-a782c9f3-f266-4e41-989b-40fa9443f88a service nova] [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a] Updating instance_info_cache with network_info: [{"id": "4a3a2b1f-db29-441d-9bf9-7f429760ae05", "address": "fa:16:3e:26:d9:9a", "network": {"id": "40aa546e-b586-43f8-bfe3-99c3822fb320", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1884215412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68a32002934044bfad2e4d84bc1b04ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a3a2b1f-db", "ovs_interfaceid": "4a3a2b1f-db29-441d-9bf9-7f429760ae05", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:33:45 user nova-compute[74960]: INFO nova.compute.manager [None req-0f16dee6-cabb-4921-9bcc-84da28c9692b tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] [instance: 12ae6707-c1c6-4bc2-a409-67cea64fc2c3] Took 9.16 seconds to spawn the instance on the hypervisor.
Nov 03 12:33:45 user nova-compute[74960]: DEBUG nova.compute.manager [None req-0f16dee6-cabb-4921-9bcc-84da28c9692b tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] [instance: 12ae6707-c1c6-4bc2-a409-67cea64fc2c3] Checking state {{(pid=74960) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 12:33:45 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-40684833-5c17-4f16-850c-da27033a64b9 req-a782c9f3-f266-4e41-989b-40fa9443f88a service nova] Releasing lock "refresh_cache-35e02c80-f626-4918-93f1-6b9a7f778c7a" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:33:45 user nova-compute[74960]: INFO nova.compute.manager [None req-0f16dee6-cabb-4921-9bcc-84da28c9692b tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] [instance: 12ae6707-c1c6-4bc2-a409-67cea64fc2c3] Took 11.22 seconds to build instance.
Nov 03 12:33:45 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-0f16dee6-cabb-4921-9bcc-84da28c9692b tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Lock "12ae6707-c1c6-4bc2-a409-67cea64fc2c3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.370s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:33:45 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "12ae6707-c1c6-4bc2-a409-67cea64fc2c3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 4.376s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:33:45 user nova-compute[74960]: INFO nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: 12ae6707-c1c6-4bc2-a409-67cea64fc2c3] During sync_power_state the instance has a pending task (spawning). Skip.
Nov 03 12:33:45 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "12ae6707-c1c6-4bc2-a409-67cea64fc2c3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:33:46 user nova-compute[74960]: DEBUG nova.compute.manager [None req-f064e8cb-2312-47eb-bb46-a489263c46c2 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: b7606a55-d5c3-4ba8-b499-f3c70813f151] Instance event wait completed in 0 seconds for  {{(pid=74960) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 12:33:46 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-f064e8cb-2312-47eb-bb46-a489263c46c2 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: b7606a55-d5c3-4ba8-b499-f3c70813f151] Guest created on hypervisor {{(pid=74960) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 12:33:46 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: b7606a55-d5c3-4ba8-b499-f3c70813f151] Instance spawned successfully.
Nov 03 12:33:46 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-f064e8cb-2312-47eb-bb46-a489263c46c2 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: b7606a55-d5c3-4ba8-b499-f3c70813f151] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 12:33:46 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-f064e8cb-2312-47eb-bb46-a489263c46c2 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: b7606a55-d5c3-4ba8-b499-f3c70813f151] Found default for hw_cdrom_bus of ide {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:33:46 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-f064e8cb-2312-47eb-bb46-a489263c46c2 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: b7606a55-d5c3-4ba8-b499-f3c70813f151] Found default for hw_disk_bus of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:33:46 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-f064e8cb-2312-47eb-bb46-a489263c46c2 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: b7606a55-d5c3-4ba8-b499-f3c70813f151] Found default for hw_input_bus of None {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:33:46 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-f064e8cb-2312-47eb-bb46-a489263c46c2 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: b7606a55-d5c3-4ba8-b499-f3c70813f151] Found default for hw_pointer_model of None {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:33:46 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-f064e8cb-2312-47eb-bb46-a489263c46c2 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: b7606a55-d5c3-4ba8-b499-f3c70813f151] Found default for hw_video_model of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:33:46 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-f064e8cb-2312-47eb-bb46-a489263c46c2 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: b7606a55-d5c3-4ba8-b499-f3c70813f151] Found default for hw_vif_model of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:33:46 user nova-compute[74960]: INFO nova.compute.manager [None req-f064e8cb-2312-47eb-bb46-a489263c46c2 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: b7606a55-d5c3-4ba8-b499-f3c70813f151] Took 8.88 seconds to spawn the instance on the hypervisor.
Nov 03 12:33:46 user nova-compute[74960]: DEBUG nova.compute.manager [None req-f064e8cb-2312-47eb-bb46-a489263c46c2 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: b7606a55-d5c3-4ba8-b499-f3c70813f151] Checking state {{(pid=74960) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 12:33:46 user nova-compute[74960]: INFO nova.compute.manager [None req-f064e8cb-2312-47eb-bb46-a489263c46c2 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: b7606a55-d5c3-4ba8-b499-f3c70813f151] Took 9.89 seconds to build instance.
Nov 03 12:33:46 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-f064e8cb-2312-47eb-bb46-a489263c46c2 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Lock "b7606a55-d5c3-4ba8-b499-f3c70813f151" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.037s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:33:46 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "b7606a55-d5c3-4ba8-b499-f3c70813f151" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 5.156s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:33:46 user nova-compute[74960]: INFO nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: b7606a55-d5c3-4ba8-b499-f3c70813f151] During sync_power_state the instance has a pending task (spawning). Skip.
Nov 03 12:33:46 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "b7606a55-d5c3-4ba8-b499-f3c70813f151" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:33:48 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:33:49 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:33:51 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:33:51 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Starting heal instance info cache {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 12:33:51 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Didn't find any instances for network info cache update. {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 03 12:33:51 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:33:51 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:33:51 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:33:53 user nova-compute[74960]: INFO nova.compute.manager [None req-eb651417-6fdc-4963-909d-30442ca70efb tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d] Rescuing
Nov 03 12:33:53 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-eb651417-6fdc-4963-909d-30442ca70efb tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Acquiring lock "refresh_cache-b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:33:53 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-eb651417-6fdc-4963-909d-30442ca70efb tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Acquired lock "refresh_cache-b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:33:53 user nova-compute[74960]: DEBUG nova.network.neutron [None req-eb651417-6fdc-4963-909d-30442ca70efb tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d] Building network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 12:33:53 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:33:53 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:33:53 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:33:53 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:33:53 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:33:53 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Auditing locally available compute resources for user (node: user) {{(pid=74960) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 12:33:53 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:33:53 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12ae6707-c1c6-4bc2-a409-67cea64fc2c3/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:33:53 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12ae6707-c1c6-4bc2-a409-67cea64fc2c3/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:33:53 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12ae6707-c1c6-4bc2-a409-67cea64fc2c3/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:33:54 user nova-compute[74960]: DEBUG nova.network.neutron [None req-eb651417-6fdc-4963-909d-30442ca70efb tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d] Updating instance_info_cache with network_info: [{"id": "b0f443c5-8a12-41fd-9275-81b88b3c08fd", "address": "fa:16:3e:68:31:70", "network": {"id": "9a9a848a-80be-4281-8554-8e28744073b3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1579909169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "434ce6c4b77342299a17e547a14e3918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0f443c5-8a", "ovs_interfaceid": "b0f443c5-8a12-41fd-9275-81b88b3c08fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:33:54 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12ae6707-c1c6-4bc2-a409-67cea64fc2c3/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:33:54 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-eb651417-6fdc-4963-909d-30442ca70efb tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Releasing lock "refresh_cache-b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:33:54 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f15f5f-8afa-4d7b-bb45-5887184f9ee5/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:33:54 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f15f5f-8afa-4d7b-bb45-5887184f9ee5/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:33:54 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f15f5f-8afa-4d7b-bb45-5887184f9ee5/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:33:54 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:33:54 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:33:54 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f15f5f-8afa-4d7b-bb45-5887184f9ee5/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:33:54 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c447082-b59b-4c8e-8fa0-bf6599a84e91/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:33:54 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:33:54 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c447082-b59b-4c8e-8fa0-bf6599a84e91/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:33:54 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c447082-b59b-4c8e-8fa0-bf6599a84e91/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:33:54 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:33:54 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:33:55 user nova-compute[74960]: DEBUG nova.compute.manager [req-e7554974-bf69-43bd-aba9-a1ce35bed3a9 req-10ae16e1-fe59-4343-85fb-625c5b192d8d service nova] [instance: b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d] Received event network-vif-unplugged-b0f443c5-8a12-41fd-9275-81b88b3c08fd {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:33:55 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-e7554974-bf69-43bd-aba9-a1ce35bed3a9 req-10ae16e1-fe59-4343-85fb-625c5b192d8d service nova] Acquiring lock "b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:33:55 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-e7554974-bf69-43bd-aba9-a1ce35bed3a9 req-10ae16e1-fe59-4343-85fb-625c5b192d8d service nova] Lock "b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:33:55 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-e7554974-bf69-43bd-aba9-a1ce35bed3a9 req-10ae16e1-fe59-4343-85fb-625c5b192d8d service nova] Lock "b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:33:55 user nova-compute[74960]: DEBUG nova.compute.manager [req-e7554974-bf69-43bd-aba9-a1ce35bed3a9 req-10ae16e1-fe59-4343-85fb-625c5b192d8d service nova] [instance: b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d] No waiting events found dispatching network-vif-unplugged-b0f443c5-8a12-41fd-9275-81b88b3c08fd {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:33:55 user nova-compute[74960]: WARNING nova.compute.manager [req-e7554974-bf69-43bd-aba9-a1ce35bed3a9 req-10ae16e1-fe59-4343-85fb-625c5b192d8d service nova] [instance: b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d] Received unexpected event network-vif-unplugged-b0f443c5-8a12-41fd-9275-81b88b3c08fd for instance with vm_state active and task_state rescuing.
Nov 03 12:33:55 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c447082-b59b-4c8e-8fa0-bf6599a84e91/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:33:55 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47eb8ddf-590f-4ffa-87c8-377cf1ee0f67/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:33:55 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d] Instance destroyed successfully.
Nov 03 12:33:55 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-eb651417-6fdc-4963-909d-30442ca70efb tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d] Attempting rescue
Nov 03 12:33:55 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-eb651417-6fdc-4963-909d-30442ca70efb tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74960) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 03 12:33:55 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-eb651417-6fdc-4963-909d-30442ca70efb tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d] Instance directory exists: not creating {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 03 12:33:55 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-eb651417-6fdc-4963-909d-30442ca70efb tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d] Creating image(s)
Nov 03 12:33:55 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-eb651417-6fdc-4963-909d-30442ca70efb tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Acquiring lock "/opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:33:55 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-eb651417-6fdc-4963-909d-30442ca70efb tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Lock "/opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:33:55 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-eb651417-6fdc-4963-909d-30442ca70efb tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Lock "/opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:33:55 user nova-compute[74960]: DEBUG nova.objects.instance [None req-eb651417-6fdc-4963-909d-30442ca70efb tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Lazy-loading 'trusted_certs' on Instance uuid b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:33:55 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-eb651417-6fdc-4963-909d-30442ca70efb tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Acquiring lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:33:55 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-eb651417-6fdc-4963-909d-30442ca70efb tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:33:55 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-eb651417-6fdc-4963-909d-30442ca70efb tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:33:55 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47eb8ddf-590f-4ffa-87c8-377cf1ee0f67/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:33:55 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47eb8ddf-590f-4ffa-87c8-377cf1ee0f67/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:33:55 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-eb651417-6fdc-4963-909d-30442ca70efb tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.188s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:33:55 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-eb651417-6fdc-4963-909d-30442ca70efb tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910,backing_fmt=raw /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk.rescue {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:33:55 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47eb8ddf-590f-4ffa-87c8-377cf1ee0f67/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:33:55 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7769e3c5-136f-4282-8e3e-224e3a80922c/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:33:55 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-eb651417-6fdc-4963-909d-30442ca70efb tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910,backing_fmt=raw /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk.rescue" returned: 0 in 0.085s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:33:55 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-eb651417-6fdc-4963-909d-30442ca70efb tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.281s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:33:55 user nova-compute[74960]: DEBUG nova.objects.instance [None req-eb651417-6fdc-4963-909d-30442ca70efb tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Lazy-loading 'migration_context' on Instance uuid b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:33:55 user nova-compute[74960]: DEBUG nova.objects.base [None req-eb651417-6fdc-4963-909d-30442ca70efb tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Object Instance<b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74960) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 12:33:55 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-eb651417-6fdc-4963-909d-30442ca70efb tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d] Created local disks {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 12:33:55 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-eb651417-6fdc-4963-909d-30442ca70efb tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d] Start _get_guest_xml network_info=[{"id": "b0f443c5-8a12-41fd-9275-81b88b3c08fd", "address": "fa:16:3e:68:31:70", "network": {"id": "9a9a848a-80be-4281-8554-8e28744073b3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1579909169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1579909169-network", "vif_mac": "fa:16:3e:68:31:70"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "434ce6c4b77342299a17e547a14e3918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0f443c5-8a", "ovs_interfaceid": "b0f443c5-8a12-41fd-9275-81b88b3c08fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=549f51ba-ac69-494b-8de1-34635aa2d7cf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='63ee9c80c632442fb0379f47b784bd20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T12:13:04Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '549f51ba-ac69-494b-8de1-34635aa2d7cf', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 12:33:55 user nova-compute[74960]: DEBUG nova.objects.instance [None req-eb651417-6fdc-4963-909d-30442ca70efb tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Lazy-loading 'resources' on Instance uuid b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:33:55 user nova-compute[74960]: DEBUG nova.objects.base [None req-eb651417-6fdc-4963-909d-30442ca70efb tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Object Instance<b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74960) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 12:33:55 user nova-compute[74960]: DEBUG nova.objects.instance [None req-eb651417-6fdc-4963-909d-30442ca70efb tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Lazy-loading 'numa_topology' on Instance uuid b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:33:55 user nova-compute[74960]: DEBUG nova.objects.base [None req-eb651417-6fdc-4963-909d-30442ca70efb tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Object Instance<b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74960) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 12:33:55 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-eb651417-6fdc-4963-909d-30442ca70efb tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:33:55 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-eb651417-6fdc-4963-909d-30442ca70efb tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:33:55 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-eb651417-6fdc-4963-909d-30442ca70efb tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 12:33:55 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-eb651417-6fdc-4963-909d-30442ca70efb tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] CPU controller missing on host. {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 12:33:55 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-eb651417-6fdc-4963-909d-30442ca70efb tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 12:33:55 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-eb651417-6fdc-4963-909d-30442ca70efb tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] CPU controller found on host. {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 12:33:55 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-eb651417-6fdc-4963-909d-30442ca70efb tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74960) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 12:33:55 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-eb651417-6fdc-4963-909d-30442ca70efb tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=549f51ba-ac69-494b-8de1-34635aa2d7cf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='63ee9c80c632442fb0379f47b784bd20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T12:13:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 12:33:55 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-eb651417-6fdc-4963-909d-30442ca70efb tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Flavor limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 12:33:55 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-eb651417-6fdc-4963-909d-30442ca70efb tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Image limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 12:33:55 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-eb651417-6fdc-4963-909d-30442ca70efb tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Flavor pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 12:33:55 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-eb651417-6fdc-4963-909d-30442ca70efb tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Image pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 12:33:55 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-eb651417-6fdc-4963-909d-30442ca70efb tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 12:33:55 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-eb651417-6fdc-4963-909d-30442ca70efb tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 12:33:55 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-eb651417-6fdc-4963-909d-30442ca70efb tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 12:33:55 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-eb651417-6fdc-4963-909d-30442ca70efb tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Got 1 possible topologies {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 12:33:55 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-eb651417-6fdc-4963-909d-30442ca70efb tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 12:33:55 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-eb651417-6fdc-4963-909d-30442ca70efb tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 12:33:55 user nova-compute[74960]: DEBUG nova.objects.instance [None req-eb651417-6fdc-4963-909d-30442ca70efb tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Lazy-loading 'vcpu_model' on Instance uuid b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:33:55 user nova-compute[74960]: DEBUG nova.objects.base [None req-eb651417-6fdc-4963-909d-30442ca70efb tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Object Instance<b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74960) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 12:33:55 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-eb651417-6fdc-4963-909d-30442ca70efb tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:32:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1585096232',display_name='tempest-ServerRescueNegativeTestJSON-server-1585096232',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1585096232',id=32,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-03T12:32:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='434ce6c4b77342299a17e547a14e3918',ramdisk_id='',reservation_id='r-qfzcokmy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1678469488',owner_user_name='tempest-ServerRescueNegativeTestJSON-1678469488-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:32:11Z,user_data=None,user_id='82a995b6307c4ba0b4cf8d5ede286a6c',uuid=b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b0f443c5-8a12-41fd-9275-81b88b3c08fd", "address": "fa:16:3e:68:31:70", "network": {"id": "9a9a848a-80be-4281-8554-8e28744073b3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1579909169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1579909169-network", "vif_mac": "fa:16:3e:68:31:70"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "434ce6c4b77342299a17e547a14e3918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0f443c5-8a", "ovs_interfaceid": "b0f443c5-8a12-41fd-9275-81b88b3c08fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74960) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 12:33:55 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-eb651417-6fdc-4963-909d-30442ca70efb tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Converting VIF {"id": "b0f443c5-8a12-41fd-9275-81b88b3c08fd", "address": "fa:16:3e:68:31:70", "network": {"id": "9a9a848a-80be-4281-8554-8e28744073b3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1579909169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1579909169-network", "vif_mac": "fa:16:3e:68:31:70"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "434ce6c4b77342299a17e547a14e3918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0f443c5-8a", "ovs_interfaceid": "b0f443c5-8a12-41fd-9275-81b88b3c08fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:33:55 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-eb651417-6fdc-4963-909d-30442ca70efb tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:68:31:70,bridge_name='br-int',has_traffic_filtering=True,id=b0f443c5-8a12-41fd-9275-81b88b3c08fd,network=Network(9a9a848a-80be-4281-8554-8e28744073b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0f443c5-8a') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:33:55 user nova-compute[74960]: DEBUG nova.objects.instance [None req-eb651417-6fdc-4963-909d-30442ca70efb tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Lazy-loading 'pci_devices' on Instance uuid b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:33:55 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7769e3c5-136f-4282-8e3e-224e3a80922c/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:33:55 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7769e3c5-136f-4282-8e3e-224e3a80922c/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:33:55 user nova-compute[74960]: DEBUG nova.objects.base [None req-eb651417-6fdc-4963-909d-30442ca70efb tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Object Instance<b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74960) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 12:33:55 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-eb651417-6fdc-4963-909d-30442ca70efb tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d] End _get_guest_xml xml=<domain type="kvm">
Nov 03 12:33:55 user nova-compute[74960]:   <uuid>b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d</uuid>
Nov 03 12:33:55 user nova-compute[74960]:   <name>instance-00000020</name>
Nov 03 12:33:55 user nova-compute[74960]:   <memory>524288</memory>
Nov 03 12:33:55 user nova-compute[74960]:   <vcpu>1</vcpu>
Nov 03 12:33:55 user nova-compute[74960]:   <metadata>
Nov 03 12:33:55 user nova-compute[74960]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 12:33:55 user nova-compute[74960]:       <nova:package version="0.0.0"/>
Nov 03 12:33:55 user nova-compute[74960]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1585096232</nova:name>
Nov 03 12:33:55 user nova-compute[74960]:       <nova:creationTime>2023-11-03 12:33:55</nova:creationTime>
Nov 03 12:33:55 user nova-compute[74960]:       <nova:flavor name="m1.tiny">
Nov 03 12:33:55 user nova-compute[74960]:         <nova:memory>512</nova:memory>
Nov 03 12:33:55 user nova-compute[74960]:         <nova:disk>1</nova:disk>
Nov 03 12:33:55 user nova-compute[74960]:         <nova:swap>0</nova:swap>
Nov 03 12:33:55 user nova-compute[74960]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 12:33:55 user nova-compute[74960]:         <nova:vcpus>1</nova:vcpus>
Nov 03 12:33:55 user nova-compute[74960]:       </nova:flavor>
Nov 03 12:33:55 user nova-compute[74960]:       <nova:owner>
Nov 03 12:33:55 user nova-compute[74960]:         <nova:user uuid="82a995b6307c4ba0b4cf8d5ede286a6c">tempest-ServerRescueNegativeTestJSON-1678469488-project-member</nova:user>
Nov 03 12:33:55 user nova-compute[74960]:         <nova:project uuid="434ce6c4b77342299a17e547a14e3918">tempest-ServerRescueNegativeTestJSON-1678469488</nova:project>
Nov 03 12:33:55 user nova-compute[74960]:       </nova:owner>
Nov 03 12:33:55 user nova-compute[74960]:       <nova:root type="image" uuid="549f51ba-ac69-494b-8de1-34635aa2d7cf"/>
Nov 03 12:33:55 user nova-compute[74960]:       <nova:ports>
Nov 03 12:33:55 user nova-compute[74960]:         <nova:port uuid="b0f443c5-8a12-41fd-9275-81b88b3c08fd">
Nov 03 12:33:55 user nova-compute[74960]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 03 12:33:55 user nova-compute[74960]:         </nova:port>
Nov 03 12:33:55 user nova-compute[74960]:       </nova:ports>
Nov 03 12:33:55 user nova-compute[74960]:     </nova:instance>
Nov 03 12:33:55 user nova-compute[74960]:   </metadata>
Nov 03 12:33:55 user nova-compute[74960]:   <sysinfo type="smbios">
Nov 03 12:33:55 user nova-compute[74960]:     <system>
Nov 03 12:33:55 user nova-compute[74960]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 12:33:55 user nova-compute[74960]:       <entry name="product">OpenStack Nova</entry>
Nov 03 12:33:55 user nova-compute[74960]:       <entry name="version">0.0.0</entry>
Nov 03 12:33:55 user nova-compute[74960]:       <entry name="serial">b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d</entry>
Nov 03 12:33:55 user nova-compute[74960]:       <entry name="uuid">b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d</entry>
Nov 03 12:33:55 user nova-compute[74960]:       <entry name="family">Virtual Machine</entry>
Nov 03 12:33:55 user nova-compute[74960]:     </system>
Nov 03 12:33:55 user nova-compute[74960]:   </sysinfo>
Nov 03 12:33:55 user nova-compute[74960]:   <os>
Nov 03 12:33:55 user nova-compute[74960]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 12:33:55 user nova-compute[74960]:     <smbios mode="sysinfo"/>
Nov 03 12:33:55 user nova-compute[74960]:   </os>
Nov 03 12:33:55 user nova-compute[74960]:   <features>
Nov 03 12:33:55 user nova-compute[74960]:     <acpi/>
Nov 03 12:33:55 user nova-compute[74960]:     <apic/>
Nov 03 12:33:55 user nova-compute[74960]:     <vmcoreinfo/>
Nov 03 12:33:55 user nova-compute[74960]:   </features>
Nov 03 12:33:55 user nova-compute[74960]:   <clock offset="utc">
Nov 03 12:33:55 user nova-compute[74960]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 12:33:55 user nova-compute[74960]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 12:33:55 user nova-compute[74960]:     <timer name="hpet" present="no"/>
Nov 03 12:33:55 user nova-compute[74960]:   </clock>
Nov 03 12:33:55 user nova-compute[74960]:   <cpu mode="custom" match="exact">
Nov 03 12:33:55 user nova-compute[74960]:     <model>Nehalem</model>
Nov 03 12:33:55 user nova-compute[74960]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 12:33:55 user nova-compute[74960]:   </cpu>
Nov 03 12:33:55 user nova-compute[74960]:   <devices>
Nov 03 12:33:55 user nova-compute[74960]:     <disk type="file" device="disk">
Nov 03 12:33:55 user nova-compute[74960]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 12:33:55 user nova-compute[74960]:       <source file="/opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk.rescue"/>
Nov 03 12:33:55 user nova-compute[74960]:       <target dev="vda" bus="virtio"/>
Nov 03 12:33:55 user nova-compute[74960]:     </disk>
Nov 03 12:33:55 user nova-compute[74960]:     <disk type="file" device="disk">
Nov 03 12:33:55 user nova-compute[74960]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 12:33:55 user nova-compute[74960]:       <source file="/opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk"/>
Nov 03 12:33:55 user nova-compute[74960]:       <target dev="vdb" bus="virtio"/>
Nov 03 12:33:55 user nova-compute[74960]:     </disk>
Nov 03 12:33:55 user nova-compute[74960]:     <interface type="ethernet">
Nov 03 12:33:55 user nova-compute[74960]:       <mac address="fa:16:3e:68:31:70"/>
Nov 03 12:33:55 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:33:55 user nova-compute[74960]:       <mtu size="1442"/>
Nov 03 12:33:55 user nova-compute[74960]:       <target dev="tapb0f443c5-8a"/>
Nov 03 12:33:55 user nova-compute[74960]:     </interface>
Nov 03 12:33:55 user nova-compute[74960]:     <serial type="pty">
Nov 03 12:33:55 user nova-compute[74960]:       <log file="/opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/console.log" append="off"/>
Nov 03 12:33:55 user nova-compute[74960]:     </serial>
Nov 03 12:33:55 user nova-compute[74960]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 12:33:55 user nova-compute[74960]:     <video>
Nov 03 12:33:55 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:33:55 user nova-compute[74960]:     </video>
Nov 03 12:33:55 user nova-compute[74960]:     <rng model="virtio">
Nov 03 12:33:55 user nova-compute[74960]:       <backend model="random">/dev/urandom</backend>
Nov 03 12:33:55 user nova-compute[74960]:     </rng>
Nov 03 12:33:55 user nova-compute[74960]:     <controller type="usb" index="0" model="none"/>
Nov 03 12:33:55 user nova-compute[74960]:     <memballoon model="virtio">
Nov 03 12:33:55 user nova-compute[74960]:       <stats period="10"/>
Nov 03 12:33:55 user nova-compute[74960]:     </memballoon>
Nov 03 12:33:55 user nova-compute[74960]:   </devices>
Nov 03 12:33:55 user nova-compute[74960]: </domain>
Nov 03 12:33:55 user nova-compute[74960]:  {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 12:33:55 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d] Instance destroyed successfully.
Nov 03 12:33:55 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-eb651417-6fdc-4963-909d-30442ca70efb tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] No BDM found with device name vda, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:33:55 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-eb651417-6fdc-4963-909d-30442ca70efb tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:33:55 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-eb651417-6fdc-4963-909d-30442ca70efb tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] No VIF found with MAC fa:16:3e:68:31:70, not building metadata {{(pid=74960) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 12:33:55 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7769e3c5-136f-4282-8e3e-224e3a80922c/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:33:55 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e02c80-f626-4918-93f1-6b9a7f778c7a/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:33:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e02c80-f626-4918-93f1-6b9a7f778c7a/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:33:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e02c80-f626-4918-93f1-6b9a7f778c7a/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:33:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e02c80-f626-4918-93f1-6b9a7f778c7a/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:33:57 user nova-compute[74960]: DEBUG nova.compute.manager [req-152cecb0-7293-4f54-ac14-4a68be3bd0de req-d7bbdb2a-43ed-4efc-98da-c0d2db4a26cb service nova] [instance: b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d] Received event network-vif-plugged-b0f443c5-8a12-41fd-9275-81b88b3c08fd {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:33:57 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-152cecb0-7293-4f54-ac14-4a68be3bd0de req-d7bbdb2a-43ed-4efc-98da-c0d2db4a26cb service nova] Acquiring lock "b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:33:57 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-152cecb0-7293-4f54-ac14-4a68be3bd0de req-d7bbdb2a-43ed-4efc-98da-c0d2db4a26cb service nova] Lock "b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:33:57 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-152cecb0-7293-4f54-ac14-4a68be3bd0de req-d7bbdb2a-43ed-4efc-98da-c0d2db4a26cb service nova] Lock "b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:33:57 user nova-compute[74960]: DEBUG nova.compute.manager [req-152cecb0-7293-4f54-ac14-4a68be3bd0de req-d7bbdb2a-43ed-4efc-98da-c0d2db4a26cb service nova] [instance: b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d] No waiting events found dispatching network-vif-plugged-b0f443c5-8a12-41fd-9275-81b88b3c08fd {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:33:57 user nova-compute[74960]: WARNING nova.compute.manager [req-152cecb0-7293-4f54-ac14-4a68be3bd0de req-d7bbdb2a-43ed-4efc-98da-c0d2db4a26cb service nova] [instance: b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d] Received unexpected event network-vif-plugged-b0f443c5-8a12-41fd-9275-81b88b3c08fd for instance with vm_state active and task_state rescuing.
Nov 03 12:33:57 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:33:57 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:33:57 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:33:57 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:33:57 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:33:57 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk.rescue --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:33:58 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk.rescue --force-share --output=json" returned: 0 in 0.290s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:33:58 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk.rescue --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:33:58 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-8c839a78-5240-4334-88cf-bbc00057e46f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Acquiring lock "7769e3c5-136f-4282-8e3e-224e3a80922c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:33:58 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-8c839a78-5240-4334-88cf-bbc00057e46f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Lock "7769e3c5-136f-4282-8e3e-224e3a80922c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:33:58 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-8c839a78-5240-4334-88cf-bbc00057e46f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Acquiring lock "7769e3c5-136f-4282-8e3e-224e3a80922c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:33:58 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-8c839a78-5240-4334-88cf-bbc00057e46f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Lock "7769e3c5-136f-4282-8e3e-224e3a80922c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:33:58 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-8c839a78-5240-4334-88cf-bbc00057e46f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Lock "7769e3c5-136f-4282-8e3e-224e3a80922c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:33:58 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:33:58 user nova-compute[74960]: INFO nova.compute.manager [None req-8c839a78-5240-4334-88cf-bbc00057e46f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: 7769e3c5-136f-4282-8e3e-224e3a80922c] Terminating instance
Nov 03 12:33:58 user nova-compute[74960]: DEBUG nova.compute.manager [None req-8c839a78-5240-4334-88cf-bbc00057e46f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: 7769e3c5-136f-4282-8e3e-224e3a80922c] Start destroying the instance on the hypervisor. {{(pid=74960) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 12:33:58 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk.rescue --force-share --output=json" returned: 0 in 0.257s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:33:58 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:33:58 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:33:58 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:33:58 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:33:58 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:33:58 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:33:58 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:33:58 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:33:58 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:33:59 user nova-compute[74960]: DEBUG nova.compute.manager [req-b3aca9b6-b6b6-4a24-8643-109457cf28ac req-31fa5782-ec22-4dbc-bbf3-cce16b7e1e8c service nova] [instance: 7769e3c5-136f-4282-8e3e-224e3a80922c] Received event network-vif-unplugged-8fe46c5c-9093-43c4-8b0d-baf325c2e18b {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:33:59 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-b3aca9b6-b6b6-4a24-8643-109457cf28ac req-31fa5782-ec22-4dbc-bbf3-cce16b7e1e8c service nova] Acquiring lock "7769e3c5-136f-4282-8e3e-224e3a80922c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:33:59 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-b3aca9b6-b6b6-4a24-8643-109457cf28ac req-31fa5782-ec22-4dbc-bbf3-cce16b7e1e8c service nova] Lock "7769e3c5-136f-4282-8e3e-224e3a80922c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:33:59 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-b3aca9b6-b6b6-4a24-8643-109457cf28ac req-31fa5782-ec22-4dbc-bbf3-cce16b7e1e8c service nova] Lock "7769e3c5-136f-4282-8e3e-224e3a80922c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:33:59 user nova-compute[74960]: DEBUG nova.compute.manager [req-b3aca9b6-b6b6-4a24-8643-109457cf28ac req-31fa5782-ec22-4dbc-bbf3-cce16b7e1e8c service nova] [instance: 7769e3c5-136f-4282-8e3e-224e3a80922c] No waiting events found dispatching network-vif-unplugged-8fe46c5c-9093-43c4-8b0d-baf325c2e18b {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:33:59 user nova-compute[74960]: DEBUG nova.compute.manager [req-b3aca9b6-b6b6-4a24-8643-109457cf28ac req-31fa5782-ec22-4dbc-bbf3-cce16b7e1e8c service nova] [instance: 7769e3c5-136f-4282-8e3e-224e3a80922c] Received event network-vif-unplugged-8fe46c5c-9093-43c4-8b0d-baf325c2e18b for instance with task_state deleting. {{(pid=74960) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 12:33:59 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7b95c0-3726-4a1c-a384-ec91abf75225/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:33:59 user nova-compute[74960]: DEBUG nova.compute.manager [req-ad183fbc-98f5-4a64-a194-32909b8db8f4 req-09587e0c-5f85-4a1a-81cf-1337a1faf45d service nova] [instance: b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d] Received event network-vif-plugged-b0f443c5-8a12-41fd-9275-81b88b3c08fd {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:33:59 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-ad183fbc-98f5-4a64-a194-32909b8db8f4 req-09587e0c-5f85-4a1a-81cf-1337a1faf45d service nova] Acquiring lock "b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:33:59 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-ad183fbc-98f5-4a64-a194-32909b8db8f4 req-09587e0c-5f85-4a1a-81cf-1337a1faf45d service nova] Lock "b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:33:59 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-ad183fbc-98f5-4a64-a194-32909b8db8f4 req-09587e0c-5f85-4a1a-81cf-1337a1faf45d service nova] Lock "b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:33:59 user nova-compute[74960]: DEBUG nova.compute.manager [req-ad183fbc-98f5-4a64-a194-32909b8db8f4 req-09587e0c-5f85-4a1a-81cf-1337a1faf45d service nova] [instance: b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d] No waiting events found dispatching network-vif-plugged-b0f443c5-8a12-41fd-9275-81b88b3c08fd {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:33:59 user nova-compute[74960]: WARNING nova.compute.manager [req-ad183fbc-98f5-4a64-a194-32909b8db8f4 req-09587e0c-5f85-4a1a-81cf-1337a1faf45d service nova] [instance: b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d] Received unexpected event network-vif-plugged-b0f443c5-8a12-41fd-9275-81b88b3c08fd for instance with vm_state active and task_state rescuing.
Nov 03 12:33:59 user nova-compute[74960]: DEBUG nova.compute.manager [req-ad183fbc-98f5-4a64-a194-32909b8db8f4 req-09587e0c-5f85-4a1a-81cf-1337a1faf45d service nova] [instance: b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d] Received event network-vif-plugged-b0f443c5-8a12-41fd-9275-81b88b3c08fd {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:33:59 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-ad183fbc-98f5-4a64-a194-32909b8db8f4 req-09587e0c-5f85-4a1a-81cf-1337a1faf45d service nova] Acquiring lock "b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:33:59 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-ad183fbc-98f5-4a64-a194-32909b8db8f4 req-09587e0c-5f85-4a1a-81cf-1337a1faf45d service nova] Lock "b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:33:59 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-ad183fbc-98f5-4a64-a194-32909b8db8f4 req-09587e0c-5f85-4a1a-81cf-1337a1faf45d service nova] Lock "b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:33:59 user nova-compute[74960]: DEBUG nova.compute.manager [req-ad183fbc-98f5-4a64-a194-32909b8db8f4 req-09587e0c-5f85-4a1a-81cf-1337a1faf45d service nova] [instance: b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d] No waiting events found dispatching network-vif-plugged-b0f443c5-8a12-41fd-9275-81b88b3c08fd {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:33:59 user nova-compute[74960]: WARNING nova.compute.manager [req-ad183fbc-98f5-4a64-a194-32909b8db8f4 req-09587e0c-5f85-4a1a-81cf-1337a1faf45d service nova] [instance: b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d] Received unexpected event network-vif-plugged-b0f443c5-8a12-41fd-9275-81b88b3c08fd for instance with vm_state active and task_state rescuing.
Nov 03 12:33:59 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7b95c0-3726-4a1c-a384-ec91abf75225/disk --force-share --output=json" returned: 0 in 0.275s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:33:59 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7b95c0-3726-4a1c-a384-ec91abf75225/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:33:59 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: 7769e3c5-136f-4282-8e3e-224e3a80922c] Instance destroyed successfully.
Nov 03 12:33:59 user nova-compute[74960]: DEBUG nova.objects.instance [None req-8c839a78-5240-4334-88cf-bbc00057e46f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Lazy-loading 'resources' on Instance uuid 7769e3c5-136f-4282-8e3e-224e3a80922c {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:33:59 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-8c839a78-5240-4334-88cf-bbc00057e46f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:16:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1764770627',display_name='tempest-ServerActionsTestOtherA-server-1764770627',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1764770627',id=3,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPAz3yp3EJUzWOfLmandSosNLGmmwlB9ouRsIIfsq3JGgx5t4USdyA4JVa+9y90auzNv5yGmALwIZZVdM/LzHirlYfhZGk/2geYmtQFtCuY7KHcICqsra/ZIlPsAiI2BYw==',key_name='tempest-keypair-1847755946',keypairs=<?>,launch_index=0,launched_at=2023-11-03T12:17:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5320673ee4f0422989a3708915375cdb',ramdisk_id='',reservation_id='r-mv8ko31k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1651581249',owner_user_name='tempest-ServerActionsTestOtherA-1651581249-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T12:17:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60d8d224d7204ede84c09433a3d82d0f',uuid=7769e3c5-136f-4282-8e3e-224e3a80922c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8fe46c5c-9093-43c4-8b0d-baf325c2e18b", "address": "fa:16:3e:ba:d5:3a", "network": {"id": "9c5fae09-5df5-45a3-b9cd-7ac3763ba878", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1736223258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5320673ee4f0422989a3708915375cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fe46c5c-90", "ovs_interfaceid": "8fe46c5c-9093-43c4-8b0d-baf325c2e18b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 12:33:59 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-8c839a78-5240-4334-88cf-bbc00057e46f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Converting VIF {"id": "8fe46c5c-9093-43c4-8b0d-baf325c2e18b", "address": "fa:16:3e:ba:d5:3a", "network": {"id": "9c5fae09-5df5-45a3-b9cd-7ac3763ba878", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1736223258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5320673ee4f0422989a3708915375cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fe46c5c-90", "ovs_interfaceid": "8fe46c5c-9093-43c4-8b0d-baf325c2e18b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:33:59 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-8c839a78-5240-4334-88cf-bbc00057e46f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ba:d5:3a,bridge_name='br-int',has_traffic_filtering=True,id=8fe46c5c-9093-43c4-8b0d-baf325c2e18b,network=Network(9c5fae09-5df5-45a3-b9cd-7ac3763ba878),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fe46c5c-90') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:33:59 user nova-compute[74960]: DEBUG os_vif [None req-8c839a78-5240-4334-88cf-bbc00057e46f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ba:d5:3a,bridge_name='br-int',has_traffic_filtering=True,id=8fe46c5c-9093-43c4-8b0d-baf325c2e18b,network=Network(9c5fae09-5df5-45a3-b9cd-7ac3763ba878),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fe46c5c-90') {{(pid=74960) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 12:33:59 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:33:59 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8fe46c5c-90, bridge=br-int, if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:33:59 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:33:59 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:33:59 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:33:59 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e29addb4-b084-48ae-bf2f-e9663e2e240e) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:33:59 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:33:59 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:33:59 user nova-compute[74960]: INFO os_vif [None req-8c839a78-5240-4334-88cf-bbc00057e46f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ba:d5:3a,bridge_name='br-int',has_traffic_filtering=True,id=8fe46c5c-9093-43c4-8b0d-baf325c2e18b,network=Network(9c5fae09-5df5-45a3-b9cd-7ac3763ba878),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fe46c5c-90')
Nov 03 12:33:59 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-8c839a78-5240-4334-88cf-bbc00057e46f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: 7769e3c5-136f-4282-8e3e-224e3a80922c] Deleting instance files /opt/stack/data/nova/instances/7769e3c5-136f-4282-8e3e-224e3a80922c_del
Nov 03 12:33:59 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-8c839a78-5240-4334-88cf-bbc00057e46f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: 7769e3c5-136f-4282-8e3e-224e3a80922c] Deletion of /opt/stack/data/nova/instances/7769e3c5-136f-4282-8e3e-224e3a80922c_del complete
Nov 03 12:33:59 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7b95c0-3726-4a1c-a384-ec91abf75225/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:33:59 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74960) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 12:33:59 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74960) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 12:33:59 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7606a55-d5c3-4ba8-b499-f3c70813f151/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:33:59 user nova-compute[74960]: INFO nova.compute.manager [None req-8c839a78-5240-4334-88cf-bbc00057e46f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] [instance: 7769e3c5-136f-4282-8e3e-224e3a80922c] Took 1.23 seconds to destroy the instance on the hypervisor.
Nov 03 12:33:59 user nova-compute[74960]: DEBUG oslo.service.loopingcall [None req-8c839a78-5240-4334-88cf-bbc00057e46f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74960) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 12:33:59 user nova-compute[74960]: DEBUG nova.compute.manager [-] [instance: 7769e3c5-136f-4282-8e3e-224e3a80922c] Deallocating network for instance {{(pid=74960) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 12:33:59 user nova-compute[74960]: DEBUG nova.network.neutron [-] [instance: 7769e3c5-136f-4282-8e3e-224e3a80922c] deallocate_for_instance() {{(pid=74960) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 12:33:59 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7606a55-d5c3-4ba8-b499-f3c70813f151/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:33:59 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7606a55-d5c3-4ba8-b499-f3c70813f151/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:33:59 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7606a55-d5c3-4ba8-b499-f3c70813f151/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:34:00 user nova-compute[74960]: DEBUG nova.compute.manager [req-2b3e9753-b18d-4daa-b9c7-8d3fe79d7378 req-2b685ffc-35b9-45bf-b910-c7d39e2ba714 service nova] [instance: 7769e3c5-136f-4282-8e3e-224e3a80922c] Received event network-vif-deleted-8fe46c5c-9093-43c4-8b0d-baf325c2e18b {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:34:00 user nova-compute[74960]: INFO nova.compute.manager [req-2b3e9753-b18d-4daa-b9c7-8d3fe79d7378 req-2b685ffc-35b9-45bf-b910-c7d39e2ba714 service nova] [instance: 7769e3c5-136f-4282-8e3e-224e3a80922c] Neutron deleted interface 8fe46c5c-9093-43c4-8b0d-baf325c2e18b; detaching it from the instance and deleting it from the info cache
Nov 03 12:34:00 user nova-compute[74960]: DEBUG nova.network.neutron [req-2b3e9753-b18d-4daa-b9c7-8d3fe79d7378 req-2b685ffc-35b9-45bf-b910-c7d39e2ba714 service nova] [instance: 7769e3c5-136f-4282-8e3e-224e3a80922c] Updating instance_info_cache with network_info: [] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:34:00 user nova-compute[74960]: DEBUG nova.network.neutron [-] [instance: 7769e3c5-136f-4282-8e3e-224e3a80922c] Updating instance_info_cache with network_info: [] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:34:00 user nova-compute[74960]: DEBUG nova.compute.manager [None req-eb651417-6fdc-4963-909d-30442ca70efb tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d] Checking state {{(pid=74960) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 12:34:00 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-46eb2a27-ef75-4377-830b-074abb9bd09b tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Acquiring lock "35e02c80-f626-4918-93f1-6b9a7f778c7a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:34:00 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-46eb2a27-ef75-4377-830b-074abb9bd09b tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Lock "35e02c80-f626-4918-93f1-6b9a7f778c7a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:34:00 user nova-compute[74960]: INFO nova.compute.manager [-] [instance: 7769e3c5-136f-4282-8e3e-224e3a80922c] Took 0.99 seconds to deallocate network for instance.
Nov 03 12:34:00 user nova-compute[74960]: DEBUG nova.objects.instance [None req-46eb2a27-ef75-4377-830b-074abb9bd09b tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Lazy-loading 'flavor' on Instance uuid 35e02c80-f626-4918-93f1-6b9a7f778c7a {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:34:00 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:34:00 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:34:00 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Hypervisor/Node resource view: name=user free_ram=7608MB free_disk=23.963401794433594GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74960) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 12:34:00 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:34:00 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:34:00 user nova-compute[74960]: DEBUG nova.compute.manager [req-2b3e9753-b18d-4daa-b9c7-8d3fe79d7378 req-2b685ffc-35b9-45bf-b910-c7d39e2ba714 service nova] [instance: 7769e3c5-136f-4282-8e3e-224e3a80922c] Detach interface failed, port_id=8fe46c5c-9093-43c4-8b0d-baf325c2e18b, reason: Instance 7769e3c5-136f-4282-8e3e-224e3a80922c could not be found. {{(pid=74960) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 03 12:34:00 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-46eb2a27-ef75-4377-830b-074abb9bd09b tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Lock "35e02c80-f626-4918-93f1-6b9a7f778c7a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.081s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:34:00 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-8c839a78-5240-4334-88cf-bbc00057e46f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:34:00 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 7769e3c5-136f-4282-8e3e-224e3a80922c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:34:00 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 87f15f5f-8afa-4d7b-bb45-5887184f9ee5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:34:00 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance a6199681-f85e-4f55-966b-6ab3f17cd640 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:34:00 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 5b7b95c0-3726-4a1c-a384-ec91abf75225 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:34:00 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 35e02c80-f626-4918-93f1-6b9a7f778c7a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:34:00 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:34:00 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:34:00 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 9c447082-b59b-4c8e-8fa0-bf6599a84e91 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:34:00 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 12ae6707-c1c6-4bc2-a409-67cea64fc2c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:34:00 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance b7606a55-d5c3-4ba8-b499-f3c70813f151 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:34:00 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74960) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 12:34:00 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74960) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 12:34:00 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-46eb2a27-ef75-4377-830b-074abb9bd09b tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Acquiring lock "35e02c80-f626-4918-93f1-6b9a7f778c7a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:34:00 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-46eb2a27-ef75-4377-830b-074abb9bd09b tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Lock "35e02c80-f626-4918-93f1-6b9a7f778c7a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:34:00 user nova-compute[74960]: INFO nova.compute.manager [None req-46eb2a27-ef75-4377-830b-074abb9bd09b tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a] Attaching volume 7da48309-69f9-407d-81b1-9bd9aea03cd0 to /dev/vdb
Nov 03 12:34:01 user nova-compute[74960]: DEBUG nova.compute.manager [req-478476ae-29ae-4fe6-be6a-6db16f1615f6 req-47d8289a-2a4d-4ce6-9e31-e67f2b7c649f service nova] [instance: 7769e3c5-136f-4282-8e3e-224e3a80922c] Received event network-vif-plugged-8fe46c5c-9093-43c4-8b0d-baf325c2e18b {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:34:01 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-478476ae-29ae-4fe6-be6a-6db16f1615f6 req-47d8289a-2a4d-4ce6-9e31-e67f2b7c649f service nova] Acquiring lock "7769e3c5-136f-4282-8e3e-224e3a80922c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:34:01 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-478476ae-29ae-4fe6-be6a-6db16f1615f6 req-47d8289a-2a4d-4ce6-9e31-e67f2b7c649f service nova] Lock "7769e3c5-136f-4282-8e3e-224e3a80922c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:34:01 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-478476ae-29ae-4fe6-be6a-6db16f1615f6 req-47d8289a-2a4d-4ce6-9e31-e67f2b7c649f service nova] Lock "7769e3c5-136f-4282-8e3e-224e3a80922c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:34:01 user nova-compute[74960]: DEBUG nova.compute.manager [req-478476ae-29ae-4fe6-be6a-6db16f1615f6 req-47d8289a-2a4d-4ce6-9e31-e67f2b7c649f service nova] [instance: 7769e3c5-136f-4282-8e3e-224e3a80922c] No waiting events found dispatching network-vif-plugged-8fe46c5c-9093-43c4-8b0d-baf325c2e18b {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:34:01 user nova-compute[74960]: WARNING nova.compute.manager [req-478476ae-29ae-4fe6-be6a-6db16f1615f6 req-47d8289a-2a4d-4ce6-9e31-e67f2b7c649f service nova] [instance: 7769e3c5-136f-4282-8e3e-224e3a80922c] Received unexpected event network-vif-plugged-8fe46c5c-9093-43c4-8b0d-baf325c2e18b for instance with vm_state deleted and task_state None.
Nov 03 12:34:01 user nova-compute[74960]: DEBUG os_brick.utils [None req-46eb2a27-ef75-4377-830b-074abb9bd09b tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:34:01 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:34:01 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:34:01 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[785c37ee-5cef-466f-9337-7aab836669f1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:75b8e219756\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:34:01 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:34:01 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:34:01 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[c730472a-144c-4995-8fd7-a55fcbd6f982]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:34:01 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:34:01 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:34:01 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[621852c3-e654-4911-b4bd-f1aef18a2b8f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:34:01 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef0c68ff-ea50-4740-8820-1fc8eca338b8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:34:01 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-46eb2a27-ef75-4377-830b-074abb9bd09b tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Running cmd (subprocess): nvme version {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:34:01 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-46eb2a27-ef75-4377-830b-074abb9bd09b tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] 'nvme version' failed. Not Retrying. {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 12:34:01 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.nvmeof [None req-46eb2a27-ef75-4377-830b-074abb9bd09b tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] nvme not present on system {{(pid=74960) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 12:34:01 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:34:01 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 12:34:01 user nova-compute[74960]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 12:34:01 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[f98c31d5-5679-4b2c-9ecc-3aad046fba02]: (4, '') {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:34:01 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-46eb2a27-ef75-4377-830b-074abb9bd09b tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74960) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 12:34:01 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-46eb2a27-ef75-4377-830b-074abb9bd09b tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74960) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 12:34:01 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-46eb2a27-ef75-4377-830b-074abb9bd09b tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] LIGHTOS: no hostnqn found. {{(pid=74960) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 12:34:01 user nova-compute[74960]: DEBUG os_brick.utils [None req-46eb2a27-ef75-4377-830b-074abb9bd09b tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] <== get_connector_properties: return (163ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:75b8e219756', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:34:01 user nova-compute[74960]: DEBUG nova.virt.block_device [None req-46eb2a27-ef75-4377-830b-074abb9bd09b tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a] Updating existing volume attachment record: 7c6b3422-2aac-4918-8c05-3f98306927e0 {{(pid=74960) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 12:34:01 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:34:01 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:34:01 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Compute_service record updated for user:user {{(pid=74960) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 12:34:01 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.754s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:34:01 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-8c839a78-5240-4334-88cf-bbc00057e46f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.674s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:34:01 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-8c839a78-5240-4334-88cf-bbc00057e46f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:34:01 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-8c839a78-5240-4334-88cf-bbc00057e46f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:34:01 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-8c839a78-5240-4334-88cf-bbc00057e46f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.451s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:34:01 user nova-compute[74960]: INFO nova.scheduler.client.report [None req-8c839a78-5240-4334-88cf-bbc00057e46f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Deleted allocations for instance 7769e3c5-136f-4282-8e3e-224e3a80922c
Nov 03 12:34:02 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-8c839a78-5240-4334-88cf-bbc00057e46f tempest-ServerActionsTestOtherA-1651581249 tempest-ServerActionsTestOtherA-1651581249-project-member] Lock "7769e3c5-136f-4282-8e3e-224e3a80922c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.641s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:34:02 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:34:02 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:34:02 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:34:02 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74960) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 12:34:03 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:34:04 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:34:08 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:34:09 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:34:10 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:34:13 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:34:14 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:34:18 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:34:19 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:34:22 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46eb2a27-ef75-4377-830b-074abb9bd09b tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a] Calling os-brick to attach iSCSI Volume {{(pid=74960) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 12:34:22 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-46eb2a27-ef75-4377-830b-074abb9bd09b tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9aa420acb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7da48309-69f9-407d-81b1-9bd9aea03cd0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fjeQGubp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:34:22 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-46eb2a27-ef75-4377-830b-074abb9bd09b tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:34:22 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-46eb2a27-ef75-4377-830b-074abb9bd09b tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:34:22 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-46eb2a27-ef75-4377-830b-074abb9bd09b tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:34:22 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-46eb2a27-ef75-4377-830b-074abb9bd09b tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:34:22 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-46eb2a27-ef75-4377-830b-074abb9bd09b tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7da48309-69f9-407d-81b1-9bd9aea03cd0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:34:22 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-46eb2a27-ef75-4377-830b-074abb9bd09b tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7da48309-69f9-407d-81b1-9bd9aea03cd0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:34:22 user nova-compute[74960]: INFO os_brick.initiator.connectors.iscsi [None req-46eb2a27-ef75-4377-830b-074abb9bd09b tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 12:34:22 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7da48309-69f9-407d-81b1-9bd9aea03cd0 -p 172.16.0.220:3260 {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:34:22 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7da48309-69f9-407d-81b1-9bd9aea03cd0 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:34:22 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce59b159-5f5c-459f-a25a-7e018eb45647]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:34:22 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-46eb2a27-ef75-4377-830b-074abb9bd09b tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 12:34:22 user nova-compute[74960]:  {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:34:22 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7da48309-69f9-407d-81b1-9bd9aea03cd0 -p 172.16.0.220:3260 --interface default --op new {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:34:22 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7da48309-69f9-407d-81b1-9bd9aea03cd0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:34:22 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[7372aa18-82e9-484e-8aa3-844032f3f9f8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7da48309-69f9-407d-81b1-9bd9aea03cd0] added\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:34:22 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-46eb2a27-ef75-4377-830b-074abb9bd09b tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7da48309-69f9-407d-81b1-9bd9aea03cd0] added
Nov 03 12:34:22 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:34:22 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7da48309-69f9-407d-81b1-9bd9aea03cd0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:34:22 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7da48309-69f9-407d-81b1-9bd9aea03cd0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:34:22 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[6492f1ae-17b9-4a29-8bf6-d862d92bef81]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:34:22 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-46eb2a27-ef75-4377-830b-074abb9bd09b tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:34:22 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7da48309-69f9-407d-81b1-9bd9aea03cd0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:34:22 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7da48309-69f9-407d-81b1-9bd9aea03cd0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:34:22 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c928421-9ead-480e-a0bf-7976c7fa23f6]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:34:22 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-46eb2a27-ef75-4377-830b-074abb9bd09b tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:34:22 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7da48309-69f9-407d-81b1-9bd9aea03cd0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fjeQGubp {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:34:23 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7da48309-69f9-407d-81b1-9bd9aea03cd0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fjeQGubp" returned: 0 in 0.042s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:34:23 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[140ec948-f7e8-4be3-a2f2-17440de08fb6]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:34:23 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-46eb2a27-ef75-4377-830b-074abb9bd09b tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fjeQGubp'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:34:23 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7da48309-69f9-407d-81b1-9bd9aea03cd0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:34:23 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7da48309-69f9-407d-81b1-9bd9aea03cd0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:34:23 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[692e547f-52a1-4ae8-a4ce-7550e5b3b4fc]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:34:23 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-46eb2a27-ef75-4377-830b-074abb9bd09b tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:34:23 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:34:23 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:34:23 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[984d01e4-da98-4278-83d1-6e37edcdd248]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:34:23 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-46eb2a27-ef75-4377-830b-074abb9bd09b tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:34:23 user nova-compute[74960]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 (non-flash)
Nov 03 12:34:23 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:34:23 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-46eb2a27-ef75-4377-830b-074abb9bd09b tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:34:23 user nova-compute[74960]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 (non-flash)
Nov 03 12:34:23 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:34:23 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7da48309-69f9-407d-81b1-9bd9aea03cd0 -p 172.16.0.220:3260 --login {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:34:23 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7da48309-69f9-407d-81b1-9bd9aea03cd0 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:34:23 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda7b331-ea46-4dfe-b80e-4603ad01da3f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7da48309-69f9-407d-81b1-9bd9aea03cd0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7da48309-69f9-407d-81b1-9bd9aea03cd0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:34:23 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-46eb2a27-ef75-4377-830b-074abb9bd09b tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7da48309-69f9-407d-81b1-9bd9aea03cd0, portal: 172.16.0.220,3260]
Nov 03 12:34:23 user nova-compute[74960]: Login to [iface: default, target: iqn.2010-10.org.openstack:7da48309-69f9-407d-81b1-9bd9aea03cd0, portal: 172.16.0.220,3260] successful.
Nov 03 12:34:23 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:34:23 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7da48309-69f9-407d-81b1-9bd9aea03cd0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:34:23 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7da48309-69f9-407d-81b1-9bd9aea03cd0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:34:23 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f433f43-4974-4cf9-9e43-ec805c4aa149]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:34:23 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-46eb2a27-ef75-4377-830b-074abb9bd09b tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:34:23 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:34:23 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:34:23 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[cee27652-2e3f-46c0-b29e-dce11b8066c5]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7da48309-69f9-407d-81b1-9bd9aea03cd0 (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:34:23 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-46eb2a27-ef75-4377-830b-074abb9bd09b tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:34:23 user nova-compute[74960]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 (non-flash)
Nov 03 12:34:23 user nova-compute[74960]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7da48309-69f9-407d-81b1-9bd9aea03cd0 (non-flash)
Nov 03 12:34:23 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:34:23 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-46eb2a27-ef75-4377-830b-074abb9bd09b tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:34:23 user nova-compute[74960]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 (non-flash)
Nov 03 12:34:23 user nova-compute[74960]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7da48309-69f9-407d-81b1-9bd9aea03cd0 (non-flash)
Nov 03 12:34:23 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:34:23 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-46eb2a27-ef75-4377-830b-074abb9bd09b tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7da48309-69f9-407d-81b1-9bd9aea03cd0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.324s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:34:23 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-46eb2a27-ef75-4377-830b-074abb9bd09b tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Connected to 172.16.0.220:3260 {{(pid=74960) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 12:34:23 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-46eb2a27-ef75-4377-830b-074abb9bd09b tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] HCTL ('33', '-', '-', 0) found on session 26 with lun 0 {{(pid=74960) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 12:34:23 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-46eb2a27-ef75-4377-830b-074abb9bd09b tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74960) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 12:34:23 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:34:23 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:34:23 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fc031ba-dc78-4e75-8761-73b335aa209c]: (4, ('- - 0', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:34:23 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-46eb2a27-ef75-4377-830b-074abb9bd09b tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Searching for a device in session 26 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74960) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 12:34:23 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-46eb2a27-ef75-4377-830b-074abb9bd09b tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:7da48309-69f9-407d-81b1-9bd9aea03cd0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fjeQGubp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74960) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 12:34:23 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:34:24 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-46eb2a27-ef75-4377-830b-074abb9bd09b tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.357s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:34:24 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-46eb2a27-ef75-4377-830b-074abb9bd09b tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] <== connect_volume: return (1359ms) {'type': 'block', 'scsi_wwn': '23837383962343535', 'path': '/dev/sdb'} {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:34:24 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46eb2a27-ef75-4377-830b-074abb9bd09b tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23837383962343535', 'path': '/dev/sdb'} {{(pid=74960) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 12:34:24 user nova-compute[74960]: DEBUG nova.objects.instance [None req-46eb2a27-ef75-4377-830b-074abb9bd09b tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Lazy-loading 'flavor' on Instance uuid 35e02c80-f626-4918-93f1-6b9a7f778c7a {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:34:24 user nova-compute[74960]: DEBUG nova.virt.libvirt.guest [None req-46eb2a27-ef75-4377-830b-074abb9bd09b tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] attach device xml: <disk type="block" device="disk">
Nov 03 12:34:24 user nova-compute[74960]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 12:34:24 user nova-compute[74960]:   <source dev="/dev/sdb"/>
Nov 03 12:34:24 user nova-compute[74960]:   <target dev="vdb" bus="virtio"/>
Nov 03 12:34:24 user nova-compute[74960]:   <serial>7da48309-69f9-407d-81b1-9bd9aea03cd0</serial>
Nov 03 12:34:24 user nova-compute[74960]: </disk>
Nov 03 12:34:24 user nova-compute[74960]:  {{(pid=74960) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 03 12:34:24 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:34:24 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-46eb2a27-ef75-4377-830b-074abb9bd09b tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] No BDM found with device name vda, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:34:24 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-46eb2a27-ef75-4377-830b-074abb9bd09b tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:34:24 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-46eb2a27-ef75-4377-830b-074abb9bd09b tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] No VIF found with MAC fa:16:3e:26:d9:9a, not building metadata {{(pid=74960) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 12:34:24 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-46eb2a27-ef75-4377-830b-074abb9bd09b tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Lock "35e02c80-f626-4918-93f1-6b9a7f778c7a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.890s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:34:28 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:34:29 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:34:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:34:34 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:34:36 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-d43b0a40-f720-47c9-a8b7-c0d9e5805c45 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Acquiring lock "5dc6cb24-fe58-4e36-bd7f-a67a804a98e1" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:34:36 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-d43b0a40-f720-47c9-a8b7-c0d9e5805c45 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Lock "5dc6cb24-fe58-4e36-bd7f-a67a804a98e1" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:34:36 user nova-compute[74960]: INFO nova.compute.manager [None req-d43b0a40-f720-47c9-a8b7-c0d9e5805c45 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] Unshelving
Nov 03 12:34:36 user nova-compute[74960]: INFO nova.virt.block_device [None req-d43b0a40-f720-47c9-a8b7-c0d9e5805c45 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] Booting with volume fa4cf8d2-7542-4bcf-840d-5ccc3401a797 at /dev/vda
Nov 03 12:34:36 user nova-compute[74960]: DEBUG os_brick.utils [None req-d43b0a40-f720-47c9-a8b7-c0d9e5805c45 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:34:36 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:34:36 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:34:36 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aa86d45-bae5-4668-ad55-2456a5601f96]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:75b8e219756\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:34:36 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:34:36 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:34:36 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc1ad72c-5c20-4153-ac3f-33f4e65ebf75]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:34:36 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:34:36 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:34:36 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bed0455-ee5e-4424-a70d-a9bdbcefd8c4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:34:36 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bb8866d-4da7-4e34-bf56-de780534abe5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:34:36 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-d43b0a40-f720-47c9-a8b7-c0d9e5805c45 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Running cmd (subprocess): nvme version {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:34:36 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-d43b0a40-f720-47c9-a8b7-c0d9e5805c45 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] 'nvme version' failed. Not Retrying. {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 12:34:36 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d43b0a40-f720-47c9-a8b7-c0d9e5805c45 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] nvme not present on system {{(pid=74960) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 12:34:36 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:34:36 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 12:34:36 user nova-compute[74960]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 12:34:36 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ee3bb07-16cd-44eb-86e9-ee47b9b429b3]: (4, '') {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:34:37 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-d43b0a40-f720-47c9-a8b7-c0d9e5805c45 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74960) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 12:34:37 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-d43b0a40-f720-47c9-a8b7-c0d9e5805c45 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74960) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 12:34:37 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-d43b0a40-f720-47c9-a8b7-c0d9e5805c45 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] LIGHTOS: no hostnqn found. {{(pid=74960) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 12:34:37 user nova-compute[74960]: DEBUG os_brick.utils [None req-d43b0a40-f720-47c9-a8b7-c0d9e5805c45 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:75b8e219756', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:34:37 user nova-compute[74960]: DEBUG nova.virt.block_device [None req-d43b0a40-f720-47c9-a8b7-c0d9e5805c45 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] Updating existing volume attachment record: f6a02f6f-27db-412d-af78-19c1b90c8fcc {{(pid=74960) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 12:34:39 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:34:44 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:34:48 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:34:49 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:34:49 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:34:50 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:34:50 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Starting heal instance info cache {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 12:34:50 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Rebuilding the list of instances to heal {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 03 12:34:50 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "refresh_cache-87f15f5f-8afa-4d7b-bb45-5887184f9ee5" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:34:50 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquired lock "refresh_cache-87f15f5f-8afa-4d7b-bb45-5887184f9ee5" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:34:50 user nova-compute[74960]: DEBUG nova.network.neutron [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: 87f15f5f-8afa-4d7b-bb45-5887184f9ee5] Forcefully refreshing network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 12:34:50 user nova-compute[74960]: DEBUG nova.objects.instance [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lazy-loading 'info_cache' on Instance uuid 87f15f5f-8afa-4d7b-bb45-5887184f9ee5 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:34:50 user nova-compute[74960]: DEBUG nova.network.neutron [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: 87f15f5f-8afa-4d7b-bb45-5887184f9ee5] Updating instance_info_cache with network_info: [{"id": "4a12f8bf-1920-4e7a-afec-9b716b73ff63", "address": "fa:16:3e:be:f4:7d", "network": {"id": "dec66832-56d5-4d68-b11f-8e8eed38f045", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-79099436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc95d68d5e147e1953c855169b17091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a12f8bf-19", "ovs_interfaceid": "4a12f8bf-1920-4e7a-afec-9b716b73ff63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:34:50 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Releasing lock "refresh_cache-87f15f5f-8afa-4d7b-bb45-5887184f9ee5" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:34:50 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: 87f15f5f-8afa-4d7b-bb45-5887184f9ee5] Updated the network info_cache for instance {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 12:34:50 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:34:50 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:34:51 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:34:52 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:34:53 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:34:53 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:34:53 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:34:53 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:34:53 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Auditing locally available compute resources for user (node: user) {{(pid=74960) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 12:34:53 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12ae6707-c1c6-4bc2-a409-67cea64fc2c3/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:34:53 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12ae6707-c1c6-4bc2-a409-67cea64fc2c3/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:34:53 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12ae6707-c1c6-4bc2-a409-67cea64fc2c3/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:34:53 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12ae6707-c1c6-4bc2-a409-67cea64fc2c3/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:34:54 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f15f5f-8afa-4d7b-bb45-5887184f9ee5/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:34:54 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f15f5f-8afa-4d7b-bb45-5887184f9ee5/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:34:54 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f15f5f-8afa-4d7b-bb45-5887184f9ee5/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:34:54 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f15f5f-8afa-4d7b-bb45-5887184f9ee5/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:34:54 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c447082-b59b-4c8e-8fa0-bf6599a84e91/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:34:54 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:34:54 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c447082-b59b-4c8e-8fa0-bf6599a84e91/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:34:54 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c447082-b59b-4c8e-8fa0-bf6599a84e91/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:34:54 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c447082-b59b-4c8e-8fa0-bf6599a84e91/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:34:54 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47eb8ddf-590f-4ffa-87c8-377cf1ee0f67/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:34:54 user nova-compute[74960]: DEBUG nova.compute.manager [req-d0d678ff-59b4-4004-b5ff-b449389c7f91 req-597ffb02-ed16-4f7b-b1ed-ed18f2291c09 service nova] [instance: 9c447082-b59b-4c8e-8fa0-bf6599a84e91] Received event network-changed-d08c2ee9-364d-4a04-a7de-2e45049473a8 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:34:54 user nova-compute[74960]: DEBUG nova.compute.manager [req-d0d678ff-59b4-4004-b5ff-b449389c7f91 req-597ffb02-ed16-4f7b-b1ed-ed18f2291c09 service nova] [instance: 9c447082-b59b-4c8e-8fa0-bf6599a84e91] Refreshing instance network info cache due to event network-changed-d08c2ee9-364d-4a04-a7de-2e45049473a8. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 12:34:54 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-d0d678ff-59b4-4004-b5ff-b449389c7f91 req-597ffb02-ed16-4f7b-b1ed-ed18f2291c09 service nova] Acquiring lock "refresh_cache-9c447082-b59b-4c8e-8fa0-bf6599a84e91" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:34:54 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-d0d678ff-59b4-4004-b5ff-b449389c7f91 req-597ffb02-ed16-4f7b-b1ed-ed18f2291c09 service nova] Acquired lock "refresh_cache-9c447082-b59b-4c8e-8fa0-bf6599a84e91" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:34:54 user nova-compute[74960]: DEBUG nova.network.neutron [req-d0d678ff-59b4-4004-b5ff-b449389c7f91 req-597ffb02-ed16-4f7b-b1ed-ed18f2291c09 service nova] [instance: 9c447082-b59b-4c8e-8fa0-bf6599a84e91] Refreshing network info cache for port d08c2ee9-364d-4a04-a7de-2e45049473a8 {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 12:34:55 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47eb8ddf-590f-4ffa-87c8-377cf1ee0f67/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:34:55 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47eb8ddf-590f-4ffa-87c8-377cf1ee0f67/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:34:55 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47eb8ddf-590f-4ffa-87c8-377cf1ee0f67/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:34:55 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e02c80-f626-4918-93f1-6b9a7f778c7a/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:34:55 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e02c80-f626-4918-93f1-6b9a7f778c7a/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:34:55 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e02c80-f626-4918-93f1-6b9a7f778c7a/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:34:55 user nova-compute[74960]: DEBUG nova.network.neutron [req-d0d678ff-59b4-4004-b5ff-b449389c7f91 req-597ffb02-ed16-4f7b-b1ed-ed18f2291c09 service nova] [instance: 9c447082-b59b-4c8e-8fa0-bf6599a84e91] Updated VIF entry in instance network info cache for port d08c2ee9-364d-4a04-a7de-2e45049473a8. {{(pid=74960) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 12:34:55 user nova-compute[74960]: DEBUG nova.network.neutron [req-d0d678ff-59b4-4004-b5ff-b449389c7f91 req-597ffb02-ed16-4f7b-b1ed-ed18f2291c09 service nova] [instance: 9c447082-b59b-4c8e-8fa0-bf6599a84e91] Updating instance_info_cache with network_info: [{"id": "d08c2ee9-364d-4a04-a7de-2e45049473a8", "address": "fa:16:3e:fd:9d:36", "network": {"id": "1acaa882-f931-44d0-b9d0-17ed988e4e8b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1021854594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ff357804ee44063bce5f36ad836d71d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd08c2ee9-36", "ovs_interfaceid": "d08c2ee9-364d-4a04-a7de-2e45049473a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:34:55 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-d0d678ff-59b4-4004-b5ff-b449389c7f91 req-597ffb02-ed16-4f7b-b1ed-ed18f2291c09 service nova] Releasing lock "refresh_cache-9c447082-b59b-4c8e-8fa0-bf6599a84e91" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:34:55 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e02c80-f626-4918-93f1-6b9a7f778c7a/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:34:55 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74960) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 12:34:55 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk.rescue --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:34:55 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:34:55 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk.rescue --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:34:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:34:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:34:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:34:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:34:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:34:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7b95c0-3726-4a1c-a384-ec91abf75225/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:34:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7b95c0-3726-4a1c-a384-ec91abf75225/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:34:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7b95c0-3726-4a1c-a384-ec91abf75225/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:34:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7b95c0-3726-4a1c-a384-ec91abf75225/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:34:56 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74960) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 12:34:56 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74960) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 12:34:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7606a55-d5c3-4ba8-b499-f3c70813f151/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:34:57 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7606a55-d5c3-4ba8-b499-f3c70813f151/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:34:57 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7606a55-d5c3-4ba8-b499-f3c70813f151/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:34:57 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7606a55-d5c3-4ba8-b499-f3c70813f151/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:34:57 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:34:57 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:34:57 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Hypervisor/Node resource view: name=user free_ram=7759MB free_disk=24.922874450683594GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74960) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 12:34:57 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:34:57 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:34:57 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:34:57 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 87f15f5f-8afa-4d7b-bb45-5887184f9ee5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:34:57 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance a6199681-f85e-4f55-966b-6ab3f17cd640 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:34:57 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 5b7b95c0-3726-4a1c-a384-ec91abf75225 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:34:57 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 35e02c80-f626-4918-93f1-6b9a7f778c7a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:34:57 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:34:57 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:34:57 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 9c447082-b59b-4c8e-8fa0-bf6599a84e91 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:34:57 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 12ae6707-c1c6-4bc2-a409-67cea64fc2c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:34:57 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance b7606a55-d5c3-4ba8-b499-f3c70813f151 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:34:57 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 03 12:34:57 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74960) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 12:34:57 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74960) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 12:34:58 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:34:58 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:34:58 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Compute_service record updated for user:user {{(pid=74960) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 12:34:58 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.626s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:34:58 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:34:59 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:34:59 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:34:59 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:34:59 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:34:59 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74960) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 12:34:59 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:35:00 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:35:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:35:01 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-53804013-af3e-42d9-b890-9a9c3683ae58 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] Acquiring lock "9c447082-b59b-4c8e-8fa0-bf6599a84e91" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:35:01 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-53804013-af3e-42d9-b890-9a9c3683ae58 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] Lock "9c447082-b59b-4c8e-8fa0-bf6599a84e91" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:35:01 user nova-compute[74960]: DEBUG nova.objects.instance [None req-53804013-af3e-42d9-b890-9a9c3683ae58 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] Lazy-loading 'flavor' on Instance uuid 9c447082-b59b-4c8e-8fa0-bf6599a84e91 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:35:01 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-53804013-af3e-42d9-b890-9a9c3683ae58 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] Lock "9c447082-b59b-4c8e-8fa0-bf6599a84e91" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.150s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:35:02 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-53804013-af3e-42d9-b890-9a9c3683ae58 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] Acquiring lock "9c447082-b59b-4c8e-8fa0-bf6599a84e91" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:35:02 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-53804013-af3e-42d9-b890-9a9c3683ae58 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] Lock "9c447082-b59b-4c8e-8fa0-bf6599a84e91" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:35:02 user nova-compute[74960]: INFO nova.compute.manager [None req-53804013-af3e-42d9-b890-9a9c3683ae58 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] [instance: 9c447082-b59b-4c8e-8fa0-bf6599a84e91] Attaching volume 7bd46dc3-8710-4ce9-9e02-3d6c442fb90c to /dev/vdb
Nov 03 12:35:02 user nova-compute[74960]: DEBUG os_brick.utils [None req-53804013-af3e-42d9-b890-9a9c3683ae58 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:35:02 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:35:02 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:35:02 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c39c12b-158f-4451-b284-1412d6e68b59]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:75b8e219756\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:35:02 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:35:02 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:35:02 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d5a8470-e0df-4d0f-86d7-354074b7d823]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:35:02 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:35:02 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:35:02 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee5324d3-80e8-4c52-a58b-1acdbe9f64e1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:35:02 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8a82667-aa35-4660-bb0d-8898c7219364]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:35:02 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-53804013-af3e-42d9-b890-9a9c3683ae58 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] Running cmd (subprocess): nvme version {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:35:02 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-53804013-af3e-42d9-b890-9a9c3683ae58 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] 'nvme version' failed. Not Retrying. {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 12:35:02 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.nvmeof [None req-53804013-af3e-42d9-b890-9a9c3683ae58 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] nvme not present on system {{(pid=74960) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 12:35:02 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:35:02 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 12:35:02 user nova-compute[74960]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 12:35:02 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a67f5f9-0a9b-4f23-abcb-565f8c47939a]: (4, '') {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:35:02 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-53804013-af3e-42d9-b890-9a9c3683ae58 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74960) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 12:35:02 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-53804013-af3e-42d9-b890-9a9c3683ae58 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74960) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 12:35:02 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-53804013-af3e-42d9-b890-9a9c3683ae58 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] LIGHTOS: no hostnqn found. {{(pid=74960) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 12:35:02 user nova-compute[74960]: DEBUG os_brick.utils [None req-53804013-af3e-42d9-b890-9a9c3683ae58 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:75b8e219756', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:35:02 user nova-compute[74960]: DEBUG nova.virt.block_device [None req-53804013-af3e-42d9-b890-9a9c3683ae58 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] [instance: 9c447082-b59b-4c8e-8fa0-bf6599a84e91] Updating existing volume attachment record: 178c8814-28cd-45a7-9a04-3777d7dff3ed {{(pid=74960) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 12:35:03 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:35:04 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:35:05 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-d43b0a40-f720-47c9-a8b7-c0d9e5805c45 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:35:05 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-d43b0a40-f720-47c9-a8b7-c0d9e5805c45 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:35:05 user nova-compute[74960]: DEBUG nova.objects.instance [None req-d43b0a40-f720-47c9-a8b7-c0d9e5805c45 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Lazy-loading 'pci_requests' on Instance uuid 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:35:05 user nova-compute[74960]: DEBUG nova.objects.instance [None req-d43b0a40-f720-47c9-a8b7-c0d9e5805c45 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Lazy-loading 'numa_topology' on Instance uuid 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:35:05 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-d43b0a40-f720-47c9-a8b7-c0d9e5805c45 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74960) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 12:35:05 user nova-compute[74960]: INFO nova.compute.claims [None req-d43b0a40-f720-47c9-a8b7-c0d9e5805c45 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] Claim successful on node user
Nov 03 12:35:05 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-d43b0a40-f720-47c9-a8b7-c0d9e5805c45 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:35:05 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-d43b0a40-f720-47c9-a8b7-c0d9e5805c45 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:35:05 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-d43b0a40-f720-47c9-a8b7-c0d9e5805c45 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.409s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:35:05 user nova-compute[74960]: INFO nova.network.neutron [None req-d43b0a40-f720-47c9-a8b7-c0d9e5805c45 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] Updating port fe22f17b-b60c-465a-9079-e9c008004741 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 03 12:35:06 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-d43b0a40-f720-47c9-a8b7-c0d9e5805c45 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Acquiring lock "refresh_cache-5dc6cb24-fe58-4e36-bd7f-a67a804a98e1" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:35:06 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-d43b0a40-f720-47c9-a8b7-c0d9e5805c45 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Acquired lock "refresh_cache-5dc6cb24-fe58-4e36-bd7f-a67a804a98e1" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:35:06 user nova-compute[74960]: DEBUG nova.network.neutron [None req-d43b0a40-f720-47c9-a8b7-c0d9e5805c45 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] Building network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 12:35:06 user nova-compute[74960]: DEBUG nova.compute.manager [req-902e3009-ef11-4682-9dfe-d3ab0cd66a3c req-0a975736-df52-4a3d-b0e0-d04c7355b297 service nova] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] Received event network-changed-fe22f17b-b60c-465a-9079-e9c008004741 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:35:06 user nova-compute[74960]: DEBUG nova.compute.manager [req-902e3009-ef11-4682-9dfe-d3ab0cd66a3c req-0a975736-df52-4a3d-b0e0-d04c7355b297 service nova] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] Refreshing instance network info cache due to event network-changed-fe22f17b-b60c-465a-9079-e9c008004741. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 12:35:06 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-902e3009-ef11-4682-9dfe-d3ab0cd66a3c req-0a975736-df52-4a3d-b0e0-d04c7355b297 service nova] Acquiring lock "refresh_cache-5dc6cb24-fe58-4e36-bd7f-a67a804a98e1" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:35:06 user nova-compute[74960]: DEBUG nova.network.neutron [None req-d43b0a40-f720-47c9-a8b7-c0d9e5805c45 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] Updating instance_info_cache with network_info: [{"id": "fe22f17b-b60c-465a-9079-e9c008004741", "address": "fa:16:3e:cd:e4:ff", "network": {"id": "a356b90b-cf10-4b3f-802a-aa2656c5588b", "bridge": "br-int", "label": "tempest-TestShelveInstance-1788680557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b44956ba8ca42f29fda6a18ef9fb198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe22f17b-b6", "ovs_interfaceid": "fe22f17b-b60c-465a-9079-e9c008004741", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:35:07 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-d43b0a40-f720-47c9-a8b7-c0d9e5805c45 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Releasing lock "refresh_cache-5dc6cb24-fe58-4e36-bd7f-a67a804a98e1" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:35:07 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-d43b0a40-f720-47c9-a8b7-c0d9e5805c45 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] Creating instance directory {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 12:35:07 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-d43b0a40-f720-47c9-a8b7-c0d9e5805c45 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] Creating image(s)
Nov 03 12:35:07 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-d43b0a40-f720-47c9-a8b7-c0d9e5805c45 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] Did not create local disks {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 03 12:35:07 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-d43b0a40-f720-47c9-a8b7-c0d9e5805c45 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] Ensure instance console log exists: /opt/stack/data/nova/instances/5dc6cb24-fe58-4e36-bd7f-a67a804a98e1/console.log {{(pid=74960) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 12:35:07 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-d43b0a40-f720-47c9-a8b7-c0d9e5805c45 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:35:07 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-d43b0a40-f720-47c9-a8b7-c0d9e5805c45 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:35:07 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-d43b0a40-f720-47c9-a8b7-c0d9e5805c45 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:35:07 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-d43b0a40-f720-47c9-a8b7-c0d9e5805c45 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] Start _get_guest_xml network_info=[{"id": "fe22f17b-b60c-465a-9079-e9c008004741", "address": "fa:16:3e:cd:e4:ff", "network": {"id": "a356b90b-cf10-4b3f-802a-aa2656c5588b", "bridge": "br-int", "label": "tempest-TestShelveInstance-1788680557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b44956ba8ca42f29fda6a18ef9fb198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe22f17b-b6", "ovs_interfaceid": "fe22f17b-b60c-465a-9079-e9c008004741", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sPdXleCb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5dc6cb24-fe58-4e36-bd7f-a67a804a98e1', 'attached_at': '', 'detached_at': '', 'volume_id': 'fa4cf8d2-7542-4bcf-840d-5ccc3401a797', 'serial': 'fa4cf8d2-7542-4bcf-840d-5ccc3401a797'}, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'device_type': 'disk', 'attachment_id': 'f6a02f6f-27db-412d-af78-19c1b90c8fcc', 'boot_index': 0, 'guest_format': None, 'volume_type': None} {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 12:35:07 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-902e3009-ef11-4682-9dfe-d3ab0cd66a3c req-0a975736-df52-4a3d-b0e0-d04c7355b297 service nova] Acquired lock "refresh_cache-5dc6cb24-fe58-4e36-bd7f-a67a804a98e1" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:35:07 user nova-compute[74960]: DEBUG nova.network.neutron [req-902e3009-ef11-4682-9dfe-d3ab0cd66a3c req-0a975736-df52-4a3d-b0e0-d04c7355b297 service nova] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] Refreshing network info cache for port fe22f17b-b60c-465a-9079-e9c008004741 {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 12:35:07 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-d43b0a40-f720-47c9-a8b7-c0d9e5805c45 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:35:07 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-d43b0a40-f720-47c9-a8b7-c0d9e5805c45 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:35:07 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-d43b0a40-f720-47c9-a8b7-c0d9e5805c45 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 12:35:07 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-d43b0a40-f720-47c9-a8b7-c0d9e5805c45 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] CPU controller missing on host. {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 12:35:07 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-d43b0a40-f720-47c9-a8b7-c0d9e5805c45 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 12:35:07 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-d43b0a40-f720-47c9-a8b7-c0d9e5805c45 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] CPU controller found on host. {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 12:35:07 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-d43b0a40-f720-47c9-a8b7-c0d9e5805c45 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74960) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 12:35:07 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-d43b0a40-f720-47c9-a8b7-c0d9e5805c45 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 12:35:07 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-d43b0a40-f720-47c9-a8b7-c0d9e5805c45 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Flavor limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 12:35:07 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-d43b0a40-f720-47c9-a8b7-c0d9e5805c45 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Image limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 12:35:07 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-d43b0a40-f720-47c9-a8b7-c0d9e5805c45 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Flavor pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 12:35:07 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-d43b0a40-f720-47c9-a8b7-c0d9e5805c45 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Image pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 12:35:07 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-d43b0a40-f720-47c9-a8b7-c0d9e5805c45 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 12:35:07 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-d43b0a40-f720-47c9-a8b7-c0d9e5805c45 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 12:35:07 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-d43b0a40-f720-47c9-a8b7-c0d9e5805c45 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 12:35:07 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-d43b0a40-f720-47c9-a8b7-c0d9e5805c45 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Got 1 possible topologies {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 12:35:07 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-d43b0a40-f720-47c9-a8b7-c0d9e5805c45 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 12:35:07 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-d43b0a40-f720-47c9-a8b7-c0d9e5805c45 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 12:35:07 user nova-compute[74960]: DEBUG nova.objects.instance [None req-d43b0a40-f720-47c9-a8b7-c0d9e5805c45 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:35:07 user nova-compute[74960]: DEBUG nova.objects.base [None req-d43b0a40-f720-47c9-a8b7-c0d9e5805c45 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Object Instance<5dc6cb24-fe58-4e36-bd7f-a67a804a98e1> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=74960) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 12:35:07 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d43b0a40-f720-47c9-a8b7-c0d9e5805c45 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] Calling os-brick to attach iSCSI Volume {{(pid=74960) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 12:35:07 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-d43b0a40-f720-47c9-a8b7-c0d9e5805c45 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9aa420acb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sPdXleCb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:35:07 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-d43b0a40-f720-47c9-a8b7-c0d9e5805c45 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:35:07 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-d43b0a40-f720-47c9-a8b7-c0d9e5805c45 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:35:07 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-d43b0a40-f720-47c9-a8b7-c0d9e5805c45 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:35:07 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-d43b0a40-f720-47c9-a8b7-c0d9e5805c45 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:35:07 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-d43b0a40-f720-47c9-a8b7-c0d9e5805c45 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:35:07 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-d43b0a40-f720-47c9-a8b7-c0d9e5805c45 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:35:07 user nova-compute[74960]: INFO os_brick.initiator.connectors.iscsi [None req-d43b0a40-f720-47c9-a8b7-c0d9e5805c45 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 12:35:07 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797 -p 172.16.0.220:3260 {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:35:07 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:35:07 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c17d89d-c00c-42bf-ae6b-d96c66abac33]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:35:07 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-d43b0a40-f720-47c9-a8b7-c0d9e5805c45 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 12:35:07 user nova-compute[74960]:  {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:35:07 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797 -p 172.16.0.220:3260 --interface default --op new {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:35:07 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:35:07 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d87a100-3295-411e-9999-79b6aebb86aa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797] added\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:35:07 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-d43b0a40-f720-47c9-a8b7-c0d9e5805c45 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797] added
Nov 03 12:35:07 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:35:07 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:35:07 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:35:07 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f2b8ef9-9d75-4ad9-aa0e-65d26b8089f6]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:35:07 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-d43b0a40-f720-47c9-a8b7-c0d9e5805c45 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:35:07 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:35:07 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:35:07 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[a93ae070-e251-467b-80d9-12d569a45833]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:35:07 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-d43b0a40-f720-47c9-a8b7-c0d9e5805c45 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:35:07 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sPdXleCb {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:35:07 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sPdXleCb" returned: 0 in 0.023s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:35:07 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[7939aeed-f93c-434b-a2a7-d0864df60aaa]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:35:07 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-d43b0a40-f720-47c9-a8b7-c0d9e5805c45 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sPdXleCb'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:35:07 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:35:07 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.032s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:35:07 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4a9418b-3e47-43dc-9463-aaa5fdbbfc97]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:35:07 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-d43b0a40-f720-47c9-a8b7-c0d9e5805c45 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:35:07 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:35:07 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:35:07 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[c914ee2f-b299-4a0e-a3b7-50a100f5cf61]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7da48309-69f9-407d-81b1-9bd9aea03cd0 (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:35:07 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-d43b0a40-f720-47c9-a8b7-c0d9e5805c45 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:35:07 user nova-compute[74960]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 (non-flash)
Nov 03 12:35:07 user nova-compute[74960]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7da48309-69f9-407d-81b1-9bd9aea03cd0 (non-flash)
Nov 03 12:35:07 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:35:07 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-d43b0a40-f720-47c9-a8b7-c0d9e5805c45 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:35:07 user nova-compute[74960]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 (non-flash)
Nov 03 12:35:07 user nova-compute[74960]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7da48309-69f9-407d-81b1-9bd9aea03cd0 (non-flash)
Nov 03 12:35:07 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:35:07 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797 -p 172.16.0.220:3260 --login {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:35:07 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:35:07 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[28729a37-00a4-4fd3-b3ce-14f462e6352a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:35:07 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-d43b0a40-f720-47c9-a8b7-c0d9e5805c45 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797, portal: 172.16.0.220,3260]
Nov 03 12:35:07 user nova-compute[74960]: Login to [iface: default, target: iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797, portal: 172.16.0.220,3260] successful.
Nov 03 12:35:07 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:35:07 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:35:07 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:35:07 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f5f3ef9-8fb0-45b4-bda0-4f94bd3ee642]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:35:07 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-d43b0a40-f720-47c9-a8b7-c0d9e5805c45 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:35:07 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:35:07 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:35:07 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c4a0caf-b74f-4467-b360-7ea83c5a3716]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7da48309-69f9-407d-81b1-9bd9aea03cd0 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797 (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:35:07 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-d43b0a40-f720-47c9-a8b7-c0d9e5805c45 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:35:07 user nova-compute[74960]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 (non-flash)
Nov 03 12:35:07 user nova-compute[74960]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7da48309-69f9-407d-81b1-9bd9aea03cd0 (non-flash)
Nov 03 12:35:07 user nova-compute[74960]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797 (non-flash)
Nov 03 12:35:07 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:35:07 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-d43b0a40-f720-47c9-a8b7-c0d9e5805c45 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:35:07 user nova-compute[74960]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 (non-flash)
Nov 03 12:35:07 user nova-compute[74960]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7da48309-69f9-407d-81b1-9bd9aea03cd0 (non-flash)
Nov 03 12:35:07 user nova-compute[74960]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797 (non-flash)
Nov 03 12:35:07 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:35:07 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-d43b0a40-f720-47c9-a8b7-c0d9e5805c45 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.306s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:35:07 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-d43b0a40-f720-47c9-a8b7-c0d9e5805c45 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Connected to 172.16.0.220:3260 {{(pid=74960) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 12:35:07 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-d43b0a40-f720-47c9-a8b7-c0d9e5805c45 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] HCTL ('36', '-', '-', 0) found on session 27 with lun 0 {{(pid=74960) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 12:35:07 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-d43b0a40-f720-47c9-a8b7-c0d9e5805c45 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74960) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 12:35:07 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:35:07 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:35:07 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[efbce064-6c19-40b1-a7bc-b6d44ec26dcf]: (4, ('- - 0', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:35:07 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-d43b0a40-f720-47c9-a8b7-c0d9e5805c45 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Searching for a device in session 27 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74960) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 12:35:07 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-d43b0a40-f720-47c9-a8b7-c0d9e5805c45 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sPdXleCb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74960) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 12:35:07 user nova-compute[74960]: DEBUG nova.network.neutron [req-902e3009-ef11-4682-9dfe-d3ab0cd66a3c req-0a975736-df52-4a3d-b0e0-d04c7355b297 service nova] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] Updated VIF entry in instance network info cache for port fe22f17b-b60c-465a-9079-e9c008004741. {{(pid=74960) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 12:35:07 user nova-compute[74960]: DEBUG nova.network.neutron [req-902e3009-ef11-4682-9dfe-d3ab0cd66a3c req-0a975736-df52-4a3d-b0e0-d04c7355b297 service nova] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] Updating instance_info_cache with network_info: [{"id": "fe22f17b-b60c-465a-9079-e9c008004741", "address": "fa:16:3e:cd:e4:ff", "network": {"id": "a356b90b-cf10-4b3f-802a-aa2656c5588b", "bridge": "br-int", "label": "tempest-TestShelveInstance-1788680557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b44956ba8ca42f29fda6a18ef9fb198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe22f17b-b6", "ovs_interfaceid": "fe22f17b-b60c-465a-9079-e9c008004741", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:35:07 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-902e3009-ef11-4682-9dfe-d3ab0cd66a3c req-0a975736-df52-4a3d-b0e0-d04c7355b297 service nova] Releasing lock "refresh_cache-5dc6cb24-fe58-4e36-bd7f-a67a804a98e1" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:35:08 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-d43b0a40-f720-47c9-a8b7-c0d9e5805c45 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:35:08 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-d43b0a40-f720-47c9-a8b7-c0d9e5805c45 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] <== connect_volume: return (1341ms) {'type': 'block', 'scsi_wwn': '26331373239393364', 'path': '/dev/sde'} {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:35:08 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d43b0a40-f720-47c9-a8b7-c0d9e5805c45 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26331373239393364', 'path': '/dev/sde'} {{(pid=74960) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 12:35:08 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:35:08 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-d43b0a40-f720-47c9-a8b7-c0d9e5805c45 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-03T12:30:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1397605353',display_name='tempest-TestShelveInstance-server-1397605353',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1397605353',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-208551886',keypairs=<?>,launch_index=0,launched_at=2023-11-03T12:31:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='3b44956ba8ca42f29fda6a18ef9fb198',ramdisk_id='',reservation_id='r-ait87mp2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1884052938',owner_user_name='tempest-TestShelveInstance-1884052938-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T12:34:37Z,user_data=None,user_id='0e7c95f83f104c0697236508cd538c3e',uuid=5dc6cb24-fe58-4e36-bd7f-a67a804a98e1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "fe22f17b-b60c-465a-9079-e9c008004741", "address": "fa:16:3e:cd:e4:ff", "network": {"id": "a356b90b-cf10-4b3f-802a-aa2656c5588b", "bridge": "br-int", "label": "tempest-TestShelveInstance-1788680557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b44956ba8ca42f29fda6a18ef9fb198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe22f17b-b6", "ovs_interfaceid": "fe22f17b-b60c-465a-9079-e9c008004741", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74960) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 12:35:08 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-d43b0a40-f720-47c9-a8b7-c0d9e5805c45 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Converting VIF {"id": "fe22f17b-b60c-465a-9079-e9c008004741", "address": "fa:16:3e:cd:e4:ff", "network": {"id": "a356b90b-cf10-4b3f-802a-aa2656c5588b", "bridge": "br-int", "label": "tempest-TestShelveInstance-1788680557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b44956ba8ca42f29fda6a18ef9fb198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe22f17b-b6", "ovs_interfaceid": "fe22f17b-b60c-465a-9079-e9c008004741", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:35:08 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-d43b0a40-f720-47c9-a8b7-c0d9e5805c45 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:e4:ff,bridge_name='br-int',has_traffic_filtering=True,id=fe22f17b-b60c-465a-9079-e9c008004741,network=Network(a356b90b-cf10-4b3f-802a-aa2656c5588b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe22f17b-b6') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:35:08 user nova-compute[74960]: DEBUG nova.objects.instance [None req-d43b0a40-f720-47c9-a8b7-c0d9e5805c45 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Lazy-loading 'pci_devices' on Instance uuid 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:35:08 user nova-compute[74960]: DEBUG nova.objects.base [None req-d43b0a40-f720-47c9-a8b7-c0d9e5805c45 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Object Instance<5dc6cb24-fe58-4e36-bd7f-a67a804a98e1> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=74960) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 12:35:08 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-d43b0a40-f720-47c9-a8b7-c0d9e5805c45 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] End _get_guest_xml xml=<domain type="kvm">
Nov 03 12:35:08 user nova-compute[74960]:   <uuid>5dc6cb24-fe58-4e36-bd7f-a67a804a98e1</uuid>
Nov 03 12:35:08 user nova-compute[74960]:   <name>instance-0000001d</name>
Nov 03 12:35:08 user nova-compute[74960]:   <memory>524288</memory>
Nov 03 12:35:08 user nova-compute[74960]:   <vcpu>1</vcpu>
Nov 03 12:35:08 user nova-compute[74960]:   <metadata>
Nov 03 12:35:08 user nova-compute[74960]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 12:35:08 user nova-compute[74960]:       <nova:package version="0.0.0"/>
Nov 03 12:35:08 user nova-compute[74960]:       <nova:name>tempest-TestShelveInstance-server-1397605353</nova:name>
Nov 03 12:35:08 user nova-compute[74960]:       <nova:creationTime>2023-11-03 12:35:07</nova:creationTime>
Nov 03 12:35:08 user nova-compute[74960]:       <nova:flavor name="m1.tiny">
Nov 03 12:35:08 user nova-compute[74960]:         <nova:memory>512</nova:memory>
Nov 03 12:35:08 user nova-compute[74960]:         <nova:disk>1</nova:disk>
Nov 03 12:35:08 user nova-compute[74960]:         <nova:swap>0</nova:swap>
Nov 03 12:35:08 user nova-compute[74960]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 12:35:08 user nova-compute[74960]:         <nova:vcpus>1</nova:vcpus>
Nov 03 12:35:08 user nova-compute[74960]:       </nova:flavor>
Nov 03 12:35:08 user nova-compute[74960]:       <nova:owner>
Nov 03 12:35:08 user nova-compute[74960]:         <nova:user uuid="0e7c95f83f104c0697236508cd538c3e">tempest-TestShelveInstance-1884052938-project-member</nova:user>
Nov 03 12:35:08 user nova-compute[74960]:         <nova:project uuid="3b44956ba8ca42f29fda6a18ef9fb198">tempest-TestShelveInstance-1884052938</nova:project>
Nov 03 12:35:08 user nova-compute[74960]:       </nova:owner>
Nov 03 12:35:08 user nova-compute[74960]:       <nova:ports>
Nov 03 12:35:08 user nova-compute[74960]:         <nova:port uuid="fe22f17b-b60c-465a-9079-e9c008004741">
Nov 03 12:35:08 user nova-compute[74960]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 03 12:35:08 user nova-compute[74960]:         </nova:port>
Nov 03 12:35:08 user nova-compute[74960]:       </nova:ports>
Nov 03 12:35:08 user nova-compute[74960]:     </nova:instance>
Nov 03 12:35:08 user nova-compute[74960]:   </metadata>
Nov 03 12:35:08 user nova-compute[74960]:   <sysinfo type="smbios">
Nov 03 12:35:08 user nova-compute[74960]:     <system>
Nov 03 12:35:08 user nova-compute[74960]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 12:35:08 user nova-compute[74960]:       <entry name="product">OpenStack Nova</entry>
Nov 03 12:35:08 user nova-compute[74960]:       <entry name="version">0.0.0</entry>
Nov 03 12:35:08 user nova-compute[74960]:       <entry name="serial">5dc6cb24-fe58-4e36-bd7f-a67a804a98e1</entry>
Nov 03 12:35:08 user nova-compute[74960]:       <entry name="uuid">5dc6cb24-fe58-4e36-bd7f-a67a804a98e1</entry>
Nov 03 12:35:08 user nova-compute[74960]:       <entry name="family">Virtual Machine</entry>
Nov 03 12:35:08 user nova-compute[74960]:     </system>
Nov 03 12:35:08 user nova-compute[74960]:   </sysinfo>
Nov 03 12:35:08 user nova-compute[74960]:   <os>
Nov 03 12:35:08 user nova-compute[74960]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 12:35:08 user nova-compute[74960]:     <boot dev="hd"/>
Nov 03 12:35:08 user nova-compute[74960]:     <smbios mode="sysinfo"/>
Nov 03 12:35:08 user nova-compute[74960]:   </os>
Nov 03 12:35:08 user nova-compute[74960]:   <features>
Nov 03 12:35:08 user nova-compute[74960]:     <acpi/>
Nov 03 12:35:08 user nova-compute[74960]:     <apic/>
Nov 03 12:35:08 user nova-compute[74960]:     <vmcoreinfo/>
Nov 03 12:35:08 user nova-compute[74960]:   </features>
Nov 03 12:35:08 user nova-compute[74960]:   <clock offset="utc">
Nov 03 12:35:08 user nova-compute[74960]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 12:35:08 user nova-compute[74960]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 12:35:08 user nova-compute[74960]:     <timer name="hpet" present="no"/>
Nov 03 12:35:08 user nova-compute[74960]:   </clock>
Nov 03 12:35:08 user nova-compute[74960]:   <cpu mode="custom" match="exact">
Nov 03 12:35:08 user nova-compute[74960]:     <model>Nehalem</model>
Nov 03 12:35:08 user nova-compute[74960]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 12:35:08 user nova-compute[74960]:   </cpu>
Nov 03 12:35:08 user nova-compute[74960]:   <devices>
Nov 03 12:35:08 user nova-compute[74960]:     <disk type="block" device="disk">
Nov 03 12:35:08 user nova-compute[74960]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 12:35:08 user nova-compute[74960]:       <source dev="/dev/sde"/>
Nov 03 12:35:08 user nova-compute[74960]:       <target dev="vda" bus="virtio"/>
Nov 03 12:35:08 user nova-compute[74960]:       <serial>fa4cf8d2-7542-4bcf-840d-5ccc3401a797</serial>
Nov 03 12:35:08 user nova-compute[74960]:     </disk>
Nov 03 12:35:08 user nova-compute[74960]:     <interface type="ethernet">
Nov 03 12:35:08 user nova-compute[74960]:       <mac address="fa:16:3e:cd:e4:ff"/>
Nov 03 12:35:08 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:35:08 user nova-compute[74960]:       <mtu size="1442"/>
Nov 03 12:35:08 user nova-compute[74960]:       <target dev="tapfe22f17b-b6"/>
Nov 03 12:35:08 user nova-compute[74960]:     </interface>
Nov 03 12:35:08 user nova-compute[74960]:     <serial type="pty">
Nov 03 12:35:08 user nova-compute[74960]:       <log file="/opt/stack/data/nova/instances/5dc6cb24-fe58-4e36-bd7f-a67a804a98e1/console.log" append="off"/>
Nov 03 12:35:08 user nova-compute[74960]:     </serial>
Nov 03 12:35:08 user nova-compute[74960]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 12:35:08 user nova-compute[74960]:     <video>
Nov 03 12:35:08 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:35:08 user nova-compute[74960]:     </video>
Nov 03 12:35:08 user nova-compute[74960]:     <rng model="virtio">
Nov 03 12:35:08 user nova-compute[74960]:       <backend model="random">/dev/urandom</backend>
Nov 03 12:35:08 user nova-compute[74960]:     </rng>
Nov 03 12:35:08 user nova-compute[74960]:     <controller type="usb" index="0" model="none"/>
Nov 03 12:35:08 user nova-compute[74960]:     <memballoon model="virtio">
Nov 03 12:35:08 user nova-compute[74960]:       <stats period="10"/>
Nov 03 12:35:08 user nova-compute[74960]:     </memballoon>
Nov 03 12:35:08 user nova-compute[74960]:   </devices>
Nov 03 12:35:08 user nova-compute[74960]: </domain>
Nov 03 12:35:08 user nova-compute[74960]:  {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 12:35:08 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-d43b0a40-f720-47c9-a8b7-c0d9e5805c45 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-03T12:30:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1397605353',display_name='tempest-TestShelveInstance-server-1397605353',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1397605353',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-208551886',keypairs=<?>,launch_index=0,launched_at=2023-11-03T12:31:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='3b44956ba8ca42f29fda6a18ef9fb198',ramdisk_id='',reservation_id='r-ait87mp2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1884052938',owner_user_name='tempest-TestShelveInstance-1884052938-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T12:34:37Z,user_data=None,user_id='0e7c95f83f104c0697236508cd538c3e',uuid=5dc6cb24-fe58-4e36-bd7f-a67a804a98e1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "fe22f17b-b60c-465a-9079-e9c008004741", "address": "fa:16:3e:cd:e4:ff", "network": {"id": "a356b90b-cf10-4b3f-802a-aa2656c5588b", "bridge": "br-int", "label": "tempest-TestShelveInstance-1788680557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b44956ba8ca42f29fda6a18ef9fb198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe22f17b-b6", "ovs_interfaceid": "fe22f17b-b60c-465a-9079-e9c008004741", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 12:35:08 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-d43b0a40-f720-47c9-a8b7-c0d9e5805c45 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Converting VIF {"id": "fe22f17b-b60c-465a-9079-e9c008004741", "address": "fa:16:3e:cd:e4:ff", "network": {"id": "a356b90b-cf10-4b3f-802a-aa2656c5588b", "bridge": "br-int", "label": "tempest-TestShelveInstance-1788680557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b44956ba8ca42f29fda6a18ef9fb198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe22f17b-b6", "ovs_interfaceid": "fe22f17b-b60c-465a-9079-e9c008004741", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:35:08 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-d43b0a40-f720-47c9-a8b7-c0d9e5805c45 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:e4:ff,bridge_name='br-int',has_traffic_filtering=True,id=fe22f17b-b60c-465a-9079-e9c008004741,network=Network(a356b90b-cf10-4b3f-802a-aa2656c5588b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe22f17b-b6') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:35:08 user nova-compute[74960]: DEBUG os_vif [None req-d43b0a40-f720-47c9-a8b7-c0d9e5805c45 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:e4:ff,bridge_name='br-int',has_traffic_filtering=True,id=fe22f17b-b60c-465a-9079-e9c008004741,network=Network(a356b90b-cf10-4b3f-802a-aa2656c5588b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe22f17b-b6') {{(pid=74960) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 12:35:08 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:35:08 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:35:08 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 12:35:08 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:35:08 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b061b02d-01dc-5c6f-8490-fcbc052be9b0', '_type': 'linux-noop'}}, row=False) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:35:08 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:35:08 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:35:08 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:35:08 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:35:08 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfe22f17b-b6, may_exist=True, interface_attrs={}) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:35:08 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfe22f17b-b6, col_values=(('qos', UUID('9bcc4dd2-6e7b-402e-8528-8bc8bfcd10cb')),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:35:08 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfe22f17b-b6, col_values=(('external_ids', {'iface-id': 'fe22f17b-b60c-465a-9079-e9c008004741', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cd:e4:ff', 'vm-uuid': '5dc6cb24-fe58-4e36-bd7f-a67a804a98e1'}),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:35:08 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:35:08 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:35:08 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:35:08 user nova-compute[74960]: INFO os_vif [None req-d43b0a40-f720-47c9-a8b7-c0d9e5805c45 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:e4:ff,bridge_name='br-int',has_traffic_filtering=True,id=fe22f17b-b60c-465a-9079-e9c008004741,network=Network(a356b90b-cf10-4b3f-802a-aa2656c5588b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe22f17b-b6')
Nov 03 12:35:08 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-d43b0a40-f720-47c9-a8b7-c0d9e5805c45 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] No BDM found with device name vda, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:35:08 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-d43b0a40-f720-47c9-a8b7-c0d9e5805c45 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] No VIF found with MAC fa:16:3e:cd:e4:ff, not building metadata {{(pid=74960) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 12:35:10 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:35:10 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:35:10 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:35:10 user nova-compute[74960]: DEBUG nova.compute.manager [req-a1dd461c-0e6a-4630-82c5-ae2e92087537 req-159e6e50-3998-48b2-87ba-78b9661654ea service nova] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] Received event network-vif-plugged-fe22f17b-b60c-465a-9079-e9c008004741 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:35:10 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-a1dd461c-0e6a-4630-82c5-ae2e92087537 req-159e6e50-3998-48b2-87ba-78b9661654ea service nova] Acquiring lock "5dc6cb24-fe58-4e36-bd7f-a67a804a98e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:35:10 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-a1dd461c-0e6a-4630-82c5-ae2e92087537 req-159e6e50-3998-48b2-87ba-78b9661654ea service nova] Lock "5dc6cb24-fe58-4e36-bd7f-a67a804a98e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:35:10 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-a1dd461c-0e6a-4630-82c5-ae2e92087537 req-159e6e50-3998-48b2-87ba-78b9661654ea service nova] Lock "5dc6cb24-fe58-4e36-bd7f-a67a804a98e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:35:10 user nova-compute[74960]: DEBUG nova.compute.manager [req-a1dd461c-0e6a-4630-82c5-ae2e92087537 req-159e6e50-3998-48b2-87ba-78b9661654ea service nova] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] No waiting events found dispatching network-vif-plugged-fe22f17b-b60c-465a-9079-e9c008004741 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:35:10 user nova-compute[74960]: WARNING nova.compute.manager [req-a1dd461c-0e6a-4630-82c5-ae2e92087537 req-159e6e50-3998-48b2-87ba-78b9661654ea service nova] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] Received unexpected event network-vif-plugged-fe22f17b-b60c-465a-9079-e9c008004741 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 03 12:35:10 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:35:10 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:35:10 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:35:10 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:35:12 user nova-compute[74960]: DEBUG nova.compute.manager [None req-d43b0a40-f720-47c9-a8b7-c0d9e5805c45 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] Instance event wait completed in 0 seconds for  {{(pid=74960) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 12:35:12 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-d43b0a40-f720-47c9-a8b7-c0d9e5805c45 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] Guest created on hypervisor {{(pid=74960) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 12:35:12 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] Instance spawned successfully.
Nov 03 12:35:12 user nova-compute[74960]: DEBUG nova.compute.manager [None req-d43b0a40-f720-47c9-a8b7-c0d9e5805c45 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] Checking state {{(pid=74960) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 12:35:12 user nova-compute[74960]: DEBUG nova.compute.manager [req-90dc679d-6711-4d96-b15b-44838fa43e1c req-bd998ad9-83fb-4d57-8238-e19fb3ca8894 service nova] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] Received event network-vif-plugged-fe22f17b-b60c-465a-9079-e9c008004741 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:35:12 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-90dc679d-6711-4d96-b15b-44838fa43e1c req-bd998ad9-83fb-4d57-8238-e19fb3ca8894 service nova] Acquiring lock "5dc6cb24-fe58-4e36-bd7f-a67a804a98e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:35:12 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-90dc679d-6711-4d96-b15b-44838fa43e1c req-bd998ad9-83fb-4d57-8238-e19fb3ca8894 service nova] Lock "5dc6cb24-fe58-4e36-bd7f-a67a804a98e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:35:12 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-90dc679d-6711-4d96-b15b-44838fa43e1c req-bd998ad9-83fb-4d57-8238-e19fb3ca8894 service nova] Lock "5dc6cb24-fe58-4e36-bd7f-a67a804a98e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:35:12 user nova-compute[74960]: DEBUG nova.compute.manager [req-90dc679d-6711-4d96-b15b-44838fa43e1c req-bd998ad9-83fb-4d57-8238-e19fb3ca8894 service nova] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] No waiting events found dispatching network-vif-plugged-fe22f17b-b60c-465a-9079-e9c008004741 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:35:12 user nova-compute[74960]: WARNING nova.compute.manager [req-90dc679d-6711-4d96-b15b-44838fa43e1c req-bd998ad9-83fb-4d57-8238-e19fb3ca8894 service nova] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] Received unexpected event network-vif-plugged-fe22f17b-b60c-465a-9079-e9c008004741 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 03 12:35:12 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-d43b0a40-f720-47c9-a8b7-c0d9e5805c45 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Lock "5dc6cb24-fe58-4e36-bd7f-a67a804a98e1" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 35.764s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:35:13 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:35:13 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:35:18 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:35:18 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:35:18 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74960) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 12:35:18 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74960) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 12:35:18 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74960) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 12:35:18 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:35:19 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-337c44e2-17bf-430d-82b5-d0358fe270a1 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Acquiring lock "27aa03bb-5613-4bde-8bc0-30517f5d48ae" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:35:19 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-337c44e2-17bf-430d-82b5-d0358fe270a1 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Lock "27aa03bb-5613-4bde-8bc0-30517f5d48ae" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:35:19 user nova-compute[74960]: DEBUG nova.compute.manager [None req-337c44e2-17bf-430d-82b5-d0358fe270a1 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] Starting instance... {{(pid=74960) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 12:35:19 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-337c44e2-17bf-430d-82b5-d0358fe270a1 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:35:19 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-337c44e2-17bf-430d-82b5-d0358fe270a1 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:35:19 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-337c44e2-17bf-430d-82b5-d0358fe270a1 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74960) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 12:35:19 user nova-compute[74960]: INFO nova.compute.claims [None req-337c44e2-17bf-430d-82b5-d0358fe270a1 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] Claim successful on node user
Nov 03 12:35:20 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-337c44e2-17bf-430d-82b5-d0358fe270a1 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:35:20 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-337c44e2-17bf-430d-82b5-d0358fe270a1 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:35:20 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-337c44e2-17bf-430d-82b5-d0358fe270a1 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.466s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:35:20 user nova-compute[74960]: DEBUG nova.compute.manager [None req-337c44e2-17bf-430d-82b5-d0358fe270a1 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] Start building networks asynchronously for instance. {{(pid=74960) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 12:35:20 user nova-compute[74960]: DEBUG nova.compute.manager [None req-337c44e2-17bf-430d-82b5-d0358fe270a1 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] Allocating IP information in the background. {{(pid=74960) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 12:35:20 user nova-compute[74960]: DEBUG nova.network.neutron [None req-337c44e2-17bf-430d-82b5-d0358fe270a1 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] allocate_for_instance() {{(pid=74960) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 12:35:20 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-337c44e2-17bf-430d-82b5-d0358fe270a1 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 12:35:20 user nova-compute[74960]: DEBUG nova.compute.manager [None req-337c44e2-17bf-430d-82b5-d0358fe270a1 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] Start building block device mappings for instance. {{(pid=74960) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 12:35:20 user nova-compute[74960]: DEBUG nova.policy [None req-337c44e2-17bf-430d-82b5-d0358fe270a1 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2a983db9b51c44938095b72874dddcf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '384450261e1f45048eb9b4b431ce8bd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74960) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 12:35:20 user nova-compute[74960]: INFO nova.virt.block_device [None req-337c44e2-17bf-430d-82b5-d0358fe270a1 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] Booting with volume 0d9b574a-cdd4-4118-a061-dfe393a5cd61 at /dev/vda
Nov 03 12:35:20 user nova-compute[74960]: DEBUG os_brick.utils [None req-337c44e2-17bf-430d-82b5-d0358fe270a1 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:35:20 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:35:20 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:35:20 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[87b2701c-62ff-4121-9777-a1bffdc727a1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:75b8e219756\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:35:20 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:35:20 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:35:20 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f4ff31a-0112-43ef-bba7-cdcfee6d166b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:35:20 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:35:20 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:35:20 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e7c734f-8917-4ddc-8aaf-e2d0488d13e2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:35:20 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea388286-ae88-4e49-89ca-1d6595469913]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:35:20 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-337c44e2-17bf-430d-82b5-d0358fe270a1 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Running cmd (subprocess): nvme version {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:35:20 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-337c44e2-17bf-430d-82b5-d0358fe270a1 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] 'nvme version' failed. Not Retrying. {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 12:35:20 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.nvmeof [None req-337c44e2-17bf-430d-82b5-d0358fe270a1 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] nvme not present on system {{(pid=74960) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 12:35:20 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:35:20 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 12:35:20 user nova-compute[74960]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 12:35:20 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b1ccde4-eab2-46a1-b8f8-1a012c59e92c]: (4, '') {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:35:20 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-337c44e2-17bf-430d-82b5-d0358fe270a1 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74960) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 12:35:20 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-337c44e2-17bf-430d-82b5-d0358fe270a1 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74960) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 12:35:20 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-337c44e2-17bf-430d-82b5-d0358fe270a1 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] LIGHTOS: no hostnqn found. {{(pid=74960) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 12:35:20 user nova-compute[74960]: DEBUG os_brick.utils [None req-337c44e2-17bf-430d-82b5-d0358fe270a1 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:75b8e219756', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:35:20 user nova-compute[74960]: DEBUG nova.virt.block_device [None req-337c44e2-17bf-430d-82b5-d0358fe270a1 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] Updating existing volume attachment record: 7d75898d-3d12-4a5a-85bd-7d52afebd9ea {{(pid=74960) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 12:35:20 user nova-compute[74960]: DEBUG nova.objects.instance [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Lazy-loading 'flavor' on Instance uuid 5b7b95c0-3726-4a1c-a384-ec91abf75225 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:35:20 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Acquiring lock "refresh_cache-5b7b95c0-3726-4a1c-a384-ec91abf75225" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:35:20 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Acquired lock "refresh_cache-5b7b95c0-3726-4a1c-a384-ec91abf75225" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:35:20 user nova-compute[74960]: DEBUG nova.network.neutron [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] Building network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 12:35:20 user nova-compute[74960]: DEBUG nova.objects.instance [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Lazy-loading 'info_cache' on Instance uuid 5b7b95c0-3726-4a1c-a384-ec91abf75225 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:35:21 user nova-compute[74960]: DEBUG nova.objects.base [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Object Instance<5b7b95c0-3726-4a1c-a384-ec91abf75225> lazy-loaded attributes: flavor,info_cache {{(pid=74960) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 12:35:21 user nova-compute[74960]: DEBUG nova.network.neutron [None req-337c44e2-17bf-430d-82b5-d0358fe270a1 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] Successfully created port: 16df3da7-2b2a-4c74-bb06-779696d25b88 {{(pid=74960) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 12:35:21 user nova-compute[74960]: DEBUG nova.network.neutron [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] Updating instance_info_cache with network_info: [{"id": "091cbb89-dd8a-448e-963a-3dbcafde6bb1", "address": "fa:16:3e:cc:a5:1b", "network": {"id": "3eaeac55-9eb7-4301-b5a7-d13735656d8e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-826950903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9160afcfdb74ba2aad7bc79e628e96f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap091cbb89-dd", "ovs_interfaceid": "091cbb89-dd8a-448e-963a-3dbcafde6bb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:35:21 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Releasing lock "refresh_cache-5b7b95c0-3726-4a1c-a384-ec91abf75225" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:35:21 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] Instance destroyed successfully.
Nov 03 12:35:21 user nova-compute[74960]: DEBUG nova.objects.instance [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Lazy-loading 'resources' on Instance uuid 5b7b95c0-3726-4a1c-a384-ec91abf75225 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:35:21 user nova-compute[74960]: DEBUG nova.objects.base [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Object Instance<5b7b95c0-3726-4a1c-a384-ec91abf75225> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74960) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 12:35:21 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:30:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-666638080',display_name='tempest-AttachVolumeTestJSON-server-666638080',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-666638080',id=28,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIQ2G2kW7RG3ei1U+rVcmbI+Ton8kNiQZeMxqXkABUJCy9iuRMgTZBhGnWGCs6R7DHln/91d5py8pZC0KUaGy+7UnlGfb1FgAKzTpiPtdr0uDnrIs+6hQLHu9y+wv2TiKg==',key_name='tempest-keypair-691388173',keypairs=<?>,launch_index=0,launched_at=2023-11-03T12:30:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='a9160afcfdb74ba2aad7bc79e628e96f',ramdisk_id='',reservation_id='r-na1kxuhs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-847320603',owner_user_name='tempest-AttachVolumeTestJSON-847320603-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T12:33:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c599d8677454b60b9434689322a6de2',uuid=5b7b95c0-3726-4a1c-a384-ec91abf75225,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "091cbb89-dd8a-448e-963a-3dbcafde6bb1", "address": "fa:16:3e:cc:a5:1b", "network": {"id": "3eaeac55-9eb7-4301-b5a7-d13735656d8e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-826950903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9160afcfdb74ba2aad7bc79e628e96f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap091cbb89-dd", "ovs_interfaceid": "091cbb89-dd8a-448e-963a-3dbcafde6bb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 12:35:21 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Converting VIF {"id": "091cbb89-dd8a-448e-963a-3dbcafde6bb1", "address": "fa:16:3e:cc:a5:1b", "network": {"id": "3eaeac55-9eb7-4301-b5a7-d13735656d8e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-826950903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9160afcfdb74ba2aad7bc79e628e96f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap091cbb89-dd", "ovs_interfaceid": "091cbb89-dd8a-448e-963a-3dbcafde6bb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:35:21 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:a5:1b,bridge_name='br-int',has_traffic_filtering=True,id=091cbb89-dd8a-448e-963a-3dbcafde6bb1,network=Network(3eaeac55-9eb7-4301-b5a7-d13735656d8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap091cbb89-dd') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:35:21 user nova-compute[74960]: DEBUG os_vif [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:a5:1b,bridge_name='br-int',has_traffic_filtering=True,id=091cbb89-dd8a-448e-963a-3dbcafde6bb1,network=Network(3eaeac55-9eb7-4301-b5a7-d13735656d8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap091cbb89-dd') {{(pid=74960) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 12:35:21 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:35:21 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap091cbb89-dd, bridge=br-int, if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:35:21 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:35:21 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:35:21 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:35:21 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=154ae01c-2119-4e07-b294-e119910c7349) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:35:21 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:35:21 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:35:21 user nova-compute[74960]: INFO os_vif [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:a5:1b,bridge_name='br-int',has_traffic_filtering=True,id=091cbb89-dd8a-448e-963a-3dbcafde6bb1,network=Network(3eaeac55-9eb7-4301-b5a7-d13735656d8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap091cbb89-dd')
Nov 03 12:35:21 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] calling os-brick to detach iSCSI Volume {{(pid=74960) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 12:35:21 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9aa420acb0>, {'target_iqn': 'iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lbqIoMWN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:35:21 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:35:21 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:35:21 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:35:21 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:35:21 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:35:21 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[743b7a3e-1015-4724-ab54-a572df0452e8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7da48309-69f9-407d-81b1-9bd9aea03cd0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:35:21 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 12:35:21 user nova-compute[74960]: No targets found.
Nov 03 12:35:21 user nova-compute[74960]: iSNS:
Nov 03 12:35:21 user nova-compute[74960]: No targets found.
Nov 03 12:35:21 user nova-compute[74960]: STATIC:
Nov 03 12:35:21 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515
Nov 03 12:35:21 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:35:21 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:35:21 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797
Nov 03 12:35:21 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:35:21 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:35:21 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2
Nov 03 12:35:21 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:35:21 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:35:21 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:7da48309-69f9-407d-81b1-9bd9aea03cd0
Nov 03 12:35:21 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:35:21 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:35:21 user nova-compute[74960]: FIRMWARE:
Nov 03 12:35:21 user nova-compute[74960]: No targets found.
Nov 03 12:35:21 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:35:21 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 12:35:21 user nova-compute[74960]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 12:35:21 user nova-compute[74960]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74960) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 12:35:21 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515', 0)] {{(pid=74960) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 12:35:21 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:35:21 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:35:21 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a8b9338-902a-41b2-b0a1-7ea2e2e7a39b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7da48309-69f9-407d-81b1-9bd9aea03cd0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:35:21 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:35:21 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:35:21 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[508ae33f-04fe-47b3-8e5a-01e58e622f4b]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7da48309-69f9-407d-81b1-9bd9aea03cd0 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797 (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:35:21 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:35:21 user nova-compute[74960]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 (non-flash)
Nov 03 12:35:21 user nova-compute[74960]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7da48309-69f9-407d-81b1-9bd9aea03cd0 (non-flash)
Nov 03 12:35:21 user nova-compute[74960]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797 (non-flash)
Nov 03 12:35:21 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:35:21 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:35:21 user nova-compute[74960]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 (non-flash)
Nov 03 12:35:21 user nova-compute[74960]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7da48309-69f9-407d-81b1-9bd9aea03cd0 (non-flash)
Nov 03 12:35:21 user nova-compute[74960]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797 (non-flash)
Nov 03 12:35:21 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:35:21 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9a8c5d88b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515'): ({'sdc'}, set())}) {{(pid=74960) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 12:35:21 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Removing single pathed devices sdc {{(pid=74960) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 12:35:21 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:35:21 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:35:21 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f715a16-cb17-4ef1-a978-36ec448ad97c]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:35:21 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:35:22 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:35:22 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7dbd24c-9551-4346-bed9-50e3ca43c64b]: (4, ('ok\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:35:22 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Flushing IO for device /dev/sdc {{(pid=74960) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 12:35:22 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:35:22 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:35:22 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4d95d20-7a6d-4ce9-88e7-43cbfd2f2f21]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:35:22 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74960) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 12:35:22 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:35:22 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.054s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:35:22 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[0683dc55-ec80-434f-8ce4-b4f9dc9f621b]: (4, ('1', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:35:22 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74960) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 12:35:22 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] SCSI volumes sdc have been removed. {{(pid=74960) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 12:35:22 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515')] {{(pid=74960) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 12:35:22 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:35:22 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:35:22 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8c4b2c6-dc62-422f-8ca8-61a3cc1e58cf]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:35:22 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:35:22 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 -p 172.16.0.220:3260 --logout {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:35:22 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:35:22 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a782d29-f45e-4529-818f-d961d94ed9de]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:35:22 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515, portal: 172.16.0.220,3260]
Nov 03 12:35:22 user nova-compute[74960]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515, portal: 172.16.0.220,3260] successful.
Nov 03 12:35:22 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:35:22 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 -p 172.16.0.220:3260 --op delete {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:35:22 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:35:22 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[1562e2f6-80a8-41c3-8e01-77be083bde97]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:35:22 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:35:22 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.370s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:35:22 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] <== disconnect_volume: return (371ms) None {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:35:22 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] Disconnected iSCSI Volume {{(pid=74960) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 12:35:22 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] Start _get_guest_xml network_info=[{"id": "091cbb89-dd8a-448e-963a-3dbcafde6bb1", "address": "fa:16:3e:cc:a5:1b", "network": {"id": "3eaeac55-9eb7-4301-b5a7-d13735656d8e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-826950903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9160afcfdb74ba2aad7bc79e628e96f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap091cbb89-dd", "ovs_interfaceid": "091cbb89-dd8a-448e-963a-3dbcafde6bb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=549f51ba-ac69-494b-8de1-34635aa2d7cf,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'image_id': '549f51ba-ac69-494b-8de1-34635aa2d7cf'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lbqIoMWN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '5b7b95c0-3726-4a1c-a384-ec91abf75225', 'attached_at': '', 'detached_at': '', 'volume_id': 'c0a0a661-c547-4364-8552-3d6497281515', 'serial': 'c0a0a661-c547-4364-8552-3d6497281515'}, 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'attachment_id': 'd0c67dcd-fd4b-46a9-a30d-96ccdfebf885', 'boot_index': None, 'guest_format': None, 'volume_type': None} {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 12:35:22 user nova-compute[74960]: DEBUG nova.objects.instance [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Lazy-loading 'numa_topology' on Instance uuid 5b7b95c0-3726-4a1c-a384-ec91abf75225 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:35:22 user nova-compute[74960]: DEBUG nova.objects.base [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Object Instance<5b7b95c0-3726-4a1c-a384-ec91abf75225> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74960) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 12:35:22 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:35:22 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:35:22 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 12:35:22 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] CPU controller missing on host. {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 12:35:22 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 12:35:22 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] CPU controller found on host. {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 12:35:22 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74960) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 12:35:22 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=549f51ba-ac69-494b-8de1-34635aa2d7cf,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 12:35:22 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Flavor limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 12:35:22 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Image limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 12:35:22 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Flavor pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 12:35:22 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Image pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 12:35:22 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 12:35:22 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 12:35:22 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 12:35:22 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Got 1 possible topologies {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 12:35:22 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 12:35:22 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 12:35:22 user nova-compute[74960]: DEBUG nova.objects.instance [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5b7b95c0-3726-4a1c-a384-ec91abf75225 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:35:22 user nova-compute[74960]: DEBUG nova.objects.base [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Object Instance<5b7b95c0-3726-4a1c-a384-ec91abf75225> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74960) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 12:35:22 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] Calling os-brick to attach iSCSI Volume {{(pid=74960) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 12:35:22 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9aa420acb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lbqIoMWN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:35:22 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:35:22 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:35:22 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:35:22 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:35:22 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:35:22 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:35:22 user nova-compute[74960]: INFO os_brick.initiator.connectors.iscsi [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 12:35:22 user nova-compute[74960]: DEBUG nova.network.neutron [None req-337c44e2-17bf-430d-82b5-d0358fe270a1 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] Successfully updated port: 16df3da7-2b2a-4c74-bb06-779696d25b88 {{(pid=74960) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 12:35:22 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 -p 172.16.0.220:3260 {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:35:22 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-337c44e2-17bf-430d-82b5-d0358fe270a1 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Acquiring lock "refresh_cache-27aa03bb-5613-4bde-8bc0-30517f5d48ae" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:35:22 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-337c44e2-17bf-430d-82b5-d0358fe270a1 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Acquired lock "refresh_cache-27aa03bb-5613-4bde-8bc0-30517f5d48ae" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:35:22 user nova-compute[74960]: DEBUG nova.network.neutron [None req-337c44e2-17bf-430d-82b5-d0358fe270a1 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] Building network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 12:35:22 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:35:22 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb03e73-e9c6-47e4-bb26-3fae8da6ea72]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:35:22 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 12:35:22 user nova-compute[74960]:  {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:35:22 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 -p 172.16.0.220:3260 --interface default --op new {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:35:22 user nova-compute[74960]: DEBUG nova.compute.manager [req-08ffbb2b-aeef-4574-9352-fb18121313d3 req-f45eeeb0-45bd-48f0-9e0e-ce39bae8415f service nova] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] Received event network-changed-16df3da7-2b2a-4c74-bb06-779696d25b88 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:35:22 user nova-compute[74960]: DEBUG nova.compute.manager [req-08ffbb2b-aeef-4574-9352-fb18121313d3 req-f45eeeb0-45bd-48f0-9e0e-ce39bae8415f service nova] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] Refreshing instance network info cache due to event network-changed-16df3da7-2b2a-4c74-bb06-779696d25b88. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 12:35:22 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-08ffbb2b-aeef-4574-9352-fb18121313d3 req-f45eeeb0-45bd-48f0-9e0e-ce39bae8415f service nova] Acquiring lock "refresh_cache-27aa03bb-5613-4bde-8bc0-30517f5d48ae" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:35:22 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:35:22 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a641634-5c9a-484c-974a-951e6df1bc35]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515] added\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:35:22 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515] added
Nov 03 12:35:22 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:35:22 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:35:22 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:35:22 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[a84067f6-56f1-4028-ba95-bd9d7cc55dbb]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:35:22 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:35:22 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:35:22 user nova-compute[74960]: DEBUG nova.network.neutron [None req-337c44e2-17bf-430d-82b5-d0358fe270a1 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] Instance cache missing network info. {{(pid=74960) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 12:35:22 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:35:22 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c0c7ec7-b424-4546-8489-e0e5fa295d49]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:35:22 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:35:22 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lbqIoMWN {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:35:22 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lbqIoMWN" returned: 0 in 0.020s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:35:22 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc9868c-ac61-4355-9227-70f41f26d529]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:35:22 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lbqIoMWN'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:35:22 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:35:22 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:35:22 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc5af9ae-c7ac-438c-9589-1598a0ec85e8]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:35:22 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:35:22 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:35:22 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:35:22 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fe68c2d-e5a4-415a-b1f5-af76eb2a8cd0]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7da48309-69f9-407d-81b1-9bd9aea03cd0 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797 (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:35:22 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:35:22 user nova-compute[74960]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7da48309-69f9-407d-81b1-9bd9aea03cd0 (non-flash)
Nov 03 12:35:22 user nova-compute[74960]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797 (non-flash)
Nov 03 12:35:22 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:35:22 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:35:22 user nova-compute[74960]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7da48309-69f9-407d-81b1-9bd9aea03cd0 (non-flash)
Nov 03 12:35:22 user nova-compute[74960]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797 (non-flash)
Nov 03 12:35:22 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:35:22 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 -p 172.16.0.220:3260 --login {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:35:22 user nova-compute[74960]: DEBUG nova.network.neutron [None req-337c44e2-17bf-430d-82b5-d0358fe270a1 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] Updating instance_info_cache with network_info: [{"id": "16df3da7-2b2a-4c74-bb06-779696d25b88", "address": "fa:16:3e:2a:35:94", "network": {"id": "4a77f235-def4-4456-8f4a-99bf5769e015", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1480494760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "384450261e1f45048eb9b4b431ce8bd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16df3da7-2b", "ovs_interfaceid": "16df3da7-2b2a-4c74-bb06-779696d25b88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:35:22 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-337c44e2-17bf-430d-82b5-d0358fe270a1 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Releasing lock "refresh_cache-27aa03bb-5613-4bde-8bc0-30517f5d48ae" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:35:22 user nova-compute[74960]: DEBUG nova.compute.manager [None req-337c44e2-17bf-430d-82b5-d0358fe270a1 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] Instance network_info: |[{"id": "16df3da7-2b2a-4c74-bb06-779696d25b88", "address": "fa:16:3e:2a:35:94", "network": {"id": "4a77f235-def4-4456-8f4a-99bf5769e015", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1480494760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "384450261e1f45048eb9b4b431ce8bd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16df3da7-2b", "ovs_interfaceid": "16df3da7-2b2a-4c74-bb06-779696d25b88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74960) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 12:35:22 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-08ffbb2b-aeef-4574-9352-fb18121313d3 req-f45eeeb0-45bd-48f0-9e0e-ce39bae8415f service nova] Acquired lock "refresh_cache-27aa03bb-5613-4bde-8bc0-30517f5d48ae" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:35:22 user nova-compute[74960]: DEBUG nova.network.neutron [req-08ffbb2b-aeef-4574-9352-fb18121313d3 req-f45eeeb0-45bd-48f0-9e0e-ce39bae8415f service nova] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] Refreshing network info cache for port 16df3da7-2b2a-4c74-bb06-779696d25b88 {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 12:35:23 user nova-compute[74960]: DEBUG nova.network.neutron [req-08ffbb2b-aeef-4574-9352-fb18121313d3 req-f45eeeb0-45bd-48f0-9e0e-ce39bae8415f service nova] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] Updated VIF entry in instance network info cache for port 16df3da7-2b2a-4c74-bb06-779696d25b88. {{(pid=74960) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 12:35:23 user nova-compute[74960]: DEBUG nova.network.neutron [req-08ffbb2b-aeef-4574-9352-fb18121313d3 req-f45eeeb0-45bd-48f0-9e0e-ce39bae8415f service nova] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] Updating instance_info_cache with network_info: [{"id": "16df3da7-2b2a-4c74-bb06-779696d25b88", "address": "fa:16:3e:2a:35:94", "network": {"id": "4a77f235-def4-4456-8f4a-99bf5769e015", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1480494760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "384450261e1f45048eb9b4b431ce8bd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16df3da7-2b", "ovs_interfaceid": "16df3da7-2b2a-4c74-bb06-779696d25b88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:35:23 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-08ffbb2b-aeef-4574-9352-fb18121313d3 req-f45eeeb0-45bd-48f0-9e0e-ce39bae8415f service nova] Releasing lock "refresh_cache-27aa03bb-5613-4bde-8bc0-30517f5d48ae" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:35:23 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 -p 172.16.0.220:3260 --login" returned: 0 in 1.072s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:35:23 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[84aadf82-6c17-4e54-a579-5f549674b4a8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:35:23 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515, portal: 172.16.0.220,3260]
Nov 03 12:35:23 user nova-compute[74960]: Login to [iface: default, target: iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515, portal: 172.16.0.220,3260] successful.
Nov 03 12:35:23 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:35:23 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:35:23 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:35:23 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[165bc9df-d1ae-4399-b64e-6ce8039c8b4d]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:35:23 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:35:23 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:35:23 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:35:23 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf9a00ae-6ad6-46ca-80c5-9f41f1245631]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7da48309-69f9-407d-81b1-9bd9aea03cd0 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:35:23 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:35:23 user nova-compute[74960]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7da48309-69f9-407d-81b1-9bd9aea03cd0 (non-flash)
Nov 03 12:35:23 user nova-compute[74960]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797 (non-flash)
Nov 03 12:35:23 user nova-compute[74960]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 (non-flash)
Nov 03 12:35:23 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:35:23 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:35:23 user nova-compute[74960]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7da48309-69f9-407d-81b1-9bd9aea03cd0 (non-flash)
Nov 03 12:35:23 user nova-compute[74960]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797 (non-flash)
Nov 03 12:35:23 user nova-compute[74960]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 (non-flash)
Nov 03 12:35:23 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:35:23 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.353s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:35:23 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Connected to 172.16.0.220:3260 {{(pid=74960) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 12:35:23 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] HCTL ('34', '-', '-', 0) found on session 28 with lun 0 {{(pid=74960) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 12:35:23 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74960) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 12:35:23 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:35:23 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:35:23 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b3792b8-ec9e-4009-accf-8506f5098586]: (4, ('- - 0', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:35:23 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Searching for a device in session 28 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74960) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 12:35:23 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lbqIoMWN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74960) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 12:35:24 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53804013-af3e-42d9-b890-9a9c3683ae58 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] [instance: 9c447082-b59b-4c8e-8fa0-bf6599a84e91] Calling os-brick to attach iSCSI Volume {{(pid=74960) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 12:35:24 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-53804013-af3e-42d9-b890-9a9c3683ae58 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9aa420acb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7bd46dc3-8710-4ce9-9e02-3d6c442fb90c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lkFNzXAj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:35:24 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-53804013-af3e-42d9-b890-9a9c3683ae58 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:35:24 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-53804013-af3e-42d9-b890-9a9c3683ae58 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:35:24 user nova-compute[74960]: DEBUG nova.compute.manager [req-4bf81e46-22ea-4df7-bb2b-c8816ce73906 req-7bac1ac4-65bb-40bb-a86e-e12c8db4b95c service nova] [instance: 12ae6707-c1c6-4bc2-a409-67cea64fc2c3] Received event network-changed-356b6bc6-6335-476f-948e-7bc8bc4fc88c {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:35:24 user nova-compute[74960]: DEBUG nova.compute.manager [req-4bf81e46-22ea-4df7-bb2b-c8816ce73906 req-7bac1ac4-65bb-40bb-a86e-e12c8db4b95c service nova] [instance: 12ae6707-c1c6-4bc2-a409-67cea64fc2c3] Refreshing instance network info cache due to event network-changed-356b6bc6-6335-476f-948e-7bc8bc4fc88c. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 12:35:24 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-4bf81e46-22ea-4df7-bb2b-c8816ce73906 req-7bac1ac4-65bb-40bb-a86e-e12c8db4b95c service nova] Acquiring lock "refresh_cache-12ae6707-c1c6-4bc2-a409-67cea64fc2c3" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:35:24 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-4bf81e46-22ea-4df7-bb2b-c8816ce73906 req-7bac1ac4-65bb-40bb-a86e-e12c8db4b95c service nova] Acquired lock "refresh_cache-12ae6707-c1c6-4bc2-a409-67cea64fc2c3" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:35:24 user nova-compute[74960]: DEBUG nova.network.neutron [req-4bf81e46-22ea-4df7-bb2b-c8816ce73906 req-7bac1ac4-65bb-40bb-a86e-e12c8db4b95c service nova] [instance: 12ae6707-c1c6-4bc2-a409-67cea64fc2c3] Refreshing network info cache for port 356b6bc6-6335-476f-948e-7bc8bc4fc88c {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 12:35:24 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-cbd8edb8-5b4d-484b-ae47-534468681521 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Acquiring lock "12ae6707-c1c6-4bc2-a409-67cea64fc2c3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:35:24 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-cbd8edb8-5b4d-484b-ae47-534468681521 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Lock "12ae6707-c1c6-4bc2-a409-67cea64fc2c3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:35:24 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.392s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:35:24 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] <== connect_volume: return (2393ms) {'type': 'block', 'scsi_wwn': '23637383138393830', 'path': '/dev/sdc'} {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:35:24 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23637383138393830', 'path': '/dev/sdc'} {{(pid=74960) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 12:35:24 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-53804013-af3e-42d9-b890-9a9c3683ae58 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.507s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:35:24 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-53804013-af3e-42d9-b890-9a9c3683ae58 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:35:24 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-53804013-af3e-42d9-b890-9a9c3683ae58 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7bd46dc3-8710-4ce9-9e02-3d6c442fb90c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:35:24 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-53804013-af3e-42d9-b890-9a9c3683ae58 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7bd46dc3-8710-4ce9-9e02-3d6c442fb90c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:35:24 user nova-compute[74960]: INFO os_brick.initiator.connectors.iscsi [None req-53804013-af3e-42d9-b890-9a9c3683ae58 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 12:35:24 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bd46dc3-8710-4ce9-9e02-3d6c442fb90c -p 172.16.0.220:3260 {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:35:24 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bd46dc3-8710-4ce9-9e02-3d6c442fb90c -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:35:24 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3686a49-f233-4299-814b-f3c82a83cb61]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:35:24 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-53804013-af3e-42d9-b890-9a9c3683ae58 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 12:35:24 user nova-compute[74960]:  {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:35:24 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bd46dc3-8710-4ce9-9e02-3d6c442fb90c -p 172.16.0.220:3260 --interface default --op new {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:35:24 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:30:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-666638080',display_name='tempest-AttachVolumeTestJSON-server-666638080',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-666638080',id=28,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIQ2G2kW7RG3ei1U+rVcmbI+Ton8kNiQZeMxqXkABUJCy9iuRMgTZBhGnWGCs6R7DHln/91d5py8pZC0KUaGy+7UnlGfb1FgAKzTpiPtdr0uDnrIs+6hQLHu9y+wv2TiKg==',key_name='tempest-keypair-691388173',keypairs=<?>,launch_index=0,launched_at=2023-11-03T12:30:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='a9160afcfdb74ba2aad7bc79e628e96f',ramdisk_id='',reservation_id='r-na1kxuhs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-847320603',owner_user_name='tempest-AttachVolumeTestJSON-847320603-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T12:33:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c599d8677454b60b9434689322a6de2',uuid=5b7b95c0-3726-4a1c-a384-ec91abf75225,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "091cbb89-dd8a-448e-963a-3dbcafde6bb1", "address": "fa:16:3e:cc:a5:1b", "network": {"id": "3eaeac55-9eb7-4301-b5a7-d13735656d8e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-826950903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9160afcfdb74ba2aad7bc79e628e96f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap091cbb89-dd", "ovs_interfaceid": "091cbb89-dd8a-448e-963a-3dbcafde6bb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74960) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 12:35:24 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Converting VIF {"id": "091cbb89-dd8a-448e-963a-3dbcafde6bb1", "address": "fa:16:3e:cc:a5:1b", "network": {"id": "3eaeac55-9eb7-4301-b5a7-d13735656d8e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-826950903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9160afcfdb74ba2aad7bc79e628e96f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap091cbb89-dd", "ovs_interfaceid": "091cbb89-dd8a-448e-963a-3dbcafde6bb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:35:24 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:a5:1b,bridge_name='br-int',has_traffic_filtering=True,id=091cbb89-dd8a-448e-963a-3dbcafde6bb1,network=Network(3eaeac55-9eb7-4301-b5a7-d13735656d8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap091cbb89-dd') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:35:24 user nova-compute[74960]: DEBUG nova.objects.instance [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Lazy-loading 'pci_devices' on Instance uuid 5b7b95c0-3726-4a1c-a384-ec91abf75225 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:35:24 user nova-compute[74960]: DEBUG nova.objects.instance [None req-cbd8edb8-5b4d-484b-ae47-534468681521 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Lazy-loading 'flavor' on Instance uuid 12ae6707-c1c6-4bc2-a409-67cea64fc2c3 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:35:24 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bd46dc3-8710-4ce9-9e02-3d6c442fb90c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:35:24 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[8afbcd26-56a3-45fe-84f5-65672577cc3b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7bd46dc3-8710-4ce9-9e02-3d6c442fb90c] added\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:35:24 user nova-compute[74960]: DEBUG nova.objects.base [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Object Instance<5b7b95c0-3726-4a1c-a384-ec91abf75225> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74960) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 12:35:24 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] End _get_guest_xml xml=<domain type="kvm">
Nov 03 12:35:24 user nova-compute[74960]:   <uuid>5b7b95c0-3726-4a1c-a384-ec91abf75225</uuid>
Nov 03 12:35:24 user nova-compute[74960]:   <name>instance-0000001c</name>
Nov 03 12:35:24 user nova-compute[74960]:   <memory>524288</memory>
Nov 03 12:35:24 user nova-compute[74960]:   <vcpu>1</vcpu>
Nov 03 12:35:24 user nova-compute[74960]:   <metadata>
Nov 03 12:35:24 user nova-compute[74960]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 12:35:24 user nova-compute[74960]:       <nova:package version="0.0.0"/>
Nov 03 12:35:24 user nova-compute[74960]:       <nova:name>tempest-AttachVolumeTestJSON-server-666638080</nova:name>
Nov 03 12:35:24 user nova-compute[74960]:       <nova:creationTime>2023-11-03 12:35:22</nova:creationTime>
Nov 03 12:35:24 user nova-compute[74960]:       <nova:flavor name="m1.tiny">
Nov 03 12:35:24 user nova-compute[74960]:         <nova:memory>512</nova:memory>
Nov 03 12:35:24 user nova-compute[74960]:         <nova:disk>1</nova:disk>
Nov 03 12:35:24 user nova-compute[74960]:         <nova:swap>0</nova:swap>
Nov 03 12:35:24 user nova-compute[74960]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 12:35:24 user nova-compute[74960]:         <nova:vcpus>1</nova:vcpus>
Nov 03 12:35:24 user nova-compute[74960]:       </nova:flavor>
Nov 03 12:35:24 user nova-compute[74960]:       <nova:owner>
Nov 03 12:35:24 user nova-compute[74960]:         <nova:user uuid="8c599d8677454b60b9434689322a6de2">tempest-AttachVolumeTestJSON-847320603-project-member</nova:user>
Nov 03 12:35:24 user nova-compute[74960]:         <nova:project uuid="a9160afcfdb74ba2aad7bc79e628e96f">tempest-AttachVolumeTestJSON-847320603</nova:project>
Nov 03 12:35:24 user nova-compute[74960]:       </nova:owner>
Nov 03 12:35:24 user nova-compute[74960]:       <nova:root type="image" uuid="549f51ba-ac69-494b-8de1-34635aa2d7cf"/>
Nov 03 12:35:24 user nova-compute[74960]:       <nova:ports>
Nov 03 12:35:24 user nova-compute[74960]:         <nova:port uuid="091cbb89-dd8a-448e-963a-3dbcafde6bb1">
Nov 03 12:35:24 user nova-compute[74960]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 03 12:35:24 user nova-compute[74960]:         </nova:port>
Nov 03 12:35:24 user nova-compute[74960]:       </nova:ports>
Nov 03 12:35:24 user nova-compute[74960]:     </nova:instance>
Nov 03 12:35:24 user nova-compute[74960]:   </metadata>
Nov 03 12:35:24 user nova-compute[74960]:   <sysinfo type="smbios">
Nov 03 12:35:24 user nova-compute[74960]:     <system>
Nov 03 12:35:24 user nova-compute[74960]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 12:35:24 user nova-compute[74960]:       <entry name="product">OpenStack Nova</entry>
Nov 03 12:35:24 user nova-compute[74960]:       <entry name="version">0.0.0</entry>
Nov 03 12:35:24 user nova-compute[74960]:       <entry name="serial">5b7b95c0-3726-4a1c-a384-ec91abf75225</entry>
Nov 03 12:35:24 user nova-compute[74960]:       <entry name="uuid">5b7b95c0-3726-4a1c-a384-ec91abf75225</entry>
Nov 03 12:35:24 user nova-compute[74960]:       <entry name="family">Virtual Machine</entry>
Nov 03 12:35:24 user nova-compute[74960]:     </system>
Nov 03 12:35:24 user nova-compute[74960]:   </sysinfo>
Nov 03 12:35:24 user nova-compute[74960]:   <os>
Nov 03 12:35:24 user nova-compute[74960]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 12:35:24 user nova-compute[74960]:     <boot dev="hd"/>
Nov 03 12:35:24 user nova-compute[74960]:     <smbios mode="sysinfo"/>
Nov 03 12:35:24 user nova-compute[74960]:   </os>
Nov 03 12:35:24 user nova-compute[74960]:   <features>
Nov 03 12:35:24 user nova-compute[74960]:     <acpi/>
Nov 03 12:35:24 user nova-compute[74960]:     <apic/>
Nov 03 12:35:24 user nova-compute[74960]:     <vmcoreinfo/>
Nov 03 12:35:24 user nova-compute[74960]:   </features>
Nov 03 12:35:24 user nova-compute[74960]:   <clock offset="utc">
Nov 03 12:35:24 user nova-compute[74960]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 12:35:24 user nova-compute[74960]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 12:35:24 user nova-compute[74960]:     <timer name="hpet" present="no"/>
Nov 03 12:35:24 user nova-compute[74960]:   </clock>
Nov 03 12:35:24 user nova-compute[74960]:   <cpu mode="custom" match="exact">
Nov 03 12:35:24 user nova-compute[74960]:     <model>Nehalem</model>
Nov 03 12:35:24 user nova-compute[74960]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 12:35:24 user nova-compute[74960]:   </cpu>
Nov 03 12:35:24 user nova-compute[74960]:   <devices>
Nov 03 12:35:24 user nova-compute[74960]:     <disk type="file" device="disk">
Nov 03 12:35:24 user nova-compute[74960]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 12:35:24 user nova-compute[74960]:       <source file="/opt/stack/data/nova/instances/5b7b95c0-3726-4a1c-a384-ec91abf75225/disk"/>
Nov 03 12:35:24 user nova-compute[74960]:       <target dev="vda" bus="virtio"/>
Nov 03 12:35:24 user nova-compute[74960]:     </disk>
Nov 03 12:35:24 user nova-compute[74960]:     <disk type="block" device="disk">
Nov 03 12:35:24 user nova-compute[74960]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 12:35:24 user nova-compute[74960]:       <source dev="/dev/sdc"/>
Nov 03 12:35:24 user nova-compute[74960]:       <target dev="vdb" bus="virtio"/>
Nov 03 12:35:24 user nova-compute[74960]:       <serial>c0a0a661-c547-4364-8552-3d6497281515</serial>
Nov 03 12:35:24 user nova-compute[74960]:     </disk>
Nov 03 12:35:24 user nova-compute[74960]:     <interface type="ethernet">
Nov 03 12:35:24 user nova-compute[74960]:       <mac address="fa:16:3e:cc:a5:1b"/>
Nov 03 12:35:24 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:35:24 user nova-compute[74960]:       <mtu size="1442"/>
Nov 03 12:35:24 user nova-compute[74960]:       <target dev="tap091cbb89-dd"/>
Nov 03 12:35:24 user nova-compute[74960]:     </interface>
Nov 03 12:35:24 user nova-compute[74960]:     <serial type="pty">
Nov 03 12:35:24 user nova-compute[74960]:       <log file="/opt/stack/data/nova/instances/5b7b95c0-3726-4a1c-a384-ec91abf75225/console.log" append="off"/>
Nov 03 12:35:24 user nova-compute[74960]:     </serial>
Nov 03 12:35:24 user nova-compute[74960]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 12:35:24 user nova-compute[74960]:     <video>
Nov 03 12:35:24 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:35:24 user nova-compute[74960]:     </video>
Nov 03 12:35:24 user nova-compute[74960]:     <rng model="virtio">
Nov 03 12:35:24 user nova-compute[74960]:       <backend model="random">/dev/urandom</backend>
Nov 03 12:35:24 user nova-compute[74960]:     </rng>
Nov 03 12:35:24 user nova-compute[74960]:     <controller type="usb" index="0" model="none"/>
Nov 03 12:35:24 user nova-compute[74960]:     <memballoon model="virtio">
Nov 03 12:35:24 user nova-compute[74960]:       <stats period="10"/>
Nov 03 12:35:24 user nova-compute[74960]:     </memballoon>
Nov 03 12:35:24 user nova-compute[74960]:   </devices>
Nov 03 12:35:24 user nova-compute[74960]: </domain>
Nov 03 12:35:24 user nova-compute[74960]:  {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 12:35:24 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7b95c0-3726-4a1c-a384-ec91abf75225/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:35:24 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-53804013-af3e-42d9-b890-9a9c3683ae58 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7bd46dc3-8710-4ce9-9e02-3d6c442fb90c] added
Nov 03 12:35:24 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:35:24 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-cbd8edb8-5b4d-484b-ae47-534468681521 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] [instance: 12ae6707-c1c6-4bc2-a409-67cea64fc2c3] Ignoring supplied device name: /dev/vdb
Nov 03 12:35:24 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bd46dc3-8710-4ce9-9e02-3d6c442fb90c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:35:24 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bd46dc3-8710-4ce9-9e02-3d6c442fb90c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:35:24 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[79dd0855-1723-4068-b145-d4e37a2bdd05]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:35:24 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-53804013-af3e-42d9-b890-9a9c3683ae58 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:35:24 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bd46dc3-8710-4ce9-9e02-3d6c442fb90c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:35:24 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-cbd8edb8-5b4d-484b-ae47-534468681521 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Lock "12ae6707-c1c6-4bc2-a409-67cea64fc2c3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.176s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:35:24 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bd46dc3-8710-4ce9-9e02-3d6c442fb90c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.038s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:35:24 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0bdd48e-89ca-4439-b91f-8e7c46f548e6]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:35:24 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-53804013-af3e-42d9-b890-9a9c3683ae58 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:35:24 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bd46dc3-8710-4ce9-9e02-3d6c442fb90c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lkFNzXAj {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:35:24 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bd46dc3-8710-4ce9-9e02-3d6c442fb90c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lkFNzXAj" returned: 0 in 0.023s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:35:24 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[d03bfee1-394c-4da9-9862-3faab71bf9e1]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:35:24 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-53804013-af3e-42d9-b890-9a9c3683ae58 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lkFNzXAj'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:35:24 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bd46dc3-8710-4ce9-9e02-3d6c442fb90c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:35:24 user nova-compute[74960]: DEBUG nova.network.neutron [req-4bf81e46-22ea-4df7-bb2b-c8816ce73906 req-7bac1ac4-65bb-40bb-a86e-e12c8db4b95c service nova] [instance: 12ae6707-c1c6-4bc2-a409-67cea64fc2c3] Updated VIF entry in instance network info cache for port 356b6bc6-6335-476f-948e-7bc8bc4fc88c. {{(pid=74960) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 12:35:24 user nova-compute[74960]: DEBUG nova.network.neutron [req-4bf81e46-22ea-4df7-bb2b-c8816ce73906 req-7bac1ac4-65bb-40bb-a86e-e12c8db4b95c service nova] [instance: 12ae6707-c1c6-4bc2-a409-67cea64fc2c3] Updating instance_info_cache with network_info: [{"id": "356b6bc6-6335-476f-948e-7bc8bc4fc88c", "address": "fa:16:3e:d7:40:80", "network": {"id": "82ebe97c-a056-4ac2-9644-ea315bf9a4b1", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1024050438-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efa134687c74460fb5a59dd3ddece671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap356b6bc6-63", "ovs_interfaceid": "356b6bc6-6335-476f-948e-7bc8bc4fc88c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:35:24 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bd46dc3-8710-4ce9-9e02-3d6c442fb90c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:35:24 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9cdb12c-c590-47b2-9763-83121a181554]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:35:24 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-53804013-af3e-42d9-b890-9a9c3683ae58 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:35:24 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:35:24 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-4bf81e46-22ea-4df7-bb2b-c8816ce73906 req-7bac1ac4-65bb-40bb-a86e-e12c8db4b95c service nova] Releasing lock "refresh_cache-12ae6707-c1c6-4bc2-a409-67cea64fc2c3" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:35:25 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:35:25 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e43daed-8adf-4dc3-909c-0715c48217c2]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7da48309-69f9-407d-81b1-9bd9aea03cd0 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:35:25 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-53804013-af3e-42d9-b890-9a9c3683ae58 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:35:25 user nova-compute[74960]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7da48309-69f9-407d-81b1-9bd9aea03cd0 (non-flash)
Nov 03 12:35:25 user nova-compute[74960]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797 (non-flash)
Nov 03 12:35:25 user nova-compute[74960]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 (non-flash)
Nov 03 12:35:25 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:35:25 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-53804013-af3e-42d9-b890-9a9c3683ae58 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:35:25 user nova-compute[74960]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7da48309-69f9-407d-81b1-9bd9aea03cd0 (non-flash)
Nov 03 12:35:25 user nova-compute[74960]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797 (non-flash)
Nov 03 12:35:25 user nova-compute[74960]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 (non-flash)
Nov 03 12:35:25 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:35:25 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bd46dc3-8710-4ce9-9e02-3d6c442fb90c -p 172.16.0.220:3260 --login {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:35:25 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7b95c0-3726-4a1c-a384-ec91abf75225/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:35:25 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7b95c0-3726-4a1c-a384-ec91abf75225/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:35:25 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-cbd8edb8-5b4d-484b-ae47-534468681521 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Acquiring lock "12ae6707-c1c6-4bc2-a409-67cea64fc2c3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:35:25 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-cbd8edb8-5b4d-484b-ae47-534468681521 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Lock "12ae6707-c1c6-4bc2-a409-67cea64fc2c3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.004s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:35:25 user nova-compute[74960]: INFO nova.compute.manager [None req-cbd8edb8-5b4d-484b-ae47-534468681521 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] [instance: 12ae6707-c1c6-4bc2-a409-67cea64fc2c3] Attaching volume 623b8c1d-ba2d-4bad-b0bd-71eefe783606 to /dev/vdb
Nov 03 12:35:25 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bd46dc3-8710-4ce9-9e02-3d6c442fb90c -p 172.16.0.220:3260 --login" returned: 0 in 0.124s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:35:25 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7f6002a-9ffd-489d-8af2-8efcdf3f8f9e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7bd46dc3-8710-4ce9-9e02-3d6c442fb90c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7bd46dc3-8710-4ce9-9e02-3d6c442fb90c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:35:25 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-53804013-af3e-42d9-b890-9a9c3683ae58 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7bd46dc3-8710-4ce9-9e02-3d6c442fb90c, portal: 172.16.0.220,3260]
Nov 03 12:35:25 user nova-compute[74960]: Login to [iface: default, target: iqn.2010-10.org.openstack:7bd46dc3-8710-4ce9-9e02-3d6c442fb90c, portal: 172.16.0.220,3260] successful.
Nov 03 12:35:25 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:35:25 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bd46dc3-8710-4ce9-9e02-3d6c442fb90c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:35:25 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bd46dc3-8710-4ce9-9e02-3d6c442fb90c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:35:25 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ad79e1b-31e4-4241-9389-14db62031644]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:35:25 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-53804013-af3e-42d9-b890-9a9c3683ae58 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:35:25 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:35:25 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:35:25 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7275266-dd8c-44d6-80f5-f5ef0cbf2991]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7da48309-69f9-407d-81b1-9bd9aea03cd0 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bd46dc3-8710-4ce9-9e02-3d6c442fb90c (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:35:25 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-53804013-af3e-42d9-b890-9a9c3683ae58 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:35:25 user nova-compute[74960]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7da48309-69f9-407d-81b1-9bd9aea03cd0 (non-flash)
Nov 03 12:35:25 user nova-compute[74960]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797 (non-flash)
Nov 03 12:35:25 user nova-compute[74960]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 (non-flash)
Nov 03 12:35:25 user nova-compute[74960]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bd46dc3-8710-4ce9-9e02-3d6c442fb90c (non-flash)
Nov 03 12:35:25 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:35:25 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-53804013-af3e-42d9-b890-9a9c3683ae58 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:35:25 user nova-compute[74960]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7da48309-69f9-407d-81b1-9bd9aea03cd0 (non-flash)
Nov 03 12:35:25 user nova-compute[74960]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797 (non-flash)
Nov 03 12:35:25 user nova-compute[74960]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 (non-flash)
Nov 03 12:35:25 user nova-compute[74960]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bd46dc3-8710-4ce9-9e02-3d6c442fb90c (non-flash)
Nov 03 12:35:25 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:35:25 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-53804013-af3e-42d9-b890-9a9c3683ae58 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7bd46dc3-8710-4ce9-9e02-3d6c442fb90c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.502s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:35:25 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-53804013-af3e-42d9-b890-9a9c3683ae58 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] Connected to 172.16.0.220:3260 {{(pid=74960) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 12:35:25 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-53804013-af3e-42d9-b890-9a9c3683ae58 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] HCTL ('37', '-', '-', 0) found on session 29 with lun 0 {{(pid=74960) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 12:35:25 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-53804013-af3e-42d9-b890-9a9c3683ae58 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74960) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 12:35:25 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:35:25 user nova-compute[74960]: DEBUG os_brick.utils [None req-cbd8edb8-5b4d-484b-ae47-534468681521 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:35:25 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:35:25 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.035s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:35:25 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[9de2cbaa-284d-4e7f-93a4-c1b48dda501b]: (4, ('- - 0', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:35:25 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-53804013-af3e-42d9-b890-9a9c3683ae58 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] Searching for a device in session 29 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74960) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 12:35:25 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-53804013-af3e-42d9-b890-9a9c3683ae58 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:7bd46dc3-8710-4ce9-9e02-3d6c442fb90c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lkFNzXAj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74960) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 12:35:25 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.027s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:35:25 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3edf70b-0516-462d-8a0d-b4d725bca581]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:75b8e219756\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:35:25 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:35:25 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:35:25 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[1635c2e6-0d77-4d5b-9771-b547c5d780d8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:35:25 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:35:25 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7b95c0-3726-4a1c-a384-ec91abf75225/disk --force-share --output=json" returned: 0 in 0.275s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:35:25 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74960) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 12:35:25 user nova-compute[74960]: DEBUG nova.objects.instance [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Lazy-loading 'trusted_certs' on Instance uuid 5b7b95c0-3726-4a1c-a384-ec91abf75225 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:35:25 user nova-compute[74960]: DEBUG nova.objects.base [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Object Instance<5b7b95c0-3726-4a1c-a384-ec91abf75225> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74960) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 12:35:25 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:35:25 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.027s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:35:25 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[17adf457-6127-43df-9964-8d480b6bb550]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:35:25 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[25a48afe-7006-44ac-88e1-d0addb9421cb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:35:25 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-cbd8edb8-5b4d-484b-ae47-534468681521 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Running cmd (subprocess): nvme version {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:35:25 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-cbd8edb8-5b4d-484b-ae47-534468681521 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] 'nvme version' failed. Not Retrying. {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 12:35:25 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cbd8edb8-5b4d-484b-ae47-534468681521 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] nvme not present on system {{(pid=74960) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 12:35:25 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:35:25 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 12:35:25 user nova-compute[74960]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 12:35:25 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b459126-c9db-4154-90e8-f898dd0f9e90]: (4, '') {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:35:25 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-cbd8edb8-5b4d-484b-ae47-534468681521 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74960) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 12:35:25 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-cbd8edb8-5b4d-484b-ae47-534468681521 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74960) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 12:35:25 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-cbd8edb8-5b4d-484b-ae47-534468681521 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] LIGHTOS: no hostnqn found. {{(pid=74960) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 12:35:25 user nova-compute[74960]: DEBUG os_brick.utils [None req-cbd8edb8-5b4d-484b-ae47-534468681521 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] <== get_connector_properties: return (198ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:75b8e219756', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:35:25 user nova-compute[74960]: DEBUG nova.virt.block_device [None req-cbd8edb8-5b4d-484b-ae47-534468681521 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] [instance: 12ae6707-c1c6-4bc2-a409-67cea64fc2c3] Updating existing volume attachment record: 76e79325-a7ea-4882-9e07-c0d4fd244a08 {{(pid=74960) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 12:35:25 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.215s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:35:25 user nova-compute[74960]: DEBUG nova.virt.disk.api [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5b7b95c0-3726-4a1c-a384-ec91abf75225/disk. size=1073741824 {{(pid=74960) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 12:35:25 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7b95c0-3726-4a1c-a384-ec91abf75225/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:35:25 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7b95c0-3726-4a1c-a384-ec91abf75225/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:35:25 user nova-compute[74960]: DEBUG nova.virt.disk.api [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Cannot resize image /opt/stack/data/nova/instances/5b7b95c0-3726-4a1c-a384-ec91abf75225/disk to a smaller size. {{(pid=74960) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 12:35:25 user nova-compute[74960]: DEBUG nova.objects.instance [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Lazy-loading 'migration_context' on Instance uuid 5b7b95c0-3726-4a1c-a384-ec91abf75225 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:35:25 user nova-compute[74960]: DEBUG nova.objects.base [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Object Instance<5b7b95c0-3726-4a1c-a384-ec91abf75225> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74960) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 12:35:25 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:30:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-666638080',display_name='tempest-AttachVolumeTestJSON-server-666638080',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-666638080',id=28,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIQ2G2kW7RG3ei1U+rVcmbI+Ton8kNiQZeMxqXkABUJCy9iuRMgTZBhGnWGCs6R7DHln/91d5py8pZC0KUaGy+7UnlGfb1FgAKzTpiPtdr0uDnrIs+6hQLHu9y+wv2TiKg==',key_name='tempest-keypair-691388173',keypairs=<?>,launch_index=0,launched_at=2023-11-03T12:30:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='a9160afcfdb74ba2aad7bc79e628e96f',ramdisk_id='',reservation_id='r-na1kxuhs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-847320603',owner_user_name='tempest-AttachVolumeTestJSON-847320603-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:33:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c599d8677454b60b9434689322a6de2',uuid=5b7b95c0-3726-4a1c-a384-ec91abf75225,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "091cbb89-dd8a-448e-963a-3dbcafde6bb1", "address": "fa:16:3e:cc:a5:1b", "network": {"id": "3eaeac55-9eb7-4301-b5a7-d13735656d8e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-826950903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9160afcfdb74ba2aad7bc79e628e96f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap091cbb89-dd", "ovs_interfaceid": "091cbb89-dd8a-448e-963a-3dbcafde6bb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 12:35:25 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Converting VIF {"id": "091cbb89-dd8a-448e-963a-3dbcafde6bb1", "address": "fa:16:3e:cc:a5:1b", "network": {"id": "3eaeac55-9eb7-4301-b5a7-d13735656d8e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-826950903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9160afcfdb74ba2aad7bc79e628e96f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap091cbb89-dd", "ovs_interfaceid": "091cbb89-dd8a-448e-963a-3dbcafde6bb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:35:25 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:a5:1b,bridge_name='br-int',has_traffic_filtering=True,id=091cbb89-dd8a-448e-963a-3dbcafde6bb1,network=Network(3eaeac55-9eb7-4301-b5a7-d13735656d8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap091cbb89-dd') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:35:25 user nova-compute[74960]: DEBUG os_vif [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:a5:1b,bridge_name='br-int',has_traffic_filtering=True,id=091cbb89-dd8a-448e-963a-3dbcafde6bb1,network=Network(3eaeac55-9eb7-4301-b5a7-d13735656d8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap091cbb89-dd') {{(pid=74960) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 12:35:25 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:35:25 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:35:25 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 12:35:25 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:35:25 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd1f60e77-fecd-575c-9f11-876b6007512b', '_type': 'linux-noop'}}, row=False) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:35:25 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:35:25 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:35:25 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:35:25 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap091cbb89-dd, may_exist=True, interface_attrs={}) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:35:25 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap091cbb89-dd, col_values=(('qos', UUID('731582ce-16eb-4b33-b60e-f5a6837e819b')),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:35:25 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap091cbb89-dd, col_values=(('external_ids', {'iface-id': '091cbb89-dd8a-448e-963a-3dbcafde6bb1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cc:a5:1b', 'vm-uuid': '5b7b95c0-3726-4a1c-a384-ec91abf75225'}),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:35:25 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:35:25 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:35:25 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:35:25 user nova-compute[74960]: INFO os_vif [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:a5:1b,bridge_name='br-int',has_traffic_filtering=True,id=091cbb89-dd8a-448e-963a-3dbcafde6bb1,network=Network(3eaeac55-9eb7-4301-b5a7-d13735656d8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap091cbb89-dd')
Nov 03 12:35:26 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-53804013-af3e-42d9-b890-9a9c3683ae58 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.558s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:35:26 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-53804013-af3e-42d9-b890-9a9c3683ae58 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] <== connect_volume: return (2065ms) {'type': 'block', 'scsi_wwn': '26337343466333735', 'path': '/dev/sdf'} {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:35:26 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53804013-af3e-42d9-b890-9a9c3683ae58 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] [instance: 9c447082-b59b-4c8e-8fa0-bf6599a84e91] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26337343466333735', 'path': '/dev/sdf'} {{(pid=74960) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 12:35:26 user nova-compute[74960]: DEBUG nova.objects.instance [None req-53804013-af3e-42d9-b890-9a9c3683ae58 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] Lazy-loading 'flavor' on Instance uuid 9c447082-b59b-4c8e-8fa0-bf6599a84e91 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:35:26 user nova-compute[74960]: DEBUG nova.virt.libvirt.guest [None req-53804013-af3e-42d9-b890-9a9c3683ae58 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] attach device xml: <disk type="block" device="disk">
Nov 03 12:35:26 user nova-compute[74960]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 12:35:26 user nova-compute[74960]:   <source dev="/dev/sdf"/>
Nov 03 12:35:26 user nova-compute[74960]:   <target dev="vdb" bus="virtio"/>
Nov 03 12:35:26 user nova-compute[74960]:   <serial>7bd46dc3-8710-4ce9-9e02-3d6c442fb90c</serial>
Nov 03 12:35:26 user nova-compute[74960]: </disk>
Nov 03 12:35:26 user nova-compute[74960]:  {{(pid=74960) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 03 12:35:27 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-53804013-af3e-42d9-b890-9a9c3683ae58 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] No BDM found with device name vda, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:35:27 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-53804013-af3e-42d9-b890-9a9c3683ae58 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:35:27 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-53804013-af3e-42d9-b890-9a9c3683ae58 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] No VIF found with MAC fa:16:3e:fd:9d:36, not building metadata {{(pid=74960) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 12:35:27 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-53804013-af3e-42d9-b890-9a9c3683ae58 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] Lock "9c447082-b59b-4c8e-8fa0-bf6599a84e91" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.555s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:35:27 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:35:27 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:35:27 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:35:27 user nova-compute[74960]: DEBUG nova.compute.manager [None req-043c20cb-2b73-4753-a483-a4df484883c9 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: b7606a55-d5c3-4ba8-b499-f3c70813f151] Checking state {{(pid=74960) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 12:35:27 user nova-compute[74960]: INFO nova.compute.manager [None req-043c20cb-2b73-4753-a483-a4df484883c9 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: b7606a55-d5c3-4ba8-b499-f3c70813f151] instance snapshotting
Nov 03 12:35:27 user nova-compute[74960]: DEBUG nova.compute.manager [req-14974c63-ceec-4128-8d2e-453aa8b12bfa req-654b912a-c464-45d3-bc02-5fc40adb974b service nova] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] Received event network-vif-plugged-091cbb89-dd8a-448e-963a-3dbcafde6bb1 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:35:27 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-14974c63-ceec-4128-8d2e-453aa8b12bfa req-654b912a-c464-45d3-bc02-5fc40adb974b service nova] Acquiring lock "5b7b95c0-3726-4a1c-a384-ec91abf75225-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:35:27 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-14974c63-ceec-4128-8d2e-453aa8b12bfa req-654b912a-c464-45d3-bc02-5fc40adb974b service nova] Lock "5b7b95c0-3726-4a1c-a384-ec91abf75225-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:35:27 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-14974c63-ceec-4128-8d2e-453aa8b12bfa req-654b912a-c464-45d3-bc02-5fc40adb974b service nova] Lock "5b7b95c0-3726-4a1c-a384-ec91abf75225-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:35:27 user nova-compute[74960]: DEBUG nova.compute.manager [req-14974c63-ceec-4128-8d2e-453aa8b12bfa req-654b912a-c464-45d3-bc02-5fc40adb974b service nova] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] No waiting events found dispatching network-vif-plugged-091cbb89-dd8a-448e-963a-3dbcafde6bb1 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:35:27 user nova-compute[74960]: WARNING nova.compute.manager [req-14974c63-ceec-4128-8d2e-453aa8b12bfa req-654b912a-c464-45d3-bc02-5fc40adb974b service nova] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] Received unexpected event network-vif-plugged-091cbb89-dd8a-448e-963a-3dbcafde6bb1 for instance with vm_state stopped and task_state powering-on.
Nov 03 12:35:28 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-043c20cb-2b73-4753-a483-a4df484883c9 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: b7606a55-d5c3-4ba8-b499-f3c70813f151] Beginning live snapshot process
Nov 03 12:35:28 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-043c20cb-2b73-4753-a483-a4df484883c9 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7606a55-d5c3-4ba8-b499-f3c70813f151/disk --force-share --output=json -f qcow2 {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:35:28 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-043c20cb-2b73-4753-a483-a4df484883c9 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7606a55-d5c3-4ba8-b499-f3c70813f151/disk --force-share --output=json -f qcow2" returned: 0 in 0.179s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:35:28 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-043c20cb-2b73-4753-a483-a4df484883c9 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7606a55-d5c3-4ba8-b499-f3c70813f151/disk --force-share --output=json -f qcow2 {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:35:28 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:35:28 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:35:28 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:35:28 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-043c20cb-2b73-4753-a483-a4df484883c9 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7606a55-d5c3-4ba8-b499-f3c70813f151/disk --force-share --output=json -f qcow2" returned: 0 in 0.199s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:35:28 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-043c20cb-2b73-4753-a483-a4df484883c9 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:35:28 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-043c20cb-2b73-4753-a483-a4df484883c9 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.199s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:35:28 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-043c20cb-2b73-4753-a483-a4df484883c9 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp1okzuqms/da9e4359684f450794fc34c6d6d7ab8c.delta 1073741824 {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:35:28 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-043c20cb-2b73-4753-a483-a4df484883c9 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp1okzuqms/da9e4359684f450794fc34c6d6d7ab8c.delta 1073741824" returned: 0 in 0.051s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:35:28 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-043c20cb-2b73-4753-a483-a4df484883c9 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: b7606a55-d5c3-4ba8-b499-f3c70813f151] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 03 12:35:29 user nova-compute[74960]: DEBUG nova.virt.libvirt.guest [None req-043c20cb-2b73-4753-a483-a4df484883c9 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74960) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 03 12:35:29 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-eb70e217-ba16-495b-98a3-2f37ed512cbb tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] Acquiring lock "9c447082-b59b-4c8e-8fa0-bf6599a84e91" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:35:29 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-eb70e217-ba16-495b-98a3-2f37ed512cbb tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] Lock "9c447082-b59b-4c8e-8fa0-bf6599a84e91" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:35:29 user nova-compute[74960]: INFO nova.compute.manager [None req-eb70e217-ba16-495b-98a3-2f37ed512cbb tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] [instance: 9c447082-b59b-4c8e-8fa0-bf6599a84e91] Detaching volume 7bd46dc3-8710-4ce9-9e02-3d6c442fb90c
Nov 03 12:35:30 user nova-compute[74960]: INFO nova.virt.block_device [None req-eb70e217-ba16-495b-98a3-2f37ed512cbb tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] [instance: 9c447082-b59b-4c8e-8fa0-bf6599a84e91] Attempting to driver detach volume 7bd46dc3-8710-4ce9-9e02-3d6c442fb90c from mountpoint /dev/vdb
Nov 03 12:35:30 user nova-compute[74960]: DEBUG nova.compute.manager [req-e4ff5589-3dc6-461f-87da-29f92499696a req-8b1a68ab-3e10-4f11-a086-22d027bb50ab service nova] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] Received event network-vif-plugged-091cbb89-dd8a-448e-963a-3dbcafde6bb1 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:35:30 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-e4ff5589-3dc6-461f-87da-29f92499696a req-8b1a68ab-3e10-4f11-a086-22d027bb50ab service nova] Acquiring lock "5b7b95c0-3726-4a1c-a384-ec91abf75225-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:35:30 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-e4ff5589-3dc6-461f-87da-29f92499696a req-8b1a68ab-3e10-4f11-a086-22d027bb50ab service nova] Lock "5b7b95c0-3726-4a1c-a384-ec91abf75225-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:35:30 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-e4ff5589-3dc6-461f-87da-29f92499696a req-8b1a68ab-3e10-4f11-a086-22d027bb50ab service nova] Lock "5b7b95c0-3726-4a1c-a384-ec91abf75225-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:35:30 user nova-compute[74960]: DEBUG nova.compute.manager [req-e4ff5589-3dc6-461f-87da-29f92499696a req-8b1a68ab-3e10-4f11-a086-22d027bb50ab service nova] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] No waiting events found dispatching network-vif-plugged-091cbb89-dd8a-448e-963a-3dbcafde6bb1 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:35:30 user nova-compute[74960]: WARNING nova.compute.manager [req-e4ff5589-3dc6-461f-87da-29f92499696a req-8b1a68ab-3e10-4f11-a086-22d027bb50ab service nova] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] Received unexpected event network-vif-plugged-091cbb89-dd8a-448e-963a-3dbcafde6bb1 for instance with vm_state stopped and task_state powering-on.
Nov 03 12:35:30 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-eb70e217-ba16-495b-98a3-2f37ed512cbb tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] Attempting to detach device vdb from instance 9c447082-b59b-4c8e-8fa0-bf6599a84e91 from the persistent domain config. {{(pid=74960) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 03 12:35:30 user nova-compute[74960]: DEBUG nova.virt.libvirt.guest [None req-eb70e217-ba16-495b-98a3-2f37ed512cbb tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 12:35:30 user nova-compute[74960]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 12:35:30 user nova-compute[74960]:   <source dev="/dev/sdf"/>
Nov 03 12:35:30 user nova-compute[74960]:   <target dev="vdb" bus="virtio"/>
Nov 03 12:35:30 user nova-compute[74960]:   <serial>7bd46dc3-8710-4ce9-9e02-3d6c442fb90c</serial>
Nov 03 12:35:30 user nova-compute[74960]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 12:35:30 user nova-compute[74960]: </disk>
Nov 03 12:35:30 user nova-compute[74960]:  {{(pid=74960) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 12:35:30 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-eb70e217-ba16-495b-98a3-2f37ed512cbb tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] Successfully detached device vdb from instance 9c447082-b59b-4c8e-8fa0-bf6599a84e91 from the persistent domain config.
Nov 03 12:35:30 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-eb70e217-ba16-495b-98a3-2f37ed512cbb tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9c447082-b59b-4c8e-8fa0-bf6599a84e91 from the live domain config. {{(pid=74960) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 03 12:35:30 user nova-compute[74960]: DEBUG nova.virt.libvirt.guest [None req-eb70e217-ba16-495b-98a3-2f37ed512cbb tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 12:35:30 user nova-compute[74960]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 12:35:30 user nova-compute[74960]:   <source dev="/dev/sdf"/>
Nov 03 12:35:30 user nova-compute[74960]:   <target dev="vdb" bus="virtio"/>
Nov 03 12:35:30 user nova-compute[74960]:   <serial>7bd46dc3-8710-4ce9-9e02-3d6c442fb90c</serial>
Nov 03 12:35:30 user nova-compute[74960]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 12:35:30 user nova-compute[74960]: </disk>
Nov 03 12:35:30 user nova-compute[74960]:  {{(pid=74960) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 12:35:30 user nova-compute[74960]: DEBUG nova.virt.libvirt.guest [None req-043c20cb-2b73-4753-a483-a4df484883c9 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74960) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 03 12:35:30 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-043c20cb-2b73-4753-a483-a4df484883c9 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: b7606a55-d5c3-4ba8-b499-f3c70813f151] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 03 12:35:30 user nova-compute[74960]: DEBUG nova.compute.manager [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] Instance event wait completed in 0 seconds for  {{(pid=74960) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 12:35:30 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] Instance rebooted successfully.
Nov 03 12:35:30 user nova-compute[74960]: DEBUG nova.compute.manager [None req-5f6df223-7382-4454-a9f1-909487098349 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] Checking state {{(pid=74960) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 12:35:30 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-eb70e217-ba16-495b-98a3-2f37ed512cbb tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9c447082-b59b-4c8e-8fa0-bf6599a84e91 {{(pid=74960) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 03 12:35:30 user nova-compute[74960]: DEBUG nova.privsep.utils [None req-043c20cb-2b73-4753-a483-a4df484883c9 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74960) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 03 12:35:30 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-043c20cb-2b73-4753-a483-a4df484883c9 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp1okzuqms/da9e4359684f450794fc34c6d6d7ab8c.delta /opt/stack/data/nova/instances/snapshots/tmp1okzuqms/da9e4359684f450794fc34c6d6d7ab8c {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:35:30 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:35:31 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-043c20cb-2b73-4753-a483-a4df484883c9 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp1okzuqms/da9e4359684f450794fc34c6d6d7ab8c.delta /opt/stack/data/nova/instances/snapshots/tmp1okzuqms/da9e4359684f450794fc34c6d6d7ab8c" returned: 0 in 0.589s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:35:31 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-043c20cb-2b73-4753-a483-a4df484883c9 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: b7606a55-d5c3-4ba8-b499-f3c70813f151] Snapshot extracted, beginning image upload
Nov 03 12:35:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:35:34 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-043c20cb-2b73-4753-a483-a4df484883c9 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: b7606a55-d5c3-4ba8-b499-f3c70813f151] Snapshot image upload complete
Nov 03 12:35:34 user nova-compute[74960]: INFO nova.compute.manager [None req-043c20cb-2b73-4753-a483-a4df484883c9 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: b7606a55-d5c3-4ba8-b499-f3c70813f151] Took 6.86 seconds to snapshot the instance on the hypervisor.
Nov 03 12:35:35 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:35:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:35:40 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:35:43 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:35:44 user nova-compute[74960]: DEBUG nova.compute.manager [None req-337c44e2-17bf-430d-82b5-d0358fe270a1 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] Start spawning the instance on the hypervisor. {{(pid=74960) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 12:35:44 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-337c44e2-17bf-430d-82b5-d0358fe270a1 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] Creating instance directory {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 12:35:44 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-337c44e2-17bf-430d-82b5-d0358fe270a1 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] Creating image(s)
Nov 03 12:35:44 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-337c44e2-17bf-430d-82b5-d0358fe270a1 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] Did not create local disks {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 03 12:35:44 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-337c44e2-17bf-430d-82b5-d0358fe270a1 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] Ensure instance console log exists: /opt/stack/data/nova/instances/27aa03bb-5613-4bde-8bc0-30517f5d48ae/console.log {{(pid=74960) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 12:35:44 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-337c44e2-17bf-430d-82b5-d0358fe270a1 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:35:44 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-337c44e2-17bf-430d-82b5-d0358fe270a1 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:35:44 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-337c44e2-17bf-430d-82b5-d0358fe270a1 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:35:44 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-337c44e2-17bf-430d-82b5-d0358fe270a1 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] Start _get_guest_xml network_info=[{"id": "16df3da7-2b2a-4c74-bb06-779696d25b88", "address": "fa:16:3e:2a:35:94", "network": {"id": "4a77f235-def4-4456-8f4a-99bf5769e015", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1480494760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "384450261e1f45048eb9b4b431ce8bd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16df3da7-2b", "ovs_interfaceid": "16df3da7-2b2a-4c74-bb06-779696d25b88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'snapNwyo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '27aa03bb-5613-4bde-8bc0-30517f5d48ae', 'attached_at': '', 'detached_at': '', 'volume_id': '0d9b574a-cdd4-4118-a061-dfe393a5cd61', 'serial': '0d9b574a-cdd4-4118-a061-dfe393a5cd61'}, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'device_type': 'disk', 'attachment_id': '7d75898d-3d12-4a5a-85bd-7d52afebd9ea', 'boot_index': 0, 'guest_format': None, 'volume_type': None} {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 12:35:44 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-337c44e2-17bf-430d-82b5-d0358fe270a1 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:35:44 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-337c44e2-17bf-430d-82b5-d0358fe270a1 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:35:44 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-337c44e2-17bf-430d-82b5-d0358fe270a1 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 12:35:44 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-337c44e2-17bf-430d-82b5-d0358fe270a1 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] CPU controller missing on host. {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 12:35:44 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-337c44e2-17bf-430d-82b5-d0358fe270a1 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 12:35:44 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-337c44e2-17bf-430d-82b5-d0358fe270a1 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] CPU controller found on host. {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 12:35:44 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-337c44e2-17bf-430d-82b5-d0358fe270a1 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74960) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 12:35:44 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-337c44e2-17bf-430d-82b5-d0358fe270a1 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 12:35:44 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-337c44e2-17bf-430d-82b5-d0358fe270a1 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Flavor limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 12:35:44 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-337c44e2-17bf-430d-82b5-d0358fe270a1 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Image limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 12:35:44 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-337c44e2-17bf-430d-82b5-d0358fe270a1 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Flavor pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 12:35:44 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-337c44e2-17bf-430d-82b5-d0358fe270a1 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Image pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 12:35:44 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-337c44e2-17bf-430d-82b5-d0358fe270a1 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 12:35:44 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-337c44e2-17bf-430d-82b5-d0358fe270a1 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 12:35:44 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-337c44e2-17bf-430d-82b5-d0358fe270a1 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 12:35:44 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-337c44e2-17bf-430d-82b5-d0358fe270a1 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Got 1 possible topologies {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 12:35:44 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-337c44e2-17bf-430d-82b5-d0358fe270a1 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 12:35:44 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-337c44e2-17bf-430d-82b5-d0358fe270a1 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 12:35:44 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-337c44e2-17bf-430d-82b5-d0358fe270a1 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] Calling os-brick to attach iSCSI Volume {{(pid=74960) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 12:35:44 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-337c44e2-17bf-430d-82b5-d0358fe270a1 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9aa420acb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'snapNwyo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:35:44 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-337c44e2-17bf-430d-82b5-d0358fe270a1 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:35:44 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-337c44e2-17bf-430d-82b5-d0358fe270a1 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:35:44 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-337c44e2-17bf-430d-82b5-d0358fe270a1 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:35:44 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-337c44e2-17bf-430d-82b5-d0358fe270a1 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:35:44 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-337c44e2-17bf-430d-82b5-d0358fe270a1 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:35:44 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-337c44e2-17bf-430d-82b5-d0358fe270a1 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:35:44 user nova-compute[74960]: INFO os_brick.initiator.connectors.iscsi [None req-337c44e2-17bf-430d-82b5-d0358fe270a1 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 12:35:44 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61 -p 172.16.0.220:3260 {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:35:44 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:35:44 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a888925-c556-486a-a576-3a6e8cac0620]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:35:44 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-337c44e2-17bf-430d-82b5-d0358fe270a1 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 12:35:44 user nova-compute[74960]:  {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:35:44 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61 -p 172.16.0.220:3260 --interface default --op new {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:35:44 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:35:44 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5e5286f-67b4-46b5-8941-2319a130edae]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61] added\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:35:44 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-337c44e2-17bf-430d-82b5-d0358fe270a1 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61] added
Nov 03 12:35:44 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:35:44 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:35:44 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:35:44 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb8f68cc-bd24-4b31-bd5e-bf97fee3acda]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:35:44 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-337c44e2-17bf-430d-82b5-d0358fe270a1 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:35:44 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:35:44 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:35:44 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ca0f4a7-b007-485b-a6ce-a238491ae2fe]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:35:44 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-337c44e2-17bf-430d-82b5-d0358fe270a1 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:35:44 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v snapNwyo {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:35:44 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v snapNwyo" returned: 0 in 0.024s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:35:44 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[e728ad0c-8f93-4e41-aabc-4ffd2faa32d0]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:35:44 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-337c44e2-17bf-430d-82b5-d0358fe270a1 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'snapNwyo'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:35:44 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:35:44 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:35:44 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[86f5eaa4-e469-4e8d-a7d8-8680402506d2]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:35:44 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-337c44e2-17bf-430d-82b5-d0358fe270a1 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:35:44 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:35:44 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:35:44 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[d971c8bd-d26d-473f-8b4b-b96f6feb93f3]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7da48309-69f9-407d-81b1-9bd9aea03cd0 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bd46dc3-8710-4ce9-9e02-3d6c442fb90c (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:35:44 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-337c44e2-17bf-430d-82b5-d0358fe270a1 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:35:44 user nova-compute[74960]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7da48309-69f9-407d-81b1-9bd9aea03cd0 (non-flash)
Nov 03 12:35:44 user nova-compute[74960]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797 (non-flash)
Nov 03 12:35:44 user nova-compute[74960]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 (non-flash)
Nov 03 12:35:44 user nova-compute[74960]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bd46dc3-8710-4ce9-9e02-3d6c442fb90c (non-flash)
Nov 03 12:35:44 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:35:44 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-337c44e2-17bf-430d-82b5-d0358fe270a1 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:35:44 user nova-compute[74960]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7da48309-69f9-407d-81b1-9bd9aea03cd0 (non-flash)
Nov 03 12:35:44 user nova-compute[74960]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797 (non-flash)
Nov 03 12:35:44 user nova-compute[74960]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 (non-flash)
Nov 03 12:35:44 user nova-compute[74960]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bd46dc3-8710-4ce9-9e02-3d6c442fb90c (non-flash)
Nov 03 12:35:44 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:35:44 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61 -p 172.16.0.220:3260 --login {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:35:44 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-b8f6ad3b-2a2e-4269-8a29-635d0ec6f43f tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Acquiring lock "35e02c80-f626-4918-93f1-6b9a7f778c7a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:35:44 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-b8f6ad3b-2a2e-4269-8a29-635d0ec6f43f tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Lock "35e02c80-f626-4918-93f1-6b9a7f778c7a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:35:44 user nova-compute[74960]: INFO nova.compute.manager [None req-b8f6ad3b-2a2e-4269-8a29-635d0ec6f43f tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a] Detaching volume 7da48309-69f9-407d-81b1-9bd9aea03cd0
Nov 03 12:35:44 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61 -p 172.16.0.220:3260 --login" returned: 0 in 0.094s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:35:44 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7716915-06b5-4799-b7e2-2c05d349b6c5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:35:44 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-337c44e2-17bf-430d-82b5-d0358fe270a1 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61, portal: 172.16.0.220,3260]
Nov 03 12:35:44 user nova-compute[74960]: Login to [iface: default, target: iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61, portal: 172.16.0.220,3260] successful.
Nov 03 12:35:44 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:35:44 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:35:44 user nova-compute[74960]: INFO nova.virt.block_device [None req-b8f6ad3b-2a2e-4269-8a29-635d0ec6f43f tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a] Attempting to driver detach volume 7da48309-69f9-407d-81b1-9bd9aea03cd0 from mountpoint /dev/vdb
Nov 03 12:35:44 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:35:44 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b6cb90e-de09-46db-b05c-0e741b0f25c3]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:35:44 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-337c44e2-17bf-430d-82b5-d0358fe270a1 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:35:45 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-b8f6ad3b-2a2e-4269-8a29-635d0ec6f43f tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Attempting to detach device vdb from instance 35e02c80-f626-4918-93f1-6b9a7f778c7a from the persistent domain config. {{(pid=74960) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 03 12:35:45 user nova-compute[74960]: DEBUG nova.virt.libvirt.guest [None req-b8f6ad3b-2a2e-4269-8a29-635d0ec6f43f tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 12:35:45 user nova-compute[74960]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 12:35:45 user nova-compute[74960]:   <source dev="/dev/sdb"/>
Nov 03 12:35:45 user nova-compute[74960]:   <target dev="vdb" bus="virtio"/>
Nov 03 12:35:45 user nova-compute[74960]:   <serial>7da48309-69f9-407d-81b1-9bd9aea03cd0</serial>
Nov 03 12:35:45 user nova-compute[74960]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 12:35:45 user nova-compute[74960]: </disk>
Nov 03 12:35:45 user nova-compute[74960]:  {{(pid=74960) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 12:35:45 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:35:45 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-b8f6ad3b-2a2e-4269-8a29-635d0ec6f43f tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Successfully detached device vdb from instance 35e02c80-f626-4918-93f1-6b9a7f778c7a from the persistent domain config.
Nov 03 12:35:45 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-b8f6ad3b-2a2e-4269-8a29-635d0ec6f43f tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 35e02c80-f626-4918-93f1-6b9a7f778c7a from the live domain config. {{(pid=74960) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 03 12:35:45 user nova-compute[74960]: DEBUG nova.virt.libvirt.guest [None req-b8f6ad3b-2a2e-4269-8a29-635d0ec6f43f tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 12:35:45 user nova-compute[74960]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 12:35:45 user nova-compute[74960]:   <source dev="/dev/sdb"/>
Nov 03 12:35:45 user nova-compute[74960]:   <target dev="vdb" bus="virtio"/>
Nov 03 12:35:45 user nova-compute[74960]:   <serial>7da48309-69f9-407d-81b1-9bd9aea03cd0</serial>
Nov 03 12:35:45 user nova-compute[74960]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 12:35:45 user nova-compute[74960]: </disk>
Nov 03 12:35:45 user nova-compute[74960]:  {{(pid=74960) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 12:35:45 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:35:45 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[147258e9-5220-435b-ac05-a270e03107bb]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7da48309-69f9-407d-81b1-9bd9aea03cd0 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bd46dc3-8710-4ce9-9e02-3d6c442fb90c (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61 (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:35:45 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-337c44e2-17bf-430d-82b5-d0358fe270a1 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:35:45 user nova-compute[74960]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7da48309-69f9-407d-81b1-9bd9aea03cd0 (non-flash)
Nov 03 12:35:45 user nova-compute[74960]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797 (non-flash)
Nov 03 12:35:45 user nova-compute[74960]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 (non-flash)
Nov 03 12:35:45 user nova-compute[74960]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bd46dc3-8710-4ce9-9e02-3d6c442fb90c (non-flash)
Nov 03 12:35:45 user nova-compute[74960]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61 (non-flash)
Nov 03 12:35:45 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:35:45 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-337c44e2-17bf-430d-82b5-d0358fe270a1 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:35:45 user nova-compute[74960]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7da48309-69f9-407d-81b1-9bd9aea03cd0 (non-flash)
Nov 03 12:35:45 user nova-compute[74960]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797 (non-flash)
Nov 03 12:35:45 user nova-compute[74960]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 (non-flash)
Nov 03 12:35:45 user nova-compute[74960]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bd46dc3-8710-4ce9-9e02-3d6c442fb90c (non-flash)
Nov 03 12:35:45 user nova-compute[74960]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61 (non-flash)
Nov 03 12:35:45 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:35:45 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-337c44e2-17bf-430d-82b5-d0358fe270a1 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.365s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:35:45 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-337c44e2-17bf-430d-82b5-d0358fe270a1 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Connected to 172.16.0.220:3260 {{(pid=74960) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 12:35:45 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-337c44e2-17bf-430d-82b5-d0358fe270a1 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] HCTL ('38', '-', '-', 0) found on session 30 with lun 0 {{(pid=74960) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 12:35:45 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-337c44e2-17bf-430d-82b5-d0358fe270a1 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74960) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 12:35:45 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:35:45 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.023s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:35:45 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e1b4710-bf38-43fd-83cd-ff298378cb98]: (4, ('- - 0', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:35:45 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-337c44e2-17bf-430d-82b5-d0358fe270a1 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Searching for a device in session 30 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74960) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 12:35:45 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-337c44e2-17bf-430d-82b5-d0358fe270a1 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'snapNwyo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74960) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 12:35:45 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-b8f6ad3b-2a2e-4269-8a29-635d0ec6f43f tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 35e02c80-f626-4918-93f1-6b9a7f778c7a {{(pid=74960) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 03 12:35:45 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:35:46 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-337c44e2-17bf-430d-82b5-d0358fe270a1 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.413s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:35:46 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-337c44e2-17bf-430d-82b5-d0358fe270a1 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] <== connect_volume: return (1415ms) {'type': 'block', 'scsi_wwn': '23934663164333132', 'path': '/dev/sdg'} {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:35:46 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-337c44e2-17bf-430d-82b5-d0358fe270a1 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23934663164333132', 'path': '/dev/sdg'} {{(pid=74960) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 12:35:46 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-337c44e2-17bf-430d-82b5-d0358fe270a1 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:35:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1532854274',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1532854274',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBYDYy6Yd4oTzqRmBgqOf0CT+Ul+2zedFmBjf4dct/ZgF3BtxBCHh2RqZpmfNUQqxXAXGv7pJgRz8+RxPwCi1ZxZq5Sw+Pludb9D/l5gQkHYcqClTVAMzGUWUIaG18LSIg==',key_name='tempest-keypair-807064414',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='384450261e1f45048eb9b4b431ce8bd5',ramdisk_id='',reservation_id='r-e40nqd7j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-999594459',owner_user_name='tempest-ServerActionsV293TestJSON-999594459-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:35:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2a983db9b51c44938095b72874dddcf9',uuid=27aa03bb-5613-4bde-8bc0-30517f5d48ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "16df3da7-2b2a-4c74-bb06-779696d25b88", "address": "fa:16:3e:2a:35:94", "network": {"id": "4a77f235-def4-4456-8f4a-99bf5769e015", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1480494760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "384450261e1f45048eb9b4b431ce8bd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16df3da7-2b", "ovs_interfaceid": "16df3da7-2b2a-4c74-bb06-779696d25b88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74960) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 12:35:46 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-337c44e2-17bf-430d-82b5-d0358fe270a1 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Converting VIF {"id": "16df3da7-2b2a-4c74-bb06-779696d25b88", "address": "fa:16:3e:2a:35:94", "network": {"id": "4a77f235-def4-4456-8f4a-99bf5769e015", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1480494760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "384450261e1f45048eb9b4b431ce8bd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16df3da7-2b", "ovs_interfaceid": "16df3da7-2b2a-4c74-bb06-779696d25b88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:35:46 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-337c44e2-17bf-430d-82b5-d0358fe270a1 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:35:94,bridge_name='br-int',has_traffic_filtering=True,id=16df3da7-2b2a-4c74-bb06-779696d25b88,network=Network(4a77f235-def4-4456-8f4a-99bf5769e015),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16df3da7-2b') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:35:46 user nova-compute[74960]: DEBUG nova.objects.instance [None req-337c44e2-17bf-430d-82b5-d0358fe270a1 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Lazy-loading 'pci_devices' on Instance uuid 27aa03bb-5613-4bde-8bc0-30517f5d48ae {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:35:46 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-337c44e2-17bf-430d-82b5-d0358fe270a1 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] End _get_guest_xml xml=<domain type="kvm">
Nov 03 12:35:46 user nova-compute[74960]:   <uuid>27aa03bb-5613-4bde-8bc0-30517f5d48ae</uuid>
Nov 03 12:35:46 user nova-compute[74960]:   <name>instance-00000024</name>
Nov 03 12:35:46 user nova-compute[74960]:   <memory>524288</memory>
Nov 03 12:35:46 user nova-compute[74960]:   <vcpu>1</vcpu>
Nov 03 12:35:46 user nova-compute[74960]:   <metadata>
Nov 03 12:35:46 user nova-compute[74960]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 12:35:46 user nova-compute[74960]:       <nova:package version="0.0.0"/>
Nov 03 12:35:46 user nova-compute[74960]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1532854274</nova:name>
Nov 03 12:35:46 user nova-compute[74960]:       <nova:creationTime>2023-11-03 12:35:44</nova:creationTime>
Nov 03 12:35:46 user nova-compute[74960]:       <nova:flavor name="m1.tiny">
Nov 03 12:35:46 user nova-compute[74960]:         <nova:memory>512</nova:memory>
Nov 03 12:35:46 user nova-compute[74960]:         <nova:disk>1</nova:disk>
Nov 03 12:35:46 user nova-compute[74960]:         <nova:swap>0</nova:swap>
Nov 03 12:35:46 user nova-compute[74960]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 12:35:46 user nova-compute[74960]:         <nova:vcpus>1</nova:vcpus>
Nov 03 12:35:46 user nova-compute[74960]:       </nova:flavor>
Nov 03 12:35:46 user nova-compute[74960]:       <nova:owner>
Nov 03 12:35:46 user nova-compute[74960]:         <nova:user uuid="2a983db9b51c44938095b72874dddcf9">tempest-ServerActionsV293TestJSON-999594459-project-member</nova:user>
Nov 03 12:35:46 user nova-compute[74960]:         <nova:project uuid="384450261e1f45048eb9b4b431ce8bd5">tempest-ServerActionsV293TestJSON-999594459</nova:project>
Nov 03 12:35:46 user nova-compute[74960]:       </nova:owner>
Nov 03 12:35:46 user nova-compute[74960]:       <nova:ports>
Nov 03 12:35:46 user nova-compute[74960]:         <nova:port uuid="16df3da7-2b2a-4c74-bb06-779696d25b88">
Nov 03 12:35:46 user nova-compute[74960]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 03 12:35:46 user nova-compute[74960]:         </nova:port>
Nov 03 12:35:46 user nova-compute[74960]:       </nova:ports>
Nov 03 12:35:46 user nova-compute[74960]:     </nova:instance>
Nov 03 12:35:46 user nova-compute[74960]:   </metadata>
Nov 03 12:35:46 user nova-compute[74960]:   <sysinfo type="smbios">
Nov 03 12:35:46 user nova-compute[74960]:     <system>
Nov 03 12:35:46 user nova-compute[74960]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 12:35:46 user nova-compute[74960]:       <entry name="product">OpenStack Nova</entry>
Nov 03 12:35:46 user nova-compute[74960]:       <entry name="version">0.0.0</entry>
Nov 03 12:35:46 user nova-compute[74960]:       <entry name="serial">27aa03bb-5613-4bde-8bc0-30517f5d48ae</entry>
Nov 03 12:35:46 user nova-compute[74960]:       <entry name="uuid">27aa03bb-5613-4bde-8bc0-30517f5d48ae</entry>
Nov 03 12:35:46 user nova-compute[74960]:       <entry name="family">Virtual Machine</entry>
Nov 03 12:35:46 user nova-compute[74960]:     </system>
Nov 03 12:35:46 user nova-compute[74960]:   </sysinfo>
Nov 03 12:35:46 user nova-compute[74960]:   <os>
Nov 03 12:35:46 user nova-compute[74960]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 12:35:46 user nova-compute[74960]:     <boot dev="hd"/>
Nov 03 12:35:46 user nova-compute[74960]:     <smbios mode="sysinfo"/>
Nov 03 12:35:46 user nova-compute[74960]:   </os>
Nov 03 12:35:46 user nova-compute[74960]:   <features>
Nov 03 12:35:46 user nova-compute[74960]:     <acpi/>
Nov 03 12:35:46 user nova-compute[74960]:     <apic/>
Nov 03 12:35:46 user nova-compute[74960]:     <vmcoreinfo/>
Nov 03 12:35:46 user nova-compute[74960]:   </features>
Nov 03 12:35:46 user nova-compute[74960]:   <clock offset="utc">
Nov 03 12:35:46 user nova-compute[74960]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 12:35:46 user nova-compute[74960]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 12:35:46 user nova-compute[74960]:     <timer name="hpet" present="no"/>
Nov 03 12:35:46 user nova-compute[74960]:   </clock>
Nov 03 12:35:46 user nova-compute[74960]:   <cpu mode="custom" match="exact">
Nov 03 12:35:46 user nova-compute[74960]:     <model>Nehalem</model>
Nov 03 12:35:46 user nova-compute[74960]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 12:35:46 user nova-compute[74960]:   </cpu>
Nov 03 12:35:46 user nova-compute[74960]:   <devices>
Nov 03 12:35:46 user nova-compute[74960]:     <disk type="block" device="disk">
Nov 03 12:35:46 user nova-compute[74960]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 12:35:46 user nova-compute[74960]:       <source dev="/dev/sdg"/>
Nov 03 12:35:46 user nova-compute[74960]:       <target dev="vda" bus="virtio"/>
Nov 03 12:35:46 user nova-compute[74960]:       <serial>0d9b574a-cdd4-4118-a061-dfe393a5cd61</serial>
Nov 03 12:35:46 user nova-compute[74960]:     </disk>
Nov 03 12:35:46 user nova-compute[74960]:     <interface type="ethernet">
Nov 03 12:35:46 user nova-compute[74960]:       <mac address="fa:16:3e:2a:35:94"/>
Nov 03 12:35:46 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:35:46 user nova-compute[74960]:       <mtu size="1442"/>
Nov 03 12:35:46 user nova-compute[74960]:       <target dev="tap16df3da7-2b"/>
Nov 03 12:35:46 user nova-compute[74960]:     </interface>
Nov 03 12:35:46 user nova-compute[74960]:     <serial type="pty">
Nov 03 12:35:46 user nova-compute[74960]:       <log file="/opt/stack/data/nova/instances/27aa03bb-5613-4bde-8bc0-30517f5d48ae/console.log" append="off"/>
Nov 03 12:35:46 user nova-compute[74960]:     </serial>
Nov 03 12:35:46 user nova-compute[74960]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 12:35:46 user nova-compute[74960]:     <video>
Nov 03 12:35:46 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:35:46 user nova-compute[74960]:     </video>
Nov 03 12:35:46 user nova-compute[74960]:     <rng model="virtio">
Nov 03 12:35:46 user nova-compute[74960]:       <backend model="random">/dev/urandom</backend>
Nov 03 12:35:46 user nova-compute[74960]:     </rng>
Nov 03 12:35:46 user nova-compute[74960]:     <controller type="usb" index="0" model="none"/>
Nov 03 12:35:46 user nova-compute[74960]:     <memballoon model="virtio">
Nov 03 12:35:46 user nova-compute[74960]:       <stats period="10"/>
Nov 03 12:35:46 user nova-compute[74960]:     </memballoon>
Nov 03 12:35:46 user nova-compute[74960]:   </devices>
Nov 03 12:35:46 user nova-compute[74960]: </domain>
Nov 03 12:35:46 user nova-compute[74960]:  {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 12:35:46 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-337c44e2-17bf-430d-82b5-d0358fe270a1 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:35:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1532854274',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1532854274',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBYDYy6Yd4oTzqRmBgqOf0CT+Ul+2zedFmBjf4dct/ZgF3BtxBCHh2RqZpmfNUQqxXAXGv7pJgRz8+RxPwCi1ZxZq5Sw+Pludb9D/l5gQkHYcqClTVAMzGUWUIaG18LSIg==',key_name='tempest-keypair-807064414',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='384450261e1f45048eb9b4b431ce8bd5',ramdisk_id='',reservation_id='r-e40nqd7j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-999594459',owner_user_name='tempest-ServerActionsV293TestJSON-999594459-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:35:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2a983db9b51c44938095b72874dddcf9',uuid=27aa03bb-5613-4bde-8bc0-30517f5d48ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "16df3da7-2b2a-4c74-bb06-779696d25b88", "address": "fa:16:3e:2a:35:94", "network": {"id": "4a77f235-def4-4456-8f4a-99bf5769e015", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1480494760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "384450261e1f45048eb9b4b431ce8bd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16df3da7-2b", "ovs_interfaceid": "16df3da7-2b2a-4c74-bb06-779696d25b88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 12:35:46 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-337c44e2-17bf-430d-82b5-d0358fe270a1 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Converting VIF {"id": "16df3da7-2b2a-4c74-bb06-779696d25b88", "address": "fa:16:3e:2a:35:94", "network": {"id": "4a77f235-def4-4456-8f4a-99bf5769e015", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1480494760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "384450261e1f45048eb9b4b431ce8bd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16df3da7-2b", "ovs_interfaceid": "16df3da7-2b2a-4c74-bb06-779696d25b88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:35:46 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-337c44e2-17bf-430d-82b5-d0358fe270a1 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:35:94,bridge_name='br-int',has_traffic_filtering=True,id=16df3da7-2b2a-4c74-bb06-779696d25b88,network=Network(4a77f235-def4-4456-8f4a-99bf5769e015),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16df3da7-2b') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:35:46 user nova-compute[74960]: DEBUG os_vif [None req-337c44e2-17bf-430d-82b5-d0358fe270a1 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:35:94,bridge_name='br-int',has_traffic_filtering=True,id=16df3da7-2b2a-4c74-bb06-779696d25b88,network=Network(4a77f235-def4-4456-8f4a-99bf5769e015),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16df3da7-2b') {{(pid=74960) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 12:35:46 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:35:46 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:35:46 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 12:35:46 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:35:46 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2bb913de-119f-504b-a7ca-c18744eb0050', '_type': 'linux-noop'}}, row=False) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:35:46 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:35:46 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:35:46 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap16df3da7-2b, may_exist=True, interface_attrs={}) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:35:46 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap16df3da7-2b, col_values=(('qos', UUID('7cf69093-db44-41a3-9e25-d1cb336ae4f4')),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:35:46 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap16df3da7-2b, col_values=(('external_ids', {'iface-id': '16df3da7-2b2a-4c74-bb06-779696d25b88', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2a:35:94', 'vm-uuid': '27aa03bb-5613-4bde-8bc0-30517f5d48ae'}),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:35:46 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:35:46 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:35:46 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:35:46 user nova-compute[74960]: INFO os_vif [None req-337c44e2-17bf-430d-82b5-d0358fe270a1 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:35:94,bridge_name='br-int',has_traffic_filtering=True,id=16df3da7-2b2a-4c74-bb06-779696d25b88,network=Network(4a77f235-def4-4456-8f4a-99bf5769e015),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16df3da7-2b')
Nov 03 12:35:46 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-337c44e2-17bf-430d-82b5-d0358fe270a1 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] No BDM found with device name vda, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:35:46 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-337c44e2-17bf-430d-82b5-d0358fe270a1 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] No VIF found with MAC fa:16:3e:2a:35:94, not building metadata {{(pid=74960) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 12:35:47 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:35:47 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:35:47 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:35:47 user nova-compute[74960]: DEBUG nova.compute.manager [req-bd7d1b15-ecb4-4661-a8bd-640feb6ffca8 req-33dfc7d0-4bc6-449f-9175-3ea73a23df70 service nova] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] Received event network-vif-plugged-16df3da7-2b2a-4c74-bb06-779696d25b88 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:35:47 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-bd7d1b15-ecb4-4661-a8bd-640feb6ffca8 req-33dfc7d0-4bc6-449f-9175-3ea73a23df70 service nova] Acquiring lock "27aa03bb-5613-4bde-8bc0-30517f5d48ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:35:47 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-bd7d1b15-ecb4-4661-a8bd-640feb6ffca8 req-33dfc7d0-4bc6-449f-9175-3ea73a23df70 service nova] Lock "27aa03bb-5613-4bde-8bc0-30517f5d48ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:35:47 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-bd7d1b15-ecb4-4661-a8bd-640feb6ffca8 req-33dfc7d0-4bc6-449f-9175-3ea73a23df70 service nova] Lock "27aa03bb-5613-4bde-8bc0-30517f5d48ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:35:47 user nova-compute[74960]: DEBUG nova.compute.manager [req-bd7d1b15-ecb4-4661-a8bd-640feb6ffca8 req-33dfc7d0-4bc6-449f-9175-3ea73a23df70 service nova] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] No waiting events found dispatching network-vif-plugged-16df3da7-2b2a-4c74-bb06-779696d25b88 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:35:47 user nova-compute[74960]: WARNING nova.compute.manager [req-bd7d1b15-ecb4-4661-a8bd-640feb6ffca8 req-33dfc7d0-4bc6-449f-9175-3ea73a23df70 service nova] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] Received unexpected event network-vif-plugged-16df3da7-2b2a-4c74-bb06-779696d25b88 for instance with vm_state building and task_state spawning.
Nov 03 12:35:48 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:35:48 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:35:48 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:35:48 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:35:48 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:35:49 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cbd8edb8-5b4d-484b-ae47-534468681521 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] [instance: 12ae6707-c1c6-4bc2-a409-67cea64fc2c3] Calling os-brick to attach iSCSI Volume {{(pid=74960) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 12:35:49 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbd8edb8-5b4d-484b-ae47-534468681521 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9aa420acb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:623b8c1d-ba2d-4bad-b0bd-71eefe783606', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HoFPlhQy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:35:49 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-cbd8edb8-5b4d-484b-ae47-534468681521 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:35:49 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-cbd8edb8-5b4d-484b-ae47-534468681521 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:35:49 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-cbd8edb8-5b4d-484b-ae47-534468681521 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:35:49 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-cbd8edb8-5b4d-484b-ae47-534468681521 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:35:49 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-cbd8edb8-5b4d-484b-ae47-534468681521 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:623b8c1d-ba2d-4bad-b0bd-71eefe783606" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:35:49 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-cbd8edb8-5b4d-484b-ae47-534468681521 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:623b8c1d-ba2d-4bad-b0bd-71eefe783606" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:35:49 user nova-compute[74960]: INFO os_brick.initiator.connectors.iscsi [None req-cbd8edb8-5b4d-484b-ae47-534468681521 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 12:35:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:623b8c1d-ba2d-4bad-b0bd-71eefe783606 -p 172.16.0.220:3260 {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:35:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:623b8c1d-ba2d-4bad-b0bd-71eefe783606 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:35:49 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc588c4-d0d3-4c41-bfd9-a9c754569886]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:35:49 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbd8edb8-5b4d-484b-ae47-534468681521 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 12:35:49 user nova-compute[74960]:  {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:35:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:623b8c1d-ba2d-4bad-b0bd-71eefe783606 -p 172.16.0.220:3260 --interface default --op new {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:35:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:623b8c1d-ba2d-4bad-b0bd-71eefe783606 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:35:49 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdcf3165-472b-472a-b242-c71741134684]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:623b8c1d-ba2d-4bad-b0bd-71eefe783606] added\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:35:49 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbd8edb8-5b4d-484b-ae47-534468681521 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:623b8c1d-ba2d-4bad-b0bd-71eefe783606] added
Nov 03 12:35:49 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:35:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:623b8c1d-ba2d-4bad-b0bd-71eefe783606 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:35:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:623b8c1d-ba2d-4bad-b0bd-71eefe783606 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:35:49 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd508673-97c3-4c80-9006-ed95c6f3ce11]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:35:49 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbd8edb8-5b4d-484b-ae47-534468681521 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:35:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:623b8c1d-ba2d-4bad-b0bd-71eefe783606 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:35:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:623b8c1d-ba2d-4bad-b0bd-71eefe783606 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:35:49 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[26f37821-aea6-4509-ad3e-3941c2fc001b]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:35:49 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbd8edb8-5b4d-484b-ae47-534468681521 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:35:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:623b8c1d-ba2d-4bad-b0bd-71eefe783606 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HoFPlhQy {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:35:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:623b8c1d-ba2d-4bad-b0bd-71eefe783606 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HoFPlhQy" returned: 0 in 0.020s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:35:49 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[b217b917-add1-483c-908b-01ec12c4c76c]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:35:49 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbd8edb8-5b4d-484b-ae47-534468681521 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HoFPlhQy'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:35:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:623b8c1d-ba2d-4bad-b0bd-71eefe783606 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:35:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:623b8c1d-ba2d-4bad-b0bd-71eefe783606 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:35:49 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[e31fa110-3345-426c-95a6-5de803379a04]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:35:49 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbd8edb8-5b4d-484b-ae47-534468681521 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:35:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:35:49 user nova-compute[74960]: DEBUG nova.compute.manager [None req-337c44e2-17bf-430d-82b5-d0358fe270a1 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] Instance event wait completed in 0 seconds for  {{(pid=74960) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 12:35:49 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-337c44e2-17bf-430d-82b5-d0358fe270a1 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] Guest created on hypervisor {{(pid=74960) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 12:35:49 user nova-compute[74960]: DEBUG nova.compute.manager [req-021beee4-f1f3-4d8c-b4fe-2b06dd9d1f2d req-8e18daca-ad85-4e8d-a2cc-d6a1f7a327da service nova] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] Received event network-vif-plugged-16df3da7-2b2a-4c74-bb06-779696d25b88 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:35:49 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-021beee4-f1f3-4d8c-b4fe-2b06dd9d1f2d req-8e18daca-ad85-4e8d-a2cc-d6a1f7a327da service nova] Acquiring lock "27aa03bb-5613-4bde-8bc0-30517f5d48ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:35:49 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-021beee4-f1f3-4d8c-b4fe-2b06dd9d1f2d req-8e18daca-ad85-4e8d-a2cc-d6a1f7a327da service nova] Lock "27aa03bb-5613-4bde-8bc0-30517f5d48ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:35:49 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-021beee4-f1f3-4d8c-b4fe-2b06dd9d1f2d req-8e18daca-ad85-4e8d-a2cc-d6a1f7a327da service nova] Lock "27aa03bb-5613-4bde-8bc0-30517f5d48ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:35:49 user nova-compute[74960]: DEBUG nova.compute.manager [req-021beee4-f1f3-4d8c-b4fe-2b06dd9d1f2d req-8e18daca-ad85-4e8d-a2cc-d6a1f7a327da service nova] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] No waiting events found dispatching network-vif-plugged-16df3da7-2b2a-4c74-bb06-779696d25b88 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:35:49 user nova-compute[74960]: WARNING nova.compute.manager [req-021beee4-f1f3-4d8c-b4fe-2b06dd9d1f2d req-8e18daca-ad85-4e8d-a2cc-d6a1f7a327da service nova] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] Received unexpected event network-vif-plugged-16df3da7-2b2a-4c74-bb06-779696d25b88 for instance with vm_state building and task_state spawning.
Nov 03 12:35:49 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] Instance spawned successfully.
Nov 03 12:35:49 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-337c44e2-17bf-430d-82b5-d0358fe270a1 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 12:35:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:35:49 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[3634debb-ac30-4fbe-9db4-1bfa8c051088]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7da48309-69f9-407d-81b1-9bd9aea03cd0 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bd46dc3-8710-4ce9-9e02-3d6c442fb90c (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61 (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:35:49 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbd8edb8-5b4d-484b-ae47-534468681521 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:35:49 user nova-compute[74960]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7da48309-69f9-407d-81b1-9bd9aea03cd0 (non-flash)
Nov 03 12:35:49 user nova-compute[74960]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797 (non-flash)
Nov 03 12:35:49 user nova-compute[74960]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 (non-flash)
Nov 03 12:35:49 user nova-compute[74960]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bd46dc3-8710-4ce9-9e02-3d6c442fb90c (non-flash)
Nov 03 12:35:49 user nova-compute[74960]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61 (non-flash)
Nov 03 12:35:49 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:35:49 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbd8edb8-5b4d-484b-ae47-534468681521 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:35:49 user nova-compute[74960]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7da48309-69f9-407d-81b1-9bd9aea03cd0 (non-flash)
Nov 03 12:35:49 user nova-compute[74960]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797 (non-flash)
Nov 03 12:35:49 user nova-compute[74960]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 (non-flash)
Nov 03 12:35:49 user nova-compute[74960]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bd46dc3-8710-4ce9-9e02-3d6c442fb90c (non-flash)
Nov 03 12:35:49 user nova-compute[74960]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61 (non-flash)
Nov 03 12:35:49 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:35:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:623b8c1d-ba2d-4bad-b0bd-71eefe783606 -p 172.16.0.220:3260 --login {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:35:49 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-337c44e2-17bf-430d-82b5-d0358fe270a1 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] Found default for hw_cdrom_bus of ide {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:35:49 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-337c44e2-17bf-430d-82b5-d0358fe270a1 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] Found default for hw_disk_bus of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:35:49 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-337c44e2-17bf-430d-82b5-d0358fe270a1 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] Found default for hw_input_bus of None {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:35:49 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-337c44e2-17bf-430d-82b5-d0358fe270a1 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] Found default for hw_pointer_model of None {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:35:49 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-337c44e2-17bf-430d-82b5-d0358fe270a1 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] Found default for hw_video_model of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:35:49 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-337c44e2-17bf-430d-82b5-d0358fe270a1 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] Found default for hw_vif_model of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:35:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:623b8c1d-ba2d-4bad-b0bd-71eefe783606 -p 172.16.0.220:3260 --login" returned: 0 in 0.101s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:35:49 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[54c43993-f4cd-4aca-9121-7ef255ca5457]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:623b8c1d-ba2d-4bad-b0bd-71eefe783606, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:623b8c1d-ba2d-4bad-b0bd-71eefe783606, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:35:49 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbd8edb8-5b4d-484b-ae47-534468681521 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:623b8c1d-ba2d-4bad-b0bd-71eefe783606, portal: 172.16.0.220,3260]
Nov 03 12:35:49 user nova-compute[74960]: Login to [iface: default, target: iqn.2010-10.org.openstack:623b8c1d-ba2d-4bad-b0bd-71eefe783606, portal: 172.16.0.220,3260] successful.
Nov 03 12:35:49 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:35:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:623b8c1d-ba2d-4bad-b0bd-71eefe783606 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:35:49 user nova-compute[74960]: INFO nova.compute.manager [None req-337c44e2-17bf-430d-82b5-d0358fe270a1 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] Took 5.29 seconds to spawn the instance on the hypervisor.
Nov 03 12:35:49 user nova-compute[74960]: DEBUG nova.compute.manager [None req-337c44e2-17bf-430d-82b5-d0358fe270a1 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] Checking state {{(pid=74960) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 12:35:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:623b8c1d-ba2d-4bad-b0bd-71eefe783606 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.043s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:35:49 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[df4a5e2b-868f-4241-a69a-d41967256814]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:35:49 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbd8edb8-5b4d-484b-ae47-534468681521 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:35:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:35:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:35:49 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecd17e7c-6c0b-474e-b23a-0e46e42f6c52]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7da48309-69f9-407d-81b1-9bd9aea03cd0 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bd46dc3-8710-4ce9-9e02-3d6c442fb90c (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:623b8c1d-ba2d-4bad-b0bd-71eefe783606 (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:35:49 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbd8edb8-5b4d-484b-ae47-534468681521 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:35:49 user nova-compute[74960]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7da48309-69f9-407d-81b1-9bd9aea03cd0 (non-flash)
Nov 03 12:35:49 user nova-compute[74960]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797 (non-flash)
Nov 03 12:35:49 user nova-compute[74960]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 (non-flash)
Nov 03 12:35:49 user nova-compute[74960]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bd46dc3-8710-4ce9-9e02-3d6c442fb90c (non-flash)
Nov 03 12:35:49 user nova-compute[74960]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61 (non-flash)
Nov 03 12:35:49 user nova-compute[74960]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:623b8c1d-ba2d-4bad-b0bd-71eefe783606 (non-flash)
Nov 03 12:35:49 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:35:49 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbd8edb8-5b4d-484b-ae47-534468681521 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:35:49 user nova-compute[74960]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7da48309-69f9-407d-81b1-9bd9aea03cd0 (non-flash)
Nov 03 12:35:49 user nova-compute[74960]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797 (non-flash)
Nov 03 12:35:49 user nova-compute[74960]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 (non-flash)
Nov 03 12:35:49 user nova-compute[74960]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bd46dc3-8710-4ce9-9e02-3d6c442fb90c (non-flash)
Nov 03 12:35:49 user nova-compute[74960]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61 (non-flash)
Nov 03 12:35:49 user nova-compute[74960]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:623b8c1d-ba2d-4bad-b0bd-71eefe783606 (non-flash)
Nov 03 12:35:49 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:35:49 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-cbd8edb8-5b4d-484b-ae47-534468681521 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:623b8c1d-ba2d-4bad-b0bd-71eefe783606" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.376s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:35:49 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbd8edb8-5b4d-484b-ae47-534468681521 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Connected to 172.16.0.220:3260 {{(pid=74960) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 12:35:49 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-cbd8edb8-5b4d-484b-ae47-534468681521 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] HCTL ('39', '-', '-', 0) found on session 31 with lun 0 {{(pid=74960) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 12:35:49 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-cbd8edb8-5b4d-484b-ae47-534468681521 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=74960) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 12:35:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:35:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:35:49 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7105809-293e-4074-95fa-05ca46c9eefa]: (4, ('- - 0', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:35:49 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-cbd8edb8-5b4d-484b-ae47-534468681521 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Searching for a device in session 31 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=74960) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 12:35:49 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbd8edb8-5b4d-484b-ae47-534468681521 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:623b8c1d-ba2d-4bad-b0bd-71eefe783606', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HoFPlhQy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74960) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 12:35:50 user nova-compute[74960]: INFO nova.compute.manager [None req-337c44e2-17bf-430d-82b5-d0358fe270a1 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] Took 30.14 seconds to build instance.
Nov 03 12:35:50 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-337c44e2-17bf-430d-82b5-d0358fe270a1 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Lock "27aa03bb-5613-4bde-8bc0-30517f5d48ae" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 30.263s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:35:50 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-eb70e217-ba16-495b-98a3-2f37ed512cbb tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9c447082-b59b-4c8e-8fa0-bf6599a84e91 is timed out.
Nov 03 12:35:50 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-eb70e217-ba16-495b-98a3-2f37ed512cbb tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] Successfully detached device vdb from instance 9c447082-b59b-4c8e-8fa0-bf6599a84e91 from the live domain config.
Nov 03 12:35:50 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb70e217-ba16-495b-98a3-2f37ed512cbb tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] [instance: 9c447082-b59b-4c8e-8fa0-bf6599a84e91] calling os-brick to detach iSCSI Volume {{(pid=74960) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 12:35:50 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb70e217-ba16-495b-98a3-2f37ed512cbb tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9aa420acb0>, {'target_iqn': 'iqn.2010-10.org.openstack:7bd46dc3-8710-4ce9-9e02-3d6c442fb90c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lkFNzXAj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:35:50 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-eb70e217-ba16-495b-98a3-2f37ed512cbb tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:35:50 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-eb70e217-ba16-495b-98a3-2f37ed512cbb tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:35:51 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-cbd8edb8-5b4d-484b-ae47-534468681521 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.419s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:35:51 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbd8edb8-5b4d-484b-ae47-534468681521 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] <== connect_volume: return (1422ms) {'type': 'block', 'scsi_wwn': '23836323037393030', 'path': '/dev/sdh'} {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:35:51 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cbd8edb8-5b4d-484b-ae47-534468681521 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] [instance: 12ae6707-c1c6-4bc2-a409-67cea64fc2c3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23836323037393030', 'path': '/dev/sdh'} {{(pid=74960) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 12:35:51 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-eb70e217-ba16-495b-98a3-2f37ed512cbb tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.391s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:35:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:35:51 user nova-compute[74960]: DEBUG nova.objects.instance [None req-cbd8edb8-5b4d-484b-ae47-534468681521 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Lazy-loading 'flavor' on Instance uuid 12ae6707-c1c6-4bc2-a409-67cea64fc2c3 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:35:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.033s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:35:51 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cea9e9e-fab0-42c4-86fa-0b63fe5380e0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7bd46dc3-8710-4ce9-9e02-3d6c442fb90c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7da48309-69f9-407d-81b1-9bd9aea03cd0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:623b8c1d-ba2d-4bad-b0bd-71eefe783606\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:35:51 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb70e217-ba16-495b-98a3-2f37ed512cbb tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 12:35:51 user nova-compute[74960]: No targets found.
Nov 03 12:35:51 user nova-compute[74960]: iSNS:
Nov 03 12:35:51 user nova-compute[74960]: No targets found.
Nov 03 12:35:51 user nova-compute[74960]: STATIC:
Nov 03 12:35:51 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515
Nov 03 12:35:51 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:35:51 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:35:51 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797
Nov 03 12:35:51 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:35:51 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:35:51 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2
Nov 03 12:35:51 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:35:51 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:35:51 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:7bd46dc3-8710-4ce9-9e02-3d6c442fb90c
Nov 03 12:35:51 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:35:51 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:35:51 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:7da48309-69f9-407d-81b1-9bd9aea03cd0
Nov 03 12:35:51 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:35:51 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:35:51 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:623b8c1d-ba2d-4bad-b0bd-71eefe783606
Nov 03 12:35:51 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:35:51 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:35:51 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61
Nov 03 12:35:51 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:35:51 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:35:51 user nova-compute[74960]: FIRMWARE:
Nov 03 12:35:51 user nova-compute[74960]: No targets found.
Nov 03 12:35:51 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:35:51 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb70e217-ba16-495b-98a3-2f37ed512cbb tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 12:35:51 user nova-compute[74960]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 12:35:51 user nova-compute[74960]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74960) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 12:35:51 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb70e217-ba16-495b-98a3-2f37ed512cbb tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7bd46dc3-8710-4ce9-9e02-3d6c442fb90c', 0)] {{(pid=74960) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 12:35:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:35:51 user nova-compute[74960]: DEBUG nova.virt.libvirt.guest [None req-cbd8edb8-5b4d-484b-ae47-534468681521 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] attach device xml: <disk type="block" device="disk">
Nov 03 12:35:51 user nova-compute[74960]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 12:35:51 user nova-compute[74960]:   <source dev="/dev/sdh"/>
Nov 03 12:35:51 user nova-compute[74960]:   <target dev="vdb" bus="virtio"/>
Nov 03 12:35:51 user nova-compute[74960]:   <serial>623b8c1d-ba2d-4bad-b0bd-71eefe783606</serial>
Nov 03 12:35:51 user nova-compute[74960]: </disk>
Nov 03 12:35:51 user nova-compute[74960]:  {{(pid=74960) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 03 12:35:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:35:51 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[fef84465-bc6a-47b6-bddb-15215103014e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:623b8c1d-ba2d-4bad-b0bd-71eefe783606\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7bd46dc3-8710-4ce9-9e02-3d6c442fb90c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7da48309-69f9-407d-81b1-9bd9aea03cd0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:35:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:35:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:35:51 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a57612-8c90-4e20-bc31-00cece9d603d]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7da48309-69f9-407d-81b1-9bd9aea03cd0 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bd46dc3-8710-4ce9-9e02-3d6c442fb90c (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:623b8c1d-ba2d-4bad-b0bd-71eefe783606 (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:35:51 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb70e217-ba16-495b-98a3-2f37ed512cbb tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:35:51 user nova-compute[74960]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7da48309-69f9-407d-81b1-9bd9aea03cd0 (non-flash)
Nov 03 12:35:51 user nova-compute[74960]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797 (non-flash)
Nov 03 12:35:51 user nova-compute[74960]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 (non-flash)
Nov 03 12:35:51 user nova-compute[74960]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bd46dc3-8710-4ce9-9e02-3d6c442fb90c (non-flash)
Nov 03 12:35:51 user nova-compute[74960]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61 (non-flash)
Nov 03 12:35:51 user nova-compute[74960]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:623b8c1d-ba2d-4bad-b0bd-71eefe783606 (non-flash)
Nov 03 12:35:51 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:35:51 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb70e217-ba16-495b-98a3-2f37ed512cbb tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:35:51 user nova-compute[74960]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7da48309-69f9-407d-81b1-9bd9aea03cd0 (non-flash)
Nov 03 12:35:51 user nova-compute[74960]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797 (non-flash)
Nov 03 12:35:51 user nova-compute[74960]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 (non-flash)
Nov 03 12:35:51 user nova-compute[74960]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bd46dc3-8710-4ce9-9e02-3d6c442fb90c (non-flash)
Nov 03 12:35:51 user nova-compute[74960]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61 (non-flash)
Nov 03 12:35:51 user nova-compute[74960]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:623b8c1d-ba2d-4bad-b0bd-71eefe783606 (non-flash)
Nov 03 12:35:51 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:35:51 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb70e217-ba16-495b-98a3-2f37ed512cbb tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9aac0fc1f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7bd46dc3-8710-4ce9-9e02-3d6c442fb90c'): ({'sdf'}, set())}) {{(pid=74960) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 12:35:51 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-eb70e217-ba16-495b-98a3-2f37ed512cbb tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] Removing single pathed devices sdf {{(pid=74960) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 12:35:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:35:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:35:51 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a74742a-10a3-4228-ab13-b88be3965d39]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:35:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:35:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:35:51 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[01d52c11-e688-432d-b539-68454523e18d]: (4, ('ok\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:35:51 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-eb70e217-ba16-495b-98a3-2f37ed512cbb tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] Flushing IO for device /dev/sdf {{(pid=74960) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 12:35:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:35:51 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:35:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:35:51 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5be6ccc-325c-4ce5-b454-a5d3561a7722]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:35:51 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-eb70e217-ba16-495b-98a3-2f37ed512cbb tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74960) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 12:35:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:35:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.043s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:35:51 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[b432d9ae-1990-404b-b8b2-294e06c83726]: (4, ('1', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:35:51 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-eb70e217-ba16-495b-98a3-2f37ed512cbb tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74960) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 12:35:51 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-eb70e217-ba16-495b-98a3-2f37ed512cbb tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] SCSI volumes sdf have been removed. {{(pid=74960) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 12:35:51 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb70e217-ba16-495b-98a3-2f37ed512cbb tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7bd46dc3-8710-4ce9-9e02-3d6c442fb90c')] {{(pid=74960) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 12:35:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bd46dc3-8710-4ce9-9e02-3d6c442fb90c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:35:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bd46dc3-8710-4ce9-9e02-3d6c442fb90c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:35:51 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[8edb3cd9-dd8f-4152-b794-05453a182999]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:35:51 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb70e217-ba16-495b-98a3-2f37ed512cbb tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:35:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bd46dc3-8710-4ce9-9e02-3d6c442fb90c -p 172.16.0.220:3260 --logout {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:35:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bd46dc3-8710-4ce9-9e02-3d6c442fb90c -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:35:51 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[00de789f-a336-44f0-89df-ffb33c42c396]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:7bd46dc3-8710-4ce9-9e02-3d6c442fb90c, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:7bd46dc3-8710-4ce9-9e02-3d6c442fb90c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:35:51 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb70e217-ba16-495b-98a3-2f37ed512cbb tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:7bd46dc3-8710-4ce9-9e02-3d6c442fb90c, portal: 172.16.0.220,3260]
Nov 03 12:35:51 user nova-compute[74960]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:7bd46dc3-8710-4ce9-9e02-3d6c442fb90c, portal: 172.16.0.220,3260] successful.
Nov 03 12:35:51 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:35:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bd46dc3-8710-4ce9-9e02-3d6c442fb90c -p 172.16.0.220:3260 --op delete {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:35:51 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:35:51 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Starting heal instance info cache {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 12:35:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bd46dc3-8710-4ce9-9e02-3d6c442fb90c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:35:51 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d193d1-92ba-47cf-b281-e1e73d17e6cf]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:35:51 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb70e217-ba16-495b-98a3-2f37ed512cbb tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:35:51 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-eb70e217-ba16-495b-98a3-2f37ed512cbb tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.376s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:35:51 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb70e217-ba16-495b-98a3-2f37ed512cbb tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] <== disconnect_volume: return (767ms) None {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:35:51 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb70e217-ba16-495b-98a3-2f37ed512cbb tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] [instance: 9c447082-b59b-4c8e-8fa0-bf6599a84e91] Disconnected iSCSI Volume {{(pid=74960) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 12:35:51 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "refresh_cache-a6199681-f85e-4f55-966b-6ab3f17cd640" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:35:51 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquired lock "refresh_cache-a6199681-f85e-4f55-966b-6ab3f17cd640" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:35:51 user nova-compute[74960]: DEBUG nova.network.neutron [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] Forcefully refreshing network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 12:35:51 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-cbd8edb8-5b4d-484b-ae47-534468681521 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] No BDM found with device name vda, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:35:51 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-cbd8edb8-5b4d-484b-ae47-534468681521 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:35:51 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-cbd8edb8-5b4d-484b-ae47-534468681521 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] No VIF found with MAC fa:16:3e:d7:40:80, not building metadata {{(pid=74960) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 12:35:51 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-cbd8edb8-5b4d-484b-ae47-534468681521 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Lock "12ae6707-c1c6-4bc2-a409-67cea64fc2c3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.733s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:35:52 user nova-compute[74960]: DEBUG nova.network.neutron [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] Updating instance_info_cache with network_info: [{"id": "40976ae5-5f49-4d8e-abd7-04dc0ce8f319", "address": "fa:16:3e:7c:40:1d", "network": {"id": "dec66832-56d5-4d68-b11f-8e8eed38f045", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-79099436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc95d68d5e147e1953c855169b17091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40976ae5-5f", "ovs_interfaceid": "40976ae5-5f49-4d8e-abd7-04dc0ce8f319", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:35:52 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Releasing lock "refresh_cache-a6199681-f85e-4f55-966b-6ab3f17cd640" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:35:52 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] Updated the network info_cache for instance {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 12:35:52 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:35:52 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:35:52 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:35:52 user nova-compute[74960]: DEBUG nova.objects.instance [None req-eb70e217-ba16-495b-98a3-2f37ed512cbb tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] Lazy-loading 'flavor' on Instance uuid 9c447082-b59b-4c8e-8fa0-bf6599a84e91 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:35:52 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-eb70e217-ba16-495b-98a3-2f37ed512cbb tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] Lock "9c447082-b59b-4c8e-8fa0-bf6599a84e91" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.823s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:35:53 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:35:54 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:35:54 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:35:54 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:35:54 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:35:54 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:35:54 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Auditing locally available compute resources for user (node: user) {{(pid=74960) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 12:35:54 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12ae6707-c1c6-4bc2-a409-67cea64fc2c3/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:35:54 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12ae6707-c1c6-4bc2-a409-67cea64fc2c3/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:35:54 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12ae6707-c1c6-4bc2-a409-67cea64fc2c3/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:35:55 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12ae6707-c1c6-4bc2-a409-67cea64fc2c3/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:35:55 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=74960) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 12:35:55 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f15f5f-8afa-4d7b-bb45-5887184f9ee5/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:35:55 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f15f5f-8afa-4d7b-bb45-5887184f9ee5/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:35:55 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f15f5f-8afa-4d7b-bb45-5887184f9ee5/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:35:55 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f15f5f-8afa-4d7b-bb45-5887184f9ee5/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:35:55 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c447082-b59b-4c8e-8fa0-bf6599a84e91/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:35:55 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c447082-b59b-4c8e-8fa0-bf6599a84e91/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:35:55 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c447082-b59b-4c8e-8fa0-bf6599a84e91/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:35:55 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c447082-b59b-4c8e-8fa0-bf6599a84e91/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:35:55 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47eb8ddf-590f-4ffa-87c8-377cf1ee0f67/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:35:56 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:35:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47eb8ddf-590f-4ffa-87c8-377cf1ee0f67/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:35:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47eb8ddf-590f-4ffa-87c8-377cf1ee0f67/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:35:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47eb8ddf-590f-4ffa-87c8-377cf1ee0f67/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:35:56 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74960) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 12:35:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7b95c0-3726-4a1c-a384-ec91abf75225/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:35:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7b95c0-3726-4a1c-a384-ec91abf75225/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:35:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7b95c0-3726-4a1c-a384-ec91abf75225/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:35:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7b95c0-3726-4a1c-a384-ec91abf75225/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:35:56 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74960) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 12:35:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e02c80-f626-4918-93f1-6b9a7f778c7a/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:35:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e02c80-f626-4918-93f1-6b9a7f778c7a/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:35:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e02c80-f626-4918-93f1-6b9a7f778c7a/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:35:57 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e02c80-f626-4918-93f1-6b9a7f778c7a/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:35:57 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk.rescue --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:35:57 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:35:57 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk.rescue --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:35:57 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:35:57 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:35:57 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:35:57 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:35:57 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:35:57 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74960) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 12:35:57 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7606a55-d5c3-4ba8-b499-f3c70813f151/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:35:58 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7606a55-d5c3-4ba8-b499-f3c70813f151/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:35:58 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7606a55-d5c3-4ba8-b499-f3c70813f151/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:35:58 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7606a55-d5c3-4ba8-b499-f3c70813f151/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:35:58 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=74960) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 12:35:58 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:35:58 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:35:58 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:35:58 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Hypervisor/Node resource view: name=user free_ram=7402MB free_disk=24.867198944091797GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74960) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 12:35:58 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:35:58 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:35:59 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 87f15f5f-8afa-4d7b-bb45-5887184f9ee5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:35:59 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance a6199681-f85e-4f55-966b-6ab3f17cd640 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:35:59 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 5b7b95c0-3726-4a1c-a384-ec91abf75225 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:35:59 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 35e02c80-f626-4918-93f1-6b9a7f778c7a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:35:59 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:35:59 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:35:59 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 9c447082-b59b-4c8e-8fa0-bf6599a84e91 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:35:59 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 12ae6707-c1c6-4bc2-a409-67cea64fc2c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:35:59 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance b7606a55-d5c3-4ba8-b499-f3c70813f151 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:35:59 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:35:59 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 27aa03bb-5613-4bde-8bc0-30517f5d48ae actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:35:59 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74960) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 12:35:59 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74960) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 12:35:59 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:35:59 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:35:59 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Compute_service record updated for user:user {{(pid=74960) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 12:35:59 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.598s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:36:01 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:36:02 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:36:03 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:36:03 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:36:03 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:36:03 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74960) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 12:36:03 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:36:05 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-b8f6ad3b-2a2e-4269-8a29-635d0ec6f43f tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 35e02c80-f626-4918-93f1-6b9a7f778c7a is timed out.
Nov 03 12:36:05 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-b8f6ad3b-2a2e-4269-8a29-635d0ec6f43f tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Successfully detached device vdb from instance 35e02c80-f626-4918-93f1-6b9a7f778c7a from the live domain config.
Nov 03 12:36:05 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8f6ad3b-2a2e-4269-8a29-635d0ec6f43f tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a] calling os-brick to detach iSCSI Volume {{(pid=74960) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 12:36:05 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8f6ad3b-2a2e-4269-8a29-635d0ec6f43f tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9aa420acb0>, {'target_iqn': 'iqn.2010-10.org.openstack:7da48309-69f9-407d-81b1-9bd9aea03cd0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fjeQGubp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:36:05 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-b8f6ad3b-2a2e-4269-8a29-635d0ec6f43f tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:36:05 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-b8f6ad3b-2a2e-4269-8a29-635d0ec6f43f tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:36:05 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-b8f6ad3b-2a2e-4269-8a29-635d0ec6f43f tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:36:05 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:36:05 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:36:05 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[653176cd-962c-4ee6-baaa-5a0343716dbb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7da48309-69f9-407d-81b1-9bd9aea03cd0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:623b8c1d-ba2d-4bad-b0bd-71eefe783606\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:36:05 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8f6ad3b-2a2e-4269-8a29-635d0ec6f43f tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 12:36:05 user nova-compute[74960]: No targets found.
Nov 03 12:36:05 user nova-compute[74960]: iSNS:
Nov 03 12:36:05 user nova-compute[74960]: No targets found.
Nov 03 12:36:05 user nova-compute[74960]: STATIC:
Nov 03 12:36:05 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515
Nov 03 12:36:05 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:36:05 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:36:05 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797
Nov 03 12:36:05 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:36:05 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:36:05 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2
Nov 03 12:36:05 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:36:05 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:36:05 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:7da48309-69f9-407d-81b1-9bd9aea03cd0
Nov 03 12:36:05 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:36:05 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:36:05 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:623b8c1d-ba2d-4bad-b0bd-71eefe783606
Nov 03 12:36:05 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:36:05 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:36:05 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61
Nov 03 12:36:05 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:36:05 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:36:05 user nova-compute[74960]: FIRMWARE:
Nov 03 12:36:05 user nova-compute[74960]: No targets found.
Nov 03 12:36:05 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:36:05 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8f6ad3b-2a2e-4269-8a29-635d0ec6f43f tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 12:36:05 user nova-compute[74960]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 12:36:05 user nova-compute[74960]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74960) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 12:36:05 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8f6ad3b-2a2e-4269-8a29-635d0ec6f43f tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7da48309-69f9-407d-81b1-9bd9aea03cd0', 0)] {{(pid=74960) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 12:36:05 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:36:05 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:36:05 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b938d2f-7766-4d76-9884-3e5d0812a8d2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:623b8c1d-ba2d-4bad-b0bd-71eefe783606\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7da48309-69f9-407d-81b1-9bd9aea03cd0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:36:05 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:36:05 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:36:05 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[814e0d1e-4d49-403f-937a-eea92e8fe9c7]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7da48309-69f9-407d-81b1-9bd9aea03cd0 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:623b8c1d-ba2d-4bad-b0bd-71eefe783606 (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:36:05 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8f6ad3b-2a2e-4269-8a29-635d0ec6f43f tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:36:05 user nova-compute[74960]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7da48309-69f9-407d-81b1-9bd9aea03cd0 (non-flash)
Nov 03 12:36:05 user nova-compute[74960]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797 (non-flash)
Nov 03 12:36:05 user nova-compute[74960]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 (non-flash)
Nov 03 12:36:05 user nova-compute[74960]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61 (non-flash)
Nov 03 12:36:05 user nova-compute[74960]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:623b8c1d-ba2d-4bad-b0bd-71eefe783606 (non-flash)
Nov 03 12:36:05 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:36:05 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8f6ad3b-2a2e-4269-8a29-635d0ec6f43f tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:36:05 user nova-compute[74960]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7da48309-69f9-407d-81b1-9bd9aea03cd0 (non-flash)
Nov 03 12:36:05 user nova-compute[74960]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797 (non-flash)
Nov 03 12:36:05 user nova-compute[74960]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 (non-flash)
Nov 03 12:36:05 user nova-compute[74960]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61 (non-flash)
Nov 03 12:36:05 user nova-compute[74960]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:623b8c1d-ba2d-4bad-b0bd-71eefe783606 (non-flash)
Nov 03 12:36:05 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:36:05 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8f6ad3b-2a2e-4269-8a29-635d0ec6f43f tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9aa4384940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7da48309-69f9-407d-81b1-9bd9aea03cd0'): ({'sdb'}, set())}) {{(pid=74960) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 12:36:05 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-b8f6ad3b-2a2e-4269-8a29-635d0ec6f43f tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Removing single pathed devices sdb {{(pid=74960) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 12:36:05 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:36:05 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:36:05 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a95fb56-7715-462d-beac-baff0ea47753]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:36:05 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:36:05 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:36:05 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[f33502cd-656d-422a-a114-68d496f980ba]: (4, ('ok\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:36:05 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-b8f6ad3b-2a2e-4269-8a29-635d0ec6f43f tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Flushing IO for device /dev/sdb {{(pid=74960) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 12:36:05 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:36:05 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:36:05 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[49dcca0d-65c0-46e4-8d68-59f74c5a9ebf]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:36:05 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-b8f6ad3b-2a2e-4269-8a29-635d0ec6f43f tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74960) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 12:36:05 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:36:05 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:36:05 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[208a97ef-fb0c-404b-b826-d6362fe35c6e]: (4, ('1', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:36:05 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-b8f6ad3b-2a2e-4269-8a29-635d0ec6f43f tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74960) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 12:36:05 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-b8f6ad3b-2a2e-4269-8a29-635d0ec6f43f tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] SCSI volumes sdb have been removed. {{(pid=74960) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 12:36:05 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8f6ad3b-2a2e-4269-8a29-635d0ec6f43f tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7da48309-69f9-407d-81b1-9bd9aea03cd0')] {{(pid=74960) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 12:36:05 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7da48309-69f9-407d-81b1-9bd9aea03cd0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:36:05 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7da48309-69f9-407d-81b1-9bd9aea03cd0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:36:05 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ad7e9b3-e431-455a-aeac-209c80a61f7d]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:36:05 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8f6ad3b-2a2e-4269-8a29-635d0ec6f43f tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:36:05 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7da48309-69f9-407d-81b1-9bd9aea03cd0 -p 172.16.0.220:3260 --logout {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:36:05 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7da48309-69f9-407d-81b1-9bd9aea03cd0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:36:05 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba538166-1d0a-4c44-814b-68875603bc3a]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:7da48309-69f9-407d-81b1-9bd9aea03cd0, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:7da48309-69f9-407d-81b1-9bd9aea03cd0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:36:05 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8f6ad3b-2a2e-4269-8a29-635d0ec6f43f tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:7da48309-69f9-407d-81b1-9bd9aea03cd0, portal: 172.16.0.220,3260]
Nov 03 12:36:05 user nova-compute[74960]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:7da48309-69f9-407d-81b1-9bd9aea03cd0, portal: 172.16.0.220,3260] successful.
Nov 03 12:36:05 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:36:05 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7da48309-69f9-407d-81b1-9bd9aea03cd0 -p 172.16.0.220:3260 --op delete {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:36:05 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7da48309-69f9-407d-81b1-9bd9aea03cd0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:36:05 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[394686b3-85ac-4421-9000-df10e4fd46e4]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:36:05 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8f6ad3b-2a2e-4269-8a29-635d0ec6f43f tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:36:05 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-b8f6ad3b-2a2e-4269-8a29-635d0ec6f43f tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.353s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:36:05 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8f6ad3b-2a2e-4269-8a29-635d0ec6f43f tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] <== disconnect_volume: return (354ms) None {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:36:05 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8f6ad3b-2a2e-4269-8a29-635d0ec6f43f tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a] Disconnected iSCSI Volume {{(pid=74960) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 12:36:06 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:36:06 user nova-compute[74960]: DEBUG nova.objects.instance [None req-b8f6ad3b-2a2e-4269-8a29-635d0ec6f43f tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Lazy-loading 'flavor' on Instance uuid 35e02c80-f626-4918-93f1-6b9a7f778c7a {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:36:06 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-b8f6ad3b-2a2e-4269-8a29-635d0ec6f43f tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Lock "35e02c80-f626-4918-93f1-6b9a7f778c7a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.879s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:36:08 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:36:11 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:36:13 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:36:16 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:36:18 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:36:21 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:36:23 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:36:26 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:36:27 user nova-compute[74960]: DEBUG nova.compute.manager [req-8b095d38-e746-44bc-a1d0-c7563fa219f6 req-ef6cac6c-1d33-40e7-b9cb-fd0c5d5c7c63 service nova] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] Received event network-changed-fe22f17b-b60c-465a-9079-e9c008004741 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:36:27 user nova-compute[74960]: DEBUG nova.compute.manager [req-8b095d38-e746-44bc-a1d0-c7563fa219f6 req-ef6cac6c-1d33-40e7-b9cb-fd0c5d5c7c63 service nova] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] Refreshing instance network info cache due to event network-changed-fe22f17b-b60c-465a-9079-e9c008004741. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 12:36:27 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-8b095d38-e746-44bc-a1d0-c7563fa219f6 req-ef6cac6c-1d33-40e7-b9cb-fd0c5d5c7c63 service nova] Acquiring lock "refresh_cache-5dc6cb24-fe58-4e36-bd7f-a67a804a98e1" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:36:27 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-8b095d38-e746-44bc-a1d0-c7563fa219f6 req-ef6cac6c-1d33-40e7-b9cb-fd0c5d5c7c63 service nova] Acquired lock "refresh_cache-5dc6cb24-fe58-4e36-bd7f-a67a804a98e1" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:36:27 user nova-compute[74960]: DEBUG nova.network.neutron [req-8b095d38-e746-44bc-a1d0-c7563fa219f6 req-ef6cac6c-1d33-40e7-b9cb-fd0c5d5c7c63 service nova] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] Refreshing network info cache for port fe22f17b-b60c-465a-9079-e9c008004741 {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 12:36:27 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-594e04c1-e0bc-4af4-8447-5f6568fc1c76 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Acquiring lock "5dc6cb24-fe58-4e36-bd7f-a67a804a98e1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:36:27 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-594e04c1-e0bc-4af4-8447-5f6568fc1c76 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Lock "5dc6cb24-fe58-4e36-bd7f-a67a804a98e1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:36:27 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-594e04c1-e0bc-4af4-8447-5f6568fc1c76 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Acquiring lock "5dc6cb24-fe58-4e36-bd7f-a67a804a98e1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:36:27 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-594e04c1-e0bc-4af4-8447-5f6568fc1c76 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Lock "5dc6cb24-fe58-4e36-bd7f-a67a804a98e1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:36:27 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-594e04c1-e0bc-4af4-8447-5f6568fc1c76 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Lock "5dc6cb24-fe58-4e36-bd7f-a67a804a98e1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:36:27 user nova-compute[74960]: INFO nova.compute.manager [None req-594e04c1-e0bc-4af4-8447-5f6568fc1c76 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] Terminating instance
Nov 03 12:36:27 user nova-compute[74960]: DEBUG nova.compute.manager [None req-594e04c1-e0bc-4af4-8447-5f6568fc1c76 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] Start destroying the instance on the hypervisor. {{(pid=74960) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 12:36:28 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:36:28 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:36:28 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:36:28 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:36:28 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:36:28 user nova-compute[74960]: DEBUG nova.network.neutron [req-8b095d38-e746-44bc-a1d0-c7563fa219f6 req-ef6cac6c-1d33-40e7-b9cb-fd0c5d5c7c63 service nova] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] Updated VIF entry in instance network info cache for port fe22f17b-b60c-465a-9079-e9c008004741. {{(pid=74960) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 12:36:28 user nova-compute[74960]: DEBUG nova.network.neutron [req-8b095d38-e746-44bc-a1d0-c7563fa219f6 req-ef6cac6c-1d33-40e7-b9cb-fd0c5d5c7c63 service nova] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] Updating instance_info_cache with network_info: [{"id": "fe22f17b-b60c-465a-9079-e9c008004741", "address": "fa:16:3e:cd:e4:ff", "network": {"id": "a356b90b-cf10-4b3f-802a-aa2656c5588b", "bridge": "br-int", "label": "tempest-TestShelveInstance-1788680557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b44956ba8ca42f29fda6a18ef9fb198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe22f17b-b6", "ovs_interfaceid": "fe22f17b-b60c-465a-9079-e9c008004741", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:36:28 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-8b095d38-e746-44bc-a1d0-c7563fa219f6 req-ef6cac6c-1d33-40e7-b9cb-fd0c5d5c7c63 service nova] Releasing lock "refresh_cache-5dc6cb24-fe58-4e36-bd7f-a67a804a98e1" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:36:28 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:36:28 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] Instance destroyed successfully.
Nov 03 12:36:28 user nova-compute[74960]: DEBUG nova.objects.instance [None req-594e04c1-e0bc-4af4-8447-5f6568fc1c76 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Lazy-loading 'resources' on Instance uuid 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:36:28 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-594e04c1-e0bc-4af4-8447-5f6568fc1c76 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-03T12:30:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1397605353',display_name='tempest-TestShelveInstance-server-1397605353',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1397605353',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHFekLWMbWYWoCQaCK9+hxX9ibPEk05TiHGhuFvRfX8RGTVqWkQB1RSDB+6j4GE33fwbvqMtRoW6yWncOnXHVCLVY/+dhav0Db70nMOqH3hrUcyPCb8MFc4JJJomwnEGlA==',key_name='tempest-TestShelveInstance-208551886',keypairs=<?>,launch_index=0,launched_at=2023-11-03T12:35:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3b44956ba8ca42f29fda6a18ef9fb198',ramdisk_id='',reservation_id='r-ait87mp2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1884052938',owner_user_name='tempest-TestShelveInstance-1884052938-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T12:35:12Z,user_data=None,user_id='0e7c95f83f104c0697236508cd538c3e',uuid=5dc6cb24-fe58-4e36-bd7f-a67a804a98e1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fe22f17b-b60c-465a-9079-e9c008004741", "address": "fa:16:3e:cd:e4:ff", "network": {"id": "a356b90b-cf10-4b3f-802a-aa2656c5588b", "bridge": "br-int", "label": "tempest-TestShelveInstance-1788680557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b44956ba8ca42f29fda6a18ef9fb198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe22f17b-b6", "ovs_interfaceid": "fe22f17b-b60c-465a-9079-e9c008004741", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 12:36:28 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-594e04c1-e0bc-4af4-8447-5f6568fc1c76 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Converting VIF {"id": "fe22f17b-b60c-465a-9079-e9c008004741", "address": "fa:16:3e:cd:e4:ff", "network": {"id": "a356b90b-cf10-4b3f-802a-aa2656c5588b", "bridge": "br-int", "label": "tempest-TestShelveInstance-1788680557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b44956ba8ca42f29fda6a18ef9fb198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe22f17b-b6", "ovs_interfaceid": "fe22f17b-b60c-465a-9079-e9c008004741", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:36:28 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-594e04c1-e0bc-4af4-8447-5f6568fc1c76 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:e4:ff,bridge_name='br-int',has_traffic_filtering=True,id=fe22f17b-b60c-465a-9079-e9c008004741,network=Network(a356b90b-cf10-4b3f-802a-aa2656c5588b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe22f17b-b6') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:36:28 user nova-compute[74960]: DEBUG os_vif [None req-594e04c1-e0bc-4af4-8447-5f6568fc1c76 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:e4:ff,bridge_name='br-int',has_traffic_filtering=True,id=fe22f17b-b60c-465a-9079-e9c008004741,network=Network(a356b90b-cf10-4b3f-802a-aa2656c5588b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe22f17b-b6') {{(pid=74960) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 12:36:28 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:36:28 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfe22f17b-b6, bridge=br-int, if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:36:28 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:36:28 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:36:28 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:36:28 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9bcc4dd2-6e7b-402e-8528-8bc8bfcd10cb) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:36:28 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:36:28 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:36:28 user nova-compute[74960]: INFO os_vif [None req-594e04c1-e0bc-4af4-8447-5f6568fc1c76 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:e4:ff,bridge_name='br-int',has_traffic_filtering=True,id=fe22f17b-b60c-465a-9079-e9c008004741,network=Network(a356b90b-cf10-4b3f-802a-aa2656c5588b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe22f17b-b6')
Nov 03 12:36:28 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-594e04c1-e0bc-4af4-8447-5f6568fc1c76 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] calling os-brick to detach iSCSI Volume {{(pid=74960) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 12:36:28 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-594e04c1-e0bc-4af4-8447-5f6568fc1c76 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9aa420acb0>, {'target_iqn': 'iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sPdXleCb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:36:28 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-594e04c1-e0bc-4af4-8447-5f6568fc1c76 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:36:28 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-594e04c1-e0bc-4af4-8447-5f6568fc1c76 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:36:28 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-594e04c1-e0bc-4af4-8447-5f6568fc1c76 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:36:28 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:36:28 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:36:28 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[11e3f89c-2dea-47bb-b33c-63780f2ef351]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:623b8c1d-ba2d-4bad-b0bd-71eefe783606\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:36:28 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-594e04c1-e0bc-4af4-8447-5f6568fc1c76 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 12:36:28 user nova-compute[74960]: No targets found.
Nov 03 12:36:28 user nova-compute[74960]: iSNS:
Nov 03 12:36:28 user nova-compute[74960]: No targets found.
Nov 03 12:36:28 user nova-compute[74960]: STATIC:
Nov 03 12:36:28 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515
Nov 03 12:36:28 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:36:28 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:36:28 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797
Nov 03 12:36:28 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:36:28 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:36:28 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2
Nov 03 12:36:28 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:36:28 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:36:28 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:623b8c1d-ba2d-4bad-b0bd-71eefe783606
Nov 03 12:36:28 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:36:28 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:36:28 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61
Nov 03 12:36:28 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:36:28 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:36:28 user nova-compute[74960]: FIRMWARE:
Nov 03 12:36:28 user nova-compute[74960]: No targets found.
Nov 03 12:36:28 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:36:28 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-594e04c1-e0bc-4af4-8447-5f6568fc1c76 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 12:36:28 user nova-compute[74960]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 12:36:28 user nova-compute[74960]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74960) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 12:36:28 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-594e04c1-e0bc-4af4-8447-5f6568fc1c76 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797', 0)] {{(pid=74960) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 12:36:28 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:36:28 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:36:28 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[073a23a1-7158-4244-9fae-071016ff84b9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:623b8c1d-ba2d-4bad-b0bd-71eefe783606\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:36:28 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:36:28 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:36:28 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[61fa91a3-2b32-47fd-803c-037b5efe89ba]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:623b8c1d-ba2d-4bad-b0bd-71eefe783606 (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:36:28 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-594e04c1-e0bc-4af4-8447-5f6568fc1c76 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:36:28 user nova-compute[74960]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797 (non-flash)
Nov 03 12:36:28 user nova-compute[74960]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 (non-flash)
Nov 03 12:36:28 user nova-compute[74960]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61 (non-flash)
Nov 03 12:36:28 user nova-compute[74960]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:623b8c1d-ba2d-4bad-b0bd-71eefe783606 (non-flash)
Nov 03 12:36:28 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:36:28 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-594e04c1-e0bc-4af4-8447-5f6568fc1c76 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:36:28 user nova-compute[74960]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797 (non-flash)
Nov 03 12:36:28 user nova-compute[74960]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 (non-flash)
Nov 03 12:36:28 user nova-compute[74960]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61 (non-flash)
Nov 03 12:36:28 user nova-compute[74960]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:623b8c1d-ba2d-4bad-b0bd-71eefe783606 (non-flash)
Nov 03 12:36:28 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:36:28 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-594e04c1-e0bc-4af4-8447-5f6568fc1c76 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9a8c43d5a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797'): ({'sde'}, set())}) {{(pid=74960) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 12:36:28 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-594e04c1-e0bc-4af4-8447-5f6568fc1c76 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Removing single pathed devices sde {{(pid=74960) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 12:36:28 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:36:28 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:36:28 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[2903491b-f1fa-4d4b-8be5-9944bd3ec2b5]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:36:28 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:36:28 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:36:28 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[019b87fd-49e0-4abf-bec1-ab1a657214d5]: (4, ('ok\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:36:28 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-594e04c1-e0bc-4af4-8447-5f6568fc1c76 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Flushing IO for device /dev/sde {{(pid=74960) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 12:36:28 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:36:28 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:36:28 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a8b763-9966-4ae3-b5e4-1739d37ffd9a]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:36:28 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-594e04c1-e0bc-4af4-8447-5f6568fc1c76 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74960) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 12:36:28 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:36:28 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.048s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:36:28 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[4df09249-b74e-4fa0-8a1f-104ade3897a0]: (4, ('1', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:36:28 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-594e04c1-e0bc-4af4-8447-5f6568fc1c76 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74960) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 12:36:28 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-594e04c1-e0bc-4af4-8447-5f6568fc1c76 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] SCSI volumes sde have been removed. {{(pid=74960) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 12:36:28 user nova-compute[74960]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_d08af5bc',) {{(pid=86167) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 03 12:36:28 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[d48bfd8e-1fb5-472f-a8bf-030b2b779b0f]: (4, None) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:36:28 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-594e04c1-e0bc-4af4-8447-5f6568fc1c76 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797')] {{(pid=74960) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 12:36:28 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:36:28 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:36:28 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[b72f272b-8b04-4c19-9b53-06b7cd3aabe7]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:36:28 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-594e04c1-e0bc-4af4-8447-5f6568fc1c76 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:36:28 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797 -p 172.16.0.220:3260 --logout {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:36:29 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:36:29 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[80aa97e4-fbbd-426b-b3a7-73c8cb0b0448]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:36:29 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-594e04c1-e0bc-4af4-8447-5f6568fc1c76 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797, portal: 172.16.0.220,3260]
Nov 03 12:36:29 user nova-compute[74960]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797, portal: 172.16.0.220,3260] successful.
Nov 03 12:36:29 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:36:29 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797 -p 172.16.0.220:3260 --op delete {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:36:29 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa4cf8d2-7542-4bcf-840d-5ccc3401a797 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:36:29 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[1641168b-5dd8-487d-9a1f-55aa2a2a799d]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:36:29 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-594e04c1-e0bc-4af4-8447-5f6568fc1c76 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:36:29 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-594e04c1-e0bc-4af4-8447-5f6568fc1c76 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:36:29 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-594e04c1-e0bc-4af4-8447-5f6568fc1c76 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] <== disconnect_volume: return (345ms) None {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:36:29 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-594e04c1-e0bc-4af4-8447-5f6568fc1c76 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] Disconnected iSCSI Volume {{(pid=74960) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 12:36:29 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-594e04c1-e0bc-4af4-8447-5f6568fc1c76 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] Deleting instance files /opt/stack/data/nova/instances/5dc6cb24-fe58-4e36-bd7f-a67a804a98e1_del
Nov 03 12:36:29 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-594e04c1-e0bc-4af4-8447-5f6568fc1c76 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] Deletion of /opt/stack/data/nova/instances/5dc6cb24-fe58-4e36-bd7f-a67a804a98e1_del complete
Nov 03 12:36:29 user nova-compute[74960]: INFO nova.compute.manager [None req-594e04c1-e0bc-4af4-8447-5f6568fc1c76 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] Took 1.21 seconds to destroy the instance on the hypervisor.
Nov 03 12:36:29 user nova-compute[74960]: DEBUG oslo.service.loopingcall [None req-594e04c1-e0bc-4af4-8447-5f6568fc1c76 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74960) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 12:36:29 user nova-compute[74960]: DEBUG nova.compute.manager [-] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] Deallocating network for instance {{(pid=74960) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 12:36:29 user nova-compute[74960]: DEBUG nova.network.neutron [-] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] deallocate_for_instance() {{(pid=74960) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 12:36:29 user nova-compute[74960]: DEBUG nova.compute.manager [req-9ae038bb-d53c-498f-bc40-91ef845a24d5 req-9abd8822-451a-437c-ae62-ef2a9c2cc371 service nova] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] Received event network-vif-unplugged-fe22f17b-b60c-465a-9079-e9c008004741 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:36:29 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-9ae038bb-d53c-498f-bc40-91ef845a24d5 req-9abd8822-451a-437c-ae62-ef2a9c2cc371 service nova] Acquiring lock "5dc6cb24-fe58-4e36-bd7f-a67a804a98e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:36:29 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-9ae038bb-d53c-498f-bc40-91ef845a24d5 req-9abd8822-451a-437c-ae62-ef2a9c2cc371 service nova] Lock "5dc6cb24-fe58-4e36-bd7f-a67a804a98e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:36:29 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-9ae038bb-d53c-498f-bc40-91ef845a24d5 req-9abd8822-451a-437c-ae62-ef2a9c2cc371 service nova] Lock "5dc6cb24-fe58-4e36-bd7f-a67a804a98e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:36:29 user nova-compute[74960]: DEBUG nova.compute.manager [req-9ae038bb-d53c-498f-bc40-91ef845a24d5 req-9abd8822-451a-437c-ae62-ef2a9c2cc371 service nova] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] No waiting events found dispatching network-vif-unplugged-fe22f17b-b60c-465a-9079-e9c008004741 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:36:29 user nova-compute[74960]: DEBUG nova.compute.manager [req-9ae038bb-d53c-498f-bc40-91ef845a24d5 req-9abd8822-451a-437c-ae62-ef2a9c2cc371 service nova] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] Received event network-vif-unplugged-fe22f17b-b60c-465a-9079-e9c008004741 for instance with task_state deleting. {{(pid=74960) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 12:36:29 user nova-compute[74960]: DEBUG nova.compute.manager [req-9ae038bb-d53c-498f-bc40-91ef845a24d5 req-9abd8822-451a-437c-ae62-ef2a9c2cc371 service nova] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] Received event network-vif-plugged-fe22f17b-b60c-465a-9079-e9c008004741 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:36:29 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-9ae038bb-d53c-498f-bc40-91ef845a24d5 req-9abd8822-451a-437c-ae62-ef2a9c2cc371 service nova] Acquiring lock "5dc6cb24-fe58-4e36-bd7f-a67a804a98e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:36:29 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-9ae038bb-d53c-498f-bc40-91ef845a24d5 req-9abd8822-451a-437c-ae62-ef2a9c2cc371 service nova] Lock "5dc6cb24-fe58-4e36-bd7f-a67a804a98e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:36:29 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-9ae038bb-d53c-498f-bc40-91ef845a24d5 req-9abd8822-451a-437c-ae62-ef2a9c2cc371 service nova] Lock "5dc6cb24-fe58-4e36-bd7f-a67a804a98e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:36:29 user nova-compute[74960]: DEBUG nova.compute.manager [req-9ae038bb-d53c-498f-bc40-91ef845a24d5 req-9abd8822-451a-437c-ae62-ef2a9c2cc371 service nova] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] No waiting events found dispatching network-vif-plugged-fe22f17b-b60c-465a-9079-e9c008004741 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:36:29 user nova-compute[74960]: WARNING nova.compute.manager [req-9ae038bb-d53c-498f-bc40-91ef845a24d5 req-9abd8822-451a-437c-ae62-ef2a9c2cc371 service nova] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] Received unexpected event network-vif-plugged-fe22f17b-b60c-465a-9079-e9c008004741 for instance with vm_state active and task_state deleting.
Nov 03 12:36:30 user nova-compute[74960]: DEBUG nova.network.neutron [-] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] Updating instance_info_cache with network_info: [] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:36:30 user nova-compute[74960]: INFO nova.compute.manager [-] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] Took 1.06 seconds to deallocate network for instance.
Nov 03 12:36:31 user nova-compute[74960]: INFO nova.compute.manager [None req-594e04c1-e0bc-4af4-8447-5f6568fc1c76 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] Took 0.93 seconds to detach 1 volumes for instance.
Nov 03 12:36:31 user nova-compute[74960]: DEBUG nova.compute.manager [None req-594e04c1-e0bc-4af4-8447-5f6568fc1c76 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] Deleting volume: fa4cf8d2-7542-4bcf-840d-5ccc3401a797 {{(pid=74960) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 03 12:36:31 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-594e04c1-e0bc-4af4-8447-5f6568fc1c76 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:36:31 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-594e04c1-e0bc-4af4-8447-5f6568fc1c76 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:36:31 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-594e04c1-e0bc-4af4-8447-5f6568fc1c76 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:36:31 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-594e04c1-e0bc-4af4-8447-5f6568fc1c76 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:36:31 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-594e04c1-e0bc-4af4-8447-5f6568fc1c76 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.425s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:36:31 user nova-compute[74960]: INFO nova.scheduler.client.report [None req-594e04c1-e0bc-4af4-8447-5f6568fc1c76 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Deleted allocations for instance 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1
Nov 03 12:36:31 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-594e04c1-e0bc-4af4-8447-5f6568fc1c76 tempest-TestShelveInstance-1884052938 tempest-TestShelveInstance-1884052938-project-member] Lock "5dc6cb24-fe58-4e36-bd7f-a67a804a98e1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.888s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:36:31 user nova-compute[74960]: DEBUG nova.compute.manager [req-9ff8ebf2-685c-4b18-bf86-277ffc549262 req-8677ac22-3e00-48e2-bd7e-e616f58dab10 service nova] [instance: 5dc6cb24-fe58-4e36-bd7f-a67a804a98e1] Received event network-vif-deleted-fe22f17b-b60c-465a-9079-e9c008004741 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:36:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:36:36 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-d69e953e-01ea-4122-a191-c674adc258f8 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Acquiring lock "895d6de1-b5d9-4555-af57-f7816183be58" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:36:36 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-d69e953e-01ea-4122-a191-c674adc258f8 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Lock "895d6de1-b5d9-4555-af57-f7816183be58" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:36:36 user nova-compute[74960]: DEBUG nova.compute.manager [None req-d69e953e-01ea-4122-a191-c674adc258f8 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] Starting instance... {{(pid=74960) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 12:36:37 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-d69e953e-01ea-4122-a191-c674adc258f8 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:36:37 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-d69e953e-01ea-4122-a191-c674adc258f8 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:36:37 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-d69e953e-01ea-4122-a191-c674adc258f8 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74960) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 12:36:37 user nova-compute[74960]: INFO nova.compute.claims [None req-d69e953e-01ea-4122-a191-c674adc258f8 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] Claim successful on node user
Nov 03 12:36:37 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-d69e953e-01ea-4122-a191-c674adc258f8 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:36:37 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-d69e953e-01ea-4122-a191-c674adc258f8 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:36:37 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-d69e953e-01ea-4122-a191-c674adc258f8 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.570s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:36:37 user nova-compute[74960]: DEBUG nova.compute.manager [None req-d69e953e-01ea-4122-a191-c674adc258f8 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] Start building networks asynchronously for instance. {{(pid=74960) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 12:36:37 user nova-compute[74960]: DEBUG nova.compute.manager [None req-d69e953e-01ea-4122-a191-c674adc258f8 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] Allocating IP information in the background. {{(pid=74960) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 12:36:37 user nova-compute[74960]: DEBUG nova.network.neutron [None req-d69e953e-01ea-4122-a191-c674adc258f8 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] allocate_for_instance() {{(pid=74960) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 12:36:37 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-d69e953e-01ea-4122-a191-c674adc258f8 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 12:36:37 user nova-compute[74960]: DEBUG nova.compute.manager [None req-d69e953e-01ea-4122-a191-c674adc258f8 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] Start building block device mappings for instance. {{(pid=74960) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 12:36:37 user nova-compute[74960]: INFO nova.virt.block_device [None req-d69e953e-01ea-4122-a191-c674adc258f8 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] Booting with volume-backed-image 549f51ba-ac69-494b-8de1-34635aa2d7cf at /dev/vda
Nov 03 12:36:38 user nova-compute[74960]: DEBUG nova.policy [None req-d69e953e-01ea-4122-a191-c674adc258f8 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c473215929044a108c9fc4d6327dfc3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc95d68d5e147e1953c855169b17091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74960) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 12:36:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:36:38 user nova-compute[74960]: DEBUG nova.network.neutron [None req-d69e953e-01ea-4122-a191-c674adc258f8 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] Successfully created port: 59f6ddba-fb77-4d36-98da-f4d645355650 {{(pid=74960) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 12:36:39 user nova-compute[74960]: DEBUG nova.network.neutron [None req-d69e953e-01ea-4122-a191-c674adc258f8 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] Successfully updated port: 59f6ddba-fb77-4d36-98da-f4d645355650 {{(pid=74960) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 12:36:39 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-d69e953e-01ea-4122-a191-c674adc258f8 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Acquiring lock "refresh_cache-895d6de1-b5d9-4555-af57-f7816183be58" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:36:39 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-d69e953e-01ea-4122-a191-c674adc258f8 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Acquired lock "refresh_cache-895d6de1-b5d9-4555-af57-f7816183be58" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:36:39 user nova-compute[74960]: DEBUG nova.network.neutron [None req-d69e953e-01ea-4122-a191-c674adc258f8 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] Building network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 12:36:39 user nova-compute[74960]: DEBUG nova.compute.manager [req-b54a1d28-802b-4f48-9504-4509ab13a83a req-f6e947f1-e591-449c-ad82-150fd2b0b235 service nova] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] Received event network-changed-59f6ddba-fb77-4d36-98da-f4d645355650 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:36:39 user nova-compute[74960]: DEBUG nova.compute.manager [req-b54a1d28-802b-4f48-9504-4509ab13a83a req-f6e947f1-e591-449c-ad82-150fd2b0b235 service nova] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] Refreshing instance network info cache due to event network-changed-59f6ddba-fb77-4d36-98da-f4d645355650. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 12:36:39 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-b54a1d28-802b-4f48-9504-4509ab13a83a req-f6e947f1-e591-449c-ad82-150fd2b0b235 service nova] Acquiring lock "refresh_cache-895d6de1-b5d9-4555-af57-f7816183be58" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:36:39 user nova-compute[74960]: DEBUG nova.network.neutron [None req-d69e953e-01ea-4122-a191-c674adc258f8 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] Instance cache missing network info. {{(pid=74960) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 12:36:39 user nova-compute[74960]: DEBUG nova.network.neutron [None req-d69e953e-01ea-4122-a191-c674adc258f8 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] Updating instance_info_cache with network_info: [{"id": "59f6ddba-fb77-4d36-98da-f4d645355650", "address": "fa:16:3e:df:ac:19", "network": {"id": "dec66832-56d5-4d68-b11f-8e8eed38f045", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-79099436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc95d68d5e147e1953c855169b17091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59f6ddba-fb", "ovs_interfaceid": "59f6ddba-fb77-4d36-98da-f4d645355650", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:36:39 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-d69e953e-01ea-4122-a191-c674adc258f8 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Releasing lock "refresh_cache-895d6de1-b5d9-4555-af57-f7816183be58" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:36:39 user nova-compute[74960]: DEBUG nova.compute.manager [None req-d69e953e-01ea-4122-a191-c674adc258f8 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] Instance network_info: |[{"id": "59f6ddba-fb77-4d36-98da-f4d645355650", "address": "fa:16:3e:df:ac:19", "network": {"id": "dec66832-56d5-4d68-b11f-8e8eed38f045", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-79099436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc95d68d5e147e1953c855169b17091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59f6ddba-fb", "ovs_interfaceid": "59f6ddba-fb77-4d36-98da-f4d645355650", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74960) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 12:36:39 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-b54a1d28-802b-4f48-9504-4509ab13a83a req-f6e947f1-e591-449c-ad82-150fd2b0b235 service nova] Acquired lock "refresh_cache-895d6de1-b5d9-4555-af57-f7816183be58" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:36:39 user nova-compute[74960]: DEBUG nova.network.neutron [req-b54a1d28-802b-4f48-9504-4509ab13a83a req-f6e947f1-e591-449c-ad82-150fd2b0b235 service nova] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] Refreshing network info cache for port 59f6ddba-fb77-4d36-98da-f4d645355650 {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 12:36:40 user nova-compute[74960]: DEBUG nova.network.neutron [req-b54a1d28-802b-4f48-9504-4509ab13a83a req-f6e947f1-e591-449c-ad82-150fd2b0b235 service nova] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] Updated VIF entry in instance network info cache for port 59f6ddba-fb77-4d36-98da-f4d645355650. {{(pid=74960) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 12:36:40 user nova-compute[74960]: DEBUG nova.network.neutron [req-b54a1d28-802b-4f48-9504-4509ab13a83a req-f6e947f1-e591-449c-ad82-150fd2b0b235 service nova] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] Updating instance_info_cache with network_info: [{"id": "59f6ddba-fb77-4d36-98da-f4d645355650", "address": "fa:16:3e:df:ac:19", "network": {"id": "dec66832-56d5-4d68-b11f-8e8eed38f045", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-79099436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc95d68d5e147e1953c855169b17091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59f6ddba-fb", "ovs_interfaceid": "59f6ddba-fb77-4d36-98da-f4d645355650", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:36:40 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-b54a1d28-802b-4f48-9504-4509ab13a83a req-f6e947f1-e591-449c-ad82-150fd2b0b235 service nova] Releasing lock "refresh_cache-895d6de1-b5d9-4555-af57-f7816183be58" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:36:42 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-9b709e7f-ba0d-4d0e-ac37-e5c6eb17f9a4 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Acquiring lock "35e02c80-f626-4918-93f1-6b9a7f778c7a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:36:42 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-9b709e7f-ba0d-4d0e-ac37-e5c6eb17f9a4 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Lock "35e02c80-f626-4918-93f1-6b9a7f778c7a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:36:42 user nova-compute[74960]: DEBUG nova.objects.instance [None req-9b709e7f-ba0d-4d0e-ac37-e5c6eb17f9a4 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Lazy-loading 'flavor' on Instance uuid 35e02c80-f626-4918-93f1-6b9a7f778c7a {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:36:42 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-9b709e7f-ba0d-4d0e-ac37-e5c6eb17f9a4 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Lock "35e02c80-f626-4918-93f1-6b9a7f778c7a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:36:42 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-9b709e7f-ba0d-4d0e-ac37-e5c6eb17f9a4 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Acquiring lock "35e02c80-f626-4918-93f1-6b9a7f778c7a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:36:42 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-9b709e7f-ba0d-4d0e-ac37-e5c6eb17f9a4 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Lock "35e02c80-f626-4918-93f1-6b9a7f778c7a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:36:42 user nova-compute[74960]: INFO nova.compute.manager [None req-9b709e7f-ba0d-4d0e-ac37-e5c6eb17f9a4 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a] Attaching volume c91df593-71cf-41cf-869f-7c87a6358e8e to /dev/vdb
Nov 03 12:36:42 user nova-compute[74960]: DEBUG os_brick.utils [None req-9b709e7f-ba0d-4d0e-ac37-e5c6eb17f9a4 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:36:42 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:36:42 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:36:42 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[6790a87a-3c0a-4197-bd56-100ba9e5dc68]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:75b8e219756\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:36:42 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:36:42 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:36:42 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba426371-4d4a-44c1-a6f5-b127c118c2e8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:36:42 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:36:42 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:36:42 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a317c1a-0c1c-4505-b9f9-fc8f4641ab8b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:36:42 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[33756db6-15aa-435a-8862-8059faaab1cb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:36:42 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-9b709e7f-ba0d-4d0e-ac37-e5c6eb17f9a4 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Running cmd (subprocess): nvme version {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:36:42 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-9b709e7f-ba0d-4d0e-ac37-e5c6eb17f9a4 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] 'nvme version' failed. Not Retrying. {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 12:36:42 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9b709e7f-ba0d-4d0e-ac37-e5c6eb17f9a4 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] nvme not present on system {{(pid=74960) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 12:36:42 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:36:42 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 12:36:42 user nova-compute[74960]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 12:36:42 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[a72764d4-f7bd-4679-923f-814193d9c613]: (4, '') {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:36:42 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-9b709e7f-ba0d-4d0e-ac37-e5c6eb17f9a4 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74960) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 12:36:42 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-9b709e7f-ba0d-4d0e-ac37-e5c6eb17f9a4 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74960) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 12:36:42 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-9b709e7f-ba0d-4d0e-ac37-e5c6eb17f9a4 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] LIGHTOS: no hostnqn found. {{(pid=74960) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 12:36:42 user nova-compute[74960]: DEBUG os_brick.utils [None req-9b709e7f-ba0d-4d0e-ac37-e5c6eb17f9a4 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:75b8e219756', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:36:42 user nova-compute[74960]: DEBUG nova.virt.block_device [None req-9b709e7f-ba0d-4d0e-ac37-e5c6eb17f9a4 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a] Updating existing volume attachment record: cd043ae3-e530-47f0-8c92-f4143b7a125e {{(pid=74960) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 12:36:43 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:36:43 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:36:44 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-58601450-1841-4650-91ad-d4bbeea21fb6 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] Acquiring lock "9c447082-b59b-4c8e-8fa0-bf6599a84e91" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:36:44 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-58601450-1841-4650-91ad-d4bbeea21fb6 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] Lock "9c447082-b59b-4c8e-8fa0-bf6599a84e91" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:36:44 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-58601450-1841-4650-91ad-d4bbeea21fb6 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] Acquiring lock "9c447082-b59b-4c8e-8fa0-bf6599a84e91-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:36:44 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-58601450-1841-4650-91ad-d4bbeea21fb6 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] Lock "9c447082-b59b-4c8e-8fa0-bf6599a84e91-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:36:44 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-58601450-1841-4650-91ad-d4bbeea21fb6 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] Lock "9c447082-b59b-4c8e-8fa0-bf6599a84e91-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:36:44 user nova-compute[74960]: INFO nova.compute.manager [None req-58601450-1841-4650-91ad-d4bbeea21fb6 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] [instance: 9c447082-b59b-4c8e-8fa0-bf6599a84e91] Terminating instance
Nov 03 12:36:44 user nova-compute[74960]: DEBUG nova.compute.manager [None req-58601450-1841-4650-91ad-d4bbeea21fb6 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] [instance: 9c447082-b59b-4c8e-8fa0-bf6599a84e91] Start destroying the instance on the hypervisor. {{(pid=74960) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 12:36:45 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:36:45 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:36:45 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:36:45 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:36:45 user nova-compute[74960]: DEBUG nova.compute.manager [req-da54a8e6-415c-4e8e-879d-eadfbf8cf7e1 req-3e05d2a9-59a9-4a31-b60d-c0fc5677bbaf service nova] [instance: 9c447082-b59b-4c8e-8fa0-bf6599a84e91] Received event network-vif-unplugged-d08c2ee9-364d-4a04-a7de-2e45049473a8 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:36:45 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-da54a8e6-415c-4e8e-879d-eadfbf8cf7e1 req-3e05d2a9-59a9-4a31-b60d-c0fc5677bbaf service nova] Acquiring lock "9c447082-b59b-4c8e-8fa0-bf6599a84e91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:36:45 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-da54a8e6-415c-4e8e-879d-eadfbf8cf7e1 req-3e05d2a9-59a9-4a31-b60d-c0fc5677bbaf service nova] Lock "9c447082-b59b-4c8e-8fa0-bf6599a84e91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:36:45 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-da54a8e6-415c-4e8e-879d-eadfbf8cf7e1 req-3e05d2a9-59a9-4a31-b60d-c0fc5677bbaf service nova] Lock "9c447082-b59b-4c8e-8fa0-bf6599a84e91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:36:45 user nova-compute[74960]: DEBUG nova.compute.manager [req-da54a8e6-415c-4e8e-879d-eadfbf8cf7e1 req-3e05d2a9-59a9-4a31-b60d-c0fc5677bbaf service nova] [instance: 9c447082-b59b-4c8e-8fa0-bf6599a84e91] No waiting events found dispatching network-vif-unplugged-d08c2ee9-364d-4a04-a7de-2e45049473a8 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:36:45 user nova-compute[74960]: DEBUG nova.compute.manager [req-da54a8e6-415c-4e8e-879d-eadfbf8cf7e1 req-3e05d2a9-59a9-4a31-b60d-c0fc5677bbaf service nova] [instance: 9c447082-b59b-4c8e-8fa0-bf6599a84e91] Received event network-vif-unplugged-d08c2ee9-364d-4a04-a7de-2e45049473a8 for instance with task_state deleting. {{(pid=74960) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 12:36:45 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: 9c447082-b59b-4c8e-8fa0-bf6599a84e91] Instance destroyed successfully.
Nov 03 12:36:45 user nova-compute[74960]: DEBUG nova.objects.instance [None req-58601450-1841-4650-91ad-d4bbeea21fb6 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] Lazy-loading 'resources' on Instance uuid 9c447082-b59b-4c8e-8fa0-bf6599a84e91 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:36:45 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-58601450-1841-4650-91ad-d4bbeea21fb6 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:33:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1428352861',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1428352861',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1428352',id=33,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN8v59hYd2ehUTvDYy0c/DZL4XOF1gEIx5mkFnOsVYBXSeNZpVJg7swiGnKfYNeOwSyat8knUkINhbcT2K4wweaTmiP2hMlled1QvQUSBBicgkHLtjMazw59akS0IWOpPQ==',key_name='tempest-keypair-865672496',keypairs=<?>,launch_index=0,launched_at=2023-11-03T12:33:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2ff357804ee44063bce5f36ad836d71d',ramdisk_id='',reservation_id='r-slml0fv7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-691169955',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T12:33:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='801107e2c6aa4cc79ffe0127c1f437de',uuid=9c447082-b59b-4c8e-8fa0-bf6599a84e91,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d08c2ee9-364d-4a04-a7de-2e45049473a8", "address": "fa:16:3e:fd:9d:36", "network": {"id": "1acaa882-f931-44d0-b9d0-17ed988e4e8b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1021854594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ff357804ee44063bce5f36ad836d71d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd08c2ee9-36", "ovs_interfaceid": "d08c2ee9-364d-4a04-a7de-2e45049473a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 12:36:45 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-58601450-1841-4650-91ad-d4bbeea21fb6 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] Converting VIF {"id": "d08c2ee9-364d-4a04-a7de-2e45049473a8", "address": "fa:16:3e:fd:9d:36", "network": {"id": "1acaa882-f931-44d0-b9d0-17ed988e4e8b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1021854594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ff357804ee44063bce5f36ad836d71d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd08c2ee9-36", "ovs_interfaceid": "d08c2ee9-364d-4a04-a7de-2e45049473a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:36:45 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-58601450-1841-4650-91ad-d4bbeea21fb6 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fd:9d:36,bridge_name='br-int',has_traffic_filtering=True,id=d08c2ee9-364d-4a04-a7de-2e45049473a8,network=Network(1acaa882-f931-44d0-b9d0-17ed988e4e8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd08c2ee9-36') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:36:45 user nova-compute[74960]: DEBUG os_vif [None req-58601450-1841-4650-91ad-d4bbeea21fb6 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fd:9d:36,bridge_name='br-int',has_traffic_filtering=True,id=d08c2ee9-364d-4a04-a7de-2e45049473a8,network=Network(1acaa882-f931-44d0-b9d0-17ed988e4e8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd08c2ee9-36') {{(pid=74960) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 12:36:45 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:36:45 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd08c2ee9-36, bridge=br-int, if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:36:45 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:36:45 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:36:45 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:36:45 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3e07043c-653c-4ea4-a8ba-e8ca66a78ac8) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:36:45 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:36:45 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:36:45 user nova-compute[74960]: INFO os_vif [None req-58601450-1841-4650-91ad-d4bbeea21fb6 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fd:9d:36,bridge_name='br-int',has_traffic_filtering=True,id=d08c2ee9-364d-4a04-a7de-2e45049473a8,network=Network(1acaa882-f931-44d0-b9d0-17ed988e4e8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd08c2ee9-36')
Nov 03 12:36:45 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-58601450-1841-4650-91ad-d4bbeea21fb6 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] [instance: 9c447082-b59b-4c8e-8fa0-bf6599a84e91] Deleting instance files /opt/stack/data/nova/instances/9c447082-b59b-4c8e-8fa0-bf6599a84e91_del
Nov 03 12:36:45 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-58601450-1841-4650-91ad-d4bbeea21fb6 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] [instance: 9c447082-b59b-4c8e-8fa0-bf6599a84e91] Deletion of /opt/stack/data/nova/instances/9c447082-b59b-4c8e-8fa0-bf6599a84e91_del complete
Nov 03 12:36:45 user nova-compute[74960]: INFO nova.compute.manager [None req-58601450-1841-4650-91ad-d4bbeea21fb6 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] [instance: 9c447082-b59b-4c8e-8fa0-bf6599a84e91] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 03 12:36:45 user nova-compute[74960]: DEBUG oslo.service.loopingcall [None req-58601450-1841-4650-91ad-d4bbeea21fb6 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74960) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 12:36:45 user nova-compute[74960]: DEBUG nova.compute.manager [-] [instance: 9c447082-b59b-4c8e-8fa0-bf6599a84e91] Deallocating network for instance {{(pid=74960) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 12:36:45 user nova-compute[74960]: DEBUG nova.network.neutron [-] [instance: 9c447082-b59b-4c8e-8fa0-bf6599a84e91] deallocate_for_instance() {{(pid=74960) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 12:36:46 user nova-compute[74960]: DEBUG nova.network.neutron [-] [instance: 9c447082-b59b-4c8e-8fa0-bf6599a84e91] Updating instance_info_cache with network_info: [] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:36:46 user nova-compute[74960]: INFO nova.compute.manager [-] [instance: 9c447082-b59b-4c8e-8fa0-bf6599a84e91] Took 1.00 seconds to deallocate network for instance.
Nov 03 12:36:46 user nova-compute[74960]: DEBUG nova.compute.manager [req-ac35a2db-4ddb-4fd0-8acd-d36c7333fb14 req-7851cb35-ddf9-4a74-b8e6-4699b1f3a855 service nova] [instance: 9c447082-b59b-4c8e-8fa0-bf6599a84e91] Received event network-vif-deleted-d08c2ee9-364d-4a04-a7de-2e45049473a8 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:36:46 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-58601450-1841-4650-91ad-d4bbeea21fb6 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:36:46 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-58601450-1841-4650-91ad-d4bbeea21fb6 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:36:47 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-58601450-1841-4650-91ad-d4bbeea21fb6 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:36:47 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-58601450-1841-4650-91ad-d4bbeea21fb6 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:36:47 user nova-compute[74960]: DEBUG nova.compute.manager [req-0ecbdac4-0c8b-40f5-a32b-e0700034409e req-42f1e77c-29f1-4284-a9e2-6ad1f0298c4c service nova] [instance: 9c447082-b59b-4c8e-8fa0-bf6599a84e91] Received event network-vif-plugged-d08c2ee9-364d-4a04-a7de-2e45049473a8 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:36:47 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-0ecbdac4-0c8b-40f5-a32b-e0700034409e req-42f1e77c-29f1-4284-a9e2-6ad1f0298c4c service nova] Acquiring lock "9c447082-b59b-4c8e-8fa0-bf6599a84e91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:36:47 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-0ecbdac4-0c8b-40f5-a32b-e0700034409e req-42f1e77c-29f1-4284-a9e2-6ad1f0298c4c service nova] Lock "9c447082-b59b-4c8e-8fa0-bf6599a84e91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:36:47 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-0ecbdac4-0c8b-40f5-a32b-e0700034409e req-42f1e77c-29f1-4284-a9e2-6ad1f0298c4c service nova] Lock "9c447082-b59b-4c8e-8fa0-bf6599a84e91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:36:47 user nova-compute[74960]: DEBUG nova.compute.manager [req-0ecbdac4-0c8b-40f5-a32b-e0700034409e req-42f1e77c-29f1-4284-a9e2-6ad1f0298c4c service nova] [instance: 9c447082-b59b-4c8e-8fa0-bf6599a84e91] No waiting events found dispatching network-vif-plugged-d08c2ee9-364d-4a04-a7de-2e45049473a8 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:36:47 user nova-compute[74960]: WARNING nova.compute.manager [req-0ecbdac4-0c8b-40f5-a32b-e0700034409e req-42f1e77c-29f1-4284-a9e2-6ad1f0298c4c service nova] [instance: 9c447082-b59b-4c8e-8fa0-bf6599a84e91] Received unexpected event network-vif-plugged-d08c2ee9-364d-4a04-a7de-2e45049473a8 for instance with vm_state deleted and task_state None.
Nov 03 12:36:47 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-58601450-1841-4650-91ad-d4bbeea21fb6 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.466s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:36:47 user nova-compute[74960]: INFO nova.scheduler.client.report [None req-58601450-1841-4650-91ad-d4bbeea21fb6 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] Deleted allocations for instance 9c447082-b59b-4c8e-8fa0-bf6599a84e91
Nov 03 12:36:47 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-58601450-1841-4650-91ad-d4bbeea21fb6 tempest-TestServerVolumeAttachScenarioOldVersion-691169955 tempest-TestServerVolumeAttachScenarioOldVersion-691169955-project-member] Lock "9c447082-b59b-4c8e-8fa0-bf6599a84e91" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.658s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:36:50 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:36:52 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:36:52 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:36:52 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:36:53 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:36:53 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Starting heal instance info cache {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 12:36:53 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "refresh_cache-5b7b95c0-3726-4a1c-a384-ec91abf75225" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:36:53 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquired lock "refresh_cache-5b7b95c0-3726-4a1c-a384-ec91abf75225" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:36:53 user nova-compute[74960]: DEBUG nova.network.neutron [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] Forcefully refreshing network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 12:36:54 user nova-compute[74960]: DEBUG nova.network.neutron [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] Updating instance_info_cache with network_info: [{"id": "091cbb89-dd8a-448e-963a-3dbcafde6bb1", "address": "fa:16:3e:cc:a5:1b", "network": {"id": "3eaeac55-9eb7-4301-b5a7-d13735656d8e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-826950903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9160afcfdb74ba2aad7bc79e628e96f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap091cbb89-dd", "ovs_interfaceid": "091cbb89-dd8a-448e-963a-3dbcafde6bb1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:36:54 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Releasing lock "refresh_cache-5b7b95c0-3726-4a1c-a384-ec91abf75225" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:36:54 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] Updated the network info_cache for instance {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 12:36:54 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:36:54 user nova-compute[74960]: INFO nova.compute.manager [None req-82fc5123-b046-42c9-9de0-b9ae304931df tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67] Rescuing
Nov 03 12:36:54 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-82fc5123-b046-42c9-9de0-b9ae304931df tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Acquiring lock "refresh_cache-47eb8ddf-590f-4ffa-87c8-377cf1ee0f67" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:36:54 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-82fc5123-b046-42c9-9de0-b9ae304931df tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Acquired lock "refresh_cache-47eb8ddf-590f-4ffa-87c8-377cf1ee0f67" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:36:54 user nova-compute[74960]: DEBUG nova.network.neutron [None req-82fc5123-b046-42c9-9de0-b9ae304931df tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67] Building network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 12:36:55 user nova-compute[74960]: DEBUG nova.network.neutron [None req-82fc5123-b046-42c9-9de0-b9ae304931df tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67] Updating instance_info_cache with network_info: [{"id": "844c85e9-5021-433d-9f93-530ec193e265", "address": "fa:16:3e:69:d8:32", "network": {"id": "9a9a848a-80be-4281-8554-8e28744073b3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1579909169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "434ce6c4b77342299a17e547a14e3918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap844c85e9-50", "ovs_interfaceid": "844c85e9-5021-433d-9f93-530ec193e265", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:36:55 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-82fc5123-b046-42c9-9de0-b9ae304931df tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Releasing lock "refresh_cache-47eb8ddf-590f-4ffa-87c8-377cf1ee0f67" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:36:55 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:36:55 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:36:55 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:36:55 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:36:55 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Auditing locally available compute resources for user (node: user) {{(pid=74960) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 12:36:55 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:36:55 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:36:55 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:36:55 user nova-compute[74960]: DEBUG nova.compute.manager [req-e3fde04c-9174-418a-bb09-896f1ee7d6f6 req-30545380-7106-4ca4-8339-54b2c51ce613 service nova] [instance: 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67] Received event network-vif-unplugged-844c85e9-5021-433d-9f93-530ec193e265 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:36:55 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-e3fde04c-9174-418a-bb09-896f1ee7d6f6 req-30545380-7106-4ca4-8339-54b2c51ce613 service nova] Acquiring lock "47eb8ddf-590f-4ffa-87c8-377cf1ee0f67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:36:55 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-e3fde04c-9174-418a-bb09-896f1ee7d6f6 req-30545380-7106-4ca4-8339-54b2c51ce613 service nova] Lock "47eb8ddf-590f-4ffa-87c8-377cf1ee0f67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:36:55 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-e3fde04c-9174-418a-bb09-896f1ee7d6f6 req-30545380-7106-4ca4-8339-54b2c51ce613 service nova] Lock "47eb8ddf-590f-4ffa-87c8-377cf1ee0f67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:36:55 user nova-compute[74960]: DEBUG nova.compute.manager [req-e3fde04c-9174-418a-bb09-896f1ee7d6f6 req-30545380-7106-4ca4-8339-54b2c51ce613 service nova] [instance: 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67] No waiting events found dispatching network-vif-unplugged-844c85e9-5021-433d-9f93-530ec193e265 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:36:55 user nova-compute[74960]: WARNING nova.compute.manager [req-e3fde04c-9174-418a-bb09-896f1ee7d6f6 req-30545380-7106-4ca4-8339-54b2c51ce613 service nova] [instance: 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67] Received unexpected event network-vif-unplugged-844c85e9-5021-433d-9f93-530ec193e265 for instance with vm_state active and task_state rescuing.
Nov 03 12:36:55 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:36:55 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:36:56 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67] Instance destroyed successfully.
Nov 03 12:36:56 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-82fc5123-b046-42c9-9de0-b9ae304931df tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67] Attempting rescue
Nov 03 12:36:56 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-82fc5123-b046-42c9-9de0-b9ae304931df tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74960) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 03 12:36:56 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-82fc5123-b046-42c9-9de0-b9ae304931df tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67] Instance directory exists: not creating {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 03 12:36:56 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-82fc5123-b046-42c9-9de0-b9ae304931df tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67] Creating image(s)
Nov 03 12:36:56 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-82fc5123-b046-42c9-9de0-b9ae304931df tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Acquiring lock "/opt/stack/data/nova/instances/47eb8ddf-590f-4ffa-87c8-377cf1ee0f67/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:36:56 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-82fc5123-b046-42c9-9de0-b9ae304931df tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Lock "/opt/stack/data/nova/instances/47eb8ddf-590f-4ffa-87c8-377cf1ee0f67/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:36:56 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-82fc5123-b046-42c9-9de0-b9ae304931df tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Lock "/opt/stack/data/nova/instances/47eb8ddf-590f-4ffa-87c8-377cf1ee0f67/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:36:56 user nova-compute[74960]: DEBUG nova.objects.instance [None req-82fc5123-b046-42c9-9de0-b9ae304931df tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Lazy-loading 'trusted_certs' on Instance uuid 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:36:56 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-82fc5123-b046-42c9-9de0-b9ae304931df tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Acquiring lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:36:56 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-82fc5123-b046-42c9-9de0-b9ae304931df tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:36:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-82fc5123-b046-42c9-9de0-b9ae304931df tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:36:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12ae6707-c1c6-4bc2-a409-67cea64fc2c3/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:36:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-82fc5123-b046-42c9-9de0-b9ae304931df tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.193s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:36:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-82fc5123-b046-42c9-9de0-b9ae304931df tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910,backing_fmt=raw /opt/stack/data/nova/instances/47eb8ddf-590f-4ffa-87c8-377cf1ee0f67/disk.rescue {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:36:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-82fc5123-b046-42c9-9de0-b9ae304931df tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910,backing_fmt=raw /opt/stack/data/nova/instances/47eb8ddf-590f-4ffa-87c8-377cf1ee0f67/disk.rescue" returned: 0 in 0.053s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:36:56 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-82fc5123-b046-42c9-9de0-b9ae304931df tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:36:56 user nova-compute[74960]: DEBUG nova.objects.instance [None req-82fc5123-b046-42c9-9de0-b9ae304931df tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Lazy-loading 'migration_context' on Instance uuid 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:36:56 user nova-compute[74960]: DEBUG nova.objects.base [None req-82fc5123-b046-42c9-9de0-b9ae304931df tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Object Instance<47eb8ddf-590f-4ffa-87c8-377cf1ee0f67> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74960) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 12:36:56 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-82fc5123-b046-42c9-9de0-b9ae304931df tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67] Created local disks {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 12:36:56 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-82fc5123-b046-42c9-9de0-b9ae304931df tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67] Start _get_guest_xml network_info=[{"id": "844c85e9-5021-433d-9f93-530ec193e265", "address": "fa:16:3e:69:d8:32", "network": {"id": "9a9a848a-80be-4281-8554-8e28744073b3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1579909169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1579909169-network", "vif_mac": "fa:16:3e:69:d8:32"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "434ce6c4b77342299a17e547a14e3918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap844c85e9-50", "ovs_interfaceid": "844c85e9-5021-433d-9f93-530ec193e265", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=549f51ba-ac69-494b-8de1-34635aa2d7cf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='63ee9c80c632442fb0379f47b784bd20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T12:13:04Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '549f51ba-ac69-494b-8de1-34635aa2d7cf', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 12:36:56 user nova-compute[74960]: DEBUG nova.objects.instance [None req-82fc5123-b046-42c9-9de0-b9ae304931df tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Lazy-loading 'resources' on Instance uuid 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:36:56 user nova-compute[74960]: DEBUG nova.objects.base [None req-82fc5123-b046-42c9-9de0-b9ae304931df tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Object Instance<47eb8ddf-590f-4ffa-87c8-377cf1ee0f67> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74960) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 12:36:56 user nova-compute[74960]: DEBUG nova.objects.instance [None req-82fc5123-b046-42c9-9de0-b9ae304931df tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Lazy-loading 'numa_topology' on Instance uuid 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:36:56 user nova-compute[74960]: DEBUG nova.objects.base [None req-82fc5123-b046-42c9-9de0-b9ae304931df tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Object Instance<47eb8ddf-590f-4ffa-87c8-377cf1ee0f67> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74960) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 12:36:56 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-82fc5123-b046-42c9-9de0-b9ae304931df tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:36:56 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-82fc5123-b046-42c9-9de0-b9ae304931df tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:36:56 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-82fc5123-b046-42c9-9de0-b9ae304931df tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 12:36:56 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-82fc5123-b046-42c9-9de0-b9ae304931df tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] CPU controller missing on host. {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 12:36:56 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-82fc5123-b046-42c9-9de0-b9ae304931df tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 12:36:56 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-82fc5123-b046-42c9-9de0-b9ae304931df tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] CPU controller found on host. {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 12:36:56 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-82fc5123-b046-42c9-9de0-b9ae304931df tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74960) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 12:36:56 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-82fc5123-b046-42c9-9de0-b9ae304931df tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=549f51ba-ac69-494b-8de1-34635aa2d7cf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='63ee9c80c632442fb0379f47b784bd20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T12:13:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 12:36:56 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-82fc5123-b046-42c9-9de0-b9ae304931df tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Flavor limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 12:36:56 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-82fc5123-b046-42c9-9de0-b9ae304931df tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Image limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 12:36:56 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-82fc5123-b046-42c9-9de0-b9ae304931df tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Flavor pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 12:36:56 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-82fc5123-b046-42c9-9de0-b9ae304931df tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Image pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 12:36:56 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-82fc5123-b046-42c9-9de0-b9ae304931df tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 12:36:56 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-82fc5123-b046-42c9-9de0-b9ae304931df tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 12:36:56 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-82fc5123-b046-42c9-9de0-b9ae304931df tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 12:36:56 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-82fc5123-b046-42c9-9de0-b9ae304931df tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Got 1 possible topologies {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 12:36:56 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-82fc5123-b046-42c9-9de0-b9ae304931df tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 12:36:56 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-82fc5123-b046-42c9-9de0-b9ae304931df tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 12:36:56 user nova-compute[74960]: DEBUG nova.objects.instance [None req-82fc5123-b046-42c9-9de0-b9ae304931df tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Lazy-loading 'vcpu_model' on Instance uuid 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:36:56 user nova-compute[74960]: DEBUG nova.objects.base [None req-82fc5123-b046-42c9-9de0-b9ae304931df tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Object Instance<47eb8ddf-590f-4ffa-87c8-377cf1ee0f67> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74960) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 12:36:56 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-82fc5123-b046-42c9-9de0-b9ae304931df tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:32:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-12909418',display_name='tempest-ServerRescueNegativeTestJSON-server-12909418',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-12909418',id=31,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-03T12:32:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='434ce6c4b77342299a17e547a14e3918',ramdisk_id='',reservation_id='r-wi42y0oc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1678469488',owner_user_name='tempest-ServerRescueNegativeTestJSON-1678469488-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:32:11Z,user_data=None,user_id='82a995b6307c4ba0b4cf8d5ede286a6c',uuid=47eb8ddf-590f-4ffa-87c8-377cf1ee0f67,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "844c85e9-5021-433d-9f93-530ec193e265", "address": "fa:16:3e:69:d8:32", "network": {"id": "9a9a848a-80be-4281-8554-8e28744073b3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1579909169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1579909169-network", "vif_mac": "fa:16:3e:69:d8:32"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "434ce6c4b77342299a17e547a14e3918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap844c85e9-50", "ovs_interfaceid": "844c85e9-5021-433d-9f93-530ec193e265", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74960) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 12:36:56 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-82fc5123-b046-42c9-9de0-b9ae304931df tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Converting VIF {"id": "844c85e9-5021-433d-9f93-530ec193e265", "address": "fa:16:3e:69:d8:32", "network": {"id": "9a9a848a-80be-4281-8554-8e28744073b3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1579909169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1579909169-network", "vif_mac": "fa:16:3e:69:d8:32"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "434ce6c4b77342299a17e547a14e3918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap844c85e9-50", "ovs_interfaceid": "844c85e9-5021-433d-9f93-530ec193e265", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:36:56 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-82fc5123-b046-42c9-9de0-b9ae304931df tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:69:d8:32,bridge_name='br-int',has_traffic_filtering=True,id=844c85e9-5021-433d-9f93-530ec193e265,network=Network(9a9a848a-80be-4281-8554-8e28744073b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap844c85e9-50') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:36:56 user nova-compute[74960]: DEBUG nova.objects.instance [None req-82fc5123-b046-42c9-9de0-b9ae304931df tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Lazy-loading 'pci_devices' on Instance uuid 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:36:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12ae6707-c1c6-4bc2-a409-67cea64fc2c3/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:36:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12ae6707-c1c6-4bc2-a409-67cea64fc2c3/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:36:56 user nova-compute[74960]: DEBUG nova.objects.base [None req-82fc5123-b046-42c9-9de0-b9ae304931df tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Object Instance<47eb8ddf-590f-4ffa-87c8-377cf1ee0f67> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74960) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 12:36:56 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-82fc5123-b046-42c9-9de0-b9ae304931df tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67] End _get_guest_xml xml=<domain type="kvm">
Nov 03 12:36:56 user nova-compute[74960]:   <uuid>47eb8ddf-590f-4ffa-87c8-377cf1ee0f67</uuid>
Nov 03 12:36:56 user nova-compute[74960]:   <name>instance-0000001f</name>
Nov 03 12:36:56 user nova-compute[74960]:   <memory>524288</memory>
Nov 03 12:36:56 user nova-compute[74960]:   <vcpu>1</vcpu>
Nov 03 12:36:56 user nova-compute[74960]:   <metadata>
Nov 03 12:36:56 user nova-compute[74960]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 12:36:56 user nova-compute[74960]:       <nova:package version="0.0.0"/>
Nov 03 12:36:56 user nova-compute[74960]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-12909418</nova:name>
Nov 03 12:36:56 user nova-compute[74960]:       <nova:creationTime>2023-11-03 12:36:56</nova:creationTime>
Nov 03 12:36:56 user nova-compute[74960]:       <nova:flavor name="m1.tiny">
Nov 03 12:36:56 user nova-compute[74960]:         <nova:memory>512</nova:memory>
Nov 03 12:36:56 user nova-compute[74960]:         <nova:disk>1</nova:disk>
Nov 03 12:36:56 user nova-compute[74960]:         <nova:swap>0</nova:swap>
Nov 03 12:36:56 user nova-compute[74960]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 12:36:56 user nova-compute[74960]:         <nova:vcpus>1</nova:vcpus>
Nov 03 12:36:56 user nova-compute[74960]:       </nova:flavor>
Nov 03 12:36:56 user nova-compute[74960]:       <nova:owner>
Nov 03 12:36:56 user nova-compute[74960]:         <nova:user uuid="82a995b6307c4ba0b4cf8d5ede286a6c">tempest-ServerRescueNegativeTestJSON-1678469488-project-member</nova:user>
Nov 03 12:36:56 user nova-compute[74960]:         <nova:project uuid="434ce6c4b77342299a17e547a14e3918">tempest-ServerRescueNegativeTestJSON-1678469488</nova:project>
Nov 03 12:36:56 user nova-compute[74960]:       </nova:owner>
Nov 03 12:36:56 user nova-compute[74960]:       <nova:root type="image" uuid="549f51ba-ac69-494b-8de1-34635aa2d7cf"/>
Nov 03 12:36:56 user nova-compute[74960]:       <nova:ports>
Nov 03 12:36:56 user nova-compute[74960]:         <nova:port uuid="844c85e9-5021-433d-9f93-530ec193e265">
Nov 03 12:36:56 user nova-compute[74960]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 03 12:36:56 user nova-compute[74960]:         </nova:port>
Nov 03 12:36:56 user nova-compute[74960]:       </nova:ports>
Nov 03 12:36:56 user nova-compute[74960]:     </nova:instance>
Nov 03 12:36:56 user nova-compute[74960]:   </metadata>
Nov 03 12:36:56 user nova-compute[74960]:   <sysinfo type="smbios">
Nov 03 12:36:56 user nova-compute[74960]:     <system>
Nov 03 12:36:56 user nova-compute[74960]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 12:36:56 user nova-compute[74960]:       <entry name="product">OpenStack Nova</entry>
Nov 03 12:36:56 user nova-compute[74960]:       <entry name="version">0.0.0</entry>
Nov 03 12:36:56 user nova-compute[74960]:       <entry name="serial">47eb8ddf-590f-4ffa-87c8-377cf1ee0f67</entry>
Nov 03 12:36:56 user nova-compute[74960]:       <entry name="uuid">47eb8ddf-590f-4ffa-87c8-377cf1ee0f67</entry>
Nov 03 12:36:56 user nova-compute[74960]:       <entry name="family">Virtual Machine</entry>
Nov 03 12:36:56 user nova-compute[74960]:     </system>
Nov 03 12:36:56 user nova-compute[74960]:   </sysinfo>
Nov 03 12:36:56 user nova-compute[74960]:   <os>
Nov 03 12:36:56 user nova-compute[74960]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 12:36:56 user nova-compute[74960]:     <smbios mode="sysinfo"/>
Nov 03 12:36:56 user nova-compute[74960]:   </os>
Nov 03 12:36:56 user nova-compute[74960]:   <features>
Nov 03 12:36:56 user nova-compute[74960]:     <acpi/>
Nov 03 12:36:56 user nova-compute[74960]:     <apic/>
Nov 03 12:36:56 user nova-compute[74960]:     <vmcoreinfo/>
Nov 03 12:36:56 user nova-compute[74960]:   </features>
Nov 03 12:36:56 user nova-compute[74960]:   <clock offset="utc">
Nov 03 12:36:56 user nova-compute[74960]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 12:36:56 user nova-compute[74960]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 12:36:56 user nova-compute[74960]:     <timer name="hpet" present="no"/>
Nov 03 12:36:56 user nova-compute[74960]:   </clock>
Nov 03 12:36:56 user nova-compute[74960]:   <cpu mode="custom" match="exact">
Nov 03 12:36:56 user nova-compute[74960]:     <model>Nehalem</model>
Nov 03 12:36:56 user nova-compute[74960]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 12:36:56 user nova-compute[74960]:   </cpu>
Nov 03 12:36:56 user nova-compute[74960]:   <devices>
Nov 03 12:36:56 user nova-compute[74960]:     <disk type="file" device="disk">
Nov 03 12:36:56 user nova-compute[74960]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 12:36:56 user nova-compute[74960]:       <source file="/opt/stack/data/nova/instances/47eb8ddf-590f-4ffa-87c8-377cf1ee0f67/disk.rescue"/>
Nov 03 12:36:56 user nova-compute[74960]:       <target dev="vda" bus="virtio"/>
Nov 03 12:36:56 user nova-compute[74960]:     </disk>
Nov 03 12:36:56 user nova-compute[74960]:     <disk type="file" device="disk">
Nov 03 12:36:56 user nova-compute[74960]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 12:36:56 user nova-compute[74960]:       <source file="/opt/stack/data/nova/instances/47eb8ddf-590f-4ffa-87c8-377cf1ee0f67/disk"/>
Nov 03 12:36:56 user nova-compute[74960]:       <target dev="vdb" bus="virtio"/>
Nov 03 12:36:56 user nova-compute[74960]:     </disk>
Nov 03 12:36:56 user nova-compute[74960]:     <interface type="ethernet">
Nov 03 12:36:56 user nova-compute[74960]:       <mac address="fa:16:3e:69:d8:32"/>
Nov 03 12:36:56 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:36:56 user nova-compute[74960]:       <mtu size="1442"/>
Nov 03 12:36:56 user nova-compute[74960]:       <target dev="tap844c85e9-50"/>
Nov 03 12:36:56 user nova-compute[74960]:     </interface>
Nov 03 12:36:56 user nova-compute[74960]:     <serial type="pty">
Nov 03 12:36:56 user nova-compute[74960]:       <log file="/opt/stack/data/nova/instances/47eb8ddf-590f-4ffa-87c8-377cf1ee0f67/console.log" append="off"/>
Nov 03 12:36:56 user nova-compute[74960]:     </serial>
Nov 03 12:36:56 user nova-compute[74960]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 12:36:56 user nova-compute[74960]:     <video>
Nov 03 12:36:56 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:36:56 user nova-compute[74960]:     </video>
Nov 03 12:36:56 user nova-compute[74960]:     <rng model="virtio">
Nov 03 12:36:56 user nova-compute[74960]:       <backend model="random">/dev/urandom</backend>
Nov 03 12:36:56 user nova-compute[74960]:     </rng>
Nov 03 12:36:56 user nova-compute[74960]:     <controller type="usb" index="0" model="none"/>
Nov 03 12:36:56 user nova-compute[74960]:     <memballoon model="virtio">
Nov 03 12:36:56 user nova-compute[74960]:       <stats period="10"/>
Nov 03 12:36:56 user nova-compute[74960]:     </memballoon>
Nov 03 12:36:56 user nova-compute[74960]:   </devices>
Nov 03 12:36:56 user nova-compute[74960]: </domain>
Nov 03 12:36:56 user nova-compute[74960]:  {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 12:36:56 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67] Instance destroyed successfully.
Nov 03 12:36:56 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-82fc5123-b046-42c9-9de0-b9ae304931df tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] No BDM found with device name vda, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:36:56 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-82fc5123-b046-42c9-9de0-b9ae304931df tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:36:56 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-82fc5123-b046-42c9-9de0-b9ae304931df tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] No VIF found with MAC fa:16:3e:69:d8:32, not building metadata {{(pid=74960) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 12:36:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12ae6707-c1c6-4bc2-a409-67cea64fc2c3/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:36:56 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=74960) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 12:36:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f15f5f-8afa-4d7b-bb45-5887184f9ee5/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:36:57 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f15f5f-8afa-4d7b-bb45-5887184f9ee5/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:36:57 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f15f5f-8afa-4d7b-bb45-5887184f9ee5/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:36:57 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f15f5f-8afa-4d7b-bb45-5887184f9ee5/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:36:57 user nova-compute[74960]: DEBUG nova.compute.manager [req-fec6e1e1-6cd2-4102-967b-f6276e5d49eb req-733c3a12-a285-4275-ade6-114a9e6394a7 service nova] [instance: 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67] Received event network-vif-plugged-844c85e9-5021-433d-9f93-530ec193e265 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:36:57 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-fec6e1e1-6cd2-4102-967b-f6276e5d49eb req-733c3a12-a285-4275-ade6-114a9e6394a7 service nova] Acquiring lock "47eb8ddf-590f-4ffa-87c8-377cf1ee0f67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:36:57 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-fec6e1e1-6cd2-4102-967b-f6276e5d49eb req-733c3a12-a285-4275-ade6-114a9e6394a7 service nova] Lock "47eb8ddf-590f-4ffa-87c8-377cf1ee0f67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:36:57 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-fec6e1e1-6cd2-4102-967b-f6276e5d49eb req-733c3a12-a285-4275-ade6-114a9e6394a7 service nova] Lock "47eb8ddf-590f-4ffa-87c8-377cf1ee0f67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:36:57 user nova-compute[74960]: DEBUG nova.compute.manager [req-fec6e1e1-6cd2-4102-967b-f6276e5d49eb req-733c3a12-a285-4275-ade6-114a9e6394a7 service nova] [instance: 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67] No waiting events found dispatching network-vif-plugged-844c85e9-5021-433d-9f93-530ec193e265 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:36:57 user nova-compute[74960]: WARNING nova.compute.manager [req-fec6e1e1-6cd2-4102-967b-f6276e5d49eb req-733c3a12-a285-4275-ade6-114a9e6394a7 service nova] [instance: 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67] Received unexpected event network-vif-plugged-844c85e9-5021-433d-9f93-530ec193e265 for instance with vm_state active and task_state rescuing.
Nov 03 12:36:58 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:36:58 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:36:58 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:36:58 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:36:58 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:36:58 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47eb8ddf-590f-4ffa-87c8-377cf1ee0f67/disk.rescue --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:36:58 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47eb8ddf-590f-4ffa-87c8-377cf1ee0f67/disk.rescue --force-share --output=json" returned: 0 in 0.201s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:36:58 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47eb8ddf-590f-4ffa-87c8-377cf1ee0f67/disk.rescue --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:36:59 user nova-compute[74960]: DEBUG os_brick.utils [None req-d69e953e-01ea-4122-a191-c674adc258f8 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:36:59 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:36:59 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:36:59 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[c502071f-7879-4c71-9c52-0954a393b725]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:75b8e219756\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:36:59 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:36:59 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:36:59 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[a25b40fa-c7e3-42eb-9266-6a17151a98ea]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:36:59 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:36:59 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:36:59 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[6854fb89-a264-439f-8dd9-5e2d66349721]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:36:59 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[bae41e4b-9e12-4fa9-bec0-b952f17b329d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:36:59 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-d69e953e-01ea-4122-a191-c674adc258f8 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Running cmd (subprocess): nvme version {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:36:59 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-d69e953e-01ea-4122-a191-c674adc258f8 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] 'nvme version' failed. Not Retrying. {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 12:36:59 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d69e953e-01ea-4122-a191-c674adc258f8 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] nvme not present on system {{(pid=74960) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 12:36:59 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:36:59 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 12:36:59 user nova-compute[74960]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 12:36:59 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[4305cef0-fc8c-4a6c-b53d-9e7250e69ec0]: (4, '') {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:36:59 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-d69e953e-01ea-4122-a191-c674adc258f8 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74960) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 12:36:59 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-d69e953e-01ea-4122-a191-c674adc258f8 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74960) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 12:36:59 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-d69e953e-01ea-4122-a191-c674adc258f8 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] LIGHTOS: no hostnqn found. {{(pid=74960) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 12:36:59 user nova-compute[74960]: DEBUG os_brick.utils [None req-d69e953e-01ea-4122-a191-c674adc258f8 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:75b8e219756', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:36:59 user nova-compute[74960]: DEBUG nova.virt.block_device [None req-d69e953e-01ea-4122-a191-c674adc258f8 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] Updating existing volume attachment record: 6901fbb3-35a1-4b6f-958e-b7fd64ea215b {{(pid=74960) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 12:36:59 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47eb8ddf-590f-4ffa-87c8-377cf1ee0f67/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:36:59 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47eb8ddf-590f-4ffa-87c8-377cf1ee0f67/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:36:59 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47eb8ddf-590f-4ffa-87c8-377cf1ee0f67/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:36:59 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47eb8ddf-590f-4ffa-87c8-377cf1ee0f67/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:36:59 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47eb8ddf-590f-4ffa-87c8-377cf1ee0f67/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:36:59 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7b95c0-3726-4a1c-a384-ec91abf75225/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:36:59 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7b95c0-3726-4a1c-a384-ec91abf75225/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:36:59 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7b95c0-3726-4a1c-a384-ec91abf75225/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:36:59 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7b95c0-3726-4a1c-a384-ec91abf75225/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:36:59 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74960) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 12:36:59 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e02c80-f626-4918-93f1-6b9a7f778c7a/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:36:59 user nova-compute[74960]: DEBUG nova.compute.manager [req-86ef1c92-d436-41a2-ae1f-d76cc1e1200d req-fdff0aa8-c733-45e2-b720-09fbec117b14 service nova] [instance: 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67] Received event network-vif-plugged-844c85e9-5021-433d-9f93-530ec193e265 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:36:59 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-86ef1c92-d436-41a2-ae1f-d76cc1e1200d req-fdff0aa8-c733-45e2-b720-09fbec117b14 service nova] Acquiring lock "47eb8ddf-590f-4ffa-87c8-377cf1ee0f67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:36:59 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-86ef1c92-d436-41a2-ae1f-d76cc1e1200d req-fdff0aa8-c733-45e2-b720-09fbec117b14 service nova] Lock "47eb8ddf-590f-4ffa-87c8-377cf1ee0f67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:36:59 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-86ef1c92-d436-41a2-ae1f-d76cc1e1200d req-fdff0aa8-c733-45e2-b720-09fbec117b14 service nova] Lock "47eb8ddf-590f-4ffa-87c8-377cf1ee0f67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:36:59 user nova-compute[74960]: DEBUG nova.compute.manager [req-86ef1c92-d436-41a2-ae1f-d76cc1e1200d req-fdff0aa8-c733-45e2-b720-09fbec117b14 service nova] [instance: 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67] No waiting events found dispatching network-vif-plugged-844c85e9-5021-433d-9f93-530ec193e265 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:36:59 user nova-compute[74960]: WARNING nova.compute.manager [req-86ef1c92-d436-41a2-ae1f-d76cc1e1200d req-fdff0aa8-c733-45e2-b720-09fbec117b14 service nova] [instance: 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67] Received unexpected event network-vif-plugged-844c85e9-5021-433d-9f93-530ec193e265 for instance with vm_state active and task_state rescuing.
Nov 03 12:36:59 user nova-compute[74960]: DEBUG nova.compute.manager [req-86ef1c92-d436-41a2-ae1f-d76cc1e1200d req-fdff0aa8-c733-45e2-b720-09fbec117b14 service nova] [instance: 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67] Received event network-vif-plugged-844c85e9-5021-433d-9f93-530ec193e265 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:36:59 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-86ef1c92-d436-41a2-ae1f-d76cc1e1200d req-fdff0aa8-c733-45e2-b720-09fbec117b14 service nova] Acquiring lock "47eb8ddf-590f-4ffa-87c8-377cf1ee0f67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:36:59 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-86ef1c92-d436-41a2-ae1f-d76cc1e1200d req-fdff0aa8-c733-45e2-b720-09fbec117b14 service nova] Lock "47eb8ddf-590f-4ffa-87c8-377cf1ee0f67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:36:59 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-86ef1c92-d436-41a2-ae1f-d76cc1e1200d req-fdff0aa8-c733-45e2-b720-09fbec117b14 service nova] Lock "47eb8ddf-590f-4ffa-87c8-377cf1ee0f67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:36:59 user nova-compute[74960]: DEBUG nova.compute.manager [req-86ef1c92-d436-41a2-ae1f-d76cc1e1200d req-fdff0aa8-c733-45e2-b720-09fbec117b14 service nova] [instance: 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67] No waiting events found dispatching network-vif-plugged-844c85e9-5021-433d-9f93-530ec193e265 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:36:59 user nova-compute[74960]: WARNING nova.compute.manager [req-86ef1c92-d436-41a2-ae1f-d76cc1e1200d req-fdff0aa8-c733-45e2-b720-09fbec117b14 service nova] [instance: 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67] Received unexpected event network-vif-plugged-844c85e9-5021-433d-9f93-530ec193e265 for instance with vm_state active and task_state rescuing.
Nov 03 12:37:00 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e02c80-f626-4918-93f1-6b9a7f778c7a/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:37:00 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e02c80-f626-4918-93f1-6b9a7f778c7a/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:37:00 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e02c80-f626-4918-93f1-6b9a7f778c7a/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:37:00 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk.rescue --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:37:00 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:37:00 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk.rescue --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:37:00 user nova-compute[74960]: DEBUG nova.compute.manager [None req-82fc5123-b046-42c9-9de0-b9ae304931df tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67] Checking state {{(pid=74960) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 12:37:00 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk.rescue --force-share --output=json" returned: 0 in 0.204s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:37:00 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:37:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:37:00 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:37:00 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:37:01 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:37:01 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74960) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 12:37:01 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7606a55-d5c3-4ba8-b499-f3c70813f151/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:37:01 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7606a55-d5c3-4ba8-b499-f3c70813f151/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:37:01 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7606a55-d5c3-4ba8-b499-f3c70813f151/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:37:01 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7606a55-d5c3-4ba8-b499-f3c70813f151/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:37:01 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=74960) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 12:37:02 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:37:02 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:37:02 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Hypervisor/Node resource view: name=user free_ram=7934MB free_disk=24.883262634277344GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74960) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 12:37:02 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:37:02 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:37:02 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 87f15f5f-8afa-4d7b-bb45-5887184f9ee5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:37:02 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance a6199681-f85e-4f55-966b-6ab3f17cd640 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:37:02 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 5b7b95c0-3726-4a1c-a384-ec91abf75225 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:37:02 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 35e02c80-f626-4918-93f1-6b9a7f778c7a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:37:02 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:37:02 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:37:02 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 12ae6707-c1c6-4bc2-a409-67cea64fc2c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:37:02 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance b7606a55-d5c3-4ba8-b499-f3c70813f151 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:37:02 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 27aa03bb-5613-4bde-8bc0-30517f5d48ae actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:37:02 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 895d6de1-b5d9-4555-af57-f7816183be58 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:37:02 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74960) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 12:37:02 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74960) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 12:37:02 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:37:02 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:37:02 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Compute_service record updated for user:user {{(pid=74960) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 12:37:02 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.542s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:37:03 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:37:03 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-028e224a-9dca-4252-b0c8-ddffbc19dcf5 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Acquiring lock "12ae6707-c1c6-4bc2-a409-67cea64fc2c3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:37:03 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-028e224a-9dca-4252-b0c8-ddffbc19dcf5 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Lock "12ae6707-c1c6-4bc2-a409-67cea64fc2c3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:37:03 user nova-compute[74960]: INFO nova.compute.manager [None req-028e224a-9dca-4252-b0c8-ddffbc19dcf5 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] [instance: 12ae6707-c1c6-4bc2-a409-67cea64fc2c3] Detaching volume 623b8c1d-ba2d-4bad-b0bd-71eefe783606
Nov 03 12:37:04 user nova-compute[74960]: INFO nova.virt.block_device [None req-028e224a-9dca-4252-b0c8-ddffbc19dcf5 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] [instance: 12ae6707-c1c6-4bc2-a409-67cea64fc2c3] Attempting to driver detach volume 623b8c1d-ba2d-4bad-b0bd-71eefe783606 from mountpoint /dev/vdb
Nov 03 12:37:04 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-53895e47-38ff-4547-8c5e-4b9dc29f97aa tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Acquiring lock "12ae6707-c1c6-4bc2-a409-67cea64fc2c3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:37:04 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-028e224a-9dca-4252-b0c8-ddffbc19dcf5 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Attempting to detach device vdb from instance 12ae6707-c1c6-4bc2-a409-67cea64fc2c3 from the persistent domain config. {{(pid=74960) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 03 12:37:04 user nova-compute[74960]: DEBUG nova.virt.libvirt.guest [None req-028e224a-9dca-4252-b0c8-ddffbc19dcf5 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 12:37:04 user nova-compute[74960]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 12:37:04 user nova-compute[74960]:   <source dev="/dev/sdh"/>
Nov 03 12:37:04 user nova-compute[74960]:   <target dev="vdb" bus="virtio"/>
Nov 03 12:37:04 user nova-compute[74960]:   <serial>623b8c1d-ba2d-4bad-b0bd-71eefe783606</serial>
Nov 03 12:37:04 user nova-compute[74960]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 12:37:04 user nova-compute[74960]: </disk>
Nov 03 12:37:04 user nova-compute[74960]:  {{(pid=74960) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 12:37:04 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-028e224a-9dca-4252-b0c8-ddffbc19dcf5 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Successfully detached device vdb from instance 12ae6707-c1c6-4bc2-a409-67cea64fc2c3 from the persistent domain config.
Nov 03 12:37:04 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-028e224a-9dca-4252-b0c8-ddffbc19dcf5 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 12ae6707-c1c6-4bc2-a409-67cea64fc2c3 from the live domain config. {{(pid=74960) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 03 12:37:04 user nova-compute[74960]: DEBUG nova.virt.libvirt.guest [None req-028e224a-9dca-4252-b0c8-ddffbc19dcf5 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 12:37:04 user nova-compute[74960]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 12:37:04 user nova-compute[74960]:   <source dev="/dev/sdh"/>
Nov 03 12:37:04 user nova-compute[74960]:   <target dev="vdb" bus="virtio"/>
Nov 03 12:37:04 user nova-compute[74960]:   <serial>623b8c1d-ba2d-4bad-b0bd-71eefe783606</serial>
Nov 03 12:37:04 user nova-compute[74960]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 12:37:04 user nova-compute[74960]: </disk>
Nov 03 12:37:04 user nova-compute[74960]:  {{(pid=74960) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 12:37:04 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b709e7f-ba0d-4d0e-ac37-e5c6eb17f9a4 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a] Calling os-brick to attach iSCSI Volume {{(pid=74960) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 12:37:04 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b709e7f-ba0d-4d0e-ac37-e5c6eb17f9a4 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9aa420acb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c91df593-71cf-41cf-869f-7c87a6358e8e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HPkZfAIF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:37:04 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-9b709e7f-ba0d-4d0e-ac37-e5c6eb17f9a4 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:37:04 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-9b709e7f-ba0d-4d0e-ac37-e5c6eb17f9a4 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:37:04 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-9b709e7f-ba0d-4d0e-ac37-e5c6eb17f9a4 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:37:04 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-9b709e7f-ba0d-4d0e-ac37-e5c6eb17f9a4 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:37:04 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-9b709e7f-ba0d-4d0e-ac37-e5c6eb17f9a4 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c91df593-71cf-41cf-869f-7c87a6358e8e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:37:04 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-9b709e7f-ba0d-4d0e-ac37-e5c6eb17f9a4 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c91df593-71cf-41cf-869f-7c87a6358e8e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:37:04 user nova-compute[74960]: INFO os_brick.initiator.connectors.iscsi [None req-9b709e7f-ba0d-4d0e-ac37-e5c6eb17f9a4 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 12:37:04 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c91df593-71cf-41cf-869f-7c87a6358e8e -p 172.16.0.220:3260 {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:37:04 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c91df593-71cf-41cf-869f-7c87a6358e8e -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:37:04 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ecc321b-ba05-42fc-835f-a395d9d846af]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:37:04 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b709e7f-ba0d-4d0e-ac37-e5c6eb17f9a4 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 12:37:04 user nova-compute[74960]:  {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:37:04 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c91df593-71cf-41cf-869f-7c87a6358e8e -p 172.16.0.220:3260 --interface default --op new {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:37:04 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-028e224a-9dca-4252-b0c8-ddffbc19dcf5 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 12ae6707-c1c6-4bc2-a409-67cea64fc2c3 {{(pid=74960) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 03 12:37:04 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c91df593-71cf-41cf-869f-7c87a6358e8e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:37:04 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a1aa146-a7fa-45e8-bbac-e08f2a428687]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c91df593-71cf-41cf-869f-7c87a6358e8e] added\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:37:04 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b709e7f-ba0d-4d0e-ac37-e5c6eb17f9a4 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c91df593-71cf-41cf-869f-7c87a6358e8e] added
Nov 03 12:37:04 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:37:04 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c91df593-71cf-41cf-869f-7c87a6358e8e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:37:04 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c91df593-71cf-41cf-869f-7c87a6358e8e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:37:04 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[abdd431e-f173-40e2-a5c7-184713002bee]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:37:04 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b709e7f-ba0d-4d0e-ac37-e5c6eb17f9a4 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:37:04 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c91df593-71cf-41cf-869f-7c87a6358e8e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:37:04 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c91df593-71cf-41cf-869f-7c87a6358e8e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:37:04 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[342fd642-1c61-43fe-b775-b6f5154654be]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:37:04 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b709e7f-ba0d-4d0e-ac37-e5c6eb17f9a4 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:37:04 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c91df593-71cf-41cf-869f-7c87a6358e8e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HPkZfAIF {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:37:04 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c91df593-71cf-41cf-869f-7c87a6358e8e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HPkZfAIF" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:37:04 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[0372873d-c21e-41d9-9233-55d4150c3388]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:37:04 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b709e7f-ba0d-4d0e-ac37-e5c6eb17f9a4 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HPkZfAIF'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:37:04 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c91df593-71cf-41cf-869f-7c87a6358e8e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:37:04 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c91df593-71cf-41cf-869f-7c87a6358e8e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:37:04 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8f1d18d-2009-4a60-8af0-b694202110a8]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:37:04 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b709e7f-ba0d-4d0e-ac37-e5c6eb17f9a4 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:37:04 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:37:04 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:37:04 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[074e8326-66ab-47b1-8b3f-8a60d4bded96]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:623b8c1d-ba2d-4bad-b0bd-71eefe783606 (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:37:04 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b709e7f-ba0d-4d0e-ac37-e5c6eb17f9a4 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:37:04 user nova-compute[74960]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 (non-flash)
Nov 03 12:37:04 user nova-compute[74960]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61 (non-flash)
Nov 03 12:37:04 user nova-compute[74960]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:623b8c1d-ba2d-4bad-b0bd-71eefe783606 (non-flash)
Nov 03 12:37:04 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:37:04 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b709e7f-ba0d-4d0e-ac37-e5c6eb17f9a4 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:37:04 user nova-compute[74960]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 (non-flash)
Nov 03 12:37:04 user nova-compute[74960]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61 (non-flash)
Nov 03 12:37:04 user nova-compute[74960]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:623b8c1d-ba2d-4bad-b0bd-71eefe783606 (non-flash)
Nov 03 12:37:04 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:37:04 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c91df593-71cf-41cf-869f-7c87a6358e8e -p 172.16.0.220:3260 --login {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:37:04 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c91df593-71cf-41cf-869f-7c87a6358e8e -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:37:04 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7db3985-7bda-43cc-bbc6-823829102a0b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c91df593-71cf-41cf-869f-7c87a6358e8e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c91df593-71cf-41cf-869f-7c87a6358e8e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:37:04 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b709e7f-ba0d-4d0e-ac37-e5c6eb17f9a4 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c91df593-71cf-41cf-869f-7c87a6358e8e, portal: 172.16.0.220,3260]
Nov 03 12:37:04 user nova-compute[74960]: Login to [iface: default, target: iqn.2010-10.org.openstack:c91df593-71cf-41cf-869f-7c87a6358e8e, portal: 172.16.0.220,3260] successful.
Nov 03 12:37:04 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:37:04 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c91df593-71cf-41cf-869f-7c87a6358e8e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:37:04 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c91df593-71cf-41cf-869f-7c87a6358e8e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:37:04 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc534f4a-4be4-4809-a889-dc7d6d73fa2c]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:37:04 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b709e7f-ba0d-4d0e-ac37-e5c6eb17f9a4 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:37:04 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:37:04 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:37:04 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc13c4ed-4c0a-4963-aca4-29f1ab915725]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:623b8c1d-ba2d-4bad-b0bd-71eefe783606 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91df593-71cf-41cf-869f-7c87a6358e8e (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:37:04 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b709e7f-ba0d-4d0e-ac37-e5c6eb17f9a4 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:37:04 user nova-compute[74960]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 (non-flash)
Nov 03 12:37:04 user nova-compute[74960]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61 (non-flash)
Nov 03 12:37:04 user nova-compute[74960]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:623b8c1d-ba2d-4bad-b0bd-71eefe783606 (non-flash)
Nov 03 12:37:04 user nova-compute[74960]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91df593-71cf-41cf-869f-7c87a6358e8e (non-flash)
Nov 03 12:37:04 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:37:04 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b709e7f-ba0d-4d0e-ac37-e5c6eb17f9a4 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:37:04 user nova-compute[74960]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 (non-flash)
Nov 03 12:37:04 user nova-compute[74960]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61 (non-flash)
Nov 03 12:37:04 user nova-compute[74960]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:623b8c1d-ba2d-4bad-b0bd-71eefe783606 (non-flash)
Nov 03 12:37:04 user nova-compute[74960]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91df593-71cf-41cf-869f-7c87a6358e8e (non-flash)
Nov 03 12:37:04 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:37:04 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-9b709e7f-ba0d-4d0e-ac37-e5c6eb17f9a4 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c91df593-71cf-41cf-869f-7c87a6358e8e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:37:04 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b709e7f-ba0d-4d0e-ac37-e5c6eb17f9a4 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Connected to 172.16.0.220:3260 {{(pid=74960) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 12:37:04 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-9b709e7f-ba0d-4d0e-ac37-e5c6eb17f9a4 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] HCTL ('33', '-', '-', 0) found on session 32 with lun 0 {{(pid=74960) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 12:37:04 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-9b709e7f-ba0d-4d0e-ac37-e5c6eb17f9a4 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74960) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 12:37:04 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:37:04 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:37:04 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[71f4b40e-429b-4360-adb6-6b519e3babce]: (4, ('- - 0', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:37:04 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-9b709e7f-ba0d-4d0e-ac37-e5c6eb17f9a4 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Searching for a device in session 32 and hctl ['33', '*', '*', 0] yield: None {{(pid=74960) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 12:37:05 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:37:05 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-9b709e7f-ba0d-4d0e-ac37-e5c6eb17f9a4 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Searching for a device in session 32 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74960) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 12:37:05 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b709e7f-ba0d-4d0e-ac37-e5c6eb17f9a4 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c91df593-71cf-41cf-869f-7c87a6358e8e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HPkZfAIF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74960) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 12:37:05 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-9b709e7f-ba0d-4d0e-ac37-e5c6eb17f9a4 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.330s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:37:05 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b709e7f-ba0d-4d0e-ac37-e5c6eb17f9a4 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] <== connect_volume: return (1332ms) {'type': 'block', 'scsi_wwn': '23233333639373563', 'path': '/dev/sdb'} {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:37:05 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b709e7f-ba0d-4d0e-ac37-e5c6eb17f9a4 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23233333639373563', 'path': '/dev/sdb'} {{(pid=74960) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 12:37:05 user nova-compute[74960]: DEBUG nova.objects.instance [None req-9b709e7f-ba0d-4d0e-ac37-e5c6eb17f9a4 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Lazy-loading 'flavor' on Instance uuid 35e02c80-f626-4918-93f1-6b9a7f778c7a {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:37:05 user nova-compute[74960]: DEBUG nova.virt.libvirt.guest [None req-9b709e7f-ba0d-4d0e-ac37-e5c6eb17f9a4 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] attach device xml: <disk type="block" device="disk">
Nov 03 12:37:05 user nova-compute[74960]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 12:37:05 user nova-compute[74960]:   <source dev="/dev/sdb"/>
Nov 03 12:37:05 user nova-compute[74960]:   <target dev="vdb" bus="virtio"/>
Nov 03 12:37:05 user nova-compute[74960]:   <serial>c91df593-71cf-41cf-869f-7c87a6358e8e</serial>
Nov 03 12:37:05 user nova-compute[74960]: </disk>
Nov 03 12:37:05 user nova-compute[74960]:  {{(pid=74960) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 03 12:37:06 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:37:06 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-9b709e7f-ba0d-4d0e-ac37-e5c6eb17f9a4 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] No BDM found with device name vda, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:37:06 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-9b709e7f-ba0d-4d0e-ac37-e5c6eb17f9a4 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:37:06 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-9b709e7f-ba0d-4d0e-ac37-e5c6eb17f9a4 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] No VIF found with MAC fa:16:3e:26:d9:9a, not building metadata {{(pid=74960) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 12:37:06 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:37:06 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:37:06 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:37:06 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74960) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 12:37:06 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-9b709e7f-ba0d-4d0e-ac37-e5c6eb17f9a4 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Lock "35e02c80-f626-4918-93f1-6b9a7f778c7a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.209s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:37:08 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:37:09 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-e36ed070-66ac-495c-8d63-ac8fefd37fc5 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Acquiring lock "35e02c80-f626-4918-93f1-6b9a7f778c7a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:37:09 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-e36ed070-66ac-495c-8d63-ac8fefd37fc5 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Lock "35e02c80-f626-4918-93f1-6b9a7f778c7a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:37:09 user nova-compute[74960]: INFO nova.compute.manager [None req-e36ed070-66ac-495c-8d63-ac8fefd37fc5 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a] Detaching volume c91df593-71cf-41cf-869f-7c87a6358e8e
Nov 03 12:37:09 user nova-compute[74960]: INFO nova.virt.block_device [None req-e36ed070-66ac-495c-8d63-ac8fefd37fc5 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a] Attempting to driver detach volume c91df593-71cf-41cf-869f-7c87a6358e8e from mountpoint /dev/vdb
Nov 03 12:37:09 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-e36ed070-66ac-495c-8d63-ac8fefd37fc5 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Attempting to detach device vdb from instance 35e02c80-f626-4918-93f1-6b9a7f778c7a from the persistent domain config. {{(pid=74960) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 03 12:37:09 user nova-compute[74960]: DEBUG nova.virt.libvirt.guest [None req-e36ed070-66ac-495c-8d63-ac8fefd37fc5 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 12:37:09 user nova-compute[74960]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 12:37:09 user nova-compute[74960]:   <source dev="/dev/sdb"/>
Nov 03 12:37:09 user nova-compute[74960]:   <target dev="vdb" bus="virtio"/>
Nov 03 12:37:09 user nova-compute[74960]:   <serial>c91df593-71cf-41cf-869f-7c87a6358e8e</serial>
Nov 03 12:37:09 user nova-compute[74960]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 12:37:09 user nova-compute[74960]: </disk>
Nov 03 12:37:09 user nova-compute[74960]:  {{(pid=74960) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 12:37:09 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-e36ed070-66ac-495c-8d63-ac8fefd37fc5 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Successfully detached device vdb from instance 35e02c80-f626-4918-93f1-6b9a7f778c7a from the persistent domain config.
Nov 03 12:37:09 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-e36ed070-66ac-495c-8d63-ac8fefd37fc5 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 35e02c80-f626-4918-93f1-6b9a7f778c7a from the live domain config. {{(pid=74960) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 03 12:37:09 user nova-compute[74960]: DEBUG nova.virt.libvirt.guest [None req-e36ed070-66ac-495c-8d63-ac8fefd37fc5 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 12:37:09 user nova-compute[74960]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 12:37:09 user nova-compute[74960]:   <source dev="/dev/sdb"/>
Nov 03 12:37:09 user nova-compute[74960]:   <target dev="vdb" bus="virtio"/>
Nov 03 12:37:09 user nova-compute[74960]:   <serial>c91df593-71cf-41cf-869f-7c87a6358e8e</serial>
Nov 03 12:37:09 user nova-compute[74960]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 12:37:09 user nova-compute[74960]: </disk>
Nov 03 12:37:09 user nova-compute[74960]:  {{(pid=74960) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 12:37:09 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-e36ed070-66ac-495c-8d63-ac8fefd37fc5 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 35e02c80-f626-4918-93f1-6b9a7f778c7a {{(pid=74960) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 03 12:37:10 user nova-compute[74960]: DEBUG nova.compute.manager [req-b9cd3b56-45be-4624-ae81-d87bf7cf3718 req-8c0c95ac-9369-45f1-83e2-5737763266e2 service nova] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] Received event network-changed-16df3da7-2b2a-4c74-bb06-779696d25b88 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:37:10 user nova-compute[74960]: DEBUG nova.compute.manager [req-b9cd3b56-45be-4624-ae81-d87bf7cf3718 req-8c0c95ac-9369-45f1-83e2-5737763266e2 service nova] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] Refreshing instance network info cache due to event network-changed-16df3da7-2b2a-4c74-bb06-779696d25b88. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 12:37:10 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-b9cd3b56-45be-4624-ae81-d87bf7cf3718 req-8c0c95ac-9369-45f1-83e2-5737763266e2 service nova] Acquiring lock "refresh_cache-27aa03bb-5613-4bde-8bc0-30517f5d48ae" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:37:10 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-b9cd3b56-45be-4624-ae81-d87bf7cf3718 req-8c0c95ac-9369-45f1-83e2-5737763266e2 service nova] Acquired lock "refresh_cache-27aa03bb-5613-4bde-8bc0-30517f5d48ae" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:37:10 user nova-compute[74960]: DEBUG nova.network.neutron [req-b9cd3b56-45be-4624-ae81-d87bf7cf3718 req-8c0c95ac-9369-45f1-83e2-5737763266e2 service nova] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] Refreshing network info cache for port 16df3da7-2b2a-4c74-bb06-779696d25b88 {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 12:37:10 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:37:11 user nova-compute[74960]: DEBUG nova.network.neutron [req-b9cd3b56-45be-4624-ae81-d87bf7cf3718 req-8c0c95ac-9369-45f1-83e2-5737763266e2 service nova] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] Updated VIF entry in instance network info cache for port 16df3da7-2b2a-4c74-bb06-779696d25b88. {{(pid=74960) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 12:37:11 user nova-compute[74960]: DEBUG nova.network.neutron [req-b9cd3b56-45be-4624-ae81-d87bf7cf3718 req-8c0c95ac-9369-45f1-83e2-5737763266e2 service nova] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] Updating instance_info_cache with network_info: [{"id": "16df3da7-2b2a-4c74-bb06-779696d25b88", "address": "fa:16:3e:2a:35:94", "network": {"id": "4a77f235-def4-4456-8f4a-99bf5769e015", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1480494760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "384450261e1f45048eb9b4b431ce8bd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16df3da7-2b", "ovs_interfaceid": "16df3da7-2b2a-4c74-bb06-779696d25b88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:37:11 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-b9cd3b56-45be-4624-ae81-d87bf7cf3718 req-8c0c95ac-9369-45f1-83e2-5737763266e2 service nova] Releasing lock "refresh_cache-27aa03bb-5613-4bde-8bc0-30517f5d48ae" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:37:11 user nova-compute[74960]: INFO nova.compute.manager [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] Rebuilding instance
Nov 03 12:37:11 user nova-compute[74960]: DEBUG nova.compute.manager [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] Checking state {{(pid=74960) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 12:37:11 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:37:12 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:37:12 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:37:12 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:37:12 user nova-compute[74960]: DEBUG nova.compute.manager [req-d3486fd9-06fa-4a35-87b8-4b645fe652ea req-f0f9d133-7495-4720-98b8-e98e421922eb service nova] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] Received event network-vif-unplugged-16df3da7-2b2a-4c74-bb06-779696d25b88 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:37:12 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-d3486fd9-06fa-4a35-87b8-4b645fe652ea req-f0f9d133-7495-4720-98b8-e98e421922eb service nova] Acquiring lock "27aa03bb-5613-4bde-8bc0-30517f5d48ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:37:12 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-d3486fd9-06fa-4a35-87b8-4b645fe652ea req-f0f9d133-7495-4720-98b8-e98e421922eb service nova] Lock "27aa03bb-5613-4bde-8bc0-30517f5d48ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:37:12 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-d3486fd9-06fa-4a35-87b8-4b645fe652ea req-f0f9d133-7495-4720-98b8-e98e421922eb service nova] Lock "27aa03bb-5613-4bde-8bc0-30517f5d48ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:37:12 user nova-compute[74960]: DEBUG nova.compute.manager [req-d3486fd9-06fa-4a35-87b8-4b645fe652ea req-f0f9d133-7495-4720-98b8-e98e421922eb service nova] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] No waiting events found dispatching network-vif-unplugged-16df3da7-2b2a-4c74-bb06-779696d25b88 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:37:12 user nova-compute[74960]: WARNING nova.compute.manager [req-d3486fd9-06fa-4a35-87b8-4b645fe652ea req-f0f9d133-7495-4720-98b8-e98e421922eb service nova] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] Received unexpected event network-vif-unplugged-16df3da7-2b2a-4c74-bb06-779696d25b88 for instance with vm_state active and task_state rebuilding.
Nov 03 12:37:12 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-5c2816d9-561e-4fc4-b744-e095e88ca64e tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Acquiring lock "5b7b95c0-3726-4a1c-a384-ec91abf75225" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:37:12 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-5c2816d9-561e-4fc4-b744-e095e88ca64e tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Lock "5b7b95c0-3726-4a1c-a384-ec91abf75225" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:37:12 user nova-compute[74960]: INFO nova.compute.manager [None req-5c2816d9-561e-4fc4-b744-e095e88ca64e tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] Detaching volume c0a0a661-c547-4364-8552-3d6497281515
Nov 03 12:37:12 user nova-compute[74960]: INFO nova.virt.block_device [None req-5c2816d9-561e-4fc4-b744-e095e88ca64e tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] Attempting to driver detach volume c0a0a661-c547-4364-8552-3d6497281515 from mountpoint /dev/vdb
Nov 03 12:37:12 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-5c2816d9-561e-4fc4-b744-e095e88ca64e tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Attempting to detach device vdb from instance 5b7b95c0-3726-4a1c-a384-ec91abf75225 from the persistent domain config. {{(pid=74960) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 03 12:37:12 user nova-compute[74960]: DEBUG nova.virt.libvirt.guest [None req-5c2816d9-561e-4fc4-b744-e095e88ca64e tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 12:37:12 user nova-compute[74960]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 12:37:12 user nova-compute[74960]:   <source dev="/dev/sdc"/>
Nov 03 12:37:12 user nova-compute[74960]:   <target dev="vdb" bus="virtio"/>
Nov 03 12:37:12 user nova-compute[74960]:   <serial>c0a0a661-c547-4364-8552-3d6497281515</serial>
Nov 03 12:37:12 user nova-compute[74960]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 03 12:37:12 user nova-compute[74960]: </disk>
Nov 03 12:37:12 user nova-compute[74960]:  {{(pid=74960) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 12:37:12 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-5c2816d9-561e-4fc4-b744-e095e88ca64e tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Successfully detached device vdb from instance 5b7b95c0-3726-4a1c-a384-ec91abf75225 from the persistent domain config.
Nov 03 12:37:12 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-5c2816d9-561e-4fc4-b744-e095e88ca64e tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5b7b95c0-3726-4a1c-a384-ec91abf75225 from the live domain config. {{(pid=74960) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 03 12:37:12 user nova-compute[74960]: DEBUG nova.virt.libvirt.guest [None req-5c2816d9-561e-4fc4-b744-e095e88ca64e tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 12:37:12 user nova-compute[74960]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 12:37:12 user nova-compute[74960]:   <source dev="/dev/sdc"/>
Nov 03 12:37:12 user nova-compute[74960]:   <target dev="vdb" bus="virtio"/>
Nov 03 12:37:12 user nova-compute[74960]:   <serial>c0a0a661-c547-4364-8552-3d6497281515</serial>
Nov 03 12:37:12 user nova-compute[74960]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 03 12:37:12 user nova-compute[74960]: </disk>
Nov 03 12:37:12 user nova-compute[74960]:  {{(pid=74960) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 12:37:12 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:37:13 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-5c2816d9-561e-4fc4-b744-e095e88ca64e tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5b7b95c0-3726-4a1c-a384-ec91abf75225 {{(pid=74960) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 03 12:37:13 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] Instance destroyed successfully.
Nov 03 12:37:13 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] Instance destroyed successfully.
Nov 03 12:37:13 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:35:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-84564102',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1532854274',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBYDYy6Yd4oTzqRmBgqOf0CT+Ul+2zedFmBjf4dct/ZgF3BtxBCHh2RqZpmfNUQqxXAXGv7pJgRz8+RxPwCi1ZxZq5Sw+Pludb9D/l5gQkHYcqClTVAMzGUWUIaG18LSIg==',key_name='tempest-keypair-807064414',keypairs=<?>,launch_index=0,launched_at=2023-11-03T12:35:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='384450261e1f45048eb9b4b431ce8bd5',ramdisk_id='',reservation_id='r-e40nqd7j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-999594459',owner_user_name='tempest-ServerActionsV293TestJSON-999594459-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:37:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2a983db9b51c44938095b72874dddcf9',uuid=27aa03bb-5613-4bde-8bc0-30517f5d48ae,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "16df3da7-2b2a-4c74-bb06-779696d25b88", "address": "fa:16:3e:2a:35:94", "network": {"id": "4a77f235-def4-4456-8f4a-99bf5769e015", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1480494760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "384450261e1f45048eb9b4b431ce8bd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16df3da7-2b", "ovs_interfaceid": "16df3da7-2b2a-4c74-bb06-779696d25b88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 12:37:13 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Converting VIF {"id": "16df3da7-2b2a-4c74-bb06-779696d25b88", "address": "fa:16:3e:2a:35:94", "network": {"id": "4a77f235-def4-4456-8f4a-99bf5769e015", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1480494760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "384450261e1f45048eb9b4b431ce8bd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16df3da7-2b", "ovs_interfaceid": "16df3da7-2b2a-4c74-bb06-779696d25b88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:37:13 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2a:35:94,bridge_name='br-int',has_traffic_filtering=True,id=16df3da7-2b2a-4c74-bb06-779696d25b88,network=Network(4a77f235-def4-4456-8f4a-99bf5769e015),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16df3da7-2b') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:37:13 user nova-compute[74960]: DEBUG os_vif [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:35:94,bridge_name='br-int',has_traffic_filtering=True,id=16df3da7-2b2a-4c74-bb06-779696d25b88,network=Network(4a77f235-def4-4456-8f4a-99bf5769e015),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16df3da7-2b') {{(pid=74960) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 12:37:13 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:37:13 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap16df3da7-2b, bridge=br-int, if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:37:13 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:37:13 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:37:13 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:37:13 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7cf69093-db44-41a3-9e25-d1cb336ae4f4) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:37:13 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:37:13 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:37:13 user nova-compute[74960]: INFO os_vif [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:35:94,bridge_name='br-int',has_traffic_filtering=True,id=16df3da7-2b2a-4c74-bb06-779696d25b88,network=Network(4a77f235-def4-4456-8f4a-99bf5769e015),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16df3da7-2b')
Nov 03 12:37:13 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] calling os-brick to detach iSCSI Volume {{(pid=74960) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 12:37:13 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9aa420acb0>, {'target_iqn': 'iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'snapNwyo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:37:13 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 03 12:37:13 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:37:13 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:37:13 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:37:13 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:37:13 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[6acc6989-aa85-4ff6-8fa7-47d6c9a7b4c9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c91df593-71cf-41cf-869f-7c87a6358e8e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:623b8c1d-ba2d-4bad-b0bd-71eefe783606\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:37:13 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 12:37:13 user nova-compute[74960]: No targets found.
Nov 03 12:37:13 user nova-compute[74960]: iSNS:
Nov 03 12:37:13 user nova-compute[74960]: No targets found.
Nov 03 12:37:13 user nova-compute[74960]: STATIC:
Nov 03 12:37:13 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515
Nov 03 12:37:13 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:37:13 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:37:13 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:c91df593-71cf-41cf-869f-7c87a6358e8e
Nov 03 12:37:13 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:37:13 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:37:13 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2
Nov 03 12:37:13 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:37:13 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:37:13 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:623b8c1d-ba2d-4bad-b0bd-71eefe783606
Nov 03 12:37:13 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:37:13 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:37:13 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61
Nov 03 12:37:13 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:37:13 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:37:13 user nova-compute[74960]: FIRMWARE:
Nov 03 12:37:13 user nova-compute[74960]: No targets found.
Nov 03 12:37:13 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:37:13 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 12:37:13 user nova-compute[74960]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 12:37:13 user nova-compute[74960]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74960) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 12:37:13 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61', 0)] {{(pid=74960) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 12:37:13 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:37:13 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:37:13 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad90a0db-2ed7-4b3c-b2d6-2d1b114d93f3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:623b8c1d-ba2d-4bad-b0bd-71eefe783606\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c91df593-71cf-41cf-869f-7c87a6358e8e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:37:13 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:37:13 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:37:13 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a4f35f4-dffb-49c2-8de6-5de36e9ea068]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:623b8c1d-ba2d-4bad-b0bd-71eefe783606 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91df593-71cf-41cf-869f-7c87a6358e8e (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:37:13 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:37:13 user nova-compute[74960]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 (non-flash)
Nov 03 12:37:13 user nova-compute[74960]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61 (non-flash)
Nov 03 12:37:13 user nova-compute[74960]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:623b8c1d-ba2d-4bad-b0bd-71eefe783606 (non-flash)
Nov 03 12:37:13 user nova-compute[74960]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91df593-71cf-41cf-869f-7c87a6358e8e (non-flash)
Nov 03 12:37:13 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:37:13 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:37:13 user nova-compute[74960]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 (non-flash)
Nov 03 12:37:13 user nova-compute[74960]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61 (non-flash)
Nov 03 12:37:13 user nova-compute[74960]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:623b8c1d-ba2d-4bad-b0bd-71eefe783606 (non-flash)
Nov 03 12:37:13 user nova-compute[74960]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91df593-71cf-41cf-869f-7c87a6358e8e (non-flash)
Nov 03 12:37:13 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:37:13 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9aac4fd3f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61'): ({'sdg'}, set())}) {{(pid=74960) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 12:37:13 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Removing single pathed devices sdg {{(pid=74960) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 12:37:13 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:37:13 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:37:13 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a1beb8-19fe-45fa-8fa5-8dc8a697d81e]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:37:13 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:37:13 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:37:13 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[572cc1af-8795-4d2d-a7ae-731c9201e959]: (4, ('ok\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:37:13 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Flushing IO for device /dev/sdg {{(pid=74960) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 12:37:13 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:37:13 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.017s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:37:13 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[c975d270-20c2-4260-89e0-e98359db18b1]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:37:13 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74960) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 12:37:13 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:37:13 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.045s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:37:13 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cbcaeaf-76f6-4592-bc58-8e5e292b7b29]: (4, ('1', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:37:13 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74960) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 12:37:13 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] SCSI volumes sdg have been removed. {{(pid=74960) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 12:37:13 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61')] {{(pid=74960) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 12:37:13 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:37:13 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:37:13 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[362309d6-95df-45f8-9ef6-13adbe154c0b]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:37:13 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:37:13 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61 -p 172.16.0.220:3260 --logout {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:37:13 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:37:13 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[f405a17b-bcd1-426c-a1b7-63ac09f92c7c]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:37:13 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61, portal: 172.16.0.220,3260]
Nov 03 12:37:13 user nova-compute[74960]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61, portal: 172.16.0.220,3260] successful.
Nov 03 12:37:13 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:37:13 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61 -p 172.16.0.220:3260 --op delete {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:37:13 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:37:13 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[b209afc9-feee-4a81-b798-efae6ef0365c]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:37:13 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:37:13 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.346s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:37:13 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] <== disconnect_volume: return (347ms) None {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:37:13 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] Disconnected iSCSI Volume {{(pid=74960) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 12:37:13 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] Deleting instance files /opt/stack/data/nova/instances/27aa03bb-5613-4bde-8bc0-30517f5d48ae_del
Nov 03 12:37:13 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] Deletion of /opt/stack/data/nova/instances/27aa03bb-5613-4bde-8bc0-30517f5d48ae_del complete
Nov 03 12:37:13 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:37:13 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 27aa03bb-5613-4bde-8bc0-30517f5d48ae could not be found.
Nov 03 12:37:13 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] calling os-brick to detach iSCSI Volume {{(pid=74960) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 12:37:13 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9aa420acb0>, {'target_iqn': 'iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'snapNwyo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:37:13 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 03 12:37:13 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:37:13 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:37:13 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:37:13 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:37:13 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[74a892aa-20b7-4b4a-8e68-b291cba44c0e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c91df593-71cf-41cf-869f-7c87a6358e8e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:623b8c1d-ba2d-4bad-b0bd-71eefe783606\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:37:13 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 12:37:13 user nova-compute[74960]: No targets found.
Nov 03 12:37:13 user nova-compute[74960]: iSNS:
Nov 03 12:37:13 user nova-compute[74960]: No targets found.
Nov 03 12:37:13 user nova-compute[74960]: STATIC:
Nov 03 12:37:13 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515
Nov 03 12:37:13 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:37:13 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:37:13 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:c91df593-71cf-41cf-869f-7c87a6358e8e
Nov 03 12:37:13 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:37:13 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:37:13 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2
Nov 03 12:37:13 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:37:13 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:37:13 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:623b8c1d-ba2d-4bad-b0bd-71eefe783606
Nov 03 12:37:13 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:37:13 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:37:13 user nova-compute[74960]: FIRMWARE:
Nov 03 12:37:13 user nova-compute[74960]: No targets found.
Nov 03 12:37:13 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:37:13 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 12:37:13 user nova-compute[74960]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 12:37:13 user nova-compute[74960]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74960) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 12:37:13 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61', 0)] {{(pid=74960) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 12:37:13 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:37:13 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:37:13 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[5451fdfe-835e-4f0e-ad9f-06c2881f9dc6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:623b8c1d-ba2d-4bad-b0bd-71eefe783606\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c91df593-71cf-41cf-869f-7c87a6358e8e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:37:13 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:37:13 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:37:13 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[9510550a-9557-41bc-b029-f78bb7e1e0eb]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:623b8c1d-ba2d-4bad-b0bd-71eefe783606 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91df593-71cf-41cf-869f-7c87a6358e8e (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:37:13 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:37:13 user nova-compute[74960]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 (non-flash)
Nov 03 12:37:13 user nova-compute[74960]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:623b8c1d-ba2d-4bad-b0bd-71eefe783606 (non-flash)
Nov 03 12:37:13 user nova-compute[74960]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91df593-71cf-41cf-869f-7c87a6358e8e (non-flash)
Nov 03 12:37:13 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:37:13 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:37:13 user nova-compute[74960]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 (non-flash)
Nov 03 12:37:13 user nova-compute[74960]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:623b8c1d-ba2d-4bad-b0bd-71eefe783606 (non-flash)
Nov 03 12:37:13 user nova-compute[74960]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91df593-71cf-41cf-869f-7c87a6358e8e (non-flash)
Nov 03 12:37:13 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:37:13 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9a8c405e10>, {}) {{(pid=74960) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 12:37:13 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Disconnecting from: [] {{(pid=74960) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 12:37:13 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.079s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:37:13 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] <== disconnect_volume: return (80ms) None {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:37:13 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] Disconnected iSCSI Volume {{(pid=74960) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 12:37:14 user nova-compute[74960]: DEBUG nova.compute.manager [req-3e28b26e-f467-42f3-b914-a65417116245 req-5c335b4b-a260-4df9-a504-5c4d8203771a service nova] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] Received event network-vif-plugged-16df3da7-2b2a-4c74-bb06-779696d25b88 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:37:14 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-3e28b26e-f467-42f3-b914-a65417116245 req-5c335b4b-a260-4df9-a504-5c4d8203771a service nova] Acquiring lock "27aa03bb-5613-4bde-8bc0-30517f5d48ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:37:14 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-3e28b26e-f467-42f3-b914-a65417116245 req-5c335b4b-a260-4df9-a504-5c4d8203771a service nova] Lock "27aa03bb-5613-4bde-8bc0-30517f5d48ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:37:14 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-3e28b26e-f467-42f3-b914-a65417116245 req-5c335b4b-a260-4df9-a504-5c4d8203771a service nova] Lock "27aa03bb-5613-4bde-8bc0-30517f5d48ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:37:14 user nova-compute[74960]: DEBUG nova.compute.manager [req-3e28b26e-f467-42f3-b914-a65417116245 req-5c335b4b-a260-4df9-a504-5c4d8203771a service nova] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] No waiting events found dispatching network-vif-plugged-16df3da7-2b2a-4c74-bb06-779696d25b88 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:37:14 user nova-compute[74960]: WARNING nova.compute.manager [req-3e28b26e-f467-42f3-b914-a65417116245 req-5c335b4b-a260-4df9-a504-5c4d8203771a service nova] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] Received unexpected event network-vif-plugged-16df3da7-2b2a-4c74-bb06-779696d25b88 for instance with vm_state active and task_state rebuilding.
Nov 03 12:37:15 user nova-compute[74960]: DEBUG nova.compute.manager [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] Preparing to wait for external event volume-reimaged-0d9b574a-cdd4-4118-a061-dfe393a5cd61 {{(pid=74960) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Nov 03 12:37:15 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Acquiring lock "27aa03bb-5613-4bde-8bc0-30517f5d48ae-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:37:15 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Lock "27aa03bb-5613-4bde-8bc0-30517f5d48ae-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:37:15 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Lock "27aa03bb-5613-4bde-8bc0-30517f5d48ae-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:37:18 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:37:18 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:37:21 user nova-compute[74960]: DEBUG nova.compute.manager [None req-d69e953e-01ea-4122-a191-c674adc258f8 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] Start spawning the instance on the hypervisor. {{(pid=74960) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 12:37:21 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-d69e953e-01ea-4122-a191-c674adc258f8 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] Creating instance directory {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 12:37:21 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-d69e953e-01ea-4122-a191-c674adc258f8 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] Creating image(s)
Nov 03 12:37:21 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-d69e953e-01ea-4122-a191-c674adc258f8 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] Did not create local disks {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 03 12:37:21 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-d69e953e-01ea-4122-a191-c674adc258f8 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] Ensure instance console log exists: /opt/stack/data/nova/instances/895d6de1-b5d9-4555-af57-f7816183be58/console.log {{(pid=74960) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 12:37:21 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-d69e953e-01ea-4122-a191-c674adc258f8 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:37:21 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-d69e953e-01ea-4122-a191-c674adc258f8 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:37:21 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-d69e953e-01ea-4122-a191-c674adc258f8 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:37:21 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-d69e953e-01ea-4122-a191-c674adc258f8 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] Start _get_guest_xml network_info=[{"id": "59f6ddba-fb77-4d36-98da-f4d645355650", "address": "fa:16:3e:df:ac:19", "network": {"id": "dec66832-56d5-4d68-b11f-8e8eed38f045", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-79099436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc95d68d5e147e1953c855169b17091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59f6ddba-fb", "ovs_interfaceid": "59f6ddba-fb77-4d36-98da-f4d645355650", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=549f51ba-ac69-494b-8de1-34635aa2d7cf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='63ee9c80c632442fb0379f47b784bd20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T12:13:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AOzUElvi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '895d6de1-b5d9-4555-af57-f7816183be58', 'attached_at': '', 'detached_at': '', 'volume_id': '0b25e85a-a887-4c1b-a798-bd360de0e9d7', 'serial': '0b25e85a-a887-4c1b-a798-bd360de0e9d7'}, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'device_type': 'disk', 'attachment_id': '6901fbb3-35a1-4b6f-958e-b7fd64ea215b', 'boot_index': 0, 'guest_format': None, 'volume_type': None} {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 12:37:21 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-d69e953e-01ea-4122-a191-c674adc258f8 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:37:21 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-d69e953e-01ea-4122-a191-c674adc258f8 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:37:21 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-d69e953e-01ea-4122-a191-c674adc258f8 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 12:37:21 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-d69e953e-01ea-4122-a191-c674adc258f8 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] CPU controller missing on host. {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 12:37:21 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-d69e953e-01ea-4122-a191-c674adc258f8 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 12:37:21 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-d69e953e-01ea-4122-a191-c674adc258f8 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] CPU controller found on host. {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 12:37:21 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-d69e953e-01ea-4122-a191-c674adc258f8 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74960) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 12:37:21 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-d69e953e-01ea-4122-a191-c674adc258f8 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=549f51ba-ac69-494b-8de1-34635aa2d7cf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='63ee9c80c632442fb0379f47b784bd20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T12:13:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 12:37:21 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-d69e953e-01ea-4122-a191-c674adc258f8 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Flavor limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 12:37:21 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-d69e953e-01ea-4122-a191-c674adc258f8 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Image limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 12:37:21 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-d69e953e-01ea-4122-a191-c674adc258f8 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Flavor pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 12:37:21 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-d69e953e-01ea-4122-a191-c674adc258f8 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Image pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 12:37:21 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-d69e953e-01ea-4122-a191-c674adc258f8 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 12:37:21 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-d69e953e-01ea-4122-a191-c674adc258f8 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 12:37:21 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-d69e953e-01ea-4122-a191-c674adc258f8 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 12:37:21 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-d69e953e-01ea-4122-a191-c674adc258f8 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Got 1 possible topologies {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 12:37:21 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-d69e953e-01ea-4122-a191-c674adc258f8 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 12:37:21 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-d69e953e-01ea-4122-a191-c674adc258f8 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 12:37:21 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d69e953e-01ea-4122-a191-c674adc258f8 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] Calling os-brick to attach iSCSI Volume {{(pid=74960) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 12:37:21 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-d69e953e-01ea-4122-a191-c674adc258f8 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9aa420acb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AOzUElvi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:37:21 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-d69e953e-01ea-4122-a191-c674adc258f8 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:37:21 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-d69e953e-01ea-4122-a191-c674adc258f8 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:37:21 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-d69e953e-01ea-4122-a191-c674adc258f8 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:37:21 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-d69e953e-01ea-4122-a191-c674adc258f8 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:37:21 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-d69e953e-01ea-4122-a191-c674adc258f8 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:37:21 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-d69e953e-01ea-4122-a191-c674adc258f8 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:37:21 user nova-compute[74960]: INFO os_brick.initiator.connectors.iscsi [None req-d69e953e-01ea-4122-a191-c674adc258f8 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 12:37:21 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:37:21 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7 -p 172.16.0.220:3260 {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:37:21 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:37:21 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3191e04-8612-43cd-8104-90512a60a7a4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:37:21 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-d69e953e-01ea-4122-a191-c674adc258f8 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 12:37:21 user nova-compute[74960]:  {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:37:21 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7 -p 172.16.0.220:3260 --interface default --op new {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:37:21 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:37:21 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[16ee7770-4cf8-4920-afb6-21c7c4024f4d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7] added\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:37:21 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-d69e953e-01ea-4122-a191-c674adc258f8 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7] added
Nov 03 12:37:21 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:37:21 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:37:21 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:37:21 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c6d3acf-c974-4a7f-b97b-5a85bbc82d5c]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:37:21 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-d69e953e-01ea-4122-a191-c674adc258f8 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:37:21 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:37:21 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:37:21 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7d3f6df-0ceb-44b9-85fe-28b7e252b0c0]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:37:21 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-d69e953e-01ea-4122-a191-c674adc258f8 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:37:21 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AOzUElvi {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:37:21 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AOzUElvi" returned: 0 in 0.022s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:37:21 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[69e2c2c5-dd5a-470d-b891-e4e565ec15af]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:37:21 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-d69e953e-01ea-4122-a191-c674adc258f8 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AOzUElvi'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:37:21 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:37:21 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:37:21 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6036397-8a70-4e54-8dd8-fa0043a972f3]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:37:21 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-d69e953e-01ea-4122-a191-c674adc258f8 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:37:21 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:37:21 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:37:21 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[02e91a9a-7879-430b-97b3-b2bc9679aadc]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:623b8c1d-ba2d-4bad-b0bd-71eefe783606 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91df593-71cf-41cf-869f-7c87a6358e8e (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:37:21 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-d69e953e-01ea-4122-a191-c674adc258f8 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:37:21 user nova-compute[74960]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 (non-flash)
Nov 03 12:37:21 user nova-compute[74960]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:623b8c1d-ba2d-4bad-b0bd-71eefe783606 (non-flash)
Nov 03 12:37:21 user nova-compute[74960]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91df593-71cf-41cf-869f-7c87a6358e8e (non-flash)
Nov 03 12:37:21 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:37:21 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-d69e953e-01ea-4122-a191-c674adc258f8 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:37:21 user nova-compute[74960]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 (non-flash)
Nov 03 12:37:21 user nova-compute[74960]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:623b8c1d-ba2d-4bad-b0bd-71eefe783606 (non-flash)
Nov 03 12:37:21 user nova-compute[74960]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91df593-71cf-41cf-869f-7c87a6358e8e (non-flash)
Nov 03 12:37:21 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:37:21 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7 -p 172.16.0.220:3260 --login {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:37:22 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:37:22 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e3bde67-c6e4-4718-83cc-f5a8c116851b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:37:22 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-d69e953e-01ea-4122-a191-c674adc258f8 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7, portal: 172.16.0.220,3260]
Nov 03 12:37:22 user nova-compute[74960]: Login to [iface: default, target: iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7, portal: 172.16.0.220,3260] successful.
Nov 03 12:37:22 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:37:22 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:37:22 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:37:22 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c425015-2c86-41b2-bb0f-1d42f9234ea0]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:37:22 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-d69e953e-01ea-4122-a191-c674adc258f8 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:37:22 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:37:22 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:37:22 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[d36e492e-f2a1-4240-8261-3516ad4aa371]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:623b8c1d-ba2d-4bad-b0bd-71eefe783606 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91df593-71cf-41cf-869f-7c87a6358e8e (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7 (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:37:22 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-d69e953e-01ea-4122-a191-c674adc258f8 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:37:22 user nova-compute[74960]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 (non-flash)
Nov 03 12:37:22 user nova-compute[74960]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:623b8c1d-ba2d-4bad-b0bd-71eefe783606 (non-flash)
Nov 03 12:37:22 user nova-compute[74960]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91df593-71cf-41cf-869f-7c87a6358e8e (non-flash)
Nov 03 12:37:22 user nova-compute[74960]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7 (non-flash)
Nov 03 12:37:22 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:37:22 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-d69e953e-01ea-4122-a191-c674adc258f8 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:37:22 user nova-compute[74960]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 (non-flash)
Nov 03 12:37:22 user nova-compute[74960]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:623b8c1d-ba2d-4bad-b0bd-71eefe783606 (non-flash)
Nov 03 12:37:22 user nova-compute[74960]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91df593-71cf-41cf-869f-7c87a6358e8e (non-flash)
Nov 03 12:37:22 user nova-compute[74960]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7 (non-flash)
Nov 03 12:37:22 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:37:22 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-d69e953e-01ea-4122-a191-c674adc258f8 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.335s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:37:22 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-d69e953e-01ea-4122-a191-c674adc258f8 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Connected to 172.16.0.220:3260 {{(pid=74960) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 12:37:22 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-d69e953e-01ea-4122-a191-c674adc258f8 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] HCTL ('36', '-', '-', 0) found on session 33 with lun 0 {{(pid=74960) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 12:37:22 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-d69e953e-01ea-4122-a191-c674adc258f8 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74960) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 12:37:22 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:37:22 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:37:22 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[52aab2ee-082a-4ab5-85d1-758db2506853]: (4, ('- - 0', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:37:22 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-d69e953e-01ea-4122-a191-c674adc258f8 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Searching for a device in session 33 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74960) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 12:37:22 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-d69e953e-01ea-4122-a191-c674adc258f8 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AOzUElvi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74960) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 12:37:23 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:37:23 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-d69e953e-01ea-4122-a191-c674adc258f8 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.368s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:37:23 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-d69e953e-01ea-4122-a191-c674adc258f8 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] <== connect_volume: return (1371ms) {'type': 'block', 'scsi_wwn': '23033643435623566', 'path': '/dev/sde'} {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:37:23 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d69e953e-01ea-4122-a191-c674adc258f8 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23033643435623566', 'path': '/dev/sde'} {{(pid=74960) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 12:37:23 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-d69e953e-01ea-4122-a191-c674adc258f8 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:36:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-657586703',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-657586703',id=37,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dbc95d68d5e147e1953c855169b17091',ramdisk_id='',reservation_id='r-phhx6hay',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-195954071',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:36:38Z,user_data=None,user_id='c473215929044a108c9fc4d6327dfc3d',uuid=895d6de1-b5d9-4555-af57-f7816183be58,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "59f6ddba-fb77-4d36-98da-f4d645355650", "address": "fa:16:3e:df:ac:19", "network": {"id": "dec66832-56d5-4d68-b11f-8e8eed38f045", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-79099436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc95d68d5e147e1953c855169b17091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59f6ddba-fb", "ovs_interfaceid": "59f6ddba-fb77-4d36-98da-f4d645355650", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74960) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 12:37:23 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-d69e953e-01ea-4122-a191-c674adc258f8 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Converting VIF {"id": "59f6ddba-fb77-4d36-98da-f4d645355650", "address": "fa:16:3e:df:ac:19", "network": {"id": "dec66832-56d5-4d68-b11f-8e8eed38f045", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-79099436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc95d68d5e147e1953c855169b17091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59f6ddba-fb", "ovs_interfaceid": "59f6ddba-fb77-4d36-98da-f4d645355650", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:37:23 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-d69e953e-01ea-4122-a191-c674adc258f8 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:ac:19,bridge_name='br-int',has_traffic_filtering=True,id=59f6ddba-fb77-4d36-98da-f4d645355650,network=Network(dec66832-56d5-4d68-b11f-8e8eed38f045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59f6ddba-fb') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:37:23 user nova-compute[74960]: DEBUG nova.objects.instance [None req-d69e953e-01ea-4122-a191-c674adc258f8 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Lazy-loading 'pci_devices' on Instance uuid 895d6de1-b5d9-4555-af57-f7816183be58 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:37:23 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-d69e953e-01ea-4122-a191-c674adc258f8 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] End _get_guest_xml xml=<domain type="kvm">
Nov 03 12:37:23 user nova-compute[74960]:   <uuid>895d6de1-b5d9-4555-af57-f7816183be58</uuid>
Nov 03 12:37:23 user nova-compute[74960]:   <name>instance-00000025</name>
Nov 03 12:37:23 user nova-compute[74960]:   <memory>524288</memory>
Nov 03 12:37:23 user nova-compute[74960]:   <vcpu>1</vcpu>
Nov 03 12:37:23 user nova-compute[74960]:   <metadata>
Nov 03 12:37:23 user nova-compute[74960]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 12:37:23 user nova-compute[74960]:       <nova:package version="0.0.0"/>
Nov 03 12:37:23 user nova-compute[74960]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-657586703</nova:name>
Nov 03 12:37:23 user nova-compute[74960]:       <nova:creationTime>2023-11-03 12:37:21</nova:creationTime>
Nov 03 12:37:23 user nova-compute[74960]:       <nova:flavor name="m1.tiny">
Nov 03 12:37:23 user nova-compute[74960]:         <nova:memory>512</nova:memory>
Nov 03 12:37:23 user nova-compute[74960]:         <nova:disk>1</nova:disk>
Nov 03 12:37:23 user nova-compute[74960]:         <nova:swap>0</nova:swap>
Nov 03 12:37:23 user nova-compute[74960]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 12:37:23 user nova-compute[74960]:         <nova:vcpus>1</nova:vcpus>
Nov 03 12:37:23 user nova-compute[74960]:       </nova:flavor>
Nov 03 12:37:23 user nova-compute[74960]:       <nova:owner>
Nov 03 12:37:23 user nova-compute[74960]:         <nova:user uuid="c473215929044a108c9fc4d6327dfc3d">tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member</nova:user>
Nov 03 12:37:23 user nova-compute[74960]:         <nova:project uuid="dbc95d68d5e147e1953c855169b17091">tempest-ServerBootFromVolumeStableRescueTest-195954071</nova:project>
Nov 03 12:37:23 user nova-compute[74960]:       </nova:owner>
Nov 03 12:37:23 user nova-compute[74960]:       <nova:root type="image" uuid="549f51ba-ac69-494b-8de1-34635aa2d7cf"/>
Nov 03 12:37:23 user nova-compute[74960]:       <nova:ports>
Nov 03 12:37:23 user nova-compute[74960]:         <nova:port uuid="59f6ddba-fb77-4d36-98da-f4d645355650">
Nov 03 12:37:23 user nova-compute[74960]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 03 12:37:23 user nova-compute[74960]:         </nova:port>
Nov 03 12:37:23 user nova-compute[74960]:       </nova:ports>
Nov 03 12:37:23 user nova-compute[74960]:     </nova:instance>
Nov 03 12:37:23 user nova-compute[74960]:   </metadata>
Nov 03 12:37:23 user nova-compute[74960]:   <sysinfo type="smbios">
Nov 03 12:37:23 user nova-compute[74960]:     <system>
Nov 03 12:37:23 user nova-compute[74960]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 12:37:23 user nova-compute[74960]:       <entry name="product">OpenStack Nova</entry>
Nov 03 12:37:23 user nova-compute[74960]:       <entry name="version">0.0.0</entry>
Nov 03 12:37:23 user nova-compute[74960]:       <entry name="serial">895d6de1-b5d9-4555-af57-f7816183be58</entry>
Nov 03 12:37:23 user nova-compute[74960]:       <entry name="uuid">895d6de1-b5d9-4555-af57-f7816183be58</entry>
Nov 03 12:37:23 user nova-compute[74960]:       <entry name="family">Virtual Machine</entry>
Nov 03 12:37:23 user nova-compute[74960]:     </system>
Nov 03 12:37:23 user nova-compute[74960]:   </sysinfo>
Nov 03 12:37:23 user nova-compute[74960]:   <os>
Nov 03 12:37:23 user nova-compute[74960]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 12:37:23 user nova-compute[74960]:     <boot dev="hd"/>
Nov 03 12:37:23 user nova-compute[74960]:     <smbios mode="sysinfo"/>
Nov 03 12:37:23 user nova-compute[74960]:   </os>
Nov 03 12:37:23 user nova-compute[74960]:   <features>
Nov 03 12:37:23 user nova-compute[74960]:     <acpi/>
Nov 03 12:37:23 user nova-compute[74960]:     <apic/>
Nov 03 12:37:23 user nova-compute[74960]:     <vmcoreinfo/>
Nov 03 12:37:23 user nova-compute[74960]:   </features>
Nov 03 12:37:23 user nova-compute[74960]:   <clock offset="utc">
Nov 03 12:37:23 user nova-compute[74960]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 12:37:23 user nova-compute[74960]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 12:37:23 user nova-compute[74960]:     <timer name="hpet" present="no"/>
Nov 03 12:37:23 user nova-compute[74960]:   </clock>
Nov 03 12:37:23 user nova-compute[74960]:   <cpu mode="custom" match="exact">
Nov 03 12:37:23 user nova-compute[74960]:     <model>Nehalem</model>
Nov 03 12:37:23 user nova-compute[74960]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 12:37:23 user nova-compute[74960]:   </cpu>
Nov 03 12:37:23 user nova-compute[74960]:   <devices>
Nov 03 12:37:23 user nova-compute[74960]:     <disk type="block" device="disk">
Nov 03 12:37:23 user nova-compute[74960]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 12:37:23 user nova-compute[74960]:       <source dev="/dev/sde"/>
Nov 03 12:37:23 user nova-compute[74960]:       <target dev="vda" bus="virtio"/>
Nov 03 12:37:23 user nova-compute[74960]:       <serial>0b25e85a-a887-4c1b-a798-bd360de0e9d7</serial>
Nov 03 12:37:23 user nova-compute[74960]:     </disk>
Nov 03 12:37:23 user nova-compute[74960]:     <interface type="ethernet">
Nov 03 12:37:23 user nova-compute[74960]:       <mac address="fa:16:3e:df:ac:19"/>
Nov 03 12:37:23 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:37:23 user nova-compute[74960]:       <mtu size="1442"/>
Nov 03 12:37:23 user nova-compute[74960]:       <target dev="tap59f6ddba-fb"/>
Nov 03 12:37:23 user nova-compute[74960]:     </interface>
Nov 03 12:37:23 user nova-compute[74960]:     <serial type="pty">
Nov 03 12:37:23 user nova-compute[74960]:       <log file="/opt/stack/data/nova/instances/895d6de1-b5d9-4555-af57-f7816183be58/console.log" append="off"/>
Nov 03 12:37:23 user nova-compute[74960]:     </serial>
Nov 03 12:37:23 user nova-compute[74960]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 12:37:23 user nova-compute[74960]:     <video>
Nov 03 12:37:23 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:37:23 user nova-compute[74960]:     </video>
Nov 03 12:37:23 user nova-compute[74960]:     <rng model="virtio">
Nov 03 12:37:23 user nova-compute[74960]:       <backend model="random">/dev/urandom</backend>
Nov 03 12:37:23 user nova-compute[74960]:     </rng>
Nov 03 12:37:23 user nova-compute[74960]:     <controller type="usb" index="0" model="none"/>
Nov 03 12:37:23 user nova-compute[74960]:     <memballoon model="virtio">
Nov 03 12:37:23 user nova-compute[74960]:       <stats period="10"/>
Nov 03 12:37:23 user nova-compute[74960]:     </memballoon>
Nov 03 12:37:23 user nova-compute[74960]:   </devices>
Nov 03 12:37:23 user nova-compute[74960]: </domain>
Nov 03 12:37:23 user nova-compute[74960]:  {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 12:37:23 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-d69e953e-01ea-4122-a191-c674adc258f8 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:36:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-657586703',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-657586703',id=37,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dbc95d68d5e147e1953c855169b17091',ramdisk_id='',reservation_id='r-phhx6hay',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-195954071',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:36:38Z,user_data=None,user_id='c473215929044a108c9fc4d6327dfc3d',uuid=895d6de1-b5d9-4555-af57-f7816183be58,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "59f6ddba-fb77-4d36-98da-f4d645355650", "address": "fa:16:3e:df:ac:19", "network": {"id": "dec66832-56d5-4d68-b11f-8e8eed38f045", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-79099436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc95d68d5e147e1953c855169b17091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59f6ddba-fb", "ovs_interfaceid": "59f6ddba-fb77-4d36-98da-f4d645355650", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 12:37:23 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-d69e953e-01ea-4122-a191-c674adc258f8 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Converting VIF {"id": "59f6ddba-fb77-4d36-98da-f4d645355650", "address": "fa:16:3e:df:ac:19", "network": {"id": "dec66832-56d5-4d68-b11f-8e8eed38f045", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-79099436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc95d68d5e147e1953c855169b17091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59f6ddba-fb", "ovs_interfaceid": "59f6ddba-fb77-4d36-98da-f4d645355650", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:37:23 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-d69e953e-01ea-4122-a191-c674adc258f8 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:ac:19,bridge_name='br-int',has_traffic_filtering=True,id=59f6ddba-fb77-4d36-98da-f4d645355650,network=Network(dec66832-56d5-4d68-b11f-8e8eed38f045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59f6ddba-fb') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:37:23 user nova-compute[74960]: DEBUG os_vif [None req-d69e953e-01ea-4122-a191-c674adc258f8 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:ac:19,bridge_name='br-int',has_traffic_filtering=True,id=59f6ddba-fb77-4d36-98da-f4d645355650,network=Network(dec66832-56d5-4d68-b11f-8e8eed38f045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59f6ddba-fb') {{(pid=74960) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 12:37:23 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:37:23 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:37:23 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 12:37:23 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:37:23 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9335b7a2-258a-51c0-8534-7bd450a48464', '_type': 'linux-noop'}}, row=False) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:37:23 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:37:23 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:37:23 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:37:23 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap59f6ddba-fb, may_exist=True, interface_attrs={}) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:37:23 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap59f6ddba-fb, col_values=(('qos', UUID('f7607270-9402-40c5-b5d6-cb36f7094f08')),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:37:23 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap59f6ddba-fb, col_values=(('external_ids', {'iface-id': '59f6ddba-fb77-4d36-98da-f4d645355650', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:df:ac:19', 'vm-uuid': '895d6de1-b5d9-4555-af57-f7816183be58'}),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:37:23 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:37:23 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:37:23 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:37:23 user nova-compute[74960]: INFO os_vif [None req-d69e953e-01ea-4122-a191-c674adc258f8 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:ac:19,bridge_name='br-int',has_traffic_filtering=True,id=59f6ddba-fb77-4d36-98da-f4d645355650,network=Network(dec66832-56d5-4d68-b11f-8e8eed38f045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59f6ddba-fb')
Nov 03 12:37:23 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-d69e953e-01ea-4122-a191-c674adc258f8 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] No BDM found with device name vda, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:37:23 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-d69e953e-01ea-4122-a191-c674adc258f8 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] No VIF found with MAC fa:16:3e:df:ac:19, not building metadata {{(pid=74960) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 12:37:23 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:37:24 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-028e224a-9dca-4252-b0c8-ddffbc19dcf5 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 12ae6707-c1c6-4bc2-a409-67cea64fc2c3 is timed out.
Nov 03 12:37:24 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-028e224a-9dca-4252-b0c8-ddffbc19dcf5 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Successfully detached device vdb from instance 12ae6707-c1c6-4bc2-a409-67cea64fc2c3 from the live domain config.
Nov 03 12:37:24 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-028e224a-9dca-4252-b0c8-ddffbc19dcf5 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] [instance: 12ae6707-c1c6-4bc2-a409-67cea64fc2c3] calling os-brick to detach iSCSI Volume {{(pid=74960) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 12:37:24 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-028e224a-9dca-4252-b0c8-ddffbc19dcf5 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9aa420acb0>, {'target_iqn': 'iqn.2010-10.org.openstack:623b8c1d-ba2d-4bad-b0bd-71eefe783606', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HoFPlhQy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:37:24 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-028e224a-9dca-4252-b0c8-ddffbc19dcf5 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:37:24 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-028e224a-9dca-4252-b0c8-ddffbc19dcf5 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:37:24 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-028e224a-9dca-4252-b0c8-ddffbc19dcf5 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:37:24 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:37:24 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:37:24 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9c08130-f6ad-4eeb-9976-36397fd2eb80]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c91df593-71cf-41cf-869f-7c87a6358e8e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:623b8c1d-ba2d-4bad-b0bd-71eefe783606\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:37:24 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-028e224a-9dca-4252-b0c8-ddffbc19dcf5 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 12:37:24 user nova-compute[74960]: No targets found.
Nov 03 12:37:24 user nova-compute[74960]: iSNS:
Nov 03 12:37:24 user nova-compute[74960]: No targets found.
Nov 03 12:37:24 user nova-compute[74960]: STATIC:
Nov 03 12:37:24 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515
Nov 03 12:37:24 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:37:24 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:37:24 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7
Nov 03 12:37:24 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:37:24 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:37:24 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:c91df593-71cf-41cf-869f-7c87a6358e8e
Nov 03 12:37:24 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:37:24 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:37:24 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2
Nov 03 12:37:24 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:37:24 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:37:24 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:623b8c1d-ba2d-4bad-b0bd-71eefe783606
Nov 03 12:37:24 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:37:24 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:37:24 user nova-compute[74960]: FIRMWARE:
Nov 03 12:37:24 user nova-compute[74960]: No targets found.
Nov 03 12:37:24 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:37:24 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-028e224a-9dca-4252-b0c8-ddffbc19dcf5 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 12:37:24 user nova-compute[74960]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 12:37:24 user nova-compute[74960]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74960) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 12:37:24 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-028e224a-9dca-4252-b0c8-ddffbc19dcf5 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:623b8c1d-ba2d-4bad-b0bd-71eefe783606', 0)] {{(pid=74960) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 12:37:24 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:37:24 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:37:24 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[3618042a-fced-462c-b2a7-5ae49057d2c7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:623b8c1d-ba2d-4bad-b0bd-71eefe783606\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c91df593-71cf-41cf-869f-7c87a6358e8e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:37:24 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:37:24 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:37:24 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:37:24 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:37:24 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3c2e803-fccb-4644-bc43-a56abd6922f2]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:623b8c1d-ba2d-4bad-b0bd-71eefe783606 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91df593-71cf-41cf-869f-7c87a6358e8e (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7 (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:37:24 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-028e224a-9dca-4252-b0c8-ddffbc19dcf5 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:37:24 user nova-compute[74960]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 (non-flash)
Nov 03 12:37:24 user nova-compute[74960]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:623b8c1d-ba2d-4bad-b0bd-71eefe783606 (non-flash)
Nov 03 12:37:24 user nova-compute[74960]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91df593-71cf-41cf-869f-7c87a6358e8e (non-flash)
Nov 03 12:37:24 user nova-compute[74960]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7 (non-flash)
Nov 03 12:37:24 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:37:24 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-028e224a-9dca-4252-b0c8-ddffbc19dcf5 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:37:24 user nova-compute[74960]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 (non-flash)
Nov 03 12:37:24 user nova-compute[74960]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:623b8c1d-ba2d-4bad-b0bd-71eefe783606 (non-flash)
Nov 03 12:37:24 user nova-compute[74960]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91df593-71cf-41cf-869f-7c87a6358e8e (non-flash)
Nov 03 12:37:24 user nova-compute[74960]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7 (non-flash)
Nov 03 12:37:24 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:37:24 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-028e224a-9dca-4252-b0c8-ddffbc19dcf5 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9a8c35f7f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:623b8c1d-ba2d-4bad-b0bd-71eefe783606'): ({'sdh'}, set())}) {{(pid=74960) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 12:37:24 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-028e224a-9dca-4252-b0c8-ddffbc19dcf5 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Removing single pathed devices sdh {{(pid=74960) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 12:37:24 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:37:24 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:37:24 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:37:24 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:37:24 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b64af9e-2bec-4f3f-b186-3f2226b1947b]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:37:24 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:37:24 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.024s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:37:24 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[702c345c-5a64-4b23-a4a1-d691aa622237]: (4, ('ok\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:37:24 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-028e224a-9dca-4252-b0c8-ddffbc19dcf5 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Flushing IO for device /dev/sdh {{(pid=74960) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 12:37:24 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:37:24 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:37:24 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[afcee6c0-c379-4a4d-9b32-4d8d87d50801]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:37:24 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-028e224a-9dca-4252-b0c8-ddffbc19dcf5 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=74960) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 12:37:24 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:37:24 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.053s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:37:24 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[0af34ae7-a603-4a01-b799-f8f25cd56859]: (4, ('1', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:37:24 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-028e224a-9dca-4252-b0c8-ddffbc19dcf5 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=74960) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 12:37:24 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-028e224a-9dca-4252-b0c8-ddffbc19dcf5 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] SCSI volumes sdh have been removed. {{(pid=74960) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 12:37:24 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-028e224a-9dca-4252-b0c8-ddffbc19dcf5 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:623b8c1d-ba2d-4bad-b0bd-71eefe783606')] {{(pid=74960) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 12:37:24 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:623b8c1d-ba2d-4bad-b0bd-71eefe783606 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:37:24 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:623b8c1d-ba2d-4bad-b0bd-71eefe783606 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:37:24 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[0696a5fa-ecaa-477d-a23f-2c61021a4109]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:37:24 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-028e224a-9dca-4252-b0c8-ddffbc19dcf5 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:37:24 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:623b8c1d-ba2d-4bad-b0bd-71eefe783606 -p 172.16.0.220:3260 --logout {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:37:24 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:623b8c1d-ba2d-4bad-b0bd-71eefe783606 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:37:24 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[f87e8eca-3310-4f4d-9518-1db71ec03162]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:623b8c1d-ba2d-4bad-b0bd-71eefe783606, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:623b8c1d-ba2d-4bad-b0bd-71eefe783606, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:37:24 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-028e224a-9dca-4252-b0c8-ddffbc19dcf5 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:623b8c1d-ba2d-4bad-b0bd-71eefe783606, portal: 172.16.0.220,3260]
Nov 03 12:37:24 user nova-compute[74960]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:623b8c1d-ba2d-4bad-b0bd-71eefe783606, portal: 172.16.0.220,3260] successful.
Nov 03 12:37:24 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:37:24 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:623b8c1d-ba2d-4bad-b0bd-71eefe783606 -p 172.16.0.220:3260 --op delete {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:37:25 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:623b8c1d-ba2d-4bad-b0bd-71eefe783606 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:37:25 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[7efbb10f-dc63-443e-98d6-07d295cd47a8]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:37:25 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-028e224a-9dca-4252-b0c8-ddffbc19dcf5 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:37:25 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-028e224a-9dca-4252-b0c8-ddffbc19dcf5 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.395s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:37:25 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-028e224a-9dca-4252-b0c8-ddffbc19dcf5 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] <== disconnect_volume: return (397ms) None {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:37:25 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-028e224a-9dca-4252-b0c8-ddffbc19dcf5 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] [instance: 12ae6707-c1c6-4bc2-a409-67cea64fc2c3] Disconnected iSCSI Volume {{(pid=74960) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 12:37:25 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:37:25 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:37:25 user nova-compute[74960]: DEBUG nova.compute.manager [req-1865e5b9-0f13-4686-bca1-8661ea06c58c req-a6bf6664-45bf-4ce6-9ee4-5547c4f1b7af service nova] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] Received event network-vif-plugged-59f6ddba-fb77-4d36-98da-f4d645355650 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:37:25 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-1865e5b9-0f13-4686-bca1-8661ea06c58c req-a6bf6664-45bf-4ce6-9ee4-5547c4f1b7af service nova] Acquiring lock "895d6de1-b5d9-4555-af57-f7816183be58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:37:25 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-1865e5b9-0f13-4686-bca1-8661ea06c58c req-a6bf6664-45bf-4ce6-9ee4-5547c4f1b7af service nova] Lock "895d6de1-b5d9-4555-af57-f7816183be58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:37:25 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-1865e5b9-0f13-4686-bca1-8661ea06c58c req-a6bf6664-45bf-4ce6-9ee4-5547c4f1b7af service nova] Lock "895d6de1-b5d9-4555-af57-f7816183be58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:37:25 user nova-compute[74960]: DEBUG nova.compute.manager [req-1865e5b9-0f13-4686-bca1-8661ea06c58c req-a6bf6664-45bf-4ce6-9ee4-5547c4f1b7af service nova] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] No waiting events found dispatching network-vif-plugged-59f6ddba-fb77-4d36-98da-f4d645355650 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:37:25 user nova-compute[74960]: WARNING nova.compute.manager [req-1865e5b9-0f13-4686-bca1-8661ea06c58c req-a6bf6664-45bf-4ce6-9ee4-5547c4f1b7af service nova] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] Received unexpected event network-vif-plugged-59f6ddba-fb77-4d36-98da-f4d645355650 for instance with vm_state building and task_state spawning.
Nov 03 12:37:25 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:37:25 user nova-compute[74960]: DEBUG nova.objects.instance [None req-028e224a-9dca-4252-b0c8-ddffbc19dcf5 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Lazy-loading 'flavor' on Instance uuid 12ae6707-c1c6-4bc2-a409-67cea64fc2c3 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:37:26 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-028e224a-9dca-4252-b0c8-ddffbc19dcf5 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Lock "12ae6707-c1c6-4bc2-a409-67cea64fc2c3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.116s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:37:26 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-53895e47-38ff-4547-8c5e-4b9dc29f97aa tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Lock "12ae6707-c1c6-4bc2-a409-67cea64fc2c3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.970s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:37:26 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-53895e47-38ff-4547-8c5e-4b9dc29f97aa tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Acquiring lock "12ae6707-c1c6-4bc2-a409-67cea64fc2c3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:37:26 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-53895e47-38ff-4547-8c5e-4b9dc29f97aa tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Lock "12ae6707-c1c6-4bc2-a409-67cea64fc2c3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:37:26 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-53895e47-38ff-4547-8c5e-4b9dc29f97aa tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Lock "12ae6707-c1c6-4bc2-a409-67cea64fc2c3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:37:26 user nova-compute[74960]: INFO nova.compute.manager [None req-53895e47-38ff-4547-8c5e-4b9dc29f97aa tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] [instance: 12ae6707-c1c6-4bc2-a409-67cea64fc2c3] Terminating instance
Nov 03 12:37:26 user nova-compute[74960]: DEBUG nova.compute.manager [None req-53895e47-38ff-4547-8c5e-4b9dc29f97aa tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] [instance: 12ae6707-c1c6-4bc2-a409-67cea64fc2c3] Start destroying the instance on the hypervisor. {{(pid=74960) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 12:37:26 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:37:26 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:37:26 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:37:26 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:37:26 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: 12ae6707-c1c6-4bc2-a409-67cea64fc2c3] Instance destroyed successfully.
Nov 03 12:37:26 user nova-compute[74960]: DEBUG nova.objects.instance [None req-53895e47-38ff-4547-8c5e-4b9dc29f97aa tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Lazy-loading 'resources' on Instance uuid 12ae6707-c1c6-4bc2-a409-67cea64fc2c3 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:37:26 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-53895e47-38ff-4547-8c5e-4b9dc29f97aa tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:33:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-763194758',display_name='tempest-VolumesSnapshotTestJSON-instance-763194758',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-763194758',id=34,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJErDah/iWWznsurVF8MVa4A/B4DpHy0yvVfrFAJrbm4OGQ5lRTx5u2rIeV78O2wMCwZJFJqJnAYfPGnicZBscmt0zG76mKOxqsuJbUc6S4Rs2Nr3msLQgPow++ETR44jw==',key_name='tempest-keypair-1601541259',keypairs=<?>,launch_index=0,launched_at=2023-11-03T12:33:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='efa134687c74460fb5a59dd3ddece671',ramdisk_id='',reservation_id='r-e83p82ny',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1639372533',owner_user_name='tempest-VolumesSnapshotTestJSON-1639372533-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T12:33:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b5fbd2703e241afb720be4680301751',uuid=12ae6707-c1c6-4bc2-a409-67cea64fc2c3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "356b6bc6-6335-476f-948e-7bc8bc4fc88c", "address": "fa:16:3e:d7:40:80", "network": {"id": "82ebe97c-a056-4ac2-9644-ea315bf9a4b1", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1024050438-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efa134687c74460fb5a59dd3ddece671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap356b6bc6-63", "ovs_interfaceid": "356b6bc6-6335-476f-948e-7bc8bc4fc88c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 12:37:26 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-53895e47-38ff-4547-8c5e-4b9dc29f97aa tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Converting VIF {"id": "356b6bc6-6335-476f-948e-7bc8bc4fc88c", "address": "fa:16:3e:d7:40:80", "network": {"id": "82ebe97c-a056-4ac2-9644-ea315bf9a4b1", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1024050438-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efa134687c74460fb5a59dd3ddece671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap356b6bc6-63", "ovs_interfaceid": "356b6bc6-6335-476f-948e-7bc8bc4fc88c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:37:26 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-53895e47-38ff-4547-8c5e-4b9dc29f97aa tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d7:40:80,bridge_name='br-int',has_traffic_filtering=True,id=356b6bc6-6335-476f-948e-7bc8bc4fc88c,network=Network(82ebe97c-a056-4ac2-9644-ea315bf9a4b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap356b6bc6-63') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:37:26 user nova-compute[74960]: DEBUG os_vif [None req-53895e47-38ff-4547-8c5e-4b9dc29f97aa tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d7:40:80,bridge_name='br-int',has_traffic_filtering=True,id=356b6bc6-6335-476f-948e-7bc8bc4fc88c,network=Network(82ebe97c-a056-4ac2-9644-ea315bf9a4b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap356b6bc6-63') {{(pid=74960) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 12:37:26 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:37:26 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap356b6bc6-63, bridge=br-int, if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:37:26 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:37:26 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:37:26 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:37:26 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=72f23780-06a6-43a0-9b41-50affa2d8be4) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:37:26 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:37:26 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:37:26 user nova-compute[74960]: INFO os_vif [None req-53895e47-38ff-4547-8c5e-4b9dc29f97aa tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d7:40:80,bridge_name='br-int',has_traffic_filtering=True,id=356b6bc6-6335-476f-948e-7bc8bc4fc88c,network=Network(82ebe97c-a056-4ac2-9644-ea315bf9a4b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap356b6bc6-63')
Nov 03 12:37:26 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53895e47-38ff-4547-8c5e-4b9dc29f97aa tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] [instance: 12ae6707-c1c6-4bc2-a409-67cea64fc2c3] calling os-brick to detach iSCSI Volume {{(pid=74960) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 12:37:26 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-53895e47-38ff-4547-8c5e-4b9dc29f97aa tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9aa420acb0>, {'target_iqn': 'iqn.2010-10.org.openstack:623b8c1d-ba2d-4bad-b0bd-71eefe783606', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HoFPlhQy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:37:26 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-53895e47-38ff-4547-8c5e-4b9dc29f97aa tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:37:26 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-53895e47-38ff-4547-8c5e-4b9dc29f97aa tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:37:26 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-53895e47-38ff-4547-8c5e-4b9dc29f97aa tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:37:26 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:37:26 user nova-compute[74960]: DEBUG nova.compute.manager [req-49d6e6f3-d43f-4617-be92-93a7ee151bd8 req-25d5ec7f-07e0-4c98-80cb-33995fbca9bf service nova] [instance: 12ae6707-c1c6-4bc2-a409-67cea64fc2c3] Received event network-vif-unplugged-356b6bc6-6335-476f-948e-7bc8bc4fc88c {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:37:26 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-49d6e6f3-d43f-4617-be92-93a7ee151bd8 req-25d5ec7f-07e0-4c98-80cb-33995fbca9bf service nova] Acquiring lock "12ae6707-c1c6-4bc2-a409-67cea64fc2c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:37:26 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-49d6e6f3-d43f-4617-be92-93a7ee151bd8 req-25d5ec7f-07e0-4c98-80cb-33995fbca9bf service nova] Lock "12ae6707-c1c6-4bc2-a409-67cea64fc2c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:37:26 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-49d6e6f3-d43f-4617-be92-93a7ee151bd8 req-25d5ec7f-07e0-4c98-80cb-33995fbca9bf service nova] Lock "12ae6707-c1c6-4bc2-a409-67cea64fc2c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:37:26 user nova-compute[74960]: DEBUG nova.compute.manager [req-49d6e6f3-d43f-4617-be92-93a7ee151bd8 req-25d5ec7f-07e0-4c98-80cb-33995fbca9bf service nova] [instance: 12ae6707-c1c6-4bc2-a409-67cea64fc2c3] No waiting events found dispatching network-vif-unplugged-356b6bc6-6335-476f-948e-7bc8bc4fc88c {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:37:26 user nova-compute[74960]: DEBUG nova.compute.manager [req-49d6e6f3-d43f-4617-be92-93a7ee151bd8 req-25d5ec7f-07e0-4c98-80cb-33995fbca9bf service nova] [instance: 12ae6707-c1c6-4bc2-a409-67cea64fc2c3] Received event network-vif-unplugged-356b6bc6-6335-476f-948e-7bc8bc4fc88c for instance with task_state deleting. {{(pid=74960) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 12:37:26 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:37:26 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[92356cc0-c085-44a8-b08c-bf831b10ee9e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c91df593-71cf-41cf-869f-7c87a6358e8e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:37:26 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-53895e47-38ff-4547-8c5e-4b9dc29f97aa tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 12:37:26 user nova-compute[74960]: No targets found.
Nov 03 12:37:26 user nova-compute[74960]: iSNS:
Nov 03 12:37:26 user nova-compute[74960]: No targets found.
Nov 03 12:37:26 user nova-compute[74960]: STATIC:
Nov 03 12:37:26 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515
Nov 03 12:37:26 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:37:26 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:37:26 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7
Nov 03 12:37:26 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:37:26 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:37:26 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:c91df593-71cf-41cf-869f-7c87a6358e8e
Nov 03 12:37:26 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:37:26 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:37:26 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2
Nov 03 12:37:26 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:37:26 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:37:26 user nova-compute[74960]: FIRMWARE:
Nov 03 12:37:26 user nova-compute[74960]: No targets found.
Nov 03 12:37:26 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:37:26 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-53895e47-38ff-4547-8c5e-4b9dc29f97aa tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 12:37:26 user nova-compute[74960]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 12:37:26 user nova-compute[74960]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74960) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 12:37:26 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-53895e47-38ff-4547-8c5e-4b9dc29f97aa tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:623b8c1d-ba2d-4bad-b0bd-71eefe783606', 0)] {{(pid=74960) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 12:37:26 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:37:26 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:37:26 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f5d6d2f-e390-4903-a2ea-26eed65c4e15]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c91df593-71cf-41cf-869f-7c87a6358e8e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:37:26 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:37:26 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:37:26 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[9169af0e-22a2-4d12-9db9-9636622deff0]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91df593-71cf-41cf-869f-7c87a6358e8e (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7 (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:37:26 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-53895e47-38ff-4547-8c5e-4b9dc29f97aa tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:37:26 user nova-compute[74960]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 (non-flash)
Nov 03 12:37:26 user nova-compute[74960]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91df593-71cf-41cf-869f-7c87a6358e8e (non-flash)
Nov 03 12:37:26 user nova-compute[74960]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7 (non-flash)
Nov 03 12:37:26 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:37:26 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-53895e47-38ff-4547-8c5e-4b9dc29f97aa tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:37:26 user nova-compute[74960]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 (non-flash)
Nov 03 12:37:26 user nova-compute[74960]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91df593-71cf-41cf-869f-7c87a6358e8e (non-flash)
Nov 03 12:37:26 user nova-compute[74960]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7 (non-flash)
Nov 03 12:37:26 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:37:26 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-53895e47-38ff-4547-8c5e-4b9dc29f97aa tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9a8c405240>, {}) {{(pid=74960) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 12:37:26 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-53895e47-38ff-4547-8c5e-4b9dc29f97aa tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Disconnecting from: [] {{(pid=74960) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 12:37:26 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-53895e47-38ff-4547-8c5e-4b9dc29f97aa tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.094s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:37:26 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-53895e47-38ff-4547-8c5e-4b9dc29f97aa tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] <== disconnect_volume: return (95ms) None {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:37:26 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53895e47-38ff-4547-8c5e-4b9dc29f97aa tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] [instance: 12ae6707-c1c6-4bc2-a409-67cea64fc2c3] Disconnected iSCSI Volume {{(pid=74960) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 12:37:26 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-53895e47-38ff-4547-8c5e-4b9dc29f97aa tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] [instance: 12ae6707-c1c6-4bc2-a409-67cea64fc2c3] Deleting instance files /opt/stack/data/nova/instances/12ae6707-c1c6-4bc2-a409-67cea64fc2c3_del
Nov 03 12:37:26 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-53895e47-38ff-4547-8c5e-4b9dc29f97aa tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] [instance: 12ae6707-c1c6-4bc2-a409-67cea64fc2c3] Deletion of /opt/stack/data/nova/instances/12ae6707-c1c6-4bc2-a409-67cea64fc2c3_del complete
Nov 03 12:37:27 user nova-compute[74960]: INFO nova.compute.manager [None req-53895e47-38ff-4547-8c5e-4b9dc29f97aa tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] [instance: 12ae6707-c1c6-4bc2-a409-67cea64fc2c3] Took 1.03 seconds to destroy the instance on the hypervisor.
Nov 03 12:37:27 user nova-compute[74960]: DEBUG oslo.service.loopingcall [None req-53895e47-38ff-4547-8c5e-4b9dc29f97aa tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74960) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 12:37:27 user nova-compute[74960]: DEBUG nova.compute.manager [-] [instance: 12ae6707-c1c6-4bc2-a409-67cea64fc2c3] Deallocating network for instance {{(pid=74960) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 12:37:27 user nova-compute[74960]: DEBUG nova.network.neutron [-] [instance: 12ae6707-c1c6-4bc2-a409-67cea64fc2c3] deallocate_for_instance() {{(pid=74960) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 12:37:27 user nova-compute[74960]: DEBUG nova.compute.manager [None req-d69e953e-01ea-4122-a191-c674adc258f8 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] Instance event wait completed in 0 seconds for  {{(pid=74960) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 12:37:27 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-d69e953e-01ea-4122-a191-c674adc258f8 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] Guest created on hypervisor {{(pid=74960) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 12:37:27 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] Instance spawned successfully.
Nov 03 12:37:27 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-d69e953e-01ea-4122-a191-c674adc258f8 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 12:37:27 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-d69e953e-01ea-4122-a191-c674adc258f8 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] Found default for hw_cdrom_bus of ide {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:37:27 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-d69e953e-01ea-4122-a191-c674adc258f8 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] Found default for hw_disk_bus of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:37:27 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-d69e953e-01ea-4122-a191-c674adc258f8 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] Found default for hw_input_bus of None {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:37:27 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-d69e953e-01ea-4122-a191-c674adc258f8 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] Found default for hw_pointer_model of None {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:37:27 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-d69e953e-01ea-4122-a191-c674adc258f8 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] Found default for hw_video_model of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:37:27 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-d69e953e-01ea-4122-a191-c674adc258f8 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] Found default for hw_vif_model of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:37:27 user nova-compute[74960]: DEBUG nova.compute.manager [req-0b252e4d-2495-4bbc-9ca1-794dd6a7c8a1 req-56b1f86d-b9ad-4155-a1ad-e600016d9031 service nova] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] Received event network-vif-plugged-59f6ddba-fb77-4d36-98da-f4d645355650 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:37:27 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-0b252e4d-2495-4bbc-9ca1-794dd6a7c8a1 req-56b1f86d-b9ad-4155-a1ad-e600016d9031 service nova] Acquiring lock "895d6de1-b5d9-4555-af57-f7816183be58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:37:27 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-0b252e4d-2495-4bbc-9ca1-794dd6a7c8a1 req-56b1f86d-b9ad-4155-a1ad-e600016d9031 service nova] Lock "895d6de1-b5d9-4555-af57-f7816183be58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:37:27 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-0b252e4d-2495-4bbc-9ca1-794dd6a7c8a1 req-56b1f86d-b9ad-4155-a1ad-e600016d9031 service nova] Lock "895d6de1-b5d9-4555-af57-f7816183be58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:37:27 user nova-compute[74960]: DEBUG nova.compute.manager [req-0b252e4d-2495-4bbc-9ca1-794dd6a7c8a1 req-56b1f86d-b9ad-4155-a1ad-e600016d9031 service nova] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] No waiting events found dispatching network-vif-plugged-59f6ddba-fb77-4d36-98da-f4d645355650 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:37:27 user nova-compute[74960]: WARNING nova.compute.manager [req-0b252e4d-2495-4bbc-9ca1-794dd6a7c8a1 req-56b1f86d-b9ad-4155-a1ad-e600016d9031 service nova] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] Received unexpected event network-vif-plugged-59f6ddba-fb77-4d36-98da-f4d645355650 for instance with vm_state building and task_state spawning.
Nov 03 12:37:27 user nova-compute[74960]: INFO nova.compute.manager [None req-d69e953e-01ea-4122-a191-c674adc258f8 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] Took 5.61 seconds to spawn the instance on the hypervisor.
Nov 03 12:37:27 user nova-compute[74960]: DEBUG nova.compute.manager [None req-d69e953e-01ea-4122-a191-c674adc258f8 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] Checking state {{(pid=74960) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 12:37:27 user nova-compute[74960]: INFO nova.compute.manager [None req-d69e953e-01ea-4122-a191-c674adc258f8 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] Took 50.17 seconds to build instance.
Nov 03 12:37:27 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-d69e953e-01ea-4122-a191-c674adc258f8 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Lock "895d6de1-b5d9-4555-af57-f7816183be58" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 50.441s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:37:27 user nova-compute[74960]: DEBUG nova.network.neutron [-] [instance: 12ae6707-c1c6-4bc2-a409-67cea64fc2c3] Updating instance_info_cache with network_info: [] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:37:27 user nova-compute[74960]: INFO nova.compute.manager [-] [instance: 12ae6707-c1c6-4bc2-a409-67cea64fc2c3] Took 0.94 seconds to deallocate network for instance.
Nov 03 12:37:28 user nova-compute[74960]: WARNING nova.volume.cinder [None req-53895e47-38ff-4547-8c5e-4b9dc29f97aa tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Attachment 76e79325-a7ea-4882-9e07-c0d4fd244a08 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 76e79325-a7ea-4882-9e07-c0d4fd244a08. (HTTP 404) (Request-ID: req-14dd410f-9e81-4265-b320-1e6f580e8cdf)
Nov 03 12:37:28 user nova-compute[74960]: INFO nova.compute.manager [None req-53895e47-38ff-4547-8c5e-4b9dc29f97aa tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] [instance: 12ae6707-c1c6-4bc2-a409-67cea64fc2c3] Took 0.03 seconds to detach 1 volumes for instance.
Nov 03 12:37:28 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-53895e47-38ff-4547-8c5e-4b9dc29f97aa tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:37:28 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-53895e47-38ff-4547-8c5e-4b9dc29f97aa tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:37:28 user nova-compute[74960]: DEBUG nova.compute.manager [req-b20f86e8-37f1-4b8f-bd37-4d52181ba7fa req-920ab753-1900-429f-9695-83353d84f835 service nova] [instance: 12ae6707-c1c6-4bc2-a409-67cea64fc2c3] Received event network-vif-deleted-356b6bc6-6335-476f-948e-7bc8bc4fc88c {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:37:28 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-53895e47-38ff-4547-8c5e-4b9dc29f97aa tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:37:28 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-53895e47-38ff-4547-8c5e-4b9dc29f97aa tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:37:28 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-53895e47-38ff-4547-8c5e-4b9dc29f97aa tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.477s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:37:28 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:37:28 user nova-compute[74960]: INFO nova.scheduler.client.report [None req-53895e47-38ff-4547-8c5e-4b9dc29f97aa tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Deleted allocations for instance 12ae6707-c1c6-4bc2-a409-67cea64fc2c3
Nov 03 12:37:28 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-53895e47-38ff-4547-8c5e-4b9dc29f97aa tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Lock "12ae6707-c1c6-4bc2-a409-67cea64fc2c3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.719s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:37:28 user nova-compute[74960]: DEBUG nova.compute.manager [req-7c70bccd-3ba1-49ca-b24b-43e3f30ee53a req-d44c3701-4e2e-4f93-90b6-3ddaf9ac85d8 service nova] [instance: 12ae6707-c1c6-4bc2-a409-67cea64fc2c3] Received event network-vif-plugged-356b6bc6-6335-476f-948e-7bc8bc4fc88c {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:37:28 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-7c70bccd-3ba1-49ca-b24b-43e3f30ee53a req-d44c3701-4e2e-4f93-90b6-3ddaf9ac85d8 service nova] Acquiring lock "12ae6707-c1c6-4bc2-a409-67cea64fc2c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:37:28 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-7c70bccd-3ba1-49ca-b24b-43e3f30ee53a req-d44c3701-4e2e-4f93-90b6-3ddaf9ac85d8 service nova] Lock "12ae6707-c1c6-4bc2-a409-67cea64fc2c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:37:28 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-7c70bccd-3ba1-49ca-b24b-43e3f30ee53a req-d44c3701-4e2e-4f93-90b6-3ddaf9ac85d8 service nova] Lock "12ae6707-c1c6-4bc2-a409-67cea64fc2c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:37:28 user nova-compute[74960]: DEBUG nova.compute.manager [req-7c70bccd-3ba1-49ca-b24b-43e3f30ee53a req-d44c3701-4e2e-4f93-90b6-3ddaf9ac85d8 service nova] [instance: 12ae6707-c1c6-4bc2-a409-67cea64fc2c3] No waiting events found dispatching network-vif-plugged-356b6bc6-6335-476f-948e-7bc8bc4fc88c {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:37:28 user nova-compute[74960]: WARNING nova.compute.manager [req-7c70bccd-3ba1-49ca-b24b-43e3f30ee53a req-d44c3701-4e2e-4f93-90b6-3ddaf9ac85d8 service nova] [instance: 12ae6707-c1c6-4bc2-a409-67cea64fc2c3] Received unexpected event network-vif-plugged-356b6bc6-6335-476f-948e-7bc8bc4fc88c for instance with vm_state deleted and task_state None.
Nov 03 12:37:29 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-e36ed070-66ac-495c-8d63-ac8fefd37fc5 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 35e02c80-f626-4918-93f1-6b9a7f778c7a is timed out.
Nov 03 12:37:29 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-e36ed070-66ac-495c-8d63-ac8fefd37fc5 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Successfully detached device vdb from instance 35e02c80-f626-4918-93f1-6b9a7f778c7a from the live domain config.
Nov 03 12:37:29 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e36ed070-66ac-495c-8d63-ac8fefd37fc5 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a] calling os-brick to detach iSCSI Volume {{(pid=74960) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 12:37:29 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-e36ed070-66ac-495c-8d63-ac8fefd37fc5 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9aa420acb0>, {'target_iqn': 'iqn.2010-10.org.openstack:c91df593-71cf-41cf-869f-7c87a6358e8e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HPkZfAIF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:37:29 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-e36ed070-66ac-495c-8d63-ac8fefd37fc5 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:37:29 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-e36ed070-66ac-495c-8d63-ac8fefd37fc5 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:37:29 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-e36ed070-66ac-495c-8d63-ac8fefd37fc5 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:37:29 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:37:29 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:37:29 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[b52866e0-bb9a-455b-b128-c27726a1ab94]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c91df593-71cf-41cf-869f-7c87a6358e8e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:37:29 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-e36ed070-66ac-495c-8d63-ac8fefd37fc5 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 12:37:29 user nova-compute[74960]: No targets found.
Nov 03 12:37:29 user nova-compute[74960]: iSNS:
Nov 03 12:37:29 user nova-compute[74960]: No targets found.
Nov 03 12:37:29 user nova-compute[74960]: STATIC:
Nov 03 12:37:29 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515
Nov 03 12:37:29 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:37:29 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:37:29 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7
Nov 03 12:37:29 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:37:29 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:37:29 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:c91df593-71cf-41cf-869f-7c87a6358e8e
Nov 03 12:37:29 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:37:29 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:37:29 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2
Nov 03 12:37:29 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:37:29 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:37:29 user nova-compute[74960]: FIRMWARE:
Nov 03 12:37:29 user nova-compute[74960]: No targets found.
Nov 03 12:37:29 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:37:29 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-e36ed070-66ac-495c-8d63-ac8fefd37fc5 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 12:37:29 user nova-compute[74960]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 12:37:29 user nova-compute[74960]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74960) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 12:37:29 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-e36ed070-66ac-495c-8d63-ac8fefd37fc5 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c91df593-71cf-41cf-869f-7c87a6358e8e', 0)] {{(pid=74960) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 12:37:29 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:37:29 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:37:29 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[65785191-0d3f-456b-a6b2-f98b8982a915]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c91df593-71cf-41cf-869f-7c87a6358e8e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:37:29 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:37:29 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:37:29 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e050a51-d895-4d7c-b3d6-af4ff43bca8e]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91df593-71cf-41cf-869f-7c87a6358e8e (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7 (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:37:29 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-e36ed070-66ac-495c-8d63-ac8fefd37fc5 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:37:29 user nova-compute[74960]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 (non-flash)
Nov 03 12:37:29 user nova-compute[74960]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91df593-71cf-41cf-869f-7c87a6358e8e (non-flash)
Nov 03 12:37:29 user nova-compute[74960]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7 (non-flash)
Nov 03 12:37:29 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:37:29 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-e36ed070-66ac-495c-8d63-ac8fefd37fc5 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:37:29 user nova-compute[74960]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 (non-flash)
Nov 03 12:37:29 user nova-compute[74960]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91df593-71cf-41cf-869f-7c87a6358e8e (non-flash)
Nov 03 12:37:29 user nova-compute[74960]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7 (non-flash)
Nov 03 12:37:29 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:37:29 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-e36ed070-66ac-495c-8d63-ac8fefd37fc5 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9aac255240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c91df593-71cf-41cf-869f-7c87a6358e8e'): ({'sdb'}, set())}) {{(pid=74960) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 12:37:29 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-e36ed070-66ac-495c-8d63-ac8fefd37fc5 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Removing single pathed devices sdb {{(pid=74960) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 12:37:29 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:37:29 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:37:29 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[397fbfbd-def8-4255-98a0-fa94aab0ee12]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:37:29 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:37:29 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.027s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:37:29 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6b6bf41-716c-4e32-ba18-8ad777d6b6b3]: (4, ('ok\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:37:29 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-e36ed070-66ac-495c-8d63-ac8fefd37fc5 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Flushing IO for device /dev/sdb {{(pid=74960) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 12:37:29 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:37:29 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:37:29 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[d950f3d8-2c0d-4c28-bf17-d1ff4e36819c]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:37:29 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-e36ed070-66ac-495c-8d63-ac8fefd37fc5 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74960) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 12:37:29 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:37:29 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:37:29 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8bacd9e-6735-4336-9f01-ea435746fd01]: (4, ('1', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:37:29 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-e36ed070-66ac-495c-8d63-ac8fefd37fc5 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74960) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 12:37:29 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-e36ed070-66ac-495c-8d63-ac8fefd37fc5 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] SCSI volumes sdb have been removed. {{(pid=74960) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 12:37:29 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-e36ed070-66ac-495c-8d63-ac8fefd37fc5 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c91df593-71cf-41cf-869f-7c87a6358e8e')] {{(pid=74960) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 12:37:29 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c91df593-71cf-41cf-869f-7c87a6358e8e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:37:29 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c91df593-71cf-41cf-869f-7c87a6358e8e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:37:29 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[7699062d-77e9-40d0-95ef-cd0a3ea1a3c6]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:37:29 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-e36ed070-66ac-495c-8d63-ac8fefd37fc5 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:37:29 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c91df593-71cf-41cf-869f-7c87a6358e8e -p 172.16.0.220:3260 --logout {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:37:30 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c91df593-71cf-41cf-869f-7c87a6358e8e -p 172.16.0.220:3260 --logout" returned: 0 in 0.132s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:37:30 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c070a1-52d0-4351-ab3d-bd56dfc59182]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:c91df593-71cf-41cf-869f-7c87a6358e8e, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:c91df593-71cf-41cf-869f-7c87a6358e8e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:37:30 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-e36ed070-66ac-495c-8d63-ac8fefd37fc5 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:c91df593-71cf-41cf-869f-7c87a6358e8e, portal: 172.16.0.220,3260]
Nov 03 12:37:30 user nova-compute[74960]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:c91df593-71cf-41cf-869f-7c87a6358e8e, portal: 172.16.0.220,3260] successful.
Nov 03 12:37:30 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:37:30 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c91df593-71cf-41cf-869f-7c87a6358e8e -p 172.16.0.220:3260 --op delete {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:37:30 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c91df593-71cf-41cf-869f-7c87a6358e8e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:37:30 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[66c1713b-faf6-4c80-b4bb-34365c03b5ea]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:37:30 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-e36ed070-66ac-495c-8d63-ac8fefd37fc5 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:37:30 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-e36ed070-66ac-495c-8d63-ac8fefd37fc5 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.495s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:37:30 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-e36ed070-66ac-495c-8d63-ac8fefd37fc5 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] <== disconnect_volume: return (496ms) None {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:37:30 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e36ed070-66ac-495c-8d63-ac8fefd37fc5 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a] Disconnected iSCSI Volume {{(pid=74960) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 12:37:31 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:37:33 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-5c2816d9-561e-4fc4-b744-e095e88ca64e tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5b7b95c0-3726-4a1c-a384-ec91abf75225 is timed out.
Nov 03 12:37:33 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-5c2816d9-561e-4fc4-b744-e095e88ca64e tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Successfully detached device vdb from instance 5b7b95c0-3726-4a1c-a384-ec91abf75225 from the live domain config.
Nov 03 12:37:33 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c2816d9-561e-4fc4-b744-e095e88ca64e tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] calling os-brick to detach iSCSI Volume {{(pid=74960) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 12:37:33 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c2816d9-561e-4fc4-b744-e095e88ca64e tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9aa420acb0>, {'target_iqn': 'iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lbqIoMWN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:37:33 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-5c2816d9-561e-4fc4-b744-e095e88ca64e tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:37:33 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-5c2816d9-561e-4fc4-b744-e095e88ca64e tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:37:33 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-5c2816d9-561e-4fc4-b744-e095e88ca64e tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:37:33 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:37:33 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:37:33 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[899105b3-e6c1-47de-ba53-22be57c5b0e0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:37:33 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c2816d9-561e-4fc4-b744-e095e88ca64e tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 12:37:33 user nova-compute[74960]: No targets found.
Nov 03 12:37:33 user nova-compute[74960]: iSNS:
Nov 03 12:37:33 user nova-compute[74960]: No targets found.
Nov 03 12:37:33 user nova-compute[74960]: STATIC:
Nov 03 12:37:33 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515
Nov 03 12:37:33 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:37:33 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:37:33 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7
Nov 03 12:37:33 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:37:33 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:37:33 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2
Nov 03 12:37:33 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:37:33 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:37:33 user nova-compute[74960]: FIRMWARE:
Nov 03 12:37:33 user nova-compute[74960]: No targets found.
Nov 03 12:37:33 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:37:33 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c2816d9-561e-4fc4-b744-e095e88ca64e tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 12:37:33 user nova-compute[74960]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 12:37:33 user nova-compute[74960]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74960) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 12:37:33 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c2816d9-561e-4fc4-b744-e095e88ca64e tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515', 0)] {{(pid=74960) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 12:37:33 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:37:33 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:37:33 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[afacc26c-fad8-4b2d-8d9a-f2c16c210de0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:37:33 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:37:33 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:37:33 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[8969ab7d-6ce9-4de7-a060-2f0ba52916eb]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7 (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:37:33 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c2816d9-561e-4fc4-b744-e095e88ca64e tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:37:33 user nova-compute[74960]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 (non-flash)
Nov 03 12:37:33 user nova-compute[74960]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7 (non-flash)
Nov 03 12:37:33 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:37:33 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c2816d9-561e-4fc4-b744-e095e88ca64e tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:37:33 user nova-compute[74960]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 (non-flash)
Nov 03 12:37:33 user nova-compute[74960]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7 (non-flash)
Nov 03 12:37:33 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:37:33 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c2816d9-561e-4fc4-b744-e095e88ca64e tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9aac3bb910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515'): ({'sdc'}, set())}) {{(pid=74960) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 12:37:33 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-5c2816d9-561e-4fc4-b744-e095e88ca64e tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Removing single pathed devices sdc {{(pid=74960) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 12:37:33 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:37:33 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:37:33 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b2d5b33-9213-4d86-bc46-722d483f3b86]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:37:33 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:37:33 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:37:33 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c4fdee8-05a9-451e-984c-fe97a9486013]: (4, ('ok\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:37:33 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-5c2816d9-561e-4fc4-b744-e095e88ca64e tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Flushing IO for device /dev/sdc {{(pid=74960) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 12:37:33 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:37:33 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:37:33 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b198924-e6af-4c3f-9e40-3de3bef44f22]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:37:33 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-5c2816d9-561e-4fc4-b744-e095e88ca64e tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74960) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 12:37:33 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:37:33 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:37:33 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceaf2546-52c7-4dd0-8cf9-60806c448c42]: (4, ('1', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:37:33 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-5c2816d9-561e-4fc4-b744-e095e88ca64e tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74960) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 12:37:33 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-5c2816d9-561e-4fc4-b744-e095e88ca64e tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] SCSI volumes sdc have been removed. {{(pid=74960) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 12:37:33 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c2816d9-561e-4fc4-b744-e095e88ca64e tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515')] {{(pid=74960) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 12:37:33 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:37:33 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:37:33 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[74098fd7-87b8-4dca-a224-9135230915ac]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:37:33 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c2816d9-561e-4fc4-b744-e095e88ca64e tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:37:33 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 -p 172.16.0.220:3260 --logout {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:37:33 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:37:33 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[84aff70b-957c-46de-b3ba-c4cbd47bed6c]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:37:33 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c2816d9-561e-4fc4-b744-e095e88ca64e tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515, portal: 172.16.0.220,3260]
Nov 03 12:37:33 user nova-compute[74960]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515, portal: 172.16.0.220,3260] successful.
Nov 03 12:37:33 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:37:33 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 -p 172.16.0.220:3260 --op delete {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:37:33 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0a0a661-c547-4364-8552-3d6497281515 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:37:33 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0615ee9-99e5-435a-ac94-6958c5b9dcc4]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:37:33 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c2816d9-561e-4fc4-b744-e095e88ca64e tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:37:33 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-5c2816d9-561e-4fc4-b744-e095e88ca64e tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:37:33 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c2816d9-561e-4fc4-b744-e095e88ca64e tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] <== disconnect_volume: return (331ms) None {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:37:33 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c2816d9-561e-4fc4-b744-e095e88ca64e tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] Disconnected iSCSI Volume {{(pid=74960) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 12:37:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:37:34 user nova-compute[74960]: DEBUG nova.objects.instance [None req-5c2816d9-561e-4fc4-b744-e095e88ca64e tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Lazy-loading 'flavor' on Instance uuid 5b7b95c0-3726-4a1c-a384-ec91abf75225 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:37:34 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-5c2816d9-561e-4fc4-b744-e095e88ca64e tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Lock "5b7b95c0-3726-4a1c-a384-ec91abf75225" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.186s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:37:35 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-d3479aab-9296-459c-9cda-f4cb4ce52830 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Acquiring lock "5b7b95c0-3726-4a1c-a384-ec91abf75225" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:37:35 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-d3479aab-9296-459c-9cda-f4cb4ce52830 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Lock "5b7b95c0-3726-4a1c-a384-ec91abf75225" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:37:35 user nova-compute[74960]: DEBUG nova.compute.manager [None req-d3479aab-9296-459c-9cda-f4cb4ce52830 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] Checking state {{(pid=74960) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 12:37:35 user nova-compute[74960]: DEBUG nova.compute.manager [None req-d3479aab-9296-459c-9cda-f4cb4ce52830 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74960) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 03 12:37:35 user nova-compute[74960]: DEBUG nova.objects.instance [None req-d3479aab-9296-459c-9cda-f4cb4ce52830 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Lazy-loading 'flavor' on Instance uuid 5b7b95c0-3726-4a1c-a384-ec91abf75225 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:37:35 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:37:35 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:37:35 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:37:35 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:37:35 user nova-compute[74960]: DEBUG nova.compute.manager [req-e40e0291-1523-4418-8456-cfa1d1172639 req-3564c111-0134-442b-b42a-3d8f200afb20 service nova] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] Received event network-vif-unplugged-091cbb89-dd8a-448e-963a-3dbcafde6bb1 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:37:35 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-e40e0291-1523-4418-8456-cfa1d1172639 req-3564c111-0134-442b-b42a-3d8f200afb20 service nova] Acquiring lock "5b7b95c0-3726-4a1c-a384-ec91abf75225-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:37:35 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-e40e0291-1523-4418-8456-cfa1d1172639 req-3564c111-0134-442b-b42a-3d8f200afb20 service nova] Lock "5b7b95c0-3726-4a1c-a384-ec91abf75225-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:37:35 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-e40e0291-1523-4418-8456-cfa1d1172639 req-3564c111-0134-442b-b42a-3d8f200afb20 service nova] Lock "5b7b95c0-3726-4a1c-a384-ec91abf75225-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:37:35 user nova-compute[74960]: DEBUG nova.compute.manager [req-e40e0291-1523-4418-8456-cfa1d1172639 req-3564c111-0134-442b-b42a-3d8f200afb20 service nova] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] No waiting events found dispatching network-vif-unplugged-091cbb89-dd8a-448e-963a-3dbcafde6bb1 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:37:35 user nova-compute[74960]: WARNING nova.compute.manager [req-e40e0291-1523-4418-8456-cfa1d1172639 req-3564c111-0134-442b-b42a-3d8f200afb20 service nova] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] Received unexpected event network-vif-unplugged-091cbb89-dd8a-448e-963a-3dbcafde6bb1 for instance with vm_state active and task_state powering-off.
Nov 03 12:37:36 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] Instance destroyed successfully.
Nov 03 12:37:36 user nova-compute[74960]: DEBUG nova.compute.manager [None req-d3479aab-9296-459c-9cda-f4cb4ce52830 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] Checking state {{(pid=74960) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 12:37:36 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-d3479aab-9296-459c-9cda-f4cb4ce52830 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Lock "5b7b95c0-3726-4a1c-a384-ec91abf75225" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.920s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:37:36 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:37:37 user nova-compute[74960]: DEBUG nova.compute.manager [req-bf5ebc3e-465f-4fca-b177-26070ce597c5 req-50f3f389-1a96-4612-a2a6-bf6fe1c9bd6a service nova] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] Received event network-vif-plugged-091cbb89-dd8a-448e-963a-3dbcafde6bb1 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:37:37 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-bf5ebc3e-465f-4fca-b177-26070ce597c5 req-50f3f389-1a96-4612-a2a6-bf6fe1c9bd6a service nova] Acquiring lock "5b7b95c0-3726-4a1c-a384-ec91abf75225-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:37:37 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-bf5ebc3e-465f-4fca-b177-26070ce597c5 req-50f3f389-1a96-4612-a2a6-bf6fe1c9bd6a service nova] Lock "5b7b95c0-3726-4a1c-a384-ec91abf75225-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:37:37 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-bf5ebc3e-465f-4fca-b177-26070ce597c5 req-50f3f389-1a96-4612-a2a6-bf6fe1c9bd6a service nova] Lock "5b7b95c0-3726-4a1c-a384-ec91abf75225-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:37:37 user nova-compute[74960]: DEBUG nova.compute.manager [req-bf5ebc3e-465f-4fca-b177-26070ce597c5 req-50f3f389-1a96-4612-a2a6-bf6fe1c9bd6a service nova] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] No waiting events found dispatching network-vif-plugged-091cbb89-dd8a-448e-963a-3dbcafde6bb1 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:37:37 user nova-compute[74960]: WARNING nova.compute.manager [req-bf5ebc3e-465f-4fca-b177-26070ce597c5 req-50f3f389-1a96-4612-a2a6-bf6fe1c9bd6a service nova] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] Received unexpected event network-vif-plugged-091cbb89-dd8a-448e-963a-3dbcafde6bb1 for instance with vm_state stopped and task_state None.
Nov 03 12:37:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:37:41 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:37:41 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:37:43 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:37:46 user nova-compute[74960]: DEBUG nova.objects.instance [None req-e36ed070-66ac-495c-8d63-ac8fefd37fc5 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Lazy-loading 'flavor' on Instance uuid 35e02c80-f626-4918-93f1-6b9a7f778c7a {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:37:46 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-e36ed070-66ac-495c-8d63-ac8fefd37fc5 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Lock "35e02c80-f626-4918-93f1-6b9a7f778c7a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 37.083s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:37:46 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:37:48 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:37:51 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:37:52 user nova-compute[74960]: DEBUG nova.compute.manager [req-41796648-4b86-4a3d-8917-9ba14c2de219 req-100f68f5-7c9c-47af-8858-cbcd80ef16b9 service nova] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] Received event volume-reimaged-0d9b574a-cdd4-4118-a061-dfe393a5cd61 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:37:52 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-41796648-4b86-4a3d-8917-9ba14c2de219 req-100f68f5-7c9c-47af-8858-cbcd80ef16b9 service nova] Acquiring lock "27aa03bb-5613-4bde-8bc0-30517f5d48ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:37:52 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-41796648-4b86-4a3d-8917-9ba14c2de219 req-100f68f5-7c9c-47af-8858-cbcd80ef16b9 service nova] Lock "27aa03bb-5613-4bde-8bc0-30517f5d48ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:37:52 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-41796648-4b86-4a3d-8917-9ba14c2de219 req-100f68f5-7c9c-47af-8858-cbcd80ef16b9 service nova] Lock "27aa03bb-5613-4bde-8bc0-30517f5d48ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:37:52 user nova-compute[74960]: DEBUG nova.compute.manager [req-41796648-4b86-4a3d-8917-9ba14c2de219 req-100f68f5-7c9c-47af-8858-cbcd80ef16b9 service nova] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] Processing event volume-reimaged-0d9b574a-cdd4-4118-a061-dfe393a5cd61 {{(pid=74960) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10872}}
Nov 03 12:37:52 user nova-compute[74960]: DEBUG nova.compute.manager [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] Instance event wait completed in 36 seconds for volume-reimaged {{(pid=74960) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 12:37:52 user nova-compute[74960]: INFO nova.virt.block_device [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] Booting with volume 0d9b574a-cdd4-4118-a061-dfe393a5cd61 at /dev/vda
Nov 03 12:37:52 user nova-compute[74960]: DEBUG os_brick.utils [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:37:52 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:37:52 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:37:52 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[0410fc89-4b1c-43e3-8aac-9d50204bac48]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:75b8e219756\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:37:52 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:37:52 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:37:52 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6d87c13-8705-4845-9dd2-8802ed4c8175]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:37:52 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:37:52 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:37:52 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[410f8f97-33e5-41f6-9dd5-8b6ab51df86f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:37:52 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[e324195b-5981-46e5-a954-a69a3453a4cb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:37:52 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Running cmd (subprocess): nvme version {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:37:52 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] 'nvme version' failed. Not Retrying. {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 12:37:52 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.nvmeof [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] nvme not present on system {{(pid=74960) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 12:37:52 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:37:52 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 12:37:52 user nova-compute[74960]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 12:37:52 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[63c5ee8a-1778-4625-9c26-5ceecf97fbf7]: (4, '') {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:37:52 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74960) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 12:37:52 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74960) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 12:37:52 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] LIGHTOS: no hostnqn found. {{(pid=74960) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 12:37:52 user nova-compute[74960]: DEBUG os_brick.utils [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:75b8e219756', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:37:52 user nova-compute[74960]: DEBUG nova.virt.block_device [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] Updating existing volume attachment record: bdfd1426-2091-4f51-ad12-40c427f3d24b {{(pid=74960) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 12:37:53 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:37:53 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:37:53 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:37:54 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:37:54 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:37:54 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Starting heal instance info cache {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 12:37:54 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "refresh_cache-35e02c80-f626-4918-93f1-6b9a7f778c7a" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:37:54 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquired lock "refresh_cache-35e02c80-f626-4918-93f1-6b9a7f778c7a" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:37:54 user nova-compute[74960]: DEBUG nova.network.neutron [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a] Forcefully refreshing network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 12:37:54 user nova-compute[74960]: DEBUG nova.network.neutron [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a] Updating instance_info_cache with network_info: [{"id": "4a3a2b1f-db29-441d-9bf9-7f429760ae05", "address": "fa:16:3e:26:d9:9a", "network": {"id": "40aa546e-b586-43f8-bfe3-99c3822fb320", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1884215412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68a32002934044bfad2e4d84bc1b04ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a3a2b1f-db", "ovs_interfaceid": "4a3a2b1f-db29-441d-9bf9-7f429760ae05", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:37:54 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Releasing lock "refresh_cache-35e02c80-f626-4918-93f1-6b9a7f778c7a" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:37:54 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a] Updated the network info_cache for instance {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 12:37:54 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:37:55 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:37:55 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:37:55 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:37:55 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:37:55 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:37:55 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Auditing locally available compute resources for user (node: user) {{(pid=74960) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 12:37:55 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f15f5f-8afa-4d7b-bb45-5887184f9ee5/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:37:55 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f15f5f-8afa-4d7b-bb45-5887184f9ee5/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:37:55 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f15f5f-8afa-4d7b-bb45-5887184f9ee5/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:37:55 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f15f5f-8afa-4d7b-bb45-5887184f9ee5/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:37:55 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47eb8ddf-590f-4ffa-87c8-377cf1ee0f67/disk.rescue --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:37:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47eb8ddf-590f-4ffa-87c8-377cf1ee0f67/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:37:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47eb8ddf-590f-4ffa-87c8-377cf1ee0f67/disk.rescue --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:37:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47eb8ddf-590f-4ffa-87c8-377cf1ee0f67/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:37:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47eb8ddf-590f-4ffa-87c8-377cf1ee0f67/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:37:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47eb8ddf-590f-4ffa-87c8-377cf1ee0f67/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:37:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47eb8ddf-590f-4ffa-87c8-377cf1ee0f67/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:37:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47eb8ddf-590f-4ffa-87c8-377cf1ee0f67/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:37:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7b95c0-3726-4a1c-a384-ec91abf75225/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:37:56 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:37:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7b95c0-3726-4a1c-a384-ec91abf75225/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:37:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7b95c0-3726-4a1c-a384-ec91abf75225/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:37:57 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7b95c0-3726-4a1c-a384-ec91abf75225/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:37:57 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e02c80-f626-4918-93f1-6b9a7f778c7a/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:37:57 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e02c80-f626-4918-93f1-6b9a7f778c7a/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:37:57 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e02c80-f626-4918-93f1-6b9a7f778c7a/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:37:57 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e02c80-f626-4918-93f1-6b9a7f778c7a/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:37:57 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk.rescue --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:37:57 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:37:57 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk.rescue --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:37:57 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:37:57 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:37:58 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:37:58 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:37:58 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:37:58 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74960) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 12:37:58 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7606a55-d5c3-4ba8-b499-f3c70813f151/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:37:58 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7606a55-d5c3-4ba8-b499-f3c70813f151/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:37:58 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7606a55-d5c3-4ba8-b499-f3c70813f151/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:37:58 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:37:58 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7606a55-d5c3-4ba8-b499-f3c70813f151/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:37:58 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74960) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 12:37:59 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:37:59 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:37:59 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Hypervisor/Node resource view: name=user free_ram=8094MB free_disk=24.897998809814453GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74960) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 12:37:59 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:37:59 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:37:59 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 87f15f5f-8afa-4d7b-bb45-5887184f9ee5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:37:59 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance a6199681-f85e-4f55-966b-6ab3f17cd640 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:37:59 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 5b7b95c0-3726-4a1c-a384-ec91abf75225 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:37:59 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 35e02c80-f626-4918-93f1-6b9a7f778c7a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:37:59 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:37:59 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:37:59 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance b7606a55-d5c3-4ba8-b499-f3c70813f151 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:37:59 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 27aa03bb-5613-4bde-8bc0-30517f5d48ae actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:37:59 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 895d6de1-b5d9-4555-af57-f7816183be58 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:37:59 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74960) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 12:37:59 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74960) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 12:37:59 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Refreshing inventories for resource provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 03 12:37:59 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Updating ProviderTree inventory for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 03 12:37:59 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Updating inventory in ProviderTree for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 03 12:37:59 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Refreshing aggregate associations for resource provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0, aggregates: None {{(pid=74960) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 03 12:37:59 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Refreshing trait associations for resource provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0, traits: COMPUTE_NODE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE41,HW_CPU_X86_SSSE3,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_DEVICE_TAGGING,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_QXL {{(pid=74960) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 03 12:37:59 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:37:59 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:37:59 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Compute_service record updated for user:user {{(pid=74960) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 12:37:59 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.787s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:37:59 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:37:59 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Cleaning up deleted instances {{(pid=74960) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 03 12:37:59 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] There are 1 instances to clean {{(pid=74960) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 03 12:37:59 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49] Instance has had 1 of 5 cleanup attempts {{(pid=74960) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11222}}
Nov 03 12:37:59 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49] Deleting instance files /opt/stack/data/nova/instances/b1f7c162-c891-460a-8f98-3c7d6aeb6c49_del
Nov 03 12:37:59 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: b1f7c162-c891-460a-8f98-3c7d6aeb6c49] Deletion of /opt/stack/data/nova/instances/b1f7c162-c891-460a-8f98-3c7d6aeb6c49_del complete
Nov 03 12:38:01 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:38:03 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:38:03 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:38:03 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:38:03 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:38:03 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74960) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 12:38:05 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-d33db2e0-bc53-4122-9103-cfa431089b9a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Acquiring lock "35e02c80-f626-4918-93f1-6b9a7f778c7a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:38:05 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-d33db2e0-bc53-4122-9103-cfa431089b9a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Lock "35e02c80-f626-4918-93f1-6b9a7f778c7a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:38:05 user nova-compute[74960]: DEBUG nova.objects.instance [None req-d33db2e0-bc53-4122-9103-cfa431089b9a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Lazy-loading 'flavor' on Instance uuid 35e02c80-f626-4918-93f1-6b9a7f778c7a {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:38:05 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-d33db2e0-bc53-4122-9103-cfa431089b9a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Lock "35e02c80-f626-4918-93f1-6b9a7f778c7a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:38:05 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-d33db2e0-bc53-4122-9103-cfa431089b9a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Acquiring lock "35e02c80-f626-4918-93f1-6b9a7f778c7a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:38:05 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-d33db2e0-bc53-4122-9103-cfa431089b9a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Lock "35e02c80-f626-4918-93f1-6b9a7f778c7a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:38:05 user nova-compute[74960]: INFO nova.compute.manager [None req-d33db2e0-bc53-4122-9103-cfa431089b9a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a] Attaching volume 7076f382-82aa-4765-91d3-750540d96879 to /dev/vdb
Nov 03 12:38:05 user nova-compute[74960]: DEBUG os_brick.utils [None req-d33db2e0-bc53-4122-9103-cfa431089b9a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:38:05 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:38:05 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:38:05 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[22efc902-f199-466c-bd0b-86645ec363e0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:75b8e219756\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:38:05 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:38:05 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:38:05 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[717a8936-eda8-4873-9ea3-d56935d21ae1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:38:05 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:38:05 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:38:05 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[7933a404-a8cf-4e01-8663-761c7aae861c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:38:05 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[97aa6bb4-f243-4841-84db-94849379572e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:38:05 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-d33db2e0-bc53-4122-9103-cfa431089b9a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Running cmd (subprocess): nvme version {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:38:05 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-d33db2e0-bc53-4122-9103-cfa431089b9a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] 'nvme version' failed. Not Retrying. {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 12:38:05 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d33db2e0-bc53-4122-9103-cfa431089b9a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] nvme not present on system {{(pid=74960) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 12:38:05 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:38:05 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 12:38:05 user nova-compute[74960]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 12:38:05 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd4e403a-38d8-46ff-9eb7-bc0350f86b5f]: (4, '') {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:38:05 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-d33db2e0-bc53-4122-9103-cfa431089b9a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74960) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 12:38:05 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-d33db2e0-bc53-4122-9103-cfa431089b9a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74960) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 12:38:05 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-d33db2e0-bc53-4122-9103-cfa431089b9a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] LIGHTOS: no hostnqn found. {{(pid=74960) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 12:38:05 user nova-compute[74960]: DEBUG os_brick.utils [None req-d33db2e0-bc53-4122-9103-cfa431089b9a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:75b8e219756', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:38:05 user nova-compute[74960]: DEBUG nova.virt.block_device [None req-d33db2e0-bc53-4122-9103-cfa431089b9a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a] Updating existing volume attachment record: eee6cb6b-fdd1-4617-a6e5-88a75fcfd250 {{(pid=74960) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 12:38:06 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:38:08 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:38:08 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Cleaning up deleted instances with incomplete migration  {{(pid=74960) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 03 12:38:08 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:38:11 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:38:16 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:38:21 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:38:26 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:38:31 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:38:36 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:38:40 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:38:41 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:38:42 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d33db2e0-bc53-4122-9103-cfa431089b9a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a] Calling os-brick to attach iSCSI Volume {{(pid=74960) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 12:38:42 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33db2e0-bc53-4122-9103-cfa431089b9a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9aa420acb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7076f382-82aa-4765-91d3-750540d96879', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vdDptsGK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:38:42 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-d33db2e0-bc53-4122-9103-cfa431089b9a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:38:42 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-d33db2e0-bc53-4122-9103-cfa431089b9a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:38:42 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-d33db2e0-bc53-4122-9103-cfa431089b9a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:38:42 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-d33db2e0-bc53-4122-9103-cfa431089b9a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:38:42 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-d33db2e0-bc53-4122-9103-cfa431089b9a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7076f382-82aa-4765-91d3-750540d96879" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:38:42 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-d33db2e0-bc53-4122-9103-cfa431089b9a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7076f382-82aa-4765-91d3-750540d96879" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:38:42 user nova-compute[74960]: INFO os_brick.initiator.connectors.iscsi [None req-d33db2e0-bc53-4122-9103-cfa431089b9a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 12:38:42 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7076f382-82aa-4765-91d3-750540d96879 -p 172.16.0.220:3260 {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:38:42 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7076f382-82aa-4765-91d3-750540d96879 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:38:42 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a266d9a-0977-4994-8d20-34bd74a2053c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:38:42 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33db2e0-bc53-4122-9103-cfa431089b9a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 12:38:42 user nova-compute[74960]:  {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:38:42 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7076f382-82aa-4765-91d3-750540d96879 -p 172.16.0.220:3260 --interface default --op new {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:38:42 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7076f382-82aa-4765-91d3-750540d96879 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:38:42 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c85077a-aea4-467a-b071-9fdfb6fe0217]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7076f382-82aa-4765-91d3-750540d96879] added\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:38:42 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33db2e0-bc53-4122-9103-cfa431089b9a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7076f382-82aa-4765-91d3-750540d96879] added
Nov 03 12:38:42 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:38:42 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7076f382-82aa-4765-91d3-750540d96879 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:38:42 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7076f382-82aa-4765-91d3-750540d96879 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:38:42 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[58c226a2-6e71-4e5f-bf70-2c1e867236db]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:38:42 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33db2e0-bc53-4122-9103-cfa431089b9a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:38:42 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7076f382-82aa-4765-91d3-750540d96879 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:38:42 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7076f382-82aa-4765-91d3-750540d96879 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:38:42 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[e480dad6-800e-4f35-bceb-d1421590f163]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:38:42 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33db2e0-bc53-4122-9103-cfa431089b9a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:38:42 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7076f382-82aa-4765-91d3-750540d96879 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vdDptsGK {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:38:42 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] Creating instance directory {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 12:38:42 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] Creating image(s)
Nov 03 12:38:42 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] Did not create local disks {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 03 12:38:42 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] Ensure instance console log exists: /opt/stack/data/nova/instances/27aa03bb-5613-4bde-8bc0-30517f5d48ae/console.log {{(pid=74960) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 12:38:42 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:38:42 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:38:42 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:38:42 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] Start _get_guest_xml network_info=[{"id": "16df3da7-2b2a-4c74-bb06-779696d25b88", "address": "fa:16:3e:2a:35:94", "network": {"id": "4a77f235-def4-4456-8f4a-99bf5769e015", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1480494760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "384450261e1f45048eb9b4b431ce8bd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16df3da7-2b", "ovs_interfaceid": "16df3da7-2b2a-4c74-bb06-779696d25b88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=549f51ba-ac69-494b-8de1-34635aa2d7cf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='63ee9c80c632442fb0379f47b784bd20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T12:13:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'snapNwyo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '27aa03bb-5613-4bde-8bc0-30517f5d48ae', 'attached_at': '', 'detached_at': '', 'volume_id': '0d9b574a-cdd4-4118-a061-dfe393a5cd61', 'serial': '0d9b574a-cdd4-4118-a061-dfe393a5cd61'}, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'device_type': 'disk', 'attachment_id': 'bdfd1426-2091-4f51-ad12-40c427f3d24b', 'boot_index': 0, 'guest_format': None, 'volume_type': None} {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 12:38:42 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 03 12:38:42 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 03 12:38:42 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7076f382-82aa-4765-91d3-750540d96879 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vdDptsGK" returned: 0 in 0.030s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:38:42 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[46dce1d1-7253-4905-9684-98204a38a488]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:38:42 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33db2e0-bc53-4122-9103-cfa431089b9a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vdDptsGK'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:38:42 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7076f382-82aa-4765-91d3-750540d96879 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:38:42 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 12:38:42 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] CPU controller missing on host. {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 12:38:42 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 12:38:42 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] CPU controller found on host. {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 12:38:42 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74960) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 12:38:42 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=549f51ba-ac69-494b-8de1-34635aa2d7cf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='63ee9c80c632442fb0379f47b784bd20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T12:13:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 12:38:42 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Flavor limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 12:38:42 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Image limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 12:38:42 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Flavor pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 12:38:42 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Image pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 12:38:42 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 12:38:42 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 12:38:42 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 12:38:42 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Got 1 possible topologies {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 12:38:42 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 12:38:42 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 12:38:42 user nova-compute[74960]: DEBUG nova.objects.instance [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Lazy-loading 'vcpu_model' on Instance uuid 27aa03bb-5613-4bde-8bc0-30517f5d48ae {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:38:42 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7076f382-82aa-4765-91d3-750540d96879 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:38:42 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[8618627c-790d-45b1-9fc4-71f9c2facfe1]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:38:42 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33db2e0-bc53-4122-9103-cfa431089b9a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:38:42 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] Calling os-brick to attach iSCSI Volume {{(pid=74960) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 12:38:42 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9aa420acb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'snapNwyo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:38:42 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 03 12:38:42 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:38:42 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:38:42 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:38:42 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[a592b349-aa93-42c3-a9ac-2f8c1d28ae3e]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7 (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:38:42 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33db2e0-bc53-4122-9103-cfa431089b9a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:38:42 user nova-compute[74960]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7 (non-flash)
Nov 03 12:38:42 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:38:42 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33db2e0-bc53-4122-9103-cfa431089b9a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:38:42 user nova-compute[74960]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7 (non-flash)
Nov 03 12:38:42 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:38:42 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7076f382-82aa-4765-91d3-750540d96879 -p 172.16.0.220:3260 --login {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:38:42 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7076f382-82aa-4765-91d3-750540d96879 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:38:42 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[dffda5ce-f33e-4c28-b546-689573544067]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7076f382-82aa-4765-91d3-750540d96879, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7076f382-82aa-4765-91d3-750540d96879, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:38:42 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33db2e0-bc53-4122-9103-cfa431089b9a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7076f382-82aa-4765-91d3-750540d96879, portal: 172.16.0.220,3260]
Nov 03 12:38:42 user nova-compute[74960]: Login to [iface: default, target: iqn.2010-10.org.openstack:7076f382-82aa-4765-91d3-750540d96879, portal: 172.16.0.220,3260] successful.
Nov 03 12:38:42 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:38:42 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7076f382-82aa-4765-91d3-750540d96879 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:38:42 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7076f382-82aa-4765-91d3-750540d96879 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:38:42 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[8acf684d-d76e-479a-a554-22cdf23c4d7c]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:38:42 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33db2e0-bc53-4122-9103-cfa431089b9a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:38:42 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:38:42 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:38:42 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a2ab73f-3839-4a6a-b2ed-9728ccefe00f]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7076f382-82aa-4765-91d3-750540d96879 (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:38:42 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33db2e0-bc53-4122-9103-cfa431089b9a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:38:42 user nova-compute[74960]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7 (non-flash)
Nov 03 12:38:42 user nova-compute[74960]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7076f382-82aa-4765-91d3-750540d96879 (non-flash)
Nov 03 12:38:42 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:38:42 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33db2e0-bc53-4122-9103-cfa431089b9a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:38:42 user nova-compute[74960]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7 (non-flash)
Nov 03 12:38:42 user nova-compute[74960]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7076f382-82aa-4765-91d3-750540d96879 (non-flash)
Nov 03 12:38:42 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:38:42 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-d33db2e0-bc53-4122-9103-cfa431089b9a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7076f382-82aa-4765-91d3-750540d96879" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:38:42 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33db2e0-bc53-4122-9103-cfa431089b9a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Connected to 172.16.0.220:3260 {{(pid=74960) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 12:38:42 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-d33db2e0-bc53-4122-9103-cfa431089b9a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] HCTL ('33', '-', '-', 0) found on session 35 with lun 0 {{(pid=74960) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 12:38:42 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-d33db2e0-bc53-4122-9103-cfa431089b9a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74960) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 12:38:42 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:38:42 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:38:42 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f99daa2-5c72-4dbf-a7d8-cd191dc10bb9]: (4, ('- - 0', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:38:42 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-d33db2e0-bc53-4122-9103-cfa431089b9a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Searching for a device in session 35 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74960) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 12:38:42 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33db2e0-bc53-4122-9103-cfa431089b9a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:7076f382-82aa-4765-91d3-750540d96879', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vdDptsGK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74960) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 12:38:43 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-919da236-1b8b-461e-9097-0d558d878459 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Acquiring lock "82215a04-bd79-4f72-b375-dc73ff9a8654" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:38:43 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-919da236-1b8b-461e-9097-0d558d878459 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Lock "82215a04-bd79-4f72-b375-dc73ff9a8654" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:38:43 user nova-compute[74960]: DEBUG nova.compute.manager [None req-919da236-1b8b-461e-9097-0d558d878459 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] [instance: 82215a04-bd79-4f72-b375-dc73ff9a8654] Starting instance... {{(pid=74960) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 12:38:43 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-919da236-1b8b-461e-9097-0d558d878459 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:38:43 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-919da236-1b8b-461e-9097-0d558d878459 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:38:43 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-919da236-1b8b-461e-9097-0d558d878459 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74960) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 12:38:43 user nova-compute[74960]: INFO nova.compute.claims [None req-919da236-1b8b-461e-9097-0d558d878459 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] [instance: 82215a04-bd79-4f72-b375-dc73ff9a8654] Claim successful on node user
Nov 03 12:38:43 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-919da236-1b8b-461e-9097-0d558d878459 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:38:43 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-919da236-1b8b-461e-9097-0d558d878459 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:38:43 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-919da236-1b8b-461e-9097-0d558d878459 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.420s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:38:43 user nova-compute[74960]: DEBUG nova.compute.manager [None req-919da236-1b8b-461e-9097-0d558d878459 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] [instance: 82215a04-bd79-4f72-b375-dc73ff9a8654] Start building networks asynchronously for instance. {{(pid=74960) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 12:38:43 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-d33db2e0-bc53-4122-9103-cfa431089b9a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:38:43 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33db2e0-bc53-4122-9103-cfa431089b9a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] <== connect_volume: return (1349ms) {'type': 'block', 'scsi_wwn': '23735393434363333', 'path': '/dev/sdb'} {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:38:43 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d33db2e0-bc53-4122-9103-cfa431089b9a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23735393434363333', 'path': '/dev/sdb'} {{(pid=74960) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 12:38:43 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.147s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:38:43 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 03 12:38:43 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:38:43 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:38:43 user nova-compute[74960]: INFO os_brick.initiator.connectors.iscsi [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 12:38:43 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61 -p 172.16.0.220:3260 {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:38:43 user nova-compute[74960]: DEBUG nova.objects.instance [None req-d33db2e0-bc53-4122-9103-cfa431089b9a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Lazy-loading 'flavor' on Instance uuid 35e02c80-f626-4918-93f1-6b9a7f778c7a {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:38:43 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:38:43 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7379ea2-02a6-4ce3-b72a-e865ca49bcac]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:38:43 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 12:38:43 user nova-compute[74960]:  {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:38:43 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61 -p 172.16.0.220:3260 --interface default --op new {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:38:43 user nova-compute[74960]: DEBUG nova.virt.libvirt.guest [None req-d33db2e0-bc53-4122-9103-cfa431089b9a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] attach device xml: <disk type="block" device="disk">
Nov 03 12:38:43 user nova-compute[74960]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 12:38:43 user nova-compute[74960]:   <source dev="/dev/sdb"/>
Nov 03 12:38:43 user nova-compute[74960]:   <target dev="vdb" bus="virtio"/>
Nov 03 12:38:43 user nova-compute[74960]:   <serial>7076f382-82aa-4765-91d3-750540d96879</serial>
Nov 03 12:38:43 user nova-compute[74960]: </disk>
Nov 03 12:38:43 user nova-compute[74960]:  {{(pid=74960) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 03 12:38:43 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.138s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:38:43 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[36d87232-2748-4087-8a0c-19b602b02def]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61] added\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:38:43 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61] added
Nov 03 12:38:43 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:38:43 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:38:44 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.114s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:38:44 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd69d66e-bd25-4ab2-9849-9c74d8e60c4d]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:38:44 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:38:44 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:38:44 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:38:44 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc2479a5-716a-4c34-8464-917f3530475b]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:38:44 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:38:44 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v snapNwyo {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:38:44 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v snapNwyo" returned: 0 in 0.021s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:38:44 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[971cf697-933e-480c-8a5e-157b3b8e7613]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:38:44 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'snapNwyo'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:38:44 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:38:44 user nova-compute[74960]: DEBUG nova.compute.manager [None req-919da236-1b8b-461e-9097-0d558d878459 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] [instance: 82215a04-bd79-4f72-b375-dc73ff9a8654] Allocating IP information in the background. {{(pid=74960) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 12:38:44 user nova-compute[74960]: DEBUG nova.network.neutron [None req-919da236-1b8b-461e-9097-0d558d878459 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] [instance: 82215a04-bd79-4f72-b375-dc73ff9a8654] allocate_for_instance() {{(pid=74960) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 12:38:44 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-919da236-1b8b-461e-9097-0d558d878459 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] [instance: 82215a04-bd79-4f72-b375-dc73ff9a8654] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 12:38:44 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:38:44 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3e3ce6d-c7d4-4721-8dc2-eb972610c3b3]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:38:44 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:38:44 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:38:44 user nova-compute[74960]: DEBUG nova.compute.manager [None req-919da236-1b8b-461e-9097-0d558d878459 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] [instance: 82215a04-bd79-4f72-b375-dc73ff9a8654] Start building block device mappings for instance. {{(pid=74960) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 12:38:44 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:38:44 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2fdea69-73aa-4746-a75b-ac9cb38a09f4]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7076f382-82aa-4765-91d3-750540d96879 (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:38:44 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:38:44 user nova-compute[74960]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7 (non-flash)
Nov 03 12:38:44 user nova-compute[74960]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7076f382-82aa-4765-91d3-750540d96879 (non-flash)
Nov 03 12:38:44 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:38:44 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:38:44 user nova-compute[74960]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7 (non-flash)
Nov 03 12:38:44 user nova-compute[74960]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7076f382-82aa-4765-91d3-750540d96879 (non-flash)
Nov 03 12:38:44 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:38:44 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61 -p 172.16.0.220:3260 --login {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:38:44 user nova-compute[74960]: DEBUG nova.policy [None req-919da236-1b8b-461e-9097-0d558d878459 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5b5fbd2703e241afb720be4680301751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa134687c74460fb5a59dd3ddece671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74960) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 12:38:44 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:38:44 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[63e06893-0c4f-423d-a8df-d1abf6449246]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:38:44 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61, portal: 172.16.0.220,3260]
Nov 03 12:38:44 user nova-compute[74960]: Login to [iface: default, target: iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61, portal: 172.16.0.220,3260] successful.
Nov 03 12:38:44 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:38:44 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:38:44 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:38:44 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[11fee66f-2027-4247-9a46-f7b1bd4bfeb4]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:38:44 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:38:44 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:38:44 user nova-compute[74960]: DEBUG nova.compute.manager [None req-919da236-1b8b-461e-9097-0d558d878459 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] [instance: 82215a04-bd79-4f72-b375-dc73ff9a8654] Start spawning the instance on the hypervisor. {{(pid=74960) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 12:38:44 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-919da236-1b8b-461e-9097-0d558d878459 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] [instance: 82215a04-bd79-4f72-b375-dc73ff9a8654] Creating instance directory {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 12:38:44 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-919da236-1b8b-461e-9097-0d558d878459 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] [instance: 82215a04-bd79-4f72-b375-dc73ff9a8654] Creating image(s)
Nov 03 12:38:44 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-919da236-1b8b-461e-9097-0d558d878459 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Acquiring lock "/opt/stack/data/nova/instances/82215a04-bd79-4f72-b375-dc73ff9a8654/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:38:44 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-919da236-1b8b-461e-9097-0d558d878459 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Lock "/opt/stack/data/nova/instances/82215a04-bd79-4f72-b375-dc73ff9a8654/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:38:44 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-919da236-1b8b-461e-9097-0d558d878459 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Lock "/opt/stack/data/nova/instances/82215a04-bd79-4f72-b375-dc73ff9a8654/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:38:44 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:38:44 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc74c3f7-f8a3-492c-82a0-3a1a0881417b]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7076f382-82aa-4765-91d3-750540d96879 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61 (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:38:44 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:38:44 user nova-compute[74960]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7 (non-flash)
Nov 03 12:38:44 user nova-compute[74960]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7076f382-82aa-4765-91d3-750540d96879 (non-flash)
Nov 03 12:38:44 user nova-compute[74960]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61 (non-flash)
Nov 03 12:38:44 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:38:44 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:38:44 user nova-compute[74960]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7 (non-flash)
Nov 03 12:38:44 user nova-compute[74960]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7076f382-82aa-4765-91d3-750540d96879 (non-flash)
Nov 03 12:38:44 user nova-compute[74960]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61 (non-flash)
Nov 03 12:38:44 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:38:44 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.561s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:38:44 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Connected to 172.16.0.220:3260 {{(pid=74960) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 12:38:44 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] HCTL ('34', '-', '-', 0) found on session 36 with lun 0 {{(pid=74960) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 12:38:44 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74960) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 12:38:44 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-919da236-1b8b-461e-9097-0d558d878459 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:38:44 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:38:44 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:38:44 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebae3a03-8448-4a56-90b5-9d513a2759a2]: (4, ('- - 0', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:38:44 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Searching for a device in session 36 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74960) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 12:38:44 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'snapNwyo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74960) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 12:38:44 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-d33db2e0-bc53-4122-9103-cfa431089b9a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] No BDM found with device name vda, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:38:44 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-d33db2e0-bc53-4122-9103-cfa431089b9a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:38:44 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-d33db2e0-bc53-4122-9103-cfa431089b9a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] No VIF found with MAC fa:16:3e:26:d9:9a, not building metadata {{(pid=74960) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 12:38:44 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-919da236-1b8b-461e-9097-0d558d878459 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.197s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:38:44 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-919da236-1b8b-461e-9097-0d558d878459 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Acquiring lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:38:44 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-919da236-1b8b-461e-9097-0d558d878459 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:38:44 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-919da236-1b8b-461e-9097-0d558d878459 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:38:44 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-d33db2e0-bc53-4122-9103-cfa431089b9a tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Lock "35e02c80-f626-4918-93f1-6b9a7f778c7a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 38.776s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:38:44 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-919da236-1b8b-461e-9097-0d558d878459 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.203s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:38:44 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-919da236-1b8b-461e-9097-0d558d878459 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910,backing_fmt=raw /opt/stack/data/nova/instances/82215a04-bd79-4f72-b375-dc73ff9a8654/disk 1073741824 {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:38:44 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-919da236-1b8b-461e-9097-0d558d878459 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910,backing_fmt=raw /opt/stack/data/nova/instances/82215a04-bd79-4f72-b375-dc73ff9a8654/disk 1073741824" returned: 0 in 0.060s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:38:44 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-919da236-1b8b-461e-9097-0d558d878459 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.276s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:38:44 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-919da236-1b8b-461e-9097-0d558d878459 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:38:44 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-919da236-1b8b-461e-9097-0d558d878459 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.174s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:38:44 user nova-compute[74960]: DEBUG nova.virt.disk.api [None req-919da236-1b8b-461e-9097-0d558d878459 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Checking if we can resize image /opt/stack/data/nova/instances/82215a04-bd79-4f72-b375-dc73ff9a8654/disk. size=1073741824 {{(pid=74960) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 12:38:44 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-919da236-1b8b-461e-9097-0d558d878459 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82215a04-bd79-4f72-b375-dc73ff9a8654/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:38:45 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-919da236-1b8b-461e-9097-0d558d878459 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82215a04-bd79-4f72-b375-dc73ff9a8654/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:38:45 user nova-compute[74960]: DEBUG nova.virt.disk.api [None req-919da236-1b8b-461e-9097-0d558d878459 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Cannot resize image /opt/stack/data/nova/instances/82215a04-bd79-4f72-b375-dc73ff9a8654/disk to a smaller size. {{(pid=74960) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 12:38:45 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-919da236-1b8b-461e-9097-0d558d878459 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] [instance: 82215a04-bd79-4f72-b375-dc73ff9a8654] Created local disks {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 12:38:45 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-919da236-1b8b-461e-9097-0d558d878459 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] [instance: 82215a04-bd79-4f72-b375-dc73ff9a8654] Ensure instance console log exists: /opt/stack/data/nova/instances/82215a04-bd79-4f72-b375-dc73ff9a8654/console.log {{(pid=74960) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 12:38:45 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-919da236-1b8b-461e-9097-0d558d878459 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:38:45 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-919da236-1b8b-461e-9097-0d558d878459 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:38:45 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-919da236-1b8b-461e-9097-0d558d878459 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:38:45 user nova-compute[74960]: DEBUG nova.network.neutron [None req-919da236-1b8b-461e-9097-0d558d878459 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] [instance: 82215a04-bd79-4f72-b375-dc73ff9a8654] Successfully created port: 36091714-1f02-4ac1-9dc7-feef6712069d {{(pid=74960) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 12:38:45 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.627s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:38:45 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] <== connect_volume: return (2775ms) {'type': 'block', 'scsi_wwn': '23934663164333132', 'path': '/dev/sdc'} {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:38:45 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23934663164333132', 'path': '/dev/sdc'} {{(pid=74960) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 12:38:45 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-03T12:35:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-84564102',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1532854274',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBYDYy6Yd4oTzqRmBgqOf0CT+Ul+2zedFmBjf4dct/ZgF3BtxBCHh2RqZpmfNUQqxXAXGv7pJgRz8+RxPwCi1ZxZq5Sw+Pludb9D/l5gQkHYcqClTVAMzGUWUIaG18LSIg==',key_name='tempest-keypair-807064414',keypairs=<?>,launch_index=0,launched_at=2023-11-03T12:35:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='384450261e1f45048eb9b4b431ce8bd5',ramdisk_id='',reservation_id='r-e40nqd7j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-999594459',owner_user_name='tempest-ServerActionsV293TestJSON-999594459-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:37:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2a983db9b51c44938095b72874dddcf9',uuid=27aa03bb-5613-4bde-8bc0-30517f5d48ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "16df3da7-2b2a-4c74-bb06-779696d25b88", "address": "fa:16:3e:2a:35:94", "network": {"id": "4a77f235-def4-4456-8f4a-99bf5769e015", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1480494760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "384450261e1f45048eb9b4b431ce8bd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16df3da7-2b", "ovs_interfaceid": "16df3da7-2b2a-4c74-bb06-779696d25b88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74960) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 12:38:45 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Converting VIF {"id": "16df3da7-2b2a-4c74-bb06-779696d25b88", "address": "fa:16:3e:2a:35:94", "network": {"id": "4a77f235-def4-4456-8f4a-99bf5769e015", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1480494760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "384450261e1f45048eb9b4b431ce8bd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16df3da7-2b", "ovs_interfaceid": "16df3da7-2b2a-4c74-bb06-779696d25b88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:38:45 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2a:35:94,bridge_name='br-int',has_traffic_filtering=True,id=16df3da7-2b2a-4c74-bb06-779696d25b88,network=Network(4a77f235-def4-4456-8f4a-99bf5769e015),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16df3da7-2b') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:38:45 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] End _get_guest_xml xml=<domain type="kvm">
Nov 03 12:38:45 user nova-compute[74960]:   <uuid>27aa03bb-5613-4bde-8bc0-30517f5d48ae</uuid>
Nov 03 12:38:45 user nova-compute[74960]:   <name>instance-00000024</name>
Nov 03 12:38:45 user nova-compute[74960]:   <memory>524288</memory>
Nov 03 12:38:45 user nova-compute[74960]:   <vcpu>1</vcpu>
Nov 03 12:38:45 user nova-compute[74960]:   <metadata>
Nov 03 12:38:45 user nova-compute[74960]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 12:38:45 user nova-compute[74960]:       <nova:package version="0.0.0"/>
Nov 03 12:38:45 user nova-compute[74960]:       <nova:name>tempest-ServerActionsV293TestJSON-server-84564102</nova:name>
Nov 03 12:38:45 user nova-compute[74960]:       <nova:creationTime>2023-11-03 12:38:42</nova:creationTime>
Nov 03 12:38:45 user nova-compute[74960]:       <nova:flavor name="m1.tiny">
Nov 03 12:38:45 user nova-compute[74960]:         <nova:memory>512</nova:memory>
Nov 03 12:38:45 user nova-compute[74960]:         <nova:disk>1</nova:disk>
Nov 03 12:38:45 user nova-compute[74960]:         <nova:swap>0</nova:swap>
Nov 03 12:38:45 user nova-compute[74960]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 12:38:45 user nova-compute[74960]:         <nova:vcpus>1</nova:vcpus>
Nov 03 12:38:45 user nova-compute[74960]:       </nova:flavor>
Nov 03 12:38:45 user nova-compute[74960]:       <nova:owner>
Nov 03 12:38:45 user nova-compute[74960]:         <nova:user uuid="2a983db9b51c44938095b72874dddcf9">tempest-ServerActionsV293TestJSON-999594459-project-member</nova:user>
Nov 03 12:38:45 user nova-compute[74960]:         <nova:project uuid="384450261e1f45048eb9b4b431ce8bd5">tempest-ServerActionsV293TestJSON-999594459</nova:project>
Nov 03 12:38:45 user nova-compute[74960]:       </nova:owner>
Nov 03 12:38:45 user nova-compute[74960]:       <nova:ports>
Nov 03 12:38:45 user nova-compute[74960]:         <nova:port uuid="16df3da7-2b2a-4c74-bb06-779696d25b88">
Nov 03 12:38:45 user nova-compute[74960]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 03 12:38:45 user nova-compute[74960]:         </nova:port>
Nov 03 12:38:45 user nova-compute[74960]:       </nova:ports>
Nov 03 12:38:45 user nova-compute[74960]:     </nova:instance>
Nov 03 12:38:45 user nova-compute[74960]:   </metadata>
Nov 03 12:38:45 user nova-compute[74960]:   <sysinfo type="smbios">
Nov 03 12:38:45 user nova-compute[74960]:     <system>
Nov 03 12:38:45 user nova-compute[74960]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 12:38:45 user nova-compute[74960]:       <entry name="product">OpenStack Nova</entry>
Nov 03 12:38:45 user nova-compute[74960]:       <entry name="version">0.0.0</entry>
Nov 03 12:38:45 user nova-compute[74960]:       <entry name="serial">27aa03bb-5613-4bde-8bc0-30517f5d48ae</entry>
Nov 03 12:38:45 user nova-compute[74960]:       <entry name="uuid">27aa03bb-5613-4bde-8bc0-30517f5d48ae</entry>
Nov 03 12:38:45 user nova-compute[74960]:       <entry name="family">Virtual Machine</entry>
Nov 03 12:38:45 user nova-compute[74960]:     </system>
Nov 03 12:38:45 user nova-compute[74960]:   </sysinfo>
Nov 03 12:38:45 user nova-compute[74960]:   <os>
Nov 03 12:38:45 user nova-compute[74960]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 12:38:45 user nova-compute[74960]:     <boot dev="hd"/>
Nov 03 12:38:45 user nova-compute[74960]:     <smbios mode="sysinfo"/>
Nov 03 12:38:45 user nova-compute[74960]:   </os>
Nov 03 12:38:45 user nova-compute[74960]:   <features>
Nov 03 12:38:45 user nova-compute[74960]:     <acpi/>
Nov 03 12:38:45 user nova-compute[74960]:     <apic/>
Nov 03 12:38:45 user nova-compute[74960]:     <vmcoreinfo/>
Nov 03 12:38:45 user nova-compute[74960]:   </features>
Nov 03 12:38:45 user nova-compute[74960]:   <clock offset="utc">
Nov 03 12:38:45 user nova-compute[74960]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 12:38:45 user nova-compute[74960]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 12:38:45 user nova-compute[74960]:     <timer name="hpet" present="no"/>
Nov 03 12:38:45 user nova-compute[74960]:   </clock>
Nov 03 12:38:45 user nova-compute[74960]:   <cpu mode="custom" match="exact">
Nov 03 12:38:45 user nova-compute[74960]:     <model>Nehalem</model>
Nov 03 12:38:45 user nova-compute[74960]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 12:38:45 user nova-compute[74960]:   </cpu>
Nov 03 12:38:45 user nova-compute[74960]:   <devices>
Nov 03 12:38:45 user nova-compute[74960]:     <disk type="block" device="disk">
Nov 03 12:38:45 user nova-compute[74960]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 12:38:45 user nova-compute[74960]:       <source dev="/dev/sdc"/>
Nov 03 12:38:45 user nova-compute[74960]:       <target dev="vda" bus="virtio"/>
Nov 03 12:38:45 user nova-compute[74960]:       <serial>0d9b574a-cdd4-4118-a061-dfe393a5cd61</serial>
Nov 03 12:38:45 user nova-compute[74960]:     </disk>
Nov 03 12:38:45 user nova-compute[74960]:     <interface type="ethernet">
Nov 03 12:38:45 user nova-compute[74960]:       <mac address="fa:16:3e:2a:35:94"/>
Nov 03 12:38:45 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:38:45 user nova-compute[74960]:       <mtu size="1442"/>
Nov 03 12:38:45 user nova-compute[74960]:       <target dev="tap16df3da7-2b"/>
Nov 03 12:38:45 user nova-compute[74960]:     </interface>
Nov 03 12:38:45 user nova-compute[74960]:     <serial type="pty">
Nov 03 12:38:45 user nova-compute[74960]:       <log file="/opt/stack/data/nova/instances/27aa03bb-5613-4bde-8bc0-30517f5d48ae/console.log" append="off"/>
Nov 03 12:38:45 user nova-compute[74960]:     </serial>
Nov 03 12:38:45 user nova-compute[74960]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 12:38:45 user nova-compute[74960]:     <video>
Nov 03 12:38:45 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:38:45 user nova-compute[74960]:     </video>
Nov 03 12:38:45 user nova-compute[74960]:     <rng model="virtio">
Nov 03 12:38:45 user nova-compute[74960]:       <backend model="random">/dev/urandom</backend>
Nov 03 12:38:45 user nova-compute[74960]:     </rng>
Nov 03 12:38:45 user nova-compute[74960]:     <controller type="usb" index="0" model="none"/>
Nov 03 12:38:45 user nova-compute[74960]:     <memballoon model="virtio">
Nov 03 12:38:45 user nova-compute[74960]:       <stats period="10"/>
Nov 03 12:38:45 user nova-compute[74960]:     </memballoon>
Nov 03 12:38:45 user nova-compute[74960]:   </devices>
Nov 03 12:38:45 user nova-compute[74960]: </domain>
Nov 03 12:38:45 user nova-compute[74960]:  {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 12:38:45 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-03T12:35:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-84564102',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1532854274',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBYDYy6Yd4oTzqRmBgqOf0CT+Ul+2zedFmBjf4dct/ZgF3BtxBCHh2RqZpmfNUQqxXAXGv7pJgRz8+RxPwCi1ZxZq5Sw+Pludb9D/l5gQkHYcqClTVAMzGUWUIaG18LSIg==',key_name='tempest-keypair-807064414',keypairs=<?>,launch_index=0,launched_at=2023-11-03T12:35:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='384450261e1f45048eb9b4b431ce8bd5',ramdisk_id='',reservation_id='r-e40nqd7j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-999594459',owner_user_name='tempest-ServerActionsV293TestJSON-999594459-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:37:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2a983db9b51c44938095b72874dddcf9',uuid=27aa03bb-5613-4bde-8bc0-30517f5d48ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "16df3da7-2b2a-4c74-bb06-779696d25b88", "address": "fa:16:3e:2a:35:94", "network": {"id": "4a77f235-def4-4456-8f4a-99bf5769e015", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1480494760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "384450261e1f45048eb9b4b431ce8bd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16df3da7-2b", "ovs_interfaceid": "16df3da7-2b2a-4c74-bb06-779696d25b88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 12:38:45 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Converting VIF {"id": "16df3da7-2b2a-4c74-bb06-779696d25b88", "address": "fa:16:3e:2a:35:94", "network": {"id": "4a77f235-def4-4456-8f4a-99bf5769e015", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1480494760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "384450261e1f45048eb9b4b431ce8bd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16df3da7-2b", "ovs_interfaceid": "16df3da7-2b2a-4c74-bb06-779696d25b88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:38:45 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2a:35:94,bridge_name='br-int',has_traffic_filtering=True,id=16df3da7-2b2a-4c74-bb06-779696d25b88,network=Network(4a77f235-def4-4456-8f4a-99bf5769e015),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16df3da7-2b') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:38:45 user nova-compute[74960]: DEBUG os_vif [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:35:94,bridge_name='br-int',has_traffic_filtering=True,id=16df3da7-2b2a-4c74-bb06-779696d25b88,network=Network(4a77f235-def4-4456-8f4a-99bf5769e015),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16df3da7-2b') {{(pid=74960) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 12:38:45 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:38:45 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:38:45 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 12:38:45 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:38:45 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2bb913de-119f-504b-a7ca-c18744eb0050', '_type': 'linux-noop'}}, row=False) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:38:45 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:38:45 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:38:45 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:38:45 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:38:45 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap16df3da7-2b, may_exist=True, interface_attrs={}) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:38:45 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap16df3da7-2b, col_values=(('qos', UUID('28c7c272-3920-494c-80e6-a0cb1c980473')),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:38:45 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap16df3da7-2b, col_values=(('external_ids', {'iface-id': '16df3da7-2b2a-4c74-bb06-779696d25b88', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2a:35:94', 'vm-uuid': '27aa03bb-5613-4bde-8bc0-30517f5d48ae'}),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:38:45 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:38:45 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:38:45 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:38:45 user nova-compute[74960]: INFO os_vif [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:35:94,bridge_name='br-int',has_traffic_filtering=True,id=16df3da7-2b2a-4c74-bb06-779696d25b88,network=Network(4a77f235-def4-4456-8f4a-99bf5769e015),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16df3da7-2b')
Nov 03 12:38:45 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] No BDM found with device name vda, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:38:45 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] No VIF found with MAC fa:16:3e:2a:35:94, not building metadata {{(pid=74960) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 12:38:45 user nova-compute[74960]: INFO nova.compute.manager [None req-3322a92b-f88f-4de4-a300-f716d5a69a36 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67] Unrescuing
Nov 03 12:38:45 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-3322a92b-f88f-4de4-a300-f716d5a69a36 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Acquiring lock "refresh_cache-47eb8ddf-590f-4ffa-87c8-377cf1ee0f67" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:38:45 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-3322a92b-f88f-4de4-a300-f716d5a69a36 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Acquired lock "refresh_cache-47eb8ddf-590f-4ffa-87c8-377cf1ee0f67" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:38:45 user nova-compute[74960]: DEBUG nova.network.neutron [None req-3322a92b-f88f-4de4-a300-f716d5a69a36 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67] Building network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 12:38:46 user nova-compute[74960]: DEBUG nova.network.neutron [None req-919da236-1b8b-461e-9097-0d558d878459 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] [instance: 82215a04-bd79-4f72-b375-dc73ff9a8654] Successfully updated port: 36091714-1f02-4ac1-9dc7-feef6712069d {{(pid=74960) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 12:38:46 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-919da236-1b8b-461e-9097-0d558d878459 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Acquiring lock "refresh_cache-82215a04-bd79-4f72-b375-dc73ff9a8654" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:38:46 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-919da236-1b8b-461e-9097-0d558d878459 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Acquired lock "refresh_cache-82215a04-bd79-4f72-b375-dc73ff9a8654" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:38:46 user nova-compute[74960]: DEBUG nova.network.neutron [None req-919da236-1b8b-461e-9097-0d558d878459 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] [instance: 82215a04-bd79-4f72-b375-dc73ff9a8654] Building network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 12:38:46 user nova-compute[74960]: DEBUG nova.compute.manager [req-ad06fd32-a1d8-4d92-9dfd-ec29a4624c9a req-7d98a21e-e45f-49c9-b54e-f4f66e7b8340 service nova] [instance: 82215a04-bd79-4f72-b375-dc73ff9a8654] Received event network-changed-36091714-1f02-4ac1-9dc7-feef6712069d {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:38:46 user nova-compute[74960]: DEBUG nova.compute.manager [req-ad06fd32-a1d8-4d92-9dfd-ec29a4624c9a req-7d98a21e-e45f-49c9-b54e-f4f66e7b8340 service nova] [instance: 82215a04-bd79-4f72-b375-dc73ff9a8654] Refreshing instance network info cache due to event network-changed-36091714-1f02-4ac1-9dc7-feef6712069d. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 12:38:46 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-ad06fd32-a1d8-4d92-9dfd-ec29a4624c9a req-7d98a21e-e45f-49c9-b54e-f4f66e7b8340 service nova] Acquiring lock "refresh_cache-82215a04-bd79-4f72-b375-dc73ff9a8654" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:38:46 user nova-compute[74960]: DEBUG nova.network.neutron [None req-919da236-1b8b-461e-9097-0d558d878459 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] [instance: 82215a04-bd79-4f72-b375-dc73ff9a8654] Instance cache missing network info. {{(pid=74960) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 12:38:46 user nova-compute[74960]: DEBUG nova.network.neutron [None req-919da236-1b8b-461e-9097-0d558d878459 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] [instance: 82215a04-bd79-4f72-b375-dc73ff9a8654] Updating instance_info_cache with network_info: [{"id": "36091714-1f02-4ac1-9dc7-feef6712069d", "address": "fa:16:3e:db:fa:06", "network": {"id": "82ebe97c-a056-4ac2-9644-ea315bf9a4b1", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1024050438-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efa134687c74460fb5a59dd3ddece671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36091714-1f", "ovs_interfaceid": "36091714-1f02-4ac1-9dc7-feef6712069d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:38:46 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-919da236-1b8b-461e-9097-0d558d878459 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Releasing lock "refresh_cache-82215a04-bd79-4f72-b375-dc73ff9a8654" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:38:46 user nova-compute[74960]: DEBUG nova.compute.manager [None req-919da236-1b8b-461e-9097-0d558d878459 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] [instance: 82215a04-bd79-4f72-b375-dc73ff9a8654] Instance network_info: |[{"id": "36091714-1f02-4ac1-9dc7-feef6712069d", "address": "fa:16:3e:db:fa:06", "network": {"id": "82ebe97c-a056-4ac2-9644-ea315bf9a4b1", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1024050438-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efa134687c74460fb5a59dd3ddece671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36091714-1f", "ovs_interfaceid": "36091714-1f02-4ac1-9dc7-feef6712069d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74960) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 12:38:46 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-ad06fd32-a1d8-4d92-9dfd-ec29a4624c9a req-7d98a21e-e45f-49c9-b54e-f4f66e7b8340 service nova] Acquired lock "refresh_cache-82215a04-bd79-4f72-b375-dc73ff9a8654" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:38:46 user nova-compute[74960]: DEBUG nova.network.neutron [req-ad06fd32-a1d8-4d92-9dfd-ec29a4624c9a req-7d98a21e-e45f-49c9-b54e-f4f66e7b8340 service nova] [instance: 82215a04-bd79-4f72-b375-dc73ff9a8654] Refreshing network info cache for port 36091714-1f02-4ac1-9dc7-feef6712069d {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 12:38:46 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-919da236-1b8b-461e-9097-0d558d878459 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] [instance: 82215a04-bd79-4f72-b375-dc73ff9a8654] Start _get_guest_xml network_info=[{"id": "36091714-1f02-4ac1-9dc7-feef6712069d", "address": "fa:16:3e:db:fa:06", "network": {"id": "82ebe97c-a056-4ac2-9644-ea315bf9a4b1", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1024050438-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efa134687c74460fb5a59dd3ddece671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36091714-1f", "ovs_interfaceid": "36091714-1f02-4ac1-9dc7-feef6712069d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=549f51ba-ac69-494b-8de1-34635aa2d7cf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='63ee9c80c632442fb0379f47b784bd20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T12:13:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'image_id': '549f51ba-ac69-494b-8de1-34635aa2d7cf'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 12:38:46 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-919da236-1b8b-461e-9097-0d558d878459 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:38:46 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-919da236-1b8b-461e-9097-0d558d878459 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:38:46 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-919da236-1b8b-461e-9097-0d558d878459 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 12:38:46 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-919da236-1b8b-461e-9097-0d558d878459 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] CPU controller missing on host. {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 12:38:46 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-919da236-1b8b-461e-9097-0d558d878459 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 12:38:46 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-919da236-1b8b-461e-9097-0d558d878459 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] CPU controller found on host. {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 12:38:46 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-919da236-1b8b-461e-9097-0d558d878459 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74960) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 12:38:46 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-919da236-1b8b-461e-9097-0d558d878459 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=549f51ba-ac69-494b-8de1-34635aa2d7cf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='63ee9c80c632442fb0379f47b784bd20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T12:13:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 12:38:46 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-919da236-1b8b-461e-9097-0d558d878459 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Flavor limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 12:38:46 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-919da236-1b8b-461e-9097-0d558d878459 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Image limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 12:38:46 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-919da236-1b8b-461e-9097-0d558d878459 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Flavor pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 12:38:46 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-919da236-1b8b-461e-9097-0d558d878459 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Image pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 12:38:46 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-919da236-1b8b-461e-9097-0d558d878459 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 12:38:46 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-919da236-1b8b-461e-9097-0d558d878459 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 12:38:46 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-919da236-1b8b-461e-9097-0d558d878459 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 12:38:46 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-919da236-1b8b-461e-9097-0d558d878459 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Got 1 possible topologies {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 12:38:46 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-919da236-1b8b-461e-9097-0d558d878459 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 12:38:46 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-919da236-1b8b-461e-9097-0d558d878459 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 12:38:46 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-919da236-1b8b-461e-9097-0d558d878459 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:38:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1380868338',display_name='tempest-VolumesSnapshotTestJSON-instance-1380868338',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1380868338',id=38,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBACWxJR0ckRMqLDYUfUZ9YuBoMi30N9o8VsC9qflYY+6dmmkHg1RehuYW7/skC4dLIM7wACaDErdibGdY9+VEoJmBPcZ4UR8DLqQ+1vAU6Qi5aa1nq2PwNvPd+N0CvE5Xw==',key_name='tempest-keypair-2117237715',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='efa134687c74460fb5a59dd3ddece671',ramdisk_id='',reservation_id='r-dh4x0wok',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1639372533',owner_user_name='tempest-VolumesSnapshotTestJSON-1639372533-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:38:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b5fbd2703e241afb720be4680301751',uuid=82215a04-bd79-4f72-b375-dc73ff9a8654,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "36091714-1f02-4ac1-9dc7-feef6712069d", "address": "fa:16:3e:db:fa:06", "network": {"id": "82ebe97c-a056-4ac2-9644-ea315bf9a4b1", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1024050438-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efa134687c74460fb5a59dd3ddece671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36091714-1f", "ovs_interfaceid": "36091714-1f02-4ac1-9dc7-feef6712069d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74960) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 12:38:46 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-919da236-1b8b-461e-9097-0d558d878459 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Converting VIF {"id": "36091714-1f02-4ac1-9dc7-feef6712069d", "address": "fa:16:3e:db:fa:06", "network": {"id": "82ebe97c-a056-4ac2-9644-ea315bf9a4b1", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1024050438-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efa134687c74460fb5a59dd3ddece671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36091714-1f", "ovs_interfaceid": "36091714-1f02-4ac1-9dc7-feef6712069d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:38:46 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-919da236-1b8b-461e-9097-0d558d878459 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:fa:06,bridge_name='br-int',has_traffic_filtering=True,id=36091714-1f02-4ac1-9dc7-feef6712069d,network=Network(82ebe97c-a056-4ac2-9644-ea315bf9a4b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36091714-1f') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:38:46 user nova-compute[74960]: DEBUG nova.objects.instance [None req-919da236-1b8b-461e-9097-0d558d878459 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Lazy-loading 'pci_devices' on Instance uuid 82215a04-bd79-4f72-b375-dc73ff9a8654 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:38:46 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-919da236-1b8b-461e-9097-0d558d878459 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] [instance: 82215a04-bd79-4f72-b375-dc73ff9a8654] End _get_guest_xml xml=<domain type="kvm">
Nov 03 12:38:46 user nova-compute[74960]:   <uuid>82215a04-bd79-4f72-b375-dc73ff9a8654</uuid>
Nov 03 12:38:46 user nova-compute[74960]:   <name>instance-00000026</name>
Nov 03 12:38:46 user nova-compute[74960]:   <memory>524288</memory>
Nov 03 12:38:46 user nova-compute[74960]:   <vcpu>1</vcpu>
Nov 03 12:38:46 user nova-compute[74960]:   <metadata>
Nov 03 12:38:46 user nova-compute[74960]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 12:38:46 user nova-compute[74960]:       <nova:package version="0.0.0"/>
Nov 03 12:38:46 user nova-compute[74960]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1380868338</nova:name>
Nov 03 12:38:46 user nova-compute[74960]:       <nova:creationTime>2023-11-03 12:38:46</nova:creationTime>
Nov 03 12:38:46 user nova-compute[74960]:       <nova:flavor name="m1.tiny">
Nov 03 12:38:46 user nova-compute[74960]:         <nova:memory>512</nova:memory>
Nov 03 12:38:46 user nova-compute[74960]:         <nova:disk>1</nova:disk>
Nov 03 12:38:46 user nova-compute[74960]:         <nova:swap>0</nova:swap>
Nov 03 12:38:46 user nova-compute[74960]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 12:38:46 user nova-compute[74960]:         <nova:vcpus>1</nova:vcpus>
Nov 03 12:38:46 user nova-compute[74960]:       </nova:flavor>
Nov 03 12:38:46 user nova-compute[74960]:       <nova:owner>
Nov 03 12:38:46 user nova-compute[74960]:         <nova:user uuid="5b5fbd2703e241afb720be4680301751">tempest-VolumesSnapshotTestJSON-1639372533-project-member</nova:user>
Nov 03 12:38:46 user nova-compute[74960]:         <nova:project uuid="efa134687c74460fb5a59dd3ddece671">tempest-VolumesSnapshotTestJSON-1639372533</nova:project>
Nov 03 12:38:46 user nova-compute[74960]:       </nova:owner>
Nov 03 12:38:46 user nova-compute[74960]:       <nova:root type="image" uuid="549f51ba-ac69-494b-8de1-34635aa2d7cf"/>
Nov 03 12:38:46 user nova-compute[74960]:       <nova:ports>
Nov 03 12:38:46 user nova-compute[74960]:         <nova:port uuid="36091714-1f02-4ac1-9dc7-feef6712069d">
Nov 03 12:38:46 user nova-compute[74960]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 03 12:38:46 user nova-compute[74960]:         </nova:port>
Nov 03 12:38:46 user nova-compute[74960]:       </nova:ports>
Nov 03 12:38:46 user nova-compute[74960]:     </nova:instance>
Nov 03 12:38:46 user nova-compute[74960]:   </metadata>
Nov 03 12:38:46 user nova-compute[74960]:   <sysinfo type="smbios">
Nov 03 12:38:46 user nova-compute[74960]:     <system>
Nov 03 12:38:46 user nova-compute[74960]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 12:38:46 user nova-compute[74960]:       <entry name="product">OpenStack Nova</entry>
Nov 03 12:38:46 user nova-compute[74960]:       <entry name="version">0.0.0</entry>
Nov 03 12:38:46 user nova-compute[74960]:       <entry name="serial">82215a04-bd79-4f72-b375-dc73ff9a8654</entry>
Nov 03 12:38:46 user nova-compute[74960]:       <entry name="uuid">82215a04-bd79-4f72-b375-dc73ff9a8654</entry>
Nov 03 12:38:46 user nova-compute[74960]:       <entry name="family">Virtual Machine</entry>
Nov 03 12:38:46 user nova-compute[74960]:     </system>
Nov 03 12:38:46 user nova-compute[74960]:   </sysinfo>
Nov 03 12:38:46 user nova-compute[74960]:   <os>
Nov 03 12:38:46 user nova-compute[74960]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 12:38:46 user nova-compute[74960]:     <boot dev="hd"/>
Nov 03 12:38:46 user nova-compute[74960]:     <smbios mode="sysinfo"/>
Nov 03 12:38:46 user nova-compute[74960]:   </os>
Nov 03 12:38:46 user nova-compute[74960]:   <features>
Nov 03 12:38:46 user nova-compute[74960]:     <acpi/>
Nov 03 12:38:46 user nova-compute[74960]:     <apic/>
Nov 03 12:38:46 user nova-compute[74960]:     <vmcoreinfo/>
Nov 03 12:38:46 user nova-compute[74960]:   </features>
Nov 03 12:38:46 user nova-compute[74960]:   <clock offset="utc">
Nov 03 12:38:46 user nova-compute[74960]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 12:38:46 user nova-compute[74960]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 12:38:46 user nova-compute[74960]:     <timer name="hpet" present="no"/>
Nov 03 12:38:46 user nova-compute[74960]:   </clock>
Nov 03 12:38:46 user nova-compute[74960]:   <cpu mode="custom" match="exact">
Nov 03 12:38:46 user nova-compute[74960]:     <model>Nehalem</model>
Nov 03 12:38:46 user nova-compute[74960]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 12:38:46 user nova-compute[74960]:   </cpu>
Nov 03 12:38:46 user nova-compute[74960]:   <devices>
Nov 03 12:38:46 user nova-compute[74960]:     <disk type="file" device="disk">
Nov 03 12:38:46 user nova-compute[74960]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 12:38:46 user nova-compute[74960]:       <source file="/opt/stack/data/nova/instances/82215a04-bd79-4f72-b375-dc73ff9a8654/disk"/>
Nov 03 12:38:46 user nova-compute[74960]:       <target dev="vda" bus="virtio"/>
Nov 03 12:38:46 user nova-compute[74960]:     </disk>
Nov 03 12:38:46 user nova-compute[74960]:     <interface type="ethernet">
Nov 03 12:38:46 user nova-compute[74960]:       <mac address="fa:16:3e:db:fa:06"/>
Nov 03 12:38:46 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:38:46 user nova-compute[74960]:       <mtu size="1442"/>
Nov 03 12:38:46 user nova-compute[74960]:       <target dev="tap36091714-1f"/>
Nov 03 12:38:46 user nova-compute[74960]:     </interface>
Nov 03 12:38:46 user nova-compute[74960]:     <serial type="pty">
Nov 03 12:38:46 user nova-compute[74960]:       <log file="/opt/stack/data/nova/instances/82215a04-bd79-4f72-b375-dc73ff9a8654/console.log" append="off"/>
Nov 03 12:38:46 user nova-compute[74960]:     </serial>
Nov 03 12:38:46 user nova-compute[74960]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 12:38:46 user nova-compute[74960]:     <video>
Nov 03 12:38:46 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:38:46 user nova-compute[74960]:     </video>
Nov 03 12:38:46 user nova-compute[74960]:     <rng model="virtio">
Nov 03 12:38:46 user nova-compute[74960]:       <backend model="random">/dev/urandom</backend>
Nov 03 12:38:46 user nova-compute[74960]:     </rng>
Nov 03 12:38:46 user nova-compute[74960]:     <controller type="usb" index="0" model="none"/>
Nov 03 12:38:46 user nova-compute[74960]:     <memballoon model="virtio">
Nov 03 12:38:46 user nova-compute[74960]:       <stats period="10"/>
Nov 03 12:38:46 user nova-compute[74960]:     </memballoon>
Nov 03 12:38:46 user nova-compute[74960]:   </devices>
Nov 03 12:38:46 user nova-compute[74960]: </domain>
Nov 03 12:38:46 user nova-compute[74960]:  {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 12:38:46 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-919da236-1b8b-461e-9097-0d558d878459 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:38:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1380868338',display_name='tempest-VolumesSnapshotTestJSON-instance-1380868338',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1380868338',id=38,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBACWxJR0ckRMqLDYUfUZ9YuBoMi30N9o8VsC9qflYY+6dmmkHg1RehuYW7/skC4dLIM7wACaDErdibGdY9+VEoJmBPcZ4UR8DLqQ+1vAU6Qi5aa1nq2PwNvPd+N0CvE5Xw==',key_name='tempest-keypair-2117237715',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='efa134687c74460fb5a59dd3ddece671',ramdisk_id='',reservation_id='r-dh4x0wok',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1639372533',owner_user_name='tempest-VolumesSnapshotTestJSON-1639372533-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:38:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b5fbd2703e241afb720be4680301751',uuid=82215a04-bd79-4f72-b375-dc73ff9a8654,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "36091714-1f02-4ac1-9dc7-feef6712069d", "address": "fa:16:3e:db:fa:06", "network": {"id": "82ebe97c-a056-4ac2-9644-ea315bf9a4b1", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1024050438-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efa134687c74460fb5a59dd3ddece671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36091714-1f", "ovs_interfaceid": "36091714-1f02-4ac1-9dc7-feef6712069d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 12:38:46 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-919da236-1b8b-461e-9097-0d558d878459 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Converting VIF {"id": "36091714-1f02-4ac1-9dc7-feef6712069d", "address": "fa:16:3e:db:fa:06", "network": {"id": "82ebe97c-a056-4ac2-9644-ea315bf9a4b1", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1024050438-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efa134687c74460fb5a59dd3ddece671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36091714-1f", "ovs_interfaceid": "36091714-1f02-4ac1-9dc7-feef6712069d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:38:46 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-919da236-1b8b-461e-9097-0d558d878459 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:fa:06,bridge_name='br-int',has_traffic_filtering=True,id=36091714-1f02-4ac1-9dc7-feef6712069d,network=Network(82ebe97c-a056-4ac2-9644-ea315bf9a4b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36091714-1f') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:38:46 user nova-compute[74960]: DEBUG os_vif [None req-919da236-1b8b-461e-9097-0d558d878459 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:fa:06,bridge_name='br-int',has_traffic_filtering=True,id=36091714-1f02-4ac1-9dc7-feef6712069d,network=Network(82ebe97c-a056-4ac2-9644-ea315bf9a4b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36091714-1f') {{(pid=74960) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 12:38:46 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:38:46 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:38:46 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 12:38:46 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:38:46 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '65d45869-0e08-55d2-b218-d88933c2f4d4', '_type': 'linux-noop'}}, row=False) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:38:46 user nova-compute[74960]: DEBUG nova.network.neutron [None req-3322a92b-f88f-4de4-a300-f716d5a69a36 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67] Updating instance_info_cache with network_info: [{"id": "844c85e9-5021-433d-9f93-530ec193e265", "address": "fa:16:3e:69:d8:32", "network": {"id": "9a9a848a-80be-4281-8554-8e28744073b3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1579909169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "434ce6c4b77342299a17e547a14e3918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap844c85e9-50", "ovs_interfaceid": "844c85e9-5021-433d-9f93-530ec193e265", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:38:46 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:38:46 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:38:46 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-3322a92b-f88f-4de4-a300-f716d5a69a36 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Releasing lock "refresh_cache-47eb8ddf-590f-4ffa-87c8-377cf1ee0f67" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:38:46 user nova-compute[74960]: DEBUG nova.objects.instance [None req-3322a92b-f88f-4de4-a300-f716d5a69a36 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Lazy-loading 'flavor' on Instance uuid 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:38:46 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:38:46 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:38:46 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap36091714-1f, may_exist=True, interface_attrs={}) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:38:46 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap36091714-1f, col_values=(('qos', UUID('ea7b48d5-bd24-4204-9391-9102c397c347')),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:38:46 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap36091714-1f, col_values=(('external_ids', {'iface-id': '36091714-1f02-4ac1-9dc7-feef6712069d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:db:fa:06', 'vm-uuid': '82215a04-bd79-4f72-b375-dc73ff9a8654'}),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:38:46 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:38:46 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:38:46 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:38:46 user nova-compute[74960]: INFO os_vif [None req-919da236-1b8b-461e-9097-0d558d878459 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:fa:06,bridge_name='br-int',has_traffic_filtering=True,id=36091714-1f02-4ac1-9dc7-feef6712069d,network=Network(82ebe97c-a056-4ac2-9644-ea315bf9a4b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36091714-1f')
Nov 03 12:38:46 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-919da236-1b8b-461e-9097-0d558d878459 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] No BDM found with device name vda, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:38:46 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-919da236-1b8b-461e-9097-0d558d878459 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] No VIF found with MAC fa:16:3e:db:fa:06, not building metadata {{(pid=74960) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 12:38:46 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:38:46 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:38:46 user nova-compute[74960]: DEBUG nova.network.neutron [req-ad06fd32-a1d8-4d92-9dfd-ec29a4624c9a req-7d98a21e-e45f-49c9-b54e-f4f66e7b8340 service nova] [instance: 82215a04-bd79-4f72-b375-dc73ff9a8654] Updated VIF entry in instance network info cache for port 36091714-1f02-4ac1-9dc7-feef6712069d. {{(pid=74960) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 12:38:46 user nova-compute[74960]: DEBUG nova.network.neutron [req-ad06fd32-a1d8-4d92-9dfd-ec29a4624c9a req-7d98a21e-e45f-49c9-b54e-f4f66e7b8340 service nova] [instance: 82215a04-bd79-4f72-b375-dc73ff9a8654] Updating instance_info_cache with network_info: [{"id": "36091714-1f02-4ac1-9dc7-feef6712069d", "address": "fa:16:3e:db:fa:06", "network": {"id": "82ebe97c-a056-4ac2-9644-ea315bf9a4b1", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1024050438-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efa134687c74460fb5a59dd3ddece671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36091714-1f", "ovs_interfaceid": "36091714-1f02-4ac1-9dc7-feef6712069d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:38:46 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-ad06fd32-a1d8-4d92-9dfd-ec29a4624c9a req-7d98a21e-e45f-49c9-b54e-f4f66e7b8340 service nova] Releasing lock "refresh_cache-82215a04-bd79-4f72-b375-dc73ff9a8654" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:38:46 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:38:47 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:38:47 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:38:47 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:38:47 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:38:47 user nova-compute[74960]: DEBUG nova.compute.manager [req-0ecaeef4-5272-4448-8efb-495da48ce186 req-a916d600-0d9f-42f3-b62e-48056f9599a5 service nova] [instance: 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67] Received event network-vif-unplugged-844c85e9-5021-433d-9f93-530ec193e265 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:38:47 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-0ecaeef4-5272-4448-8efb-495da48ce186 req-a916d600-0d9f-42f3-b62e-48056f9599a5 service nova] Acquiring lock "47eb8ddf-590f-4ffa-87c8-377cf1ee0f67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:38:47 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-0ecaeef4-5272-4448-8efb-495da48ce186 req-a916d600-0d9f-42f3-b62e-48056f9599a5 service nova] Lock "47eb8ddf-590f-4ffa-87c8-377cf1ee0f67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:38:47 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-0ecaeef4-5272-4448-8efb-495da48ce186 req-a916d600-0d9f-42f3-b62e-48056f9599a5 service nova] Lock "47eb8ddf-590f-4ffa-87c8-377cf1ee0f67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:38:47 user nova-compute[74960]: DEBUG nova.compute.manager [req-0ecaeef4-5272-4448-8efb-495da48ce186 req-a916d600-0d9f-42f3-b62e-48056f9599a5 service nova] [instance: 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67] No waiting events found dispatching network-vif-unplugged-844c85e9-5021-433d-9f93-530ec193e265 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:38:47 user nova-compute[74960]: WARNING nova.compute.manager [req-0ecaeef4-5272-4448-8efb-495da48ce186 req-a916d600-0d9f-42f3-b62e-48056f9599a5 service nova] [instance: 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67] Received unexpected event network-vif-unplugged-844c85e9-5021-433d-9f93-530ec193e265 for instance with vm_state rescued and task_state unrescuing.
Nov 03 12:38:47 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:38:47 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-fe895e72-7af7-4074-874e-9cba601ff5c4 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Acquiring lock "35e02c80-f626-4918-93f1-6b9a7f778c7a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:38:47 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-fe895e72-7af7-4074-874e-9cba601ff5c4 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Lock "35e02c80-f626-4918-93f1-6b9a7f778c7a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:38:47 user nova-compute[74960]: INFO nova.compute.manager [None req-fe895e72-7af7-4074-874e-9cba601ff5c4 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a] Detaching volume 7076f382-82aa-4765-91d3-750540d96879
Nov 03 12:38:47 user nova-compute[74960]: INFO nova.virt.block_device [None req-fe895e72-7af7-4074-874e-9cba601ff5c4 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a] Attempting to driver detach volume 7076f382-82aa-4765-91d3-750540d96879 from mountpoint /dev/vdb
Nov 03 12:38:47 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-fe895e72-7af7-4074-874e-9cba601ff5c4 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Attempting to detach device vdb from instance 35e02c80-f626-4918-93f1-6b9a7f778c7a from the persistent domain config. {{(pid=74960) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 03 12:38:47 user nova-compute[74960]: DEBUG nova.virt.libvirt.guest [None req-fe895e72-7af7-4074-874e-9cba601ff5c4 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 12:38:47 user nova-compute[74960]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 12:38:47 user nova-compute[74960]:   <source dev="/dev/sdb"/>
Nov 03 12:38:47 user nova-compute[74960]:   <target dev="vdb" bus="virtio"/>
Nov 03 12:38:47 user nova-compute[74960]:   <serial>7076f382-82aa-4765-91d3-750540d96879</serial>
Nov 03 12:38:47 user nova-compute[74960]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 12:38:47 user nova-compute[74960]: </disk>
Nov 03 12:38:47 user nova-compute[74960]:  {{(pid=74960) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 12:38:47 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-fe895e72-7af7-4074-874e-9cba601ff5c4 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Successfully detached device vdb from instance 35e02c80-f626-4918-93f1-6b9a7f778c7a from the persistent domain config.
Nov 03 12:38:47 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-fe895e72-7af7-4074-874e-9cba601ff5c4 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 35e02c80-f626-4918-93f1-6b9a7f778c7a from the live domain config. {{(pid=74960) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 03 12:38:47 user nova-compute[74960]: DEBUG nova.virt.libvirt.guest [None req-fe895e72-7af7-4074-874e-9cba601ff5c4 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 12:38:47 user nova-compute[74960]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 12:38:47 user nova-compute[74960]:   <source dev="/dev/sdb"/>
Nov 03 12:38:47 user nova-compute[74960]:   <target dev="vdb" bus="virtio"/>
Nov 03 12:38:47 user nova-compute[74960]:   <serial>7076f382-82aa-4765-91d3-750540d96879</serial>
Nov 03 12:38:47 user nova-compute[74960]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 12:38:47 user nova-compute[74960]: </disk>
Nov 03 12:38:47 user nova-compute[74960]:  {{(pid=74960) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 12:38:47 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:38:47 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:38:47 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:38:47 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:38:47 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:38:48 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-fe895e72-7af7-4074-874e-9cba601ff5c4 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 35e02c80-f626-4918-93f1-6b9a7f778c7a {{(pid=74960) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 03 12:38:48 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67] Instance destroyed successfully.
Nov 03 12:38:48 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:38:49 user nova-compute[74960]: DEBUG nova.compute.manager [req-84b43c37-7609-453c-a473-c5611a6cdc1d req-53175df0-86c2-4abf-b35a-5cd125574f68 service nova] [instance: 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67] Received event network-vif-plugged-844c85e9-5021-433d-9f93-530ec193e265 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:38:49 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-84b43c37-7609-453c-a473-c5611a6cdc1d req-53175df0-86c2-4abf-b35a-5cd125574f68 service nova] Acquiring lock "47eb8ddf-590f-4ffa-87c8-377cf1ee0f67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:38:49 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-84b43c37-7609-453c-a473-c5611a6cdc1d req-53175df0-86c2-4abf-b35a-5cd125574f68 service nova] Lock "47eb8ddf-590f-4ffa-87c8-377cf1ee0f67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:38:49 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-84b43c37-7609-453c-a473-c5611a6cdc1d req-53175df0-86c2-4abf-b35a-5cd125574f68 service nova] Lock "47eb8ddf-590f-4ffa-87c8-377cf1ee0f67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:38:49 user nova-compute[74960]: DEBUG nova.compute.manager [req-84b43c37-7609-453c-a473-c5611a6cdc1d req-53175df0-86c2-4abf-b35a-5cd125574f68 service nova] [instance: 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67] No waiting events found dispatching network-vif-plugged-844c85e9-5021-433d-9f93-530ec193e265 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:38:49 user nova-compute[74960]: WARNING nova.compute.manager [req-84b43c37-7609-453c-a473-c5611a6cdc1d req-53175df0-86c2-4abf-b35a-5cd125574f68 service nova] [instance: 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67] Received unexpected event network-vif-plugged-844c85e9-5021-433d-9f93-530ec193e265 for instance with vm_state rescued and task_state unrescuing.
Nov 03 12:38:49 user nova-compute[74960]: DEBUG nova.compute.manager [req-84b43c37-7609-453c-a473-c5611a6cdc1d req-53175df0-86c2-4abf-b35a-5cd125574f68 service nova] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] Received event network-vif-plugged-16df3da7-2b2a-4c74-bb06-779696d25b88 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:38:49 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-84b43c37-7609-453c-a473-c5611a6cdc1d req-53175df0-86c2-4abf-b35a-5cd125574f68 service nova] Acquiring lock "27aa03bb-5613-4bde-8bc0-30517f5d48ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:38:49 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-84b43c37-7609-453c-a473-c5611a6cdc1d req-53175df0-86c2-4abf-b35a-5cd125574f68 service nova] Lock "27aa03bb-5613-4bde-8bc0-30517f5d48ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:38:49 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-84b43c37-7609-453c-a473-c5611a6cdc1d req-53175df0-86c2-4abf-b35a-5cd125574f68 service nova] Lock "27aa03bb-5613-4bde-8bc0-30517f5d48ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:38:49 user nova-compute[74960]: DEBUG nova.compute.manager [req-84b43c37-7609-453c-a473-c5611a6cdc1d req-53175df0-86c2-4abf-b35a-5cd125574f68 service nova] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] No waiting events found dispatching network-vif-plugged-16df3da7-2b2a-4c74-bb06-779696d25b88 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:38:49 user nova-compute[74960]: WARNING nova.compute.manager [req-84b43c37-7609-453c-a473-c5611a6cdc1d req-53175df0-86c2-4abf-b35a-5cd125574f68 service nova] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] Received unexpected event network-vif-plugged-16df3da7-2b2a-4c74-bb06-779696d25b88 for instance with vm_state active and task_state rebuild_spawning.
Nov 03 12:38:49 user nova-compute[74960]: DEBUG nova.compute.manager [req-84b43c37-7609-453c-a473-c5611a6cdc1d req-53175df0-86c2-4abf-b35a-5cd125574f68 service nova] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] Received event network-vif-plugged-16df3da7-2b2a-4c74-bb06-779696d25b88 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:38:49 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-84b43c37-7609-453c-a473-c5611a6cdc1d req-53175df0-86c2-4abf-b35a-5cd125574f68 service nova] Acquiring lock "27aa03bb-5613-4bde-8bc0-30517f5d48ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:38:49 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-84b43c37-7609-453c-a473-c5611a6cdc1d req-53175df0-86c2-4abf-b35a-5cd125574f68 service nova] Lock "27aa03bb-5613-4bde-8bc0-30517f5d48ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:38:49 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-84b43c37-7609-453c-a473-c5611a6cdc1d req-53175df0-86c2-4abf-b35a-5cd125574f68 service nova] Lock "27aa03bb-5613-4bde-8bc0-30517f5d48ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:38:49 user nova-compute[74960]: DEBUG nova.compute.manager [req-84b43c37-7609-453c-a473-c5611a6cdc1d req-53175df0-86c2-4abf-b35a-5cd125574f68 service nova] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] No waiting events found dispatching network-vif-plugged-16df3da7-2b2a-4c74-bb06-779696d25b88 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:38:49 user nova-compute[74960]: WARNING nova.compute.manager [req-84b43c37-7609-453c-a473-c5611a6cdc1d req-53175df0-86c2-4abf-b35a-5cd125574f68 service nova] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] Received unexpected event network-vif-plugged-16df3da7-2b2a-4c74-bb06-779696d25b88 for instance with vm_state active and task_state rebuild_spawning.
Nov 03 12:38:49 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:38:50 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:38:50 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:38:50 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:38:50 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:38:50 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:38:50 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:38:50 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:38:51 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:38:51 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:38:51 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:38:51 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:38:51 user nova-compute[74960]: DEBUG nova.compute.manager [req-771d98f6-6ab3-4350-bf58-72bd73fce7b8 req-83e0bbd0-41e7-4ee2-9ba6-c51345f12d0e service nova] [instance: 82215a04-bd79-4f72-b375-dc73ff9a8654] Received event network-vif-plugged-36091714-1f02-4ac1-9dc7-feef6712069d {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:38:51 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-771d98f6-6ab3-4350-bf58-72bd73fce7b8 req-83e0bbd0-41e7-4ee2-9ba6-c51345f12d0e service nova] Acquiring lock "82215a04-bd79-4f72-b375-dc73ff9a8654-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:38:51 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-771d98f6-6ab3-4350-bf58-72bd73fce7b8 req-83e0bbd0-41e7-4ee2-9ba6-c51345f12d0e service nova] Lock "82215a04-bd79-4f72-b375-dc73ff9a8654-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:38:51 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-771d98f6-6ab3-4350-bf58-72bd73fce7b8 req-83e0bbd0-41e7-4ee2-9ba6-c51345f12d0e service nova] Lock "82215a04-bd79-4f72-b375-dc73ff9a8654-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:38:51 user nova-compute[74960]: DEBUG nova.compute.manager [req-771d98f6-6ab3-4350-bf58-72bd73fce7b8 req-83e0bbd0-41e7-4ee2-9ba6-c51345f12d0e service nova] [instance: 82215a04-bd79-4f72-b375-dc73ff9a8654] No waiting events found dispatching network-vif-plugged-36091714-1f02-4ac1-9dc7-feef6712069d {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:38:51 user nova-compute[74960]: WARNING nova.compute.manager [req-771d98f6-6ab3-4350-bf58-72bd73fce7b8 req-83e0bbd0-41e7-4ee2-9ba6-c51345f12d0e service nova] [instance: 82215a04-bd79-4f72-b375-dc73ff9a8654] Received unexpected event network-vif-plugged-36091714-1f02-4ac1-9dc7-feef6712069d for instance with vm_state building and task_state spawning.
Nov 03 12:38:51 user nova-compute[74960]: DEBUG nova.compute.manager [req-771d98f6-6ab3-4350-bf58-72bd73fce7b8 req-83e0bbd0-41e7-4ee2-9ba6-c51345f12d0e service nova] [instance: 82215a04-bd79-4f72-b375-dc73ff9a8654] Received event network-vif-plugged-36091714-1f02-4ac1-9dc7-feef6712069d {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:38:51 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-771d98f6-6ab3-4350-bf58-72bd73fce7b8 req-83e0bbd0-41e7-4ee2-9ba6-c51345f12d0e service nova] Acquiring lock "82215a04-bd79-4f72-b375-dc73ff9a8654-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:38:51 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-771d98f6-6ab3-4350-bf58-72bd73fce7b8 req-83e0bbd0-41e7-4ee2-9ba6-c51345f12d0e service nova] Lock "82215a04-bd79-4f72-b375-dc73ff9a8654-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:38:51 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-771d98f6-6ab3-4350-bf58-72bd73fce7b8 req-83e0bbd0-41e7-4ee2-9ba6-c51345f12d0e service nova] Lock "82215a04-bd79-4f72-b375-dc73ff9a8654-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:38:51 user nova-compute[74960]: DEBUG nova.compute.manager [req-771d98f6-6ab3-4350-bf58-72bd73fce7b8 req-83e0bbd0-41e7-4ee2-9ba6-c51345f12d0e service nova] [instance: 82215a04-bd79-4f72-b375-dc73ff9a8654] No waiting events found dispatching network-vif-plugged-36091714-1f02-4ac1-9dc7-feef6712069d {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:38:51 user nova-compute[74960]: WARNING nova.compute.manager [req-771d98f6-6ab3-4350-bf58-72bd73fce7b8 req-83e0bbd0-41e7-4ee2-9ba6-c51345f12d0e service nova] [instance: 82215a04-bd79-4f72-b375-dc73ff9a8654] Received unexpected event network-vif-plugged-36091714-1f02-4ac1-9dc7-feef6712069d for instance with vm_state building and task_state spawning.
Nov 03 12:38:51 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:38:51 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:38:51 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:38:52 user nova-compute[74960]: DEBUG nova.compute.manager [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] Instance event wait completed in 0 seconds for  {{(pid=74960) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 12:38:52 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] Guest created on hypervisor {{(pid=74960) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 12:38:52 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] Instance spawned successfully.
Nov 03 12:38:52 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 12:38:52 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] Found default for hw_cdrom_bus of ide {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:38:52 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] Found default for hw_disk_bus of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:38:52 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] Found default for hw_input_bus of None {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:38:52 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] Found default for hw_pointer_model of None {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:38:52 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] Found default for hw_video_model of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:38:52 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] Found default for hw_vif_model of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:38:52 user nova-compute[74960]: DEBUG nova.compute.manager [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] Checking state {{(pid=74960) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 12:38:52 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:38:52 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:38:52 user nova-compute[74960]: DEBUG nova.objects.instance [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74960) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 03 12:38:52 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-41796648-4b86-4a3d-8917-9ba14c2de219 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.099s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:38:53 user nova-compute[74960]: DEBUG nova.compute.manager [None req-919da236-1b8b-461e-9097-0d558d878459 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] [instance: 82215a04-bd79-4f72-b375-dc73ff9a8654] Instance event wait completed in 0 seconds for  {{(pid=74960) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 12:38:53 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-919da236-1b8b-461e-9097-0d558d878459 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] [instance: 82215a04-bd79-4f72-b375-dc73ff9a8654] Guest created on hypervisor {{(pid=74960) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 12:38:53 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: 82215a04-bd79-4f72-b375-dc73ff9a8654] Instance spawned successfully.
Nov 03 12:38:53 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-919da236-1b8b-461e-9097-0d558d878459 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] [instance: 82215a04-bd79-4f72-b375-dc73ff9a8654] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 12:38:53 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-919da236-1b8b-461e-9097-0d558d878459 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] [instance: 82215a04-bd79-4f72-b375-dc73ff9a8654] Found default for hw_cdrom_bus of ide {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:38:53 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-919da236-1b8b-461e-9097-0d558d878459 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] [instance: 82215a04-bd79-4f72-b375-dc73ff9a8654] Found default for hw_disk_bus of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:38:53 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-919da236-1b8b-461e-9097-0d558d878459 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] [instance: 82215a04-bd79-4f72-b375-dc73ff9a8654] Found default for hw_input_bus of None {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:38:53 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-919da236-1b8b-461e-9097-0d558d878459 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] [instance: 82215a04-bd79-4f72-b375-dc73ff9a8654] Found default for hw_pointer_model of None {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:38:53 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-919da236-1b8b-461e-9097-0d558d878459 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] [instance: 82215a04-bd79-4f72-b375-dc73ff9a8654] Found default for hw_video_model of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:38:53 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-919da236-1b8b-461e-9097-0d558d878459 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] [instance: 82215a04-bd79-4f72-b375-dc73ff9a8654] Found default for hw_vif_model of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:38:53 user nova-compute[74960]: INFO nova.compute.manager [None req-919da236-1b8b-461e-9097-0d558d878459 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] [instance: 82215a04-bd79-4f72-b375-dc73ff9a8654] Took 9.04 seconds to spawn the instance on the hypervisor.
Nov 03 12:38:53 user nova-compute[74960]: DEBUG nova.compute.manager [None req-919da236-1b8b-461e-9097-0d558d878459 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] [instance: 82215a04-bd79-4f72-b375-dc73ff9a8654] Checking state {{(pid=74960) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 12:38:53 user nova-compute[74960]: DEBUG nova.compute.manager [None req-3322a92b-f88f-4de4-a300-f716d5a69a36 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67] Checking state {{(pid=74960) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 12:38:53 user nova-compute[74960]: DEBUG nova.compute.manager [req-2f741b68-f528-4f29-93f4-658ad7481bfc req-3e24b894-51e2-4585-8adc-0987dd0c9425 service nova] [instance: 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67] Received event network-vif-plugged-844c85e9-5021-433d-9f93-530ec193e265 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:38:53 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-2f741b68-f528-4f29-93f4-658ad7481bfc req-3e24b894-51e2-4585-8adc-0987dd0c9425 service nova] Acquiring lock "47eb8ddf-590f-4ffa-87c8-377cf1ee0f67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:38:53 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-2f741b68-f528-4f29-93f4-658ad7481bfc req-3e24b894-51e2-4585-8adc-0987dd0c9425 service nova] Lock "47eb8ddf-590f-4ffa-87c8-377cf1ee0f67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:38:53 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-2f741b68-f528-4f29-93f4-658ad7481bfc req-3e24b894-51e2-4585-8adc-0987dd0c9425 service nova] Lock "47eb8ddf-590f-4ffa-87c8-377cf1ee0f67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:38:53 user nova-compute[74960]: DEBUG nova.compute.manager [req-2f741b68-f528-4f29-93f4-658ad7481bfc req-3e24b894-51e2-4585-8adc-0987dd0c9425 service nova] [instance: 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67] No waiting events found dispatching network-vif-plugged-844c85e9-5021-433d-9f93-530ec193e265 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:38:53 user nova-compute[74960]: WARNING nova.compute.manager [req-2f741b68-f528-4f29-93f4-658ad7481bfc req-3e24b894-51e2-4585-8adc-0987dd0c9425 service nova] [instance: 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67] Received unexpected event network-vif-plugged-844c85e9-5021-433d-9f93-530ec193e265 for instance with vm_state rescued and task_state unrescuing.
Nov 03 12:38:53 user nova-compute[74960]: DEBUG nova.compute.manager [req-2f741b68-f528-4f29-93f4-658ad7481bfc req-3e24b894-51e2-4585-8adc-0987dd0c9425 service nova] [instance: 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67] Received event network-vif-plugged-844c85e9-5021-433d-9f93-530ec193e265 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:38:53 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-2f741b68-f528-4f29-93f4-658ad7481bfc req-3e24b894-51e2-4585-8adc-0987dd0c9425 service nova] Acquiring lock "47eb8ddf-590f-4ffa-87c8-377cf1ee0f67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:38:53 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-2f741b68-f528-4f29-93f4-658ad7481bfc req-3e24b894-51e2-4585-8adc-0987dd0c9425 service nova] Lock "47eb8ddf-590f-4ffa-87c8-377cf1ee0f67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:38:53 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-2f741b68-f528-4f29-93f4-658ad7481bfc req-3e24b894-51e2-4585-8adc-0987dd0c9425 service nova] Lock "47eb8ddf-590f-4ffa-87c8-377cf1ee0f67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:38:53 user nova-compute[74960]: DEBUG nova.compute.manager [req-2f741b68-f528-4f29-93f4-658ad7481bfc req-3e24b894-51e2-4585-8adc-0987dd0c9425 service nova] [instance: 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67] No waiting events found dispatching network-vif-plugged-844c85e9-5021-433d-9f93-530ec193e265 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:38:53 user nova-compute[74960]: WARNING nova.compute.manager [req-2f741b68-f528-4f29-93f4-658ad7481bfc req-3e24b894-51e2-4585-8adc-0987dd0c9425 service nova] [instance: 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67] Received unexpected event network-vif-plugged-844c85e9-5021-433d-9f93-530ec193e265 for instance with vm_state rescued and task_state unrescuing.
Nov 03 12:38:53 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:38:53 user nova-compute[74960]: INFO nova.compute.manager [None req-919da236-1b8b-461e-9097-0d558d878459 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] [instance: 82215a04-bd79-4f72-b375-dc73ff9a8654] Took 10.13 seconds to build instance.
Nov 03 12:38:53 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-919da236-1b8b-461e-9097-0d558d878459 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Lock "82215a04-bd79-4f72-b375-dc73ff9a8654" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.224s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:38:53 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:38:54 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:38:55 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:38:56 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:38:56 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Starting heal instance info cache {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 12:38:56 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "refresh_cache-47eb8ddf-590f-4ffa-87c8-377cf1ee0f67" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:38:56 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquired lock "refresh_cache-47eb8ddf-590f-4ffa-87c8-377cf1ee0f67" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:38:56 user nova-compute[74960]: DEBUG nova.network.neutron [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67] Forcefully refreshing network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 12:38:56 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:38:57 user nova-compute[74960]: DEBUG nova.network.neutron [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67] Updating instance_info_cache with network_info: [{"id": "844c85e9-5021-433d-9f93-530ec193e265", "address": "fa:16:3e:69:d8:32", "network": {"id": "9a9a848a-80be-4281-8554-8e28744073b3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1579909169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "434ce6c4b77342299a17e547a14e3918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap844c85e9-50", "ovs_interfaceid": "844c85e9-5021-433d-9f93-530ec193e265", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:38:57 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Releasing lock "refresh_cache-47eb8ddf-590f-4ffa-87c8-377cf1ee0f67" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:38:57 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67] Updated the network info_cache for instance {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 12:38:57 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:38:57 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:38:57 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:38:57 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:38:57 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:38:57 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Auditing locally available compute resources for user (node: user) {{(pid=74960) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 12:38:57 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74960) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 12:38:57 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f15f5f-8afa-4d7b-bb45-5887184f9ee5/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:38:57 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f15f5f-8afa-4d7b-bb45-5887184f9ee5/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:38:57 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f15f5f-8afa-4d7b-bb45-5887184f9ee5/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:38:57 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f15f5f-8afa-4d7b-bb45-5887184f9ee5/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:38:57 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47eb8ddf-590f-4ffa-87c8-377cf1ee0f67/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:38:57 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47eb8ddf-590f-4ffa-87c8-377cf1ee0f67/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:38:57 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47eb8ddf-590f-4ffa-87c8-377cf1ee0f67/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:38:58 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47eb8ddf-590f-4ffa-87c8-377cf1ee0f67/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:38:58 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7b95c0-3726-4a1c-a384-ec91abf75225/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:38:58 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7b95c0-3726-4a1c-a384-ec91abf75225/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:38:58 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7b95c0-3726-4a1c-a384-ec91abf75225/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:38:58 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7b95c0-3726-4a1c-a384-ec91abf75225/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:38:58 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e02c80-f626-4918-93f1-6b9a7f778c7a/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:38:58 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e02c80-f626-4918-93f1-6b9a7f778c7a/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:38:58 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e02c80-f626-4918-93f1-6b9a7f778c7a/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:38:58 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e02c80-f626-4918-93f1-6b9a7f778c7a/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:38:58 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk.rescue --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:38:59 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:38:59 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk.rescue --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:38:59 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:38:59 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:38:59 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:38:59 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:38:59 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:38:59 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74960) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 12:38:59 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7606a55-d5c3-4ba8-b499-f3c70813f151/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:38:59 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7606a55-d5c3-4ba8-b499-f3c70813f151/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:38:59 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7606a55-d5c3-4ba8-b499-f3c70813f151/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:39:00 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7606a55-d5c3-4ba8-b499-f3c70813f151/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:39:00 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82215a04-bd79-4f72-b375-dc73ff9a8654/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:39:00 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82215a04-bd79-4f72-b375-dc73ff9a8654/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:39:00 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82215a04-bd79-4f72-b375-dc73ff9a8654/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:39:00 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82215a04-bd79-4f72-b375-dc73ff9a8654/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:39:00 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74960) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 12:39:00 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:39:00 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:39:00 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Hypervisor/Node resource view: name=user free_ram=8188MB free_disk=24.892932891845703GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74960) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 12:39:00 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:39:00 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:39:01 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 87f15f5f-8afa-4d7b-bb45-5887184f9ee5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:39:01 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance a6199681-f85e-4f55-966b-6ab3f17cd640 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:39:01 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 5b7b95c0-3726-4a1c-a384-ec91abf75225 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:39:01 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 35e02c80-f626-4918-93f1-6b9a7f778c7a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:39:01 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:39:01 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:39:01 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance b7606a55-d5c3-4ba8-b499-f3c70813f151 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:39:01 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 27aa03bb-5613-4bde-8bc0-30517f5d48ae actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:39:01 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 895d6de1-b5d9-4555-af57-f7816183be58 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:39:01 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 82215a04-bd79-4f72-b375-dc73ff9a8654 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:39:01 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74960) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 12:39:01 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74960) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 12:39:01 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:39:01 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:39:01 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:39:01 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Compute_service record updated for user:user {{(pid=74960) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 12:39:01 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.684s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:39:03 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:39:03 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:39:03 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:39:03 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74960) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 12:39:06 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:39:06 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:39:06 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:39:06 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74960) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 12:39:06 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74960) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 12:39:06 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:39:06 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74960) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 12:39:08 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-fe895e72-7af7-4074-874e-9cba601ff5c4 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 35e02c80-f626-4918-93f1-6b9a7f778c7a is timed out.
Nov 03 12:39:08 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-fe895e72-7af7-4074-874e-9cba601ff5c4 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Successfully detached device vdb from instance 35e02c80-f626-4918-93f1-6b9a7f778c7a from the live domain config.
Nov 03 12:39:08 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe895e72-7af7-4074-874e-9cba601ff5c4 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a] calling os-brick to detach iSCSI Volume {{(pid=74960) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 12:39:08 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe895e72-7af7-4074-874e-9cba601ff5c4 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9aa420acb0>, {'target_iqn': 'iqn.2010-10.org.openstack:7076f382-82aa-4765-91d3-750540d96879', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vdDptsGK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:39:08 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-fe895e72-7af7-4074-874e-9cba601ff5c4 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:39:08 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-fe895e72-7af7-4074-874e-9cba601ff5c4 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:39:08 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-fe895e72-7af7-4074-874e-9cba601ff5c4 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:39:08 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:39:08 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:39:08 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[f97c9ba9-7b1d-4708-9f13-8e2418a64251]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7076f382-82aa-4765-91d3-750540d96879\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:39:08 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe895e72-7af7-4074-874e-9cba601ff5c4 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 12:39:08 user nova-compute[74960]: No targets found.
Nov 03 12:39:08 user nova-compute[74960]: iSNS:
Nov 03 12:39:08 user nova-compute[74960]: No targets found.
Nov 03 12:39:08 user nova-compute[74960]: STATIC:
Nov 03 12:39:08 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7
Nov 03 12:39:08 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:39:08 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:39:08 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:7076f382-82aa-4765-91d3-750540d96879
Nov 03 12:39:08 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:39:08 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:39:08 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2
Nov 03 12:39:08 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:39:08 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:39:08 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61
Nov 03 12:39:08 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:39:08 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:39:08 user nova-compute[74960]: FIRMWARE:
Nov 03 12:39:08 user nova-compute[74960]: No targets found.
Nov 03 12:39:08 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:39:08 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe895e72-7af7-4074-874e-9cba601ff5c4 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 12:39:08 user nova-compute[74960]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 12:39:08 user nova-compute[74960]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74960) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 12:39:08 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe895e72-7af7-4074-874e-9cba601ff5c4 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7076f382-82aa-4765-91d3-750540d96879', 0)] {{(pid=74960) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 12:39:08 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:39:08 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:39:08 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc12a8e2-d6a8-4d66-b0b2-fc38492ffe07]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7076f382-82aa-4765-91d3-750540d96879\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:39:08 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:39:08 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:39:08 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[eff13a36-ddf3-4d5a-bf55-d3c1a2617074]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7076f382-82aa-4765-91d3-750540d96879 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61 (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:39:08 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe895e72-7af7-4074-874e-9cba601ff5c4 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:39:08 user nova-compute[74960]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7 (non-flash)
Nov 03 12:39:08 user nova-compute[74960]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7076f382-82aa-4765-91d3-750540d96879 (non-flash)
Nov 03 12:39:08 user nova-compute[74960]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61 (non-flash)
Nov 03 12:39:08 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:39:08 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe895e72-7af7-4074-874e-9cba601ff5c4 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:39:08 user nova-compute[74960]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7 (non-flash)
Nov 03 12:39:08 user nova-compute[74960]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7076f382-82aa-4765-91d3-750540d96879 (non-flash)
Nov 03 12:39:08 user nova-compute[74960]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61 (non-flash)
Nov 03 12:39:08 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:39:08 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe895e72-7af7-4074-874e-9cba601ff5c4 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9a8c35dea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7076f382-82aa-4765-91d3-750540d96879'): ({'sdb'}, set())}) {{(pid=74960) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 12:39:08 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-fe895e72-7af7-4074-874e-9cba601ff5c4 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Removing single pathed devices sdb {{(pid=74960) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 12:39:08 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:39:08 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:39:08 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9d4caec-2f9a-47b3-92e0-406be411bc7b]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:39:08 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:39:08 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:39:08 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[f394e492-5b82-446e-878b-9a1da5f3700b]: (4, ('ok\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:39:08 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-fe895e72-7af7-4074-874e-9cba601ff5c4 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Flushing IO for device /dev/sdb {{(pid=74960) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 12:39:08 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:39:08 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:39:08 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[25e70c32-7d87-4a0c-bad9-d738a070c37f]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:39:08 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-fe895e72-7af7-4074-874e-9cba601ff5c4 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74960) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 12:39:08 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:39:08 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:39:08 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d9e6792-de76-4079-b3d5-dc64a5d925d8]: (4, ('1', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:39:08 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-fe895e72-7af7-4074-874e-9cba601ff5c4 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74960) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 12:39:08 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-fe895e72-7af7-4074-874e-9cba601ff5c4 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] SCSI volumes sdb have been removed. {{(pid=74960) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 12:39:08 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe895e72-7af7-4074-874e-9cba601ff5c4 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7076f382-82aa-4765-91d3-750540d96879')] {{(pid=74960) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 12:39:08 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7076f382-82aa-4765-91d3-750540d96879 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:39:08 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7076f382-82aa-4765-91d3-750540d96879 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:39:08 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5651243-c5b8-4c85-babe-9a10c0a5026e]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:39:08 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe895e72-7af7-4074-874e-9cba601ff5c4 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:39:08 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7076f382-82aa-4765-91d3-750540d96879 -p 172.16.0.220:3260 --logout {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:39:08 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:39:08 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7076f382-82aa-4765-91d3-750540d96879 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:39:08 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[17fcd8a2-bbac-40c1-b69f-b8ceb3d5946a]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:7076f382-82aa-4765-91d3-750540d96879, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:7076f382-82aa-4765-91d3-750540d96879, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:39:08 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe895e72-7af7-4074-874e-9cba601ff5c4 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:7076f382-82aa-4765-91d3-750540d96879, portal: 172.16.0.220,3260]
Nov 03 12:39:08 user nova-compute[74960]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:7076f382-82aa-4765-91d3-750540d96879, portal: 172.16.0.220,3260] successful.
Nov 03 12:39:08 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:39:08 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7076f382-82aa-4765-91d3-750540d96879 -p 172.16.0.220:3260 --op delete {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:39:08 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7076f382-82aa-4765-91d3-750540d96879 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:39:08 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8349042-2c74-407c-87c9-fbfdef11cb59]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:39:08 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe895e72-7af7-4074-874e-9cba601ff5c4 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:39:08 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-fe895e72-7af7-4074-874e-9cba601ff5c4 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:39:08 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe895e72-7af7-4074-874e-9cba601ff5c4 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] <== disconnect_volume: return (306ms) None {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:39:08 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe895e72-7af7-4074-874e-9cba601ff5c4 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a] Disconnected iSCSI Volume {{(pid=74960) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 12:39:09 user nova-compute[74960]: DEBUG nova.objects.instance [None req-fe895e72-7af7-4074-874e-9cba601ff5c4 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Lazy-loading 'flavor' on Instance uuid 35e02c80-f626-4918-93f1-6b9a7f778c7a {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:39:09 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-fe895e72-7af7-4074-874e-9cba601ff5c4 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Lock "35e02c80-f626-4918-93f1-6b9a7f778c7a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.347s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:39:11 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:39:13 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:39:16 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:39:18 user nova-compute[74960]: INFO nova.compute.manager [None req-6ecdbaf0-a494-4d37-97a0-43c7c1425f16 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] Rescuing
Nov 03 12:39:18 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-6ecdbaf0-a494-4d37-97a0-43c7c1425f16 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Acquiring lock "refresh_cache-895d6de1-b5d9-4555-af57-f7816183be58" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:39:18 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-6ecdbaf0-a494-4d37-97a0-43c7c1425f16 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Acquired lock "refresh_cache-895d6de1-b5d9-4555-af57-f7816183be58" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:39:18 user nova-compute[74960]: DEBUG nova.network.neutron [None req-6ecdbaf0-a494-4d37-97a0-43c7c1425f16 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] Building network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 12:39:18 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:39:18 user nova-compute[74960]: DEBUG nova.network.neutron [None req-6ecdbaf0-a494-4d37-97a0-43c7c1425f16 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] Updating instance_info_cache with network_info: [{"id": "59f6ddba-fb77-4d36-98da-f4d645355650", "address": "fa:16:3e:df:ac:19", "network": {"id": "dec66832-56d5-4d68-b11f-8e8eed38f045", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-79099436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc95d68d5e147e1953c855169b17091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59f6ddba-fb", "ovs_interfaceid": "59f6ddba-fb77-4d36-98da-f4d645355650", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:39:18 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-6ecdbaf0-a494-4d37-97a0-43c7c1425f16 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Releasing lock "refresh_cache-895d6de1-b5d9-4555-af57-f7816183be58" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:39:18 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:39:18 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:39:19 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:39:19 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:39:19 user nova-compute[74960]: DEBUG nova.compute.manager [req-5f72c79f-b0ea-4f14-84ae-c92db7f0a840 req-6bee0ce6-1869-47f1-b58c-b09567972a7d service nova] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] Received event network-vif-unplugged-59f6ddba-fb77-4d36-98da-f4d645355650 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:39:19 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-5f72c79f-b0ea-4f14-84ae-c92db7f0a840 req-6bee0ce6-1869-47f1-b58c-b09567972a7d service nova] Acquiring lock "895d6de1-b5d9-4555-af57-f7816183be58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:39:19 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-5f72c79f-b0ea-4f14-84ae-c92db7f0a840 req-6bee0ce6-1869-47f1-b58c-b09567972a7d service nova] Lock "895d6de1-b5d9-4555-af57-f7816183be58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:39:19 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-5f72c79f-b0ea-4f14-84ae-c92db7f0a840 req-6bee0ce6-1869-47f1-b58c-b09567972a7d service nova] Lock "895d6de1-b5d9-4555-af57-f7816183be58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:39:19 user nova-compute[74960]: DEBUG nova.compute.manager [req-5f72c79f-b0ea-4f14-84ae-c92db7f0a840 req-6bee0ce6-1869-47f1-b58c-b09567972a7d service nova] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] No waiting events found dispatching network-vif-unplugged-59f6ddba-fb77-4d36-98da-f4d645355650 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:39:19 user nova-compute[74960]: WARNING nova.compute.manager [req-5f72c79f-b0ea-4f14-84ae-c92db7f0a840 req-6bee0ce6-1869-47f1-b58c-b09567972a7d service nova] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] Received unexpected event network-vif-unplugged-59f6ddba-fb77-4d36-98da-f4d645355650 for instance with vm_state active and task_state rescuing.
Nov 03 12:39:19 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] Instance destroyed successfully.
Nov 03 12:39:19 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-6ecdbaf0-a494-4d37-97a0-43c7c1425f16 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] Attempting a stable device rescue
Nov 03 12:39:19 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-6ecdbaf0-a494-4d37-97a0-43c7c1425f16 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74960) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 03 12:39:19 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-6ecdbaf0-a494-4d37-97a0-43c7c1425f16 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] Instance directory exists: not creating {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 03 12:39:19 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-6ecdbaf0-a494-4d37-97a0-43c7c1425f16 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] Creating image(s)
Nov 03 12:39:19 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-6ecdbaf0-a494-4d37-97a0-43c7c1425f16 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Acquiring lock "/opt/stack/data/nova/instances/895d6de1-b5d9-4555-af57-f7816183be58/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:39:19 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-6ecdbaf0-a494-4d37-97a0-43c7c1425f16 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Lock "/opt/stack/data/nova/instances/895d6de1-b5d9-4555-af57-f7816183be58/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:39:19 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-6ecdbaf0-a494-4d37-97a0-43c7c1425f16 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Lock "/opt/stack/data/nova/instances/895d6de1-b5d9-4555-af57-f7816183be58/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:39:19 user nova-compute[74960]: DEBUG nova.objects.instance [None req-6ecdbaf0-a494-4d37-97a0-43c7c1425f16 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Lazy-loading 'trusted_certs' on Instance uuid 895d6de1-b5d9-4555-af57-f7816183be58 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:39:19 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-6ecdbaf0-a494-4d37-97a0-43c7c1425f16 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Acquiring lock "98ff57db1069e799a7e32024ace676f6d7c1f767" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:39:19 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-6ecdbaf0-a494-4d37-97a0-43c7c1425f16 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Lock "98ff57db1069e799a7e32024ace676f6d7c1f767" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:39:20 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-6ecdbaf0-a494-4d37-97a0-43c7c1425f16 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98ff57db1069e799a7e32024ace676f6d7c1f767.part --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:39:20 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-6ecdbaf0-a494-4d37-97a0-43c7c1425f16 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98ff57db1069e799a7e32024ace676f6d7c1f767.part --force-share --output=json" returned: 0 in 0.199s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:39:20 user nova-compute[74960]: DEBUG nova.virt.images [None req-6ecdbaf0-a494-4d37-97a0-43c7c1425f16 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] c5076cd5-e0ae-42f8-8bb7-5a7a3310c591 was qcow2, converting to raw {{(pid=74960) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 03 12:39:20 user nova-compute[74960]: DEBUG nova.privsep.utils [None req-6ecdbaf0-a494-4d37-97a0-43c7c1425f16 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74960) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 03 12:39:20 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-6ecdbaf0-a494-4d37-97a0-43c7c1425f16 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/98ff57db1069e799a7e32024ace676f6d7c1f767.part /opt/stack/data/nova/instances/_base/98ff57db1069e799a7e32024ace676f6d7c1f767.converted {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:39:21 user nova-compute[74960]: DEBUG nova.compute.manager [req-2ca90413-e247-4a06-9371-c22e52860642 req-34a23155-cc12-4fb4-b273-4b476dd147ff service nova] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] Received event network-vif-plugged-59f6ddba-fb77-4d36-98da-f4d645355650 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:39:21 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-2ca90413-e247-4a06-9371-c22e52860642 req-34a23155-cc12-4fb4-b273-4b476dd147ff service nova] Acquiring lock "895d6de1-b5d9-4555-af57-f7816183be58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:39:21 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-2ca90413-e247-4a06-9371-c22e52860642 req-34a23155-cc12-4fb4-b273-4b476dd147ff service nova] Lock "895d6de1-b5d9-4555-af57-f7816183be58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:39:21 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-2ca90413-e247-4a06-9371-c22e52860642 req-34a23155-cc12-4fb4-b273-4b476dd147ff service nova] Lock "895d6de1-b5d9-4555-af57-f7816183be58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:39:21 user nova-compute[74960]: DEBUG nova.compute.manager [req-2ca90413-e247-4a06-9371-c22e52860642 req-34a23155-cc12-4fb4-b273-4b476dd147ff service nova] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] No waiting events found dispatching network-vif-plugged-59f6ddba-fb77-4d36-98da-f4d645355650 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:39:21 user nova-compute[74960]: WARNING nova.compute.manager [req-2ca90413-e247-4a06-9371-c22e52860642 req-34a23155-cc12-4fb4-b273-4b476dd147ff service nova] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] Received unexpected event network-vif-plugged-59f6ddba-fb77-4d36-98da-f4d645355650 for instance with vm_state active and task_state rescuing.
Nov 03 12:39:21 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-6ecdbaf0-a494-4d37-97a0-43c7c1425f16 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/98ff57db1069e799a7e32024ace676f6d7c1f767.part /opt/stack/data/nova/instances/_base/98ff57db1069e799a7e32024ace676f6d7c1f767.converted" returned: 0 in 0.492s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:39:21 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-6ecdbaf0-a494-4d37-97a0-43c7c1425f16 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98ff57db1069e799a7e32024ace676f6d7c1f767.converted --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:39:21 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:39:21 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-6ecdbaf0-a494-4d37-97a0-43c7c1425f16 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98ff57db1069e799a7e32024ace676f6d7c1f767.converted --force-share --output=json" returned: 0 in 0.210s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:39:21 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-6ecdbaf0-a494-4d37-97a0-43c7c1425f16 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Lock "98ff57db1069e799a7e32024ace676f6d7c1f767" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.949s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:39:21 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-6ecdbaf0-a494-4d37-97a0-43c7c1425f16 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Acquiring lock "98ff57db1069e799a7e32024ace676f6d7c1f767" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:39:21 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-6ecdbaf0-a494-4d37-97a0-43c7c1425f16 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Lock "98ff57db1069e799a7e32024ace676f6d7c1f767" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:39:21 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-6ecdbaf0-a494-4d37-97a0-43c7c1425f16 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98ff57db1069e799a7e32024ace676f6d7c1f767 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:39:21 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-6ecdbaf0-a494-4d37-97a0-43c7c1425f16 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98ff57db1069e799a7e32024ace676f6d7c1f767 --force-share --output=json" returned: 0 in 0.173s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:39:21 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-6ecdbaf0-a494-4d37-97a0-43c7c1425f16 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98ff57db1069e799a7e32024ace676f6d7c1f767,backing_fmt=raw /opt/stack/data/nova/instances/895d6de1-b5d9-4555-af57-f7816183be58/disk.rescue {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:39:21 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-6ecdbaf0-a494-4d37-97a0-43c7c1425f16 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98ff57db1069e799a7e32024ace676f6d7c1f767,backing_fmt=raw /opt/stack/data/nova/instances/895d6de1-b5d9-4555-af57-f7816183be58/disk.rescue" returned: 0 in 0.054s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:39:21 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-6ecdbaf0-a494-4d37-97a0-43c7c1425f16 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Lock "98ff57db1069e799a7e32024ace676f6d7c1f767" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:39:21 user nova-compute[74960]: DEBUG nova.objects.instance [None req-6ecdbaf0-a494-4d37-97a0-43c7c1425f16 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Lazy-loading 'migration_context' on Instance uuid 895d6de1-b5d9-4555-af57-f7816183be58 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:39:21 user nova-compute[74960]: DEBUG nova.objects.base [None req-6ecdbaf0-a494-4d37-97a0-43c7c1425f16 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Object Instance<895d6de1-b5d9-4555-af57-f7816183be58> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74960) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 12:39:21 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-6ecdbaf0-a494-4d37-97a0-43c7c1425f16 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] Created local disks {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 12:39:21 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-6ecdbaf0-a494-4d37-97a0-43c7c1425f16 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] Start _get_guest_xml network_info=[{"id": "59f6ddba-fb77-4d36-98da-f4d645355650", "address": "fa:16:3e:df:ac:19", "network": {"id": "dec66832-56d5-4d68-b11f-8e8eed38f045", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-79099436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-79099436-network", "vif_mac": "fa:16:3e:df:ac:19"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc95d68d5e147e1953c855169b17091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59f6ddba-fb", "ovs_interfaceid": "59f6ddba-fb77-4d36-98da-f4d645355650", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=549f51ba-ac69-494b-8de1-34635aa2d7cf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='63ee9c80c632442fb0379f47b784bd20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T12:13:04Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'c5076cd5-e0ae-42f8-8bb7-5a7a3310c591', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AOzUElvi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '895d6de1-b5d9-4555-af57-f7816183be58', 'attached_at': '', 'detached_at': '', 'volume_id': '0b25e85a-a887-4c1b-a798-bd360de0e9d7', 'serial': '0b25e85a-a887-4c1b-a798-bd360de0e9d7'}, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'device_type': 'disk', 'attachment_id': '6901fbb3-35a1-4b6f-958e-b7fd64ea215b', 'boot_index': 0, 'guest_format': None, 'volume_type': None} {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 12:39:21 user nova-compute[74960]: DEBUG nova.objects.instance [None req-6ecdbaf0-a494-4d37-97a0-43c7c1425f16 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Lazy-loading 'resources' on Instance uuid 895d6de1-b5d9-4555-af57-f7816183be58 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:39:21 user nova-compute[74960]: DEBUG nova.objects.base [None req-6ecdbaf0-a494-4d37-97a0-43c7c1425f16 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Object Instance<895d6de1-b5d9-4555-af57-f7816183be58> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74960) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 12:39:21 user nova-compute[74960]: DEBUG nova.objects.instance [None req-6ecdbaf0-a494-4d37-97a0-43c7c1425f16 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Lazy-loading 'numa_topology' on Instance uuid 895d6de1-b5d9-4555-af57-f7816183be58 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:39:21 user nova-compute[74960]: DEBUG nova.objects.base [None req-6ecdbaf0-a494-4d37-97a0-43c7c1425f16 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Object Instance<895d6de1-b5d9-4555-af57-f7816183be58> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74960) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 12:39:21 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-6ecdbaf0-a494-4d37-97a0-43c7c1425f16 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:39:21 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-6ecdbaf0-a494-4d37-97a0-43c7c1425f16 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:39:22 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-6ecdbaf0-a494-4d37-97a0-43c7c1425f16 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 12:39:22 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-6ecdbaf0-a494-4d37-97a0-43c7c1425f16 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] CPU controller missing on host. {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 12:39:22 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-6ecdbaf0-a494-4d37-97a0-43c7c1425f16 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 12:39:22 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-6ecdbaf0-a494-4d37-97a0-43c7c1425f16 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] CPU controller found on host. {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 12:39:22 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-6ecdbaf0-a494-4d37-97a0-43c7c1425f16 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74960) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 12:39:22 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-6ecdbaf0-a494-4d37-97a0-43c7c1425f16 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=549f51ba-ac69-494b-8de1-34635aa2d7cf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='63ee9c80c632442fb0379f47b784bd20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T12:13:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 12:39:22 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-6ecdbaf0-a494-4d37-97a0-43c7c1425f16 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Flavor limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 12:39:22 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-6ecdbaf0-a494-4d37-97a0-43c7c1425f16 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Image limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 12:39:22 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-6ecdbaf0-a494-4d37-97a0-43c7c1425f16 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Flavor pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 12:39:22 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-6ecdbaf0-a494-4d37-97a0-43c7c1425f16 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Image pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 12:39:22 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-6ecdbaf0-a494-4d37-97a0-43c7c1425f16 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 12:39:22 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-6ecdbaf0-a494-4d37-97a0-43c7c1425f16 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 12:39:22 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-6ecdbaf0-a494-4d37-97a0-43c7c1425f16 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 12:39:22 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-6ecdbaf0-a494-4d37-97a0-43c7c1425f16 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Got 1 possible topologies {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 12:39:22 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-6ecdbaf0-a494-4d37-97a0-43c7c1425f16 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 12:39:22 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-6ecdbaf0-a494-4d37-97a0-43c7c1425f16 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 12:39:22 user nova-compute[74960]: DEBUG nova.objects.instance [None req-6ecdbaf0-a494-4d37-97a0-43c7c1425f16 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Lazy-loading 'vcpu_model' on Instance uuid 895d6de1-b5d9-4555-af57-f7816183be58 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:39:22 user nova-compute[74960]: DEBUG nova.objects.base [None req-6ecdbaf0-a494-4d37-97a0-43c7c1425f16 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Object Instance<895d6de1-b5d9-4555-af57-f7816183be58> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74960) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 12:39:22 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ecdbaf0-a494-4d37-97a0-43c7c1425f16 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] Calling os-brick to attach iSCSI Volume {{(pid=74960) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 12:39:22 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ecdbaf0-a494-4d37-97a0-43c7c1425f16 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9aa420acb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AOzUElvi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:39:22 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-6ecdbaf0-a494-4d37-97a0-43c7c1425f16 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:39:22 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-6ecdbaf0-a494-4d37-97a0-43c7c1425f16 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:39:22 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-6ecdbaf0-a494-4d37-97a0-43c7c1425f16 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:39:22 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-6ecdbaf0-a494-4d37-97a0-43c7c1425f16 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:39:22 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-6ecdbaf0-a494-4d37-97a0-43c7c1425f16 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:39:22 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-6ecdbaf0-a494-4d37-97a0-43c7c1425f16 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:39:22 user nova-compute[74960]: INFO os_brick.initiator.connectors.iscsi [None req-6ecdbaf0-a494-4d37-97a0-43c7c1425f16 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 12:39:22 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7 -p 172.16.0.220:3260 {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:39:22 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7 -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:39:22 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fcb6c52-67fd-4046-a329-23bc9285ac07]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = AOzUElvi\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:39:22 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ecdbaf0-a494-4d37-97a0-43c7c1425f16 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 03 12:39:22 user nova-compute[74960]: node.name = iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7
Nov 03 12:39:22 user nova-compute[74960]: node.tpgt = -1
Nov 03 12:39:22 user nova-compute[74960]: node.startup = automatic
Nov 03 12:39:22 user nova-compute[74960]: node.leading_login = No
Nov 03 12:39:22 user nova-compute[74960]: iface.iscsi_ifacename = default
Nov 03 12:39:22 user nova-compute[74960]: iface.net_ifacename = <empty>
Nov 03 12:39:22 user nova-compute[74960]: iface.ipaddress = <empty>
Nov 03 12:39:22 user nova-compute[74960]: iface.prefix_len = 0
Nov 03 12:39:22 user nova-compute[74960]: iface.hwaddress = <empty>
Nov 03 12:39:22 user nova-compute[74960]: iface.transport_name = tcp
Nov 03 12:39:22 user nova-compute[74960]: iface.initiatorname = <empty>
Nov 03 12:39:22 user nova-compute[74960]: iface.state = <empty>
Nov 03 12:39:22 user nova-compute[74960]: iface.vlan_id = 0
Nov 03 12:39:22 user nova-compute[74960]: iface.vlan_priority = 0
Nov 03 12:39:22 user nova-compute[74960]: iface.vlan_state = <empty>
Nov 03 12:39:22 user nova-compute[74960]: iface.iface_num = 0
Nov 03 12:39:22 user nova-compute[74960]: iface.mtu = 0
Nov 03 12:39:22 user nova-compute[74960]: iface.port = 0
Nov 03 12:39:22 user nova-compute[74960]: iface.bootproto = <empty>
Nov 03 12:39:22 user nova-compute[74960]: iface.subnet_mask = <empty>
Nov 03 12:39:22 user nova-compute[74960]: iface.gateway = <empty>
Nov 03 12:39:22 user nova-compute[74960]: iface.dhcp_alt_client_id_state = <empty>
Nov 03 12:39:22 user nova-compute[74960]: iface.dhcp_alt_client_id = <empty>
Nov 03 12:39:22 user nova-compute[74960]: iface.dhcp_dns = <empty>
Nov 03 12:39:22 user nova-compute[74960]: iface.dhcp_learn_iqn = <empty>
Nov 03 12:39:22 user nova-compute[74960]: iface.dhcp_req_vendor_id_state = <empty>
Nov 03 12:39:22 user nova-compute[74960]: iface.dhcp_vendor_id_state = <empty>
Nov 03 12:39:22 user nova-compute[74960]: iface.dhcp_vendor_id = <empty>
Nov 03 12:39:22 user nova-compute[74960]: iface.dhcp_slp_da = <empty>
Nov 03 12:39:22 user nova-compute[74960]: iface.fragmentation = <empty>
Nov 03 12:39:22 user nova-compute[74960]: iface.gratuitous_arp = <empty>
Nov 03 12:39:22 user nova-compute[74960]: iface.incoming_forwarding = <empty>
Nov 03 12:39:22 user nova-compute[74960]: iface.tos_state = <empty>
Nov 03 12:39:22 user nova-compute[74960]: iface.tos = 0
Nov 03 12:39:22 user nova-compute[74960]: iface.ttl = 0
Nov 03 12:39:22 user nova-compute[74960]: iface.delayed_ack = <empty>
Nov 03 12:39:22 user nova-compute[74960]: iface.tcp_nagle = <empty>
Nov 03 12:39:22 user nova-compute[74960]: iface.tcp_wsf_state = <empty>
Nov 03 12:39:22 user nova-compute[74960]: iface.tcp_wsf = 0
Nov 03 12:39:22 user nova-compute[74960]: iface.tcp_timer_scale = 0
Nov 03 12:39:22 user nova-compute[74960]: iface.tcp_timestamp = <empty>
Nov 03 12:39:22 user nova-compute[74960]: iface.redirect = <empty>
Nov 03 12:39:22 user nova-compute[74960]: iface.def_task_mgmt_timeout = 0
Nov 03 12:39:22 user nova-compute[74960]: iface.header_digest = <empty>
Nov 03 12:39:22 user nova-compute[74960]: iface.data_digest = <empty>
Nov 03 12:39:22 user nova-compute[74960]: iface.immediate_data = <empty>
Nov 03 12:39:22 user nova-compute[74960]: iface.initial_r2t = <empty>
Nov 03 12:39:22 user nova-compute[74960]: iface.data_seq_inorder = <empty>
Nov 03 12:39:22 user nova-compute[74960]: iface.data_pdu_inorder = <empty>
Nov 03 12:39:22 user nova-compute[74960]: iface.erl = 0
Nov 03 12:39:22 user nova-compute[74960]: iface.max_receive_data_len = 0
Nov 03 12:39:22 user nova-compute[74960]: iface.first_burst_len = 0
Nov 03 12:39:22 user nova-compute[74960]: iface.max_outstanding_r2t = 0
Nov 03 12:39:22 user nova-compute[74960]: iface.max_burst_len = 0
Nov 03 12:39:22 user nova-compute[74960]: iface.chap_auth = <empty>
Nov 03 12:39:22 user nova-compute[74960]: iface.bidi_chap = <empty>
Nov 03 12:39:22 user nova-compute[74960]: iface.strict_login_compliance = <empty>
Nov 03 12:39:22 user nova-compute[74960]: iface.discovery_auth = <empty>
Nov 03 12:39:22 user nova-compute[74960]: iface.discovery_logout = <empty>
Nov 03 12:39:22 user nova-compute[74960]: node.discovery_address = <empty>
Nov 03 12:39:22 user nova-compute[74960]: node.discovery_port = 0
Nov 03 12:39:22 user nova-compute[74960]: node.discovery_type = static
Nov 03 12:39:22 user nova-compute[74960]: node.session.initial_cmdsn = 0
Nov 03 12:39:22 user nova-compute[74960]: node.session.initial_login_retry_max = 8
Nov 03 12:39:22 user nova-compute[74960]: node.session.xmit_thread_priority = -20
Nov 03 12:39:22 user nova-compute[74960]: node.session.cmds_max = 128
Nov 03 12:39:22 user nova-compute[74960]: node.session.queue_depth = 32
Nov 03 12:39:22 user nova-compute[74960]: node.session.nr_sessions = 1
Nov 03 12:39:22 user nova-compute[74960]: node.session.auth.authmethod = CHAP
Nov 03 12:39:22 user nova-compute[74960]: node.session.auth.username = AOzUElvi
Nov 03 12:39:22 user nova-compute[74960]: node.session.auth.password = ***
Nov 03 12:39:22 user nova-compute[74960]: node.session.auth.username_in = <empty>
Nov 03 12:39:22 user nova-compute[74960]: node.session.auth.password_in = <empty>
Nov 03 12:39:22 user nova-compute[74960]: node.session.auth.chap_algs = MD5
Nov 03 12:39:22 user nova-compute[74960]: node.session.timeo.replacement_timeout = 120
Nov 03 12:39:22 user nova-compute[74960]: node.session.err_timeo.abort_timeout = 15
Nov 03 12:39:22 user nova-compute[74960]: node.session.err_timeo.lu_reset_timeout = 30
Nov 03 12:39:22 user nova-compute[74960]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 03 12:39:22 user nova-compute[74960]: node.session.err_timeo.host_reset_timeout = 60
Nov 03 12:39:22 user nova-compute[74960]: node.session.iscsi.FastAbort = Yes
Nov 03 12:39:22 user nova-compute[74960]: node.session.iscsi.InitialR2T = No
Nov 03 12:39:22 user nova-compute[74960]: node.session.iscsi.ImmediateData = Yes
Nov 03 12:39:22 user nova-compute[74960]: node.session.iscsi.FirstBurstLength = 262144
Nov 03 12:39:22 user nova-compute[74960]: node.session.iscsi.MaxBurstLength = 16776192
Nov 03 12:39:22 user nova-compute[74960]: node.session.iscsi.DefaultTime2Retain = 0
Nov 03 12:39:22 user nova-compute[74960]: node.session.iscsi.DefaultTime2Wait = 2
Nov 03 12:39:22 user nova-compute[74960]: node.session.iscsi.MaxConnections = 1
Nov 03 12:39:22 user nova-compute[74960]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 03 12:39:22 user nova-compute[74960]: node.session.iscsi.ERL = 0
Nov 03 12:39:22 user nova-compute[74960]: node.session.scan = manual
Nov 03 12:39:22 user nova-compute[74960]: node.session.reopen_max = 0
Nov 03 12:39:22 user nova-compute[74960]: node.conn[0].address = 172.16.0.220
Nov 03 12:39:22 user nova-compute[74960]: node.conn[0].port = 3260
Nov 03 12:39:22 user nova-compute[74960]: node.conn[0].startup = manual
Nov 03 12:39:22 user nova-compute[74960]: node.conn[0].tcp.window_size = 524288
Nov 03 12:39:22 user nova-compute[74960]: node.conn[0].tcp.type_of_service = 0
Nov 03 12:39:22 user nova-compute[74960]: node.conn[0].timeo.logout_timeout = 15
Nov 03 12:39:22 user nova-compute[74960]: node.conn[0].timeo.login_timeout = 15
Nov 03 12:39:22 user nova-compute[74960]: node.conn[0].timeo.auth_timeout = 45
Nov 03 12:39:22 user nova-compute[74960]: node.conn[0].timeo.noop_out_interval = 5
Nov 03 12:39:22 user nova-compute[74960]: node.conn[0].timeo.noop_out_timeout = 5
Nov 03 12:39:22 user nova-compute[74960]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 03 12:39:22 user nova-compute[74960]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 03 12:39:22 user nova-compute[74960]: node.conn[0].iscsi.HeaderDigest = None
Nov 03 12:39:22 user nova-compute[74960]: node.conn[0].iscsi.DataDigest = None
Nov 03 12:39:22 user nova-compute[74960]: node.conn[0].iscsi.IFMarker = No
Nov 03 12:39:22 user nova-compute[74960]: node.conn[0].iscsi.OFMarker = No
Nov 03 12:39:22 user nova-compute[74960]: # END RECORD
Nov 03 12:39:22 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:39:22 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:39:22 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:39:22 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d061e45-8d18-415f-a374-55d83d83cb61]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:39:22 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ecdbaf0-a494-4d37-97a0-43c7c1425f16 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:39:22 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:39:22 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:39:22 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[47c9710a-f844-4522-8edc-0f7dc4f17b5a]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:39:22 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ecdbaf0-a494-4d37-97a0-43c7c1425f16 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:39:22 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AOzUElvi {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:39:22 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AOzUElvi" returned: 0 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:39:22 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[41b214d3-d01a-48b0-be89-299d2b348d54]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:39:22 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ecdbaf0-a494-4d37-97a0-43c7c1425f16 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AOzUElvi'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:39:22 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:39:22 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:39:22 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c5e6050-e5d9-4cfc-9d51-ea3c191f4a1c]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:39:22 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ecdbaf0-a494-4d37-97a0-43c7c1425f16 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:39:22 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:39:22 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:39:22 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[c172c3a0-fffe-4d21-8f45-c193be185d8a]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61 (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:39:22 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ecdbaf0-a494-4d37-97a0-43c7c1425f16 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:39:22 user nova-compute[74960]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7 (non-flash)
Nov 03 12:39:22 user nova-compute[74960]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61 (non-flash)
Nov 03 12:39:22 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:39:22 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ecdbaf0-a494-4d37-97a0-43c7c1425f16 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:39:22 user nova-compute[74960]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7 (non-flash)
Nov 03 12:39:22 user nova-compute[74960]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61 (non-flash)
Nov 03 12:39:22 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:39:22 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-6ecdbaf0-a494-4d37-97a0-43c7c1425f16 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.150s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:39:22 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ecdbaf0-a494-4d37-97a0-43c7c1425f16 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Connected to 172.16.0.220:3260 {{(pid=74960) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 12:39:22 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-6ecdbaf0-a494-4d37-97a0-43c7c1425f16 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] HCTL ('36', '0', '0', 0) found on session 33 with lun 0 {{(pid=74960) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 12:39:22 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-6ecdbaf0-a494-4d37-97a0-43c7c1425f16 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Scanning host 36 c: 0, t: 0, l: 0) {{(pid=74960) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 12:39:22 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:39:22 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.014s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:39:22 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[6101034e-bfda-4adc-8222-aa35653c293d]: (4, ('0 0 0', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:39:22 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-6ecdbaf0-a494-4d37-97a0-43c7c1425f16 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Searching for a device in session 33 and hctl ('36', '0', '0', 0) yield: sde {{(pid=74960) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 12:39:22 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ecdbaf0-a494-4d37-97a0-43c7c1425f16 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AOzUElvi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74960) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 12:39:22 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-6ecdbaf0-a494-4d37-97a0-43c7c1425f16 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.174s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:39:22 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ecdbaf0-a494-4d37-97a0-43c7c1425f16 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] <== connect_volume: return (175ms) {'type': 'block', 'scsi_wwn': '23033643435623566', 'path': '/dev/sde'} {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:39:22 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ecdbaf0-a494-4d37-97a0-43c7c1425f16 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23033643435623566', 'path': '/dev/sde'} {{(pid=74960) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 12:39:22 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-6ecdbaf0-a494-4d37-97a0-43c7c1425f16 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:36:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-657586703',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-657586703',id=37,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-03T12:37:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dbc95d68d5e147e1953c855169b17091',ramdisk_id='',reservation_id='r-phhx6hay',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-195954071',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:37:27Z,user_data=None,user_id='c473215929044a108c9fc4d6327dfc3d',uuid=895d6de1-b5d9-4555-af57-f7816183be58,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "59f6ddba-fb77-4d36-98da-f4d645355650", "address": "fa:16:3e:df:ac:19", "network": {"id": "dec66832-56d5-4d68-b11f-8e8eed38f045", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-79099436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-79099436-network", "vif_mac": "fa:16:3e:df:ac:19"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc95d68d5e147e1953c855169b17091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59f6ddba-fb", "ovs_interfaceid": "59f6ddba-fb77-4d36-98da-f4d645355650", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74960) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 12:39:22 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-6ecdbaf0-a494-4d37-97a0-43c7c1425f16 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Converting VIF {"id": "59f6ddba-fb77-4d36-98da-f4d645355650", "address": "fa:16:3e:df:ac:19", "network": {"id": "dec66832-56d5-4d68-b11f-8e8eed38f045", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-79099436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-79099436-network", "vif_mac": "fa:16:3e:df:ac:19"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc95d68d5e147e1953c855169b17091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59f6ddba-fb", "ovs_interfaceid": "59f6ddba-fb77-4d36-98da-f4d645355650", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:39:22 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-6ecdbaf0-a494-4d37-97a0-43c7c1425f16 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:df:ac:19,bridge_name='br-int',has_traffic_filtering=True,id=59f6ddba-fb77-4d36-98da-f4d645355650,network=Network(dec66832-56d5-4d68-b11f-8e8eed38f045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59f6ddba-fb') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:39:22 user nova-compute[74960]: DEBUG nova.objects.instance [None req-6ecdbaf0-a494-4d37-97a0-43c7c1425f16 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Lazy-loading 'pci_devices' on Instance uuid 895d6de1-b5d9-4555-af57-f7816183be58 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:39:22 user nova-compute[74960]: DEBUG nova.objects.base [None req-6ecdbaf0-a494-4d37-97a0-43c7c1425f16 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Object Instance<895d6de1-b5d9-4555-af57-f7816183be58> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74960) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 12:39:22 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-6ecdbaf0-a494-4d37-97a0-43c7c1425f16 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] End _get_guest_xml xml=<domain type="kvm">
Nov 03 12:39:22 user nova-compute[74960]:   <uuid>895d6de1-b5d9-4555-af57-f7816183be58</uuid>
Nov 03 12:39:22 user nova-compute[74960]:   <name>instance-00000025</name>
Nov 03 12:39:22 user nova-compute[74960]:   <memory>524288</memory>
Nov 03 12:39:22 user nova-compute[74960]:   <vcpu>1</vcpu>
Nov 03 12:39:22 user nova-compute[74960]:   <metadata>
Nov 03 12:39:22 user nova-compute[74960]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 12:39:22 user nova-compute[74960]:       <nova:package version="0.0.0"/>
Nov 03 12:39:22 user nova-compute[74960]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-657586703</nova:name>
Nov 03 12:39:22 user nova-compute[74960]:       <nova:creationTime>2023-11-03 12:39:21</nova:creationTime>
Nov 03 12:39:22 user nova-compute[74960]:       <nova:flavor name="m1.tiny">
Nov 03 12:39:22 user nova-compute[74960]:         <nova:memory>512</nova:memory>
Nov 03 12:39:22 user nova-compute[74960]:         <nova:disk>1</nova:disk>
Nov 03 12:39:22 user nova-compute[74960]:         <nova:swap>0</nova:swap>
Nov 03 12:39:22 user nova-compute[74960]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 12:39:22 user nova-compute[74960]:         <nova:vcpus>1</nova:vcpus>
Nov 03 12:39:22 user nova-compute[74960]:       </nova:flavor>
Nov 03 12:39:22 user nova-compute[74960]:       <nova:owner>
Nov 03 12:39:22 user nova-compute[74960]:         <nova:user uuid="c473215929044a108c9fc4d6327dfc3d">tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member</nova:user>
Nov 03 12:39:22 user nova-compute[74960]:         <nova:project uuid="dbc95d68d5e147e1953c855169b17091">tempest-ServerBootFromVolumeStableRescueTest-195954071</nova:project>
Nov 03 12:39:22 user nova-compute[74960]:       </nova:owner>
Nov 03 12:39:22 user nova-compute[74960]:       <nova:root type="image" uuid="549f51ba-ac69-494b-8de1-34635aa2d7cf"/>
Nov 03 12:39:22 user nova-compute[74960]:       <nova:ports>
Nov 03 12:39:22 user nova-compute[74960]:         <nova:port uuid="59f6ddba-fb77-4d36-98da-f4d645355650">
Nov 03 12:39:22 user nova-compute[74960]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 03 12:39:22 user nova-compute[74960]:         </nova:port>
Nov 03 12:39:22 user nova-compute[74960]:       </nova:ports>
Nov 03 12:39:22 user nova-compute[74960]:     </nova:instance>
Nov 03 12:39:22 user nova-compute[74960]:   </metadata>
Nov 03 12:39:22 user nova-compute[74960]:   <sysinfo type="smbios">
Nov 03 12:39:22 user nova-compute[74960]:     <system>
Nov 03 12:39:22 user nova-compute[74960]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 12:39:22 user nova-compute[74960]:       <entry name="product">OpenStack Nova</entry>
Nov 03 12:39:22 user nova-compute[74960]:       <entry name="version">0.0.0</entry>
Nov 03 12:39:22 user nova-compute[74960]:       <entry name="serial">895d6de1-b5d9-4555-af57-f7816183be58</entry>
Nov 03 12:39:22 user nova-compute[74960]:       <entry name="uuid">895d6de1-b5d9-4555-af57-f7816183be58</entry>
Nov 03 12:39:22 user nova-compute[74960]:       <entry name="family">Virtual Machine</entry>
Nov 03 12:39:22 user nova-compute[74960]:     </system>
Nov 03 12:39:22 user nova-compute[74960]:   </sysinfo>
Nov 03 12:39:22 user nova-compute[74960]:   <os>
Nov 03 12:39:22 user nova-compute[74960]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 12:39:22 user nova-compute[74960]:     <smbios mode="sysinfo"/>
Nov 03 12:39:22 user nova-compute[74960]:   </os>
Nov 03 12:39:22 user nova-compute[74960]:   <features>
Nov 03 12:39:22 user nova-compute[74960]:     <acpi/>
Nov 03 12:39:22 user nova-compute[74960]:     <apic/>
Nov 03 12:39:22 user nova-compute[74960]:     <vmcoreinfo/>
Nov 03 12:39:22 user nova-compute[74960]:   </features>
Nov 03 12:39:22 user nova-compute[74960]:   <clock offset="utc">
Nov 03 12:39:22 user nova-compute[74960]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 12:39:22 user nova-compute[74960]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 12:39:22 user nova-compute[74960]:     <timer name="hpet" present="no"/>
Nov 03 12:39:22 user nova-compute[74960]:   </clock>
Nov 03 12:39:22 user nova-compute[74960]:   <cpu mode="custom" match="exact">
Nov 03 12:39:22 user nova-compute[74960]:     <model>Nehalem</model>
Nov 03 12:39:22 user nova-compute[74960]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 12:39:22 user nova-compute[74960]:   </cpu>
Nov 03 12:39:22 user nova-compute[74960]:   <devices>
Nov 03 12:39:22 user nova-compute[74960]:     <disk type="block" device="disk">
Nov 03 12:39:22 user nova-compute[74960]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 12:39:22 user nova-compute[74960]:       <source dev="/dev/sde"/>
Nov 03 12:39:22 user nova-compute[74960]:       <target dev="vda" bus="virtio"/>
Nov 03 12:39:22 user nova-compute[74960]:       <serial>0b25e85a-a887-4c1b-a798-bd360de0e9d7</serial>
Nov 03 12:39:22 user nova-compute[74960]:     </disk>
Nov 03 12:39:22 user nova-compute[74960]:     <disk type="file" device="disk">
Nov 03 12:39:22 user nova-compute[74960]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 12:39:22 user nova-compute[74960]:       <source file="/opt/stack/data/nova/instances/895d6de1-b5d9-4555-af57-f7816183be58/disk.rescue"/>
Nov 03 12:39:22 user nova-compute[74960]:       <target dev="vdb" bus="virtio"/>
Nov 03 12:39:22 user nova-compute[74960]:       <boot order="1"/>
Nov 03 12:39:22 user nova-compute[74960]:     </disk>
Nov 03 12:39:22 user nova-compute[74960]:     <interface type="ethernet">
Nov 03 12:39:22 user nova-compute[74960]:       <mac address="fa:16:3e:df:ac:19"/>
Nov 03 12:39:22 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:39:22 user nova-compute[74960]:       <mtu size="1442"/>
Nov 03 12:39:22 user nova-compute[74960]:       <target dev="tap59f6ddba-fb"/>
Nov 03 12:39:22 user nova-compute[74960]:     </interface>
Nov 03 12:39:22 user nova-compute[74960]:     <serial type="pty">
Nov 03 12:39:22 user nova-compute[74960]:       <log file="/opt/stack/data/nova/instances/895d6de1-b5d9-4555-af57-f7816183be58/console.log" append="off"/>
Nov 03 12:39:22 user nova-compute[74960]:     </serial>
Nov 03 12:39:22 user nova-compute[74960]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 12:39:22 user nova-compute[74960]:     <video>
Nov 03 12:39:22 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:39:22 user nova-compute[74960]:     </video>
Nov 03 12:39:22 user nova-compute[74960]:     <rng model="virtio">
Nov 03 12:39:22 user nova-compute[74960]:       <backend model="random">/dev/urandom</backend>
Nov 03 12:39:22 user nova-compute[74960]:     </rng>
Nov 03 12:39:22 user nova-compute[74960]:     <controller type="usb" index="0" model="none"/>
Nov 03 12:39:22 user nova-compute[74960]:     <memballoon model="virtio">
Nov 03 12:39:22 user nova-compute[74960]:       <stats period="10"/>
Nov 03 12:39:22 user nova-compute[74960]:     </memballoon>
Nov 03 12:39:22 user nova-compute[74960]:   </devices>
Nov 03 12:39:22 user nova-compute[74960]: </domain>
Nov 03 12:39:22 user nova-compute[74960]:  {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 12:39:22 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] Instance destroyed successfully.
Nov 03 12:39:22 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-6ecdbaf0-a494-4d37-97a0-43c7c1425f16 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] No BDM found with device name vda, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:39:22 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-6ecdbaf0-a494-4d37-97a0-43c7c1425f16 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:39:22 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-6ecdbaf0-a494-4d37-97a0-43c7c1425f16 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] No VIF found with MAC fa:16:3e:df:ac:19, not building metadata {{(pid=74960) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 12:39:23 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:39:23 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:39:23 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:39:23 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:39:23 user nova-compute[74960]: DEBUG nova.compute.manager [req-23708a62-b179-4589-ab58-e9b19d04d9c6 req-86bfa518-12f2-4649-adb0-dba00ed16a97 service nova] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] Received event network-vif-plugged-59f6ddba-fb77-4d36-98da-f4d645355650 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:39:23 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-23708a62-b179-4589-ab58-e9b19d04d9c6 req-86bfa518-12f2-4649-adb0-dba00ed16a97 service nova] Acquiring lock "895d6de1-b5d9-4555-af57-f7816183be58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:39:23 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-23708a62-b179-4589-ab58-e9b19d04d9c6 req-86bfa518-12f2-4649-adb0-dba00ed16a97 service nova] Lock "895d6de1-b5d9-4555-af57-f7816183be58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:39:23 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-23708a62-b179-4589-ab58-e9b19d04d9c6 req-86bfa518-12f2-4649-adb0-dba00ed16a97 service nova] Lock "895d6de1-b5d9-4555-af57-f7816183be58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:39:23 user nova-compute[74960]: DEBUG nova.compute.manager [req-23708a62-b179-4589-ab58-e9b19d04d9c6 req-86bfa518-12f2-4649-adb0-dba00ed16a97 service nova] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] No waiting events found dispatching network-vif-plugged-59f6ddba-fb77-4d36-98da-f4d645355650 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:39:23 user nova-compute[74960]: WARNING nova.compute.manager [req-23708a62-b179-4589-ab58-e9b19d04d9c6 req-86bfa518-12f2-4649-adb0-dba00ed16a97 service nova] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] Received unexpected event network-vif-plugged-59f6ddba-fb77-4d36-98da-f4d645355650 for instance with vm_state active and task_state rescuing.
Nov 03 12:39:23 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:39:23 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:39:25 user nova-compute[74960]: DEBUG nova.compute.manager [req-10c21631-f8d4-449a-9272-3b952c11973a req-974c1d97-6bf7-4105-a6a2-bc079ef09ecb service nova] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] Received event network-vif-plugged-59f6ddba-fb77-4d36-98da-f4d645355650 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:39:25 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-10c21631-f8d4-449a-9272-3b952c11973a req-974c1d97-6bf7-4105-a6a2-bc079ef09ecb service nova] Acquiring lock "895d6de1-b5d9-4555-af57-f7816183be58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:39:25 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-10c21631-f8d4-449a-9272-3b952c11973a req-974c1d97-6bf7-4105-a6a2-bc079ef09ecb service nova] Lock "895d6de1-b5d9-4555-af57-f7816183be58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:39:25 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-10c21631-f8d4-449a-9272-3b952c11973a req-974c1d97-6bf7-4105-a6a2-bc079ef09ecb service nova] Lock "895d6de1-b5d9-4555-af57-f7816183be58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:39:25 user nova-compute[74960]: DEBUG nova.compute.manager [req-10c21631-f8d4-449a-9272-3b952c11973a req-974c1d97-6bf7-4105-a6a2-bc079ef09ecb service nova] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] No waiting events found dispatching network-vif-plugged-59f6ddba-fb77-4d36-98da-f4d645355650 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:39:25 user nova-compute[74960]: WARNING nova.compute.manager [req-10c21631-f8d4-449a-9272-3b952c11973a req-974c1d97-6bf7-4105-a6a2-bc079ef09ecb service nova] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] Received unexpected event network-vif-plugged-59f6ddba-fb77-4d36-98da-f4d645355650 for instance with vm_state active and task_state rescuing.
Nov 03 12:39:25 user nova-compute[74960]: DEBUG nova.compute.manager [None req-6ecdbaf0-a494-4d37-97a0-43c7c1425f16 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] Checking state {{(pid=74960) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 12:39:26 user nova-compute[74960]: DEBUG nova.objects.instance [None req-2c734201-89bc-410b-a40a-70d8429ad8e3 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Lazy-loading 'flavor' on Instance uuid 5b7b95c0-3726-4a1c-a384-ec91abf75225 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:39:26 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-2c734201-89bc-410b-a40a-70d8429ad8e3 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Acquiring lock "refresh_cache-5b7b95c0-3726-4a1c-a384-ec91abf75225" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:39:26 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-2c734201-89bc-410b-a40a-70d8429ad8e3 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Acquired lock "refresh_cache-5b7b95c0-3726-4a1c-a384-ec91abf75225" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:39:26 user nova-compute[74960]: DEBUG nova.network.neutron [None req-2c734201-89bc-410b-a40a-70d8429ad8e3 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] Building network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 12:39:26 user nova-compute[74960]: DEBUG nova.objects.instance [None req-2c734201-89bc-410b-a40a-70d8429ad8e3 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Lazy-loading 'info_cache' on Instance uuid 5b7b95c0-3726-4a1c-a384-ec91abf75225 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:39:26 user nova-compute[74960]: DEBUG nova.objects.base [None req-2c734201-89bc-410b-a40a-70d8429ad8e3 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Object Instance<5b7b95c0-3726-4a1c-a384-ec91abf75225> lazy-loaded attributes: flavor,info_cache {{(pid=74960) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 12:39:26 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:39:26 user nova-compute[74960]: DEBUG nova.network.neutron [None req-2c734201-89bc-410b-a40a-70d8429ad8e3 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] Updating instance_info_cache with network_info: [{"id": "091cbb89-dd8a-448e-963a-3dbcafde6bb1", "address": "fa:16:3e:cc:a5:1b", "network": {"id": "3eaeac55-9eb7-4301-b5a7-d13735656d8e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-826950903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9160afcfdb74ba2aad7bc79e628e96f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap091cbb89-dd", "ovs_interfaceid": "091cbb89-dd8a-448e-963a-3dbcafde6bb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:39:26 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-2c734201-89bc-410b-a40a-70d8429ad8e3 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Releasing lock "refresh_cache-5b7b95c0-3726-4a1c-a384-ec91abf75225" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:39:26 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] Instance destroyed successfully.
Nov 03 12:39:26 user nova-compute[74960]: DEBUG nova.objects.instance [None req-2c734201-89bc-410b-a40a-70d8429ad8e3 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Lazy-loading 'resources' on Instance uuid 5b7b95c0-3726-4a1c-a384-ec91abf75225 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:39:26 user nova-compute[74960]: DEBUG nova.objects.base [None req-2c734201-89bc-410b-a40a-70d8429ad8e3 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Object Instance<5b7b95c0-3726-4a1c-a384-ec91abf75225> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74960) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 12:39:26 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-2c734201-89bc-410b-a40a-70d8429ad8e3 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:30:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-666638080',display_name='tempest-AttachVolumeTestJSON-server-666638080',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-666638080',id=28,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIQ2G2kW7RG3ei1U+rVcmbI+Ton8kNiQZeMxqXkABUJCy9iuRMgTZBhGnWGCs6R7DHln/91d5py8pZC0KUaGy+7UnlGfb1FgAKzTpiPtdr0uDnrIs+6hQLHu9y+wv2TiKg==',key_name='tempest-keypair-691388173',keypairs=<?>,launch_index=0,launched_at=2023-11-03T12:30:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='a9160afcfdb74ba2aad7bc79e628e96f',ramdisk_id='',reservation_id='r-na1kxuhs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-847320603',owner_user_name='tempest-AttachVolumeTestJSON-847320603-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T12:37:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c599d8677454b60b9434689322a6de2',uuid=5b7b95c0-3726-4a1c-a384-ec91abf75225,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "091cbb89-dd8a-448e-963a-3dbcafde6bb1", "address": "fa:16:3e:cc:a5:1b", "network": {"id": "3eaeac55-9eb7-4301-b5a7-d13735656d8e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-826950903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9160afcfdb74ba2aad7bc79e628e96f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap091cbb89-dd", "ovs_interfaceid": "091cbb89-dd8a-448e-963a-3dbcafde6bb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 12:39:26 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-2c734201-89bc-410b-a40a-70d8429ad8e3 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Converting VIF {"id": "091cbb89-dd8a-448e-963a-3dbcafde6bb1", "address": "fa:16:3e:cc:a5:1b", "network": {"id": "3eaeac55-9eb7-4301-b5a7-d13735656d8e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-826950903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9160afcfdb74ba2aad7bc79e628e96f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap091cbb89-dd", "ovs_interfaceid": "091cbb89-dd8a-448e-963a-3dbcafde6bb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:39:26 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-2c734201-89bc-410b-a40a-70d8429ad8e3 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:a5:1b,bridge_name='br-int',has_traffic_filtering=True,id=091cbb89-dd8a-448e-963a-3dbcafde6bb1,network=Network(3eaeac55-9eb7-4301-b5a7-d13735656d8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap091cbb89-dd') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:39:26 user nova-compute[74960]: DEBUG os_vif [None req-2c734201-89bc-410b-a40a-70d8429ad8e3 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:a5:1b,bridge_name='br-int',has_traffic_filtering=True,id=091cbb89-dd8a-448e-963a-3dbcafde6bb1,network=Network(3eaeac55-9eb7-4301-b5a7-d13735656d8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap091cbb89-dd') {{(pid=74960) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 12:39:26 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:39:26 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap091cbb89-dd, bridge=br-int, if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:39:26 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:39:26 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:39:26 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:39:26 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=731582ce-16eb-4b33-b60e-f5a6837e819b) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:39:26 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:39:26 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:39:26 user nova-compute[74960]: INFO os_vif [None req-2c734201-89bc-410b-a40a-70d8429ad8e3 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:a5:1b,bridge_name='br-int',has_traffic_filtering=True,id=091cbb89-dd8a-448e-963a-3dbcafde6bb1,network=Network(3eaeac55-9eb7-4301-b5a7-d13735656d8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap091cbb89-dd')
Nov 03 12:39:26 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-2c734201-89bc-410b-a40a-70d8429ad8e3 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] Start _get_guest_xml network_info=[{"id": "091cbb89-dd8a-448e-963a-3dbcafde6bb1", "address": "fa:16:3e:cc:a5:1b", "network": {"id": "3eaeac55-9eb7-4301-b5a7-d13735656d8e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-826950903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9160afcfdb74ba2aad7bc79e628e96f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap091cbb89-dd", "ovs_interfaceid": "091cbb89-dd8a-448e-963a-3dbcafde6bb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=549f51ba-ac69-494b-8de1-34635aa2d7cf,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'image_id': '549f51ba-ac69-494b-8de1-34635aa2d7cf'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 12:39:26 user nova-compute[74960]: DEBUG nova.objects.instance [None req-2c734201-89bc-410b-a40a-70d8429ad8e3 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Lazy-loading 'numa_topology' on Instance uuid 5b7b95c0-3726-4a1c-a384-ec91abf75225 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:39:26 user nova-compute[74960]: DEBUG nova.objects.base [None req-2c734201-89bc-410b-a40a-70d8429ad8e3 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Object Instance<5b7b95c0-3726-4a1c-a384-ec91abf75225> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74960) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 12:39:26 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-2c734201-89bc-410b-a40a-70d8429ad8e3 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:39:26 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-2c734201-89bc-410b-a40a-70d8429ad8e3 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:39:26 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-2c734201-89bc-410b-a40a-70d8429ad8e3 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 12:39:26 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-2c734201-89bc-410b-a40a-70d8429ad8e3 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] CPU controller missing on host. {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 12:39:26 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-2c734201-89bc-410b-a40a-70d8429ad8e3 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 12:39:26 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-2c734201-89bc-410b-a40a-70d8429ad8e3 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] CPU controller found on host. {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 12:39:26 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-2c734201-89bc-410b-a40a-70d8429ad8e3 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74960) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 12:39:26 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-2c734201-89bc-410b-a40a-70d8429ad8e3 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=549f51ba-ac69-494b-8de1-34635aa2d7cf,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 12:39:26 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-2c734201-89bc-410b-a40a-70d8429ad8e3 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Flavor limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 12:39:26 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-2c734201-89bc-410b-a40a-70d8429ad8e3 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Image limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 12:39:26 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-2c734201-89bc-410b-a40a-70d8429ad8e3 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Flavor pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 12:39:26 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-2c734201-89bc-410b-a40a-70d8429ad8e3 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Image pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 12:39:26 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-2c734201-89bc-410b-a40a-70d8429ad8e3 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 12:39:26 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-2c734201-89bc-410b-a40a-70d8429ad8e3 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 12:39:26 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-2c734201-89bc-410b-a40a-70d8429ad8e3 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 12:39:26 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-2c734201-89bc-410b-a40a-70d8429ad8e3 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Got 1 possible topologies {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 12:39:26 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-2c734201-89bc-410b-a40a-70d8429ad8e3 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 12:39:26 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-2c734201-89bc-410b-a40a-70d8429ad8e3 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 12:39:26 user nova-compute[74960]: DEBUG nova.objects.instance [None req-2c734201-89bc-410b-a40a-70d8429ad8e3 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5b7b95c0-3726-4a1c-a384-ec91abf75225 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:39:26 user nova-compute[74960]: DEBUG nova.objects.base [None req-2c734201-89bc-410b-a40a-70d8429ad8e3 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Object Instance<5b7b95c0-3726-4a1c-a384-ec91abf75225> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74960) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 12:39:26 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-2c734201-89bc-410b-a40a-70d8429ad8e3 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:30:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-666638080',display_name='tempest-AttachVolumeTestJSON-server-666638080',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-666638080',id=28,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIQ2G2kW7RG3ei1U+rVcmbI+Ton8kNiQZeMxqXkABUJCy9iuRMgTZBhGnWGCs6R7DHln/91d5py8pZC0KUaGy+7UnlGfb1FgAKzTpiPtdr0uDnrIs+6hQLHu9y+wv2TiKg==',key_name='tempest-keypair-691388173',keypairs=<?>,launch_index=0,launched_at=2023-11-03T12:30:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='a9160afcfdb74ba2aad7bc79e628e96f',ramdisk_id='',reservation_id='r-na1kxuhs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-847320603',owner_user_name='tempest-AttachVolumeTestJSON-847320603-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T12:37:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c599d8677454b60b9434689322a6de2',uuid=5b7b95c0-3726-4a1c-a384-ec91abf75225,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "091cbb89-dd8a-448e-963a-3dbcafde6bb1", "address": "fa:16:3e:cc:a5:1b", "network": {"id": "3eaeac55-9eb7-4301-b5a7-d13735656d8e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-826950903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9160afcfdb74ba2aad7bc79e628e96f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap091cbb89-dd", "ovs_interfaceid": "091cbb89-dd8a-448e-963a-3dbcafde6bb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74960) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 12:39:26 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-2c734201-89bc-410b-a40a-70d8429ad8e3 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Converting VIF {"id": "091cbb89-dd8a-448e-963a-3dbcafde6bb1", "address": "fa:16:3e:cc:a5:1b", "network": {"id": "3eaeac55-9eb7-4301-b5a7-d13735656d8e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-826950903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9160afcfdb74ba2aad7bc79e628e96f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap091cbb89-dd", "ovs_interfaceid": "091cbb89-dd8a-448e-963a-3dbcafde6bb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:39:26 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-2c734201-89bc-410b-a40a-70d8429ad8e3 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:a5:1b,bridge_name='br-int',has_traffic_filtering=True,id=091cbb89-dd8a-448e-963a-3dbcafde6bb1,network=Network(3eaeac55-9eb7-4301-b5a7-d13735656d8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap091cbb89-dd') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:39:26 user nova-compute[74960]: DEBUG nova.objects.instance [None req-2c734201-89bc-410b-a40a-70d8429ad8e3 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Lazy-loading 'pci_devices' on Instance uuid 5b7b95c0-3726-4a1c-a384-ec91abf75225 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:39:26 user nova-compute[74960]: DEBUG nova.objects.base [None req-2c734201-89bc-410b-a40a-70d8429ad8e3 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Object Instance<5b7b95c0-3726-4a1c-a384-ec91abf75225> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74960) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 12:39:26 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-2c734201-89bc-410b-a40a-70d8429ad8e3 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] End _get_guest_xml xml=<domain type="kvm">
Nov 03 12:39:26 user nova-compute[74960]:   <uuid>5b7b95c0-3726-4a1c-a384-ec91abf75225</uuid>
Nov 03 12:39:26 user nova-compute[74960]:   <name>instance-0000001c</name>
Nov 03 12:39:26 user nova-compute[74960]:   <memory>524288</memory>
Nov 03 12:39:26 user nova-compute[74960]:   <vcpu>1</vcpu>
Nov 03 12:39:26 user nova-compute[74960]:   <metadata>
Nov 03 12:39:26 user nova-compute[74960]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 12:39:26 user nova-compute[74960]:       <nova:package version="0.0.0"/>
Nov 03 12:39:26 user nova-compute[74960]:       <nova:name>tempest-AttachVolumeTestJSON-server-666638080</nova:name>
Nov 03 12:39:26 user nova-compute[74960]:       <nova:creationTime>2023-11-03 12:39:26</nova:creationTime>
Nov 03 12:39:26 user nova-compute[74960]:       <nova:flavor name="m1.tiny">
Nov 03 12:39:26 user nova-compute[74960]:         <nova:memory>512</nova:memory>
Nov 03 12:39:26 user nova-compute[74960]:         <nova:disk>1</nova:disk>
Nov 03 12:39:26 user nova-compute[74960]:         <nova:swap>0</nova:swap>
Nov 03 12:39:26 user nova-compute[74960]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 12:39:26 user nova-compute[74960]:         <nova:vcpus>1</nova:vcpus>
Nov 03 12:39:26 user nova-compute[74960]:       </nova:flavor>
Nov 03 12:39:26 user nova-compute[74960]:       <nova:owner>
Nov 03 12:39:26 user nova-compute[74960]:         <nova:user uuid="8c599d8677454b60b9434689322a6de2">tempest-AttachVolumeTestJSON-847320603-project-member</nova:user>
Nov 03 12:39:26 user nova-compute[74960]:         <nova:project uuid="a9160afcfdb74ba2aad7bc79e628e96f">tempest-AttachVolumeTestJSON-847320603</nova:project>
Nov 03 12:39:26 user nova-compute[74960]:       </nova:owner>
Nov 03 12:39:26 user nova-compute[74960]:       <nova:root type="image" uuid="549f51ba-ac69-494b-8de1-34635aa2d7cf"/>
Nov 03 12:39:26 user nova-compute[74960]:       <nova:ports>
Nov 03 12:39:26 user nova-compute[74960]:         <nova:port uuid="091cbb89-dd8a-448e-963a-3dbcafde6bb1">
Nov 03 12:39:26 user nova-compute[74960]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 03 12:39:26 user nova-compute[74960]:         </nova:port>
Nov 03 12:39:26 user nova-compute[74960]:       </nova:ports>
Nov 03 12:39:26 user nova-compute[74960]:     </nova:instance>
Nov 03 12:39:26 user nova-compute[74960]:   </metadata>
Nov 03 12:39:26 user nova-compute[74960]:   <sysinfo type="smbios">
Nov 03 12:39:26 user nova-compute[74960]:     <system>
Nov 03 12:39:26 user nova-compute[74960]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 12:39:26 user nova-compute[74960]:       <entry name="product">OpenStack Nova</entry>
Nov 03 12:39:26 user nova-compute[74960]:       <entry name="version">0.0.0</entry>
Nov 03 12:39:26 user nova-compute[74960]:       <entry name="serial">5b7b95c0-3726-4a1c-a384-ec91abf75225</entry>
Nov 03 12:39:26 user nova-compute[74960]:       <entry name="uuid">5b7b95c0-3726-4a1c-a384-ec91abf75225</entry>
Nov 03 12:39:26 user nova-compute[74960]:       <entry name="family">Virtual Machine</entry>
Nov 03 12:39:26 user nova-compute[74960]:     </system>
Nov 03 12:39:26 user nova-compute[74960]:   </sysinfo>
Nov 03 12:39:26 user nova-compute[74960]:   <os>
Nov 03 12:39:26 user nova-compute[74960]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 12:39:26 user nova-compute[74960]:     <boot dev="hd"/>
Nov 03 12:39:26 user nova-compute[74960]:     <smbios mode="sysinfo"/>
Nov 03 12:39:26 user nova-compute[74960]:   </os>
Nov 03 12:39:26 user nova-compute[74960]:   <features>
Nov 03 12:39:26 user nova-compute[74960]:     <acpi/>
Nov 03 12:39:26 user nova-compute[74960]:     <apic/>
Nov 03 12:39:26 user nova-compute[74960]:     <vmcoreinfo/>
Nov 03 12:39:26 user nova-compute[74960]:   </features>
Nov 03 12:39:26 user nova-compute[74960]:   <clock offset="utc">
Nov 03 12:39:26 user nova-compute[74960]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 12:39:26 user nova-compute[74960]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 12:39:26 user nova-compute[74960]:     <timer name="hpet" present="no"/>
Nov 03 12:39:26 user nova-compute[74960]:   </clock>
Nov 03 12:39:26 user nova-compute[74960]:   <cpu mode="custom" match="exact">
Nov 03 12:39:26 user nova-compute[74960]:     <model>Nehalem</model>
Nov 03 12:39:26 user nova-compute[74960]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 12:39:26 user nova-compute[74960]:   </cpu>
Nov 03 12:39:26 user nova-compute[74960]:   <devices>
Nov 03 12:39:26 user nova-compute[74960]:     <disk type="file" device="disk">
Nov 03 12:39:26 user nova-compute[74960]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 12:39:26 user nova-compute[74960]:       <source file="/opt/stack/data/nova/instances/5b7b95c0-3726-4a1c-a384-ec91abf75225/disk"/>
Nov 03 12:39:26 user nova-compute[74960]:       <target dev="vda" bus="virtio"/>
Nov 03 12:39:26 user nova-compute[74960]:     </disk>
Nov 03 12:39:26 user nova-compute[74960]:     <interface type="ethernet">
Nov 03 12:39:26 user nova-compute[74960]:       <mac address="fa:16:3e:cc:a5:1b"/>
Nov 03 12:39:26 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:39:26 user nova-compute[74960]:       <mtu size="1442"/>
Nov 03 12:39:26 user nova-compute[74960]:       <target dev="tap091cbb89-dd"/>
Nov 03 12:39:26 user nova-compute[74960]:     </interface>
Nov 03 12:39:26 user nova-compute[74960]:     <serial type="pty">
Nov 03 12:39:26 user nova-compute[74960]:       <log file="/opt/stack/data/nova/instances/5b7b95c0-3726-4a1c-a384-ec91abf75225/console.log" append="off"/>
Nov 03 12:39:26 user nova-compute[74960]:     </serial>
Nov 03 12:39:26 user nova-compute[74960]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 12:39:26 user nova-compute[74960]:     <video>
Nov 03 12:39:26 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:39:26 user nova-compute[74960]:     </video>
Nov 03 12:39:26 user nova-compute[74960]:     <rng model="virtio">
Nov 03 12:39:26 user nova-compute[74960]:       <backend model="random">/dev/urandom</backend>
Nov 03 12:39:26 user nova-compute[74960]:     </rng>
Nov 03 12:39:26 user nova-compute[74960]:     <controller type="usb" index="0" model="none"/>
Nov 03 12:39:26 user nova-compute[74960]:     <memballoon model="virtio">
Nov 03 12:39:26 user nova-compute[74960]:       <stats period="10"/>
Nov 03 12:39:26 user nova-compute[74960]:     </memballoon>
Nov 03 12:39:26 user nova-compute[74960]:   </devices>
Nov 03 12:39:26 user nova-compute[74960]: </domain>
Nov 03 12:39:26 user nova-compute[74960]:  {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 12:39:26 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-2c734201-89bc-410b-a40a-70d8429ad8e3 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7b95c0-3726-4a1c-a384-ec91abf75225/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:39:27 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-2c734201-89bc-410b-a40a-70d8429ad8e3 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7b95c0-3726-4a1c-a384-ec91abf75225/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:39:27 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-2c734201-89bc-410b-a40a-70d8429ad8e3 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7b95c0-3726-4a1c-a384-ec91abf75225/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:39:27 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-2c734201-89bc-410b-a40a-70d8429ad8e3 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7b95c0-3726-4a1c-a384-ec91abf75225/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:39:27 user nova-compute[74960]: DEBUG nova.objects.instance [None req-2c734201-89bc-410b-a40a-70d8429ad8e3 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Lazy-loading 'trusted_certs' on Instance uuid 5b7b95c0-3726-4a1c-a384-ec91abf75225 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:39:27 user nova-compute[74960]: DEBUG nova.objects.base [None req-2c734201-89bc-410b-a40a-70d8429ad8e3 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Object Instance<5b7b95c0-3726-4a1c-a384-ec91abf75225> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74960) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 12:39:27 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-2c734201-89bc-410b-a40a-70d8429ad8e3 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:39:27 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-2c734201-89bc-410b-a40a-70d8429ad8e3 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.185s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:39:27 user nova-compute[74960]: DEBUG nova.virt.disk.api [None req-2c734201-89bc-410b-a40a-70d8429ad8e3 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5b7b95c0-3726-4a1c-a384-ec91abf75225/disk. size=1073741824 {{(pid=74960) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 12:39:27 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-2c734201-89bc-410b-a40a-70d8429ad8e3 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7b95c0-3726-4a1c-a384-ec91abf75225/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:39:27 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-2c734201-89bc-410b-a40a-70d8429ad8e3 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7b95c0-3726-4a1c-a384-ec91abf75225/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:39:27 user nova-compute[74960]: DEBUG nova.virt.disk.api [None req-2c734201-89bc-410b-a40a-70d8429ad8e3 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Cannot resize image /opt/stack/data/nova/instances/5b7b95c0-3726-4a1c-a384-ec91abf75225/disk to a smaller size. {{(pid=74960) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 12:39:27 user nova-compute[74960]: DEBUG nova.objects.instance [None req-2c734201-89bc-410b-a40a-70d8429ad8e3 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Lazy-loading 'migration_context' on Instance uuid 5b7b95c0-3726-4a1c-a384-ec91abf75225 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:39:27 user nova-compute[74960]: DEBUG nova.objects.base [None req-2c734201-89bc-410b-a40a-70d8429ad8e3 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Object Instance<5b7b95c0-3726-4a1c-a384-ec91abf75225> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74960) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 12:39:27 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-2c734201-89bc-410b-a40a-70d8429ad8e3 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:30:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-666638080',display_name='tempest-AttachVolumeTestJSON-server-666638080',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-666638080',id=28,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIQ2G2kW7RG3ei1U+rVcmbI+Ton8kNiQZeMxqXkABUJCy9iuRMgTZBhGnWGCs6R7DHln/91d5py8pZC0KUaGy+7UnlGfb1FgAKzTpiPtdr0uDnrIs+6hQLHu9y+wv2TiKg==',key_name='tempest-keypair-691388173',keypairs=<?>,launch_index=0,launched_at=2023-11-03T12:30:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='a9160afcfdb74ba2aad7bc79e628e96f',ramdisk_id='',reservation_id='r-na1kxuhs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-847320603',owner_user_name='tempest-AttachVolumeTestJSON-847320603-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:37:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c599d8677454b60b9434689322a6de2',uuid=5b7b95c0-3726-4a1c-a384-ec91abf75225,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "091cbb89-dd8a-448e-963a-3dbcafde6bb1", "address": "fa:16:3e:cc:a5:1b", "network": {"id": "3eaeac55-9eb7-4301-b5a7-d13735656d8e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-826950903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9160afcfdb74ba2aad7bc79e628e96f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap091cbb89-dd", "ovs_interfaceid": "091cbb89-dd8a-448e-963a-3dbcafde6bb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 12:39:27 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-2c734201-89bc-410b-a40a-70d8429ad8e3 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Converting VIF {"id": "091cbb89-dd8a-448e-963a-3dbcafde6bb1", "address": "fa:16:3e:cc:a5:1b", "network": {"id": "3eaeac55-9eb7-4301-b5a7-d13735656d8e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-826950903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9160afcfdb74ba2aad7bc79e628e96f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap091cbb89-dd", "ovs_interfaceid": "091cbb89-dd8a-448e-963a-3dbcafde6bb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:39:27 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-2c734201-89bc-410b-a40a-70d8429ad8e3 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:a5:1b,bridge_name='br-int',has_traffic_filtering=True,id=091cbb89-dd8a-448e-963a-3dbcafde6bb1,network=Network(3eaeac55-9eb7-4301-b5a7-d13735656d8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap091cbb89-dd') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:39:27 user nova-compute[74960]: DEBUG os_vif [None req-2c734201-89bc-410b-a40a-70d8429ad8e3 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:a5:1b,bridge_name='br-int',has_traffic_filtering=True,id=091cbb89-dd8a-448e-963a-3dbcafde6bb1,network=Network(3eaeac55-9eb7-4301-b5a7-d13735656d8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap091cbb89-dd') {{(pid=74960) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 12:39:27 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:39:27 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:39:27 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 12:39:27 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:39:27 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd1f60e77-fecd-575c-9f11-876b6007512b', '_type': 'linux-noop'}}, row=False) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:39:27 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:39:27 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:39:27 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:39:27 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap091cbb89-dd, may_exist=True, interface_attrs={}) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:39:27 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap091cbb89-dd, col_values=(('qos', UUID('18e5a9a3-8e18-4fcc-a98b-8885c88609d0')),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:39:27 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap091cbb89-dd, col_values=(('external_ids', {'iface-id': '091cbb89-dd8a-448e-963a-3dbcafde6bb1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cc:a5:1b', 'vm-uuid': '5b7b95c0-3726-4a1c-a384-ec91abf75225'}),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:39:27 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:39:27 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:39:27 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:39:27 user nova-compute[74960]: INFO os_vif [None req-2c734201-89bc-410b-a40a-70d8429ad8e3 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:a5:1b,bridge_name='br-int',has_traffic_filtering=True,id=091cbb89-dd8a-448e-963a-3dbcafde6bb1,network=Network(3eaeac55-9eb7-4301-b5a7-d13735656d8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap091cbb89-dd')
Nov 03 12:39:28 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:39:29 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:39:29 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:39:29 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:39:29 user nova-compute[74960]: DEBUG nova.compute.manager [req-55b83c5d-d98a-4d9c-8093-3dc8b7dbc226 req-1f093891-66be-4e0a-8d1b-7d5a291fd8cc service nova] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] Received event network-vif-plugged-091cbb89-dd8a-448e-963a-3dbcafde6bb1 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:39:29 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-55b83c5d-d98a-4d9c-8093-3dc8b7dbc226 req-1f093891-66be-4e0a-8d1b-7d5a291fd8cc service nova] Acquiring lock "5b7b95c0-3726-4a1c-a384-ec91abf75225-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:39:29 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-55b83c5d-d98a-4d9c-8093-3dc8b7dbc226 req-1f093891-66be-4e0a-8d1b-7d5a291fd8cc service nova] Lock "5b7b95c0-3726-4a1c-a384-ec91abf75225-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:39:29 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-55b83c5d-d98a-4d9c-8093-3dc8b7dbc226 req-1f093891-66be-4e0a-8d1b-7d5a291fd8cc service nova] Lock "5b7b95c0-3726-4a1c-a384-ec91abf75225-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:39:29 user nova-compute[74960]: DEBUG nova.compute.manager [req-55b83c5d-d98a-4d9c-8093-3dc8b7dbc226 req-1f093891-66be-4e0a-8d1b-7d5a291fd8cc service nova] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] No waiting events found dispatching network-vif-plugged-091cbb89-dd8a-448e-963a-3dbcafde6bb1 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:39:29 user nova-compute[74960]: WARNING nova.compute.manager [req-55b83c5d-d98a-4d9c-8093-3dc8b7dbc226 req-1f093891-66be-4e0a-8d1b-7d5a291fd8cc service nova] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] Received unexpected event network-vif-plugged-091cbb89-dd8a-448e-963a-3dbcafde6bb1 for instance with vm_state stopped and task_state powering-on.
Nov 03 12:39:30 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:39:30 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:39:30 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:39:30 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:39:31 user nova-compute[74960]: DEBUG nova.compute.manager [req-efa7131c-a7b9-4d5f-8757-5d86b8f9791a req-b5d53492-4d61-4c7f-9bd4-fd8dc4dcb713 service nova] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] Received event network-vif-plugged-091cbb89-dd8a-448e-963a-3dbcafde6bb1 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:39:31 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-efa7131c-a7b9-4d5f-8757-5d86b8f9791a req-b5d53492-4d61-4c7f-9bd4-fd8dc4dcb713 service nova] Acquiring lock "5b7b95c0-3726-4a1c-a384-ec91abf75225-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:39:31 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-efa7131c-a7b9-4d5f-8757-5d86b8f9791a req-b5d53492-4d61-4c7f-9bd4-fd8dc4dcb713 service nova] Lock "5b7b95c0-3726-4a1c-a384-ec91abf75225-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:39:31 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-efa7131c-a7b9-4d5f-8757-5d86b8f9791a req-b5d53492-4d61-4c7f-9bd4-fd8dc4dcb713 service nova] Lock "5b7b95c0-3726-4a1c-a384-ec91abf75225-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:39:31 user nova-compute[74960]: DEBUG nova.compute.manager [req-efa7131c-a7b9-4d5f-8757-5d86b8f9791a req-b5d53492-4d61-4c7f-9bd4-fd8dc4dcb713 service nova] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] No waiting events found dispatching network-vif-plugged-091cbb89-dd8a-448e-963a-3dbcafde6bb1 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:39:31 user nova-compute[74960]: WARNING nova.compute.manager [req-efa7131c-a7b9-4d5f-8757-5d86b8f9791a req-b5d53492-4d61-4c7f-9bd4-fd8dc4dcb713 service nova] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] Received unexpected event network-vif-plugged-091cbb89-dd8a-448e-963a-3dbcafde6bb1 for instance with vm_state stopped and task_state powering-on.
Nov 03 12:39:32 user nova-compute[74960]: DEBUG nova.compute.manager [None req-2c734201-89bc-410b-a40a-70d8429ad8e3 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] Instance event wait completed in 0 seconds for  {{(pid=74960) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 12:39:32 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] Instance rebooted successfully.
Nov 03 12:39:32 user nova-compute[74960]: DEBUG nova.compute.manager [None req-2c734201-89bc-410b-a40a-70d8429ad8e3 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] Checking state {{(pid=74960) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 12:39:32 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:39:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:39:36 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:39:37 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:39:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:39:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:39:41 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:39:42 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:39:42 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:39:43 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:39:43 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-efb5dd5f-d8cb-4bd1-b4ce-aa7340e92de9 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Acquiring lock "35e02c80-f626-4918-93f1-6b9a7f778c7a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:39:43 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-efb5dd5f-d8cb-4bd1-b4ce-aa7340e92de9 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Lock "35e02c80-f626-4918-93f1-6b9a7f778c7a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:39:43 user nova-compute[74960]: DEBUG nova.objects.instance [None req-efb5dd5f-d8cb-4bd1-b4ce-aa7340e92de9 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Lazy-loading 'flavor' on Instance uuid 35e02c80-f626-4918-93f1-6b9a7f778c7a {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:39:43 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-efb5dd5f-d8cb-4bd1-b4ce-aa7340e92de9 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Lock "35e02c80-f626-4918-93f1-6b9a7f778c7a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:39:43 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:39:44 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-efb5dd5f-d8cb-4bd1-b4ce-aa7340e92de9 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Acquiring lock "35e02c80-f626-4918-93f1-6b9a7f778c7a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:39:44 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-efb5dd5f-d8cb-4bd1-b4ce-aa7340e92de9 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Lock "35e02c80-f626-4918-93f1-6b9a7f778c7a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:39:44 user nova-compute[74960]: INFO nova.compute.manager [None req-efb5dd5f-d8cb-4bd1-b4ce-aa7340e92de9 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a] Attaching volume 6baa9581-03ba-48ce-a1c9-cd5b84f0c1f0 to /dev/vdb
Nov 03 12:39:44 user nova-compute[74960]: DEBUG os_brick.utils [None req-efb5dd5f-d8cb-4bd1-b4ce-aa7340e92de9 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:39:44 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:39:44 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:39:44 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[6715f69f-c147-45e1-a38f-0b9cf8785d0a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:75b8e219756\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:39:44 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:39:44 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:39:44 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfb6341a-f598-4dae-8e99-87e1c7c93d25]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:39:44 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:39:44 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:39:44 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[7181ffd4-135b-467d-88b8-b26dcf2ecb1d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:39:44 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c8e9201-b209-46e7-8e9c-1f3d41e91ab8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:39:44 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-efb5dd5f-d8cb-4bd1-b4ce-aa7340e92de9 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Running cmd (subprocess): nvme version {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:39:44 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-efb5dd5f-d8cb-4bd1-b4ce-aa7340e92de9 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] 'nvme version' failed. Not Retrying. {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 12:39:44 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.nvmeof [None req-efb5dd5f-d8cb-4bd1-b4ce-aa7340e92de9 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] nvme not present on system {{(pid=74960) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 12:39:44 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:39:44 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 12:39:44 user nova-compute[74960]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 12:39:44 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fd40804-3584-44c2-aab5-77786ab6d1c5]: (4, '') {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:39:44 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-efb5dd5f-d8cb-4bd1-b4ce-aa7340e92de9 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74960) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 12:39:44 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-efb5dd5f-d8cb-4bd1-b4ce-aa7340e92de9 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74960) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 12:39:44 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-efb5dd5f-d8cb-4bd1-b4ce-aa7340e92de9 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] LIGHTOS: no hostnqn found. {{(pid=74960) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 12:39:44 user nova-compute[74960]: DEBUG os_brick.utils [None req-efb5dd5f-d8cb-4bd1-b4ce-aa7340e92de9 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:75b8e219756', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:39:44 user nova-compute[74960]: DEBUG nova.virt.block_device [None req-efb5dd5f-d8cb-4bd1-b4ce-aa7340e92de9 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a] Updating existing volume attachment record: 0c9b51b3-842f-43d2-baa4-774bf22a814b {{(pid=74960) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 12:39:47 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-cb410033-b53a-41e0-b011-fbead392daec tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Acquiring lock "60658b54-5e34-4a2b-be14-124e47e291c2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:39:47 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-cb410033-b53a-41e0-b011-fbead392daec tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Lock "60658b54-5e34-4a2b-be14-124e47e291c2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:39:47 user nova-compute[74960]: DEBUG nova.compute.manager [None req-cb410033-b53a-41e0-b011-fbead392daec tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] [instance: 60658b54-5e34-4a2b-be14-124e47e291c2] Starting instance... {{(pid=74960) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 12:39:47 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-cb410033-b53a-41e0-b011-fbead392daec tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:39:47 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-cb410033-b53a-41e0-b011-fbead392daec tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:39:47 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-cb410033-b53a-41e0-b011-fbead392daec tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74960) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 12:39:47 user nova-compute[74960]: INFO nova.compute.claims [None req-cb410033-b53a-41e0-b011-fbead392daec tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] [instance: 60658b54-5e34-4a2b-be14-124e47e291c2] Claim successful on node user
Nov 03 12:39:47 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:39:47 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-cb410033-b53a-41e0-b011-fbead392daec tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:39:47 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-cb410033-b53a-41e0-b011-fbead392daec tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:39:47 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-cb410033-b53a-41e0-b011-fbead392daec tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.473s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:39:47 user nova-compute[74960]: DEBUG nova.compute.manager [None req-cb410033-b53a-41e0-b011-fbead392daec tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] [instance: 60658b54-5e34-4a2b-be14-124e47e291c2] Start building networks asynchronously for instance. {{(pid=74960) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 12:39:48 user nova-compute[74960]: DEBUG nova.compute.manager [None req-cb410033-b53a-41e0-b011-fbead392daec tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] [instance: 60658b54-5e34-4a2b-be14-124e47e291c2] Allocating IP information in the background. {{(pid=74960) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 12:39:48 user nova-compute[74960]: DEBUG nova.network.neutron [None req-cb410033-b53a-41e0-b011-fbead392daec tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] [instance: 60658b54-5e34-4a2b-be14-124e47e291c2] allocate_for_instance() {{(pid=74960) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 12:39:48 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-cb410033-b53a-41e0-b011-fbead392daec tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] [instance: 60658b54-5e34-4a2b-be14-124e47e291c2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 12:39:48 user nova-compute[74960]: DEBUG nova.compute.manager [None req-cb410033-b53a-41e0-b011-fbead392daec tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] [instance: 60658b54-5e34-4a2b-be14-124e47e291c2] Start building block device mappings for instance. {{(pid=74960) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 12:39:48 user nova-compute[74960]: DEBUG nova.policy [None req-cb410033-b53a-41e0-b011-fbead392daec tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '946ef9f0f5d04f43bc8c248de57d6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8ca5bb565b48648e39e6c128f54a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74960) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 12:39:48 user nova-compute[74960]: DEBUG nova.compute.manager [None req-cb410033-b53a-41e0-b011-fbead392daec tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] [instance: 60658b54-5e34-4a2b-be14-124e47e291c2] Start spawning the instance on the hypervisor. {{(pid=74960) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 12:39:48 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-cb410033-b53a-41e0-b011-fbead392daec tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] [instance: 60658b54-5e34-4a2b-be14-124e47e291c2] Creating instance directory {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 12:39:48 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-cb410033-b53a-41e0-b011-fbead392daec tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] [instance: 60658b54-5e34-4a2b-be14-124e47e291c2] Creating image(s)
Nov 03 12:39:48 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-cb410033-b53a-41e0-b011-fbead392daec tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Acquiring lock "/opt/stack/data/nova/instances/60658b54-5e34-4a2b-be14-124e47e291c2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:39:48 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-cb410033-b53a-41e0-b011-fbead392daec tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Lock "/opt/stack/data/nova/instances/60658b54-5e34-4a2b-be14-124e47e291c2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:39:48 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-cb410033-b53a-41e0-b011-fbead392daec tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Lock "/opt/stack/data/nova/instances/60658b54-5e34-4a2b-be14-124e47e291c2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:39:48 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-cb410033-b53a-41e0-b011-fbead392daec tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:39:48 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-cb410033-b53a-41e0-b011-fbead392daec tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.170s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:39:48 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-cb410033-b53a-41e0-b011-fbead392daec tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Acquiring lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:39:48 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-cb410033-b53a-41e0-b011-fbead392daec tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:39:48 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-cb410033-b53a-41e0-b011-fbead392daec tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:39:48 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-cb410033-b53a-41e0-b011-fbead392daec tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.168s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:39:48 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-cb410033-b53a-41e0-b011-fbead392daec tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910,backing_fmt=raw /opt/stack/data/nova/instances/60658b54-5e34-4a2b-be14-124e47e291c2/disk 1073741824 {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:39:48 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-cb410033-b53a-41e0-b011-fbead392daec tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910,backing_fmt=raw /opt/stack/data/nova/instances/60658b54-5e34-4a2b-be14-124e47e291c2/disk 1073741824" returned: 0 in 0.092s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:39:48 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-cb410033-b53a-41e0-b011-fbead392daec tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.267s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:39:48 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-cb410033-b53a-41e0-b011-fbead392daec tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:39:48 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:39:48 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-cb410033-b53a-41e0-b011-fbead392daec tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.181s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:39:48 user nova-compute[74960]: DEBUG nova.virt.disk.api [None req-cb410033-b53a-41e0-b011-fbead392daec tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Checking if we can resize image /opt/stack/data/nova/instances/60658b54-5e34-4a2b-be14-124e47e291c2/disk. size=1073741824 {{(pid=74960) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 12:39:48 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-cb410033-b53a-41e0-b011-fbead392daec tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60658b54-5e34-4a2b-be14-124e47e291c2/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:39:48 user nova-compute[74960]: DEBUG nova.network.neutron [None req-cb410033-b53a-41e0-b011-fbead392daec tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] [instance: 60658b54-5e34-4a2b-be14-124e47e291c2] Successfully created port: 70b66449-7eef-45c1-a3b1-69e50370ed0b {{(pid=74960) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 12:39:48 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-cb410033-b53a-41e0-b011-fbead392daec tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60658b54-5e34-4a2b-be14-124e47e291c2/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:39:48 user nova-compute[74960]: DEBUG nova.virt.disk.api [None req-cb410033-b53a-41e0-b011-fbead392daec tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Cannot resize image /opt/stack/data/nova/instances/60658b54-5e34-4a2b-be14-124e47e291c2/disk to a smaller size. {{(pid=74960) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 12:39:48 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-cb410033-b53a-41e0-b011-fbead392daec tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] [instance: 60658b54-5e34-4a2b-be14-124e47e291c2] Created local disks {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 12:39:48 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-cb410033-b53a-41e0-b011-fbead392daec tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] [instance: 60658b54-5e34-4a2b-be14-124e47e291c2] Ensure instance console log exists: /opt/stack/data/nova/instances/60658b54-5e34-4a2b-be14-124e47e291c2/console.log {{(pid=74960) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 12:39:48 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-cb410033-b53a-41e0-b011-fbead392daec tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:39:48 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-cb410033-b53a-41e0-b011-fbead392daec tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:39:48 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-cb410033-b53a-41e0-b011-fbead392daec tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:39:49 user nova-compute[74960]: DEBUG nova.network.neutron [None req-cb410033-b53a-41e0-b011-fbead392daec tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] [instance: 60658b54-5e34-4a2b-be14-124e47e291c2] Successfully updated port: 70b66449-7eef-45c1-a3b1-69e50370ed0b {{(pid=74960) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 12:39:49 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-cb410033-b53a-41e0-b011-fbead392daec tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Acquiring lock "refresh_cache-60658b54-5e34-4a2b-be14-124e47e291c2" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:39:49 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-cb410033-b53a-41e0-b011-fbead392daec tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Acquired lock "refresh_cache-60658b54-5e34-4a2b-be14-124e47e291c2" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:39:49 user nova-compute[74960]: DEBUG nova.network.neutron [None req-cb410033-b53a-41e0-b011-fbead392daec tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] [instance: 60658b54-5e34-4a2b-be14-124e47e291c2] Building network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 12:39:49 user nova-compute[74960]: DEBUG nova.compute.manager [req-d8325391-80c7-45d1-aaf7-910aa1c8464b req-6a01dd89-b61b-4b6b-b7b6-e0776f937d12 service nova] [instance: 60658b54-5e34-4a2b-be14-124e47e291c2] Received event network-changed-70b66449-7eef-45c1-a3b1-69e50370ed0b {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:39:49 user nova-compute[74960]: DEBUG nova.compute.manager [req-d8325391-80c7-45d1-aaf7-910aa1c8464b req-6a01dd89-b61b-4b6b-b7b6-e0776f937d12 service nova] [instance: 60658b54-5e34-4a2b-be14-124e47e291c2] Refreshing instance network info cache due to event network-changed-70b66449-7eef-45c1-a3b1-69e50370ed0b. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 12:39:49 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-d8325391-80c7-45d1-aaf7-910aa1c8464b req-6a01dd89-b61b-4b6b-b7b6-e0776f937d12 service nova] Acquiring lock "refresh_cache-60658b54-5e34-4a2b-be14-124e47e291c2" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:39:49 user nova-compute[74960]: DEBUG nova.network.neutron [None req-cb410033-b53a-41e0-b011-fbead392daec tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] [instance: 60658b54-5e34-4a2b-be14-124e47e291c2] Instance cache missing network info. {{(pid=74960) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 12:39:50 user nova-compute[74960]: DEBUG nova.network.neutron [None req-cb410033-b53a-41e0-b011-fbead392daec tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] [instance: 60658b54-5e34-4a2b-be14-124e47e291c2] Updating instance_info_cache with network_info: [{"id": "70b66449-7eef-45c1-a3b1-69e50370ed0b", "address": "fa:16:3e:8f:d3:55", "network": {"id": "6c29b2f1-0c30-45d5-ade3-f792d5af7037", "bridge": "br-int", "label": "tempest-TestStampPattern-1770578791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df8ca5bb565b48648e39e6c128f54a57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70b66449-7e", "ovs_interfaceid": "70b66449-7eef-45c1-a3b1-69e50370ed0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:39:50 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-cb410033-b53a-41e0-b011-fbead392daec tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Releasing lock "refresh_cache-60658b54-5e34-4a2b-be14-124e47e291c2" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:39:50 user nova-compute[74960]: DEBUG nova.compute.manager [None req-cb410033-b53a-41e0-b011-fbead392daec tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] [instance: 60658b54-5e34-4a2b-be14-124e47e291c2] Instance network_info: |[{"id": "70b66449-7eef-45c1-a3b1-69e50370ed0b", "address": "fa:16:3e:8f:d3:55", "network": {"id": "6c29b2f1-0c30-45d5-ade3-f792d5af7037", "bridge": "br-int", "label": "tempest-TestStampPattern-1770578791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df8ca5bb565b48648e39e6c128f54a57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70b66449-7e", "ovs_interfaceid": "70b66449-7eef-45c1-a3b1-69e50370ed0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74960) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 12:39:50 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-d8325391-80c7-45d1-aaf7-910aa1c8464b req-6a01dd89-b61b-4b6b-b7b6-e0776f937d12 service nova] Acquired lock "refresh_cache-60658b54-5e34-4a2b-be14-124e47e291c2" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:39:50 user nova-compute[74960]: DEBUG nova.network.neutron [req-d8325391-80c7-45d1-aaf7-910aa1c8464b req-6a01dd89-b61b-4b6b-b7b6-e0776f937d12 service nova] [instance: 60658b54-5e34-4a2b-be14-124e47e291c2] Refreshing network info cache for port 70b66449-7eef-45c1-a3b1-69e50370ed0b {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 12:39:50 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-cb410033-b53a-41e0-b011-fbead392daec tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] [instance: 60658b54-5e34-4a2b-be14-124e47e291c2] Start _get_guest_xml network_info=[{"id": "70b66449-7eef-45c1-a3b1-69e50370ed0b", "address": "fa:16:3e:8f:d3:55", "network": {"id": "6c29b2f1-0c30-45d5-ade3-f792d5af7037", "bridge": "br-int", "label": "tempest-TestStampPattern-1770578791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df8ca5bb565b48648e39e6c128f54a57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70b66449-7e", "ovs_interfaceid": "70b66449-7eef-45c1-a3b1-69e50370ed0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=549f51ba-ac69-494b-8de1-34635aa2d7cf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='63ee9c80c632442fb0379f47b784bd20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T12:13:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'image_id': '549f51ba-ac69-494b-8de1-34635aa2d7cf'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 12:39:50 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-cb410033-b53a-41e0-b011-fbead392daec tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:39:50 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-cb410033-b53a-41e0-b011-fbead392daec tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:39:50 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-cb410033-b53a-41e0-b011-fbead392daec tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 12:39:50 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-cb410033-b53a-41e0-b011-fbead392daec tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] CPU controller missing on host. {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 12:39:50 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-cb410033-b53a-41e0-b011-fbead392daec tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 12:39:50 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-cb410033-b53a-41e0-b011-fbead392daec tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] CPU controller found on host. {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 12:39:50 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-cb410033-b53a-41e0-b011-fbead392daec tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74960) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 12:39:50 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-cb410033-b53a-41e0-b011-fbead392daec tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=549f51ba-ac69-494b-8de1-34635aa2d7cf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='63ee9c80c632442fb0379f47b784bd20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T12:13:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 12:39:50 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-cb410033-b53a-41e0-b011-fbead392daec tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Flavor limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 12:39:50 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-cb410033-b53a-41e0-b011-fbead392daec tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Image limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 12:39:50 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-cb410033-b53a-41e0-b011-fbead392daec tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Flavor pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 12:39:50 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-cb410033-b53a-41e0-b011-fbead392daec tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Image pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 12:39:50 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-cb410033-b53a-41e0-b011-fbead392daec tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 12:39:50 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-cb410033-b53a-41e0-b011-fbead392daec tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 12:39:50 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-cb410033-b53a-41e0-b011-fbead392daec tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 12:39:50 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-cb410033-b53a-41e0-b011-fbead392daec tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Got 1 possible topologies {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 12:39:50 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-cb410033-b53a-41e0-b011-fbead392daec tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 12:39:50 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-cb410033-b53a-41e0-b011-fbead392daec tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 12:39:50 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-cb410033-b53a-41e0-b011-fbead392daec tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:39:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-429799797',display_name='tempest-TestStampPattern-server-429799797',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-429799797',id=39,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOVJGiA8+WxYV0H4D5A8tW82c36Y66O0cQc4FMiKT0kp3U+xT9R3wjcl8Y9oz6PsAiIG74/EBNibsdR8g5KJgAe/YXLGMoJSdUpoQNRjhz9zQdfyFtfcNImepV7xlRbyrw==',key_name='tempest-TestStampPattern-2145016267',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df8ca5bb565b48648e39e6c128f54a57',ramdisk_id='',reservation_id='r-v0d1u5pn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1528534742',owner_user_name='tempest-TestStampPattern-1528534742-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:39:48Z,user_data=None,user_id='946ef9f0f5d04f43bc8c248de57d6566',uuid=60658b54-5e34-4a2b-be14-124e47e291c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "70b66449-7eef-45c1-a3b1-69e50370ed0b", "address": "fa:16:3e:8f:d3:55", "network": {"id": "6c29b2f1-0c30-45d5-ade3-f792d5af7037", "bridge": "br-int", "label": "tempest-TestStampPattern-1770578791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df8ca5bb565b48648e39e6c128f54a57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70b66449-7e", "ovs_interfaceid": "70b66449-7eef-45c1-a3b1-69e50370ed0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74960) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 12:39:50 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-cb410033-b53a-41e0-b011-fbead392daec tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Converting VIF {"id": "70b66449-7eef-45c1-a3b1-69e50370ed0b", "address": "fa:16:3e:8f:d3:55", "network": {"id": "6c29b2f1-0c30-45d5-ade3-f792d5af7037", "bridge": "br-int", "label": "tempest-TestStampPattern-1770578791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df8ca5bb565b48648e39e6c128f54a57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70b66449-7e", "ovs_interfaceid": "70b66449-7eef-45c1-a3b1-69e50370ed0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:39:50 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-cb410033-b53a-41e0-b011-fbead392daec tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:d3:55,bridge_name='br-int',has_traffic_filtering=True,id=70b66449-7eef-45c1-a3b1-69e50370ed0b,network=Network(6c29b2f1-0c30-45d5-ade3-f792d5af7037),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70b66449-7e') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:39:50 user nova-compute[74960]: DEBUG nova.objects.instance [None req-cb410033-b53a-41e0-b011-fbead392daec tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Lazy-loading 'pci_devices' on Instance uuid 60658b54-5e34-4a2b-be14-124e47e291c2 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:39:50 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-cb410033-b53a-41e0-b011-fbead392daec tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] [instance: 60658b54-5e34-4a2b-be14-124e47e291c2] End _get_guest_xml xml=<domain type="kvm">
Nov 03 12:39:50 user nova-compute[74960]:   <uuid>60658b54-5e34-4a2b-be14-124e47e291c2</uuid>
Nov 03 12:39:50 user nova-compute[74960]:   <name>instance-00000027</name>
Nov 03 12:39:50 user nova-compute[74960]:   <memory>524288</memory>
Nov 03 12:39:50 user nova-compute[74960]:   <vcpu>1</vcpu>
Nov 03 12:39:50 user nova-compute[74960]:   <metadata>
Nov 03 12:39:50 user nova-compute[74960]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 12:39:50 user nova-compute[74960]:       <nova:package version="0.0.0"/>
Nov 03 12:39:50 user nova-compute[74960]:       <nova:name>tempest-TestStampPattern-server-429799797</nova:name>
Nov 03 12:39:50 user nova-compute[74960]:       <nova:creationTime>2023-11-03 12:39:50</nova:creationTime>
Nov 03 12:39:50 user nova-compute[74960]:       <nova:flavor name="m1.tiny">
Nov 03 12:39:50 user nova-compute[74960]:         <nova:memory>512</nova:memory>
Nov 03 12:39:50 user nova-compute[74960]:         <nova:disk>1</nova:disk>
Nov 03 12:39:50 user nova-compute[74960]:         <nova:swap>0</nova:swap>
Nov 03 12:39:50 user nova-compute[74960]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 12:39:50 user nova-compute[74960]:         <nova:vcpus>1</nova:vcpus>
Nov 03 12:39:50 user nova-compute[74960]:       </nova:flavor>
Nov 03 12:39:50 user nova-compute[74960]:       <nova:owner>
Nov 03 12:39:50 user nova-compute[74960]:         <nova:user uuid="946ef9f0f5d04f43bc8c248de57d6566">tempest-TestStampPattern-1528534742-project-member</nova:user>
Nov 03 12:39:50 user nova-compute[74960]:         <nova:project uuid="df8ca5bb565b48648e39e6c128f54a57">tempest-TestStampPattern-1528534742</nova:project>
Nov 03 12:39:50 user nova-compute[74960]:       </nova:owner>
Nov 03 12:39:50 user nova-compute[74960]:       <nova:root type="image" uuid="549f51ba-ac69-494b-8de1-34635aa2d7cf"/>
Nov 03 12:39:50 user nova-compute[74960]:       <nova:ports>
Nov 03 12:39:50 user nova-compute[74960]:         <nova:port uuid="70b66449-7eef-45c1-a3b1-69e50370ed0b">
Nov 03 12:39:50 user nova-compute[74960]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 03 12:39:50 user nova-compute[74960]:         </nova:port>
Nov 03 12:39:50 user nova-compute[74960]:       </nova:ports>
Nov 03 12:39:50 user nova-compute[74960]:     </nova:instance>
Nov 03 12:39:50 user nova-compute[74960]:   </metadata>
Nov 03 12:39:50 user nova-compute[74960]:   <sysinfo type="smbios">
Nov 03 12:39:50 user nova-compute[74960]:     <system>
Nov 03 12:39:50 user nova-compute[74960]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 12:39:50 user nova-compute[74960]:       <entry name="product">OpenStack Nova</entry>
Nov 03 12:39:50 user nova-compute[74960]:       <entry name="version">0.0.0</entry>
Nov 03 12:39:50 user nova-compute[74960]:       <entry name="serial">60658b54-5e34-4a2b-be14-124e47e291c2</entry>
Nov 03 12:39:50 user nova-compute[74960]:       <entry name="uuid">60658b54-5e34-4a2b-be14-124e47e291c2</entry>
Nov 03 12:39:50 user nova-compute[74960]:       <entry name="family">Virtual Machine</entry>
Nov 03 12:39:50 user nova-compute[74960]:     </system>
Nov 03 12:39:50 user nova-compute[74960]:   </sysinfo>
Nov 03 12:39:50 user nova-compute[74960]:   <os>
Nov 03 12:39:50 user nova-compute[74960]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 12:39:50 user nova-compute[74960]:     <boot dev="hd"/>
Nov 03 12:39:50 user nova-compute[74960]:     <smbios mode="sysinfo"/>
Nov 03 12:39:50 user nova-compute[74960]:   </os>
Nov 03 12:39:50 user nova-compute[74960]:   <features>
Nov 03 12:39:50 user nova-compute[74960]:     <acpi/>
Nov 03 12:39:50 user nova-compute[74960]:     <apic/>
Nov 03 12:39:50 user nova-compute[74960]:     <vmcoreinfo/>
Nov 03 12:39:50 user nova-compute[74960]:   </features>
Nov 03 12:39:50 user nova-compute[74960]:   <clock offset="utc">
Nov 03 12:39:50 user nova-compute[74960]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 12:39:50 user nova-compute[74960]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 12:39:50 user nova-compute[74960]:     <timer name="hpet" present="no"/>
Nov 03 12:39:50 user nova-compute[74960]:   </clock>
Nov 03 12:39:50 user nova-compute[74960]:   <cpu mode="custom" match="exact">
Nov 03 12:39:50 user nova-compute[74960]:     <model>Nehalem</model>
Nov 03 12:39:50 user nova-compute[74960]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 12:39:50 user nova-compute[74960]:   </cpu>
Nov 03 12:39:50 user nova-compute[74960]:   <devices>
Nov 03 12:39:50 user nova-compute[74960]:     <disk type="file" device="disk">
Nov 03 12:39:50 user nova-compute[74960]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 12:39:50 user nova-compute[74960]:       <source file="/opt/stack/data/nova/instances/60658b54-5e34-4a2b-be14-124e47e291c2/disk"/>
Nov 03 12:39:50 user nova-compute[74960]:       <target dev="vda" bus="virtio"/>
Nov 03 12:39:50 user nova-compute[74960]:     </disk>
Nov 03 12:39:50 user nova-compute[74960]:     <interface type="ethernet">
Nov 03 12:39:50 user nova-compute[74960]:       <mac address="fa:16:3e:8f:d3:55"/>
Nov 03 12:39:50 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:39:50 user nova-compute[74960]:       <mtu size="1442"/>
Nov 03 12:39:50 user nova-compute[74960]:       <target dev="tap70b66449-7e"/>
Nov 03 12:39:50 user nova-compute[74960]:     </interface>
Nov 03 12:39:50 user nova-compute[74960]:     <serial type="pty">
Nov 03 12:39:50 user nova-compute[74960]:       <log file="/opt/stack/data/nova/instances/60658b54-5e34-4a2b-be14-124e47e291c2/console.log" append="off"/>
Nov 03 12:39:50 user nova-compute[74960]:     </serial>
Nov 03 12:39:50 user nova-compute[74960]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 12:39:50 user nova-compute[74960]:     <video>
Nov 03 12:39:50 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:39:50 user nova-compute[74960]:     </video>
Nov 03 12:39:50 user nova-compute[74960]:     <rng model="virtio">
Nov 03 12:39:50 user nova-compute[74960]:       <backend model="random">/dev/urandom</backend>
Nov 03 12:39:50 user nova-compute[74960]:     </rng>
Nov 03 12:39:50 user nova-compute[74960]:     <controller type="usb" index="0" model="none"/>
Nov 03 12:39:50 user nova-compute[74960]:     <memballoon model="virtio">
Nov 03 12:39:50 user nova-compute[74960]:       <stats period="10"/>
Nov 03 12:39:50 user nova-compute[74960]:     </memballoon>
Nov 03 12:39:50 user nova-compute[74960]:   </devices>
Nov 03 12:39:50 user nova-compute[74960]: </domain>
Nov 03 12:39:50 user nova-compute[74960]:  {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 12:39:50 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-cb410033-b53a-41e0-b011-fbead392daec tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:39:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-429799797',display_name='tempest-TestStampPattern-server-429799797',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-429799797',id=39,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOVJGiA8+WxYV0H4D5A8tW82c36Y66O0cQc4FMiKT0kp3U+xT9R3wjcl8Y9oz6PsAiIG74/EBNibsdR8g5KJgAe/YXLGMoJSdUpoQNRjhz9zQdfyFtfcNImepV7xlRbyrw==',key_name='tempest-TestStampPattern-2145016267',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df8ca5bb565b48648e39e6c128f54a57',ramdisk_id='',reservation_id='r-v0d1u5pn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1528534742',owner_user_name='tempest-TestStampPattern-1528534742-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:39:48Z,user_data=None,user_id='946ef9f0f5d04f43bc8c248de57d6566',uuid=60658b54-5e34-4a2b-be14-124e47e291c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "70b66449-7eef-45c1-a3b1-69e50370ed0b", "address": "fa:16:3e:8f:d3:55", "network": {"id": "6c29b2f1-0c30-45d5-ade3-f792d5af7037", "bridge": "br-int", "label": "tempest-TestStampPattern-1770578791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df8ca5bb565b48648e39e6c128f54a57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70b66449-7e", "ovs_interfaceid": "70b66449-7eef-45c1-a3b1-69e50370ed0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 12:39:50 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-cb410033-b53a-41e0-b011-fbead392daec tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Converting VIF {"id": "70b66449-7eef-45c1-a3b1-69e50370ed0b", "address": "fa:16:3e:8f:d3:55", "network": {"id": "6c29b2f1-0c30-45d5-ade3-f792d5af7037", "bridge": "br-int", "label": "tempest-TestStampPattern-1770578791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df8ca5bb565b48648e39e6c128f54a57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70b66449-7e", "ovs_interfaceid": "70b66449-7eef-45c1-a3b1-69e50370ed0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:39:50 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-cb410033-b53a-41e0-b011-fbead392daec tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:d3:55,bridge_name='br-int',has_traffic_filtering=True,id=70b66449-7eef-45c1-a3b1-69e50370ed0b,network=Network(6c29b2f1-0c30-45d5-ade3-f792d5af7037),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70b66449-7e') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:39:50 user nova-compute[74960]: DEBUG os_vif [None req-cb410033-b53a-41e0-b011-fbead392daec tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:d3:55,bridge_name='br-int',has_traffic_filtering=True,id=70b66449-7eef-45c1-a3b1-69e50370ed0b,network=Network(6c29b2f1-0c30-45d5-ade3-f792d5af7037),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70b66449-7e') {{(pid=74960) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 12:39:50 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:39:50 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:39:50 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 12:39:50 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:39:50 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '270b3e06-707e-567e-823d-24df719864b5', '_type': 'linux-noop'}}, row=False) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:39:50 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:39:50 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:39:50 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:39:50 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap70b66449-7e, may_exist=True, interface_attrs={}) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:39:50 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap70b66449-7e, col_values=(('qos', UUID('2f27854a-eecd-4716-818d-d6a6bc620009')),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:39:50 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap70b66449-7e, col_values=(('external_ids', {'iface-id': '70b66449-7eef-45c1-a3b1-69e50370ed0b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8f:d3:55', 'vm-uuid': '60658b54-5e34-4a2b-be14-124e47e291c2'}),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:39:50 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:39:50 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:39:50 user nova-compute[74960]: INFO os_vif [None req-cb410033-b53a-41e0-b011-fbead392daec tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:d3:55,bridge_name='br-int',has_traffic_filtering=True,id=70b66449-7eef-45c1-a3b1-69e50370ed0b,network=Network(6c29b2f1-0c30-45d5-ade3-f792d5af7037),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70b66449-7e')
Nov 03 12:39:50 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-cb410033-b53a-41e0-b011-fbead392daec tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] No BDM found with device name vda, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:39:50 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-cb410033-b53a-41e0-b011-fbead392daec tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] No VIF found with MAC fa:16:3e:8f:d3:55, not building metadata {{(pid=74960) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 12:39:50 user nova-compute[74960]: DEBUG nova.network.neutron [req-d8325391-80c7-45d1-aaf7-910aa1c8464b req-6a01dd89-b61b-4b6b-b7b6-e0776f937d12 service nova] [instance: 60658b54-5e34-4a2b-be14-124e47e291c2] Updated VIF entry in instance network info cache for port 70b66449-7eef-45c1-a3b1-69e50370ed0b. {{(pid=74960) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 12:39:50 user nova-compute[74960]: DEBUG nova.network.neutron [req-d8325391-80c7-45d1-aaf7-910aa1c8464b req-6a01dd89-b61b-4b6b-b7b6-e0776f937d12 service nova] [instance: 60658b54-5e34-4a2b-be14-124e47e291c2] Updating instance_info_cache with network_info: [{"id": "70b66449-7eef-45c1-a3b1-69e50370ed0b", "address": "fa:16:3e:8f:d3:55", "network": {"id": "6c29b2f1-0c30-45d5-ade3-f792d5af7037", "bridge": "br-int", "label": "tempest-TestStampPattern-1770578791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df8ca5bb565b48648e39e6c128f54a57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70b66449-7e", "ovs_interfaceid": "70b66449-7eef-45c1-a3b1-69e50370ed0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:39:50 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-d8325391-80c7-45d1-aaf7-910aa1c8464b req-6a01dd89-b61b-4b6b-b7b6-e0776f937d12 service nova] Releasing lock "refresh_cache-60658b54-5e34-4a2b-be14-124e47e291c2" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:39:51 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:39:51 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:39:51 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:39:51 user nova-compute[74960]: DEBUG nova.compute.manager [req-332633bc-b3a2-4d8f-9d67-76033816c664 req-177db85e-fe02-4b88-8b0a-b10169030990 service nova] [instance: 60658b54-5e34-4a2b-be14-124e47e291c2] Received event network-vif-plugged-70b66449-7eef-45c1-a3b1-69e50370ed0b {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:39:51 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-332633bc-b3a2-4d8f-9d67-76033816c664 req-177db85e-fe02-4b88-8b0a-b10169030990 service nova] Acquiring lock "60658b54-5e34-4a2b-be14-124e47e291c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:39:51 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-332633bc-b3a2-4d8f-9d67-76033816c664 req-177db85e-fe02-4b88-8b0a-b10169030990 service nova] Lock "60658b54-5e34-4a2b-be14-124e47e291c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:39:51 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-332633bc-b3a2-4d8f-9d67-76033816c664 req-177db85e-fe02-4b88-8b0a-b10169030990 service nova] Lock "60658b54-5e34-4a2b-be14-124e47e291c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:39:51 user nova-compute[74960]: DEBUG nova.compute.manager [req-332633bc-b3a2-4d8f-9d67-76033816c664 req-177db85e-fe02-4b88-8b0a-b10169030990 service nova] [instance: 60658b54-5e34-4a2b-be14-124e47e291c2] No waiting events found dispatching network-vif-plugged-70b66449-7eef-45c1-a3b1-69e50370ed0b {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:39:51 user nova-compute[74960]: WARNING nova.compute.manager [req-332633bc-b3a2-4d8f-9d67-76033816c664 req-177db85e-fe02-4b88-8b0a-b10169030990 service nova] [instance: 60658b54-5e34-4a2b-be14-124e47e291c2] Received unexpected event network-vif-plugged-70b66449-7eef-45c1-a3b1-69e50370ed0b for instance with vm_state building and task_state spawning.
Nov 03 12:39:52 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:39:52 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:39:52 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:39:52 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:39:53 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:39:53 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:39:53 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-20e4e4fc-11f1-4f60-893e-78ce7d9e3578 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Acquiring lock "27aa03bb-5613-4bde-8bc0-30517f5d48ae" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:39:53 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-20e4e4fc-11f1-4f60-893e-78ce7d9e3578 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Lock "27aa03bb-5613-4bde-8bc0-30517f5d48ae" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:39:53 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-20e4e4fc-11f1-4f60-893e-78ce7d9e3578 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Acquiring lock "27aa03bb-5613-4bde-8bc0-30517f5d48ae-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:39:53 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-20e4e4fc-11f1-4f60-893e-78ce7d9e3578 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Lock "27aa03bb-5613-4bde-8bc0-30517f5d48ae-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:39:53 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-20e4e4fc-11f1-4f60-893e-78ce7d9e3578 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Lock "27aa03bb-5613-4bde-8bc0-30517f5d48ae-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:39:53 user nova-compute[74960]: INFO nova.compute.manager [None req-20e4e4fc-11f1-4f60-893e-78ce7d9e3578 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] Terminating instance
Nov 03 12:39:53 user nova-compute[74960]: DEBUG nova.compute.manager [None req-20e4e4fc-11f1-4f60-893e-78ce7d9e3578 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] Start destroying the instance on the hypervisor. {{(pid=74960) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 12:39:53 user nova-compute[74960]: DEBUG nova.compute.manager [req-0454ed68-b929-49ac-95ac-9cbd798bae58 req-3826e704-59b1-4e23-be0d-d5cbe8488240 service nova] [instance: 60658b54-5e34-4a2b-be14-124e47e291c2] Received event network-vif-plugged-70b66449-7eef-45c1-a3b1-69e50370ed0b {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:39:53 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-0454ed68-b929-49ac-95ac-9cbd798bae58 req-3826e704-59b1-4e23-be0d-d5cbe8488240 service nova] Acquiring lock "60658b54-5e34-4a2b-be14-124e47e291c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:39:53 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-0454ed68-b929-49ac-95ac-9cbd798bae58 req-3826e704-59b1-4e23-be0d-d5cbe8488240 service nova] Lock "60658b54-5e34-4a2b-be14-124e47e291c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:39:53 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-0454ed68-b929-49ac-95ac-9cbd798bae58 req-3826e704-59b1-4e23-be0d-d5cbe8488240 service nova] Lock "60658b54-5e34-4a2b-be14-124e47e291c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:39:53 user nova-compute[74960]: DEBUG nova.compute.manager [req-0454ed68-b929-49ac-95ac-9cbd798bae58 req-3826e704-59b1-4e23-be0d-d5cbe8488240 service nova] [instance: 60658b54-5e34-4a2b-be14-124e47e291c2] No waiting events found dispatching network-vif-plugged-70b66449-7eef-45c1-a3b1-69e50370ed0b {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:39:53 user nova-compute[74960]: WARNING nova.compute.manager [req-0454ed68-b929-49ac-95ac-9cbd798bae58 req-3826e704-59b1-4e23-be0d-d5cbe8488240 service nova] [instance: 60658b54-5e34-4a2b-be14-124e47e291c2] Received unexpected event network-vif-plugged-70b66449-7eef-45c1-a3b1-69e50370ed0b for instance with vm_state building and task_state spawning.
Nov 03 12:39:53 user nova-compute[74960]: DEBUG nova.compute.manager [None req-cb410033-b53a-41e0-b011-fbead392daec tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] [instance: 60658b54-5e34-4a2b-be14-124e47e291c2] Instance event wait completed in 0 seconds for  {{(pid=74960) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 12:39:53 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-cb410033-b53a-41e0-b011-fbead392daec tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] [instance: 60658b54-5e34-4a2b-be14-124e47e291c2] Guest created on hypervisor {{(pid=74960) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 12:39:53 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:39:53 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: 60658b54-5e34-4a2b-be14-124e47e291c2] Instance spawned successfully.
Nov 03 12:39:53 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-cb410033-b53a-41e0-b011-fbead392daec tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] [instance: 60658b54-5e34-4a2b-be14-124e47e291c2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 12:39:53 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:39:53 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-cb410033-b53a-41e0-b011-fbead392daec tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] [instance: 60658b54-5e34-4a2b-be14-124e47e291c2] Found default for hw_cdrom_bus of ide {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:39:53 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-cb410033-b53a-41e0-b011-fbead392daec tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] [instance: 60658b54-5e34-4a2b-be14-124e47e291c2] Found default for hw_disk_bus of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:39:53 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-cb410033-b53a-41e0-b011-fbead392daec tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] [instance: 60658b54-5e34-4a2b-be14-124e47e291c2] Found default for hw_input_bus of None {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:39:53 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-cb410033-b53a-41e0-b011-fbead392daec tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] [instance: 60658b54-5e34-4a2b-be14-124e47e291c2] Found default for hw_pointer_model of None {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:39:53 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-cb410033-b53a-41e0-b011-fbead392daec tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] [instance: 60658b54-5e34-4a2b-be14-124e47e291c2] Found default for hw_video_model of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:39:53 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-cb410033-b53a-41e0-b011-fbead392daec tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] [instance: 60658b54-5e34-4a2b-be14-124e47e291c2] Found default for hw_vif_model of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:39:53 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:39:53 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:39:54 user nova-compute[74960]: INFO nova.compute.manager [None req-cb410033-b53a-41e0-b011-fbead392daec tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] [instance: 60658b54-5e34-4a2b-be14-124e47e291c2] Took 5.87 seconds to spawn the instance on the hypervisor.
Nov 03 12:39:54 user nova-compute[74960]: DEBUG nova.compute.manager [None req-cb410033-b53a-41e0-b011-fbead392daec tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] [instance: 60658b54-5e34-4a2b-be14-124e47e291c2] Checking state {{(pid=74960) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 12:39:54 user nova-compute[74960]: INFO nova.compute.manager [None req-cb410033-b53a-41e0-b011-fbead392daec tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] [instance: 60658b54-5e34-4a2b-be14-124e47e291c2] Took 6.72 seconds to build instance.
Nov 03 12:39:54 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-cb410033-b53a-41e0-b011-fbead392daec tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Lock "60658b54-5e34-4a2b-be14-124e47e291c2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.846s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:39:54 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:39:54 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:39:54 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] Instance destroyed successfully.
Nov 03 12:39:54 user nova-compute[74960]: DEBUG nova.objects.instance [None req-20e4e4fc-11f1-4f60-893e-78ce7d9e3578 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Lazy-loading 'resources' on Instance uuid 27aa03bb-5613-4bde-8bc0-30517f5d48ae {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:39:54 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-20e4e4fc-11f1-4f60-893e-78ce7d9e3578 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-03T12:35:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-84564102',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1532854274',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBYDYy6Yd4oTzqRmBgqOf0CT+Ul+2zedFmBjf4dct/ZgF3BtxBCHh2RqZpmfNUQqxXAXGv7pJgRz8+RxPwCi1ZxZq5Sw+Pludb9D/l5gQkHYcqClTVAMzGUWUIaG18LSIg==',key_name='tempest-keypair-807064414',keypairs=<?>,launch_index=0,launched_at=2023-11-03T12:38:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='384450261e1f45048eb9b4b431ce8bd5',ramdisk_id='',reservation_id='r-e40nqd7j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-999594459',owner_user_name='tempest-ServerActionsV293TestJSON-999594459-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T12:38:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2a983db9b51c44938095b72874dddcf9',uuid=27aa03bb-5613-4bde-8bc0-30517f5d48ae,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "16df3da7-2b2a-4c74-bb06-779696d25b88", "address": "fa:16:3e:2a:35:94", "network": {"id": "4a77f235-def4-4456-8f4a-99bf5769e015", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1480494760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "384450261e1f45048eb9b4b431ce8bd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16df3da7-2b", "ovs_interfaceid": "16df3da7-2b2a-4c74-bb06-779696d25b88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 12:39:54 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-20e4e4fc-11f1-4f60-893e-78ce7d9e3578 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Converting VIF {"id": "16df3da7-2b2a-4c74-bb06-779696d25b88", "address": "fa:16:3e:2a:35:94", "network": {"id": "4a77f235-def4-4456-8f4a-99bf5769e015", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1480494760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "384450261e1f45048eb9b4b431ce8bd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16df3da7-2b", "ovs_interfaceid": "16df3da7-2b2a-4c74-bb06-779696d25b88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:39:54 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-20e4e4fc-11f1-4f60-893e-78ce7d9e3578 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2a:35:94,bridge_name='br-int',has_traffic_filtering=True,id=16df3da7-2b2a-4c74-bb06-779696d25b88,network=Network(4a77f235-def4-4456-8f4a-99bf5769e015),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16df3da7-2b') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:39:54 user nova-compute[74960]: DEBUG os_vif [None req-20e4e4fc-11f1-4f60-893e-78ce7d9e3578 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:35:94,bridge_name='br-int',has_traffic_filtering=True,id=16df3da7-2b2a-4c74-bb06-779696d25b88,network=Network(4a77f235-def4-4456-8f4a-99bf5769e015),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16df3da7-2b') {{(pid=74960) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 12:39:54 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:39:54 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap16df3da7-2b, bridge=br-int, if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:39:54 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:39:54 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:39:54 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:39:54 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=28c7c272-3920-494c-80e6-a0cb1c980473) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:39:54 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:39:54 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:39:54 user nova-compute[74960]: INFO os_vif [None req-20e4e4fc-11f1-4f60-893e-78ce7d9e3578 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:35:94,bridge_name='br-int',has_traffic_filtering=True,id=16df3da7-2b2a-4c74-bb06-779696d25b88,network=Network(4a77f235-def4-4456-8f4a-99bf5769e015),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16df3da7-2b')
Nov 03 12:39:54 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20e4e4fc-11f1-4f60-893e-78ce7d9e3578 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] calling os-brick to detach iSCSI Volume {{(pid=74960) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 12:39:54 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-20e4e4fc-11f1-4f60-893e-78ce7d9e3578 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9aa420acb0>, {'target_iqn': 'iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'snapNwyo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:39:54 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-20e4e4fc-11f1-4f60-893e-78ce7d9e3578 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:39:54 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-20e4e4fc-11f1-4f60-893e-78ce7d9e3578 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:39:54 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-20e4e4fc-11f1-4f60-893e-78ce7d9e3578 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:39:54 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:39:54 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:39:54 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec7b39f4-9492-42d4-8a38-d028da267e92]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:39:54 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-20e4e4fc-11f1-4f60-893e-78ce7d9e3578 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 12:39:54 user nova-compute[74960]: No targets found.
Nov 03 12:39:54 user nova-compute[74960]: iSNS:
Nov 03 12:39:54 user nova-compute[74960]: No targets found.
Nov 03 12:39:54 user nova-compute[74960]: STATIC:
Nov 03 12:39:54 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7
Nov 03 12:39:54 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:39:54 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:39:54 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2
Nov 03 12:39:54 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:39:54 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:39:54 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61
Nov 03 12:39:54 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:39:54 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:39:54 user nova-compute[74960]: FIRMWARE:
Nov 03 12:39:54 user nova-compute[74960]: No targets found.
Nov 03 12:39:54 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:39:54 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-20e4e4fc-11f1-4f60-893e-78ce7d9e3578 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 12:39:54 user nova-compute[74960]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 12:39:54 user nova-compute[74960]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74960) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 12:39:54 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-20e4e4fc-11f1-4f60-893e-78ce7d9e3578 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61', 0)] {{(pid=74960) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 12:39:54 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:39:54 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:39:54 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[49c5c52a-6993-4b67-95ad-a470ead09aa8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:39:54 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:39:54 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:39:54 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d311e81-8495-4593-b26c-9da5b5ee1413]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61 (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:39:54 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-20e4e4fc-11f1-4f60-893e-78ce7d9e3578 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:39:54 user nova-compute[74960]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7 (non-flash)
Nov 03 12:39:54 user nova-compute[74960]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61 (non-flash)
Nov 03 12:39:54 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:39:54 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-20e4e4fc-11f1-4f60-893e-78ce7d9e3578 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:39:54 user nova-compute[74960]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7 (non-flash)
Nov 03 12:39:54 user nova-compute[74960]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61 (non-flash)
Nov 03 12:39:54 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:39:54 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-20e4e4fc-11f1-4f60-893e-78ce7d9e3578 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9ab065fd00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61'): ({'sdc'}, set())}) {{(pid=74960) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 12:39:54 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-20e4e4fc-11f1-4f60-893e-78ce7d9e3578 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Removing single pathed devices sdc {{(pid=74960) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 12:39:54 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:39:54 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:39:54 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[83b96ec4-f706-4d0c-9ef6-6a5c678fd5b5]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:39:54 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:39:54 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:39:54 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[a14f3aa0-5376-40bb-9ad8-eb5419fd3f36]: (4, ('ok\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:39:54 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-20e4e4fc-11f1-4f60-893e-78ce7d9e3578 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Flushing IO for device /dev/sdc {{(pid=74960) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 12:39:54 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:39:54 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:39:54 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d7d0287-0f70-41ce-8f8a-95bb8cc985ef]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:39:54 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-20e4e4fc-11f1-4f60-893e-78ce7d9e3578 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74960) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 12:39:54 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:39:54 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.059s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:39:54 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb283219-ddb3-4aed-a03f-06da638311e8]: (4, ('1', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:39:54 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-20e4e4fc-11f1-4f60-893e-78ce7d9e3578 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74960) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 12:39:54 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-20e4e4fc-11f1-4f60-893e-78ce7d9e3578 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] SCSI volumes sdc have been removed. {{(pid=74960) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 12:39:54 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-20e4e4fc-11f1-4f60-893e-78ce7d9e3578 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61')] {{(pid=74960) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 12:39:54 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:39:54 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:39:54 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[204fefc2-6d84-4295-8798-b066e35d2c9c]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:39:54 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-20e4e4fc-11f1-4f60-893e-78ce7d9e3578 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:39:54 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61 -p 172.16.0.220:3260 --logout {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:39:55 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:39:55 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba4c6c22-6be8-4e96-a0ad-bbe6d190e806]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:39:55 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-20e4e4fc-11f1-4f60-893e-78ce7d9e3578 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61, portal: 172.16.0.220,3260]
Nov 03 12:39:55 user nova-compute[74960]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61, portal: 172.16.0.220,3260] successful.
Nov 03 12:39:55 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:39:55 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61 -p 172.16.0.220:3260 --op delete {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:39:55 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d9b574a-cdd4-4118-a061-dfe393a5cd61 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:39:55 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3100827-c5c5-46d9-a123-a9a1e8bb9a36]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:39:55 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-20e4e4fc-11f1-4f60-893e-78ce7d9e3578 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:39:55 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-20e4e4fc-11f1-4f60-893e-78ce7d9e3578 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.378s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:39:55 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-20e4e4fc-11f1-4f60-893e-78ce7d9e3578 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] <== disconnect_volume: return (379ms) None {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:39:55 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20e4e4fc-11f1-4f60-893e-78ce7d9e3578 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] Disconnected iSCSI Volume {{(pid=74960) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 12:39:55 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-20e4e4fc-11f1-4f60-893e-78ce7d9e3578 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] Deleting instance files /opt/stack/data/nova/instances/27aa03bb-5613-4bde-8bc0-30517f5d48ae_del
Nov 03 12:39:55 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-20e4e4fc-11f1-4f60-893e-78ce7d9e3578 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] Deletion of /opt/stack/data/nova/instances/27aa03bb-5613-4bde-8bc0-30517f5d48ae_del complete
Nov 03 12:39:55 user nova-compute[74960]: INFO nova.compute.manager [None req-20e4e4fc-11f1-4f60-893e-78ce7d9e3578 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] Took 1.29 seconds to destroy the instance on the hypervisor.
Nov 03 12:39:55 user nova-compute[74960]: DEBUG oslo.service.loopingcall [None req-20e4e4fc-11f1-4f60-893e-78ce7d9e3578 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74960) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 12:39:55 user nova-compute[74960]: DEBUG nova.compute.manager [-] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] Deallocating network for instance {{(pid=74960) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 12:39:55 user nova-compute[74960]: DEBUG nova.network.neutron [-] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] deallocate_for_instance() {{(pid=74960) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 12:39:55 user nova-compute[74960]: DEBUG nova.network.neutron [-] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] Updating instance_info_cache with network_info: [] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:39:55 user nova-compute[74960]: DEBUG nova.compute.manager [req-bad3d146-5db5-4271-9e3f-5a629f1d4b8f req-9e6f88e5-014e-47c2-9480-91a71360d345 service nova] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] Received event network-vif-unplugged-16df3da7-2b2a-4c74-bb06-779696d25b88 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:39:55 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-bad3d146-5db5-4271-9e3f-5a629f1d4b8f req-9e6f88e5-014e-47c2-9480-91a71360d345 service nova] Acquiring lock "27aa03bb-5613-4bde-8bc0-30517f5d48ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:39:55 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-bad3d146-5db5-4271-9e3f-5a629f1d4b8f req-9e6f88e5-014e-47c2-9480-91a71360d345 service nova] Lock "27aa03bb-5613-4bde-8bc0-30517f5d48ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:39:55 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-bad3d146-5db5-4271-9e3f-5a629f1d4b8f req-9e6f88e5-014e-47c2-9480-91a71360d345 service nova] Lock "27aa03bb-5613-4bde-8bc0-30517f5d48ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:39:55 user nova-compute[74960]: DEBUG nova.compute.manager [req-bad3d146-5db5-4271-9e3f-5a629f1d4b8f req-9e6f88e5-014e-47c2-9480-91a71360d345 service nova] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] No waiting events found dispatching network-vif-unplugged-16df3da7-2b2a-4c74-bb06-779696d25b88 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:39:55 user nova-compute[74960]: DEBUG nova.compute.manager [req-bad3d146-5db5-4271-9e3f-5a629f1d4b8f req-9e6f88e5-014e-47c2-9480-91a71360d345 service nova] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] Received event network-vif-unplugged-16df3da7-2b2a-4c74-bb06-779696d25b88 for instance with task_state deleting. {{(pid=74960) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 12:39:55 user nova-compute[74960]: DEBUG nova.compute.manager [req-bad3d146-5db5-4271-9e3f-5a629f1d4b8f req-9e6f88e5-014e-47c2-9480-91a71360d345 service nova] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] Received event network-vif-plugged-16df3da7-2b2a-4c74-bb06-779696d25b88 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:39:55 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-bad3d146-5db5-4271-9e3f-5a629f1d4b8f req-9e6f88e5-014e-47c2-9480-91a71360d345 service nova] Acquiring lock "27aa03bb-5613-4bde-8bc0-30517f5d48ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:39:55 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-bad3d146-5db5-4271-9e3f-5a629f1d4b8f req-9e6f88e5-014e-47c2-9480-91a71360d345 service nova] Lock "27aa03bb-5613-4bde-8bc0-30517f5d48ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:39:55 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-bad3d146-5db5-4271-9e3f-5a629f1d4b8f req-9e6f88e5-014e-47c2-9480-91a71360d345 service nova] Lock "27aa03bb-5613-4bde-8bc0-30517f5d48ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:39:55 user nova-compute[74960]: DEBUG nova.compute.manager [req-bad3d146-5db5-4271-9e3f-5a629f1d4b8f req-9e6f88e5-014e-47c2-9480-91a71360d345 service nova] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] No waiting events found dispatching network-vif-plugged-16df3da7-2b2a-4c74-bb06-779696d25b88 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:39:55 user nova-compute[74960]: WARNING nova.compute.manager [req-bad3d146-5db5-4271-9e3f-5a629f1d4b8f req-9e6f88e5-014e-47c2-9480-91a71360d345 service nova] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] Received unexpected event network-vif-plugged-16df3da7-2b2a-4c74-bb06-779696d25b88 for instance with vm_state active and task_state deleting.
Nov 03 12:39:55 user nova-compute[74960]: INFO nova.compute.manager [-] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] Took 0.83 seconds to deallocate network for instance.
Nov 03 12:39:55 user nova-compute[74960]: DEBUG nova.compute.manager [req-410b6e9f-c788-42a6-b9c4-070b86ea0bc9 req-56e43693-5f2f-4d89-8dfc-d81e6057e249 service nova] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] Received event network-vif-deleted-16df3da7-2b2a-4c74-bb06-779696d25b88 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:39:56 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:39:56 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:39:56 user nova-compute[74960]: INFO nova.compute.manager [None req-20e4e4fc-11f1-4f60-893e-78ce7d9e3578 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] Took 0.97 seconds to detach 1 volumes for instance.
Nov 03 12:39:56 user nova-compute[74960]: DEBUG nova.compute.manager [None req-20e4e4fc-11f1-4f60-893e-78ce7d9e3578 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] [instance: 27aa03bb-5613-4bde-8bc0-30517f5d48ae] Deleting volume: 0d9b574a-cdd4-4118-a061-dfe393a5cd61 {{(pid=74960) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 03 12:39:57 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-20e4e4fc-11f1-4f60-893e-78ce7d9e3578 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:39:57 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-20e4e4fc-11f1-4f60-893e-78ce7d9e3578 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:39:57 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:39:57 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Starting heal instance info cache {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 12:39:57 user nova-compute[74960]: ERROR nova.volume.cinder [None req-efb5dd5f-d8cb-4bd1-b4ce-aa7340e92de9 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Update attachment failed for attachment 0c9b51b3-842f-43d2-baa4-774bf22a814b. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-78e4c77c-2f8e-483d-9ed8-3e1368b4b559) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-78e4c77c-2f8e-483d-9ed8-3e1368b4b559)
Nov 03 12:39:57 user nova-compute[74960]: ERROR nova.compute.manager [None req-efb5dd5f-d8cb-4bd1-b4ce-aa7340e92de9 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a] Failed to attach 6baa9581-03ba-48ce-a1c9-cd5b84f0c1f0 at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-78e4c77c-2f8e-483d-9ed8-3e1368b4b559)
Nov 03 12:39:57 user nova-compute[74960]: ERROR nova.compute.manager [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a] Traceback (most recent call last):
Nov 03 12:39:57 user nova-compute[74960]: ERROR nova.compute.manager [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a]   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 03 12:39:57 user nova-compute[74960]: ERROR nova.compute.manager [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a]     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 03 12:39:57 user nova-compute[74960]: ERROR nova.compute.manager [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 03 12:39:57 user nova-compute[74960]: ERROR nova.compute.manager [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a]     ret_val = method(obj, context, *args, **kwargs)
Nov 03 12:39:57 user nova-compute[74960]: ERROR nova.compute.manager [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 03 12:39:57 user nova-compute[74960]: ERROR nova.compute.manager [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a]     self._do_attach(context, instance, volume, volume_api,
Nov 03 12:39:57 user nova-compute[74960]: ERROR nova.compute.manager [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 03 12:39:57 user nova-compute[74960]: ERROR nova.compute.manager [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a]     self._volume_attach(context, volume, connector, instance,
Nov 03 12:39:57 user nova-compute[74960]: ERROR nova.compute.manager [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 03 12:39:57 user nova-compute[74960]: ERROR nova.compute.manager [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a]     connection_info = volume_api.attachment_update(
Nov 03 12:39:57 user nova-compute[74960]: ERROR nova.compute.manager [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 03 12:39:57 user nova-compute[74960]: ERROR nova.compute.manager [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a]     res = method(self, ctx, *args, **kwargs)
Nov 03 12:39:57 user nova-compute[74960]: ERROR nova.compute.manager [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 03 12:39:57 user nova-compute[74960]: ERROR nova.compute.manager [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 03 12:39:57 user nova-compute[74960]: ERROR nova.compute.manager [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 03 12:39:57 user nova-compute[74960]: ERROR nova.compute.manager [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a]     with excutils.save_and_reraise_exception():
Nov 03 12:39:57 user nova-compute[74960]: ERROR nova.compute.manager [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 03 12:39:57 user nova-compute[74960]: ERROR nova.compute.manager [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a]     self.force_reraise()
Nov 03 12:39:57 user nova-compute[74960]: ERROR nova.compute.manager [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 03 12:39:57 user nova-compute[74960]: ERROR nova.compute.manager [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a]     raise self.value
Nov 03 12:39:57 user nova-compute[74960]: ERROR nova.compute.manager [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 03 12:39:57 user nova-compute[74960]: ERROR nova.compute.manager [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a]     context, '3.44', skip_version_check=True).attachments.update(
Nov 03 12:39:57 user nova-compute[74960]: ERROR nova.compute.manager [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 03 12:39:57 user nova-compute[74960]: ERROR nova.compute.manager [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a]     return method.func(obj, *args, **kwargs)
Nov 03 12:39:57 user nova-compute[74960]: ERROR nova.compute.manager [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 03 12:39:57 user nova-compute[74960]: ERROR nova.compute.manager [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a]     resp = self._update('/attachments/%s' % id, body)
Nov 03 12:39:57 user nova-compute[74960]: ERROR nova.compute.manager [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 03 12:39:57 user nova-compute[74960]: ERROR nova.compute.manager [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 03 12:39:57 user nova-compute[74960]: ERROR nova.compute.manager [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 03 12:39:57 user nova-compute[74960]: ERROR nova.compute.manager [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a]     return self._cs_request(url, 'PUT', **kwargs)
Nov 03 12:39:57 user nova-compute[74960]: ERROR nova.compute.manager [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 03 12:39:57 user nova-compute[74960]: ERROR nova.compute.manager [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a]     return self.request(url, method, **kwargs)
Nov 03 12:39:57 user nova-compute[74960]: ERROR nova.compute.manager [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 03 12:39:57 user nova-compute[74960]: ERROR nova.compute.manager [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a]     raise exceptions.from_response(resp, body)
Nov 03 12:39:57 user nova-compute[74960]: ERROR nova.compute.manager [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-78e4c77c-2f8e-483d-9ed8-3e1368b4b559)
Nov 03 12:39:57 user nova-compute[74960]: ERROR nova.compute.manager [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a] 
Nov 03 12:39:57 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-20e4e4fc-11f1-4f60-893e-78ce7d9e3578 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:39:57 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "refresh_cache-b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:39:57 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquired lock "refresh_cache-b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:39:57 user nova-compute[74960]: DEBUG nova.network.neutron [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d] Forcefully refreshing network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 12:39:57 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-20e4e4fc-11f1-4f60-893e-78ce7d9e3578 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:39:57 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-20e4e4fc-11f1-4f60-893e-78ce7d9e3578 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.419s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:39:57 user nova-compute[74960]: INFO nova.scheduler.client.report [None req-20e4e4fc-11f1-4f60-893e-78ce7d9e3578 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Deleted allocations for instance 27aa03bb-5613-4bde-8bc0-30517f5d48ae
Nov 03 12:39:57 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-efb5dd5f-d8cb-4bd1-b4ce-aa7340e92de9 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Lock "35e02c80-f626-4918-93f1-6b9a7f778c7a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.548s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:39:57 user nova-compute[74960]: ERROR oslo_messaging.rpc.server [None req-efb5dd5f-d8cb-4bd1-b4ce-aa7340e92de9 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-78e4c77c-2f8e-483d-9ed8-3e1368b4b559)
Nov 03 12:39:57 user nova-compute[74960]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 03 12:39:57 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 03 12:39:57 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 03 12:39:57 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 03 12:39:57 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 03 12:39:57 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 03 12:39:57 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 03 12:39:57 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 03 12:39:57 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 03 12:39:57 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 03 12:39:57 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 03 12:39:57 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 03 12:39:57 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 03 12:39:57 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 03 12:39:57 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 03 12:39:57 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Nov 03 12:39:57 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 03 12:39:57 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Nov 03 12:39:57 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 03 12:39:57 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 03 12:39:57 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 03 12:39:57 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 03 12:39:57 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 03 12:39:57 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Nov 03 12:39:57 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 03 12:39:57 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7553, in attach_volume
Nov 03 12:39:57 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Nov 03 12:39:57 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Nov 03 12:39:57 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Nov 03 12:39:57 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7550, in do_attach_volume
Nov 03 12:39:57 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 03 12:39:57 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 03 12:39:57 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 03 12:39:57 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 03 12:39:57 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 03 12:39:57 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7548, in do_attach_volume
Nov 03 12:39:57 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Nov 03 12:39:57 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7570, in _attach_volume
Nov 03 12:39:57 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 03 12:39:57 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 03 12:39:57 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 03 12:39:57 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 03 12:39:57 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 03 12:39:57 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 03 12:39:57 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 03 12:39:57 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 03 12:39:57 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Nov 03 12:39:57 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 03 12:39:57 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Nov 03 12:39:57 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 03 12:39:57 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Nov 03 12:39:57 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 03 12:39:57 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Nov 03 12:39:57 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 03 12:39:57 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Nov 03 12:39:57 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 03 12:39:57 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 03 12:39:57 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 03 12:39:57 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 03 12:39:57 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 03 12:39:57 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 03 12:39:57 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 03 12:39:57 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 03 12:39:57 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 03 12:39:57 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Nov 03 12:39:57 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 03 12:39:57 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Nov 03 12:39:57 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 03 12:39:57 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Nov 03 12:39:57 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 03 12:39:57 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 03 12:39:57 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 03 12:39:57 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Nov 03 12:39:57 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 03 12:39:57 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Nov 03 12:39:57 user nova-compute[74960]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 03 12:39:57 user nova-compute[74960]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Nov 03 12:39:57 user nova-compute[74960]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-78e4c77c-2f8e-483d-9ed8-3e1368b4b559)
Nov 03 12:39:57 user nova-compute[74960]: ERROR oslo_messaging.rpc.server 
Nov 03 12:39:57 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-20e4e4fc-11f1-4f60-893e-78ce7d9e3578 tempest-ServerActionsV293TestJSON-999594459 tempest-ServerActionsV293TestJSON-999594459-project-member] Lock "27aa03bb-5613-4bde-8bc0-30517f5d48ae" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.851s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:39:57 user nova-compute[74960]: DEBUG nova.network.neutron [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d] Updating instance_info_cache with network_info: [{"id": "b0f443c5-8a12-41fd-9275-81b88b3c08fd", "address": "fa:16:3e:68:31:70", "network": {"id": "9a9a848a-80be-4281-8554-8e28744073b3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1579909169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "434ce6c4b77342299a17e547a14e3918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0f443c5-8a", "ovs_interfaceid": "b0f443c5-8a12-41fd-9275-81b88b3c08fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:39:57 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Releasing lock "refresh_cache-b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:39:57 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d] Updated the network info_cache for instance {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 12:39:57 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:39:58 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:39:58 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:39:58 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:39:58 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Auditing locally available compute resources for user (node: user) {{(pid=74960) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 12:39:58 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f15f5f-8afa-4d7b-bb45-5887184f9ee5/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:39:58 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f15f5f-8afa-4d7b-bb45-5887184f9ee5/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:39:58 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f15f5f-8afa-4d7b-bb45-5887184f9ee5/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:39:58 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f15f5f-8afa-4d7b-bb45-5887184f9ee5/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:39:58 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47eb8ddf-590f-4ffa-87c8-377cf1ee0f67/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:39:58 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:39:58 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47eb8ddf-590f-4ffa-87c8-377cf1ee0f67/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:39:58 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47eb8ddf-590f-4ffa-87c8-377cf1ee0f67/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:39:58 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47eb8ddf-590f-4ffa-87c8-377cf1ee0f67/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:39:58 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60658b54-5e34-4a2b-be14-124e47e291c2/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:39:59 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60658b54-5e34-4a2b-be14-124e47e291c2/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:39:59 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60658b54-5e34-4a2b-be14-124e47e291c2/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:39:59 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60658b54-5e34-4a2b-be14-124e47e291c2/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:39:59 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7b95c0-3726-4a1c-a384-ec91abf75225/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:39:59 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7b95c0-3726-4a1c-a384-ec91abf75225/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:39:59 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7b95c0-3726-4a1c-a384-ec91abf75225/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:39:59 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:39:59 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7b95c0-3726-4a1c-a384-ec91abf75225/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:39:59 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e02c80-f626-4918-93f1-6b9a7f778c7a/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:39:59 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e02c80-f626-4918-93f1-6b9a7f778c7a/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:39:59 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e02c80-f626-4918-93f1-6b9a7f778c7a/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:40:00 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e02c80-f626-4918-93f1-6b9a7f778c7a/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:40:00 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk.rescue --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:40:00 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:40:00 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk.rescue --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:40:00 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:40:00 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:40:00 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:40:00 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:40:00 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:40:00 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74960) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 12:40:00 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7606a55-d5c3-4ba8-b499-f3c70813f151/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:40:01 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7606a55-d5c3-4ba8-b499-f3c70813f151/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:40:01 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7606a55-d5c3-4ba8-b499-f3c70813f151/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:40:01 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7606a55-d5c3-4ba8-b499-f3c70813f151/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:40:01 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82215a04-bd79-4f72-b375-dc73ff9a8654/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:40:01 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82215a04-bd79-4f72-b375-dc73ff9a8654/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:40:01 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82215a04-bd79-4f72-b375-dc73ff9a8654/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:40:01 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82215a04-bd79-4f72-b375-dc73ff9a8654/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:40:01 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74960) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 12:40:01 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/895d6de1-b5d9-4555-af57-f7816183be58/disk.rescue --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:40:01 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/895d6de1-b5d9-4555-af57-f7816183be58/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:40:01 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/895d6de1-b5d9-4555-af57-f7816183be58/disk.rescue --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:40:02 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/895d6de1-b5d9-4555-af57-f7816183be58/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:40:02 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:40:02 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:40:02 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Hypervisor/Node resource view: name=user free_ram=7664MB free_disk=24.748680114746094GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74960) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 12:40:02 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:40:02 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:40:02 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 87f15f5f-8afa-4d7b-bb45-5887184f9ee5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:40:02 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance a6199681-f85e-4f55-966b-6ab3f17cd640 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:40:02 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 5b7b95c0-3726-4a1c-a384-ec91abf75225 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:40:02 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 35e02c80-f626-4918-93f1-6b9a7f778c7a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:40:02 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:40:02 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:40:02 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance b7606a55-d5c3-4ba8-b499-f3c70813f151 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:40:02 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 895d6de1-b5d9-4555-af57-f7816183be58 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:40:02 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 82215a04-bd79-4f72-b375-dc73ff9a8654 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:40:02 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 60658b54-5e34-4a2b-be14-124e47e291c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:40:02 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74960) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 12:40:02 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74960) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 12:40:02 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:40:02 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:40:02 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Compute_service record updated for user:user {{(pid=74960) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 12:40:02 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.495s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:40:03 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:40:03 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:40:03 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:40:03 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:40:04 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:40:04 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74960) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 12:40:04 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:40:08 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:40:09 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:40:13 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:40:14 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:40:18 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:40:19 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:40:23 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:40:24 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:40:29 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:40:34 user nova-compute[74960]: DEBUG nova.compute.manager [req-482138fd-1d46-4d74-b6ce-f9e91f9800e1 req-fb02902f-1a1b-4a4e-9769-f450175c25bf service nova] [instance: 82215a04-bd79-4f72-b375-dc73ff9a8654] Received event network-changed-36091714-1f02-4ac1-9dc7-feef6712069d {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:40:34 user nova-compute[74960]: DEBUG nova.compute.manager [req-482138fd-1d46-4d74-b6ce-f9e91f9800e1 req-fb02902f-1a1b-4a4e-9769-f450175c25bf service nova] [instance: 82215a04-bd79-4f72-b375-dc73ff9a8654] Refreshing instance network info cache due to event network-changed-36091714-1f02-4ac1-9dc7-feef6712069d. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 12:40:34 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-482138fd-1d46-4d74-b6ce-f9e91f9800e1 req-fb02902f-1a1b-4a4e-9769-f450175c25bf service nova] Acquiring lock "refresh_cache-82215a04-bd79-4f72-b375-dc73ff9a8654" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:40:34 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-482138fd-1d46-4d74-b6ce-f9e91f9800e1 req-fb02902f-1a1b-4a4e-9769-f450175c25bf service nova] Acquired lock "refresh_cache-82215a04-bd79-4f72-b375-dc73ff9a8654" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:40:34 user nova-compute[74960]: DEBUG nova.network.neutron [req-482138fd-1d46-4d74-b6ce-f9e91f9800e1 req-fb02902f-1a1b-4a4e-9769-f450175c25bf service nova] [instance: 82215a04-bd79-4f72-b375-dc73ff9a8654] Refreshing network info cache for port 36091714-1f02-4ac1-9dc7-feef6712069d {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 12:40:34 user nova-compute[74960]: DEBUG nova.network.neutron [req-482138fd-1d46-4d74-b6ce-f9e91f9800e1 req-fb02902f-1a1b-4a4e-9769-f450175c25bf service nova] [instance: 82215a04-bd79-4f72-b375-dc73ff9a8654] Updated VIF entry in instance network info cache for port 36091714-1f02-4ac1-9dc7-feef6712069d. {{(pid=74960) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 12:40:34 user nova-compute[74960]: DEBUG nova.network.neutron [req-482138fd-1d46-4d74-b6ce-f9e91f9800e1 req-fb02902f-1a1b-4a4e-9769-f450175c25bf service nova] [instance: 82215a04-bd79-4f72-b375-dc73ff9a8654] Updating instance_info_cache with network_info: [{"id": "36091714-1f02-4ac1-9dc7-feef6712069d", "address": "fa:16:3e:db:fa:06", "network": {"id": "82ebe97c-a056-4ac2-9644-ea315bf9a4b1", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1024050438-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efa134687c74460fb5a59dd3ddece671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36091714-1f", "ovs_interfaceid": "36091714-1f02-4ac1-9dc7-feef6712069d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:40:34 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-482138fd-1d46-4d74-b6ce-f9e91f9800e1 req-fb02902f-1a1b-4a4e-9769-f450175c25bf service nova] Releasing lock "refresh_cache-82215a04-bd79-4f72-b375-dc73ff9a8654" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:40:34 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:40:35 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-060a1436-6458-4638-aa07-a94f313452c4 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Acquiring lock "82215a04-bd79-4f72-b375-dc73ff9a8654" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:40:35 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-060a1436-6458-4638-aa07-a94f313452c4 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Lock "82215a04-bd79-4f72-b375-dc73ff9a8654" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:40:35 user nova-compute[74960]: DEBUG nova.objects.instance [None req-060a1436-6458-4638-aa07-a94f313452c4 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Lazy-loading 'flavor' on Instance uuid 82215a04-bd79-4f72-b375-dc73ff9a8654 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:40:35 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-060a1436-6458-4638-aa07-a94f313452c4 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] [instance: 82215a04-bd79-4f72-b375-dc73ff9a8654] Ignoring supplied device name: /dev/vdb
Nov 03 12:40:35 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-060a1436-6458-4638-aa07-a94f313452c4 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Lock "82215a04-bd79-4f72-b375-dc73ff9a8654" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:40:35 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-060a1436-6458-4638-aa07-a94f313452c4 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Acquiring lock "82215a04-bd79-4f72-b375-dc73ff9a8654" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:40:35 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-060a1436-6458-4638-aa07-a94f313452c4 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Lock "82215a04-bd79-4f72-b375-dc73ff9a8654" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:40:35 user nova-compute[74960]: INFO nova.compute.manager [None req-060a1436-6458-4638-aa07-a94f313452c4 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] [instance: 82215a04-bd79-4f72-b375-dc73ff9a8654] Attaching volume 75cf5a5c-6445-43bf-b3dd-19c8d94645ea to /dev/vdb
Nov 03 12:40:35 user nova-compute[74960]: DEBUG os_brick.utils [None req-060a1436-6458-4638-aa07-a94f313452c4 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:40:35 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:40:35 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:40:35 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c8aca34-6523-40eb-9934-438dd58a26bf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:75b8e219756\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:40:35 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:40:35 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:40:35 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f354964-6bb5-4924-9efd-e5c9507736e2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:40:35 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:40:35 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:40:35 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[dea81f07-d5eb-4e50-b277-a0402ed7046c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:40:35 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[90e7e969-4609-40bd-8e16-0c6c5f08fdf0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:40:35 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-060a1436-6458-4638-aa07-a94f313452c4 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Running cmd (subprocess): nvme version {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:40:35 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-060a1436-6458-4638-aa07-a94f313452c4 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] 'nvme version' failed. Not Retrying. {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 12:40:35 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.nvmeof [None req-060a1436-6458-4638-aa07-a94f313452c4 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] nvme not present on system {{(pid=74960) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 12:40:35 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:40:35 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 12:40:35 user nova-compute[74960]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 12:40:35 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[79d81b6a-4333-4369-aa85-7caf9ab0d423]: (4, '') {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:40:35 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-060a1436-6458-4638-aa07-a94f313452c4 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74960) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 12:40:35 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-060a1436-6458-4638-aa07-a94f313452c4 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74960) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 12:40:35 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-060a1436-6458-4638-aa07-a94f313452c4 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] LIGHTOS: no hostnqn found. {{(pid=74960) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 12:40:35 user nova-compute[74960]: DEBUG os_brick.utils [None req-060a1436-6458-4638-aa07-a94f313452c4 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:75b8e219756', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:40:35 user nova-compute[74960]: DEBUG nova.virt.block_device [None req-060a1436-6458-4638-aa07-a94f313452c4 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] [instance: 82215a04-bd79-4f72-b375-dc73ff9a8654] Updating existing volume attachment record: 72e9751b-1acf-4d19-8d5b-ae7e4c9d55b3 {{(pid=74960) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 12:40:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:40:39 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:40:42 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:40:43 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:40:44 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:40:44 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-457a261a-7eab-4367-b905-1c2241403d83 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Acquiring lock "3cfe99be-b74b-4fd3-a5d6-a94708992c5b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:40:44 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-457a261a-7eab-4367-b905-1c2241403d83 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Lock "3cfe99be-b74b-4fd3-a5d6-a94708992c5b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:40:44 user nova-compute[74960]: DEBUG nova.compute.manager [None req-457a261a-7eab-4367-b905-1c2241403d83 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] Starting instance... {{(pid=74960) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 12:40:45 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-457a261a-7eab-4367-b905-1c2241403d83 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:40:45 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-457a261a-7eab-4367-b905-1c2241403d83 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:40:45 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-457a261a-7eab-4367-b905-1c2241403d83 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74960) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 12:40:45 user nova-compute[74960]: INFO nova.compute.claims [None req-457a261a-7eab-4367-b905-1c2241403d83 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] Claim successful on node user
Nov 03 12:40:45 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-457a261a-7eab-4367-b905-1c2241403d83 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:40:45 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-457a261a-7eab-4367-b905-1c2241403d83 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:40:45 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-457a261a-7eab-4367-b905-1c2241403d83 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.449s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:40:45 user nova-compute[74960]: DEBUG nova.compute.manager [None req-457a261a-7eab-4367-b905-1c2241403d83 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] Start building networks asynchronously for instance. {{(pid=74960) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 12:40:45 user nova-compute[74960]: DEBUG nova.compute.manager [None req-457a261a-7eab-4367-b905-1c2241403d83 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] Allocating IP information in the background. {{(pid=74960) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 12:40:45 user nova-compute[74960]: DEBUG nova.network.neutron [None req-457a261a-7eab-4367-b905-1c2241403d83 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] allocate_for_instance() {{(pid=74960) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 12:40:45 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-457a261a-7eab-4367-b905-1c2241403d83 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 12:40:45 user nova-compute[74960]: DEBUG nova.compute.manager [None req-457a261a-7eab-4367-b905-1c2241403d83 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] Start building block device mappings for instance. {{(pid=74960) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 12:40:45 user nova-compute[74960]: DEBUG nova.policy [None req-457a261a-7eab-4367-b905-1c2241403d83 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '82a995b6307c4ba0b4cf8d5ede286a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434ce6c4b77342299a17e547a14e3918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74960) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 12:40:45 user nova-compute[74960]: DEBUG nova.compute.manager [None req-457a261a-7eab-4367-b905-1c2241403d83 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] Start spawning the instance on the hypervisor. {{(pid=74960) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 12:40:45 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-457a261a-7eab-4367-b905-1c2241403d83 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] Creating instance directory {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 12:40:45 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-457a261a-7eab-4367-b905-1c2241403d83 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] Creating image(s)
Nov 03 12:40:45 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-457a261a-7eab-4367-b905-1c2241403d83 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Acquiring lock "/opt/stack/data/nova/instances/3cfe99be-b74b-4fd3-a5d6-a94708992c5b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:40:45 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-457a261a-7eab-4367-b905-1c2241403d83 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Lock "/opt/stack/data/nova/instances/3cfe99be-b74b-4fd3-a5d6-a94708992c5b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:40:45 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-457a261a-7eab-4367-b905-1c2241403d83 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Lock "/opt/stack/data/nova/instances/3cfe99be-b74b-4fd3-a5d6-a94708992c5b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:40:45 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-457a261a-7eab-4367-b905-1c2241403d83 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:40:45 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-457a261a-7eab-4367-b905-1c2241403d83 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.175s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:40:45 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-457a261a-7eab-4367-b905-1c2241403d83 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Acquiring lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:40:45 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-457a261a-7eab-4367-b905-1c2241403d83 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:40:45 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-457a261a-7eab-4367-b905-1c2241403d83 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:40:46 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-457a261a-7eab-4367-b905-1c2241403d83 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.168s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:40:46 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-457a261a-7eab-4367-b905-1c2241403d83 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910,backing_fmt=raw /opt/stack/data/nova/instances/3cfe99be-b74b-4fd3-a5d6-a94708992c5b/disk 1073741824 {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:40:46 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-457a261a-7eab-4367-b905-1c2241403d83 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910,backing_fmt=raw /opt/stack/data/nova/instances/3cfe99be-b74b-4fd3-a5d6-a94708992c5b/disk 1073741824" returned: 0 in 0.063s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:40:46 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-457a261a-7eab-4367-b905-1c2241403d83 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:40:46 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-457a261a-7eab-4367-b905-1c2241403d83 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:40:46 user nova-compute[74960]: DEBUG nova.network.neutron [None req-457a261a-7eab-4367-b905-1c2241403d83 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] Successfully created port: ad28ac84-3419-4701-90df-e93359da2c28 {{(pid=74960) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 12:40:46 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-457a261a-7eab-4367-b905-1c2241403d83 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.169s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:40:46 user nova-compute[74960]: DEBUG nova.virt.disk.api [None req-457a261a-7eab-4367-b905-1c2241403d83 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3cfe99be-b74b-4fd3-a5d6-a94708992c5b/disk. size=1073741824 {{(pid=74960) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 12:40:46 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-457a261a-7eab-4367-b905-1c2241403d83 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cfe99be-b74b-4fd3-a5d6-a94708992c5b/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:40:46 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-457a261a-7eab-4367-b905-1c2241403d83 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cfe99be-b74b-4fd3-a5d6-a94708992c5b/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:40:46 user nova-compute[74960]: DEBUG nova.virt.disk.api [None req-457a261a-7eab-4367-b905-1c2241403d83 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Cannot resize image /opt/stack/data/nova/instances/3cfe99be-b74b-4fd3-a5d6-a94708992c5b/disk to a smaller size. {{(pid=74960) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 12:40:46 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-457a261a-7eab-4367-b905-1c2241403d83 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] Created local disks {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 12:40:46 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-457a261a-7eab-4367-b905-1c2241403d83 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] Ensure instance console log exists: /opt/stack/data/nova/instances/3cfe99be-b74b-4fd3-a5d6-a94708992c5b/console.log {{(pid=74960) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 12:40:46 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-457a261a-7eab-4367-b905-1c2241403d83 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:40:46 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-457a261a-7eab-4367-b905-1c2241403d83 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:40:46 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-457a261a-7eab-4367-b905-1c2241403d83 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:40:46 user nova-compute[74960]: DEBUG nova.network.neutron [None req-457a261a-7eab-4367-b905-1c2241403d83 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] Successfully updated port: ad28ac84-3419-4701-90df-e93359da2c28 {{(pid=74960) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 12:40:46 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-457a261a-7eab-4367-b905-1c2241403d83 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Acquiring lock "refresh_cache-3cfe99be-b74b-4fd3-a5d6-a94708992c5b" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:40:46 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-457a261a-7eab-4367-b905-1c2241403d83 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Acquired lock "refresh_cache-3cfe99be-b74b-4fd3-a5d6-a94708992c5b" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:40:46 user nova-compute[74960]: DEBUG nova.network.neutron [None req-457a261a-7eab-4367-b905-1c2241403d83 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] Building network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 12:40:47 user nova-compute[74960]: DEBUG nova.compute.manager [req-3e9264f5-0b43-4c36-a7d4-68c3722557f3 req-609027a1-3b94-4aa6-a7f7-e182ae24f05b service nova] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] Received event network-changed-ad28ac84-3419-4701-90df-e93359da2c28 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:40:47 user nova-compute[74960]: DEBUG nova.compute.manager [req-3e9264f5-0b43-4c36-a7d4-68c3722557f3 req-609027a1-3b94-4aa6-a7f7-e182ae24f05b service nova] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] Refreshing instance network info cache due to event network-changed-ad28ac84-3419-4701-90df-e93359da2c28. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 12:40:47 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-3e9264f5-0b43-4c36-a7d4-68c3722557f3 req-609027a1-3b94-4aa6-a7f7-e182ae24f05b service nova] Acquiring lock "refresh_cache-3cfe99be-b74b-4fd3-a5d6-a94708992c5b" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:40:47 user nova-compute[74960]: DEBUG nova.network.neutron [None req-457a261a-7eab-4367-b905-1c2241403d83 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] Instance cache missing network info. {{(pid=74960) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 12:40:47 user nova-compute[74960]: DEBUG nova.network.neutron [None req-457a261a-7eab-4367-b905-1c2241403d83 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] Updating instance_info_cache with network_info: [{"id": "ad28ac84-3419-4701-90df-e93359da2c28", "address": "fa:16:3e:1f:4e:b6", "network": {"id": "9a9a848a-80be-4281-8554-8e28744073b3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1579909169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "434ce6c4b77342299a17e547a14e3918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad28ac84-34", "ovs_interfaceid": "ad28ac84-3419-4701-90df-e93359da2c28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:40:47 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-457a261a-7eab-4367-b905-1c2241403d83 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Releasing lock "refresh_cache-3cfe99be-b74b-4fd3-a5d6-a94708992c5b" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:40:47 user nova-compute[74960]: DEBUG nova.compute.manager [None req-457a261a-7eab-4367-b905-1c2241403d83 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] Instance network_info: |[{"id": "ad28ac84-3419-4701-90df-e93359da2c28", "address": "fa:16:3e:1f:4e:b6", "network": {"id": "9a9a848a-80be-4281-8554-8e28744073b3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1579909169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "434ce6c4b77342299a17e547a14e3918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad28ac84-34", "ovs_interfaceid": "ad28ac84-3419-4701-90df-e93359da2c28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74960) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 12:40:47 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-3e9264f5-0b43-4c36-a7d4-68c3722557f3 req-609027a1-3b94-4aa6-a7f7-e182ae24f05b service nova] Acquired lock "refresh_cache-3cfe99be-b74b-4fd3-a5d6-a94708992c5b" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:40:47 user nova-compute[74960]: DEBUG nova.network.neutron [req-3e9264f5-0b43-4c36-a7d4-68c3722557f3 req-609027a1-3b94-4aa6-a7f7-e182ae24f05b service nova] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] Refreshing network info cache for port ad28ac84-3419-4701-90df-e93359da2c28 {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 12:40:47 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-457a261a-7eab-4367-b905-1c2241403d83 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] Start _get_guest_xml network_info=[{"id": "ad28ac84-3419-4701-90df-e93359da2c28", "address": "fa:16:3e:1f:4e:b6", "network": {"id": "9a9a848a-80be-4281-8554-8e28744073b3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1579909169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "434ce6c4b77342299a17e547a14e3918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad28ac84-34", "ovs_interfaceid": "ad28ac84-3419-4701-90df-e93359da2c28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=549f51ba-ac69-494b-8de1-34635aa2d7cf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='63ee9c80c632442fb0379f47b784bd20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T12:13:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'image_id': '549f51ba-ac69-494b-8de1-34635aa2d7cf'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 12:40:47 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-457a261a-7eab-4367-b905-1c2241403d83 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:40:47 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-457a261a-7eab-4367-b905-1c2241403d83 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:40:47 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-457a261a-7eab-4367-b905-1c2241403d83 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 12:40:47 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-457a261a-7eab-4367-b905-1c2241403d83 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] CPU controller missing on host. {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 12:40:47 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-457a261a-7eab-4367-b905-1c2241403d83 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 12:40:47 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-457a261a-7eab-4367-b905-1c2241403d83 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] CPU controller found on host. {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 12:40:47 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-457a261a-7eab-4367-b905-1c2241403d83 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74960) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 12:40:47 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-457a261a-7eab-4367-b905-1c2241403d83 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=549f51ba-ac69-494b-8de1-34635aa2d7cf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='63ee9c80c632442fb0379f47b784bd20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T12:13:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 12:40:47 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-457a261a-7eab-4367-b905-1c2241403d83 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Flavor limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 12:40:47 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-457a261a-7eab-4367-b905-1c2241403d83 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Image limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 12:40:47 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-457a261a-7eab-4367-b905-1c2241403d83 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Flavor pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 12:40:47 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-457a261a-7eab-4367-b905-1c2241403d83 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Image pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 12:40:47 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-457a261a-7eab-4367-b905-1c2241403d83 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 12:40:47 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-457a261a-7eab-4367-b905-1c2241403d83 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 12:40:47 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-457a261a-7eab-4367-b905-1c2241403d83 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 12:40:47 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-457a261a-7eab-4367-b905-1c2241403d83 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Got 1 possible topologies {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 12:40:47 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-457a261a-7eab-4367-b905-1c2241403d83 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 12:40:47 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-457a261a-7eab-4367-b905-1c2241403d83 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 12:40:47 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-457a261a-7eab-4367-b905-1c2241403d83 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:40:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1884980457',display_name='tempest-ServerRescueNegativeTestJSON-server-1884980457',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1884980457',id=40,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMAPMnFd1JRN0E4yOaz+7M9XDigELBr/MyBa4o6iI8rumzVsQU30J0F61h3Gx9Yw2QtcQXEUTWFuTmbBZuwDvVSgVUx/2raFWAzK21Wh2+8Wr1ogAAMcu8n8DGpouEmeFw==',key_name='tempest-keypair-1713845316',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='434ce6c4b77342299a17e547a14e3918',ramdisk_id='',reservation_id='r-oiu8hz60',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1678469488',owner_user_name='tempest-ServerRescueNegativeTestJSON-1678469488-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:40:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82a995b6307c4ba0b4cf8d5ede286a6c',uuid=3cfe99be-b74b-4fd3-a5d6-a94708992c5b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ad28ac84-3419-4701-90df-e93359da2c28", "address": "fa:16:3e:1f:4e:b6", "network": {"id": "9a9a848a-80be-4281-8554-8e28744073b3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1579909169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "434ce6c4b77342299a17e547a14e3918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad28ac84-34", "ovs_interfaceid": "ad28ac84-3419-4701-90df-e93359da2c28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74960) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 12:40:47 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-457a261a-7eab-4367-b905-1c2241403d83 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Converting VIF {"id": "ad28ac84-3419-4701-90df-e93359da2c28", "address": "fa:16:3e:1f:4e:b6", "network": {"id": "9a9a848a-80be-4281-8554-8e28744073b3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1579909169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "434ce6c4b77342299a17e547a14e3918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad28ac84-34", "ovs_interfaceid": "ad28ac84-3419-4701-90df-e93359da2c28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:40:47 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-457a261a-7eab-4367-b905-1c2241403d83 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:4e:b6,bridge_name='br-int',has_traffic_filtering=True,id=ad28ac84-3419-4701-90df-e93359da2c28,network=Network(9a9a848a-80be-4281-8554-8e28744073b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad28ac84-34') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:40:47 user nova-compute[74960]: DEBUG nova.objects.instance [None req-457a261a-7eab-4367-b905-1c2241403d83 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Lazy-loading 'pci_devices' on Instance uuid 3cfe99be-b74b-4fd3-a5d6-a94708992c5b {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:40:47 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-457a261a-7eab-4367-b905-1c2241403d83 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] End _get_guest_xml xml=<domain type="kvm">
Nov 03 12:40:47 user nova-compute[74960]:   <uuid>3cfe99be-b74b-4fd3-a5d6-a94708992c5b</uuid>
Nov 03 12:40:47 user nova-compute[74960]:   <name>instance-00000028</name>
Nov 03 12:40:47 user nova-compute[74960]:   <memory>524288</memory>
Nov 03 12:40:47 user nova-compute[74960]:   <vcpu>1</vcpu>
Nov 03 12:40:47 user nova-compute[74960]:   <metadata>
Nov 03 12:40:47 user nova-compute[74960]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 12:40:47 user nova-compute[74960]:       <nova:package version="0.0.0"/>
Nov 03 12:40:47 user nova-compute[74960]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1884980457</nova:name>
Nov 03 12:40:47 user nova-compute[74960]:       <nova:creationTime>2023-11-03 12:40:47</nova:creationTime>
Nov 03 12:40:47 user nova-compute[74960]:       <nova:flavor name="m1.tiny">
Nov 03 12:40:47 user nova-compute[74960]:         <nova:memory>512</nova:memory>
Nov 03 12:40:47 user nova-compute[74960]:         <nova:disk>1</nova:disk>
Nov 03 12:40:47 user nova-compute[74960]:         <nova:swap>0</nova:swap>
Nov 03 12:40:47 user nova-compute[74960]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 12:40:47 user nova-compute[74960]:         <nova:vcpus>1</nova:vcpus>
Nov 03 12:40:47 user nova-compute[74960]:       </nova:flavor>
Nov 03 12:40:47 user nova-compute[74960]:       <nova:owner>
Nov 03 12:40:47 user nova-compute[74960]:         <nova:user uuid="82a995b6307c4ba0b4cf8d5ede286a6c">tempest-ServerRescueNegativeTestJSON-1678469488-project-member</nova:user>
Nov 03 12:40:47 user nova-compute[74960]:         <nova:project uuid="434ce6c4b77342299a17e547a14e3918">tempest-ServerRescueNegativeTestJSON-1678469488</nova:project>
Nov 03 12:40:47 user nova-compute[74960]:       </nova:owner>
Nov 03 12:40:47 user nova-compute[74960]:       <nova:root type="image" uuid="549f51ba-ac69-494b-8de1-34635aa2d7cf"/>
Nov 03 12:40:47 user nova-compute[74960]:       <nova:ports>
Nov 03 12:40:47 user nova-compute[74960]:         <nova:port uuid="ad28ac84-3419-4701-90df-e93359da2c28">
Nov 03 12:40:47 user nova-compute[74960]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 03 12:40:47 user nova-compute[74960]:         </nova:port>
Nov 03 12:40:47 user nova-compute[74960]:       </nova:ports>
Nov 03 12:40:47 user nova-compute[74960]:     </nova:instance>
Nov 03 12:40:47 user nova-compute[74960]:   </metadata>
Nov 03 12:40:47 user nova-compute[74960]:   <sysinfo type="smbios">
Nov 03 12:40:47 user nova-compute[74960]:     <system>
Nov 03 12:40:47 user nova-compute[74960]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 12:40:47 user nova-compute[74960]:       <entry name="product">OpenStack Nova</entry>
Nov 03 12:40:47 user nova-compute[74960]:       <entry name="version">0.0.0</entry>
Nov 03 12:40:47 user nova-compute[74960]:       <entry name="serial">3cfe99be-b74b-4fd3-a5d6-a94708992c5b</entry>
Nov 03 12:40:47 user nova-compute[74960]:       <entry name="uuid">3cfe99be-b74b-4fd3-a5d6-a94708992c5b</entry>
Nov 03 12:40:47 user nova-compute[74960]:       <entry name="family">Virtual Machine</entry>
Nov 03 12:40:47 user nova-compute[74960]:     </system>
Nov 03 12:40:47 user nova-compute[74960]:   </sysinfo>
Nov 03 12:40:47 user nova-compute[74960]:   <os>
Nov 03 12:40:47 user nova-compute[74960]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 12:40:47 user nova-compute[74960]:     <boot dev="hd"/>
Nov 03 12:40:47 user nova-compute[74960]:     <smbios mode="sysinfo"/>
Nov 03 12:40:47 user nova-compute[74960]:   </os>
Nov 03 12:40:47 user nova-compute[74960]:   <features>
Nov 03 12:40:47 user nova-compute[74960]:     <acpi/>
Nov 03 12:40:47 user nova-compute[74960]:     <apic/>
Nov 03 12:40:47 user nova-compute[74960]:     <vmcoreinfo/>
Nov 03 12:40:47 user nova-compute[74960]:   </features>
Nov 03 12:40:47 user nova-compute[74960]:   <clock offset="utc">
Nov 03 12:40:47 user nova-compute[74960]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 12:40:47 user nova-compute[74960]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 12:40:47 user nova-compute[74960]:     <timer name="hpet" present="no"/>
Nov 03 12:40:47 user nova-compute[74960]:   </clock>
Nov 03 12:40:47 user nova-compute[74960]:   <cpu mode="custom" match="exact">
Nov 03 12:40:47 user nova-compute[74960]:     <model>Nehalem</model>
Nov 03 12:40:47 user nova-compute[74960]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 12:40:47 user nova-compute[74960]:   </cpu>
Nov 03 12:40:47 user nova-compute[74960]:   <devices>
Nov 03 12:40:47 user nova-compute[74960]:     <disk type="file" device="disk">
Nov 03 12:40:47 user nova-compute[74960]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 12:40:47 user nova-compute[74960]:       <source file="/opt/stack/data/nova/instances/3cfe99be-b74b-4fd3-a5d6-a94708992c5b/disk"/>
Nov 03 12:40:47 user nova-compute[74960]:       <target dev="vda" bus="virtio"/>
Nov 03 12:40:47 user nova-compute[74960]:     </disk>
Nov 03 12:40:47 user nova-compute[74960]:     <interface type="ethernet">
Nov 03 12:40:47 user nova-compute[74960]:       <mac address="fa:16:3e:1f:4e:b6"/>
Nov 03 12:40:47 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:40:47 user nova-compute[74960]:       <mtu size="1442"/>
Nov 03 12:40:47 user nova-compute[74960]:       <target dev="tapad28ac84-34"/>
Nov 03 12:40:47 user nova-compute[74960]:     </interface>
Nov 03 12:40:47 user nova-compute[74960]:     <serial type="pty">
Nov 03 12:40:47 user nova-compute[74960]:       <log file="/opt/stack/data/nova/instances/3cfe99be-b74b-4fd3-a5d6-a94708992c5b/console.log" append="off"/>
Nov 03 12:40:47 user nova-compute[74960]:     </serial>
Nov 03 12:40:47 user nova-compute[74960]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 12:40:47 user nova-compute[74960]:     <video>
Nov 03 12:40:47 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:40:47 user nova-compute[74960]:     </video>
Nov 03 12:40:47 user nova-compute[74960]:     <rng model="virtio">
Nov 03 12:40:47 user nova-compute[74960]:       <backend model="random">/dev/urandom</backend>
Nov 03 12:40:47 user nova-compute[74960]:     </rng>
Nov 03 12:40:47 user nova-compute[74960]:     <controller type="usb" index="0" model="none"/>
Nov 03 12:40:47 user nova-compute[74960]:     <memballoon model="virtio">
Nov 03 12:40:47 user nova-compute[74960]:       <stats period="10"/>
Nov 03 12:40:47 user nova-compute[74960]:     </memballoon>
Nov 03 12:40:47 user nova-compute[74960]:   </devices>
Nov 03 12:40:47 user nova-compute[74960]: </domain>
Nov 03 12:40:47 user nova-compute[74960]:  {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 12:40:47 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-457a261a-7eab-4367-b905-1c2241403d83 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:40:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1884980457',display_name='tempest-ServerRescueNegativeTestJSON-server-1884980457',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1884980457',id=40,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMAPMnFd1JRN0E4yOaz+7M9XDigELBr/MyBa4o6iI8rumzVsQU30J0F61h3Gx9Yw2QtcQXEUTWFuTmbBZuwDvVSgVUx/2raFWAzK21Wh2+8Wr1ogAAMcu8n8DGpouEmeFw==',key_name='tempest-keypair-1713845316',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='434ce6c4b77342299a17e547a14e3918',ramdisk_id='',reservation_id='r-oiu8hz60',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1678469488',owner_user_name='tempest-ServerRescueNegativeTestJSON-1678469488-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:40:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82a995b6307c4ba0b4cf8d5ede286a6c',uuid=3cfe99be-b74b-4fd3-a5d6-a94708992c5b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ad28ac84-3419-4701-90df-e93359da2c28", "address": "fa:16:3e:1f:4e:b6", "network": {"id": "9a9a848a-80be-4281-8554-8e28744073b3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1579909169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "434ce6c4b77342299a17e547a14e3918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad28ac84-34", "ovs_interfaceid": "ad28ac84-3419-4701-90df-e93359da2c28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 12:40:47 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-457a261a-7eab-4367-b905-1c2241403d83 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Converting VIF {"id": "ad28ac84-3419-4701-90df-e93359da2c28", "address": "fa:16:3e:1f:4e:b6", "network": {"id": "9a9a848a-80be-4281-8554-8e28744073b3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1579909169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "434ce6c4b77342299a17e547a14e3918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad28ac84-34", "ovs_interfaceid": "ad28ac84-3419-4701-90df-e93359da2c28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:40:47 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-457a261a-7eab-4367-b905-1c2241403d83 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:4e:b6,bridge_name='br-int',has_traffic_filtering=True,id=ad28ac84-3419-4701-90df-e93359da2c28,network=Network(9a9a848a-80be-4281-8554-8e28744073b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad28ac84-34') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:40:47 user nova-compute[74960]: DEBUG os_vif [None req-457a261a-7eab-4367-b905-1c2241403d83 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:4e:b6,bridge_name='br-int',has_traffic_filtering=True,id=ad28ac84-3419-4701-90df-e93359da2c28,network=Network(9a9a848a-80be-4281-8554-8e28744073b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad28ac84-34') {{(pid=74960) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 12:40:47 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:40:47 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:40:47 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 12:40:47 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:40:47 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f987c0f7-210a-5f00-9177-8e7c502d86ed', '_type': 'linux-noop'}}, row=False) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:40:47 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:40:47 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:40:47 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapad28ac84-34, may_exist=True, interface_attrs={}) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:40:47 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapad28ac84-34, col_values=(('qos', UUID('993d46c2-9174-438c-b42f-52fc0a034ee6')),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:40:47 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapad28ac84-34, col_values=(('external_ids', {'iface-id': 'ad28ac84-3419-4701-90df-e93359da2c28', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1f:4e:b6', 'vm-uuid': '3cfe99be-b74b-4fd3-a5d6-a94708992c5b'}),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:40:47 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:40:47 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:40:47 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:40:47 user nova-compute[74960]: INFO os_vif [None req-457a261a-7eab-4367-b905-1c2241403d83 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:4e:b6,bridge_name='br-int',has_traffic_filtering=True,id=ad28ac84-3419-4701-90df-e93359da2c28,network=Network(9a9a848a-80be-4281-8554-8e28744073b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad28ac84-34')
Nov 03 12:40:47 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-457a261a-7eab-4367-b905-1c2241403d83 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] No BDM found with device name vda, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:40:47 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-457a261a-7eab-4367-b905-1c2241403d83 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] No VIF found with MAC fa:16:3e:1f:4e:b6, not building metadata {{(pid=74960) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 12:40:47 user nova-compute[74960]: DEBUG nova.network.neutron [req-3e9264f5-0b43-4c36-a7d4-68c3722557f3 req-609027a1-3b94-4aa6-a7f7-e182ae24f05b service nova] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] Updated VIF entry in instance network info cache for port ad28ac84-3419-4701-90df-e93359da2c28. {{(pid=74960) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 12:40:47 user nova-compute[74960]: DEBUG nova.network.neutron [req-3e9264f5-0b43-4c36-a7d4-68c3722557f3 req-609027a1-3b94-4aa6-a7f7-e182ae24f05b service nova] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] Updating instance_info_cache with network_info: [{"id": "ad28ac84-3419-4701-90df-e93359da2c28", "address": "fa:16:3e:1f:4e:b6", "network": {"id": "9a9a848a-80be-4281-8554-8e28744073b3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1579909169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "434ce6c4b77342299a17e547a14e3918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad28ac84-34", "ovs_interfaceid": "ad28ac84-3419-4701-90df-e93359da2c28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:40:47 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-3e9264f5-0b43-4c36-a7d4-68c3722557f3 req-609027a1-3b94-4aa6-a7f7-e182ae24f05b service nova] Releasing lock "refresh_cache-3cfe99be-b74b-4fd3-a5d6-a94708992c5b" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:40:48 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:40:48 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:40:48 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:40:48 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:40:49 user nova-compute[74960]: DEBUG nova.compute.manager [req-89115212-632f-4176-bdcc-99d8543b3bd5 req-557cd877-cdfb-4fa7-a741-8c210bcdb4ed service nova] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] Received event network-vif-plugged-ad28ac84-3419-4701-90df-e93359da2c28 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:40:49 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-89115212-632f-4176-bdcc-99d8543b3bd5 req-557cd877-cdfb-4fa7-a741-8c210bcdb4ed service nova] Acquiring lock "3cfe99be-b74b-4fd3-a5d6-a94708992c5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:40:49 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-89115212-632f-4176-bdcc-99d8543b3bd5 req-557cd877-cdfb-4fa7-a741-8c210bcdb4ed service nova] Lock "3cfe99be-b74b-4fd3-a5d6-a94708992c5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:40:49 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-89115212-632f-4176-bdcc-99d8543b3bd5 req-557cd877-cdfb-4fa7-a741-8c210bcdb4ed service nova] Lock "3cfe99be-b74b-4fd3-a5d6-a94708992c5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:40:49 user nova-compute[74960]: DEBUG nova.compute.manager [req-89115212-632f-4176-bdcc-99d8543b3bd5 req-557cd877-cdfb-4fa7-a741-8c210bcdb4ed service nova] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] No waiting events found dispatching network-vif-plugged-ad28ac84-3419-4701-90df-e93359da2c28 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:40:49 user nova-compute[74960]: WARNING nova.compute.manager [req-89115212-632f-4176-bdcc-99d8543b3bd5 req-557cd877-cdfb-4fa7-a741-8c210bcdb4ed service nova] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] Received unexpected event network-vif-plugged-ad28ac84-3419-4701-90df-e93359da2c28 for instance with vm_state building and task_state spawning.
Nov 03 12:40:49 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:40:49 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:40:50 user nova-compute[74960]: DEBUG nova.compute.manager [None req-457a261a-7eab-4367-b905-1c2241403d83 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] Instance event wait completed in 0 seconds for  {{(pid=74960) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 12:40:50 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-457a261a-7eab-4367-b905-1c2241403d83 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] Guest created on hypervisor {{(pid=74960) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 12:40:50 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] Instance spawned successfully.
Nov 03 12:40:50 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-457a261a-7eab-4367-b905-1c2241403d83 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 12:40:50 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-457a261a-7eab-4367-b905-1c2241403d83 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] Found default for hw_cdrom_bus of ide {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:40:50 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-457a261a-7eab-4367-b905-1c2241403d83 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] Found default for hw_disk_bus of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:40:50 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-457a261a-7eab-4367-b905-1c2241403d83 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] Found default for hw_input_bus of None {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:40:50 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-457a261a-7eab-4367-b905-1c2241403d83 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] Found default for hw_pointer_model of None {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:40:51 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-457a261a-7eab-4367-b905-1c2241403d83 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] Found default for hw_video_model of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:40:51 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-457a261a-7eab-4367-b905-1c2241403d83 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] Found default for hw_vif_model of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:40:51 user nova-compute[74960]: INFO nova.compute.manager [None req-457a261a-7eab-4367-b905-1c2241403d83 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] Took 5.33 seconds to spawn the instance on the hypervisor.
Nov 03 12:40:51 user nova-compute[74960]: DEBUG nova.compute.manager [None req-457a261a-7eab-4367-b905-1c2241403d83 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] Checking state {{(pid=74960) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 12:40:51 user nova-compute[74960]: DEBUG nova.compute.manager [req-b7f90517-c591-4d2b-976b-9ad9cf6d0b3b req-e9fc3ac1-a236-40c1-9292-4207266daca7 service nova] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] Received event network-vif-plugged-ad28ac84-3419-4701-90df-e93359da2c28 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:40:51 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-b7f90517-c591-4d2b-976b-9ad9cf6d0b3b req-e9fc3ac1-a236-40c1-9292-4207266daca7 service nova] Acquiring lock "3cfe99be-b74b-4fd3-a5d6-a94708992c5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:40:51 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-b7f90517-c591-4d2b-976b-9ad9cf6d0b3b req-e9fc3ac1-a236-40c1-9292-4207266daca7 service nova] Lock "3cfe99be-b74b-4fd3-a5d6-a94708992c5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:40:51 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-b7f90517-c591-4d2b-976b-9ad9cf6d0b3b req-e9fc3ac1-a236-40c1-9292-4207266daca7 service nova] Lock "3cfe99be-b74b-4fd3-a5d6-a94708992c5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:40:51 user nova-compute[74960]: DEBUG nova.compute.manager [req-b7f90517-c591-4d2b-976b-9ad9cf6d0b3b req-e9fc3ac1-a236-40c1-9292-4207266daca7 service nova] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] No waiting events found dispatching network-vif-plugged-ad28ac84-3419-4701-90df-e93359da2c28 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:40:51 user nova-compute[74960]: WARNING nova.compute.manager [req-b7f90517-c591-4d2b-976b-9ad9cf6d0b3b req-e9fc3ac1-a236-40c1-9292-4207266daca7 service nova] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] Received unexpected event network-vif-plugged-ad28ac84-3419-4701-90df-e93359da2c28 for instance with vm_state building and task_state spawning.
Nov 03 12:40:51 user nova-compute[74960]: INFO nova.compute.manager [None req-457a261a-7eab-4367-b905-1c2241403d83 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] Took 6.17 seconds to build instance.
Nov 03 12:40:51 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-457a261a-7eab-4367-b905-1c2241403d83 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Lock "3cfe99be-b74b-4fd3-a5d6-a94708992c5b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.273s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:40:52 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:40:53 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:40:53 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:40:56 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-060a1436-6458-4638-aa07-a94f313452c4 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] [instance: 82215a04-bd79-4f72-b375-dc73ff9a8654] Calling os-brick to attach iSCSI Volume {{(pid=74960) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 12:40:56 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-060a1436-6458-4638-aa07-a94f313452c4 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9aa420acb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:75cf5a5c-6445-43bf-b3dd-19c8d94645ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bFQPpZmo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:40:56 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-060a1436-6458-4638-aa07-a94f313452c4 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:40:56 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-060a1436-6458-4638-aa07-a94f313452c4 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:40:56 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-060a1436-6458-4638-aa07-a94f313452c4 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:40:56 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-060a1436-6458-4638-aa07-a94f313452c4 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:40:56 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-060a1436-6458-4638-aa07-a94f313452c4 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:75cf5a5c-6445-43bf-b3dd-19c8d94645ea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:40:56 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-060a1436-6458-4638-aa07-a94f313452c4 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:75cf5a5c-6445-43bf-b3dd-19c8d94645ea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:40:56 user nova-compute[74960]: INFO os_brick.initiator.connectors.iscsi [None req-060a1436-6458-4638-aa07-a94f313452c4 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 12:40:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75cf5a5c-6445-43bf-b3dd-19c8d94645ea -p 172.16.0.220:3260 {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:40:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75cf5a5c-6445-43bf-b3dd-19c8d94645ea -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:40:56 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3c80598-aad4-49f6-b3bf-5cad7a45cbad]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:40:56 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-060a1436-6458-4638-aa07-a94f313452c4 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 12:40:56 user nova-compute[74960]:  {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:40:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75cf5a5c-6445-43bf-b3dd-19c8d94645ea -p 172.16.0.220:3260 --interface default --op new {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:40:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75cf5a5c-6445-43bf-b3dd-19c8d94645ea -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:40:56 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[b91b58c6-3688-4a85-bb7e-ae01c32d309c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:75cf5a5c-6445-43bf-b3dd-19c8d94645ea] added\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:40:56 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-060a1436-6458-4638-aa07-a94f313452c4 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:75cf5a5c-6445-43bf-b3dd-19c8d94645ea] added
Nov 03 12:40:56 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:40:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75cf5a5c-6445-43bf-b3dd-19c8d94645ea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:40:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75cf5a5c-6445-43bf-b3dd-19c8d94645ea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:40:56 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1b442b7-0af6-402c-9615-90450c42a94e]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:40:56 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-060a1436-6458-4638-aa07-a94f313452c4 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:40:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75cf5a5c-6445-43bf-b3dd-19c8d94645ea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:40:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75cf5a5c-6445-43bf-b3dd-19c8d94645ea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:40:56 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b2b42eb-c3e2-4176-b3da-553d42e1497f]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:40:56 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-060a1436-6458-4638-aa07-a94f313452c4 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:40:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75cf5a5c-6445-43bf-b3dd-19c8d94645ea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bFQPpZmo {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:40:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75cf5a5c-6445-43bf-b3dd-19c8d94645ea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bFQPpZmo" returned: 0 in 0.020s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:40:56 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[fde1a9bc-c609-4ff8-9d8c-f2582eb73f44]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:40:56 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-060a1436-6458-4638-aa07-a94f313452c4 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bFQPpZmo'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:40:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75cf5a5c-6445-43bf-b3dd-19c8d94645ea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:40:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75cf5a5c-6445-43bf-b3dd-19c8d94645ea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:40:56 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec4563e0-96ab-4054-afb8-699e0aa3fc54]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:40:56 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-060a1436-6458-4638-aa07-a94f313452c4 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:40:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:40:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:40:56 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[6001db27-ab73-4b9a-b5b3-a4fc6d2c4743]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7 (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:40:56 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-060a1436-6458-4638-aa07-a94f313452c4 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:40:56 user nova-compute[74960]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7 (non-flash)
Nov 03 12:40:56 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:40:56 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-060a1436-6458-4638-aa07-a94f313452c4 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:40:56 user nova-compute[74960]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7 (non-flash)
Nov 03 12:40:56 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:40:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75cf5a5c-6445-43bf-b3dd-19c8d94645ea -p 172.16.0.220:3260 --login {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:40:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75cf5a5c-6445-43bf-b3dd-19c8d94645ea -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:40:57 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[706087c1-8153-4105-8b4f-a13dc6baa05e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:75cf5a5c-6445-43bf-b3dd-19c8d94645ea, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:75cf5a5c-6445-43bf-b3dd-19c8d94645ea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:40:57 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-060a1436-6458-4638-aa07-a94f313452c4 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:75cf5a5c-6445-43bf-b3dd-19c8d94645ea, portal: 172.16.0.220,3260]
Nov 03 12:40:57 user nova-compute[74960]: Login to [iface: default, target: iqn.2010-10.org.openstack:75cf5a5c-6445-43bf-b3dd-19c8d94645ea, portal: 172.16.0.220,3260] successful.
Nov 03 12:40:57 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:40:57 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75cf5a5c-6445-43bf-b3dd-19c8d94645ea -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:40:57 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75cf5a5c-6445-43bf-b3dd-19c8d94645ea -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:40:57 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ebaeda5-6109-421e-a4e4-d7b09c0770da]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:40:57 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-060a1436-6458-4638-aa07-a94f313452c4 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:40:57 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:40:57 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:40:57 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0815fa8-08c7-411e-804f-be103259f4a1]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75cf5a5c-6445-43bf-b3dd-19c8d94645ea (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:40:57 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-060a1436-6458-4638-aa07-a94f313452c4 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:40:57 user nova-compute[74960]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7 (non-flash)
Nov 03 12:40:57 user nova-compute[74960]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75cf5a5c-6445-43bf-b3dd-19c8d94645ea (non-flash)
Nov 03 12:40:57 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:40:57 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-060a1436-6458-4638-aa07-a94f313452c4 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:40:57 user nova-compute[74960]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7 (non-flash)
Nov 03 12:40:57 user nova-compute[74960]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75cf5a5c-6445-43bf-b3dd-19c8d94645ea (non-flash)
Nov 03 12:40:57 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:40:57 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-060a1436-6458-4638-aa07-a94f313452c4 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:75cf5a5c-6445-43bf-b3dd-19c8d94645ea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:40:57 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-060a1436-6458-4638-aa07-a94f313452c4 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Connected to 172.16.0.220:3260 {{(pid=74960) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 12:40:57 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-060a1436-6458-4638-aa07-a94f313452c4 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] HCTL ('33', '-', '-', 0) found on session 37 with lun 0 {{(pid=74960) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 12:40:57 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-060a1436-6458-4638-aa07-a94f313452c4 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74960) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 12:40:57 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:40:57 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.026s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:40:57 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ae7c469-48eb-43a2-8431-48ab26dbd05b]: (4, ('- - 0', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:40:57 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-060a1436-6458-4638-aa07-a94f313452c4 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Searching for a device in session 37 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74960) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 12:40:57 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-060a1436-6458-4638-aa07-a94f313452c4 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:75cf5a5c-6445-43bf-b3dd-19c8d94645ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bFQPpZmo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74960) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 12:40:57 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:40:57 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:40:57 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Starting heal instance info cache {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 12:40:57 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:40:57 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "refresh_cache-b7606a55-d5c3-4ba8-b499-f3c70813f151" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:40:57 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquired lock "refresh_cache-b7606a55-d5c3-4ba8-b499-f3c70813f151" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:40:57 user nova-compute[74960]: DEBUG nova.network.neutron [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: b7606a55-d5c3-4ba8-b499-f3c70813f151] Forcefully refreshing network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 12:40:57 user nova-compute[74960]: DEBUG nova.network.neutron [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: b7606a55-d5c3-4ba8-b499-f3c70813f151] Updating instance_info_cache with network_info: [{"id": "1c3fd855-b339-4f79-b36c-8e89b6fcc190", "address": "fa:16:3e:4c:62:cc", "network": {"id": "dec66832-56d5-4d68-b11f-8e8eed38f045", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-79099436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc95d68d5e147e1953c855169b17091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c3fd855-b3", "ovs_interfaceid": "1c3fd855-b339-4f79-b36c-8e89b6fcc190", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:40:57 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Releasing lock "refresh_cache-b7606a55-d5c3-4ba8-b499-f3c70813f151" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:40:57 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: b7606a55-d5c3-4ba8-b499-f3c70813f151] Updated the network info_cache for instance {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 12:40:57 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:40:57 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:40:57 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:40:57 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:40:57 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Auditing locally available compute resources for user (node: user) {{(pid=74960) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 12:40:58 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cfe99be-b74b-4fd3-a5d6-a94708992c5b/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:40:58 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-060a1436-6458-4638-aa07-a94f313452c4 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:40:58 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-060a1436-6458-4638-aa07-a94f313452c4 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '26430393437616331', 'path': '/dev/sdb'} {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:40:58 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-060a1436-6458-4638-aa07-a94f313452c4 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] [instance: 82215a04-bd79-4f72-b375-dc73ff9a8654] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26430393437616331', 'path': '/dev/sdb'} {{(pid=74960) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 12:40:58 user nova-compute[74960]: DEBUG nova.objects.instance [None req-060a1436-6458-4638-aa07-a94f313452c4 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Lazy-loading 'flavor' on Instance uuid 82215a04-bd79-4f72-b375-dc73ff9a8654 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:40:58 user nova-compute[74960]: DEBUG nova.virt.libvirt.guest [None req-060a1436-6458-4638-aa07-a94f313452c4 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] attach device xml: <disk type="block" device="disk">
Nov 03 12:40:58 user nova-compute[74960]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 12:40:58 user nova-compute[74960]:   <source dev="/dev/sdb"/>
Nov 03 12:40:58 user nova-compute[74960]:   <target dev="vdb" bus="virtio"/>
Nov 03 12:40:58 user nova-compute[74960]:   <serial>75cf5a5c-6445-43bf-b3dd-19c8d94645ea</serial>
Nov 03 12:40:58 user nova-compute[74960]: </disk>
Nov 03 12:40:58 user nova-compute[74960]:  {{(pid=74960) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 03 12:40:58 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cfe99be-b74b-4fd3-a5d6-a94708992c5b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:40:58 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cfe99be-b74b-4fd3-a5d6-a94708992c5b/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:40:58 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cfe99be-b74b-4fd3-a5d6-a94708992c5b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:40:58 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f15f5f-8afa-4d7b-bb45-5887184f9ee5/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:40:58 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-060a1436-6458-4638-aa07-a94f313452c4 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] No BDM found with device name vda, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:40:58 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-060a1436-6458-4638-aa07-a94f313452c4 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:40:58 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-060a1436-6458-4638-aa07-a94f313452c4 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] No VIF found with MAC fa:16:3e:db:fa:06, not building metadata {{(pid=74960) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 12:40:58 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f15f5f-8afa-4d7b-bb45-5887184f9ee5/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:40:58 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f15f5f-8afa-4d7b-bb45-5887184f9ee5/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:40:58 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-060a1436-6458-4638-aa07-a94f313452c4 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Lock "82215a04-bd79-4f72-b375-dc73ff9a8654" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.209s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:40:58 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f15f5f-8afa-4d7b-bb45-5887184f9ee5/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:40:58 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47eb8ddf-590f-4ffa-87c8-377cf1ee0f67/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:40:59 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47eb8ddf-590f-4ffa-87c8-377cf1ee0f67/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:40:59 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47eb8ddf-590f-4ffa-87c8-377cf1ee0f67/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:40:59 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47eb8ddf-590f-4ffa-87c8-377cf1ee0f67/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:40:59 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60658b54-5e34-4a2b-be14-124e47e291c2/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:40:59 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60658b54-5e34-4a2b-be14-124e47e291c2/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:40:59 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60658b54-5e34-4a2b-be14-124e47e291c2/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:40:59 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60658b54-5e34-4a2b-be14-124e47e291c2/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:40:59 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7b95c0-3726-4a1c-a384-ec91abf75225/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:40:59 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7b95c0-3726-4a1c-a384-ec91abf75225/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:40:59 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7b95c0-3726-4a1c-a384-ec91abf75225/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:40:59 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7b95c0-3726-4a1c-a384-ec91abf75225/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:40:59 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e02c80-f626-4918-93f1-6b9a7f778c7a/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:41:00 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e02c80-f626-4918-93f1-6b9a7f778c7a/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:41:00 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e02c80-f626-4918-93f1-6b9a7f778c7a/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:41:00 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e02c80-f626-4918-93f1-6b9a7f778c7a/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:41:00 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk.rescue --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:41:00 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk.rescue --force-share --output=json" returned: 0 in 0.206s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:41:00 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk.rescue --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:41:00 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:41:00 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:41:00 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:41:00 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:41:01 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:41:01 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74960) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 12:41:01 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7606a55-d5c3-4ba8-b499-f3c70813f151/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:41:01 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7606a55-d5c3-4ba8-b499-f3c70813f151/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:41:01 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7606a55-d5c3-4ba8-b499-f3c70813f151/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:41:01 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7606a55-d5c3-4ba8-b499-f3c70813f151/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:41:01 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82215a04-bd79-4f72-b375-dc73ff9a8654/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:41:01 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82215a04-bd79-4f72-b375-dc73ff9a8654/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:41:01 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82215a04-bd79-4f72-b375-dc73ff9a8654/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:41:01 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82215a04-bd79-4f72-b375-dc73ff9a8654/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:41:01 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74960) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 12:41:01 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74960) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 12:41:01 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/895d6de1-b5d9-4555-af57-f7816183be58/disk.rescue --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:41:02 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/895d6de1-b5d9-4555-af57-f7816183be58/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:41:02 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/895d6de1-b5d9-4555-af57-f7816183be58/disk.rescue --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:41:02 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/895d6de1-b5d9-4555-af57-f7816183be58/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:41:02 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:41:02 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:41:02 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:41:02 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Hypervisor/Node resource view: name=user free_ram=7550MB free_disk=24.70970916748047GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74960) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 12:41:02 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:41:02 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:41:02 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 87f15f5f-8afa-4d7b-bb45-5887184f9ee5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:41:02 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance a6199681-f85e-4f55-966b-6ab3f17cd640 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:41:02 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 5b7b95c0-3726-4a1c-a384-ec91abf75225 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:41:02 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 35e02c80-f626-4918-93f1-6b9a7f778c7a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:41:02 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:41:02 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:41:02 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance b7606a55-d5c3-4ba8-b499-f3c70813f151 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:41:02 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 895d6de1-b5d9-4555-af57-f7816183be58 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:41:02 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 82215a04-bd79-4f72-b375-dc73ff9a8654 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:41:02 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 60658b54-5e34-4a2b-be14-124e47e291c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:41:02 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 3cfe99be-b74b-4fd3-a5d6-a94708992c5b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:41:02 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74960) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 12:41:02 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74960) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 12:41:03 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:41:03 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:41:03 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Compute_service record updated for user:user {{(pid=74960) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 12:41:03 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.540s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:41:03 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:41:03 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:41:03 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:41:03 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:41:05 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:41:05 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74960) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 12:41:07 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:41:08 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:41:09 user nova-compute[74960]: INFO nova.compute.manager [None req-ddc35afe-889d-4ade-9383-bf6940dbd02f tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] Unrescuing
Nov 03 12:41:09 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-ddc35afe-889d-4ade-9383-bf6940dbd02f tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Acquiring lock "refresh_cache-895d6de1-b5d9-4555-af57-f7816183be58" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:41:09 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-ddc35afe-889d-4ade-9383-bf6940dbd02f tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Acquired lock "refresh_cache-895d6de1-b5d9-4555-af57-f7816183be58" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:41:09 user nova-compute[74960]: DEBUG nova.network.neutron [None req-ddc35afe-889d-4ade-9383-bf6940dbd02f tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] Building network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 12:41:09 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:41:09 user nova-compute[74960]: DEBUG nova.network.neutron [None req-ddc35afe-889d-4ade-9383-bf6940dbd02f tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] Updating instance_info_cache with network_info: [{"id": "59f6ddba-fb77-4d36-98da-f4d645355650", "address": "fa:16:3e:df:ac:19", "network": {"id": "dec66832-56d5-4d68-b11f-8e8eed38f045", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-79099436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc95d68d5e147e1953c855169b17091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59f6ddba-fb", "ovs_interfaceid": "59f6ddba-fb77-4d36-98da-f4d645355650", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:41:09 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-ddc35afe-889d-4ade-9383-bf6940dbd02f tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Releasing lock "refresh_cache-895d6de1-b5d9-4555-af57-f7816183be58" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:41:09 user nova-compute[74960]: DEBUG nova.objects.instance [None req-ddc35afe-889d-4ade-9383-bf6940dbd02f tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Lazy-loading 'flavor' on Instance uuid 895d6de1-b5d9-4555-af57-f7816183be58 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:41:09 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:41:09 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:41:09 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:41:09 user nova-compute[74960]: DEBUG nova.compute.manager [req-f083ec90-627c-4571-b3f6-db4c0a4dfc88 req-7c908bd1-369f-4d24-bd91-4b3f8aba6370 service nova] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] Received event network-vif-unplugged-59f6ddba-fb77-4d36-98da-f4d645355650 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:41:09 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-f083ec90-627c-4571-b3f6-db4c0a4dfc88 req-7c908bd1-369f-4d24-bd91-4b3f8aba6370 service nova] Acquiring lock "895d6de1-b5d9-4555-af57-f7816183be58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:41:09 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-f083ec90-627c-4571-b3f6-db4c0a4dfc88 req-7c908bd1-369f-4d24-bd91-4b3f8aba6370 service nova] Lock "895d6de1-b5d9-4555-af57-f7816183be58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:41:09 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-f083ec90-627c-4571-b3f6-db4c0a4dfc88 req-7c908bd1-369f-4d24-bd91-4b3f8aba6370 service nova] Lock "895d6de1-b5d9-4555-af57-f7816183be58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:41:09 user nova-compute[74960]: DEBUG nova.compute.manager [req-f083ec90-627c-4571-b3f6-db4c0a4dfc88 req-7c908bd1-369f-4d24-bd91-4b3f8aba6370 service nova] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] No waiting events found dispatching network-vif-unplugged-59f6ddba-fb77-4d36-98da-f4d645355650 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:41:09 user nova-compute[74960]: WARNING nova.compute.manager [req-f083ec90-627c-4571-b3f6-db4c0a4dfc88 req-7c908bd1-369f-4d24-bd91-4b3f8aba6370 service nova] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] Received unexpected event network-vif-unplugged-59f6ddba-fb77-4d36-98da-f4d645355650 for instance with vm_state rescued and task_state unrescuing.
Nov 03 12:41:09 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:41:10 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] Instance destroyed successfully.
Nov 03 12:41:11 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:41:11 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:41:11 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:41:11 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:41:11 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:41:12 user nova-compute[74960]: DEBUG nova.compute.manager [req-133fbbbc-c165-4b3c-9f93-e03516b844ba req-fc0ab331-2f50-4fc2-83ce-93e6622d6845 service nova] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] Received event network-vif-plugged-59f6ddba-fb77-4d36-98da-f4d645355650 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:41:12 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-133fbbbc-c165-4b3c-9f93-e03516b844ba req-fc0ab331-2f50-4fc2-83ce-93e6622d6845 service nova] Acquiring lock "895d6de1-b5d9-4555-af57-f7816183be58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:41:12 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-133fbbbc-c165-4b3c-9f93-e03516b844ba req-fc0ab331-2f50-4fc2-83ce-93e6622d6845 service nova] Lock "895d6de1-b5d9-4555-af57-f7816183be58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:41:12 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-133fbbbc-c165-4b3c-9f93-e03516b844ba req-fc0ab331-2f50-4fc2-83ce-93e6622d6845 service nova] Lock "895d6de1-b5d9-4555-af57-f7816183be58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:41:12 user nova-compute[74960]: DEBUG nova.compute.manager [req-133fbbbc-c165-4b3c-9f93-e03516b844ba req-fc0ab331-2f50-4fc2-83ce-93e6622d6845 service nova] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] No waiting events found dispatching network-vif-plugged-59f6ddba-fb77-4d36-98da-f4d645355650 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:41:12 user nova-compute[74960]: WARNING nova.compute.manager [req-133fbbbc-c165-4b3c-9f93-e03516b844ba req-fc0ab331-2f50-4fc2-83ce-93e6622d6845 service nova] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] Received unexpected event network-vif-plugged-59f6ddba-fb77-4d36-98da-f4d645355650 for instance with vm_state rescued and task_state unrescuing.
Nov 03 12:41:12 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:41:12 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:41:12 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:41:13 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:41:13 user nova-compute[74960]: DEBUG nova.compute.manager [None req-ddc35afe-889d-4ade-9383-bf6940dbd02f tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] Checking state {{(pid=74960) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 12:41:14 user nova-compute[74960]: DEBUG nova.compute.manager [req-cd872661-e1c0-4b63-ae65-35e5baa6b78a req-93fb5789-7ef1-4112-a845-97dffe75f434 service nova] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] Received event network-vif-plugged-59f6ddba-fb77-4d36-98da-f4d645355650 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:41:14 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-cd872661-e1c0-4b63-ae65-35e5baa6b78a req-93fb5789-7ef1-4112-a845-97dffe75f434 service nova] Acquiring lock "895d6de1-b5d9-4555-af57-f7816183be58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:41:14 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-cd872661-e1c0-4b63-ae65-35e5baa6b78a req-93fb5789-7ef1-4112-a845-97dffe75f434 service nova] Lock "895d6de1-b5d9-4555-af57-f7816183be58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:41:14 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-cd872661-e1c0-4b63-ae65-35e5baa6b78a req-93fb5789-7ef1-4112-a845-97dffe75f434 service nova] Lock "895d6de1-b5d9-4555-af57-f7816183be58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:41:14 user nova-compute[74960]: DEBUG nova.compute.manager [req-cd872661-e1c0-4b63-ae65-35e5baa6b78a req-93fb5789-7ef1-4112-a845-97dffe75f434 service nova] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] No waiting events found dispatching network-vif-plugged-59f6ddba-fb77-4d36-98da-f4d645355650 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:41:14 user nova-compute[74960]: WARNING nova.compute.manager [req-cd872661-e1c0-4b63-ae65-35e5baa6b78a req-93fb5789-7ef1-4112-a845-97dffe75f434 service nova] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] Received unexpected event network-vif-plugged-59f6ddba-fb77-4d36-98da-f4d645355650 for instance with vm_state active and task_state None.
Nov 03 12:41:14 user nova-compute[74960]: DEBUG nova.compute.manager [req-cd872661-e1c0-4b63-ae65-35e5baa6b78a req-93fb5789-7ef1-4112-a845-97dffe75f434 service nova] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] Received event network-vif-plugged-59f6ddba-fb77-4d36-98da-f4d645355650 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:41:14 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-cd872661-e1c0-4b63-ae65-35e5baa6b78a req-93fb5789-7ef1-4112-a845-97dffe75f434 service nova] Acquiring lock "895d6de1-b5d9-4555-af57-f7816183be58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:41:14 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-cd872661-e1c0-4b63-ae65-35e5baa6b78a req-93fb5789-7ef1-4112-a845-97dffe75f434 service nova] Lock "895d6de1-b5d9-4555-af57-f7816183be58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:41:14 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-cd872661-e1c0-4b63-ae65-35e5baa6b78a req-93fb5789-7ef1-4112-a845-97dffe75f434 service nova] Lock "895d6de1-b5d9-4555-af57-f7816183be58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:41:14 user nova-compute[74960]: DEBUG nova.compute.manager [req-cd872661-e1c0-4b63-ae65-35e5baa6b78a req-93fb5789-7ef1-4112-a845-97dffe75f434 service nova] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] No waiting events found dispatching network-vif-plugged-59f6ddba-fb77-4d36-98da-f4d645355650 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:41:14 user nova-compute[74960]: WARNING nova.compute.manager [req-cd872661-e1c0-4b63-ae65-35e5baa6b78a req-93fb5789-7ef1-4112-a845-97dffe75f434 service nova] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] Received unexpected event network-vif-plugged-59f6ddba-fb77-4d36-98da-f4d645355650 for instance with vm_state active and task_state None.
Nov 03 12:41:17 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-4b50adfa-7794-4f14-a983-d069ba6b353e tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Acquiring lock "5b7b95c0-3726-4a1c-a384-ec91abf75225" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:41:17 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-4b50adfa-7794-4f14-a983-d069ba6b353e tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Lock "5b7b95c0-3726-4a1c-a384-ec91abf75225" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:41:17 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-4b50adfa-7794-4f14-a983-d069ba6b353e tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Acquiring lock "5b7b95c0-3726-4a1c-a384-ec91abf75225-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:41:17 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-4b50adfa-7794-4f14-a983-d069ba6b353e tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Lock "5b7b95c0-3726-4a1c-a384-ec91abf75225-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:41:17 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-4b50adfa-7794-4f14-a983-d069ba6b353e tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Lock "5b7b95c0-3726-4a1c-a384-ec91abf75225-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:41:17 user nova-compute[74960]: INFO nova.compute.manager [None req-4b50adfa-7794-4f14-a983-d069ba6b353e tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] Terminating instance
Nov 03 12:41:17 user nova-compute[74960]: DEBUG nova.compute.manager [None req-4b50adfa-7794-4f14-a983-d069ba6b353e tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] Start destroying the instance on the hypervisor. {{(pid=74960) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 12:41:17 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:41:17 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:41:17 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:41:17 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:41:17 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:41:17 user nova-compute[74960]: DEBUG nova.compute.manager [req-59000214-037e-43eb-96e1-92db7dfb3a45 req-ec229336-8cf5-4655-885f-c811c8cd7f0d service nova] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] Received event network-vif-unplugged-091cbb89-dd8a-448e-963a-3dbcafde6bb1 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:41:17 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-59000214-037e-43eb-96e1-92db7dfb3a45 req-ec229336-8cf5-4655-885f-c811c8cd7f0d service nova] Acquiring lock "5b7b95c0-3726-4a1c-a384-ec91abf75225-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:41:17 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-59000214-037e-43eb-96e1-92db7dfb3a45 req-ec229336-8cf5-4655-885f-c811c8cd7f0d service nova] Lock "5b7b95c0-3726-4a1c-a384-ec91abf75225-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:41:17 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-59000214-037e-43eb-96e1-92db7dfb3a45 req-ec229336-8cf5-4655-885f-c811c8cd7f0d service nova] Lock "5b7b95c0-3726-4a1c-a384-ec91abf75225-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:41:17 user nova-compute[74960]: DEBUG nova.compute.manager [req-59000214-037e-43eb-96e1-92db7dfb3a45 req-ec229336-8cf5-4655-885f-c811c8cd7f0d service nova] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] No waiting events found dispatching network-vif-unplugged-091cbb89-dd8a-448e-963a-3dbcafde6bb1 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:41:17 user nova-compute[74960]: DEBUG nova.compute.manager [req-59000214-037e-43eb-96e1-92db7dfb3a45 req-ec229336-8cf5-4655-885f-c811c8cd7f0d service nova] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] Received event network-vif-unplugged-091cbb89-dd8a-448e-963a-3dbcafde6bb1 for instance with task_state deleting. {{(pid=74960) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 12:41:18 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] Instance destroyed successfully.
Nov 03 12:41:18 user nova-compute[74960]: DEBUG nova.objects.instance [None req-4b50adfa-7794-4f14-a983-d069ba6b353e tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Lazy-loading 'resources' on Instance uuid 5b7b95c0-3726-4a1c-a384-ec91abf75225 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:41:18 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-4b50adfa-7794-4f14-a983-d069ba6b353e tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:30:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-666638080',display_name='tempest-AttachVolumeTestJSON-server-666638080',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-666638080',id=28,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIQ2G2kW7RG3ei1U+rVcmbI+Ton8kNiQZeMxqXkABUJCy9iuRMgTZBhGnWGCs6R7DHln/91d5py8pZC0KUaGy+7UnlGfb1FgAKzTpiPtdr0uDnrIs+6hQLHu9y+wv2TiKg==',key_name='tempest-keypair-691388173',keypairs=<?>,launch_index=0,launched_at=2023-11-03T12:30:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a9160afcfdb74ba2aad7bc79e628e96f',ramdisk_id='',reservation_id='r-na1kxuhs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-847320603',owner_user_name='tempest-AttachVolumeTestJSON-847320603-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T12:39:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c599d8677454b60b9434689322a6de2',uuid=5b7b95c0-3726-4a1c-a384-ec91abf75225,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "091cbb89-dd8a-448e-963a-3dbcafde6bb1", "address": "fa:16:3e:cc:a5:1b", "network": {"id": "3eaeac55-9eb7-4301-b5a7-d13735656d8e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-826950903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9160afcfdb74ba2aad7bc79e628e96f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap091cbb89-dd", "ovs_interfaceid": "091cbb89-dd8a-448e-963a-3dbcafde6bb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 12:41:18 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-4b50adfa-7794-4f14-a983-d069ba6b353e tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Converting VIF {"id": "091cbb89-dd8a-448e-963a-3dbcafde6bb1", "address": "fa:16:3e:cc:a5:1b", "network": {"id": "3eaeac55-9eb7-4301-b5a7-d13735656d8e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-826950903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9160afcfdb74ba2aad7bc79e628e96f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap091cbb89-dd", "ovs_interfaceid": "091cbb89-dd8a-448e-963a-3dbcafde6bb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:41:18 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-4b50adfa-7794-4f14-a983-d069ba6b353e tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:a5:1b,bridge_name='br-int',has_traffic_filtering=True,id=091cbb89-dd8a-448e-963a-3dbcafde6bb1,network=Network(3eaeac55-9eb7-4301-b5a7-d13735656d8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap091cbb89-dd') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:41:18 user nova-compute[74960]: DEBUG os_vif [None req-4b50adfa-7794-4f14-a983-d069ba6b353e tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:a5:1b,bridge_name='br-int',has_traffic_filtering=True,id=091cbb89-dd8a-448e-963a-3dbcafde6bb1,network=Network(3eaeac55-9eb7-4301-b5a7-d13735656d8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap091cbb89-dd') {{(pid=74960) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 12:41:18 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:41:18 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap091cbb89-dd, bridge=br-int, if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:41:18 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:41:18 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:41:18 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:41:18 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=18e5a9a3-8e18-4fcc-a98b-8885c88609d0) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:41:18 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:41:18 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:41:18 user nova-compute[74960]: INFO os_vif [None req-4b50adfa-7794-4f14-a983-d069ba6b353e tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:a5:1b,bridge_name='br-int',has_traffic_filtering=True,id=091cbb89-dd8a-448e-963a-3dbcafde6bb1,network=Network(3eaeac55-9eb7-4301-b5a7-d13735656d8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap091cbb89-dd')
Nov 03 12:41:18 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-4b50adfa-7794-4f14-a983-d069ba6b353e tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] Deleting instance files /opt/stack/data/nova/instances/5b7b95c0-3726-4a1c-a384-ec91abf75225_del
Nov 03 12:41:18 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-4b50adfa-7794-4f14-a983-d069ba6b353e tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] Deletion of /opt/stack/data/nova/instances/5b7b95c0-3726-4a1c-a384-ec91abf75225_del complete
Nov 03 12:41:18 user nova-compute[74960]: INFO nova.compute.manager [None req-4b50adfa-7794-4f14-a983-d069ba6b353e tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] Took 0.78 seconds to destroy the instance on the hypervisor.
Nov 03 12:41:18 user nova-compute[74960]: DEBUG oslo.service.loopingcall [None req-4b50adfa-7794-4f14-a983-d069ba6b353e tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74960) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 12:41:18 user nova-compute[74960]: DEBUG nova.compute.manager [-] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] Deallocating network for instance {{(pid=74960) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 12:41:18 user nova-compute[74960]: DEBUG nova.network.neutron [-] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] deallocate_for_instance() {{(pid=74960) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 12:41:18 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:41:19 user nova-compute[74960]: DEBUG nova.network.neutron [-] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] Updating instance_info_cache with network_info: [] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:41:19 user nova-compute[74960]: INFO nova.compute.manager [-] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] Took 0.81 seconds to deallocate network for instance.
Nov 03 12:41:19 user nova-compute[74960]: DEBUG nova.compute.manager [req-0cd78105-36d4-4718-83d8-72fe8d742d05 req-8d101154-297f-4d23-9fe0-7ee14f7747d6 service nova] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] Received event network-vif-deleted-091cbb89-dd8a-448e-963a-3dbcafde6bb1 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:41:19 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-4b50adfa-7794-4f14-a983-d069ba6b353e tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:41:19 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-4b50adfa-7794-4f14-a983-d069ba6b353e tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:41:19 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-4b50adfa-7794-4f14-a983-d069ba6b353e tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:41:19 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-4b50adfa-7794-4f14-a983-d069ba6b353e tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:41:19 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-4b50adfa-7794-4f14-a983-d069ba6b353e tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.495s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:41:19 user nova-compute[74960]: INFO nova.scheduler.client.report [None req-4b50adfa-7794-4f14-a983-d069ba6b353e tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Deleted allocations for instance 5b7b95c0-3726-4a1c-a384-ec91abf75225
Nov 03 12:41:19 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-4b50adfa-7794-4f14-a983-d069ba6b353e tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Lock "5b7b95c0-3726-4a1c-a384-ec91abf75225" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.323s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:41:19 user nova-compute[74960]: DEBUG nova.compute.manager [req-4dea303b-bce4-43c1-8649-8973cf431228 req-db2d2ee5-273e-4087-918b-aaa8ef62604b service nova] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] Received event network-vif-plugged-091cbb89-dd8a-448e-963a-3dbcafde6bb1 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:41:19 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-4dea303b-bce4-43c1-8649-8973cf431228 req-db2d2ee5-273e-4087-918b-aaa8ef62604b service nova] Acquiring lock "5b7b95c0-3726-4a1c-a384-ec91abf75225-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:41:19 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-4dea303b-bce4-43c1-8649-8973cf431228 req-db2d2ee5-273e-4087-918b-aaa8ef62604b service nova] Lock "5b7b95c0-3726-4a1c-a384-ec91abf75225-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:41:19 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-4dea303b-bce4-43c1-8649-8973cf431228 req-db2d2ee5-273e-4087-918b-aaa8ef62604b service nova] Lock "5b7b95c0-3726-4a1c-a384-ec91abf75225-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:41:19 user nova-compute[74960]: DEBUG nova.compute.manager [req-4dea303b-bce4-43c1-8649-8973cf431228 req-db2d2ee5-273e-4087-918b-aaa8ef62604b service nova] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] No waiting events found dispatching network-vif-plugged-091cbb89-dd8a-448e-963a-3dbcafde6bb1 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:41:19 user nova-compute[74960]: WARNING nova.compute.manager [req-4dea303b-bce4-43c1-8649-8973cf431228 req-db2d2ee5-273e-4087-918b-aaa8ef62604b service nova] [instance: 5b7b95c0-3726-4a1c-a384-ec91abf75225] Received unexpected event network-vif-plugged-091cbb89-dd8a-448e-963a-3dbcafde6bb1 for instance with vm_state deleted and task_state None.
Nov 03 12:41:23 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:41:28 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:41:28 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:41:28 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74960) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 12:41:28 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74960) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 12:41:28 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74960) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 12:41:28 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:41:28 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:41:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:41:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:41:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:41:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:41:39 user nova-compute[74960]: DEBUG nova.compute.manager [req-53d6cd95-b561-47d0-a7c6-2c4ce591e3f4 req-a7d0f931-b700-4c7b-8b65-56d16e13d755 service nova] [instance: 60658b54-5e34-4a2b-be14-124e47e291c2] Received event network-changed-70b66449-7eef-45c1-a3b1-69e50370ed0b {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:41:39 user nova-compute[74960]: DEBUG nova.compute.manager [req-53d6cd95-b561-47d0-a7c6-2c4ce591e3f4 req-a7d0f931-b700-4c7b-8b65-56d16e13d755 service nova] [instance: 60658b54-5e34-4a2b-be14-124e47e291c2] Refreshing instance network info cache due to event network-changed-70b66449-7eef-45c1-a3b1-69e50370ed0b. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 12:41:39 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-53d6cd95-b561-47d0-a7c6-2c4ce591e3f4 req-a7d0f931-b700-4c7b-8b65-56d16e13d755 service nova] Acquiring lock "refresh_cache-60658b54-5e34-4a2b-be14-124e47e291c2" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:41:39 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-53d6cd95-b561-47d0-a7c6-2c4ce591e3f4 req-a7d0f931-b700-4c7b-8b65-56d16e13d755 service nova] Acquired lock "refresh_cache-60658b54-5e34-4a2b-be14-124e47e291c2" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:41:39 user nova-compute[74960]: DEBUG nova.network.neutron [req-53d6cd95-b561-47d0-a7c6-2c4ce591e3f4 req-a7d0f931-b700-4c7b-8b65-56d16e13d755 service nova] [instance: 60658b54-5e34-4a2b-be14-124e47e291c2] Refreshing network info cache for port 70b66449-7eef-45c1-a3b1-69e50370ed0b {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 12:41:39 user nova-compute[74960]: DEBUG nova.network.neutron [req-53d6cd95-b561-47d0-a7c6-2c4ce591e3f4 req-a7d0f931-b700-4c7b-8b65-56d16e13d755 service nova] [instance: 60658b54-5e34-4a2b-be14-124e47e291c2] Updated VIF entry in instance network info cache for port 70b66449-7eef-45c1-a3b1-69e50370ed0b. {{(pid=74960) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 12:41:39 user nova-compute[74960]: DEBUG nova.network.neutron [req-53d6cd95-b561-47d0-a7c6-2c4ce591e3f4 req-a7d0f931-b700-4c7b-8b65-56d16e13d755 service nova] [instance: 60658b54-5e34-4a2b-be14-124e47e291c2] Updating instance_info_cache with network_info: [{"id": "70b66449-7eef-45c1-a3b1-69e50370ed0b", "address": "fa:16:3e:8f:d3:55", "network": {"id": "6c29b2f1-0c30-45d5-ade3-f792d5af7037", "bridge": "br-int", "label": "tempest-TestStampPattern-1770578791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df8ca5bb565b48648e39e6c128f54a57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70b66449-7e", "ovs_interfaceid": "70b66449-7eef-45c1-a3b1-69e50370ed0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:41:39 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-53d6cd95-b561-47d0-a7c6-2c4ce591e3f4 req-a7d0f931-b700-4c7b-8b65-56d16e13d755 service nova] Releasing lock "refresh_cache-60658b54-5e34-4a2b-be14-124e47e291c2" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:41:39 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-8b7bacd2-4f78-4e4a-96a7-e58b5ba67779 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Acquiring lock "60658b54-5e34-4a2b-be14-124e47e291c2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:41:39 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-8b7bacd2-4f78-4e4a-96a7-e58b5ba67779 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Lock "60658b54-5e34-4a2b-be14-124e47e291c2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:41:39 user nova-compute[74960]: DEBUG nova.objects.instance [None req-8b7bacd2-4f78-4e4a-96a7-e58b5ba67779 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Lazy-loading 'flavor' on Instance uuid 60658b54-5e34-4a2b-be14-124e47e291c2 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:41:39 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-8b7bacd2-4f78-4e4a-96a7-e58b5ba67779 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Lock "60658b54-5e34-4a2b-be14-124e47e291c2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:41:39 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-8b7bacd2-4f78-4e4a-96a7-e58b5ba67779 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Acquiring lock "60658b54-5e34-4a2b-be14-124e47e291c2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:41:39 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-8b7bacd2-4f78-4e4a-96a7-e58b5ba67779 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Lock "60658b54-5e34-4a2b-be14-124e47e291c2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:41:39 user nova-compute[74960]: INFO nova.compute.manager [None req-8b7bacd2-4f78-4e4a-96a7-e58b5ba67779 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] [instance: 60658b54-5e34-4a2b-be14-124e47e291c2] Attaching volume cf27367c-241f-494a-8393-4dd59f97c36a to /dev/vdb
Nov 03 12:41:40 user nova-compute[74960]: DEBUG os_brick.utils [None req-8b7bacd2-4f78-4e4a-96a7-e58b5ba67779 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:41:40 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:41:40 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:41:40 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ccf0258-1bb5-4519-92c4-2441bbfd587e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:75b8e219756\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:41:40 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:41:40 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:41:40 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6ada40d-1698-43f1-b92a-5617b88d8145]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:41:40 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:41:40 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:41:40 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e8c86ca-1e9f-44c0-8847-a6a58e894466]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:41:40 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[829feece-c1b7-405e-8151-408523c5c560]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:41:40 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-8b7bacd2-4f78-4e4a-96a7-e58b5ba67779 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Running cmd (subprocess): nvme version {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:41:40 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-8b7bacd2-4f78-4e4a-96a7-e58b5ba67779 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] 'nvme version' failed. Not Retrying. {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 12:41:40 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8b7bacd2-4f78-4e4a-96a7-e58b5ba67779 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] nvme not present on system {{(pid=74960) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 12:41:40 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:41:40 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 12:41:40 user nova-compute[74960]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 12:41:40 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[c74b7195-758b-4ad3-bc0d-dfb88b3d8189]: (4, '') {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:41:40 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-8b7bacd2-4f78-4e4a-96a7-e58b5ba67779 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74960) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 12:41:40 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-8b7bacd2-4f78-4e4a-96a7-e58b5ba67779 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74960) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 12:41:40 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-8b7bacd2-4f78-4e4a-96a7-e58b5ba67779 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] LIGHTOS: no hostnqn found. {{(pid=74960) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 12:41:40 user nova-compute[74960]: DEBUG os_brick.utils [None req-8b7bacd2-4f78-4e4a-96a7-e58b5ba67779 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:75b8e219756', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:41:40 user nova-compute[74960]: DEBUG nova.virt.block_device [None req-8b7bacd2-4f78-4e4a-96a7-e58b5ba67779 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] [instance: 60658b54-5e34-4a2b-be14-124e47e291c2] Updating existing volume attachment record: ce579782-df1f-41e2-a84a-c8ac8640a958 {{(pid=74960) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 12:41:43 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:41:43 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:41:43 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:41:48 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:41:48 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:41:53 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:41:53 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:41:57 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-9694cfab-e58e-4d24-b16c-9b9718cdab42 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Acquiring lock "82215a04-bd79-4f72-b375-dc73ff9a8654" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:41:57 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-9694cfab-e58e-4d24-b16c-9b9718cdab42 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Lock "82215a04-bd79-4f72-b375-dc73ff9a8654" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:41:57 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:41:57 user nova-compute[74960]: INFO nova.compute.manager [None req-9694cfab-e58e-4d24-b16c-9b9718cdab42 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] [instance: 82215a04-bd79-4f72-b375-dc73ff9a8654] Detaching volume 75cf5a5c-6445-43bf-b3dd-19c8d94645ea
Nov 03 12:41:57 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-ea6ac46b-a454-46c7-8d8b-d120d03e068e tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Acquiring lock "82215a04-bd79-4f72-b375-dc73ff9a8654" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:41:57 user nova-compute[74960]: INFO nova.virt.block_device [None req-9694cfab-e58e-4d24-b16c-9b9718cdab42 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] [instance: 82215a04-bd79-4f72-b375-dc73ff9a8654] Attempting to driver detach volume 75cf5a5c-6445-43bf-b3dd-19c8d94645ea from mountpoint /dev/vdb
Nov 03 12:41:57 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-9694cfab-e58e-4d24-b16c-9b9718cdab42 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Attempting to detach device vdb from instance 82215a04-bd79-4f72-b375-dc73ff9a8654 from the persistent domain config. {{(pid=74960) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 03 12:41:57 user nova-compute[74960]: DEBUG nova.virt.libvirt.guest [None req-9694cfab-e58e-4d24-b16c-9b9718cdab42 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 12:41:57 user nova-compute[74960]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 12:41:57 user nova-compute[74960]:   <source dev="/dev/sdb"/>
Nov 03 12:41:57 user nova-compute[74960]:   <target dev="vdb" bus="virtio"/>
Nov 03 12:41:57 user nova-compute[74960]:   <serial>75cf5a5c-6445-43bf-b3dd-19c8d94645ea</serial>
Nov 03 12:41:57 user nova-compute[74960]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 12:41:57 user nova-compute[74960]: </disk>
Nov 03 12:41:57 user nova-compute[74960]:  {{(pid=74960) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 12:41:57 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-9694cfab-e58e-4d24-b16c-9b9718cdab42 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Successfully detached device vdb from instance 82215a04-bd79-4f72-b375-dc73ff9a8654 from the persistent domain config.
Nov 03 12:41:57 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-9694cfab-e58e-4d24-b16c-9b9718cdab42 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 82215a04-bd79-4f72-b375-dc73ff9a8654 from the live domain config. {{(pid=74960) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 03 12:41:57 user nova-compute[74960]: DEBUG nova.virt.libvirt.guest [None req-9694cfab-e58e-4d24-b16c-9b9718cdab42 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 12:41:57 user nova-compute[74960]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 12:41:57 user nova-compute[74960]:   <source dev="/dev/sdb"/>
Nov 03 12:41:57 user nova-compute[74960]:   <target dev="vdb" bus="virtio"/>
Nov 03 12:41:57 user nova-compute[74960]:   <serial>75cf5a5c-6445-43bf-b3dd-19c8d94645ea</serial>
Nov 03 12:41:57 user nova-compute[74960]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 12:41:57 user nova-compute[74960]: </disk>
Nov 03 12:41:57 user nova-compute[74960]:  {{(pid=74960) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 12:41:57 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-9694cfab-e58e-4d24-b16c-9b9718cdab42 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 82215a04-bd79-4f72-b375-dc73ff9a8654 {{(pid=74960) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 03 12:41:58 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:41:58 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:41:58 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:41:59 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:41:59 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Starting heal instance info cache {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 12:41:59 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Rebuilding the list of instances to heal {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 03 12:41:59 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: 82215a04-bd79-4f72-b375-dc73ff9a8654] Skipping network cache update for instance because it is being deleted. {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9939}}
Nov 03 12:41:59 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "refresh_cache-87f15f5f-8afa-4d7b-bb45-5887184f9ee5" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:41:59 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquired lock "refresh_cache-87f15f5f-8afa-4d7b-bb45-5887184f9ee5" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:41:59 user nova-compute[74960]: DEBUG nova.network.neutron [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: 87f15f5f-8afa-4d7b-bb45-5887184f9ee5] Forcefully refreshing network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 12:41:59 user nova-compute[74960]: DEBUG nova.objects.instance [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lazy-loading 'info_cache' on Instance uuid 87f15f5f-8afa-4d7b-bb45-5887184f9ee5 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:42:00 user nova-compute[74960]: DEBUG nova.network.neutron [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: 87f15f5f-8afa-4d7b-bb45-5887184f9ee5] Updating instance_info_cache with network_info: [{"id": "4a12f8bf-1920-4e7a-afec-9b716b73ff63", "address": "fa:16:3e:be:f4:7d", "network": {"id": "dec66832-56d5-4d68-b11f-8e8eed38f045", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-79099436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc95d68d5e147e1953c855169b17091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a12f8bf-19", "ovs_interfaceid": "4a12f8bf-1920-4e7a-afec-9b716b73ff63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:42:00 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Releasing lock "refresh_cache-87f15f5f-8afa-4d7b-bb45-5887184f9ee5" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:42:00 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: 87f15f5f-8afa-4d7b-bb45-5887184f9ee5] Updated the network info_cache for instance {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 12:42:00 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:42:00 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:42:00 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:42:00 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:42:00 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Auditing locally available compute resources for user (node: user) {{(pid=74960) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 12:42:00 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b7bacd2-4f78-4e4a-96a7-e58b5ba67779 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] [instance: 60658b54-5e34-4a2b-be14-124e47e291c2] Calling os-brick to attach iSCSI Volume {{(pid=74960) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 12:42:00 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b7bacd2-4f78-4e4a-96a7-e58b5ba67779 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9aa420acb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cf27367c-241f-494a-8393-4dd59f97c36a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yleLYbKH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:42:00 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-8b7bacd2-4f78-4e4a-96a7-e58b5ba67779 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:42:00 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-8b7bacd2-4f78-4e4a-96a7-e58b5ba67779 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:42:00 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-8b7bacd2-4f78-4e4a-96a7-e58b5ba67779 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:42:00 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-8b7bacd2-4f78-4e4a-96a7-e58b5ba67779 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:42:00 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-8b7bacd2-4f78-4e4a-96a7-e58b5ba67779 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf27367c-241f-494a-8393-4dd59f97c36a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:42:00 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-8b7bacd2-4f78-4e4a-96a7-e58b5ba67779 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf27367c-241f-494a-8393-4dd59f97c36a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:42:00 user nova-compute[74960]: INFO os_brick.initiator.connectors.iscsi [None req-8b7bacd2-4f78-4e4a-96a7-e58b5ba67779 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 12:42:00 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf27367c-241f-494a-8393-4dd59f97c36a -p 172.16.0.220:3260 {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:42:00 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf27367c-241f-494a-8393-4dd59f97c36a -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:42:00 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ba281a0-ccb1-43e9-8a78-659a955d0373]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:42:00 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b7bacd2-4f78-4e4a-96a7-e58b5ba67779 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 12:42:00 user nova-compute[74960]:  {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:42:00 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf27367c-241f-494a-8393-4dd59f97c36a -p 172.16.0.220:3260 --interface default --op new {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:42:00 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf27367c-241f-494a-8393-4dd59f97c36a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:42:00 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[6546bc8a-79b7-4f28-961e-12ff30a5da87]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cf27367c-241f-494a-8393-4dd59f97c36a] added\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:42:00 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b7bacd2-4f78-4e4a-96a7-e58b5ba67779 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cf27367c-241f-494a-8393-4dd59f97c36a] added
Nov 03 12:42:00 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:42:00 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf27367c-241f-494a-8393-4dd59f97c36a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:42:00 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf27367c-241f-494a-8393-4dd59f97c36a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:42:00 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9d8fc8f-1f04-4158-961b-c7cc463cfbc9]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:42:00 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b7bacd2-4f78-4e4a-96a7-e58b5ba67779 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:42:00 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf27367c-241f-494a-8393-4dd59f97c36a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:42:00 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf27367c-241f-494a-8393-4dd59f97c36a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:42:00 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[37cb224e-ecaa-423c-a2e3-b0663e863a00]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:42:00 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b7bacd2-4f78-4e4a-96a7-e58b5ba67779 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:42:00 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf27367c-241f-494a-8393-4dd59f97c36a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yleLYbKH {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:42:00 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cfe99be-b74b-4fd3-a5d6-a94708992c5b/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:42:00 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf27367c-241f-494a-8393-4dd59f97c36a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yleLYbKH" returned: 0 in 0.043s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:42:00 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3f9dfb9-71bb-4bac-be14-735f4998d054]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:42:00 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b7bacd2-4f78-4e4a-96a7-e58b5ba67779 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yleLYbKH'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:42:00 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf27367c-241f-494a-8393-4dd59f97c36a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:42:00 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf27367c-241f-494a-8393-4dd59f97c36a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:42:00 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[935f3abb-2278-4216-be24-c3e1f0f030a1]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:42:00 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b7bacd2-4f78-4e4a-96a7-e58b5ba67779 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:42:00 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:42:00 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:42:00 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[d29ff6fd-1546-4514-8f5d-4d904a87292f]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75cf5a5c-6445-43bf-b3dd-19c8d94645ea (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:42:00 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b7bacd2-4f78-4e4a-96a7-e58b5ba67779 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:42:00 user nova-compute[74960]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7 (non-flash)
Nov 03 12:42:00 user nova-compute[74960]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75cf5a5c-6445-43bf-b3dd-19c8d94645ea (non-flash)
Nov 03 12:42:00 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:42:00 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b7bacd2-4f78-4e4a-96a7-e58b5ba67779 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:42:00 user nova-compute[74960]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7 (non-flash)
Nov 03 12:42:00 user nova-compute[74960]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75cf5a5c-6445-43bf-b3dd-19c8d94645ea (non-flash)
Nov 03 12:42:00 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:42:00 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf27367c-241f-494a-8393-4dd59f97c36a -p 172.16.0.220:3260 --login {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:42:00 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf27367c-241f-494a-8393-4dd59f97c36a -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:42:00 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fda8dde-b8d7-431c-9b3b-aed7c13c23d6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cf27367c-241f-494a-8393-4dd59f97c36a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cf27367c-241f-494a-8393-4dd59f97c36a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:42:00 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b7bacd2-4f78-4e4a-96a7-e58b5ba67779 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cf27367c-241f-494a-8393-4dd59f97c36a, portal: 172.16.0.220,3260]
Nov 03 12:42:00 user nova-compute[74960]: Login to [iface: default, target: iqn.2010-10.org.openstack:cf27367c-241f-494a-8393-4dd59f97c36a, portal: 172.16.0.220,3260] successful.
Nov 03 12:42:00 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:42:00 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf27367c-241f-494a-8393-4dd59f97c36a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:42:00 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cfe99be-b74b-4fd3-a5d6-a94708992c5b/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:42:00 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cfe99be-b74b-4fd3-a5d6-a94708992c5b/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:42:00 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf27367c-241f-494a-8393-4dd59f97c36a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.035s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:42:00 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b3931f0-f7d9-40a1-b410-72fe1b61c2f1]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:42:00 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b7bacd2-4f78-4e4a-96a7-e58b5ba67779 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:42:00 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:42:00 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:42:00 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[7781434d-1880-4711-9cd3-ce0012bed52d]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75cf5a5c-6445-43bf-b3dd-19c8d94645ea (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf27367c-241f-494a-8393-4dd59f97c36a (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:42:00 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b7bacd2-4f78-4e4a-96a7-e58b5ba67779 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:42:00 user nova-compute[74960]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7 (non-flash)
Nov 03 12:42:00 user nova-compute[74960]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75cf5a5c-6445-43bf-b3dd-19c8d94645ea (non-flash)
Nov 03 12:42:00 user nova-compute[74960]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf27367c-241f-494a-8393-4dd59f97c36a (non-flash)
Nov 03 12:42:00 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:42:00 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b7bacd2-4f78-4e4a-96a7-e58b5ba67779 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:42:00 user nova-compute[74960]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7 (non-flash)
Nov 03 12:42:00 user nova-compute[74960]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75cf5a5c-6445-43bf-b3dd-19c8d94645ea (non-flash)
Nov 03 12:42:00 user nova-compute[74960]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf27367c-241f-494a-8393-4dd59f97c36a (non-flash)
Nov 03 12:42:00 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:42:00 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-8b7bacd2-4f78-4e4a-96a7-e58b5ba67779 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf27367c-241f-494a-8393-4dd59f97c36a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.406s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:42:00 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b7bacd2-4f78-4e4a-96a7-e58b5ba67779 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Connected to 172.16.0.220:3260 {{(pid=74960) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 12:42:00 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-8b7bacd2-4f78-4e4a-96a7-e58b5ba67779 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] HCTL ('34', '-', '-', 0) found on session 38 with lun 0 {{(pid=74960) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 12:42:00 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-8b7bacd2-4f78-4e4a-96a7-e58b5ba67779 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74960) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 12:42:00 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:42:00 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:42:00 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[17ba332c-5069-4958-98da-26a0a67e4a18]: (4, ('- - 0', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:42:00 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-8b7bacd2-4f78-4e4a-96a7-e58b5ba67779 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Searching for a device in session 38 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74960) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 12:42:00 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b7bacd2-4f78-4e4a-96a7-e58b5ba67779 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:cf27367c-241f-494a-8393-4dd59f97c36a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yleLYbKH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74960) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 12:42:00 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cfe99be-b74b-4fd3-a5d6-a94708992c5b/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:42:00 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f15f5f-8afa-4d7b-bb45-5887184f9ee5/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:42:00 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f15f5f-8afa-4d7b-bb45-5887184f9ee5/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:42:00 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f15f5f-8afa-4d7b-bb45-5887184f9ee5/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:42:01 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f15f5f-8afa-4d7b-bb45-5887184f9ee5/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:42:01 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47eb8ddf-590f-4ffa-87c8-377cf1ee0f67/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:42:01 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47eb8ddf-590f-4ffa-87c8-377cf1ee0f67/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:42:01 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47eb8ddf-590f-4ffa-87c8-377cf1ee0f67/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:42:01 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47eb8ddf-590f-4ffa-87c8-377cf1ee0f67/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:42:01 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60658b54-5e34-4a2b-be14-124e47e291c2/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:42:01 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-8b7bacd2-4f78-4e4a-96a7-e58b5ba67779 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.446s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:42:01 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b7bacd2-4f78-4e4a-96a7-e58b5ba67779 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] <== connect_volume: return (1451ms) {'type': 'block', 'scsi_wwn': '23661323966393832', 'path': '/dev/sdc'} {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:42:01 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b7bacd2-4f78-4e4a-96a7-e58b5ba67779 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] [instance: 60658b54-5e34-4a2b-be14-124e47e291c2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23661323966393832', 'path': '/dev/sdc'} {{(pid=74960) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 12:42:01 user nova-compute[74960]: DEBUG nova.objects.instance [None req-8b7bacd2-4f78-4e4a-96a7-e58b5ba67779 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Lazy-loading 'flavor' on Instance uuid 60658b54-5e34-4a2b-be14-124e47e291c2 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:42:01 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60658b54-5e34-4a2b-be14-124e47e291c2/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:42:01 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60658b54-5e34-4a2b-be14-124e47e291c2/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:42:01 user nova-compute[74960]: DEBUG nova.virt.libvirt.guest [None req-8b7bacd2-4f78-4e4a-96a7-e58b5ba67779 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] attach device xml: <disk type="block" device="disk">
Nov 03 12:42:01 user nova-compute[74960]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 12:42:01 user nova-compute[74960]:   <source dev="/dev/sdc"/>
Nov 03 12:42:01 user nova-compute[74960]:   <target dev="vdb" bus="virtio"/>
Nov 03 12:42:01 user nova-compute[74960]:   <serial>cf27367c-241f-494a-8393-4dd59f97c36a</serial>
Nov 03 12:42:01 user nova-compute[74960]: </disk>
Nov 03 12:42:01 user nova-compute[74960]:  {{(pid=74960) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 03 12:42:01 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60658b54-5e34-4a2b-be14-124e47e291c2/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:42:01 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e02c80-f626-4918-93f1-6b9a7f778c7a/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:42:02 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e02c80-f626-4918-93f1-6b9a7f778c7a/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:42:02 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e02c80-f626-4918-93f1-6b9a7f778c7a/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:42:02 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-8b7bacd2-4f78-4e4a-96a7-e58b5ba67779 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] No BDM found with device name vda, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:42:02 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-8b7bacd2-4f78-4e4a-96a7-e58b5ba67779 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:42:02 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-8b7bacd2-4f78-4e4a-96a7-e58b5ba67779 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] No VIF found with MAC fa:16:3e:8f:d3:55, not building metadata {{(pid=74960) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 12:42:02 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e02c80-f626-4918-93f1-6b9a7f778c7a/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:42:02 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk.rescue --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:42:02 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-8b7bacd2-4f78-4e4a-96a7-e58b5ba67779 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Lock "60658b54-5e34-4a2b-be14-124e47e291c2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.341s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:42:02 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:42:02 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk.rescue --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:42:02 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:42:02 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:42:02 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:42:02 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:42:02 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:42:03 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74960) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 12:42:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7606a55-d5c3-4ba8-b499-f3c70813f151/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:42:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7606a55-d5c3-4ba8-b499-f3c70813f151/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:42:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7606a55-d5c3-4ba8-b499-f3c70813f151/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:42:03 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:42:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7606a55-d5c3-4ba8-b499-f3c70813f151/disk --force-share --output=json" returned: 0 in 0.425s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:42:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82215a04-bd79-4f72-b375-dc73ff9a8654/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:42:03 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:42:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82215a04-bd79-4f72-b375-dc73ff9a8654/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:42:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82215a04-bd79-4f72-b375-dc73ff9a8654/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:42:04 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82215a04-bd79-4f72-b375-dc73ff9a8654/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:42:04 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74960) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 12:42:04 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:42:04 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:42:04 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Hypervisor/Node resource view: name=user free_ram=7754MB free_disk=24.699298858642578GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74960) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 12:42:04 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:42:04 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:42:04 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 87f15f5f-8afa-4d7b-bb45-5887184f9ee5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:42:04 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance a6199681-f85e-4f55-966b-6ab3f17cd640 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:42:04 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 35e02c80-f626-4918-93f1-6b9a7f778c7a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:42:04 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:42:04 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:42:04 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance b7606a55-d5c3-4ba8-b499-f3c70813f151 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:42:04 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 895d6de1-b5d9-4555-af57-f7816183be58 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:42:04 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 82215a04-bd79-4f72-b375-dc73ff9a8654 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:42:04 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 60658b54-5e34-4a2b-be14-124e47e291c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:42:04 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 3cfe99be-b74b-4fd3-a5d6-a94708992c5b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:42:04 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74960) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 12:42:04 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74960) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 12:42:04 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:42:04 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-e5f424ea-c00d-48b1-81e2-aa4ca518104a tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Acquiring lock "60658b54-5e34-4a2b-be14-124e47e291c2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:42:04 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-e5f424ea-c00d-48b1-81e2-aa4ca518104a tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Lock "60658b54-5e34-4a2b-be14-124e47e291c2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:42:04 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:42:04 user nova-compute[74960]: INFO nova.compute.manager [None req-e5f424ea-c00d-48b1-81e2-aa4ca518104a tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] [instance: 60658b54-5e34-4a2b-be14-124e47e291c2] Detaching volume cf27367c-241f-494a-8393-4dd59f97c36a
Nov 03 12:42:04 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Compute_service record updated for user:user {{(pid=74960) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 12:42:04 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.509s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:42:04 user nova-compute[74960]: INFO nova.virt.block_device [None req-e5f424ea-c00d-48b1-81e2-aa4ca518104a tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] [instance: 60658b54-5e34-4a2b-be14-124e47e291c2] Attempting to driver detach volume cf27367c-241f-494a-8393-4dd59f97c36a from mountpoint /dev/vdb
Nov 03 12:42:04 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-e5f424ea-c00d-48b1-81e2-aa4ca518104a tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Attempting to detach device vdb from instance 60658b54-5e34-4a2b-be14-124e47e291c2 from the persistent domain config. {{(pid=74960) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 03 12:42:04 user nova-compute[74960]: DEBUG nova.virt.libvirt.guest [None req-e5f424ea-c00d-48b1-81e2-aa4ca518104a tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 12:42:04 user nova-compute[74960]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 12:42:04 user nova-compute[74960]:   <source dev="/dev/sdc"/>
Nov 03 12:42:04 user nova-compute[74960]:   <target dev="vdb" bus="virtio"/>
Nov 03 12:42:04 user nova-compute[74960]:   <serial>cf27367c-241f-494a-8393-4dd59f97c36a</serial>
Nov 03 12:42:04 user nova-compute[74960]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 12:42:04 user nova-compute[74960]: </disk>
Nov 03 12:42:04 user nova-compute[74960]:  {{(pid=74960) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 12:42:04 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-e5f424ea-c00d-48b1-81e2-aa4ca518104a tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Successfully detached device vdb from instance 60658b54-5e34-4a2b-be14-124e47e291c2 from the persistent domain config.
Nov 03 12:42:04 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-e5f424ea-c00d-48b1-81e2-aa4ca518104a tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 60658b54-5e34-4a2b-be14-124e47e291c2 from the live domain config. {{(pid=74960) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 03 12:42:04 user nova-compute[74960]: DEBUG nova.virt.libvirt.guest [None req-e5f424ea-c00d-48b1-81e2-aa4ca518104a tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 12:42:04 user nova-compute[74960]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 12:42:04 user nova-compute[74960]:   <source dev="/dev/sdc"/>
Nov 03 12:42:04 user nova-compute[74960]:   <target dev="vdb" bus="virtio"/>
Nov 03 12:42:04 user nova-compute[74960]:   <serial>cf27367c-241f-494a-8393-4dd59f97c36a</serial>
Nov 03 12:42:04 user nova-compute[74960]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 12:42:04 user nova-compute[74960]: </disk>
Nov 03 12:42:04 user nova-compute[74960]:  {{(pid=74960) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 12:42:05 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:42:05 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:42:05 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:42:05 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:42:05 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74960) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 12:42:05 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-e5f424ea-c00d-48b1-81e2-aa4ca518104a tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 60658b54-5e34-4a2b-be14-124e47e291c2 {{(pid=74960) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 03 12:42:08 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:42:08 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:42:11 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-375cf158-97ff-4b47-a2b0-41c19624834a tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Acquiring lock "cce474db-fa6f-4670-9be7-88a3e62caa60" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:42:11 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-375cf158-97ff-4b47-a2b0-41c19624834a tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Lock "cce474db-fa6f-4670-9be7-88a3e62caa60" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:42:11 user nova-compute[74960]: DEBUG nova.compute.manager [None req-375cf158-97ff-4b47-a2b0-41c19624834a tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: cce474db-fa6f-4670-9be7-88a3e62caa60] Starting instance... {{(pid=74960) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 12:42:11 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-375cf158-97ff-4b47-a2b0-41c19624834a tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:42:11 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-375cf158-97ff-4b47-a2b0-41c19624834a tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:42:11 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-375cf158-97ff-4b47-a2b0-41c19624834a tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74960) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 12:42:11 user nova-compute[74960]: INFO nova.compute.claims [None req-375cf158-97ff-4b47-a2b0-41c19624834a tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: cce474db-fa6f-4670-9be7-88a3e62caa60] Claim successful on node user
Nov 03 12:42:11 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-375cf158-97ff-4b47-a2b0-41c19624834a tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:42:11 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-375cf158-97ff-4b47-a2b0-41c19624834a tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:42:11 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-375cf158-97ff-4b47-a2b0-41c19624834a tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.437s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:42:11 user nova-compute[74960]: DEBUG nova.compute.manager [None req-375cf158-97ff-4b47-a2b0-41c19624834a tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: cce474db-fa6f-4670-9be7-88a3e62caa60] Start building networks asynchronously for instance. {{(pid=74960) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 12:42:11 user nova-compute[74960]: DEBUG nova.compute.manager [None req-375cf158-97ff-4b47-a2b0-41c19624834a tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: cce474db-fa6f-4670-9be7-88a3e62caa60] Allocating IP information in the background. {{(pid=74960) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 12:42:11 user nova-compute[74960]: DEBUG nova.network.neutron [None req-375cf158-97ff-4b47-a2b0-41c19624834a tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: cce474db-fa6f-4670-9be7-88a3e62caa60] allocate_for_instance() {{(pid=74960) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 12:42:11 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-375cf158-97ff-4b47-a2b0-41c19624834a tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: cce474db-fa6f-4670-9be7-88a3e62caa60] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 12:42:11 user nova-compute[74960]: DEBUG nova.compute.manager [None req-375cf158-97ff-4b47-a2b0-41c19624834a tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: cce474db-fa6f-4670-9be7-88a3e62caa60] Start building block device mappings for instance. {{(pid=74960) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 12:42:11 user nova-compute[74960]: DEBUG nova.policy [None req-375cf158-97ff-4b47-a2b0-41c19624834a tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8c599d8677454b60b9434689322a6de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9160afcfdb74ba2aad7bc79e628e96f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74960) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 12:42:12 user nova-compute[74960]: DEBUG nova.compute.manager [None req-375cf158-97ff-4b47-a2b0-41c19624834a tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: cce474db-fa6f-4670-9be7-88a3e62caa60] Start spawning the instance on the hypervisor. {{(pid=74960) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 12:42:12 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-375cf158-97ff-4b47-a2b0-41c19624834a tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: cce474db-fa6f-4670-9be7-88a3e62caa60] Creating instance directory {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 12:42:12 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-375cf158-97ff-4b47-a2b0-41c19624834a tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: cce474db-fa6f-4670-9be7-88a3e62caa60] Creating image(s)
Nov 03 12:42:12 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-375cf158-97ff-4b47-a2b0-41c19624834a tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Acquiring lock "/opt/stack/data/nova/instances/cce474db-fa6f-4670-9be7-88a3e62caa60/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:42:12 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-375cf158-97ff-4b47-a2b0-41c19624834a tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Lock "/opt/stack/data/nova/instances/cce474db-fa6f-4670-9be7-88a3e62caa60/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:42:12 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-375cf158-97ff-4b47-a2b0-41c19624834a tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Lock "/opt/stack/data/nova/instances/cce474db-fa6f-4670-9be7-88a3e62caa60/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:42:12 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-375cf158-97ff-4b47-a2b0-41c19624834a tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:42:12 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-375cf158-97ff-4b47-a2b0-41c19624834a tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.175s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:42:12 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-375cf158-97ff-4b47-a2b0-41c19624834a tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Acquiring lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:42:12 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-375cf158-97ff-4b47-a2b0-41c19624834a tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:42:12 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-375cf158-97ff-4b47-a2b0-41c19624834a tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:42:12 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-375cf158-97ff-4b47-a2b0-41c19624834a tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.185s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:42:12 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-375cf158-97ff-4b47-a2b0-41c19624834a tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910,backing_fmt=raw /opt/stack/data/nova/instances/cce474db-fa6f-4670-9be7-88a3e62caa60/disk 1073741824 {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:42:12 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-375cf158-97ff-4b47-a2b0-41c19624834a tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910,backing_fmt=raw /opt/stack/data/nova/instances/cce474db-fa6f-4670-9be7-88a3e62caa60/disk 1073741824" returned: 0 in 0.073s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:42:12 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-375cf158-97ff-4b47-a2b0-41c19624834a tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.266s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:42:12 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-375cf158-97ff-4b47-a2b0-41c19624834a tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:42:12 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-375cf158-97ff-4b47-a2b0-41c19624834a tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.207s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:42:12 user nova-compute[74960]: DEBUG nova.virt.disk.api [None req-375cf158-97ff-4b47-a2b0-41c19624834a tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cce474db-fa6f-4670-9be7-88a3e62caa60/disk. size=1073741824 {{(pid=74960) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 12:42:12 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-375cf158-97ff-4b47-a2b0-41c19624834a tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cce474db-fa6f-4670-9be7-88a3e62caa60/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:42:12 user nova-compute[74960]: DEBUG nova.network.neutron [None req-375cf158-97ff-4b47-a2b0-41c19624834a tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: cce474db-fa6f-4670-9be7-88a3e62caa60] Successfully created port: 92da7392-5a28-47ec-96d5-a976824a2318 {{(pid=74960) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 12:42:12 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-375cf158-97ff-4b47-a2b0-41c19624834a tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cce474db-fa6f-4670-9be7-88a3e62caa60/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:42:12 user nova-compute[74960]: DEBUG nova.virt.disk.api [None req-375cf158-97ff-4b47-a2b0-41c19624834a tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Cannot resize image /opt/stack/data/nova/instances/cce474db-fa6f-4670-9be7-88a3e62caa60/disk to a smaller size. {{(pid=74960) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 12:42:12 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-375cf158-97ff-4b47-a2b0-41c19624834a tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: cce474db-fa6f-4670-9be7-88a3e62caa60] Created local disks {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 12:42:12 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-375cf158-97ff-4b47-a2b0-41c19624834a tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: cce474db-fa6f-4670-9be7-88a3e62caa60] Ensure instance console log exists: /opt/stack/data/nova/instances/cce474db-fa6f-4670-9be7-88a3e62caa60/console.log {{(pid=74960) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 12:42:12 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-375cf158-97ff-4b47-a2b0-41c19624834a tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:42:12 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-375cf158-97ff-4b47-a2b0-41c19624834a tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:42:12 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-375cf158-97ff-4b47-a2b0-41c19624834a tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:42:13 user nova-compute[74960]: DEBUG nova.network.neutron [None req-375cf158-97ff-4b47-a2b0-41c19624834a tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: cce474db-fa6f-4670-9be7-88a3e62caa60] Successfully updated port: 92da7392-5a28-47ec-96d5-a976824a2318 {{(pid=74960) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 12:42:13 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-375cf158-97ff-4b47-a2b0-41c19624834a tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Acquiring lock "refresh_cache-cce474db-fa6f-4670-9be7-88a3e62caa60" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:42:13 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-375cf158-97ff-4b47-a2b0-41c19624834a tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Acquired lock "refresh_cache-cce474db-fa6f-4670-9be7-88a3e62caa60" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:42:13 user nova-compute[74960]: DEBUG nova.network.neutron [None req-375cf158-97ff-4b47-a2b0-41c19624834a tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: cce474db-fa6f-4670-9be7-88a3e62caa60] Building network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 12:42:13 user nova-compute[74960]: DEBUG nova.compute.manager [req-16dd8eec-cdb0-4bf4-9998-b37feea9767a req-6ab76e67-bc50-488a-bddb-25787df510d0 service nova] [instance: cce474db-fa6f-4670-9be7-88a3e62caa60] Received event network-changed-92da7392-5a28-47ec-96d5-a976824a2318 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:42:13 user nova-compute[74960]: DEBUG nova.compute.manager [req-16dd8eec-cdb0-4bf4-9998-b37feea9767a req-6ab76e67-bc50-488a-bddb-25787df510d0 service nova] [instance: cce474db-fa6f-4670-9be7-88a3e62caa60] Refreshing instance network info cache due to event network-changed-92da7392-5a28-47ec-96d5-a976824a2318. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 12:42:13 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-16dd8eec-cdb0-4bf4-9998-b37feea9767a req-6ab76e67-bc50-488a-bddb-25787df510d0 service nova] Acquiring lock "refresh_cache-cce474db-fa6f-4670-9be7-88a3e62caa60" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:42:13 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:42:13 user nova-compute[74960]: DEBUG nova.network.neutron [None req-375cf158-97ff-4b47-a2b0-41c19624834a tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: cce474db-fa6f-4670-9be7-88a3e62caa60] Instance cache missing network info. {{(pid=74960) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 12:42:13 user nova-compute[74960]: DEBUG nova.network.neutron [None req-375cf158-97ff-4b47-a2b0-41c19624834a tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: cce474db-fa6f-4670-9be7-88a3e62caa60] Updating instance_info_cache with network_info: [{"id": "92da7392-5a28-47ec-96d5-a976824a2318", "address": "fa:16:3e:de:f4:80", "network": {"id": "3eaeac55-9eb7-4301-b5a7-d13735656d8e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-826950903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9160afcfdb74ba2aad7bc79e628e96f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92da7392-5a", "ovs_interfaceid": "92da7392-5a28-47ec-96d5-a976824a2318", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:42:13 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-375cf158-97ff-4b47-a2b0-41c19624834a tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Releasing lock "refresh_cache-cce474db-fa6f-4670-9be7-88a3e62caa60" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:42:13 user nova-compute[74960]: DEBUG nova.compute.manager [None req-375cf158-97ff-4b47-a2b0-41c19624834a tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: cce474db-fa6f-4670-9be7-88a3e62caa60] Instance network_info: |[{"id": "92da7392-5a28-47ec-96d5-a976824a2318", "address": "fa:16:3e:de:f4:80", "network": {"id": "3eaeac55-9eb7-4301-b5a7-d13735656d8e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-826950903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9160afcfdb74ba2aad7bc79e628e96f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92da7392-5a", "ovs_interfaceid": "92da7392-5a28-47ec-96d5-a976824a2318", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74960) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 12:42:13 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-16dd8eec-cdb0-4bf4-9998-b37feea9767a req-6ab76e67-bc50-488a-bddb-25787df510d0 service nova] Acquired lock "refresh_cache-cce474db-fa6f-4670-9be7-88a3e62caa60" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:42:13 user nova-compute[74960]: DEBUG nova.network.neutron [req-16dd8eec-cdb0-4bf4-9998-b37feea9767a req-6ab76e67-bc50-488a-bddb-25787df510d0 service nova] [instance: cce474db-fa6f-4670-9be7-88a3e62caa60] Refreshing network info cache for port 92da7392-5a28-47ec-96d5-a976824a2318 {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 12:42:13 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-375cf158-97ff-4b47-a2b0-41c19624834a tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: cce474db-fa6f-4670-9be7-88a3e62caa60] Start _get_guest_xml network_info=[{"id": "92da7392-5a28-47ec-96d5-a976824a2318", "address": "fa:16:3e:de:f4:80", "network": {"id": "3eaeac55-9eb7-4301-b5a7-d13735656d8e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-826950903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9160afcfdb74ba2aad7bc79e628e96f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92da7392-5a", "ovs_interfaceid": "92da7392-5a28-47ec-96d5-a976824a2318", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=549f51ba-ac69-494b-8de1-34635aa2d7cf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='63ee9c80c632442fb0379f47b784bd20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T12:13:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'image_id': '549f51ba-ac69-494b-8de1-34635aa2d7cf'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 12:42:13 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-375cf158-97ff-4b47-a2b0-41c19624834a tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:42:13 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-375cf158-97ff-4b47-a2b0-41c19624834a tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:42:13 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-375cf158-97ff-4b47-a2b0-41c19624834a tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 12:42:13 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-375cf158-97ff-4b47-a2b0-41c19624834a tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] CPU controller missing on host. {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 12:42:13 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-375cf158-97ff-4b47-a2b0-41c19624834a tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 12:42:13 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-375cf158-97ff-4b47-a2b0-41c19624834a tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] CPU controller found on host. {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 12:42:13 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-375cf158-97ff-4b47-a2b0-41c19624834a tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74960) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 12:42:13 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-375cf158-97ff-4b47-a2b0-41c19624834a tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=549f51ba-ac69-494b-8de1-34635aa2d7cf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='63ee9c80c632442fb0379f47b784bd20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T12:13:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 12:42:13 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-375cf158-97ff-4b47-a2b0-41c19624834a tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Flavor limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 12:42:13 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-375cf158-97ff-4b47-a2b0-41c19624834a tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Image limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 12:42:13 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-375cf158-97ff-4b47-a2b0-41c19624834a tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Flavor pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 12:42:13 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-375cf158-97ff-4b47-a2b0-41c19624834a tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Image pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 12:42:13 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-375cf158-97ff-4b47-a2b0-41c19624834a tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 12:42:13 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-375cf158-97ff-4b47-a2b0-41c19624834a tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 12:42:13 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-375cf158-97ff-4b47-a2b0-41c19624834a tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 12:42:13 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-375cf158-97ff-4b47-a2b0-41c19624834a tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Got 1 possible topologies {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 12:42:13 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-375cf158-97ff-4b47-a2b0-41c19624834a tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 12:42:13 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-375cf158-97ff-4b47-a2b0-41c19624834a tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 12:42:13 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-375cf158-97ff-4b47-a2b0-41c19624834a tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:42:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-629060934',display_name='tempest-AttachVolumeTestJSON-server-629060934',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-629060934',id=41,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA8bl/AFIVmNmMMOGMbdAsqlWThR2423PzcvOu83z5vOXMkzGj9R0/u4CtDNGExEqEHN7eVDGokWYtZ+5GqDA6b3aGze6/kTD/hX8wM1t59hVNVpA6Evz+KOxnrw0gLVQw==',key_name='tempest-keypair-1051873060',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a9160afcfdb74ba2aad7bc79e628e96f',ramdisk_id='',reservation_id='r-9fzpw8w1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-847320603',owner_user_name='tempest-AttachVolumeTestJSON-847320603-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:42:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c599d8677454b60b9434689322a6de2',uuid=cce474db-fa6f-4670-9be7-88a3e62caa60,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "92da7392-5a28-47ec-96d5-a976824a2318", "address": "fa:16:3e:de:f4:80", "network": {"id": "3eaeac55-9eb7-4301-b5a7-d13735656d8e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-826950903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9160afcfdb74ba2aad7bc79e628e96f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92da7392-5a", "ovs_interfaceid": "92da7392-5a28-47ec-96d5-a976824a2318", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74960) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 12:42:13 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-375cf158-97ff-4b47-a2b0-41c19624834a tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Converting VIF {"id": "92da7392-5a28-47ec-96d5-a976824a2318", "address": "fa:16:3e:de:f4:80", "network": {"id": "3eaeac55-9eb7-4301-b5a7-d13735656d8e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-826950903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9160afcfdb74ba2aad7bc79e628e96f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92da7392-5a", "ovs_interfaceid": "92da7392-5a28-47ec-96d5-a976824a2318", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:42:13 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-375cf158-97ff-4b47-a2b0-41c19624834a tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:f4:80,bridge_name='br-int',has_traffic_filtering=True,id=92da7392-5a28-47ec-96d5-a976824a2318,network=Network(3eaeac55-9eb7-4301-b5a7-d13735656d8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92da7392-5a') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:42:13 user nova-compute[74960]: DEBUG nova.objects.instance [None req-375cf158-97ff-4b47-a2b0-41c19624834a tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Lazy-loading 'pci_devices' on Instance uuid cce474db-fa6f-4670-9be7-88a3e62caa60 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:42:13 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:42:13 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-375cf158-97ff-4b47-a2b0-41c19624834a tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: cce474db-fa6f-4670-9be7-88a3e62caa60] End _get_guest_xml xml=<domain type="kvm">
Nov 03 12:42:13 user nova-compute[74960]:   <uuid>cce474db-fa6f-4670-9be7-88a3e62caa60</uuid>
Nov 03 12:42:13 user nova-compute[74960]:   <name>instance-00000029</name>
Nov 03 12:42:13 user nova-compute[74960]:   <memory>524288</memory>
Nov 03 12:42:13 user nova-compute[74960]:   <vcpu>1</vcpu>
Nov 03 12:42:13 user nova-compute[74960]:   <metadata>
Nov 03 12:42:13 user nova-compute[74960]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 12:42:13 user nova-compute[74960]:       <nova:package version="0.0.0"/>
Nov 03 12:42:13 user nova-compute[74960]:       <nova:name>tempest-AttachVolumeTestJSON-server-629060934</nova:name>
Nov 03 12:42:13 user nova-compute[74960]:       <nova:creationTime>2023-11-03 12:42:13</nova:creationTime>
Nov 03 12:42:13 user nova-compute[74960]:       <nova:flavor name="m1.tiny">
Nov 03 12:42:13 user nova-compute[74960]:         <nova:memory>512</nova:memory>
Nov 03 12:42:13 user nova-compute[74960]:         <nova:disk>1</nova:disk>
Nov 03 12:42:13 user nova-compute[74960]:         <nova:swap>0</nova:swap>
Nov 03 12:42:13 user nova-compute[74960]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 12:42:13 user nova-compute[74960]:         <nova:vcpus>1</nova:vcpus>
Nov 03 12:42:13 user nova-compute[74960]:       </nova:flavor>
Nov 03 12:42:13 user nova-compute[74960]:       <nova:owner>
Nov 03 12:42:13 user nova-compute[74960]:         <nova:user uuid="8c599d8677454b60b9434689322a6de2">tempest-AttachVolumeTestJSON-847320603-project-member</nova:user>
Nov 03 12:42:13 user nova-compute[74960]:         <nova:project uuid="a9160afcfdb74ba2aad7bc79e628e96f">tempest-AttachVolumeTestJSON-847320603</nova:project>
Nov 03 12:42:13 user nova-compute[74960]:       </nova:owner>
Nov 03 12:42:13 user nova-compute[74960]:       <nova:root type="image" uuid="549f51ba-ac69-494b-8de1-34635aa2d7cf"/>
Nov 03 12:42:13 user nova-compute[74960]:       <nova:ports>
Nov 03 12:42:13 user nova-compute[74960]:         <nova:port uuid="92da7392-5a28-47ec-96d5-a976824a2318">
Nov 03 12:42:13 user nova-compute[74960]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 03 12:42:13 user nova-compute[74960]:         </nova:port>
Nov 03 12:42:13 user nova-compute[74960]:       </nova:ports>
Nov 03 12:42:13 user nova-compute[74960]:     </nova:instance>
Nov 03 12:42:13 user nova-compute[74960]:   </metadata>
Nov 03 12:42:13 user nova-compute[74960]:   <sysinfo type="smbios">
Nov 03 12:42:13 user nova-compute[74960]:     <system>
Nov 03 12:42:13 user nova-compute[74960]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 12:42:13 user nova-compute[74960]:       <entry name="product">OpenStack Nova</entry>
Nov 03 12:42:13 user nova-compute[74960]:       <entry name="version">0.0.0</entry>
Nov 03 12:42:13 user nova-compute[74960]:       <entry name="serial">cce474db-fa6f-4670-9be7-88a3e62caa60</entry>
Nov 03 12:42:13 user nova-compute[74960]:       <entry name="uuid">cce474db-fa6f-4670-9be7-88a3e62caa60</entry>
Nov 03 12:42:13 user nova-compute[74960]:       <entry name="family">Virtual Machine</entry>
Nov 03 12:42:13 user nova-compute[74960]:     </system>
Nov 03 12:42:13 user nova-compute[74960]:   </sysinfo>
Nov 03 12:42:13 user nova-compute[74960]:   <os>
Nov 03 12:42:13 user nova-compute[74960]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 12:42:13 user nova-compute[74960]:     <boot dev="hd"/>
Nov 03 12:42:13 user nova-compute[74960]:     <smbios mode="sysinfo"/>
Nov 03 12:42:13 user nova-compute[74960]:   </os>
Nov 03 12:42:13 user nova-compute[74960]:   <features>
Nov 03 12:42:13 user nova-compute[74960]:     <acpi/>
Nov 03 12:42:13 user nova-compute[74960]:     <apic/>
Nov 03 12:42:13 user nova-compute[74960]:     <vmcoreinfo/>
Nov 03 12:42:13 user nova-compute[74960]:   </features>
Nov 03 12:42:13 user nova-compute[74960]:   <clock offset="utc">
Nov 03 12:42:13 user nova-compute[74960]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 12:42:13 user nova-compute[74960]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 12:42:13 user nova-compute[74960]:     <timer name="hpet" present="no"/>
Nov 03 12:42:13 user nova-compute[74960]:   </clock>
Nov 03 12:42:13 user nova-compute[74960]:   <cpu mode="custom" match="exact">
Nov 03 12:42:13 user nova-compute[74960]:     <model>Nehalem</model>
Nov 03 12:42:13 user nova-compute[74960]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 12:42:13 user nova-compute[74960]:   </cpu>
Nov 03 12:42:13 user nova-compute[74960]:   <devices>
Nov 03 12:42:13 user nova-compute[74960]:     <disk type="file" device="disk">
Nov 03 12:42:13 user nova-compute[74960]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 12:42:13 user nova-compute[74960]:       <source file="/opt/stack/data/nova/instances/cce474db-fa6f-4670-9be7-88a3e62caa60/disk"/>
Nov 03 12:42:13 user nova-compute[74960]:       <target dev="vda" bus="virtio"/>
Nov 03 12:42:13 user nova-compute[74960]:     </disk>
Nov 03 12:42:13 user nova-compute[74960]:     <interface type="ethernet">
Nov 03 12:42:13 user nova-compute[74960]:       <mac address="fa:16:3e:de:f4:80"/>
Nov 03 12:42:13 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:42:13 user nova-compute[74960]:       <mtu size="1442"/>
Nov 03 12:42:13 user nova-compute[74960]:       <target dev="tap92da7392-5a"/>
Nov 03 12:42:13 user nova-compute[74960]:     </interface>
Nov 03 12:42:13 user nova-compute[74960]:     <serial type="pty">
Nov 03 12:42:13 user nova-compute[74960]:       <log file="/opt/stack/data/nova/instances/cce474db-fa6f-4670-9be7-88a3e62caa60/console.log" append="off"/>
Nov 03 12:42:13 user nova-compute[74960]:     </serial>
Nov 03 12:42:13 user nova-compute[74960]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 12:42:13 user nova-compute[74960]:     <video>
Nov 03 12:42:13 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:42:13 user nova-compute[74960]:     </video>
Nov 03 12:42:13 user nova-compute[74960]:     <rng model="virtio">
Nov 03 12:42:13 user nova-compute[74960]:       <backend model="random">/dev/urandom</backend>
Nov 03 12:42:13 user nova-compute[74960]:     </rng>
Nov 03 12:42:13 user nova-compute[74960]:     <controller type="usb" index="0" model="none"/>
Nov 03 12:42:13 user nova-compute[74960]:     <memballoon model="virtio">
Nov 03 12:42:13 user nova-compute[74960]:       <stats period="10"/>
Nov 03 12:42:13 user nova-compute[74960]:     </memballoon>
Nov 03 12:42:13 user nova-compute[74960]:   </devices>
Nov 03 12:42:13 user nova-compute[74960]: </domain>
Nov 03 12:42:13 user nova-compute[74960]:  {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 12:42:13 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-375cf158-97ff-4b47-a2b0-41c19624834a tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:42:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-629060934',display_name='tempest-AttachVolumeTestJSON-server-629060934',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-629060934',id=41,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA8bl/AFIVmNmMMOGMbdAsqlWThR2423PzcvOu83z5vOXMkzGj9R0/u4CtDNGExEqEHN7eVDGokWYtZ+5GqDA6b3aGze6/kTD/hX8wM1t59hVNVpA6Evz+KOxnrw0gLVQw==',key_name='tempest-keypair-1051873060',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a9160afcfdb74ba2aad7bc79e628e96f',ramdisk_id='',reservation_id='r-9fzpw8w1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-847320603',owner_user_name='tempest-AttachVolumeTestJSON-847320603-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:42:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c599d8677454b60b9434689322a6de2',uuid=cce474db-fa6f-4670-9be7-88a3e62caa60,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "92da7392-5a28-47ec-96d5-a976824a2318", "address": "fa:16:3e:de:f4:80", "network": {"id": "3eaeac55-9eb7-4301-b5a7-d13735656d8e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-826950903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9160afcfdb74ba2aad7bc79e628e96f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92da7392-5a", "ovs_interfaceid": "92da7392-5a28-47ec-96d5-a976824a2318", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 12:42:13 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-375cf158-97ff-4b47-a2b0-41c19624834a tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Converting VIF {"id": "92da7392-5a28-47ec-96d5-a976824a2318", "address": "fa:16:3e:de:f4:80", "network": {"id": "3eaeac55-9eb7-4301-b5a7-d13735656d8e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-826950903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9160afcfdb74ba2aad7bc79e628e96f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92da7392-5a", "ovs_interfaceid": "92da7392-5a28-47ec-96d5-a976824a2318", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:42:13 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-375cf158-97ff-4b47-a2b0-41c19624834a tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:f4:80,bridge_name='br-int',has_traffic_filtering=True,id=92da7392-5a28-47ec-96d5-a976824a2318,network=Network(3eaeac55-9eb7-4301-b5a7-d13735656d8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92da7392-5a') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:42:13 user nova-compute[74960]: DEBUG os_vif [None req-375cf158-97ff-4b47-a2b0-41c19624834a tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:f4:80,bridge_name='br-int',has_traffic_filtering=True,id=92da7392-5a28-47ec-96d5-a976824a2318,network=Network(3eaeac55-9eb7-4301-b5a7-d13735656d8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92da7392-5a') {{(pid=74960) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 12:42:13 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:42:13 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:42:13 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 12:42:13 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:42:13 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6ddb3b39-0f4f-5683-be94-4d10364e70c3', '_type': 'linux-noop'}}, row=False) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:42:13 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:42:13 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:42:13 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:42:13 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap92da7392-5a, may_exist=True, interface_attrs={}) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:42:13 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap92da7392-5a, col_values=(('qos', UUID('9b87cc13-2156-49c2-ab24-98c46444ca06')),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:42:13 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap92da7392-5a, col_values=(('external_ids', {'iface-id': '92da7392-5a28-47ec-96d5-a976824a2318', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:de:f4:80', 'vm-uuid': 'cce474db-fa6f-4670-9be7-88a3e62caa60'}),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:42:13 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:42:13 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:42:13 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:42:13 user nova-compute[74960]: INFO os_vif [None req-375cf158-97ff-4b47-a2b0-41c19624834a tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:f4:80,bridge_name='br-int',has_traffic_filtering=True,id=92da7392-5a28-47ec-96d5-a976824a2318,network=Network(3eaeac55-9eb7-4301-b5a7-d13735656d8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92da7392-5a')
Nov 03 12:42:13 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-375cf158-97ff-4b47-a2b0-41c19624834a tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] No BDM found with device name vda, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:42:13 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-375cf158-97ff-4b47-a2b0-41c19624834a tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] No VIF found with MAC fa:16:3e:de:f4:80, not building metadata {{(pid=74960) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 12:42:14 user nova-compute[74960]: DEBUG nova.network.neutron [req-16dd8eec-cdb0-4bf4-9998-b37feea9767a req-6ab76e67-bc50-488a-bddb-25787df510d0 service nova] [instance: cce474db-fa6f-4670-9be7-88a3e62caa60] Updated VIF entry in instance network info cache for port 92da7392-5a28-47ec-96d5-a976824a2318. {{(pid=74960) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 12:42:14 user nova-compute[74960]: DEBUG nova.network.neutron [req-16dd8eec-cdb0-4bf4-9998-b37feea9767a req-6ab76e67-bc50-488a-bddb-25787df510d0 service nova] [instance: cce474db-fa6f-4670-9be7-88a3e62caa60] Updating instance_info_cache with network_info: [{"id": "92da7392-5a28-47ec-96d5-a976824a2318", "address": "fa:16:3e:de:f4:80", "network": {"id": "3eaeac55-9eb7-4301-b5a7-d13735656d8e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-826950903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9160afcfdb74ba2aad7bc79e628e96f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92da7392-5a", "ovs_interfaceid": "92da7392-5a28-47ec-96d5-a976824a2318", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:42:14 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-16dd8eec-cdb0-4bf4-9998-b37feea9767a req-6ab76e67-bc50-488a-bddb-25787df510d0 service nova] Releasing lock "refresh_cache-cce474db-fa6f-4670-9be7-88a3e62caa60" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:42:15 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:42:15 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:42:15 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:42:15 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:42:15 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:42:15 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:42:15 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:42:15 user nova-compute[74960]: DEBUG nova.compute.manager [req-cb0e7fe5-92e8-4219-9fc8-c3379584885f req-7593e55b-5dab-4e79-acf4-e14b5b8e4600 service nova] [instance: cce474db-fa6f-4670-9be7-88a3e62caa60] Received event network-vif-plugged-92da7392-5a28-47ec-96d5-a976824a2318 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:42:15 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-cb0e7fe5-92e8-4219-9fc8-c3379584885f req-7593e55b-5dab-4e79-acf4-e14b5b8e4600 service nova] Acquiring lock "cce474db-fa6f-4670-9be7-88a3e62caa60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:42:15 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-cb0e7fe5-92e8-4219-9fc8-c3379584885f req-7593e55b-5dab-4e79-acf4-e14b5b8e4600 service nova] Lock "cce474db-fa6f-4670-9be7-88a3e62caa60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:42:15 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-cb0e7fe5-92e8-4219-9fc8-c3379584885f req-7593e55b-5dab-4e79-acf4-e14b5b8e4600 service nova] Lock "cce474db-fa6f-4670-9be7-88a3e62caa60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:42:15 user nova-compute[74960]: DEBUG nova.compute.manager [req-cb0e7fe5-92e8-4219-9fc8-c3379584885f req-7593e55b-5dab-4e79-acf4-e14b5b8e4600 service nova] [instance: cce474db-fa6f-4670-9be7-88a3e62caa60] No waiting events found dispatching network-vif-plugged-92da7392-5a28-47ec-96d5-a976824a2318 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:42:15 user nova-compute[74960]: WARNING nova.compute.manager [req-cb0e7fe5-92e8-4219-9fc8-c3379584885f req-7593e55b-5dab-4e79-acf4-e14b5b8e4600 service nova] [instance: cce474db-fa6f-4670-9be7-88a3e62caa60] Received unexpected event network-vif-plugged-92da7392-5a28-47ec-96d5-a976824a2318 for instance with vm_state building and task_state spawning.
Nov 03 12:42:17 user nova-compute[74960]: DEBUG nova.compute.manager [None req-375cf158-97ff-4b47-a2b0-41c19624834a tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: cce474db-fa6f-4670-9be7-88a3e62caa60] Instance event wait completed in 0 seconds for  {{(pid=74960) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 12:42:17 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-375cf158-97ff-4b47-a2b0-41c19624834a tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: cce474db-fa6f-4670-9be7-88a3e62caa60] Guest created on hypervisor {{(pid=74960) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 12:42:17 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: cce474db-fa6f-4670-9be7-88a3e62caa60] Instance spawned successfully.
Nov 03 12:42:17 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-375cf158-97ff-4b47-a2b0-41c19624834a tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: cce474db-fa6f-4670-9be7-88a3e62caa60] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 12:42:17 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-375cf158-97ff-4b47-a2b0-41c19624834a tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: cce474db-fa6f-4670-9be7-88a3e62caa60] Found default for hw_cdrom_bus of ide {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:42:17 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-375cf158-97ff-4b47-a2b0-41c19624834a tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: cce474db-fa6f-4670-9be7-88a3e62caa60] Found default for hw_disk_bus of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:42:17 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-375cf158-97ff-4b47-a2b0-41c19624834a tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: cce474db-fa6f-4670-9be7-88a3e62caa60] Found default for hw_input_bus of None {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:42:17 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-375cf158-97ff-4b47-a2b0-41c19624834a tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: cce474db-fa6f-4670-9be7-88a3e62caa60] Found default for hw_pointer_model of None {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:42:17 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-375cf158-97ff-4b47-a2b0-41c19624834a tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: cce474db-fa6f-4670-9be7-88a3e62caa60] Found default for hw_video_model of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:42:17 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-375cf158-97ff-4b47-a2b0-41c19624834a tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: cce474db-fa6f-4670-9be7-88a3e62caa60] Found default for hw_vif_model of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:42:17 user nova-compute[74960]: INFO nova.compute.manager [None req-375cf158-97ff-4b47-a2b0-41c19624834a tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: cce474db-fa6f-4670-9be7-88a3e62caa60] Took 5.41 seconds to spawn the instance on the hypervisor.
Nov 03 12:42:17 user nova-compute[74960]: DEBUG nova.compute.manager [None req-375cf158-97ff-4b47-a2b0-41c19624834a tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: cce474db-fa6f-4670-9be7-88a3e62caa60] Checking state {{(pid=74960) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 12:42:17 user nova-compute[74960]: INFO nova.compute.manager [None req-375cf158-97ff-4b47-a2b0-41c19624834a tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: cce474db-fa6f-4670-9be7-88a3e62caa60] Took 6.18 seconds to build instance.
Nov 03 12:42:17 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-375cf158-97ff-4b47-a2b0-41c19624834a tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Lock "cce474db-fa6f-4670-9be7-88a3e62caa60" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.276s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:42:17 user nova-compute[74960]: DEBUG nova.compute.manager [req-04dd810c-a884-424b-8962-be129a2f0679 req-531f1547-f876-4f19-a6be-55e3705e4d18 service nova] [instance: cce474db-fa6f-4670-9be7-88a3e62caa60] Received event network-vif-plugged-92da7392-5a28-47ec-96d5-a976824a2318 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:42:17 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-04dd810c-a884-424b-8962-be129a2f0679 req-531f1547-f876-4f19-a6be-55e3705e4d18 service nova] Acquiring lock "cce474db-fa6f-4670-9be7-88a3e62caa60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:42:17 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-04dd810c-a884-424b-8962-be129a2f0679 req-531f1547-f876-4f19-a6be-55e3705e4d18 service nova] Lock "cce474db-fa6f-4670-9be7-88a3e62caa60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:42:17 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-04dd810c-a884-424b-8962-be129a2f0679 req-531f1547-f876-4f19-a6be-55e3705e4d18 service nova] Lock "cce474db-fa6f-4670-9be7-88a3e62caa60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:42:17 user nova-compute[74960]: DEBUG nova.compute.manager [req-04dd810c-a884-424b-8962-be129a2f0679 req-531f1547-f876-4f19-a6be-55e3705e4d18 service nova] [instance: cce474db-fa6f-4670-9be7-88a3e62caa60] No waiting events found dispatching network-vif-plugged-92da7392-5a28-47ec-96d5-a976824a2318 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:42:17 user nova-compute[74960]: WARNING nova.compute.manager [req-04dd810c-a884-424b-8962-be129a2f0679 req-531f1547-f876-4f19-a6be-55e3705e4d18 service nova] [instance: cce474db-fa6f-4670-9be7-88a3e62caa60] Received unexpected event network-vif-plugged-92da7392-5a28-47ec-96d5-a976824a2318 for instance with vm_state active and task_state None.
Nov 03 12:42:17 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-9694cfab-e58e-4d24-b16c-9b9718cdab42 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 82215a04-bd79-4f72-b375-dc73ff9a8654 is timed out.
Nov 03 12:42:17 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-9694cfab-e58e-4d24-b16c-9b9718cdab42 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Successfully detached device vdb from instance 82215a04-bd79-4f72-b375-dc73ff9a8654 from the live domain config.
Nov 03 12:42:17 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9694cfab-e58e-4d24-b16c-9b9718cdab42 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] [instance: 82215a04-bd79-4f72-b375-dc73ff9a8654] calling os-brick to detach iSCSI Volume {{(pid=74960) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 12:42:17 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-9694cfab-e58e-4d24-b16c-9b9718cdab42 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9aa420acb0>, {'target_iqn': 'iqn.2010-10.org.openstack:75cf5a5c-6445-43bf-b3dd-19c8d94645ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bFQPpZmo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:42:17 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-9694cfab-e58e-4d24-b16c-9b9718cdab42 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:42:17 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-9694cfab-e58e-4d24-b16c-9b9718cdab42 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:42:17 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-9694cfab-e58e-4d24-b16c-9b9718cdab42 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:42:17 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:42:17 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:42:17 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[def8111b-ebf6-4bdd-ae4b-79971841c1b2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cf27367c-241f-494a-8393-4dd59f97c36a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:75cf5a5c-6445-43bf-b3dd-19c8d94645ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:42:17 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-9694cfab-e58e-4d24-b16c-9b9718cdab42 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 12:42:17 user nova-compute[74960]: No targets found.
Nov 03 12:42:17 user nova-compute[74960]: iSNS:
Nov 03 12:42:17 user nova-compute[74960]: No targets found.
Nov 03 12:42:17 user nova-compute[74960]: STATIC:
Nov 03 12:42:17 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:cf27367c-241f-494a-8393-4dd59f97c36a
Nov 03 12:42:17 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:42:17 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:42:17 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:75cf5a5c-6445-43bf-b3dd-19c8d94645ea
Nov 03 12:42:17 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:42:17 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:42:17 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7
Nov 03 12:42:17 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:42:17 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:42:17 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2
Nov 03 12:42:17 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:42:17 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:42:17 user nova-compute[74960]: FIRMWARE:
Nov 03 12:42:17 user nova-compute[74960]: No targets found.
Nov 03 12:42:17 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:42:17 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-9694cfab-e58e-4d24-b16c-9b9718cdab42 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 12:42:17 user nova-compute[74960]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 12:42:17 user nova-compute[74960]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74960) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 12:42:17 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-9694cfab-e58e-4d24-b16c-9b9718cdab42 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:75cf5a5c-6445-43bf-b3dd-19c8d94645ea', 0)] {{(pid=74960) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 12:42:17 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:42:18 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:42:18 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[77724463-5820-43cc-9f30-d80b561bce99]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75cf5a5c-6445-43bf-b3dd-19c8d94645ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cf27367c-241f-494a-8393-4dd59f97c36a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:42:18 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:42:18 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:42:18 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3626ee1-b72f-43a2-91ec-676841d3fbd0]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75cf5a5c-6445-43bf-b3dd-19c8d94645ea (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf27367c-241f-494a-8393-4dd59f97c36a (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:42:18 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-9694cfab-e58e-4d24-b16c-9b9718cdab42 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:42:18 user nova-compute[74960]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7 (non-flash)
Nov 03 12:42:18 user nova-compute[74960]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75cf5a5c-6445-43bf-b3dd-19c8d94645ea (non-flash)
Nov 03 12:42:18 user nova-compute[74960]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf27367c-241f-494a-8393-4dd59f97c36a (non-flash)
Nov 03 12:42:18 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:42:18 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-9694cfab-e58e-4d24-b16c-9b9718cdab42 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:42:18 user nova-compute[74960]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7 (non-flash)
Nov 03 12:42:18 user nova-compute[74960]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75cf5a5c-6445-43bf-b3dd-19c8d94645ea (non-flash)
Nov 03 12:42:18 user nova-compute[74960]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf27367c-241f-494a-8393-4dd59f97c36a (non-flash)
Nov 03 12:42:18 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:42:18 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-9694cfab-e58e-4d24-b16c-9b9718cdab42 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9a8c35df30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:75cf5a5c-6445-43bf-b3dd-19c8d94645ea'): ({'sdb'}, set())}) {{(pid=74960) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 12:42:18 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-9694cfab-e58e-4d24-b16c-9b9718cdab42 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Removing single pathed devices sdb {{(pid=74960) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 12:42:18 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:42:18 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:42:18 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[1253fe47-bebe-4fe1-a2da-71b25a3490cc]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:42:18 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:42:18 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:42:18 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[683065e3-7133-45c2-a7ce-b8d313742f2b]: (4, ('ok\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:42:18 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-9694cfab-e58e-4d24-b16c-9b9718cdab42 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Flushing IO for device /dev/sdb {{(pid=74960) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 12:42:18 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:42:18 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:42:18 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1d5c5a6-9553-4d6d-b984-7a65730bcef6]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:42:18 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-9694cfab-e58e-4d24-b16c-9b9718cdab42 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74960) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 12:42:18 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:42:18 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:42:18 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[0316e528-7ac9-47a0-80ff-186f830eb9b6]: (4, ('1', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:42:18 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-9694cfab-e58e-4d24-b16c-9b9718cdab42 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74960) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 12:42:18 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-9694cfab-e58e-4d24-b16c-9b9718cdab42 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] SCSI volumes sdb have been removed. {{(pid=74960) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 12:42:18 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-9694cfab-e58e-4d24-b16c-9b9718cdab42 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:75cf5a5c-6445-43bf-b3dd-19c8d94645ea')] {{(pid=74960) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 12:42:18 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75cf5a5c-6445-43bf-b3dd-19c8d94645ea -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:42:18 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75cf5a5c-6445-43bf-b3dd-19c8d94645ea -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:42:18 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[47189600-ac11-421c-926a-0152b76ff136]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:42:18 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-9694cfab-e58e-4d24-b16c-9b9718cdab42 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:42:18 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75cf5a5c-6445-43bf-b3dd-19c8d94645ea -p 172.16.0.220:3260 --logout {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:42:18 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75cf5a5c-6445-43bf-b3dd-19c8d94645ea -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:42:18 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b88ed4-95d9-44c7-b893-29cb4dccbfc6]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:75cf5a5c-6445-43bf-b3dd-19c8d94645ea, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:75cf5a5c-6445-43bf-b3dd-19c8d94645ea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:42:18 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-9694cfab-e58e-4d24-b16c-9b9718cdab42 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:75cf5a5c-6445-43bf-b3dd-19c8d94645ea, portal: 172.16.0.220,3260]
Nov 03 12:42:18 user nova-compute[74960]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:75cf5a5c-6445-43bf-b3dd-19c8d94645ea, portal: 172.16.0.220,3260] successful.
Nov 03 12:42:18 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:42:18 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75cf5a5c-6445-43bf-b3dd-19c8d94645ea -p 172.16.0.220:3260 --op delete {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:42:18 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75cf5a5c-6445-43bf-b3dd-19c8d94645ea -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:42:18 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1fb7a50-1d74-46ad-af1f-7b0c8d3cabc8]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:42:18 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-9694cfab-e58e-4d24-b16c-9b9718cdab42 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:42:18 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-9694cfab-e58e-4d24-b16c-9b9718cdab42 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:42:18 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-9694cfab-e58e-4d24-b16c-9b9718cdab42 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] <== disconnect_volume: return (330ms) None {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:42:18 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9694cfab-e58e-4d24-b16c-9b9718cdab42 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] [instance: 82215a04-bd79-4f72-b375-dc73ff9a8654] Disconnected iSCSI Volume {{(pid=74960) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 12:42:18 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:42:18 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:42:19 user nova-compute[74960]: DEBUG nova.objects.instance [None req-9694cfab-e58e-4d24-b16c-9b9718cdab42 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Lazy-loading 'flavor' on Instance uuid 82215a04-bd79-4f72-b375-dc73ff9a8654 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:42:19 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-9694cfab-e58e-4d24-b16c-9b9718cdab42 tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Lock "82215a04-bd79-4f72-b375-dc73ff9a8654" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.947s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:42:19 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-ea6ac46b-a454-46c7-8d8b-d120d03e068e tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Lock "82215a04-bd79-4f72-b375-dc73ff9a8654" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.842s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:42:19 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-ea6ac46b-a454-46c7-8d8b-d120d03e068e tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Acquiring lock "82215a04-bd79-4f72-b375-dc73ff9a8654-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:42:19 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-ea6ac46b-a454-46c7-8d8b-d120d03e068e tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Lock "82215a04-bd79-4f72-b375-dc73ff9a8654-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:42:19 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-ea6ac46b-a454-46c7-8d8b-d120d03e068e tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Lock "82215a04-bd79-4f72-b375-dc73ff9a8654-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:42:19 user nova-compute[74960]: INFO nova.compute.manager [None req-ea6ac46b-a454-46c7-8d8b-d120d03e068e tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] [instance: 82215a04-bd79-4f72-b375-dc73ff9a8654] Terminating instance
Nov 03 12:42:19 user nova-compute[74960]: DEBUG nova.compute.manager [None req-ea6ac46b-a454-46c7-8d8b-d120d03e068e tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] [instance: 82215a04-bd79-4f72-b375-dc73ff9a8654] Start destroying the instance on the hypervisor. {{(pid=74960) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 12:42:19 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:42:19 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:42:19 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:42:19 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:42:19 user nova-compute[74960]: DEBUG nova.compute.manager [req-2364253d-5e6f-4949-8774-48ad968cc627 req-8e2b8f32-77bd-49d9-853f-07f6a691833c service nova] [instance: 82215a04-bd79-4f72-b375-dc73ff9a8654] Received event network-vif-unplugged-36091714-1f02-4ac1-9dc7-feef6712069d {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:42:19 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-2364253d-5e6f-4949-8774-48ad968cc627 req-8e2b8f32-77bd-49d9-853f-07f6a691833c service nova] Acquiring lock "82215a04-bd79-4f72-b375-dc73ff9a8654-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:42:19 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-2364253d-5e6f-4949-8774-48ad968cc627 req-8e2b8f32-77bd-49d9-853f-07f6a691833c service nova] Lock "82215a04-bd79-4f72-b375-dc73ff9a8654-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:42:19 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-2364253d-5e6f-4949-8774-48ad968cc627 req-8e2b8f32-77bd-49d9-853f-07f6a691833c service nova] Lock "82215a04-bd79-4f72-b375-dc73ff9a8654-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:42:19 user nova-compute[74960]: DEBUG nova.compute.manager [req-2364253d-5e6f-4949-8774-48ad968cc627 req-8e2b8f32-77bd-49d9-853f-07f6a691833c service nova] [instance: 82215a04-bd79-4f72-b375-dc73ff9a8654] No waiting events found dispatching network-vif-unplugged-36091714-1f02-4ac1-9dc7-feef6712069d {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:42:19 user nova-compute[74960]: DEBUG nova.compute.manager [req-2364253d-5e6f-4949-8774-48ad968cc627 req-8e2b8f32-77bd-49d9-853f-07f6a691833c service nova] [instance: 82215a04-bd79-4f72-b375-dc73ff9a8654] Received event network-vif-unplugged-36091714-1f02-4ac1-9dc7-feef6712069d for instance with task_state deleting. {{(pid=74960) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 12:42:19 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:42:20 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:42:20 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: 82215a04-bd79-4f72-b375-dc73ff9a8654] Instance destroyed successfully.
Nov 03 12:42:20 user nova-compute[74960]: DEBUG nova.objects.instance [None req-ea6ac46b-a454-46c7-8d8b-d120d03e068e tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Lazy-loading 'resources' on Instance uuid 82215a04-bd79-4f72-b375-dc73ff9a8654 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:42:20 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-ea6ac46b-a454-46c7-8d8b-d120d03e068e tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:38:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1380868338',display_name='tempest-VolumesSnapshotTestJSON-instance-1380868338',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1380868338',id=38,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBACWxJR0ckRMqLDYUfUZ9YuBoMi30N9o8VsC9qflYY+6dmmkHg1RehuYW7/skC4dLIM7wACaDErdibGdY9+VEoJmBPcZ4UR8DLqQ+1vAU6Qi5aa1nq2PwNvPd+N0CvE5Xw==',key_name='tempest-keypair-2117237715',keypairs=<?>,launch_index=0,launched_at=2023-11-03T12:38:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='efa134687c74460fb5a59dd3ddece671',ramdisk_id='',reservation_id='r-dh4x0wok',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1639372533',owner_user_name='tempest-VolumesSnapshotTestJSON-1639372533-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T12:38:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b5fbd2703e241afb720be4680301751',uuid=82215a04-bd79-4f72-b375-dc73ff9a8654,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "36091714-1f02-4ac1-9dc7-feef6712069d", "address": "fa:16:3e:db:fa:06", "network": {"id": "82ebe97c-a056-4ac2-9644-ea315bf9a4b1", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1024050438-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efa134687c74460fb5a59dd3ddece671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36091714-1f", "ovs_interfaceid": "36091714-1f02-4ac1-9dc7-feef6712069d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 12:42:20 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-ea6ac46b-a454-46c7-8d8b-d120d03e068e tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Converting VIF {"id": "36091714-1f02-4ac1-9dc7-feef6712069d", "address": "fa:16:3e:db:fa:06", "network": {"id": "82ebe97c-a056-4ac2-9644-ea315bf9a4b1", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1024050438-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efa134687c74460fb5a59dd3ddece671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36091714-1f", "ovs_interfaceid": "36091714-1f02-4ac1-9dc7-feef6712069d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:42:20 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-ea6ac46b-a454-46c7-8d8b-d120d03e068e tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:db:fa:06,bridge_name='br-int',has_traffic_filtering=True,id=36091714-1f02-4ac1-9dc7-feef6712069d,network=Network(82ebe97c-a056-4ac2-9644-ea315bf9a4b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36091714-1f') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:42:20 user nova-compute[74960]: DEBUG os_vif [None req-ea6ac46b-a454-46c7-8d8b-d120d03e068e tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:db:fa:06,bridge_name='br-int',has_traffic_filtering=True,id=36091714-1f02-4ac1-9dc7-feef6712069d,network=Network(82ebe97c-a056-4ac2-9644-ea315bf9a4b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36091714-1f') {{(pid=74960) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 12:42:20 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:42:20 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap36091714-1f, bridge=br-int, if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:42:20 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:42:20 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:42:20 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:42:20 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ea7b48d5-bd24-4204-9391-9102c397c347) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:42:20 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:42:20 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:42:20 user nova-compute[74960]: INFO os_vif [None req-ea6ac46b-a454-46c7-8d8b-d120d03e068e tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:db:fa:06,bridge_name='br-int',has_traffic_filtering=True,id=36091714-1f02-4ac1-9dc7-feef6712069d,network=Network(82ebe97c-a056-4ac2-9644-ea315bf9a4b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36091714-1f')
Nov 03 12:42:20 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea6ac46b-a454-46c7-8d8b-d120d03e068e tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] [instance: 82215a04-bd79-4f72-b375-dc73ff9a8654] calling os-brick to detach iSCSI Volume {{(pid=74960) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 12:42:20 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea6ac46b-a454-46c7-8d8b-d120d03e068e tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9aa420acb0>, {'target_iqn': 'iqn.2010-10.org.openstack:75cf5a5c-6445-43bf-b3dd-19c8d94645ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bFQPpZmo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:42:20 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-ea6ac46b-a454-46c7-8d8b-d120d03e068e tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:42:20 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-ea6ac46b-a454-46c7-8d8b-d120d03e068e tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:42:20 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-ea6ac46b-a454-46c7-8d8b-d120d03e068e tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:42:20 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:42:20 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:42:20 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[38a4c385-9db2-407b-a79c-a427ce3d31cb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cf27367c-241f-494a-8393-4dd59f97c36a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:42:20 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea6ac46b-a454-46c7-8d8b-d120d03e068e tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 12:42:20 user nova-compute[74960]: No targets found.
Nov 03 12:42:20 user nova-compute[74960]: iSNS:
Nov 03 12:42:20 user nova-compute[74960]: No targets found.
Nov 03 12:42:20 user nova-compute[74960]: STATIC:
Nov 03 12:42:20 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:cf27367c-241f-494a-8393-4dd59f97c36a
Nov 03 12:42:20 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:42:20 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:42:20 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7
Nov 03 12:42:20 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:42:20 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:42:20 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2
Nov 03 12:42:20 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:42:20 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:42:20 user nova-compute[74960]: FIRMWARE:
Nov 03 12:42:20 user nova-compute[74960]: No targets found.
Nov 03 12:42:20 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:42:20 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea6ac46b-a454-46c7-8d8b-d120d03e068e tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 12:42:20 user nova-compute[74960]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 12:42:20 user nova-compute[74960]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74960) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 12:42:20 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea6ac46b-a454-46c7-8d8b-d120d03e068e tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:75cf5a5c-6445-43bf-b3dd-19c8d94645ea', 0)] {{(pid=74960) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 12:42:20 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:42:20 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:42:20 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee4f8d9e-78ab-483f-8b36-b15a3bfff342]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cf27367c-241f-494a-8393-4dd59f97c36a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:42:20 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:42:20 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:42:20 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[09acec1c-8b66-4d88-ba6e-7a59b5fc23f2]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf27367c-241f-494a-8393-4dd59f97c36a (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:42:20 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea6ac46b-a454-46c7-8d8b-d120d03e068e tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:42:20 user nova-compute[74960]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7 (non-flash)
Nov 03 12:42:20 user nova-compute[74960]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf27367c-241f-494a-8393-4dd59f97c36a (non-flash)
Nov 03 12:42:20 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:42:20 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea6ac46b-a454-46c7-8d8b-d120d03e068e tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:42:20 user nova-compute[74960]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7 (non-flash)
Nov 03 12:42:20 user nova-compute[74960]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf27367c-241f-494a-8393-4dd59f97c36a (non-flash)
Nov 03 12:42:20 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:42:20 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea6ac46b-a454-46c7-8d8b-d120d03e068e tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9a8c208700>, {}) {{(pid=74960) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 12:42:20 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea6ac46b-a454-46c7-8d8b-d120d03e068e tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Disconnecting from: [] {{(pid=74960) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 12:42:20 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-ea6ac46b-a454-46c7-8d8b-d120d03e068e tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.075s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:42:20 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea6ac46b-a454-46c7-8d8b-d120d03e068e tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] <== disconnect_volume: return (77ms) None {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:42:20 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea6ac46b-a454-46c7-8d8b-d120d03e068e tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] [instance: 82215a04-bd79-4f72-b375-dc73ff9a8654] Disconnected iSCSI Volume {{(pid=74960) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 12:42:20 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-ea6ac46b-a454-46c7-8d8b-d120d03e068e tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] [instance: 82215a04-bd79-4f72-b375-dc73ff9a8654] Deleting instance files /opt/stack/data/nova/instances/82215a04-bd79-4f72-b375-dc73ff9a8654_del
Nov 03 12:42:20 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-ea6ac46b-a454-46c7-8d8b-d120d03e068e tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] [instance: 82215a04-bd79-4f72-b375-dc73ff9a8654] Deletion of /opt/stack/data/nova/instances/82215a04-bd79-4f72-b375-dc73ff9a8654_del complete
Nov 03 12:42:20 user nova-compute[74960]: INFO nova.compute.manager [None req-ea6ac46b-a454-46c7-8d8b-d120d03e068e tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] [instance: 82215a04-bd79-4f72-b375-dc73ff9a8654] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 03 12:42:20 user nova-compute[74960]: DEBUG oslo.service.loopingcall [None req-ea6ac46b-a454-46c7-8d8b-d120d03e068e tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74960) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 12:42:20 user nova-compute[74960]: DEBUG nova.compute.manager [-] [instance: 82215a04-bd79-4f72-b375-dc73ff9a8654] Deallocating network for instance {{(pid=74960) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 12:42:20 user nova-compute[74960]: DEBUG nova.network.neutron [-] [instance: 82215a04-bd79-4f72-b375-dc73ff9a8654] deallocate_for_instance() {{(pid=74960) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 12:42:21 user nova-compute[74960]: DEBUG nova.compute.manager [req-df794b82-0897-454d-abad-3941043bf350 req-f5f52407-fc6b-40d6-9c92-6087a317da77 service nova] [instance: 82215a04-bd79-4f72-b375-dc73ff9a8654] Received event network-vif-deleted-36091714-1f02-4ac1-9dc7-feef6712069d {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:42:21 user nova-compute[74960]: INFO nova.compute.manager [req-df794b82-0897-454d-abad-3941043bf350 req-f5f52407-fc6b-40d6-9c92-6087a317da77 service nova] [instance: 82215a04-bd79-4f72-b375-dc73ff9a8654] Neutron deleted interface 36091714-1f02-4ac1-9dc7-feef6712069d; detaching it from the instance and deleting it from the info cache
Nov 03 12:42:21 user nova-compute[74960]: DEBUG nova.network.neutron [req-df794b82-0897-454d-abad-3941043bf350 req-f5f52407-fc6b-40d6-9c92-6087a317da77 service nova] [instance: 82215a04-bd79-4f72-b375-dc73ff9a8654] Updating instance_info_cache with network_info: [] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:42:21 user nova-compute[74960]: DEBUG nova.network.neutron [-] [instance: 82215a04-bd79-4f72-b375-dc73ff9a8654] Updating instance_info_cache with network_info: [] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:42:21 user nova-compute[74960]: INFO nova.compute.manager [-] [instance: 82215a04-bd79-4f72-b375-dc73ff9a8654] Took 0.83 seconds to deallocate network for instance.
Nov 03 12:42:21 user nova-compute[74960]: DEBUG nova.compute.manager [req-df794b82-0897-454d-abad-3941043bf350 req-f5f52407-fc6b-40d6-9c92-6087a317da77 service nova] [instance: 82215a04-bd79-4f72-b375-dc73ff9a8654] Detach interface failed, port_id=36091714-1f02-4ac1-9dc7-feef6712069d, reason: Instance 82215a04-bd79-4f72-b375-dc73ff9a8654 could not be found. {{(pid=74960) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 03 12:42:21 user nova-compute[74960]: WARNING nova.volume.cinder [None req-ea6ac46b-a454-46c7-8d8b-d120d03e068e tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Attachment 72e9751b-1acf-4d19-8d5b-ae7e4c9d55b3 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 72e9751b-1acf-4d19-8d5b-ae7e4c9d55b3. (HTTP 404) (Request-ID: req-817bbf26-d7fe-48a4-b920-ce37f8c2aa71)
Nov 03 12:42:21 user nova-compute[74960]: INFO nova.compute.manager [None req-ea6ac46b-a454-46c7-8d8b-d120d03e068e tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] [instance: 82215a04-bd79-4f72-b375-dc73ff9a8654] Took 0.04 seconds to detach 1 volumes for instance.
Nov 03 12:42:21 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-ea6ac46b-a454-46c7-8d8b-d120d03e068e tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:42:21 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-ea6ac46b-a454-46c7-8d8b-d120d03e068e tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:42:21 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-ea6ac46b-a454-46c7-8d8b-d120d03e068e tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:42:21 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-ea6ac46b-a454-46c7-8d8b-d120d03e068e tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:42:21 user nova-compute[74960]: DEBUG nova.compute.manager [req-a7a232a3-1f4b-4d46-9dc2-064f20d547ba req-eac78c63-6f9f-442a-bd7a-03f647baf07c service nova] [instance: 82215a04-bd79-4f72-b375-dc73ff9a8654] Received event network-vif-plugged-36091714-1f02-4ac1-9dc7-feef6712069d {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:42:21 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-a7a232a3-1f4b-4d46-9dc2-064f20d547ba req-eac78c63-6f9f-442a-bd7a-03f647baf07c service nova] Acquiring lock "82215a04-bd79-4f72-b375-dc73ff9a8654-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:42:21 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-a7a232a3-1f4b-4d46-9dc2-064f20d547ba req-eac78c63-6f9f-442a-bd7a-03f647baf07c service nova] Lock "82215a04-bd79-4f72-b375-dc73ff9a8654-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:42:21 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-a7a232a3-1f4b-4d46-9dc2-064f20d547ba req-eac78c63-6f9f-442a-bd7a-03f647baf07c service nova] Lock "82215a04-bd79-4f72-b375-dc73ff9a8654-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:42:21 user nova-compute[74960]: DEBUG nova.compute.manager [req-a7a232a3-1f4b-4d46-9dc2-064f20d547ba req-eac78c63-6f9f-442a-bd7a-03f647baf07c service nova] [instance: 82215a04-bd79-4f72-b375-dc73ff9a8654] No waiting events found dispatching network-vif-plugged-36091714-1f02-4ac1-9dc7-feef6712069d {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:42:21 user nova-compute[74960]: WARNING nova.compute.manager [req-a7a232a3-1f4b-4d46-9dc2-064f20d547ba req-eac78c63-6f9f-442a-bd7a-03f647baf07c service nova] [instance: 82215a04-bd79-4f72-b375-dc73ff9a8654] Received unexpected event network-vif-plugged-36091714-1f02-4ac1-9dc7-feef6712069d for instance with vm_state deleted and task_state None.
Nov 03 12:42:21 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-ea6ac46b-a454-46c7-8d8b-d120d03e068e tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.456s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:42:21 user nova-compute[74960]: INFO nova.scheduler.client.report [None req-ea6ac46b-a454-46c7-8d8b-d120d03e068e tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Deleted allocations for instance 82215a04-bd79-4f72-b375-dc73ff9a8654
Nov 03 12:42:21 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-ea6ac46b-a454-46c7-8d8b-d120d03e068e tempest-VolumesSnapshotTestJSON-1639372533 tempest-VolumesSnapshotTestJSON-1639372533-project-member] Lock "82215a04-bd79-4f72-b375-dc73ff9a8654" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.537s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:42:25 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:42:25 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-e5f424ea-c00d-48b1-81e2-aa4ca518104a tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 60658b54-5e34-4a2b-be14-124e47e291c2 is timed out.
Nov 03 12:42:25 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-e5f424ea-c00d-48b1-81e2-aa4ca518104a tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Successfully detached device vdb from instance 60658b54-5e34-4a2b-be14-124e47e291c2 from the live domain config.
Nov 03 12:42:25 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5f424ea-c00d-48b1-81e2-aa4ca518104a tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] [instance: 60658b54-5e34-4a2b-be14-124e47e291c2] calling os-brick to detach iSCSI Volume {{(pid=74960) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 12:42:25 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5f424ea-c00d-48b1-81e2-aa4ca518104a tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9aa420acb0>, {'target_iqn': 'iqn.2010-10.org.openstack:cf27367c-241f-494a-8393-4dd59f97c36a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yleLYbKH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:42:25 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-e5f424ea-c00d-48b1-81e2-aa4ca518104a tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:42:25 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-e5f424ea-c00d-48b1-81e2-aa4ca518104a tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:42:25 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-e5f424ea-c00d-48b1-81e2-aa4ca518104a tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:42:25 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:42:25 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:42:25 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[4449cba9-0003-4b42-991e-551446469981]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cf27367c-241f-494a-8393-4dd59f97c36a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:42:25 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5f424ea-c00d-48b1-81e2-aa4ca518104a tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 12:42:25 user nova-compute[74960]: No targets found.
Nov 03 12:42:25 user nova-compute[74960]: iSNS:
Nov 03 12:42:25 user nova-compute[74960]: No targets found.
Nov 03 12:42:25 user nova-compute[74960]: STATIC:
Nov 03 12:42:25 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:cf27367c-241f-494a-8393-4dd59f97c36a
Nov 03 12:42:25 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:42:25 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:42:25 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7
Nov 03 12:42:25 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:42:25 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:42:25 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2
Nov 03 12:42:25 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:42:25 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:42:25 user nova-compute[74960]: FIRMWARE:
Nov 03 12:42:25 user nova-compute[74960]: No targets found.
Nov 03 12:42:25 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:42:25 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5f424ea-c00d-48b1-81e2-aa4ca518104a tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 12:42:25 user nova-compute[74960]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 12:42:25 user nova-compute[74960]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74960) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 12:42:25 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5f424ea-c00d-48b1-81e2-aa4ca518104a tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf27367c-241f-494a-8393-4dd59f97c36a', 0)] {{(pid=74960) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 12:42:25 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:42:25 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:42:25 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d8cb823-a551-4f10-913b-bda4e7f65015]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cf27367c-241f-494a-8393-4dd59f97c36a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:42:25 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:42:25 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:42:25 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e5039f9-420e-400f-8ea8-d956c2d13ad6]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf27367c-241f-494a-8393-4dd59f97c36a (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:42:25 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5f424ea-c00d-48b1-81e2-aa4ca518104a tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:42:25 user nova-compute[74960]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7 (non-flash)
Nov 03 12:42:25 user nova-compute[74960]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf27367c-241f-494a-8393-4dd59f97c36a (non-flash)
Nov 03 12:42:25 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:42:25 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5f424ea-c00d-48b1-81e2-aa4ca518104a tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:42:25 user nova-compute[74960]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7 (non-flash)
Nov 03 12:42:25 user nova-compute[74960]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf27367c-241f-494a-8393-4dd59f97c36a (non-flash)
Nov 03 12:42:25 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:42:25 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5f424ea-c00d-48b1-81e2-aa4ca518104a tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9aa43b6320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf27367c-241f-494a-8393-4dd59f97c36a'): ({'sdc'}, set())}) {{(pid=74960) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 12:42:25 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-e5f424ea-c00d-48b1-81e2-aa4ca518104a tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Removing single pathed devices sdc {{(pid=74960) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 12:42:25 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:42:25 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:42:25 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa50b6bf-bb3d-4e9c-a5a6-324936276c7e]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:42:25 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:42:25 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:42:25 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d4b2207-9412-4c2c-bedd-52369e9a4d4b]: (4, ('ok\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:42:25 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-e5f424ea-c00d-48b1-81e2-aa4ca518104a tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Flushing IO for device /dev/sdc {{(pid=74960) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 12:42:25 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:42:25 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:42:25 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b0716f4-3b32-43fd-936e-b1a0fa9d6941]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:42:25 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-e5f424ea-c00d-48b1-81e2-aa4ca518104a tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74960) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 12:42:25 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:42:25 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:42:25 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e61438c-5340-42d3-b7ac-f382c6e6b6c0]: (4, ('1', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:42:25 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-e5f424ea-c00d-48b1-81e2-aa4ca518104a tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74960) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 12:42:25 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-e5f424ea-c00d-48b1-81e2-aa4ca518104a tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] SCSI volumes sdc have been removed. {{(pid=74960) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 12:42:25 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5f424ea-c00d-48b1-81e2-aa4ca518104a tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf27367c-241f-494a-8393-4dd59f97c36a')] {{(pid=74960) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 12:42:25 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf27367c-241f-494a-8393-4dd59f97c36a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:42:25 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf27367c-241f-494a-8393-4dd59f97c36a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:42:25 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[3386027a-8d47-4bbc-9dbe-ddda1f061eeb]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:42:25 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5f424ea-c00d-48b1-81e2-aa4ca518104a tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:42:25 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf27367c-241f-494a-8393-4dd59f97c36a -p 172.16.0.220:3260 --logout {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:42:25 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf27367c-241f-494a-8393-4dd59f97c36a -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:42:25 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[57b03a88-09a6-40f9-994d-e011dbef4d8d]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:cf27367c-241f-494a-8393-4dd59f97c36a, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:cf27367c-241f-494a-8393-4dd59f97c36a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:42:25 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5f424ea-c00d-48b1-81e2-aa4ca518104a tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:cf27367c-241f-494a-8393-4dd59f97c36a, portal: 172.16.0.220,3260]
Nov 03 12:42:25 user nova-compute[74960]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:cf27367c-241f-494a-8393-4dd59f97c36a, portal: 172.16.0.220,3260] successful.
Nov 03 12:42:25 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:42:25 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf27367c-241f-494a-8393-4dd59f97c36a -p 172.16.0.220:3260 --op delete {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:42:25 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf27367c-241f-494a-8393-4dd59f97c36a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:42:25 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed0047b1-d7a2-410c-999d-88d9c149e876]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:42:25 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5f424ea-c00d-48b1-81e2-aa4ca518104a tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:42:25 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-e5f424ea-c00d-48b1-81e2-aa4ca518104a tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:42:25 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5f424ea-c00d-48b1-81e2-aa4ca518104a tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] <== disconnect_volume: return (300ms) None {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:42:25 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5f424ea-c00d-48b1-81e2-aa4ca518104a tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] [instance: 60658b54-5e34-4a2b-be14-124e47e291c2] Disconnected iSCSI Volume {{(pid=74960) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 12:42:26 user nova-compute[74960]: DEBUG nova.objects.instance [None req-e5f424ea-c00d-48b1-81e2-aa4ca518104a tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Lazy-loading 'flavor' on Instance uuid 60658b54-5e34-4a2b-be14-124e47e291c2 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:42:26 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-e5f424ea-c00d-48b1-81e2-aa4ca518104a tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Lock "60658b54-5e34-4a2b-be14-124e47e291c2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.081s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:42:30 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:42:30 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:42:30 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74960) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 12:42:30 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74960) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 12:42:30 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74960) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 12:42:30 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:42:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:42:35 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:42:35 user nova-compute[74960]: DEBUG nova.compute.manager [req-8e74e4ce-473f-42a6-b9f6-2f8ca5fec4c4 req-3c0391c0-294b-49d5-b552-aacdd2070187 service nova] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] Received event network-changed-ad28ac84-3419-4701-90df-e93359da2c28 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:42:35 user nova-compute[74960]: DEBUG nova.compute.manager [req-8e74e4ce-473f-42a6-b9f6-2f8ca5fec4c4 req-3c0391c0-294b-49d5-b552-aacdd2070187 service nova] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] Refreshing instance network info cache due to event network-changed-ad28ac84-3419-4701-90df-e93359da2c28. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 12:42:35 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-8e74e4ce-473f-42a6-b9f6-2f8ca5fec4c4 req-3c0391c0-294b-49d5-b552-aacdd2070187 service nova] Acquiring lock "refresh_cache-3cfe99be-b74b-4fd3-a5d6-a94708992c5b" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:42:35 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-8e74e4ce-473f-42a6-b9f6-2f8ca5fec4c4 req-3c0391c0-294b-49d5-b552-aacdd2070187 service nova] Acquired lock "refresh_cache-3cfe99be-b74b-4fd3-a5d6-a94708992c5b" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:42:35 user nova-compute[74960]: DEBUG nova.network.neutron [req-8e74e4ce-473f-42a6-b9f6-2f8ca5fec4c4 req-3c0391c0-294b-49d5-b552-aacdd2070187 service nova] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] Refreshing network info cache for port ad28ac84-3419-4701-90df-e93359da2c28 {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 12:42:36 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-6abae01a-1a00-4ee1-aa75-6d2f215378c9 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Acquiring lock "3cfe99be-b74b-4fd3-a5d6-a94708992c5b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:42:36 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-6abae01a-1a00-4ee1-aa75-6d2f215378c9 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Lock "3cfe99be-b74b-4fd3-a5d6-a94708992c5b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:42:36 user nova-compute[74960]: DEBUG nova.objects.instance [None req-6abae01a-1a00-4ee1-aa75-6d2f215378c9 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Lazy-loading 'flavor' on Instance uuid 3cfe99be-b74b-4fd3-a5d6-a94708992c5b {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:42:36 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-6abae01a-1a00-4ee1-aa75-6d2f215378c9 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Lock "3cfe99be-b74b-4fd3-a5d6-a94708992c5b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:42:36 user nova-compute[74960]: DEBUG nova.network.neutron [req-8e74e4ce-473f-42a6-b9f6-2f8ca5fec4c4 req-3c0391c0-294b-49d5-b552-aacdd2070187 service nova] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] Updated VIF entry in instance network info cache for port ad28ac84-3419-4701-90df-e93359da2c28. {{(pid=74960) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 12:42:36 user nova-compute[74960]: DEBUG nova.network.neutron [req-8e74e4ce-473f-42a6-b9f6-2f8ca5fec4c4 req-3c0391c0-294b-49d5-b552-aacdd2070187 service nova] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] Updating instance_info_cache with network_info: [{"id": "ad28ac84-3419-4701-90df-e93359da2c28", "address": "fa:16:3e:1f:4e:b6", "network": {"id": "9a9a848a-80be-4281-8554-8e28744073b3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1579909169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "434ce6c4b77342299a17e547a14e3918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad28ac84-34", "ovs_interfaceid": "ad28ac84-3419-4701-90df-e93359da2c28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:42:36 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-8e74e4ce-473f-42a6-b9f6-2f8ca5fec4c4 req-3c0391c0-294b-49d5-b552-aacdd2070187 service nova] Releasing lock "refresh_cache-3cfe99be-b74b-4fd3-a5d6-a94708992c5b" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:42:36 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-6abae01a-1a00-4ee1-aa75-6d2f215378c9 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Acquiring lock "3cfe99be-b74b-4fd3-a5d6-a94708992c5b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:42:36 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-6abae01a-1a00-4ee1-aa75-6d2f215378c9 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Lock "3cfe99be-b74b-4fd3-a5d6-a94708992c5b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:42:36 user nova-compute[74960]: INFO nova.compute.manager [None req-6abae01a-1a00-4ee1-aa75-6d2f215378c9 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] Attaching volume f4c6cd96-5bb9-496e-aaa7-37f872cee704 to /dev/vdb
Nov 03 12:42:36 user nova-compute[74960]: DEBUG os_brick.utils [None req-6abae01a-1a00-4ee1-aa75-6d2f215378c9 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:42:36 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:42:36 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:42:36 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[d299c4dc-282b-4de3-bcb4-f8e8b0c962ea]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:75b8e219756\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:42:36 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:42:36 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:42:36 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6f8242d-cdd7-4169-b009-37a521d18825]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:42:36 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:42:36 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:42:36 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[e434a8c1-4a5e-4e54-aad7-4ae6cf3833c7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:42:36 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[195a74c0-00b9-4c1f-9155-4dd95a2848e7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:42:36 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-6abae01a-1a00-4ee1-aa75-6d2f215378c9 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Running cmd (subprocess): nvme version {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:42:36 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-6abae01a-1a00-4ee1-aa75-6d2f215378c9 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] 'nvme version' failed. Not Retrying. {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 12:42:36 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6abae01a-1a00-4ee1-aa75-6d2f215378c9 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] nvme not present on system {{(pid=74960) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 12:42:36 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:42:36 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 12:42:36 user nova-compute[74960]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 12:42:36 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[649fa89d-82fe-492c-87df-90a7d8b47569]: (4, '') {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:42:36 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-6abae01a-1a00-4ee1-aa75-6d2f215378c9 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74960) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 12:42:36 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-6abae01a-1a00-4ee1-aa75-6d2f215378c9 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74960) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 12:42:36 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-6abae01a-1a00-4ee1-aa75-6d2f215378c9 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] LIGHTOS: no hostnqn found. {{(pid=74960) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 12:42:36 user nova-compute[74960]: DEBUG os_brick.utils [None req-6abae01a-1a00-4ee1-aa75-6d2f215378c9 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:75b8e219756', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:42:36 user nova-compute[74960]: DEBUG nova.virt.block_device [None req-6abae01a-1a00-4ee1-aa75-6d2f215378c9 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] Updating existing volume attachment record: 22ef2beb-d178-4a6c-ad48-d21d951ffbea {{(pid=74960) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 12:42:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:42:40 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:42:43 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:42:45 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:42:48 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:42:48 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:42:50 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:42:53 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:42:55 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:42:55 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:42:56 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6abae01a-1a00-4ee1-aa75-6d2f215378c9 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] Calling os-brick to attach iSCSI Volume {{(pid=74960) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 12:42:56 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-6abae01a-1a00-4ee1-aa75-6d2f215378c9 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9aa420acb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f4c6cd96-5bb9-496e-aaa7-37f872cee704', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LepNhaHS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:42:56 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-6abae01a-1a00-4ee1-aa75-6d2f215378c9 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:42:56 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-6abae01a-1a00-4ee1-aa75-6d2f215378c9 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:42:56 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-6abae01a-1a00-4ee1-aa75-6d2f215378c9 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:42:56 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-6abae01a-1a00-4ee1-aa75-6d2f215378c9 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:42:56 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-6abae01a-1a00-4ee1-aa75-6d2f215378c9 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f4c6cd96-5bb9-496e-aaa7-37f872cee704" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:42:56 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-6abae01a-1a00-4ee1-aa75-6d2f215378c9 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f4c6cd96-5bb9-496e-aaa7-37f872cee704" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:42:56 user nova-compute[74960]: INFO os_brick.initiator.connectors.iscsi [None req-6abae01a-1a00-4ee1-aa75-6d2f215378c9 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 12:42:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4c6cd96-5bb9-496e-aaa7-37f872cee704 -p 172.16.0.220:3260 {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:42:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4c6cd96-5bb9-496e-aaa7-37f872cee704 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:42:56 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[a135bc31-b1c3-4ed2-9ad4-ef6898372bfc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:42:56 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-6abae01a-1a00-4ee1-aa75-6d2f215378c9 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 12:42:56 user nova-compute[74960]:  {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:42:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4c6cd96-5bb9-496e-aaa7-37f872cee704 -p 172.16.0.220:3260 --interface default --op new {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:42:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4c6cd96-5bb9-496e-aaa7-37f872cee704 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:42:56 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[c45cb4e4-8b51-4498-ba77-753c471496a9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f4c6cd96-5bb9-496e-aaa7-37f872cee704] added\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:42:56 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-6abae01a-1a00-4ee1-aa75-6d2f215378c9 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f4c6cd96-5bb9-496e-aaa7-37f872cee704] added
Nov 03 12:42:56 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:42:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4c6cd96-5bb9-496e-aaa7-37f872cee704 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:42:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4c6cd96-5bb9-496e-aaa7-37f872cee704 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:42:56 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[c65cbdfd-c373-4337-a506-e2ac3b232b6b]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:42:56 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-6abae01a-1a00-4ee1-aa75-6d2f215378c9 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:42:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4c6cd96-5bb9-496e-aaa7-37f872cee704 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:42:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4c6cd96-5bb9-496e-aaa7-37f872cee704 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:42:56 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[2681494a-173e-4d87-b0f2-90d8c956ca36]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:42:56 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-6abae01a-1a00-4ee1-aa75-6d2f215378c9 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:42:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4c6cd96-5bb9-496e-aaa7-37f872cee704 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LepNhaHS {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:42:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4c6cd96-5bb9-496e-aaa7-37f872cee704 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LepNhaHS" returned: 0 in 0.021s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:42:56 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[a73721e3-3085-46ae-b9fb-1dae8abaeb2d]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:42:56 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-6abae01a-1a00-4ee1-aa75-6d2f215378c9 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LepNhaHS'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:42:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4c6cd96-5bb9-496e-aaa7-37f872cee704 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:42:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4c6cd96-5bb9-496e-aaa7-37f872cee704 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:42:56 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ff70abb-b71f-4618-b88b-1a2d16007a54]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:42:56 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-6abae01a-1a00-4ee1-aa75-6d2f215378c9 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:42:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:42:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:42:56 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[928d329f-ef4c-4dd8-867a-a93e6b2e93d8]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7 (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:42:56 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-6abae01a-1a00-4ee1-aa75-6d2f215378c9 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:42:56 user nova-compute[74960]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7 (non-flash)
Nov 03 12:42:56 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:42:56 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-6abae01a-1a00-4ee1-aa75-6d2f215378c9 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:42:56 user nova-compute[74960]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7 (non-flash)
Nov 03 12:42:56 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:42:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4c6cd96-5bb9-496e-aaa7-37f872cee704 -p 172.16.0.220:3260 --login {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:42:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4c6cd96-5bb9-496e-aaa7-37f872cee704 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:42:56 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1838ae7-3da9-42ad-986b-e2a7d578184f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f4c6cd96-5bb9-496e-aaa7-37f872cee704, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f4c6cd96-5bb9-496e-aaa7-37f872cee704, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:42:56 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-6abae01a-1a00-4ee1-aa75-6d2f215378c9 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f4c6cd96-5bb9-496e-aaa7-37f872cee704, portal: 172.16.0.220,3260]
Nov 03 12:42:56 user nova-compute[74960]: Login to [iface: default, target: iqn.2010-10.org.openstack:f4c6cd96-5bb9-496e-aaa7-37f872cee704, portal: 172.16.0.220,3260] successful.
Nov 03 12:42:56 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:42:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4c6cd96-5bb9-496e-aaa7-37f872cee704 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:42:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4c6cd96-5bb9-496e-aaa7-37f872cee704 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:42:56 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[7929ab64-c1c6-4838-bac7-f508a6daec9d]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:42:56 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-6abae01a-1a00-4ee1-aa75-6d2f215378c9 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:42:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:42:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:42:56 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf24dd2b-aac8-41e2-94fe-605090fd5442]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4c6cd96-5bb9-496e-aaa7-37f872cee704 (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:42:56 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-6abae01a-1a00-4ee1-aa75-6d2f215378c9 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:42:56 user nova-compute[74960]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7 (non-flash)
Nov 03 12:42:56 user nova-compute[74960]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4c6cd96-5bb9-496e-aaa7-37f872cee704 (non-flash)
Nov 03 12:42:56 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:42:56 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-6abae01a-1a00-4ee1-aa75-6d2f215378c9 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:42:56 user nova-compute[74960]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7 (non-flash)
Nov 03 12:42:56 user nova-compute[74960]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4c6cd96-5bb9-496e-aaa7-37f872cee704 (non-flash)
Nov 03 12:42:56 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:42:56 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-6abae01a-1a00-4ee1-aa75-6d2f215378c9 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f4c6cd96-5bb9-496e-aaa7-37f872cee704" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:42:56 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-6abae01a-1a00-4ee1-aa75-6d2f215378c9 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Connected to 172.16.0.220:3260 {{(pid=74960) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 12:42:56 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-6abae01a-1a00-4ee1-aa75-6d2f215378c9 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] HCTL ('33', '-', '-', 0) found on session 39 with lun 0 {{(pid=74960) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 12:42:56 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-6abae01a-1a00-4ee1-aa75-6d2f215378c9 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74960) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 12:42:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:42:56 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:42:56 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[89c42fda-2b71-4094-9de0-2a8abe013176]: (4, ('- - 0', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:42:56 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-6abae01a-1a00-4ee1-aa75-6d2f215378c9 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Searching for a device in session 39 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74960) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 12:42:56 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-6abae01a-1a00-4ee1-aa75-6d2f215378c9 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f4c6cd96-5bb9-496e-aaa7-37f872cee704', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LepNhaHS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74960) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 12:42:57 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:42:57 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-6abae01a-1a00-4ee1-aa75-6d2f215378c9 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.422s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:42:57 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-6abae01a-1a00-4ee1-aa75-6d2f215378c9 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] <== connect_volume: return (1424ms) {'type': 'block', 'scsi_wwn': '23634613631653939', 'path': '/dev/sdb'} {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:42:57 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6abae01a-1a00-4ee1-aa75-6d2f215378c9 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23634613631653939', 'path': '/dev/sdb'} {{(pid=74960) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 12:42:57 user nova-compute[74960]: DEBUG nova.objects.instance [None req-6abae01a-1a00-4ee1-aa75-6d2f215378c9 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Lazy-loading 'flavor' on Instance uuid 3cfe99be-b74b-4fd3-a5d6-a94708992c5b {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:42:57 user nova-compute[74960]: DEBUG nova.virt.libvirt.guest [None req-6abae01a-1a00-4ee1-aa75-6d2f215378c9 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] attach device xml: <disk type="block" device="disk">
Nov 03 12:42:57 user nova-compute[74960]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 12:42:57 user nova-compute[74960]:   <source dev="/dev/sdb"/>
Nov 03 12:42:57 user nova-compute[74960]:   <target dev="vdb" bus="virtio"/>
Nov 03 12:42:57 user nova-compute[74960]:   <serial>f4c6cd96-5bb9-496e-aaa7-37f872cee704</serial>
Nov 03 12:42:57 user nova-compute[74960]: </disk>
Nov 03 12:42:57 user nova-compute[74960]:  {{(pid=74960) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 03 12:42:58 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-6abae01a-1a00-4ee1-aa75-6d2f215378c9 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] No BDM found with device name vda, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:42:58 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-6abae01a-1a00-4ee1-aa75-6d2f215378c9 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:42:58 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-6abae01a-1a00-4ee1-aa75-6d2f215378c9 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] No VIF found with MAC fa:16:3e:1f:4e:b6, not building metadata {{(pid=74960) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 12:42:58 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:42:58 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-6abae01a-1a00-4ee1-aa75-6d2f215378c9 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Lock "3cfe99be-b74b-4fd3-a5d6-a94708992c5b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.004s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:42:59 user nova-compute[74960]: INFO nova.compute.manager [None req-4daa47ae-9e61-446f-a72f-336f0649b840 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] Rescuing
Nov 03 12:42:59 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-4daa47ae-9e61-446f-a72f-336f0649b840 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Acquiring lock "refresh_cache-3cfe99be-b74b-4fd3-a5d6-a94708992c5b" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:42:59 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-4daa47ae-9e61-446f-a72f-336f0649b840 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Acquired lock "refresh_cache-3cfe99be-b74b-4fd3-a5d6-a94708992c5b" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:42:59 user nova-compute[74960]: DEBUG nova.network.neutron [None req-4daa47ae-9e61-446f-a72f-336f0649b840 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] Building network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 12:42:59 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:42:59 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:42:59 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:42:59 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:42:59 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Auditing locally available compute resources for user (node: user) {{(pid=74960) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 12:42:59 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cfe99be-b74b-4fd3-a5d6-a94708992c5b/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:42:59 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cfe99be-b74b-4fd3-a5d6-a94708992c5b/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:42:59 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cfe99be-b74b-4fd3-a5d6-a94708992c5b/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:42:59 user nova-compute[74960]: DEBUG nova.network.neutron [None req-4daa47ae-9e61-446f-a72f-336f0649b840 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] Updating instance_info_cache with network_info: [{"id": "ad28ac84-3419-4701-90df-e93359da2c28", "address": "fa:16:3e:1f:4e:b6", "network": {"id": "9a9a848a-80be-4281-8554-8e28744073b3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1579909169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "434ce6c4b77342299a17e547a14e3918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad28ac84-34", "ovs_interfaceid": "ad28ac84-3419-4701-90df-e93359da2c28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:42:59 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-4daa47ae-9e61-446f-a72f-336f0649b840 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Releasing lock "refresh_cache-3cfe99be-b74b-4fd3-a5d6-a94708992c5b" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:42:59 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cfe99be-b74b-4fd3-a5d6-a94708992c5b/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:42:59 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74960) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 12:42:59 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f15f5f-8afa-4d7b-bb45-5887184f9ee5/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:43:00 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-8fa8efa4-1dee-41ad-b79f-80e32d42e7f7 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Acquiring lock "895d6de1-b5d9-4555-af57-f7816183be58" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:43:00 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-8fa8efa4-1dee-41ad-b79f-80e32d42e7f7 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Lock "895d6de1-b5d9-4555-af57-f7816183be58" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:43:00 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-8fa8efa4-1dee-41ad-b79f-80e32d42e7f7 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Acquiring lock "895d6de1-b5d9-4555-af57-f7816183be58-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:43:00 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-8fa8efa4-1dee-41ad-b79f-80e32d42e7f7 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Lock "895d6de1-b5d9-4555-af57-f7816183be58-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:43:00 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-8fa8efa4-1dee-41ad-b79f-80e32d42e7f7 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Lock "895d6de1-b5d9-4555-af57-f7816183be58-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:43:00 user nova-compute[74960]: INFO nova.compute.manager [None req-8fa8efa4-1dee-41ad-b79f-80e32d42e7f7 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] Terminating instance
Nov 03 12:43:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:43:00 user nova-compute[74960]: DEBUG nova.compute.manager [None req-8fa8efa4-1dee-41ad-b79f-80e32d42e7f7 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] Start destroying the instance on the hypervisor. {{(pid=74960) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 12:43:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:43:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:43:00 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f15f5f-8afa-4d7b-bb45-5887184f9ee5/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:43:00 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f15f5f-8afa-4d7b-bb45-5887184f9ee5/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:43:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:43:00 user nova-compute[74960]: DEBUG nova.compute.manager [req-429a44c9-1be9-4b6a-bc7c-2c55b7ba9282 req-4f276875-4657-4203-ae0e-d99522a8b86c service nova] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] Received event network-vif-unplugged-ad28ac84-3419-4701-90df-e93359da2c28 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:43:00 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-429a44c9-1be9-4b6a-bc7c-2c55b7ba9282 req-4f276875-4657-4203-ae0e-d99522a8b86c service nova] Acquiring lock "3cfe99be-b74b-4fd3-a5d6-a94708992c5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:43:00 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-429a44c9-1be9-4b6a-bc7c-2c55b7ba9282 req-4f276875-4657-4203-ae0e-d99522a8b86c service nova] Lock "3cfe99be-b74b-4fd3-a5d6-a94708992c5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:43:00 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-429a44c9-1be9-4b6a-bc7c-2c55b7ba9282 req-4f276875-4657-4203-ae0e-d99522a8b86c service nova] Lock "3cfe99be-b74b-4fd3-a5d6-a94708992c5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:43:00 user nova-compute[74960]: DEBUG nova.compute.manager [req-429a44c9-1be9-4b6a-bc7c-2c55b7ba9282 req-4f276875-4657-4203-ae0e-d99522a8b86c service nova] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] No waiting events found dispatching network-vif-unplugged-ad28ac84-3419-4701-90df-e93359da2c28 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:43:00 user nova-compute[74960]: WARNING nova.compute.manager [req-429a44c9-1be9-4b6a-bc7c-2c55b7ba9282 req-4f276875-4657-4203-ae0e-d99522a8b86c service nova] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] Received unexpected event network-vif-unplugged-ad28ac84-3419-4701-90df-e93359da2c28 for instance with vm_state active and task_state rescuing.
Nov 03 12:43:00 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f15f5f-8afa-4d7b-bb45-5887184f9ee5/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:43:00 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47eb8ddf-590f-4ffa-87c8-377cf1ee0f67/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:43:00 user nova-compute[74960]: DEBUG nova.compute.manager [req-86c5b2cd-b6c6-491f-999a-90814a955c70 req-ee8b10d1-98d0-4239-ab31-bf5c902542b8 service nova] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] Received event network-vif-unplugged-59f6ddba-fb77-4d36-98da-f4d645355650 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:43:00 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-86c5b2cd-b6c6-491f-999a-90814a955c70 req-ee8b10d1-98d0-4239-ab31-bf5c902542b8 service nova] Acquiring lock "895d6de1-b5d9-4555-af57-f7816183be58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:43:00 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-86c5b2cd-b6c6-491f-999a-90814a955c70 req-ee8b10d1-98d0-4239-ab31-bf5c902542b8 service nova] Lock "895d6de1-b5d9-4555-af57-f7816183be58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:43:00 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-86c5b2cd-b6c6-491f-999a-90814a955c70 req-ee8b10d1-98d0-4239-ab31-bf5c902542b8 service nova] Lock "895d6de1-b5d9-4555-af57-f7816183be58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:43:00 user nova-compute[74960]: DEBUG nova.compute.manager [req-86c5b2cd-b6c6-491f-999a-90814a955c70 req-ee8b10d1-98d0-4239-ab31-bf5c902542b8 service nova] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] No waiting events found dispatching network-vif-unplugged-59f6ddba-fb77-4d36-98da-f4d645355650 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:43:00 user nova-compute[74960]: DEBUG nova.compute.manager [req-86c5b2cd-b6c6-491f-999a-90814a955c70 req-ee8b10d1-98d0-4239-ab31-bf5c902542b8 service nova] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] Received event network-vif-unplugged-59f6ddba-fb77-4d36-98da-f4d645355650 for instance with task_state deleting. {{(pid=74960) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 12:43:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:43:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:43:00 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47eb8ddf-590f-4ffa-87c8-377cf1ee0f67/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:43:00 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47eb8ddf-590f-4ffa-87c8-377cf1ee0f67/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:43:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:43:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:43:00 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47eb8ddf-590f-4ffa-87c8-377cf1ee0f67/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:43:00 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60658b54-5e34-4a2b-be14-124e47e291c2/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:43:01 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60658b54-5e34-4a2b-be14-124e47e291c2/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:43:01 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60658b54-5e34-4a2b-be14-124e47e291c2/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:43:01 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:43:01 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] Instance destroyed successfully.
Nov 03 12:43:01 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:43:01 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-4daa47ae-9e61-446f-a72f-336f0649b840 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] Attempting rescue
Nov 03 12:43:01 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-4daa47ae-9e61-446f-a72f-336f0649b840 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74960) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 03 12:43:01 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] Instance destroyed successfully.
Nov 03 12:43:01 user nova-compute[74960]: DEBUG nova.objects.instance [None req-8fa8efa4-1dee-41ad-b79f-80e32d42e7f7 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Lazy-loading 'resources' on Instance uuid 895d6de1-b5d9-4555-af57-f7816183be58 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:43:01 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:43:01 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-4daa47ae-9e61-446f-a72f-336f0649b840 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] Instance directory exists: not creating {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 03 12:43:01 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-4daa47ae-9e61-446f-a72f-336f0649b840 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] Creating image(s)
Nov 03 12:43:01 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-4daa47ae-9e61-446f-a72f-336f0649b840 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Acquiring lock "/opt/stack/data/nova/instances/3cfe99be-b74b-4fd3-a5d6-a94708992c5b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:43:01 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-4daa47ae-9e61-446f-a72f-336f0649b840 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Lock "/opt/stack/data/nova/instances/3cfe99be-b74b-4fd3-a5d6-a94708992c5b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:43:01 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-4daa47ae-9e61-446f-a72f-336f0649b840 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Lock "/opt/stack/data/nova/instances/3cfe99be-b74b-4fd3-a5d6-a94708992c5b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:43:01 user nova-compute[74960]: DEBUG nova.objects.instance [None req-4daa47ae-9e61-446f-a72f-336f0649b840 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Lazy-loading 'trusted_certs' on Instance uuid 3cfe99be-b74b-4fd3-a5d6-a94708992c5b {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:43:01 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-8fa8efa4-1dee-41ad-b79f-80e32d42e7f7 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:36:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-657586703',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-657586703',id=37,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-03T12:39:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dbc95d68d5e147e1953c855169b17091',ramdisk_id='',reservation_id='r-phhx6hay',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-195954071',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T12:41:14Z,user_data=None,user_id='c473215929044a108c9fc4d6327dfc3d',uuid=895d6de1-b5d9-4555-af57-f7816183be58,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "59f6ddba-fb77-4d36-98da-f4d645355650", "address": "fa:16:3e:df:ac:19", "network": {"id": "dec66832-56d5-4d68-b11f-8e8eed38f045", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-79099436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc95d68d5e147e1953c855169b17091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59f6ddba-fb", "ovs_interfaceid": "59f6ddba-fb77-4d36-98da-f4d645355650", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 12:43:01 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-8fa8efa4-1dee-41ad-b79f-80e32d42e7f7 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Converting VIF {"id": "59f6ddba-fb77-4d36-98da-f4d645355650", "address": "fa:16:3e:df:ac:19", "network": {"id": "dec66832-56d5-4d68-b11f-8e8eed38f045", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-79099436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc95d68d5e147e1953c855169b17091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59f6ddba-fb", "ovs_interfaceid": "59f6ddba-fb77-4d36-98da-f4d645355650", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:43:01 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-8fa8efa4-1dee-41ad-b79f-80e32d42e7f7 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:df:ac:19,bridge_name='br-int',has_traffic_filtering=True,id=59f6ddba-fb77-4d36-98da-f4d645355650,network=Network(dec66832-56d5-4d68-b11f-8e8eed38f045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59f6ddba-fb') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:43:01 user nova-compute[74960]: DEBUG os_vif [None req-8fa8efa4-1dee-41ad-b79f-80e32d42e7f7 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:ac:19,bridge_name='br-int',has_traffic_filtering=True,id=59f6ddba-fb77-4d36-98da-f4d645355650,network=Network(dec66832-56d5-4d68-b11f-8e8eed38f045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59f6ddba-fb') {{(pid=74960) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 12:43:01 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60658b54-5e34-4a2b-be14-124e47e291c2/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:43:01 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:43:01 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap59f6ddba-fb, bridge=br-int, if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:43:01 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-4daa47ae-9e61-446f-a72f-336f0649b840 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Acquiring lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:43:01 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-4daa47ae-9e61-446f-a72f-336f0649b840 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:43:01 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-4daa47ae-9e61-446f-a72f-336f0649b840 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:43:01 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:43:01 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:43:01 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:43:01 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f7607270-9402-40c5-b5d6-cb36f7094f08) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:43:01 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:43:01 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:43:01 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e02c80-f626-4918-93f1-6b9a7f778c7a/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:43:01 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:43:01 user nova-compute[74960]: INFO os_vif [None req-8fa8efa4-1dee-41ad-b79f-80e32d42e7f7 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:ac:19,bridge_name='br-int',has_traffic_filtering=True,id=59f6ddba-fb77-4d36-98da-f4d645355650,network=Network(dec66832-56d5-4d68-b11f-8e8eed38f045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59f6ddba-fb')
Nov 03 12:43:01 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8fa8efa4-1dee-41ad-b79f-80e32d42e7f7 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] calling os-brick to detach iSCSI Volume {{(pid=74960) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 12:43:01 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa8efa4-1dee-41ad-b79f-80e32d42e7f7 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9aa420acb0>, {'target_iqn': 'iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AOzUElvi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:43:01 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-8fa8efa4-1dee-41ad-b79f-80e32d42e7f7 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:43:01 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-8fa8efa4-1dee-41ad-b79f-80e32d42e7f7 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:43:01 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-8fa8efa4-1dee-41ad-b79f-80e32d42e7f7 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:43:01 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:43:01 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:43:01 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[6060db03-7e24-494c-9a1f-dd353cc31e65]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f4c6cd96-5bb9-496e-aaa7-37f872cee704\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:43:01 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa8efa4-1dee-41ad-b79f-80e32d42e7f7 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 12:43:01 user nova-compute[74960]: No targets found.
Nov 03 12:43:01 user nova-compute[74960]: iSNS:
Nov 03 12:43:01 user nova-compute[74960]: No targets found.
Nov 03 12:43:01 user nova-compute[74960]: STATIC:
Nov 03 12:43:01 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7
Nov 03 12:43:01 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:43:01 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:43:01 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2
Nov 03 12:43:01 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:43:01 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:43:01 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:f4c6cd96-5bb9-496e-aaa7-37f872cee704
Nov 03 12:43:01 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:43:01 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:43:01 user nova-compute[74960]: FIRMWARE:
Nov 03 12:43:01 user nova-compute[74960]: No targets found.
Nov 03 12:43:01 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:43:01 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa8efa4-1dee-41ad-b79f-80e32d42e7f7 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 12:43:01 user nova-compute[74960]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 12:43:01 user nova-compute[74960]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74960) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 12:43:01 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa8efa4-1dee-41ad-b79f-80e32d42e7f7 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7', 0)] {{(pid=74960) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 12:43:01 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:43:01 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:43:01 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[be258d69-603b-40f5-9e2b-eb3f2bd84b21]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4c6cd96-5bb9-496e-aaa7-37f872cee704\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:43:01 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:43:01 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-4daa47ae-9e61-446f-a72f-336f0649b840 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.245s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:43:01 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-4daa47ae-9e61-446f-a72f-336f0649b840 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910,backing_fmt=raw /opt/stack/data/nova/instances/3cfe99be-b74b-4fd3-a5d6-a94708992c5b/disk.rescue {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:43:01 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:43:01 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:43:01 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[7965d91c-c8d2-4f96-a464-e6b5bd24750d]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4c6cd96-5bb9-496e-aaa7-37f872cee704 (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:43:01 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa8efa4-1dee-41ad-b79f-80e32d42e7f7 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:43:01 user nova-compute[74960]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7 (non-flash)
Nov 03 12:43:01 user nova-compute[74960]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4c6cd96-5bb9-496e-aaa7-37f872cee704 (non-flash)
Nov 03 12:43:01 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:43:01 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa8efa4-1dee-41ad-b79f-80e32d42e7f7 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:43:01 user nova-compute[74960]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7 (non-flash)
Nov 03 12:43:01 user nova-compute[74960]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4c6cd96-5bb9-496e-aaa7-37f872cee704 (non-flash)
Nov 03 12:43:01 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:43:01 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa8efa4-1dee-41ad-b79f-80e32d42e7f7 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9ab06d5d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7'): ({'sde'}, set())}) {{(pid=74960) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 12:43:01 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-8fa8efa4-1dee-41ad-b79f-80e32d42e7f7 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Removing single pathed devices sde {{(pid=74960) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 12:43:01 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e02c80-f626-4918-93f1-6b9a7f778c7a/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:43:01 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e02c80-f626-4918-93f1-6b9a7f778c7a/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:43:01 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:43:01 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:43:01 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8dc5b4c-e4ab-4b69-986a-cfb15ff7ed2e]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:43:01 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-4daa47ae-9e61-446f-a72f-336f0649b840 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910,backing_fmt=raw /opt/stack/data/nova/instances/3cfe99be-b74b-4fd3-a5d6-a94708992c5b/disk.rescue" returned: 0 in 0.131s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:43:01 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-4daa47ae-9e61-446f-a72f-336f0649b840 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.386s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:43:01 user nova-compute[74960]: DEBUG nova.objects.instance [None req-4daa47ae-9e61-446f-a72f-336f0649b840 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Lazy-loading 'migration_context' on Instance uuid 3cfe99be-b74b-4fd3-a5d6-a94708992c5b {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:43:01 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:43:01 user nova-compute[74960]: DEBUG nova.objects.base [None req-4daa47ae-9e61-446f-a72f-336f0649b840 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Object Instance<3cfe99be-b74b-4fd3-a5d6-a94708992c5b> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74960) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 12:43:01 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-4daa47ae-9e61-446f-a72f-336f0649b840 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] Created local disks {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 12:43:01 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-4daa47ae-9e61-446f-a72f-336f0649b840 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] Start _get_guest_xml network_info=[{"id": "ad28ac84-3419-4701-90df-e93359da2c28", "address": "fa:16:3e:1f:4e:b6", "network": {"id": "9a9a848a-80be-4281-8554-8e28744073b3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1579909169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1579909169-network", "vif_mac": "fa:16:3e:1f:4e:b6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "434ce6c4b77342299a17e547a14e3918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad28ac84-34", "ovs_interfaceid": "ad28ac84-3419-4701-90df-e93359da2c28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=549f51ba-ac69-494b-8de1-34635aa2d7cf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='63ee9c80c632442fb0379f47b784bd20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T12:13:04Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '549f51ba-ac69-494b-8de1-34635aa2d7cf', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 12:43:01 user nova-compute[74960]: DEBUG nova.objects.instance [None req-4daa47ae-9e61-446f-a72f-336f0649b840 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Lazy-loading 'resources' on Instance uuid 3cfe99be-b74b-4fd3-a5d6-a94708992c5b {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:43:01 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.030s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:43:01 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[581a4a4d-a167-4885-81a4-1a504e5c014f]: (4, ('ok\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:43:01 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-8fa8efa4-1dee-41ad-b79f-80e32d42e7f7 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Flushing IO for device /dev/sde {{(pid=74960) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 12:43:01 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:43:01 user nova-compute[74960]: DEBUG nova.objects.base [None req-4daa47ae-9e61-446f-a72f-336f0649b840 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Object Instance<3cfe99be-b74b-4fd3-a5d6-a94708992c5b> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74960) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 12:43:01 user nova-compute[74960]: DEBUG nova.objects.instance [None req-4daa47ae-9e61-446f-a72f-336f0649b840 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Lazy-loading 'numa_topology' on Instance uuid 3cfe99be-b74b-4fd3-a5d6-a94708992c5b {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:43:01 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:43:01 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[01e1ee1b-a8ac-4d7e-95f9-e02fd2a3cfcc]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:43:01 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-8fa8efa4-1dee-41ad-b79f-80e32d42e7f7 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74960) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 12:43:01 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:43:01 user nova-compute[74960]: DEBUG nova.objects.base [None req-4daa47ae-9e61-446f-a72f-336f0649b840 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Object Instance<3cfe99be-b74b-4fd3-a5d6-a94708992c5b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74960) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 12:43:01 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-4daa47ae-9e61-446f-a72f-336f0649b840 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:43:01 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-4daa47ae-9e61-446f-a72f-336f0649b840 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:43:01 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-4daa47ae-9e61-446f-a72f-336f0649b840 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 12:43:01 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-4daa47ae-9e61-446f-a72f-336f0649b840 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] CPU controller missing on host. {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 12:43:01 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-4daa47ae-9e61-446f-a72f-336f0649b840 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 12:43:01 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-4daa47ae-9e61-446f-a72f-336f0649b840 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] CPU controller found on host. {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 12:43:01 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-4daa47ae-9e61-446f-a72f-336f0649b840 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74960) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 12:43:01 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-4daa47ae-9e61-446f-a72f-336f0649b840 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=549f51ba-ac69-494b-8de1-34635aa2d7cf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='63ee9c80c632442fb0379f47b784bd20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T12:13:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 12:43:01 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-4daa47ae-9e61-446f-a72f-336f0649b840 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Flavor limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 12:43:01 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-4daa47ae-9e61-446f-a72f-336f0649b840 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Image limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 12:43:01 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-4daa47ae-9e61-446f-a72f-336f0649b840 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Flavor pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 12:43:01 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-4daa47ae-9e61-446f-a72f-336f0649b840 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Image pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 12:43:01 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-4daa47ae-9e61-446f-a72f-336f0649b840 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 12:43:01 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-4daa47ae-9e61-446f-a72f-336f0649b840 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 12:43:01 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-4daa47ae-9e61-446f-a72f-336f0649b840 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 12:43:01 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-4daa47ae-9e61-446f-a72f-336f0649b840 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Got 1 possible topologies {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 12:43:01 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-4daa47ae-9e61-446f-a72f-336f0649b840 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 12:43:01 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-4daa47ae-9e61-446f-a72f-336f0649b840 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 12:43:01 user nova-compute[74960]: DEBUG nova.objects.instance [None req-4daa47ae-9e61-446f-a72f-336f0649b840 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3cfe99be-b74b-4fd3-a5d6-a94708992c5b {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:43:01 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.055s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:43:01 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[fedb0b4c-c7e8-4db0-9ccb-017b035fcd13]: (4, ('1', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:43:01 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-8fa8efa4-1dee-41ad-b79f-80e32d42e7f7 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74960) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 12:43:01 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-8fa8efa4-1dee-41ad-b79f-80e32d42e7f7 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] SCSI volumes sde have been removed. {{(pid=74960) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 12:43:01 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa8efa4-1dee-41ad-b79f-80e32d42e7f7 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7')] {{(pid=74960) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 12:43:01 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:43:01 user nova-compute[74960]: DEBUG nova.objects.base [None req-4daa47ae-9e61-446f-a72f-336f0649b840 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Object Instance<3cfe99be-b74b-4fd3-a5d6-a94708992c5b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74960) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 12:43:01 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-4daa47ae-9e61-446f-a72f-336f0649b840 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:40:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1884980457',display_name='tempest-ServerRescueNegativeTestJSON-server-1884980457',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1884980457',id=40,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMAPMnFd1JRN0E4yOaz+7M9XDigELBr/MyBa4o6iI8rumzVsQU30J0F61h3Gx9Yw2QtcQXEUTWFuTmbBZuwDvVSgVUx/2raFWAzK21Wh2+8Wr1ogAAMcu8n8DGpouEmeFw==',key_name='tempest-keypair-1713845316',keypairs=<?>,launch_index=0,launched_at=2023-11-03T12:40:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='434ce6c4b77342299a17e547a14e3918',ramdisk_id='',reservation_id='r-oiu8hz60',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1678469488',owner_user_name='tempest-ServerRescueNegativeTestJSON-1678469488-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:40:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82a995b6307c4ba0b4cf8d5ede286a6c',uuid=3cfe99be-b74b-4fd3-a5d6-a94708992c5b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ad28ac84-3419-4701-90df-e93359da2c28", "address": "fa:16:3e:1f:4e:b6", "network": {"id": "9a9a848a-80be-4281-8554-8e28744073b3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1579909169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1579909169-network", "vif_mac": "fa:16:3e:1f:4e:b6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "434ce6c4b77342299a17e547a14e3918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad28ac84-34", "ovs_interfaceid": "ad28ac84-3419-4701-90df-e93359da2c28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74960) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 12:43:01 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-4daa47ae-9e61-446f-a72f-336f0649b840 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Converting VIF {"id": "ad28ac84-3419-4701-90df-e93359da2c28", "address": "fa:16:3e:1f:4e:b6", "network": {"id": "9a9a848a-80be-4281-8554-8e28744073b3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1579909169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1579909169-network", "vif_mac": "fa:16:3e:1f:4e:b6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "434ce6c4b77342299a17e547a14e3918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad28ac84-34", "ovs_interfaceid": "ad28ac84-3419-4701-90df-e93359da2c28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:43:01 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-4daa47ae-9e61-446f-a72f-336f0649b840 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1f:4e:b6,bridge_name='br-int',has_traffic_filtering=True,id=ad28ac84-3419-4701-90df-e93359da2c28,network=Network(9a9a848a-80be-4281-8554-8e28744073b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad28ac84-34') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:43:01 user nova-compute[74960]: DEBUG nova.objects.instance [None req-4daa47ae-9e61-446f-a72f-336f0649b840 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Lazy-loading 'pci_devices' on Instance uuid 3cfe99be-b74b-4fd3-a5d6-a94708992c5b {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:43:01 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:43:01 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[d60fd7e5-b6ed-4a2a-9f06-bbaad8cb69da]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:43:01 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa8efa4-1dee-41ad-b79f-80e32d42e7f7 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:43:01 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e02c80-f626-4918-93f1-6b9a7f778c7a/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:43:01 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7 -p 172.16.0.220:3260 --logout {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:43:01 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk.rescue --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:43:01 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:43:01 user nova-compute[74960]: DEBUG nova.objects.base [None req-4daa47ae-9e61-446f-a72f-336f0649b840 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Object Instance<3cfe99be-b74b-4fd3-a5d6-a94708992c5b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74960) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 12:43:01 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-4daa47ae-9e61-446f-a72f-336f0649b840 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] End _get_guest_xml xml=<domain type="kvm">
Nov 03 12:43:01 user nova-compute[74960]:   <uuid>3cfe99be-b74b-4fd3-a5d6-a94708992c5b</uuid>
Nov 03 12:43:01 user nova-compute[74960]:   <name>instance-00000028</name>
Nov 03 12:43:01 user nova-compute[74960]:   <memory>524288</memory>
Nov 03 12:43:01 user nova-compute[74960]:   <vcpu>1</vcpu>
Nov 03 12:43:01 user nova-compute[74960]:   <metadata>
Nov 03 12:43:01 user nova-compute[74960]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 12:43:01 user nova-compute[74960]:       <nova:package version="0.0.0"/>
Nov 03 12:43:01 user nova-compute[74960]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1884980457</nova:name>
Nov 03 12:43:01 user nova-compute[74960]:       <nova:creationTime>2023-11-03 12:43:01</nova:creationTime>
Nov 03 12:43:01 user nova-compute[74960]:       <nova:flavor name="m1.tiny">
Nov 03 12:43:01 user nova-compute[74960]:         <nova:memory>512</nova:memory>
Nov 03 12:43:01 user nova-compute[74960]:         <nova:disk>1</nova:disk>
Nov 03 12:43:01 user nova-compute[74960]:         <nova:swap>0</nova:swap>
Nov 03 12:43:01 user nova-compute[74960]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 12:43:01 user nova-compute[74960]:         <nova:vcpus>1</nova:vcpus>
Nov 03 12:43:01 user nova-compute[74960]:       </nova:flavor>
Nov 03 12:43:01 user nova-compute[74960]:       <nova:owner>
Nov 03 12:43:01 user nova-compute[74960]:         <nova:user uuid="82a995b6307c4ba0b4cf8d5ede286a6c">tempest-ServerRescueNegativeTestJSON-1678469488-project-member</nova:user>
Nov 03 12:43:01 user nova-compute[74960]:         <nova:project uuid="434ce6c4b77342299a17e547a14e3918">tempest-ServerRescueNegativeTestJSON-1678469488</nova:project>
Nov 03 12:43:01 user nova-compute[74960]:       </nova:owner>
Nov 03 12:43:01 user nova-compute[74960]:       <nova:root type="image" uuid="549f51ba-ac69-494b-8de1-34635aa2d7cf"/>
Nov 03 12:43:01 user nova-compute[74960]:       <nova:ports>
Nov 03 12:43:01 user nova-compute[74960]:         <nova:port uuid="ad28ac84-3419-4701-90df-e93359da2c28">
Nov 03 12:43:01 user nova-compute[74960]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 03 12:43:01 user nova-compute[74960]:         </nova:port>
Nov 03 12:43:01 user nova-compute[74960]:       </nova:ports>
Nov 03 12:43:01 user nova-compute[74960]:     </nova:instance>
Nov 03 12:43:01 user nova-compute[74960]:   </metadata>
Nov 03 12:43:01 user nova-compute[74960]:   <sysinfo type="smbios">
Nov 03 12:43:01 user nova-compute[74960]:     <system>
Nov 03 12:43:01 user nova-compute[74960]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 12:43:01 user nova-compute[74960]:       <entry name="product">OpenStack Nova</entry>
Nov 03 12:43:01 user nova-compute[74960]:       <entry name="version">0.0.0</entry>
Nov 03 12:43:01 user nova-compute[74960]:       <entry name="serial">3cfe99be-b74b-4fd3-a5d6-a94708992c5b</entry>
Nov 03 12:43:01 user nova-compute[74960]:       <entry name="uuid">3cfe99be-b74b-4fd3-a5d6-a94708992c5b</entry>
Nov 03 12:43:01 user nova-compute[74960]:       <entry name="family">Virtual Machine</entry>
Nov 03 12:43:01 user nova-compute[74960]:     </system>
Nov 03 12:43:01 user nova-compute[74960]:   </sysinfo>
Nov 03 12:43:01 user nova-compute[74960]:   <os>
Nov 03 12:43:01 user nova-compute[74960]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 12:43:01 user nova-compute[74960]:     <smbios mode="sysinfo"/>
Nov 03 12:43:01 user nova-compute[74960]:   </os>
Nov 03 12:43:01 user nova-compute[74960]:   <features>
Nov 03 12:43:01 user nova-compute[74960]:     <acpi/>
Nov 03 12:43:01 user nova-compute[74960]:     <apic/>
Nov 03 12:43:01 user nova-compute[74960]:     <vmcoreinfo/>
Nov 03 12:43:01 user nova-compute[74960]:   </features>
Nov 03 12:43:01 user nova-compute[74960]:   <clock offset="utc">
Nov 03 12:43:01 user nova-compute[74960]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 12:43:01 user nova-compute[74960]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 12:43:01 user nova-compute[74960]:     <timer name="hpet" present="no"/>
Nov 03 12:43:01 user nova-compute[74960]:   </clock>
Nov 03 12:43:01 user nova-compute[74960]:   <cpu mode="custom" match="exact">
Nov 03 12:43:01 user nova-compute[74960]:     <model>Nehalem</model>
Nov 03 12:43:01 user nova-compute[74960]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 12:43:01 user nova-compute[74960]:   </cpu>
Nov 03 12:43:01 user nova-compute[74960]:   <devices>
Nov 03 12:43:01 user nova-compute[74960]:     <disk type="file" device="disk">
Nov 03 12:43:01 user nova-compute[74960]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 12:43:01 user nova-compute[74960]:       <source file="/opt/stack/data/nova/instances/3cfe99be-b74b-4fd3-a5d6-a94708992c5b/disk.rescue"/>
Nov 03 12:43:01 user nova-compute[74960]:       <target dev="vda" bus="virtio"/>
Nov 03 12:43:01 user nova-compute[74960]:     </disk>
Nov 03 12:43:01 user nova-compute[74960]:     <disk type="file" device="disk">
Nov 03 12:43:01 user nova-compute[74960]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 12:43:01 user nova-compute[74960]:       <source file="/opt/stack/data/nova/instances/3cfe99be-b74b-4fd3-a5d6-a94708992c5b/disk"/>
Nov 03 12:43:01 user nova-compute[74960]:       <target dev="vdb" bus="virtio"/>
Nov 03 12:43:01 user nova-compute[74960]:     </disk>
Nov 03 12:43:01 user nova-compute[74960]:     <interface type="ethernet">
Nov 03 12:43:01 user nova-compute[74960]:       <mac address="fa:16:3e:1f:4e:b6"/>
Nov 03 12:43:01 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:43:01 user nova-compute[74960]:       <mtu size="1442"/>
Nov 03 12:43:01 user nova-compute[74960]:       <target dev="tapad28ac84-34"/>
Nov 03 12:43:01 user nova-compute[74960]:     </interface>
Nov 03 12:43:01 user nova-compute[74960]:     <serial type="pty">
Nov 03 12:43:01 user nova-compute[74960]:       <log file="/opt/stack/data/nova/instances/3cfe99be-b74b-4fd3-a5d6-a94708992c5b/console.log" append="off"/>
Nov 03 12:43:01 user nova-compute[74960]:     </serial>
Nov 03 12:43:01 user nova-compute[74960]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 12:43:01 user nova-compute[74960]:     <video>
Nov 03 12:43:01 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:43:01 user nova-compute[74960]:     </video>
Nov 03 12:43:01 user nova-compute[74960]:     <rng model="virtio">
Nov 03 12:43:01 user nova-compute[74960]:       <backend model="random">/dev/urandom</backend>
Nov 03 12:43:01 user nova-compute[74960]:     </rng>
Nov 03 12:43:01 user nova-compute[74960]:     <controller type="usb" index="0" model="none"/>
Nov 03 12:43:01 user nova-compute[74960]:     <memballoon model="virtio">
Nov 03 12:43:01 user nova-compute[74960]:       <stats period="10"/>
Nov 03 12:43:01 user nova-compute[74960]:     </memballoon>
Nov 03 12:43:01 user nova-compute[74960]:   </devices>
Nov 03 12:43:01 user nova-compute[74960]: </domain>
Nov 03 12:43:01 user nova-compute[74960]:  {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 12:43:01 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:43:01 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bd1be55-9f92-4e25-9ef5-ae503ad7324f]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:43:01 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa8efa4-1dee-41ad-b79f-80e32d42e7f7 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7, portal: 172.16.0.220,3260]
Nov 03 12:43:01 user nova-compute[74960]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7, portal: 172.16.0.220,3260] successful.
Nov 03 12:43:01 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:43:01 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7 -p 172.16.0.220:3260 --op delete {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:43:01 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] Instance destroyed successfully.
Nov 03 12:43:01 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b25e85a-a887-4c1b-a798-bd360de0e9d7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:43:01 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[9034f22e-bcb7-4691-9eb8-9fdd34b5299e]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:43:01 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa8efa4-1dee-41ad-b79f-80e32d42e7f7 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:43:01 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-8fa8efa4-1dee-41ad-b79f-80e32d42e7f7 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.529s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:43:01 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa8efa4-1dee-41ad-b79f-80e32d42e7f7 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] <== disconnect_volume: return (532ms) None {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:43:01 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8fa8efa4-1dee-41ad-b79f-80e32d42e7f7 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] Disconnected iSCSI Volume {{(pid=74960) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 12:43:01 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-8fa8efa4-1dee-41ad-b79f-80e32d42e7f7 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] Deleting instance files /opt/stack/data/nova/instances/895d6de1-b5d9-4555-af57-f7816183be58_del
Nov 03 12:43:01 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-8fa8efa4-1dee-41ad-b79f-80e32d42e7f7 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] Deletion of /opt/stack/data/nova/instances/895d6de1-b5d9-4555-af57-f7816183be58_del complete
Nov 03 12:43:02 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-4daa47ae-9e61-446f-a72f-336f0649b840 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] No BDM found with device name vda, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:43:02 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-4daa47ae-9e61-446f-a72f-336f0649b840 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:43:02 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-4daa47ae-9e61-446f-a72f-336f0649b840 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] No VIF found with MAC fa:16:3e:1f:4e:b6, not building metadata {{(pid=74960) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 12:43:02 user nova-compute[74960]: INFO nova.compute.manager [None req-8fa8efa4-1dee-41ad-b79f-80e32d42e7f7 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] Took 2.02 seconds to destroy the instance on the hypervisor.
Nov 03 12:43:02 user nova-compute[74960]: DEBUG oslo.service.loopingcall [None req-8fa8efa4-1dee-41ad-b79f-80e32d42e7f7 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74960) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 12:43:02 user nova-compute[74960]: DEBUG nova.compute.manager [-] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] Deallocating network for instance {{(pid=74960) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 12:43:02 user nova-compute[74960]: DEBUG nova.network.neutron [-] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] deallocate_for_instance() {{(pid=74960) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 12:43:02 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk.rescue --force-share --output=json" returned: 0 in 0.218s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:43:02 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk.rescue --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:43:02 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:43:02 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:43:02 user nova-compute[74960]: DEBUG nova.compute.manager [req-244e0a50-7ed7-4340-8765-662332e89c5a req-317810c0-f27a-4cba-9886-2ed9b4b7b930 service nova] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] Received event network-vif-plugged-ad28ac84-3419-4701-90df-e93359da2c28 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:43:02 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-244e0a50-7ed7-4340-8765-662332e89c5a req-317810c0-f27a-4cba-9886-2ed9b4b7b930 service nova] Acquiring lock "3cfe99be-b74b-4fd3-a5d6-a94708992c5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:43:02 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-244e0a50-7ed7-4340-8765-662332e89c5a req-317810c0-f27a-4cba-9886-2ed9b4b7b930 service nova] Lock "3cfe99be-b74b-4fd3-a5d6-a94708992c5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:43:02 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-244e0a50-7ed7-4340-8765-662332e89c5a req-317810c0-f27a-4cba-9886-2ed9b4b7b930 service nova] Lock "3cfe99be-b74b-4fd3-a5d6-a94708992c5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:43:02 user nova-compute[74960]: DEBUG nova.compute.manager [req-244e0a50-7ed7-4340-8765-662332e89c5a req-317810c0-f27a-4cba-9886-2ed9b4b7b930 service nova] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] No waiting events found dispatching network-vif-plugged-ad28ac84-3419-4701-90df-e93359da2c28 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:43:02 user nova-compute[74960]: WARNING nova.compute.manager [req-244e0a50-7ed7-4340-8765-662332e89c5a req-317810c0-f27a-4cba-9886-2ed9b4b7b930 service nova] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] Received unexpected event network-vif-plugged-ad28ac84-3419-4701-90df-e93359da2c28 for instance with vm_state active and task_state rescuing.
Nov 03 12:43:02 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:43:02 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:43:02 user nova-compute[74960]: DEBUG nova.compute.manager [req-59f8d4aa-0f00-4f00-aa93-bf3bf79d6133 req-6cc79b91-a20b-4df8-b1c8-438cf89cf082 service nova] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] Received event network-vif-plugged-59f6ddba-fb77-4d36-98da-f4d645355650 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:43:02 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-59f8d4aa-0f00-4f00-aa93-bf3bf79d6133 req-6cc79b91-a20b-4df8-b1c8-438cf89cf082 service nova] Acquiring lock "895d6de1-b5d9-4555-af57-f7816183be58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:43:02 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-59f8d4aa-0f00-4f00-aa93-bf3bf79d6133 req-6cc79b91-a20b-4df8-b1c8-438cf89cf082 service nova] Lock "895d6de1-b5d9-4555-af57-f7816183be58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:43:02 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-59f8d4aa-0f00-4f00-aa93-bf3bf79d6133 req-6cc79b91-a20b-4df8-b1c8-438cf89cf082 service nova] Lock "895d6de1-b5d9-4555-af57-f7816183be58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:43:02 user nova-compute[74960]: DEBUG nova.compute.manager [req-59f8d4aa-0f00-4f00-aa93-bf3bf79d6133 req-6cc79b91-a20b-4df8-b1c8-438cf89cf082 service nova] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] No waiting events found dispatching network-vif-plugged-59f6ddba-fb77-4d36-98da-f4d645355650 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:43:02 user nova-compute[74960]: WARNING nova.compute.manager [req-59f8d4aa-0f00-4f00-aa93-bf3bf79d6133 req-6cc79b91-a20b-4df8-b1c8-438cf89cf082 service nova] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] Received unexpected event network-vif-plugged-59f6ddba-fb77-4d36-98da-f4d645355650 for instance with vm_state active and task_state deleting.
Nov 03 12:43:02 user nova-compute[74960]: DEBUG nova.compute.manager [req-59f8d4aa-0f00-4f00-aa93-bf3bf79d6133 req-6cc79b91-a20b-4df8-b1c8-438cf89cf082 service nova] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] Received event network-vif-plugged-59f6ddba-fb77-4d36-98da-f4d645355650 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:43:02 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-59f8d4aa-0f00-4f00-aa93-bf3bf79d6133 req-6cc79b91-a20b-4df8-b1c8-438cf89cf082 service nova] Acquiring lock "895d6de1-b5d9-4555-af57-f7816183be58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:43:02 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-59f8d4aa-0f00-4f00-aa93-bf3bf79d6133 req-6cc79b91-a20b-4df8-b1c8-438cf89cf082 service nova] Lock "895d6de1-b5d9-4555-af57-f7816183be58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:43:02 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-59f8d4aa-0f00-4f00-aa93-bf3bf79d6133 req-6cc79b91-a20b-4df8-b1c8-438cf89cf082 service nova] Lock "895d6de1-b5d9-4555-af57-f7816183be58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:43:02 user nova-compute[74960]: DEBUG nova.compute.manager [req-59f8d4aa-0f00-4f00-aa93-bf3bf79d6133 req-6cc79b91-a20b-4df8-b1c8-438cf89cf082 service nova] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] No waiting events found dispatching network-vif-plugged-59f6ddba-fb77-4d36-98da-f4d645355650 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:43:02 user nova-compute[74960]: WARNING nova.compute.manager [req-59f8d4aa-0f00-4f00-aa93-bf3bf79d6133 req-6cc79b91-a20b-4df8-b1c8-438cf89cf082 service nova] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] Received unexpected event network-vif-plugged-59f6ddba-fb77-4d36-98da-f4d645355650 for instance with vm_state active and task_state deleting.
Nov 03 12:43:02 user nova-compute[74960]: DEBUG nova.compute.manager [req-59f8d4aa-0f00-4f00-aa93-bf3bf79d6133 req-6cc79b91-a20b-4df8-b1c8-438cf89cf082 service nova] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] Received event network-vif-plugged-59f6ddba-fb77-4d36-98da-f4d645355650 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:43:02 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-59f8d4aa-0f00-4f00-aa93-bf3bf79d6133 req-6cc79b91-a20b-4df8-b1c8-438cf89cf082 service nova] Acquiring lock "895d6de1-b5d9-4555-af57-f7816183be58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:43:02 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-59f8d4aa-0f00-4f00-aa93-bf3bf79d6133 req-6cc79b91-a20b-4df8-b1c8-438cf89cf082 service nova] Lock "895d6de1-b5d9-4555-af57-f7816183be58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:43:02 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-59f8d4aa-0f00-4f00-aa93-bf3bf79d6133 req-6cc79b91-a20b-4df8-b1c8-438cf89cf082 service nova] Lock "895d6de1-b5d9-4555-af57-f7816183be58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:43:02 user nova-compute[74960]: DEBUG nova.compute.manager [req-59f8d4aa-0f00-4f00-aa93-bf3bf79d6133 req-6cc79b91-a20b-4df8-b1c8-438cf89cf082 service nova] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] No waiting events found dispatching network-vif-plugged-59f6ddba-fb77-4d36-98da-f4d645355650 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:43:02 user nova-compute[74960]: WARNING nova.compute.manager [req-59f8d4aa-0f00-4f00-aa93-bf3bf79d6133 req-6cc79b91-a20b-4df8-b1c8-438cf89cf082 service nova] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] Received unexpected event network-vif-plugged-59f6ddba-fb77-4d36-98da-f4d645355650 for instance with vm_state active and task_state deleting.
Nov 03 12:43:02 user nova-compute[74960]: DEBUG nova.compute.manager [req-59f8d4aa-0f00-4f00-aa93-bf3bf79d6133 req-6cc79b91-a20b-4df8-b1c8-438cf89cf082 service nova] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] Received event network-vif-unplugged-59f6ddba-fb77-4d36-98da-f4d645355650 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:43:02 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-59f8d4aa-0f00-4f00-aa93-bf3bf79d6133 req-6cc79b91-a20b-4df8-b1c8-438cf89cf082 service nova] Acquiring lock "895d6de1-b5d9-4555-af57-f7816183be58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:43:02 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-59f8d4aa-0f00-4f00-aa93-bf3bf79d6133 req-6cc79b91-a20b-4df8-b1c8-438cf89cf082 service nova] Lock "895d6de1-b5d9-4555-af57-f7816183be58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:43:02 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-59f8d4aa-0f00-4f00-aa93-bf3bf79d6133 req-6cc79b91-a20b-4df8-b1c8-438cf89cf082 service nova] Lock "895d6de1-b5d9-4555-af57-f7816183be58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:43:02 user nova-compute[74960]: DEBUG nova.compute.manager [req-59f8d4aa-0f00-4f00-aa93-bf3bf79d6133 req-6cc79b91-a20b-4df8-b1c8-438cf89cf082 service nova] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] No waiting events found dispatching network-vif-unplugged-59f6ddba-fb77-4d36-98da-f4d645355650 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:43:02 user nova-compute[74960]: DEBUG nova.compute.manager [req-59f8d4aa-0f00-4f00-aa93-bf3bf79d6133 req-6cc79b91-a20b-4df8-b1c8-438cf89cf082 service nova] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] Received event network-vif-unplugged-59f6ddba-fb77-4d36-98da-f4d645355650 for instance with task_state deleting. {{(pid=74960) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 12:43:02 user nova-compute[74960]: DEBUG nova.compute.manager [req-59f8d4aa-0f00-4f00-aa93-bf3bf79d6133 req-6cc79b91-a20b-4df8-b1c8-438cf89cf082 service nova] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] Received event network-vif-plugged-59f6ddba-fb77-4d36-98da-f4d645355650 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:43:02 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-59f8d4aa-0f00-4f00-aa93-bf3bf79d6133 req-6cc79b91-a20b-4df8-b1c8-438cf89cf082 service nova] Acquiring lock "895d6de1-b5d9-4555-af57-f7816183be58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:43:02 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-59f8d4aa-0f00-4f00-aa93-bf3bf79d6133 req-6cc79b91-a20b-4df8-b1c8-438cf89cf082 service nova] Lock "895d6de1-b5d9-4555-af57-f7816183be58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:43:02 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-59f8d4aa-0f00-4f00-aa93-bf3bf79d6133 req-6cc79b91-a20b-4df8-b1c8-438cf89cf082 service nova] Lock "895d6de1-b5d9-4555-af57-f7816183be58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:43:02 user nova-compute[74960]: DEBUG nova.compute.manager [req-59f8d4aa-0f00-4f00-aa93-bf3bf79d6133 req-6cc79b91-a20b-4df8-b1c8-438cf89cf082 service nova] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] No waiting events found dispatching network-vif-plugged-59f6ddba-fb77-4d36-98da-f4d645355650 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:43:02 user nova-compute[74960]: WARNING nova.compute.manager [req-59f8d4aa-0f00-4f00-aa93-bf3bf79d6133 req-6cc79b91-a20b-4df8-b1c8-438cf89cf082 service nova] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] Received unexpected event network-vif-plugged-59f6ddba-fb77-4d36-98da-f4d645355650 for instance with vm_state active and task_state deleting.
Nov 03 12:43:02 user nova-compute[74960]: DEBUG nova.network.neutron [-] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] Updating instance_info_cache with network_info: [] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:43:02 user nova-compute[74960]: INFO nova.compute.manager [-] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] Took 0.55 seconds to deallocate network for instance.
Nov 03 12:43:02 user nova-compute[74960]: DEBUG nova.compute.manager [req-c71e387b-4f48-4335-943a-25713e0c48ce req-88037267-4eee-476a-a381-6b7aca10c0c0 service nova] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] Received event network-vif-deleted-59f6ddba-fb77-4d36-98da-f4d645355650 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:43:02 user nova-compute[74960]: INFO nova.compute.manager [req-c71e387b-4f48-4335-943a-25713e0c48ce req-88037267-4eee-476a-a381-6b7aca10c0c0 service nova] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] Neutron deleted interface 59f6ddba-fb77-4d36-98da-f4d645355650; detaching it from the instance and deleting it from the info cache
Nov 03 12:43:02 user nova-compute[74960]: DEBUG nova.network.neutron [req-c71e387b-4f48-4335-943a-25713e0c48ce req-88037267-4eee-476a-a381-6b7aca10c0c0 service nova] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] Updating instance_info_cache with network_info: [] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:43:02 user nova-compute[74960]: DEBUG nova.compute.manager [req-c71e387b-4f48-4335-943a-25713e0c48ce req-88037267-4eee-476a-a381-6b7aca10c0c0 service nova] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] Detach interface failed, port_id=59f6ddba-fb77-4d36-98da-f4d645355650, reason: Instance 895d6de1-b5d9-4555-af57-f7816183be58 could not be found. {{(pid=74960) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 03 12:43:02 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:43:02 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cce474db-fa6f-4670-9be7-88a3e62caa60/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:43:02 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cce474db-fa6f-4670-9be7-88a3e62caa60/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:43:02 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cce474db-fa6f-4670-9be7-88a3e62caa60/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:43:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cce474db-fa6f-4670-9be7-88a3e62caa60/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:43:03 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74960) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 12:43:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7606a55-d5c3-4ba8-b499-f3c70813f151/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:43:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7606a55-d5c3-4ba8-b499-f3c70813f151/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:43:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7606a55-d5c3-4ba8-b499-f3c70813f151/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:43:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7606a55-d5c3-4ba8-b499-f3c70813f151/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:43:03 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Error from libvirt while getting description of instance-00000025: [Error Code 42] Domain not found: no domain with matching uuid '895d6de1-b5d9-4555-af57-f7816183be58' (instance-00000025): libvirt.libvirtError: Domain not found: no domain with matching uuid '895d6de1-b5d9-4555-af57-f7816183be58' (instance-00000025)
Nov 03 12:43:06 user nova-compute[74960]: INFO nova.compute.manager [None req-8fa8efa4-1dee-41ad-b79f-80e32d42e7f7 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: 895d6de1-b5d9-4555-af57-f7816183be58] Took 3.54 seconds to detach 1 volumes for instance.
Nov 03 12:43:06 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:43:06 user nova-compute[74960]: DEBUG nova.compute.manager [req-fb48f372-a4f5-4fd2-9f32-4b93f0592a33 req-cbc257b9-163a-4902-99e4-6990d2ebe8ad service nova] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] Received event network-vif-plugged-ad28ac84-3419-4701-90df-e93359da2c28 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:43:06 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-fb48f372-a4f5-4fd2-9f32-4b93f0592a33 req-cbc257b9-163a-4902-99e4-6990d2ebe8ad service nova] Acquiring lock "3cfe99be-b74b-4fd3-a5d6-a94708992c5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:43:06 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-fb48f372-a4f5-4fd2-9f32-4b93f0592a33 req-cbc257b9-163a-4902-99e4-6990d2ebe8ad service nova] Lock "3cfe99be-b74b-4fd3-a5d6-a94708992c5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:43:06 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-fb48f372-a4f5-4fd2-9f32-4b93f0592a33 req-cbc257b9-163a-4902-99e4-6990d2ebe8ad service nova] Lock "3cfe99be-b74b-4fd3-a5d6-a94708992c5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:43:06 user nova-compute[74960]: DEBUG nova.compute.manager [req-fb48f372-a4f5-4fd2-9f32-4b93f0592a33 req-cbc257b9-163a-4902-99e4-6990d2ebe8ad service nova] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] No waiting events found dispatching network-vif-plugged-ad28ac84-3419-4701-90df-e93359da2c28 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:43:06 user nova-compute[74960]: WARNING nova.compute.manager [req-fb48f372-a4f5-4fd2-9f32-4b93f0592a33 req-cbc257b9-163a-4902-99e4-6990d2ebe8ad service nova] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] Received unexpected event network-vif-plugged-ad28ac84-3419-4701-90df-e93359da2c28 for instance with vm_state active and task_state rescuing.
Nov 03 12:43:06 user nova-compute[74960]: DEBUG nova.compute.manager [req-fb48f372-a4f5-4fd2-9f32-4b93f0592a33 req-cbc257b9-163a-4902-99e4-6990d2ebe8ad service nova] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] Received event network-vif-plugged-ad28ac84-3419-4701-90df-e93359da2c28 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:43:06 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-fb48f372-a4f5-4fd2-9f32-4b93f0592a33 req-cbc257b9-163a-4902-99e4-6990d2ebe8ad service nova] Acquiring lock "3cfe99be-b74b-4fd3-a5d6-a94708992c5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:43:06 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-fb48f372-a4f5-4fd2-9f32-4b93f0592a33 req-cbc257b9-163a-4902-99e4-6990d2ebe8ad service nova] Lock "3cfe99be-b74b-4fd3-a5d6-a94708992c5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:43:06 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-fb48f372-a4f5-4fd2-9f32-4b93f0592a33 req-cbc257b9-163a-4902-99e4-6990d2ebe8ad service nova] Lock "3cfe99be-b74b-4fd3-a5d6-a94708992c5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:43:06 user nova-compute[74960]: DEBUG nova.compute.manager [req-fb48f372-a4f5-4fd2-9f32-4b93f0592a33 req-cbc257b9-163a-4902-99e4-6990d2ebe8ad service nova] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] No waiting events found dispatching network-vif-plugged-ad28ac84-3419-4701-90df-e93359da2c28 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:43:06 user nova-compute[74960]: WARNING nova.compute.manager [req-fb48f372-a4f5-4fd2-9f32-4b93f0592a33 req-cbc257b9-163a-4902-99e4-6990d2ebe8ad service nova] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] Received unexpected event network-vif-plugged-ad28ac84-3419-4701-90df-e93359da2c28 for instance with vm_state active and task_state rescuing.
Nov 03 12:43:06 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:43:06 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:43:06 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Hypervisor/Node resource view: name=user free_ram=7798MB free_disk=24.694942474365234GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74960) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 12:43:06 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:43:06 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:43:06 user nova-compute[74960]: DEBUG nova.compute.manager [None req-4daa47ae-9e61-446f-a72f-336f0649b840 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] Checking state {{(pid=74960) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 12:43:06 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-8fa8efa4-1dee-41ad-b79f-80e32d42e7f7 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:43:06 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:43:06 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 87f15f5f-8afa-4d7b-bb45-5887184f9ee5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:43:06 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance a6199681-f85e-4f55-966b-6ab3f17cd640 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:43:06 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 35e02c80-f626-4918-93f1-6b9a7f778c7a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:43:06 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:43:06 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:43:06 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance b7606a55-d5c3-4ba8-b499-f3c70813f151 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:43:06 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 895d6de1-b5d9-4555-af57-f7816183be58 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:43:06 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 60658b54-5e34-4a2b-be14-124e47e291c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:43:06 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 3cfe99be-b74b-4fd3-a5d6-a94708992c5b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:43:06 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance cce474db-fa6f-4670-9be7-88a3e62caa60 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:43:06 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74960) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 12:43:06 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74960) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 12:43:06 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Refreshing inventories for resource provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 03 12:43:06 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Updating ProviderTree inventory for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 03 12:43:06 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Updating inventory in ProviderTree for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 03 12:43:06 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Refreshing aggregate associations for resource provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0, aggregates: None {{(pid=74960) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 03 12:43:06 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Refreshing trait associations for resource provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0, traits: COMPUTE_NODE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE41,HW_CPU_X86_SSSE3,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_DEVICE_TAGGING,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_QXL {{(pid=74960) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 03 12:43:07 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:43:07 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:43:07 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Compute_service record updated for user:user {{(pid=74960) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 12:43:07 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.990s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:43:07 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-8fa8efa4-1dee-41ad-b79f-80e32d42e7f7 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.936s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:43:07 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:43:07 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Cleaning up deleted instances {{(pid=74960) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 03 12:43:07 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] There are 0 instances to clean {{(pid=74960) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 03 12:43:07 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-8fa8efa4-1dee-41ad-b79f-80e32d42e7f7 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:43:07 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-8fa8efa4-1dee-41ad-b79f-80e32d42e7f7 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:43:07 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-8fa8efa4-1dee-41ad-b79f-80e32d42e7f7 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.399s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:43:07 user nova-compute[74960]: INFO nova.scheduler.client.report [None req-8fa8efa4-1dee-41ad-b79f-80e32d42e7f7 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Deleted allocations for instance 895d6de1-b5d9-4555-af57-f7816183be58
Nov 03 12:43:07 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-8fa8efa4-1dee-41ad-b79f-80e32d42e7f7 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Lock "895d6de1-b5d9-4555-af57-f7816183be58" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.727s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:43:08 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:43:08 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Starting heal instance info cache {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 12:43:08 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "refresh_cache-a6199681-f85e-4f55-966b-6ab3f17cd640" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:43:08 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquired lock "refresh_cache-a6199681-f85e-4f55-966b-6ab3f17cd640" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:43:08 user nova-compute[74960]: DEBUG nova.network.neutron [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] Forcefully refreshing network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 12:43:08 user nova-compute[74960]: DEBUG nova.network.neutron [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] Updating instance_info_cache with network_info: [{"id": "40976ae5-5f49-4d8e-abd7-04dc0ce8f319", "address": "fa:16:3e:7c:40:1d", "network": {"id": "dec66832-56d5-4d68-b11f-8e8eed38f045", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-79099436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc95d68d5e147e1953c855169b17091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40976ae5-5f", "ovs_interfaceid": "40976ae5-5f49-4d8e-abd7-04dc0ce8f319", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:43:08 user nova-compute[74960]: DEBUG nova.compute.manager [None req-3b4d7e83-9422-44fc-b53e-def003611db4 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] [instance: 60658b54-5e34-4a2b-be14-124e47e291c2] Checking state {{(pid=74960) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 12:43:08 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:43:08 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Releasing lock "refresh_cache-a6199681-f85e-4f55-966b-6ab3f17cd640" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:43:08 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] Updated the network info_cache for instance {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 12:43:08 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:43:08 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:43:08 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:43:08 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:43:08 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:43:08 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74960) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 12:43:08 user nova-compute[74960]: INFO nova.compute.manager [None req-3b4d7e83-9422-44fc-b53e-def003611db4 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] [instance: 60658b54-5e34-4a2b-be14-124e47e291c2] instance snapshotting
Nov 03 12:43:08 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-3b4d7e83-9422-44fc-b53e-def003611db4 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] [instance: 60658b54-5e34-4a2b-be14-124e47e291c2] Beginning live snapshot process
Nov 03 12:43:09 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-3b4d7e83-9422-44fc-b53e-def003611db4 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60658b54-5e34-4a2b-be14-124e47e291c2/disk --force-share --output=json -f qcow2 {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:43:09 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-3b4d7e83-9422-44fc-b53e-def003611db4 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60658b54-5e34-4a2b-be14-124e47e291c2/disk --force-share --output=json -f qcow2" returned: 0 in 0.280s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:43:09 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-3b4d7e83-9422-44fc-b53e-def003611db4 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60658b54-5e34-4a2b-be14-124e47e291c2/disk --force-share --output=json -f qcow2 {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:43:09 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-3b4d7e83-9422-44fc-b53e-def003611db4 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60658b54-5e34-4a2b-be14-124e47e291c2/disk --force-share --output=json -f qcow2" returned: 0 in 0.186s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:43:09 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-3b4d7e83-9422-44fc-b53e-def003611db4 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:43:09 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-3b4d7e83-9422-44fc-b53e-def003611db4 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.293s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:43:09 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-3b4d7e83-9422-44fc-b53e-def003611db4 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpbqa4bqnb/4609b5b988d74c85b955a16cfcfe81cb.delta 1073741824 {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:43:10 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-3b4d7e83-9422-44fc-b53e-def003611db4 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpbqa4bqnb/4609b5b988d74c85b955a16cfcfe81cb.delta 1073741824" returned: 0 in 0.063s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:43:10 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-3b4d7e83-9422-44fc-b53e-def003611db4 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] [instance: 60658b54-5e34-4a2b-be14-124e47e291c2] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 03 12:43:10 user nova-compute[74960]: DEBUG nova.virt.libvirt.guest [None req-3b4d7e83-9422-44fc-b53e-def003611db4 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=74960) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 03 12:43:11 user nova-compute[74960]: DEBUG nova.virt.libvirt.guest [None req-3b4d7e83-9422-44fc-b53e-def003611db4 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] COPY block job progress, current cursor: 24576000 final cursor: 75563008 {{(pid=74960) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 03 12:43:11 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:43:11 user nova-compute[74960]: DEBUG nova.virt.libvirt.guest [None req-3b4d7e83-9422-44fc-b53e-def003611db4 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=74960) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 03 12:43:11 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-3b4d7e83-9422-44fc-b53e-def003611db4 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] [instance: 60658b54-5e34-4a2b-be14-124e47e291c2] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 03 12:43:11 user nova-compute[74960]: DEBUG nova.privsep.utils [None req-3b4d7e83-9422-44fc-b53e-def003611db4 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74960) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 03 12:43:11 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-3b4d7e83-9422-44fc-b53e-def003611db4 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpbqa4bqnb/4609b5b988d74c85b955a16cfcfe81cb.delta /opt/stack/data/nova/instances/snapshots/tmpbqa4bqnb/4609b5b988d74c85b955a16cfcfe81cb {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:43:12 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-3b4d7e83-9422-44fc-b53e-def003611db4 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpbqa4bqnb/4609b5b988d74c85b955a16cfcfe81cb.delta /opt/stack/data/nova/instances/snapshots/tmpbqa4bqnb/4609b5b988d74c85b955a16cfcfe81cb" returned: 0 in 0.521s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:43:12 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-3b4d7e83-9422-44fc-b53e-def003611db4 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] [instance: 60658b54-5e34-4a2b-be14-124e47e291c2] Snapshot extracted, beginning image upload
Nov 03 12:43:12 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:43:15 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-3b4d7e83-9422-44fc-b53e-def003611db4 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] [instance: 60658b54-5e34-4a2b-be14-124e47e291c2] Snapshot image upload complete
Nov 03 12:43:15 user nova-compute[74960]: INFO nova.compute.manager [None req-3b4d7e83-9422-44fc-b53e-def003611db4 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] [instance: 60658b54-5e34-4a2b-be14-124e47e291c2] Took 6.25 seconds to snapshot the instance on the hypervisor.
Nov 03 12:43:16 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:43:16 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:43:16 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74960) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 12:43:16 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74960) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 12:43:16 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74960) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 12:43:16 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:43:17 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-4f0ed8bf-1c6f-47e4-a09f-38bb223a1544 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Acquiring lock "6fe524ec-5fb2-4399-bc41-5898413ff9d4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:43:17 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-4f0ed8bf-1c6f-47e4-a09f-38bb223a1544 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Lock "6fe524ec-5fb2-4399-bc41-5898413ff9d4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:43:17 user nova-compute[74960]: DEBUG nova.compute.manager [None req-4f0ed8bf-1c6f-47e4-a09f-38bb223a1544 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] [instance: 6fe524ec-5fb2-4399-bc41-5898413ff9d4] Starting instance... {{(pid=74960) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 12:43:18 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-4f0ed8bf-1c6f-47e4-a09f-38bb223a1544 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:43:18 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-4f0ed8bf-1c6f-47e4-a09f-38bb223a1544 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:43:18 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-4f0ed8bf-1c6f-47e4-a09f-38bb223a1544 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74960) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 12:43:18 user nova-compute[74960]: INFO nova.compute.claims [None req-4f0ed8bf-1c6f-47e4-a09f-38bb223a1544 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] [instance: 6fe524ec-5fb2-4399-bc41-5898413ff9d4] Claim successful on node user
Nov 03 12:43:18 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-4f0ed8bf-1c6f-47e4-a09f-38bb223a1544 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:43:18 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-4f0ed8bf-1c6f-47e4-a09f-38bb223a1544 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:43:18 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-4f0ed8bf-1c6f-47e4-a09f-38bb223a1544 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.464s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:43:18 user nova-compute[74960]: DEBUG nova.compute.manager [None req-4f0ed8bf-1c6f-47e4-a09f-38bb223a1544 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] [instance: 6fe524ec-5fb2-4399-bc41-5898413ff9d4] Start building networks asynchronously for instance. {{(pid=74960) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 12:43:18 user nova-compute[74960]: DEBUG nova.compute.manager [None req-4f0ed8bf-1c6f-47e4-a09f-38bb223a1544 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] [instance: 6fe524ec-5fb2-4399-bc41-5898413ff9d4] Allocating IP information in the background. {{(pid=74960) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 12:43:18 user nova-compute[74960]: DEBUG nova.network.neutron [None req-4f0ed8bf-1c6f-47e4-a09f-38bb223a1544 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] [instance: 6fe524ec-5fb2-4399-bc41-5898413ff9d4] allocate_for_instance() {{(pid=74960) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 12:43:18 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-4f0ed8bf-1c6f-47e4-a09f-38bb223a1544 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] [instance: 6fe524ec-5fb2-4399-bc41-5898413ff9d4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 12:43:18 user nova-compute[74960]: DEBUG nova.compute.manager [None req-4f0ed8bf-1c6f-47e4-a09f-38bb223a1544 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] [instance: 6fe524ec-5fb2-4399-bc41-5898413ff9d4] Start building block device mappings for instance. {{(pid=74960) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 12:43:18 user nova-compute[74960]: DEBUG nova.policy [None req-4f0ed8bf-1c6f-47e4-a09f-38bb223a1544 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '946ef9f0f5d04f43bc8c248de57d6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8ca5bb565b48648e39e6c128f54a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74960) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 12:43:18 user nova-compute[74960]: DEBUG nova.compute.manager [None req-4f0ed8bf-1c6f-47e4-a09f-38bb223a1544 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] [instance: 6fe524ec-5fb2-4399-bc41-5898413ff9d4] Start spawning the instance on the hypervisor. {{(pid=74960) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 12:43:18 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-4f0ed8bf-1c6f-47e4-a09f-38bb223a1544 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] [instance: 6fe524ec-5fb2-4399-bc41-5898413ff9d4] Creating instance directory {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 12:43:18 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-4f0ed8bf-1c6f-47e4-a09f-38bb223a1544 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] [instance: 6fe524ec-5fb2-4399-bc41-5898413ff9d4] Creating image(s)
Nov 03 12:43:18 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-4f0ed8bf-1c6f-47e4-a09f-38bb223a1544 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Acquiring lock "/opt/stack/data/nova/instances/6fe524ec-5fb2-4399-bc41-5898413ff9d4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:43:18 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-4f0ed8bf-1c6f-47e4-a09f-38bb223a1544 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Lock "/opt/stack/data/nova/instances/6fe524ec-5fb2-4399-bc41-5898413ff9d4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:43:18 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-4f0ed8bf-1c6f-47e4-a09f-38bb223a1544 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Lock "/opt/stack/data/nova/instances/6fe524ec-5fb2-4399-bc41-5898413ff9d4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:43:18 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-4f0ed8bf-1c6f-47e4-a09f-38bb223a1544 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Acquiring lock "c57948025419588ca82f919dadb057e60fc123d9" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:43:18 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-4f0ed8bf-1c6f-47e4-a09f-38bb223a1544 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Lock "c57948025419588ca82f919dadb057e60fc123d9" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:43:20 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-4f0ed8bf-1c6f-47e4-a09f-38bb223a1544 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c57948025419588ca82f919dadb057e60fc123d9.part --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:43:20 user nova-compute[74960]: DEBUG nova.network.neutron [None req-4f0ed8bf-1c6f-47e4-a09f-38bb223a1544 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] [instance: 6fe524ec-5fb2-4399-bc41-5898413ff9d4] Successfully created port: 348e9fcf-472e-432b-b7f5-a706b7f5c4e2 {{(pid=74960) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 12:43:20 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-4f0ed8bf-1c6f-47e4-a09f-38bb223a1544 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c57948025419588ca82f919dadb057e60fc123d9.part --force-share --output=json" returned: 0 in 0.198s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:43:20 user nova-compute[74960]: DEBUG nova.virt.images [None req-4f0ed8bf-1c6f-47e4-a09f-38bb223a1544 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] d0a4a243-c0c8-4512-a9e4-c72c43357702 was qcow2, converting to raw {{(pid=74960) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 03 12:43:20 user nova-compute[74960]: DEBUG nova.privsep.utils [None req-4f0ed8bf-1c6f-47e4-a09f-38bb223a1544 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74960) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 03 12:43:20 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-4f0ed8bf-1c6f-47e4-a09f-38bb223a1544 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c57948025419588ca82f919dadb057e60fc123d9.part /opt/stack/data/nova/instances/_base/c57948025419588ca82f919dadb057e60fc123d9.converted {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:43:20 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-4f0ed8bf-1c6f-47e4-a09f-38bb223a1544 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c57948025419588ca82f919dadb057e60fc123d9.part /opt/stack/data/nova/instances/_base/c57948025419588ca82f919dadb057e60fc123d9.converted" returned: 0 in 0.244s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:43:20 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-4f0ed8bf-1c6f-47e4-a09f-38bb223a1544 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c57948025419588ca82f919dadb057e60fc123d9.converted --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:43:20 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-4f0ed8bf-1c6f-47e4-a09f-38bb223a1544 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c57948025419588ca82f919dadb057e60fc123d9.converted --force-share --output=json" returned: 0 in 0.216s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:43:20 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-4f0ed8bf-1c6f-47e4-a09f-38bb223a1544 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Lock "c57948025419588ca82f919dadb057e60fc123d9" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.934s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:43:20 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-4f0ed8bf-1c6f-47e4-a09f-38bb223a1544 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c57948025419588ca82f919dadb057e60fc123d9 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:43:20 user nova-compute[74960]: DEBUG nova.network.neutron [None req-4f0ed8bf-1c6f-47e4-a09f-38bb223a1544 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] [instance: 6fe524ec-5fb2-4399-bc41-5898413ff9d4] Successfully updated port: 348e9fcf-472e-432b-b7f5-a706b7f5c4e2 {{(pid=74960) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 12:43:20 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-4f0ed8bf-1c6f-47e4-a09f-38bb223a1544 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Acquiring lock "refresh_cache-6fe524ec-5fb2-4399-bc41-5898413ff9d4" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:43:20 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-4f0ed8bf-1c6f-47e4-a09f-38bb223a1544 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Acquired lock "refresh_cache-6fe524ec-5fb2-4399-bc41-5898413ff9d4" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:43:20 user nova-compute[74960]: DEBUG nova.network.neutron [None req-4f0ed8bf-1c6f-47e4-a09f-38bb223a1544 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] [instance: 6fe524ec-5fb2-4399-bc41-5898413ff9d4] Building network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 12:43:20 user nova-compute[74960]: DEBUG nova.compute.manager [req-3dfc2c39-5609-4bf9-b7b1-f014c6af509f req-18a77521-3dd7-47f6-b97f-9fcf6d31fb60 service nova] [instance: 6fe524ec-5fb2-4399-bc41-5898413ff9d4] Received event network-changed-348e9fcf-472e-432b-b7f5-a706b7f5c4e2 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:43:20 user nova-compute[74960]: DEBUG nova.compute.manager [req-3dfc2c39-5609-4bf9-b7b1-f014c6af509f req-18a77521-3dd7-47f6-b97f-9fcf6d31fb60 service nova] [instance: 6fe524ec-5fb2-4399-bc41-5898413ff9d4] Refreshing instance network info cache due to event network-changed-348e9fcf-472e-432b-b7f5-a706b7f5c4e2. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 12:43:20 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-3dfc2c39-5609-4bf9-b7b1-f014c6af509f req-18a77521-3dd7-47f6-b97f-9fcf6d31fb60 service nova] Acquiring lock "refresh_cache-6fe524ec-5fb2-4399-bc41-5898413ff9d4" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:43:20 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-4f0ed8bf-1c6f-47e4-a09f-38bb223a1544 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c57948025419588ca82f919dadb057e60fc123d9 --force-share --output=json" returned: 0 in 0.197s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:43:20 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-4f0ed8bf-1c6f-47e4-a09f-38bb223a1544 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Acquiring lock "c57948025419588ca82f919dadb057e60fc123d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:43:20 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-4f0ed8bf-1c6f-47e4-a09f-38bb223a1544 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Lock "c57948025419588ca82f919dadb057e60fc123d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:43:20 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-4f0ed8bf-1c6f-47e4-a09f-38bb223a1544 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c57948025419588ca82f919dadb057e60fc123d9 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:43:21 user nova-compute[74960]: DEBUG nova.network.neutron [None req-4f0ed8bf-1c6f-47e4-a09f-38bb223a1544 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] [instance: 6fe524ec-5fb2-4399-bc41-5898413ff9d4] Instance cache missing network info. {{(pid=74960) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 12:43:21 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-4f0ed8bf-1c6f-47e4-a09f-38bb223a1544 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c57948025419588ca82f919dadb057e60fc123d9 --force-share --output=json" returned: 0 in 0.213s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:43:21 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-4f0ed8bf-1c6f-47e4-a09f-38bb223a1544 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c57948025419588ca82f919dadb057e60fc123d9,backing_fmt=raw /opt/stack/data/nova/instances/6fe524ec-5fb2-4399-bc41-5898413ff9d4/disk 1073741824 {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:43:21 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-4f0ed8bf-1c6f-47e4-a09f-38bb223a1544 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c57948025419588ca82f919dadb057e60fc123d9,backing_fmt=raw /opt/stack/data/nova/instances/6fe524ec-5fb2-4399-bc41-5898413ff9d4/disk 1073741824" returned: 0 in 0.084s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:43:21 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-4f0ed8bf-1c6f-47e4-a09f-38bb223a1544 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Lock "c57948025419588ca82f919dadb057e60fc123d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.303s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:43:21 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-4f0ed8bf-1c6f-47e4-a09f-38bb223a1544 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c57948025419588ca82f919dadb057e60fc123d9 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:43:21 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:43:21 user nova-compute[74960]: DEBUG nova.network.neutron [None req-4f0ed8bf-1c6f-47e4-a09f-38bb223a1544 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] [instance: 6fe524ec-5fb2-4399-bc41-5898413ff9d4] Updating instance_info_cache with network_info: [{"id": "348e9fcf-472e-432b-b7f5-a706b7f5c4e2", "address": "fa:16:3e:2d:7c:be", "network": {"id": "6c29b2f1-0c30-45d5-ade3-f792d5af7037", "bridge": "br-int", "label": "tempest-TestStampPattern-1770578791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df8ca5bb565b48648e39e6c128f54a57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap348e9fcf-47", "ovs_interfaceid": "348e9fcf-472e-432b-b7f5-a706b7f5c4e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:43:21 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-4f0ed8bf-1c6f-47e4-a09f-38bb223a1544 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Releasing lock "refresh_cache-6fe524ec-5fb2-4399-bc41-5898413ff9d4" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:43:21 user nova-compute[74960]: DEBUG nova.compute.manager [None req-4f0ed8bf-1c6f-47e4-a09f-38bb223a1544 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] [instance: 6fe524ec-5fb2-4399-bc41-5898413ff9d4] Instance network_info: |[{"id": "348e9fcf-472e-432b-b7f5-a706b7f5c4e2", "address": "fa:16:3e:2d:7c:be", "network": {"id": "6c29b2f1-0c30-45d5-ade3-f792d5af7037", "bridge": "br-int", "label": "tempest-TestStampPattern-1770578791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df8ca5bb565b48648e39e6c128f54a57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap348e9fcf-47", "ovs_interfaceid": "348e9fcf-472e-432b-b7f5-a706b7f5c4e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74960) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 12:43:21 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-3dfc2c39-5609-4bf9-b7b1-f014c6af509f req-18a77521-3dd7-47f6-b97f-9fcf6d31fb60 service nova] Acquired lock "refresh_cache-6fe524ec-5fb2-4399-bc41-5898413ff9d4" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:43:21 user nova-compute[74960]: DEBUG nova.network.neutron [req-3dfc2c39-5609-4bf9-b7b1-f014c6af509f req-18a77521-3dd7-47f6-b97f-9fcf6d31fb60 service nova] [instance: 6fe524ec-5fb2-4399-bc41-5898413ff9d4] Refreshing network info cache for port 348e9fcf-472e-432b-b7f5-a706b7f5c4e2 {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 12:43:21 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-4f0ed8bf-1c6f-47e4-a09f-38bb223a1544 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c57948025419588ca82f919dadb057e60fc123d9 --force-share --output=json" returned: 0 in 0.195s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:43:21 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-4f0ed8bf-1c6f-47e4-a09f-38bb223a1544 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] [instance: 6fe524ec-5fb2-4399-bc41-5898413ff9d4] Created local disks {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 12:43:21 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-4f0ed8bf-1c6f-47e4-a09f-38bb223a1544 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] [instance: 6fe524ec-5fb2-4399-bc41-5898413ff9d4] Ensure instance console log exists: /opt/stack/data/nova/instances/6fe524ec-5fb2-4399-bc41-5898413ff9d4/console.log {{(pid=74960) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 12:43:21 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-4f0ed8bf-1c6f-47e4-a09f-38bb223a1544 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:43:21 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-4f0ed8bf-1c6f-47e4-a09f-38bb223a1544 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:43:21 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-4f0ed8bf-1c6f-47e4-a09f-38bb223a1544 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:43:21 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-4f0ed8bf-1c6f-47e4-a09f-38bb223a1544 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] [instance: 6fe524ec-5fb2-4399-bc41-5898413ff9d4] Start _get_guest_xml network_info=[{"id": "348e9fcf-472e-432b-b7f5-a706b7f5c4e2", "address": "fa:16:3e:2d:7c:be", "network": {"id": "6c29b2f1-0c30-45d5-ade3-f792d5af7037", "bridge": "br-int", "label": "tempest-TestStampPattern-1770578791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df8ca5bb565b48648e39e6c128f54a57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap348e9fcf-47", "ovs_interfaceid": "348e9fcf-472e-432b-b7f5-a706b7f5c4e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='8c49f772a1c1b0fa44adba911f5f26bc',container_format='bare',created_at=2023-11-03T12:43:09Z,direct_url=<?>,disk_format='qcow2',id=d0a4a243-c0c8-4512-a9e4-c72c43357702,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-368759661',owner='df8ca5bb565b48648e39e6c128f54a57',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-03T12:43:15Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'image_id': 'd0a4a243-c0c8-4512-a9e4-c72c43357702'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 12:43:21 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-4f0ed8bf-1c6f-47e4-a09f-38bb223a1544 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:43:21 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-4f0ed8bf-1c6f-47e4-a09f-38bb223a1544 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:43:21 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-4f0ed8bf-1c6f-47e4-a09f-38bb223a1544 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 12:43:21 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-4f0ed8bf-1c6f-47e4-a09f-38bb223a1544 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] CPU controller missing on host. {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 12:43:21 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-4f0ed8bf-1c6f-47e4-a09f-38bb223a1544 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 12:43:21 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-4f0ed8bf-1c6f-47e4-a09f-38bb223a1544 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] CPU controller found on host. {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 12:43:21 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-4f0ed8bf-1c6f-47e4-a09f-38bb223a1544 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74960) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 12:43:21 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-4f0ed8bf-1c6f-47e4-a09f-38bb223a1544 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='8c49f772a1c1b0fa44adba911f5f26bc',container_format='bare',created_at=2023-11-03T12:43:09Z,direct_url=<?>,disk_format='qcow2',id=d0a4a243-c0c8-4512-a9e4-c72c43357702,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-368759661',owner='df8ca5bb565b48648e39e6c128f54a57',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-03T12:43:15Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 12:43:21 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-4f0ed8bf-1c6f-47e4-a09f-38bb223a1544 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Flavor limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 12:43:21 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-4f0ed8bf-1c6f-47e4-a09f-38bb223a1544 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Image limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 12:43:21 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-4f0ed8bf-1c6f-47e4-a09f-38bb223a1544 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Flavor pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 12:43:21 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-4f0ed8bf-1c6f-47e4-a09f-38bb223a1544 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Image pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 12:43:21 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-4f0ed8bf-1c6f-47e4-a09f-38bb223a1544 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 12:43:21 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-4f0ed8bf-1c6f-47e4-a09f-38bb223a1544 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 12:43:21 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-4f0ed8bf-1c6f-47e4-a09f-38bb223a1544 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 12:43:21 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-4f0ed8bf-1c6f-47e4-a09f-38bb223a1544 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Got 1 possible topologies {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 12:43:21 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-4f0ed8bf-1c6f-47e4-a09f-38bb223a1544 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 12:43:21 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-4f0ed8bf-1c6f-47e4-a09f-38bb223a1544 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 12:43:21 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-4f0ed8bf-1c6f-47e4-a09f-38bb223a1544 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:43:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-751503575',display_name='tempest-TestStampPattern-server-751503575',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-751503575',id=42,image_ref='d0a4a243-c0c8-4512-a9e4-c72c43357702',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOVJGiA8+WxYV0H4D5A8tW82c36Y66O0cQc4FMiKT0kp3U+xT9R3wjcl8Y9oz6PsAiIG74/EBNibsdR8g5KJgAe/YXLGMoJSdUpoQNRjhz9zQdfyFtfcNImepV7xlRbyrw==',key_name='tempest-TestStampPattern-2145016267',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df8ca5bb565b48648e39e6c128f54a57',ramdisk_id='',reservation_id='r-3r53fnq2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='60658b54-5e34-4a2b-be14-124e47e291c2',image_min_disk='1',image_min_ram='0',image_owner_id='df8ca5bb565b48648e39e6c128f54a57',image_owner_project_name='tempest-TestStampPattern-1528534742',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1528534742-project-member',image_user_id='946ef9f0f5d04f43bc8c248de57d6566',network_allocated='True',owner_project_name='tempest-TestStampPattern-1528534742',owner_user_name='tempest-TestStampPattern-1528534742-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:43:19Z,user_data=None,user_id='946ef9f0f5d04f43bc8c248de57d6566',uuid=6fe524ec-5fb2-4399-bc41-5898413ff9d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "348e9fcf-472e-432b-b7f5-a706b7f5c4e2", "address": "fa:16:3e:2d:7c:be", "network": {"id": "6c29b2f1-0c30-45d5-ade3-f792d5af7037", "bridge": "br-int", "label": "tempest-TestStampPattern-1770578791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df8ca5bb565b48648e39e6c128f54a57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap348e9fcf-47", "ovs_interfaceid": "348e9fcf-472e-432b-b7f5-a706b7f5c4e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74960) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 12:43:21 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-4f0ed8bf-1c6f-47e4-a09f-38bb223a1544 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Converting VIF {"id": "348e9fcf-472e-432b-b7f5-a706b7f5c4e2", "address": "fa:16:3e:2d:7c:be", "network": {"id": "6c29b2f1-0c30-45d5-ade3-f792d5af7037", "bridge": "br-int", "label": "tempest-TestStampPattern-1770578791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df8ca5bb565b48648e39e6c128f54a57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap348e9fcf-47", "ovs_interfaceid": "348e9fcf-472e-432b-b7f5-a706b7f5c4e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:43:21 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-4f0ed8bf-1c6f-47e4-a09f-38bb223a1544 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:7c:be,bridge_name='br-int',has_traffic_filtering=True,id=348e9fcf-472e-432b-b7f5-a706b7f5c4e2,network=Network(6c29b2f1-0c30-45d5-ade3-f792d5af7037),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap348e9fcf-47') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:43:21 user nova-compute[74960]: DEBUG nova.objects.instance [None req-4f0ed8bf-1c6f-47e4-a09f-38bb223a1544 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Lazy-loading 'pci_devices' on Instance uuid 6fe524ec-5fb2-4399-bc41-5898413ff9d4 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:43:21 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-4f0ed8bf-1c6f-47e4-a09f-38bb223a1544 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] [instance: 6fe524ec-5fb2-4399-bc41-5898413ff9d4] End _get_guest_xml xml=<domain type="kvm">
Nov 03 12:43:21 user nova-compute[74960]:   <uuid>6fe524ec-5fb2-4399-bc41-5898413ff9d4</uuid>
Nov 03 12:43:21 user nova-compute[74960]:   <name>instance-0000002a</name>
Nov 03 12:43:21 user nova-compute[74960]:   <memory>524288</memory>
Nov 03 12:43:21 user nova-compute[74960]:   <vcpu>1</vcpu>
Nov 03 12:43:21 user nova-compute[74960]:   <metadata>
Nov 03 12:43:21 user nova-compute[74960]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 12:43:21 user nova-compute[74960]:       <nova:package version="0.0.0"/>
Nov 03 12:43:21 user nova-compute[74960]:       <nova:name>tempest-TestStampPattern-server-751503575</nova:name>
Nov 03 12:43:21 user nova-compute[74960]:       <nova:creationTime>2023-11-03 12:43:21</nova:creationTime>
Nov 03 12:43:21 user nova-compute[74960]:       <nova:flavor name="m1.tiny">
Nov 03 12:43:21 user nova-compute[74960]:         <nova:memory>512</nova:memory>
Nov 03 12:43:21 user nova-compute[74960]:         <nova:disk>1</nova:disk>
Nov 03 12:43:21 user nova-compute[74960]:         <nova:swap>0</nova:swap>
Nov 03 12:43:21 user nova-compute[74960]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 12:43:21 user nova-compute[74960]:         <nova:vcpus>1</nova:vcpus>
Nov 03 12:43:21 user nova-compute[74960]:       </nova:flavor>
Nov 03 12:43:21 user nova-compute[74960]:       <nova:owner>
Nov 03 12:43:21 user nova-compute[74960]:         <nova:user uuid="946ef9f0f5d04f43bc8c248de57d6566">tempest-TestStampPattern-1528534742-project-member</nova:user>
Nov 03 12:43:21 user nova-compute[74960]:         <nova:project uuid="df8ca5bb565b48648e39e6c128f54a57">tempest-TestStampPattern-1528534742</nova:project>
Nov 03 12:43:21 user nova-compute[74960]:       </nova:owner>
Nov 03 12:43:21 user nova-compute[74960]:       <nova:root type="image" uuid="d0a4a243-c0c8-4512-a9e4-c72c43357702"/>
Nov 03 12:43:21 user nova-compute[74960]:       <nova:ports>
Nov 03 12:43:21 user nova-compute[74960]:         <nova:port uuid="348e9fcf-472e-432b-b7f5-a706b7f5c4e2">
Nov 03 12:43:21 user nova-compute[74960]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 03 12:43:21 user nova-compute[74960]:         </nova:port>
Nov 03 12:43:21 user nova-compute[74960]:       </nova:ports>
Nov 03 12:43:21 user nova-compute[74960]:     </nova:instance>
Nov 03 12:43:21 user nova-compute[74960]:   </metadata>
Nov 03 12:43:21 user nova-compute[74960]:   <sysinfo type="smbios">
Nov 03 12:43:21 user nova-compute[74960]:     <system>
Nov 03 12:43:21 user nova-compute[74960]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 12:43:21 user nova-compute[74960]:       <entry name="product">OpenStack Nova</entry>
Nov 03 12:43:21 user nova-compute[74960]:       <entry name="version">0.0.0</entry>
Nov 03 12:43:21 user nova-compute[74960]:       <entry name="serial">6fe524ec-5fb2-4399-bc41-5898413ff9d4</entry>
Nov 03 12:43:21 user nova-compute[74960]:       <entry name="uuid">6fe524ec-5fb2-4399-bc41-5898413ff9d4</entry>
Nov 03 12:43:21 user nova-compute[74960]:       <entry name="family">Virtual Machine</entry>
Nov 03 12:43:21 user nova-compute[74960]:     </system>
Nov 03 12:43:21 user nova-compute[74960]:   </sysinfo>
Nov 03 12:43:21 user nova-compute[74960]:   <os>
Nov 03 12:43:21 user nova-compute[74960]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 12:43:21 user nova-compute[74960]:     <boot dev="hd"/>
Nov 03 12:43:21 user nova-compute[74960]:     <smbios mode="sysinfo"/>
Nov 03 12:43:21 user nova-compute[74960]:   </os>
Nov 03 12:43:21 user nova-compute[74960]:   <features>
Nov 03 12:43:21 user nova-compute[74960]:     <acpi/>
Nov 03 12:43:21 user nova-compute[74960]:     <apic/>
Nov 03 12:43:21 user nova-compute[74960]:     <vmcoreinfo/>
Nov 03 12:43:21 user nova-compute[74960]:   </features>
Nov 03 12:43:21 user nova-compute[74960]:   <clock offset="utc">
Nov 03 12:43:21 user nova-compute[74960]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 12:43:21 user nova-compute[74960]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 12:43:21 user nova-compute[74960]:     <timer name="hpet" present="no"/>
Nov 03 12:43:21 user nova-compute[74960]:   </clock>
Nov 03 12:43:21 user nova-compute[74960]:   <cpu mode="custom" match="exact">
Nov 03 12:43:21 user nova-compute[74960]:     <model>Nehalem</model>
Nov 03 12:43:21 user nova-compute[74960]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 12:43:21 user nova-compute[74960]:   </cpu>
Nov 03 12:43:21 user nova-compute[74960]:   <devices>
Nov 03 12:43:21 user nova-compute[74960]:     <disk type="file" device="disk">
Nov 03 12:43:21 user nova-compute[74960]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 12:43:21 user nova-compute[74960]:       <source file="/opt/stack/data/nova/instances/6fe524ec-5fb2-4399-bc41-5898413ff9d4/disk"/>
Nov 03 12:43:21 user nova-compute[74960]:       <target dev="vda" bus="virtio"/>
Nov 03 12:43:21 user nova-compute[74960]:     </disk>
Nov 03 12:43:21 user nova-compute[74960]:     <interface type="ethernet">
Nov 03 12:43:21 user nova-compute[74960]:       <mac address="fa:16:3e:2d:7c:be"/>
Nov 03 12:43:21 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:43:21 user nova-compute[74960]:       <mtu size="1442"/>
Nov 03 12:43:21 user nova-compute[74960]:       <target dev="tap348e9fcf-47"/>
Nov 03 12:43:21 user nova-compute[74960]:     </interface>
Nov 03 12:43:21 user nova-compute[74960]:     <serial type="pty">
Nov 03 12:43:21 user nova-compute[74960]:       <log file="/opt/stack/data/nova/instances/6fe524ec-5fb2-4399-bc41-5898413ff9d4/console.log" append="off"/>
Nov 03 12:43:21 user nova-compute[74960]:     </serial>
Nov 03 12:43:21 user nova-compute[74960]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 12:43:21 user nova-compute[74960]:     <video>
Nov 03 12:43:21 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:43:21 user nova-compute[74960]:     </video>
Nov 03 12:43:21 user nova-compute[74960]:     <rng model="virtio">
Nov 03 12:43:21 user nova-compute[74960]:       <backend model="random">/dev/urandom</backend>
Nov 03 12:43:21 user nova-compute[74960]:     </rng>
Nov 03 12:43:21 user nova-compute[74960]:     <controller type="usb" index="0" model="none"/>
Nov 03 12:43:21 user nova-compute[74960]:     <memballoon model="virtio">
Nov 03 12:43:21 user nova-compute[74960]:       <stats period="10"/>
Nov 03 12:43:21 user nova-compute[74960]:     </memballoon>
Nov 03 12:43:21 user nova-compute[74960]:   </devices>
Nov 03 12:43:21 user nova-compute[74960]: </domain>
Nov 03 12:43:21 user nova-compute[74960]:  {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 12:43:21 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-4f0ed8bf-1c6f-47e4-a09f-38bb223a1544 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:43:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-751503575',display_name='tempest-TestStampPattern-server-751503575',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-751503575',id=42,image_ref='d0a4a243-c0c8-4512-a9e4-c72c43357702',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOVJGiA8+WxYV0H4D5A8tW82c36Y66O0cQc4FMiKT0kp3U+xT9R3wjcl8Y9oz6PsAiIG74/EBNibsdR8g5KJgAe/YXLGMoJSdUpoQNRjhz9zQdfyFtfcNImepV7xlRbyrw==',key_name='tempest-TestStampPattern-2145016267',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df8ca5bb565b48648e39e6c128f54a57',ramdisk_id='',reservation_id='r-3r53fnq2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='60658b54-5e34-4a2b-be14-124e47e291c2',image_min_disk='1',image_min_ram='0',image_owner_id='df8ca5bb565b48648e39e6c128f54a57',image_owner_project_name='tempest-TestStampPattern-1528534742',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1528534742-project-member',image_user_id='946ef9f0f5d04f43bc8c248de57d6566',network_allocated='True',owner_project_name='tempest-TestStampPattern-1528534742',owner_user_name='tempest-TestStampPattern-1528534742-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:43:19Z,user_data=None,user_id='946ef9f0f5d04f43bc8c248de57d6566',uuid=6fe524ec-5fb2-4399-bc41-5898413ff9d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "348e9fcf-472e-432b-b7f5-a706b7f5c4e2", "address": "fa:16:3e:2d:7c:be", "network": {"id": "6c29b2f1-0c30-45d5-ade3-f792d5af7037", "bridge": "br-int", "label": "tempest-TestStampPattern-1770578791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df8ca5bb565b48648e39e6c128f54a57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap348e9fcf-47", "ovs_interfaceid": "348e9fcf-472e-432b-b7f5-a706b7f5c4e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 12:43:21 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-4f0ed8bf-1c6f-47e4-a09f-38bb223a1544 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Converting VIF {"id": "348e9fcf-472e-432b-b7f5-a706b7f5c4e2", "address": "fa:16:3e:2d:7c:be", "network": {"id": "6c29b2f1-0c30-45d5-ade3-f792d5af7037", "bridge": "br-int", "label": "tempest-TestStampPattern-1770578791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df8ca5bb565b48648e39e6c128f54a57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap348e9fcf-47", "ovs_interfaceid": "348e9fcf-472e-432b-b7f5-a706b7f5c4e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:43:21 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-4f0ed8bf-1c6f-47e4-a09f-38bb223a1544 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:7c:be,bridge_name='br-int',has_traffic_filtering=True,id=348e9fcf-472e-432b-b7f5-a706b7f5c4e2,network=Network(6c29b2f1-0c30-45d5-ade3-f792d5af7037),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap348e9fcf-47') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:43:21 user nova-compute[74960]: DEBUG os_vif [None req-4f0ed8bf-1c6f-47e4-a09f-38bb223a1544 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:7c:be,bridge_name='br-int',has_traffic_filtering=True,id=348e9fcf-472e-432b-b7f5-a706b7f5c4e2,network=Network(6c29b2f1-0c30-45d5-ade3-f792d5af7037),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap348e9fcf-47') {{(pid=74960) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 12:43:21 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:43:21 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:43:21 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 12:43:21 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:43:21 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e67944bf-a885-58c9-9ee3-acb344d41361', '_type': 'linux-noop'}}, row=False) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:43:21 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:43:21 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:43:21 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:43:21 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap348e9fcf-47, may_exist=True, interface_attrs={}) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:43:21 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap348e9fcf-47, col_values=(('qos', UUID('c2a490a8-bf5a-40f6-af92-cf9d3feca448')),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:43:21 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap348e9fcf-47, col_values=(('external_ids', {'iface-id': '348e9fcf-472e-432b-b7f5-a706b7f5c4e2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2d:7c:be', 'vm-uuid': '6fe524ec-5fb2-4399-bc41-5898413ff9d4'}),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:43:21 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:43:21 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:43:21 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:43:21 user nova-compute[74960]: INFO os_vif [None req-4f0ed8bf-1c6f-47e4-a09f-38bb223a1544 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:7c:be,bridge_name='br-int',has_traffic_filtering=True,id=348e9fcf-472e-432b-b7f5-a706b7f5c4e2,network=Network(6c29b2f1-0c30-45d5-ade3-f792d5af7037),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap348e9fcf-47')
Nov 03 12:43:21 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-4f0ed8bf-1c6f-47e4-a09f-38bb223a1544 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] No BDM found with device name vda, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:43:21 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-4f0ed8bf-1c6f-47e4-a09f-38bb223a1544 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] No VIF found with MAC fa:16:3e:2d:7c:be, not building metadata {{(pid=74960) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 12:43:21 user nova-compute[74960]: DEBUG nova.network.neutron [req-3dfc2c39-5609-4bf9-b7b1-f014c6af509f req-18a77521-3dd7-47f6-b97f-9fcf6d31fb60 service nova] [instance: 6fe524ec-5fb2-4399-bc41-5898413ff9d4] Updated VIF entry in instance network info cache for port 348e9fcf-472e-432b-b7f5-a706b7f5c4e2. {{(pid=74960) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 12:43:21 user nova-compute[74960]: DEBUG nova.network.neutron [req-3dfc2c39-5609-4bf9-b7b1-f014c6af509f req-18a77521-3dd7-47f6-b97f-9fcf6d31fb60 service nova] [instance: 6fe524ec-5fb2-4399-bc41-5898413ff9d4] Updating instance_info_cache with network_info: [{"id": "348e9fcf-472e-432b-b7f5-a706b7f5c4e2", "address": "fa:16:3e:2d:7c:be", "network": {"id": "6c29b2f1-0c30-45d5-ade3-f792d5af7037", "bridge": "br-int", "label": "tempest-TestStampPattern-1770578791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df8ca5bb565b48648e39e6c128f54a57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap348e9fcf-47", "ovs_interfaceid": "348e9fcf-472e-432b-b7f5-a706b7f5c4e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:43:21 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-3dfc2c39-5609-4bf9-b7b1-f014c6af509f req-18a77521-3dd7-47f6-b97f-9fcf6d31fb60 service nova] Releasing lock "refresh_cache-6fe524ec-5fb2-4399-bc41-5898413ff9d4" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:43:22 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:43:22 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Cleaning up deleted instances with incomplete migration  {{(pid=74960) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 03 12:43:23 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:43:23 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:43:23 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:43:23 user nova-compute[74960]: DEBUG nova.compute.manager [req-cf826c0c-68fa-4be5-8c75-b5d9ce46be24 req-15eb118a-1723-4052-b7b5-e4245a68464f service nova] [instance: 6fe524ec-5fb2-4399-bc41-5898413ff9d4] Received event network-vif-plugged-348e9fcf-472e-432b-b7f5-a706b7f5c4e2 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:43:23 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-cf826c0c-68fa-4be5-8c75-b5d9ce46be24 req-15eb118a-1723-4052-b7b5-e4245a68464f service nova] Acquiring lock "6fe524ec-5fb2-4399-bc41-5898413ff9d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:43:23 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-cf826c0c-68fa-4be5-8c75-b5d9ce46be24 req-15eb118a-1723-4052-b7b5-e4245a68464f service nova] Lock "6fe524ec-5fb2-4399-bc41-5898413ff9d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:43:23 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-cf826c0c-68fa-4be5-8c75-b5d9ce46be24 req-15eb118a-1723-4052-b7b5-e4245a68464f service nova] Lock "6fe524ec-5fb2-4399-bc41-5898413ff9d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:43:23 user nova-compute[74960]: DEBUG nova.compute.manager [req-cf826c0c-68fa-4be5-8c75-b5d9ce46be24 req-15eb118a-1723-4052-b7b5-e4245a68464f service nova] [instance: 6fe524ec-5fb2-4399-bc41-5898413ff9d4] No waiting events found dispatching network-vif-plugged-348e9fcf-472e-432b-b7f5-a706b7f5c4e2 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:43:23 user nova-compute[74960]: WARNING nova.compute.manager [req-cf826c0c-68fa-4be5-8c75-b5d9ce46be24 req-15eb118a-1723-4052-b7b5-e4245a68464f service nova] [instance: 6fe524ec-5fb2-4399-bc41-5898413ff9d4] Received unexpected event network-vif-plugged-348e9fcf-472e-432b-b7f5-a706b7f5c4e2 for instance with vm_state building and task_state spawning.
Nov 03 12:43:23 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:43:23 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:43:23 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:43:25 user nova-compute[74960]: DEBUG nova.compute.manager [req-ff65e49e-115a-4c6a-8ae0-6c7640eecd0b req-a511f5b7-7e4b-4f22-9130-e60dec092270 service nova] [instance: 6fe524ec-5fb2-4399-bc41-5898413ff9d4] Received event network-vif-plugged-348e9fcf-472e-432b-b7f5-a706b7f5c4e2 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:43:25 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-ff65e49e-115a-4c6a-8ae0-6c7640eecd0b req-a511f5b7-7e4b-4f22-9130-e60dec092270 service nova] Acquiring lock "6fe524ec-5fb2-4399-bc41-5898413ff9d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:43:25 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-ff65e49e-115a-4c6a-8ae0-6c7640eecd0b req-a511f5b7-7e4b-4f22-9130-e60dec092270 service nova] Lock "6fe524ec-5fb2-4399-bc41-5898413ff9d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:43:25 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-ff65e49e-115a-4c6a-8ae0-6c7640eecd0b req-a511f5b7-7e4b-4f22-9130-e60dec092270 service nova] Lock "6fe524ec-5fb2-4399-bc41-5898413ff9d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:43:25 user nova-compute[74960]: DEBUG nova.compute.manager [req-ff65e49e-115a-4c6a-8ae0-6c7640eecd0b req-a511f5b7-7e4b-4f22-9130-e60dec092270 service nova] [instance: 6fe524ec-5fb2-4399-bc41-5898413ff9d4] No waiting events found dispatching network-vif-plugged-348e9fcf-472e-432b-b7f5-a706b7f5c4e2 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:43:25 user nova-compute[74960]: WARNING nova.compute.manager [req-ff65e49e-115a-4c6a-8ae0-6c7640eecd0b req-a511f5b7-7e4b-4f22-9130-e60dec092270 service nova] [instance: 6fe524ec-5fb2-4399-bc41-5898413ff9d4] Received unexpected event network-vif-plugged-348e9fcf-472e-432b-b7f5-a706b7f5c4e2 for instance with vm_state building and task_state spawning.
Nov 03 12:43:25 user nova-compute[74960]: DEBUG nova.compute.manager [None req-4f0ed8bf-1c6f-47e4-a09f-38bb223a1544 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] [instance: 6fe524ec-5fb2-4399-bc41-5898413ff9d4] Instance event wait completed in 0 seconds for  {{(pid=74960) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 12:43:25 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-4f0ed8bf-1c6f-47e4-a09f-38bb223a1544 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] [instance: 6fe524ec-5fb2-4399-bc41-5898413ff9d4] Guest created on hypervisor {{(pid=74960) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 12:43:25 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: 6fe524ec-5fb2-4399-bc41-5898413ff9d4] Instance spawned successfully.
Nov 03 12:43:25 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-4f0ed8bf-1c6f-47e4-a09f-38bb223a1544 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] [instance: 6fe524ec-5fb2-4399-bc41-5898413ff9d4] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 12:43:25 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-4f0ed8bf-1c6f-47e4-a09f-38bb223a1544 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] [instance: 6fe524ec-5fb2-4399-bc41-5898413ff9d4] Found default for hw_input_bus of None {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:43:25 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-4f0ed8bf-1c6f-47e4-a09f-38bb223a1544 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] [instance: 6fe524ec-5fb2-4399-bc41-5898413ff9d4] Found default for hw_pointer_model of None {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:43:25 user nova-compute[74960]: INFO nova.compute.manager [None req-4f0ed8bf-1c6f-47e4-a09f-38bb223a1544 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] [instance: 6fe524ec-5fb2-4399-bc41-5898413ff9d4] Took 6.69 seconds to spawn the instance on the hypervisor.
Nov 03 12:43:25 user nova-compute[74960]: DEBUG nova.compute.manager [None req-4f0ed8bf-1c6f-47e4-a09f-38bb223a1544 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] [instance: 6fe524ec-5fb2-4399-bc41-5898413ff9d4] Checking state {{(pid=74960) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 12:43:25 user nova-compute[74960]: INFO nova.compute.manager [None req-4f0ed8bf-1c6f-47e4-a09f-38bb223a1544 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] [instance: 6fe524ec-5fb2-4399-bc41-5898413ff9d4] Took 7.57 seconds to build instance.
Nov 03 12:43:25 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-4f0ed8bf-1c6f-47e4-a09f-38bb223a1544 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Lock "6fe524ec-5fb2-4399-bc41-5898413ff9d4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.700s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:43:26 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:43:28 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:43:31 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:43:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:43:35 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:43:36 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:43:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:43:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:43:41 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:43:43 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:43:45 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._sync_power_states {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:43:45 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Triggering sync for uuid 87f15f5f-8afa-4d7b-bb45-5887184f9ee5 {{(pid=74960) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 12:43:45 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Triggering sync for uuid a6199681-f85e-4f55-966b-6ab3f17cd640 {{(pid=74960) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 12:43:45 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Triggering sync for uuid 35e02c80-f626-4918-93f1-6b9a7f778c7a {{(pid=74960) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 12:43:45 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Triggering sync for uuid 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67 {{(pid=74960) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 12:43:45 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Triggering sync for uuid b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d {{(pid=74960) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 12:43:45 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Triggering sync for uuid b7606a55-d5c3-4ba8-b499-f3c70813f151 {{(pid=74960) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 12:43:45 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Triggering sync for uuid 60658b54-5e34-4a2b-be14-124e47e291c2 {{(pid=74960) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 12:43:45 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Triggering sync for uuid 3cfe99be-b74b-4fd3-a5d6-a94708992c5b {{(pid=74960) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 12:43:45 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Triggering sync for uuid cce474db-fa6f-4670-9be7-88a3e62caa60 {{(pid=74960) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 12:43:45 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Triggering sync for uuid 6fe524ec-5fb2-4399-bc41-5898413ff9d4 {{(pid=74960) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 12:43:45 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "87f15f5f-8afa-4d7b-bb45-5887184f9ee5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:43:45 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "87f15f5f-8afa-4d7b-bb45-5887184f9ee5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:43:45 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "a6199681-f85e-4f55-966b-6ab3f17cd640" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:43:45 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "a6199681-f85e-4f55-966b-6ab3f17cd640" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:43:45 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "35e02c80-f626-4918-93f1-6b9a7f778c7a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:43:45 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "35e02c80-f626-4918-93f1-6b9a7f778c7a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:43:45 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "47eb8ddf-590f-4ffa-87c8-377cf1ee0f67" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:43:45 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "47eb8ddf-590f-4ffa-87c8-377cf1ee0f67" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:43:45 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:43:45 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:43:45 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "b7606a55-d5c3-4ba8-b499-f3c70813f151" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:43:45 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "b7606a55-d5c3-4ba8-b499-f3c70813f151" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:43:45 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "60658b54-5e34-4a2b-be14-124e47e291c2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:43:45 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "60658b54-5e34-4a2b-be14-124e47e291c2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:43:45 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "3cfe99be-b74b-4fd3-a5d6-a94708992c5b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:43:45 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "3cfe99be-b74b-4fd3-a5d6-a94708992c5b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:43:45 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "cce474db-fa6f-4670-9be7-88a3e62caa60" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:43:45 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "cce474db-fa6f-4670-9be7-88a3e62caa60" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:43:45 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "6fe524ec-5fb2-4399-bc41-5898413ff9d4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:43:45 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "6fe524ec-5fb2-4399-bc41-5898413ff9d4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:43:45 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "87f15f5f-8afa-4d7b-bb45-5887184f9ee5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.040s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:43:45 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "35e02c80-f626-4918-93f1-6b9a7f778c7a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.053s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:43:45 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "a6199681-f85e-4f55-966b-6ab3f17cd640" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.055s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:43:45 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "47eb8ddf-590f-4ffa-87c8-377cf1ee0f67" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.054s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:43:45 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "b7606a55-d5c3-4ba8-b499-f3c70813f151" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.063s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:43:45 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "60658b54-5e34-4a2b-be14-124e47e291c2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.067s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:43:46 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "3cfe99be-b74b-4fd3-a5d6-a94708992c5b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.076s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:43:46 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "cce474db-fa6f-4670-9be7-88a3e62caa60" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.079s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:43:46 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "6fe524ec-5fb2-4399-bc41-5898413ff9d4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.083s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:43:46 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.091s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:43:46 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:43:48 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:43:50 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-8f7fad59-fdd0-440d-95e0-a009929fc88a tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Acquiring lock "b7606a55-d5c3-4ba8-b499-f3c70813f151" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:43:50 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-8f7fad59-fdd0-440d-95e0-a009929fc88a tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Lock "b7606a55-d5c3-4ba8-b499-f3c70813f151" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:43:50 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-8f7fad59-fdd0-440d-95e0-a009929fc88a tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Acquiring lock "b7606a55-d5c3-4ba8-b499-f3c70813f151-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:43:50 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-8f7fad59-fdd0-440d-95e0-a009929fc88a tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Lock "b7606a55-d5c3-4ba8-b499-f3c70813f151-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:43:50 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-8f7fad59-fdd0-440d-95e0-a009929fc88a tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Lock "b7606a55-d5c3-4ba8-b499-f3c70813f151-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:43:50 user nova-compute[74960]: INFO nova.compute.manager [None req-8f7fad59-fdd0-440d-95e0-a009929fc88a tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: b7606a55-d5c3-4ba8-b499-f3c70813f151] Terminating instance
Nov 03 12:43:50 user nova-compute[74960]: DEBUG nova.compute.manager [None req-8f7fad59-fdd0-440d-95e0-a009929fc88a tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: b7606a55-d5c3-4ba8-b499-f3c70813f151] Start destroying the instance on the hypervisor. {{(pid=74960) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 12:43:51 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:43:51 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:43:51 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:43:51 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:43:51 user nova-compute[74960]: DEBUG nova.compute.manager [req-1c05f9df-b0e2-4989-8348-d5e920c78631 req-ea0794c2-b33e-4d67-8578-0d67f5da0e8a service nova] [instance: b7606a55-d5c3-4ba8-b499-f3c70813f151] Received event network-vif-unplugged-1c3fd855-b339-4f79-b36c-8e89b6fcc190 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:43:51 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-1c05f9df-b0e2-4989-8348-d5e920c78631 req-ea0794c2-b33e-4d67-8578-0d67f5da0e8a service nova] Acquiring lock "b7606a55-d5c3-4ba8-b499-f3c70813f151-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:43:51 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-1c05f9df-b0e2-4989-8348-d5e920c78631 req-ea0794c2-b33e-4d67-8578-0d67f5da0e8a service nova] Lock "b7606a55-d5c3-4ba8-b499-f3c70813f151-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:43:51 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-1c05f9df-b0e2-4989-8348-d5e920c78631 req-ea0794c2-b33e-4d67-8578-0d67f5da0e8a service nova] Lock "b7606a55-d5c3-4ba8-b499-f3c70813f151-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:43:51 user nova-compute[74960]: DEBUG nova.compute.manager [req-1c05f9df-b0e2-4989-8348-d5e920c78631 req-ea0794c2-b33e-4d67-8578-0d67f5da0e8a service nova] [instance: b7606a55-d5c3-4ba8-b499-f3c70813f151] No waiting events found dispatching network-vif-unplugged-1c3fd855-b339-4f79-b36c-8e89b6fcc190 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:43:51 user nova-compute[74960]: DEBUG nova.compute.manager [req-1c05f9df-b0e2-4989-8348-d5e920c78631 req-ea0794c2-b33e-4d67-8578-0d67f5da0e8a service nova] [instance: b7606a55-d5c3-4ba8-b499-f3c70813f151] Received event network-vif-unplugged-1c3fd855-b339-4f79-b36c-8e89b6fcc190 for instance with task_state deleting. {{(pid=74960) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 12:43:51 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:43:51 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:43:51 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:43:51 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: b7606a55-d5c3-4ba8-b499-f3c70813f151] Instance destroyed successfully.
Nov 03 12:43:51 user nova-compute[74960]: DEBUG nova.objects.instance [None req-8f7fad59-fdd0-440d-95e0-a009929fc88a tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Lazy-loading 'resources' on Instance uuid b7606a55-d5c3-4ba8-b499-f3c70813f151 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:43:51 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-8f7fad59-fdd0-440d-95e0-a009929fc88a tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:33:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1974704989',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1974704989',id=35,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-03T12:33:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dbc95d68d5e147e1953c855169b17091',ramdisk_id='',reservation_id='r-tqku4ipl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-195954071',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T12:35:35Z,user_data=None,user_id='c473215929044a108c9fc4d6327dfc3d',uuid=b7606a55-d5c3-4ba8-b499-f3c70813f151,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1c3fd855-b339-4f79-b36c-8e89b6fcc190", "address": "fa:16:3e:4c:62:cc", "network": {"id": "dec66832-56d5-4d68-b11f-8e8eed38f045", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-79099436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc95d68d5e147e1953c855169b17091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c3fd855-b3", "ovs_interfaceid": "1c3fd855-b339-4f79-b36c-8e89b6fcc190", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 12:43:51 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-8f7fad59-fdd0-440d-95e0-a009929fc88a tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Converting VIF {"id": "1c3fd855-b339-4f79-b36c-8e89b6fcc190", "address": "fa:16:3e:4c:62:cc", "network": {"id": "dec66832-56d5-4d68-b11f-8e8eed38f045", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-79099436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc95d68d5e147e1953c855169b17091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c3fd855-b3", "ovs_interfaceid": "1c3fd855-b339-4f79-b36c-8e89b6fcc190", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:43:51 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-8f7fad59-fdd0-440d-95e0-a009929fc88a tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4c:62:cc,bridge_name='br-int',has_traffic_filtering=True,id=1c3fd855-b339-4f79-b36c-8e89b6fcc190,network=Network(dec66832-56d5-4d68-b11f-8e8eed38f045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c3fd855-b3') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:43:51 user nova-compute[74960]: DEBUG os_vif [None req-8f7fad59-fdd0-440d-95e0-a009929fc88a tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4c:62:cc,bridge_name='br-int',has_traffic_filtering=True,id=1c3fd855-b339-4f79-b36c-8e89b6fcc190,network=Network(dec66832-56d5-4d68-b11f-8e8eed38f045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c3fd855-b3') {{(pid=74960) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 12:43:51 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:43:51 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1c3fd855-b3, bridge=br-int, if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:43:51 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:43:51 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:43:51 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:43:51 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=506932bb-f289-45bb-a0ca-b9718f2ae049) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:43:51 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:43:51 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:43:51 user nova-compute[74960]: INFO os_vif [None req-8f7fad59-fdd0-440d-95e0-a009929fc88a tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4c:62:cc,bridge_name='br-int',has_traffic_filtering=True,id=1c3fd855-b339-4f79-b36c-8e89b6fcc190,network=Network(dec66832-56d5-4d68-b11f-8e8eed38f045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c3fd855-b3')
Nov 03 12:43:51 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-8f7fad59-fdd0-440d-95e0-a009929fc88a tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: b7606a55-d5c3-4ba8-b499-f3c70813f151] Deleting instance files /opt/stack/data/nova/instances/b7606a55-d5c3-4ba8-b499-f3c70813f151_del
Nov 03 12:43:51 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-8f7fad59-fdd0-440d-95e0-a009929fc88a tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: b7606a55-d5c3-4ba8-b499-f3c70813f151] Deletion of /opt/stack/data/nova/instances/b7606a55-d5c3-4ba8-b499-f3c70813f151_del complete
Nov 03 12:43:51 user nova-compute[74960]: INFO nova.compute.manager [None req-8f7fad59-fdd0-440d-95e0-a009929fc88a tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: b7606a55-d5c3-4ba8-b499-f3c70813f151] Took 0.98 seconds to destroy the instance on the hypervisor.
Nov 03 12:43:51 user nova-compute[74960]: DEBUG oslo.service.loopingcall [None req-8f7fad59-fdd0-440d-95e0-a009929fc88a tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74960) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 12:43:51 user nova-compute[74960]: DEBUG nova.compute.manager [-] [instance: b7606a55-d5c3-4ba8-b499-f3c70813f151] Deallocating network for instance {{(pid=74960) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 12:43:51 user nova-compute[74960]: DEBUG nova.network.neutron [-] [instance: b7606a55-d5c3-4ba8-b499-f3c70813f151] deallocate_for_instance() {{(pid=74960) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 12:43:52 user nova-compute[74960]: DEBUG nova.network.neutron [-] [instance: b7606a55-d5c3-4ba8-b499-f3c70813f151] Updating instance_info_cache with network_info: [] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:43:52 user nova-compute[74960]: INFO nova.compute.manager [-] [instance: b7606a55-d5c3-4ba8-b499-f3c70813f151] Took 0.53 seconds to deallocate network for instance.
Nov 03 12:43:52 user nova-compute[74960]: DEBUG nova.compute.manager [req-86831e91-d640-454f-b822-db1ced606d13 req-925de603-9cde-4632-ae12-c98ff82c96aa service nova] [instance: b7606a55-d5c3-4ba8-b499-f3c70813f151] Received event network-vif-deleted-1c3fd855-b339-4f79-b36c-8e89b6fcc190 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:43:52 user nova-compute[74960]: INFO nova.compute.manager [req-86831e91-d640-454f-b822-db1ced606d13 req-925de603-9cde-4632-ae12-c98ff82c96aa service nova] [instance: b7606a55-d5c3-4ba8-b499-f3c70813f151] Neutron deleted interface 1c3fd855-b339-4f79-b36c-8e89b6fcc190; detaching it from the instance and deleting it from the info cache
Nov 03 12:43:52 user nova-compute[74960]: DEBUG nova.network.neutron [req-86831e91-d640-454f-b822-db1ced606d13 req-925de603-9cde-4632-ae12-c98ff82c96aa service nova] [instance: b7606a55-d5c3-4ba8-b499-f3c70813f151] Updating instance_info_cache with network_info: [] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:43:52 user nova-compute[74960]: DEBUG nova.compute.manager [req-86831e91-d640-454f-b822-db1ced606d13 req-925de603-9cde-4632-ae12-c98ff82c96aa service nova] [instance: b7606a55-d5c3-4ba8-b499-f3c70813f151] Detach interface failed, port_id=1c3fd855-b339-4f79-b36c-8e89b6fcc190, reason: Instance b7606a55-d5c3-4ba8-b499-f3c70813f151 could not be found. {{(pid=74960) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 03 12:43:52 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-8f7fad59-fdd0-440d-95e0-a009929fc88a tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:43:52 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-8f7fad59-fdd0-440d-95e0-a009929fc88a tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:43:52 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-8f7fad59-fdd0-440d-95e0-a009929fc88a tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:43:52 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-8f7fad59-fdd0-440d-95e0-a009929fc88a tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:43:53 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-8f7fad59-fdd0-440d-95e0-a009929fc88a tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.422s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:43:53 user nova-compute[74960]: INFO nova.scheduler.client.report [None req-8f7fad59-fdd0-440d-95e0-a009929fc88a tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Deleted allocations for instance b7606a55-d5c3-4ba8-b499-f3c70813f151
Nov 03 12:43:53 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-8f7fad59-fdd0-440d-95e0-a009929fc88a tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Lock "b7606a55-d5c3-4ba8-b499-f3c70813f151" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.135s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:43:53 user nova-compute[74960]: DEBUG nova.compute.manager [req-22bc92aa-43a6-4c9c-952e-1732aa168715 req-15288985-bb25-4603-a419-d5b4d40ac994 service nova] [instance: b7606a55-d5c3-4ba8-b499-f3c70813f151] Received event network-vif-plugged-1c3fd855-b339-4f79-b36c-8e89b6fcc190 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:43:53 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-22bc92aa-43a6-4c9c-952e-1732aa168715 req-15288985-bb25-4603-a419-d5b4d40ac994 service nova] Acquiring lock "b7606a55-d5c3-4ba8-b499-f3c70813f151-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:43:53 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-22bc92aa-43a6-4c9c-952e-1732aa168715 req-15288985-bb25-4603-a419-d5b4d40ac994 service nova] Lock "b7606a55-d5c3-4ba8-b499-f3c70813f151-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:43:53 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-22bc92aa-43a6-4c9c-952e-1732aa168715 req-15288985-bb25-4603-a419-d5b4d40ac994 service nova] Lock "b7606a55-d5c3-4ba8-b499-f3c70813f151-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:43:53 user nova-compute[74960]: DEBUG nova.compute.manager [req-22bc92aa-43a6-4c9c-952e-1732aa168715 req-15288985-bb25-4603-a419-d5b4d40ac994 service nova] [instance: b7606a55-d5c3-4ba8-b499-f3c70813f151] No waiting events found dispatching network-vif-plugged-1c3fd855-b339-4f79-b36c-8e89b6fcc190 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:43:53 user nova-compute[74960]: WARNING nova.compute.manager [req-22bc92aa-43a6-4c9c-952e-1732aa168715 req-15288985-bb25-4603-a419-d5b4d40ac994 service nova] [instance: b7606a55-d5c3-4ba8-b499-f3c70813f151] Received unexpected event network-vif-plugged-1c3fd855-b339-4f79-b36c-8e89b6fcc190 for instance with vm_state deleted and task_state None.
Nov 03 12:43:53 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:43:56 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:43:57 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:43:58 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:43:58 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:44:00 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:44:01 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:44:01 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:44:01 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:44:01 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:44:01 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:44:01 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Auditing locally available compute resources for user (node: user) {{(pid=74960) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 12:44:01 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cfe99be-b74b-4fd3-a5d6-a94708992c5b/disk.rescue --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:44:01 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cfe99be-b74b-4fd3-a5d6-a94708992c5b/disk.rescue --force-share --output=json" returned: 0 in 0.222s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:44:01 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cfe99be-b74b-4fd3-a5d6-a94708992c5b/disk.rescue --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:44:01 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:44:01 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cfe99be-b74b-4fd3-a5d6-a94708992c5b/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:44:01 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] skipping disk /opt/stack/data/nova/instances/3cfe99be-b74b-4fd3-a5d6-a94708992c5b/disk (vdb) as it is a volume {{(pid=74960) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 12:44:01 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f15f5f-8afa-4d7b-bb45-5887184f9ee5/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:44:02 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f15f5f-8afa-4d7b-bb45-5887184f9ee5/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:44:02 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f15f5f-8afa-4d7b-bb45-5887184f9ee5/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:44:02 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f15f5f-8afa-4d7b-bb45-5887184f9ee5/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:44:02 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47eb8ddf-590f-4ffa-87c8-377cf1ee0f67/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:44:02 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47eb8ddf-590f-4ffa-87c8-377cf1ee0f67/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:44:02 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47eb8ddf-590f-4ffa-87c8-377cf1ee0f67/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:44:02 user nova-compute[74960]: DEBUG nova.compute.manager [req-47b26e8d-bc14-4736-a143-df4ebabdda26 req-0be75bdb-f116-4987-a1f6-0dbeb6a94340 service nova] [instance: cce474db-fa6f-4670-9be7-88a3e62caa60] Received event network-changed-92da7392-5a28-47ec-96d5-a976824a2318 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:44:02 user nova-compute[74960]: DEBUG nova.compute.manager [req-47b26e8d-bc14-4736-a143-df4ebabdda26 req-0be75bdb-f116-4987-a1f6-0dbeb6a94340 service nova] [instance: cce474db-fa6f-4670-9be7-88a3e62caa60] Refreshing instance network info cache due to event network-changed-92da7392-5a28-47ec-96d5-a976824a2318. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 12:44:02 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-47b26e8d-bc14-4736-a143-df4ebabdda26 req-0be75bdb-f116-4987-a1f6-0dbeb6a94340 service nova] Acquiring lock "refresh_cache-cce474db-fa6f-4670-9be7-88a3e62caa60" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:44:02 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-47b26e8d-bc14-4736-a143-df4ebabdda26 req-0be75bdb-f116-4987-a1f6-0dbeb6a94340 service nova] Acquired lock "refresh_cache-cce474db-fa6f-4670-9be7-88a3e62caa60" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:44:02 user nova-compute[74960]: DEBUG nova.network.neutron [req-47b26e8d-bc14-4736-a143-df4ebabdda26 req-0be75bdb-f116-4987-a1f6-0dbeb6a94340 service nova] [instance: cce474db-fa6f-4670-9be7-88a3e62caa60] Refreshing network info cache for port 92da7392-5a28-47ec-96d5-a976824a2318 {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 12:44:02 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47eb8ddf-590f-4ffa-87c8-377cf1ee0f67/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:44:02 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60658b54-5e34-4a2b-be14-124e47e291c2/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:44:02 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60658b54-5e34-4a2b-be14-124e47e291c2/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:44:02 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60658b54-5e34-4a2b-be14-124e47e291c2/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:44:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60658b54-5e34-4a2b-be14-124e47e291c2/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:44:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e02c80-f626-4918-93f1-6b9a7f778c7a/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:44:03 user nova-compute[74960]: DEBUG nova.network.neutron [req-47b26e8d-bc14-4736-a143-df4ebabdda26 req-0be75bdb-f116-4987-a1f6-0dbeb6a94340 service nova] [instance: cce474db-fa6f-4670-9be7-88a3e62caa60] Updated VIF entry in instance network info cache for port 92da7392-5a28-47ec-96d5-a976824a2318. {{(pid=74960) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 12:44:03 user nova-compute[74960]: DEBUG nova.network.neutron [req-47b26e8d-bc14-4736-a143-df4ebabdda26 req-0be75bdb-f116-4987-a1f6-0dbeb6a94340 service nova] [instance: cce474db-fa6f-4670-9be7-88a3e62caa60] Updating instance_info_cache with network_info: [{"id": "92da7392-5a28-47ec-96d5-a976824a2318", "address": "fa:16:3e:de:f4:80", "network": {"id": "3eaeac55-9eb7-4301-b5a7-d13735656d8e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-826950903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9160afcfdb74ba2aad7bc79e628e96f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92da7392-5a", "ovs_interfaceid": "92da7392-5a28-47ec-96d5-a976824a2318", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:44:03 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-47b26e8d-bc14-4736-a143-df4ebabdda26 req-0be75bdb-f116-4987-a1f6-0dbeb6a94340 service nova] Releasing lock "refresh_cache-cce474db-fa6f-4670-9be7-88a3e62caa60" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:44:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e02c80-f626-4918-93f1-6b9a7f778c7a/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:44:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e02c80-f626-4918-93f1-6b9a7f778c7a/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:44:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e02c80-f626-4918-93f1-6b9a7f778c7a/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:44:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk.rescue --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:44:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:44:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk.rescue --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:44:03 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:44:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:44:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:44:04 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:44:04 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:44:04 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:44:04 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cce474db-fa6f-4670-9be7-88a3e62caa60/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:44:04 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cce474db-fa6f-4670-9be7-88a3e62caa60/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:44:04 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cce474db-fa6f-4670-9be7-88a3e62caa60/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:44:04 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cce474db-fa6f-4670-9be7-88a3e62caa60/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:44:04 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74960) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 12:44:04 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fe524ec-5fb2-4399-bc41-5898413ff9d4/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:44:04 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fe524ec-5fb2-4399-bc41-5898413ff9d4/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:44:04 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fe524ec-5fb2-4399-bc41-5898413ff9d4/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:44:04 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fe524ec-5fb2-4399-bc41-5898413ff9d4/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:44:05 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:44:05 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:44:05 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Hypervisor/Node resource view: name=user free_ram=7900MB free_disk=24.663272857666016GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74960) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 12:44:05 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:44:05 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:44:05 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 87f15f5f-8afa-4d7b-bb45-5887184f9ee5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:44:05 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance a6199681-f85e-4f55-966b-6ab3f17cd640 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:44:05 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 35e02c80-f626-4918-93f1-6b9a7f778c7a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:44:05 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:44:05 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:44:05 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 60658b54-5e34-4a2b-be14-124e47e291c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:44:05 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 3cfe99be-b74b-4fd3-a5d6-a94708992c5b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:44:05 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance cce474db-fa6f-4670-9be7-88a3e62caa60 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:44:05 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 6fe524ec-5fb2-4399-bc41-5898413ff9d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:44:05 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74960) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 12:44:05 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74960) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 12:44:05 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:44:05 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:44:05 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Compute_service record updated for user:user {{(pid=74960) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 12:44:05 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.424s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:44:06 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:44:07 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:44:07 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Starting heal instance info cache {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 12:44:07 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "refresh_cache-35e02c80-f626-4918-93f1-6b9a7f778c7a" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:44:07 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquired lock "refresh_cache-35e02c80-f626-4918-93f1-6b9a7f778c7a" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:44:07 user nova-compute[74960]: DEBUG nova.network.neutron [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a] Forcefully refreshing network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 12:44:08 user nova-compute[74960]: DEBUG nova.network.neutron [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a] Updating instance_info_cache with network_info: [{"id": "4a3a2b1f-db29-441d-9bf9-7f429760ae05", "address": "fa:16:3e:26:d9:9a", "network": {"id": "40aa546e-b586-43f8-bfe3-99c3822fb320", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1884215412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68a32002934044bfad2e4d84bc1b04ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a3a2b1f-db", "ovs_interfaceid": "4a3a2b1f-db29-441d-9bf9-7f429760ae05", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:44:08 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Releasing lock "refresh_cache-35e02c80-f626-4918-93f1-6b9a7f778c7a" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:44:08 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a] Updated the network info_cache for instance {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 12:44:08 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:44:08 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:44:08 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:44:08 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74960) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 12:44:08 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:44:11 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:44:13 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:44:16 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:44:18 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-51ef5c56-3bb5-4b44-bdfb-eda1ddcb53eb tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Acquiring lock "cce474db-fa6f-4670-9be7-88a3e62caa60" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:44:18 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-51ef5c56-3bb5-4b44-bdfb-eda1ddcb53eb tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Lock "cce474db-fa6f-4670-9be7-88a3e62caa60" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:44:18 user nova-compute[74960]: DEBUG nova.objects.instance [None req-51ef5c56-3bb5-4b44-bdfb-eda1ddcb53eb tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Lazy-loading 'flavor' on Instance uuid cce474db-fa6f-4670-9be7-88a3e62caa60 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:44:18 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-51ef5c56-3bb5-4b44-bdfb-eda1ddcb53eb tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Lock "cce474db-fa6f-4670-9be7-88a3e62caa60" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:44:18 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-51ef5c56-3bb5-4b44-bdfb-eda1ddcb53eb tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Acquiring lock "cce474db-fa6f-4670-9be7-88a3e62caa60" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:44:18 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-51ef5c56-3bb5-4b44-bdfb-eda1ddcb53eb tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Lock "cce474db-fa6f-4670-9be7-88a3e62caa60" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:44:18 user nova-compute[74960]: INFO nova.compute.manager [None req-51ef5c56-3bb5-4b44-bdfb-eda1ddcb53eb tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: cce474db-fa6f-4670-9be7-88a3e62caa60] Attaching volume ade00ce0-c0e8-4dba-b496-853713ed7ee5 to /dev/vdb
Nov 03 12:44:18 user nova-compute[74960]: DEBUG os_brick.utils [None req-51ef5c56-3bb5-4b44-bdfb-eda1ddcb53eb tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:44:18 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:44:18 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:44:18 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc43351c-adcb-4dc2-a252-9526456802f7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:75b8e219756\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:44:18 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:44:18 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:44:18 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7efba37-e393-4b36-bfbb-032b0179b187]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:44:18 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:44:18 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:44:18 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[90836a7d-2188-4aa7-8669-f92bb03a2601]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:44:18 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[457f6a39-e48a-461f-8195-26a65d237092]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:44:18 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-51ef5c56-3bb5-4b44-bdfb-eda1ddcb53eb tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Running cmd (subprocess): nvme version {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:44:18 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-51ef5c56-3bb5-4b44-bdfb-eda1ddcb53eb tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] 'nvme version' failed. Not Retrying. {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 12:44:18 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.nvmeof [None req-51ef5c56-3bb5-4b44-bdfb-eda1ddcb53eb tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] nvme not present on system {{(pid=74960) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 12:44:18 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:44:18 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 12:44:18 user nova-compute[74960]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 12:44:18 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5df8258-233c-4600-bec4-18c464ca983c]: (4, '') {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:44:18 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-51ef5c56-3bb5-4b44-bdfb-eda1ddcb53eb tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74960) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 12:44:18 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-51ef5c56-3bb5-4b44-bdfb-eda1ddcb53eb tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74960) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 12:44:18 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-51ef5c56-3bb5-4b44-bdfb-eda1ddcb53eb tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] LIGHTOS: no hostnqn found. {{(pid=74960) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 12:44:18 user nova-compute[74960]: DEBUG os_brick.utils [None req-51ef5c56-3bb5-4b44-bdfb-eda1ddcb53eb tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:75b8e219756', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:44:18 user nova-compute[74960]: DEBUG nova.virt.block_device [None req-51ef5c56-3bb5-4b44-bdfb-eda1ddcb53eb tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: cce474db-fa6f-4670-9be7-88a3e62caa60] Updating existing volume attachment record: ff5f3f7d-ff04-4b2c-90ed-3a421a9537be {{(pid=74960) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 12:44:18 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:44:21 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:44:26 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:44:31 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:44:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:44:36 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:44:41 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-8ed5c460-a7ed-4507-984e-1ed77c70cace tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Acquiring lock "a6199681-f85e-4f55-966b-6ab3f17cd640" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:44:41 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-8ed5c460-a7ed-4507-984e-1ed77c70cace tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Lock "a6199681-f85e-4f55-966b-6ab3f17cd640" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:44:41 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-8ed5c460-a7ed-4507-984e-1ed77c70cace tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Acquiring lock "a6199681-f85e-4f55-966b-6ab3f17cd640-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:44:41 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-8ed5c460-a7ed-4507-984e-1ed77c70cace tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Lock "a6199681-f85e-4f55-966b-6ab3f17cd640-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:44:41 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-8ed5c460-a7ed-4507-984e-1ed77c70cace tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Lock "a6199681-f85e-4f55-966b-6ab3f17cd640-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:44:41 user nova-compute[74960]: INFO nova.compute.manager [None req-8ed5c460-a7ed-4507-984e-1ed77c70cace tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] Terminating instance
Nov 03 12:44:41 user nova-compute[74960]: DEBUG nova.compute.manager [None req-8ed5c460-a7ed-4507-984e-1ed77c70cace tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] Start destroying the instance on the hypervisor. {{(pid=74960) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 12:44:41 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:44:41 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:44:41 user nova-compute[74960]: DEBUG nova.compute.manager [req-62d3d2b8-fa90-42f0-a7dc-d4d3f96d3d22 req-9f0ad6ba-e2b3-437e-b15e-efbe2897d758 service nova] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] Received event network-vif-unplugged-40976ae5-5f49-4d8e-abd7-04dc0ce8f319 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:44:41 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-62d3d2b8-fa90-42f0-a7dc-d4d3f96d3d22 req-9f0ad6ba-e2b3-437e-b15e-efbe2897d758 service nova] Acquiring lock "a6199681-f85e-4f55-966b-6ab3f17cd640-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:44:41 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-62d3d2b8-fa90-42f0-a7dc-d4d3f96d3d22 req-9f0ad6ba-e2b3-437e-b15e-efbe2897d758 service nova] Lock "a6199681-f85e-4f55-966b-6ab3f17cd640-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:44:41 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-62d3d2b8-fa90-42f0-a7dc-d4d3f96d3d22 req-9f0ad6ba-e2b3-437e-b15e-efbe2897d758 service nova] Lock "a6199681-f85e-4f55-966b-6ab3f17cd640-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:44:41 user nova-compute[74960]: DEBUG nova.compute.manager [req-62d3d2b8-fa90-42f0-a7dc-d4d3f96d3d22 req-9f0ad6ba-e2b3-437e-b15e-efbe2897d758 service nova] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] No waiting events found dispatching network-vif-unplugged-40976ae5-5f49-4d8e-abd7-04dc0ce8f319 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:44:41 user nova-compute[74960]: DEBUG nova.compute.manager [req-62d3d2b8-fa90-42f0-a7dc-d4d3f96d3d22 req-9f0ad6ba-e2b3-437e-b15e-efbe2897d758 service nova] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] Received event network-vif-unplugged-40976ae5-5f49-4d8e-abd7-04dc0ce8f319 for instance with task_state deleting. {{(pid=74960) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 12:44:41 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:44:41 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:44:41 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:44:42 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:44:42 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] Instance destroyed successfully.
Nov 03 12:44:42 user nova-compute[74960]: DEBUG nova.objects.instance [None req-8ed5c460-a7ed-4507-984e-1ed77c70cace tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Lazy-loading 'resources' on Instance uuid a6199681-f85e-4f55-966b-6ab3f17cd640 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:44:42 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-8ed5c460-a7ed-4507-984e-1ed77c70cace tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:28:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-391818015',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-391818015',id=25,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-03T12:30:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dbc95d68d5e147e1953c855169b17091',ramdisk_id='',reservation_id='r-l1ygoxml',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-195954071',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T12:31:51Z,user_data=None,user_id='c473215929044a108c9fc4d6327dfc3d',uuid=a6199681-f85e-4f55-966b-6ab3f17cd640,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "40976ae5-5f49-4d8e-abd7-04dc0ce8f319", "address": "fa:16:3e:7c:40:1d", "network": {"id": "dec66832-56d5-4d68-b11f-8e8eed38f045", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-79099436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc95d68d5e147e1953c855169b17091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40976ae5-5f", "ovs_interfaceid": "40976ae5-5f49-4d8e-abd7-04dc0ce8f319", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 12:44:42 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-8ed5c460-a7ed-4507-984e-1ed77c70cace tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Converting VIF {"id": "40976ae5-5f49-4d8e-abd7-04dc0ce8f319", "address": "fa:16:3e:7c:40:1d", "network": {"id": "dec66832-56d5-4d68-b11f-8e8eed38f045", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-79099436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc95d68d5e147e1953c855169b17091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40976ae5-5f", "ovs_interfaceid": "40976ae5-5f49-4d8e-abd7-04dc0ce8f319", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:44:42 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-8ed5c460-a7ed-4507-984e-1ed77c70cace tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7c:40:1d,bridge_name='br-int',has_traffic_filtering=True,id=40976ae5-5f49-4d8e-abd7-04dc0ce8f319,network=Network(dec66832-56d5-4d68-b11f-8e8eed38f045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40976ae5-5f') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:44:42 user nova-compute[74960]: DEBUG os_vif [None req-8ed5c460-a7ed-4507-984e-1ed77c70cace tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:40:1d,bridge_name='br-int',has_traffic_filtering=True,id=40976ae5-5f49-4d8e-abd7-04dc0ce8f319,network=Network(dec66832-56d5-4d68-b11f-8e8eed38f045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40976ae5-5f') {{(pid=74960) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 12:44:42 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:44:42 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap40976ae5-5f, bridge=br-int, if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:44:42 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:44:42 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:44:42 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:44:42 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6992b725-dd13-4583-907f-aa75d67af35d) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:44:42 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:44:42 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:44:42 user nova-compute[74960]: INFO os_vif [None req-8ed5c460-a7ed-4507-984e-1ed77c70cace tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:40:1d,bridge_name='br-int',has_traffic_filtering=True,id=40976ae5-5f49-4d8e-abd7-04dc0ce8f319,network=Network(dec66832-56d5-4d68-b11f-8e8eed38f045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40976ae5-5f')
Nov 03 12:44:42 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ed5c460-a7ed-4507-984e-1ed77c70cace tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] calling os-brick to detach iSCSI Volume {{(pid=74960) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 12:44:42 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed5c460-a7ed-4507-984e-1ed77c70cace tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9aa420acb0>, {'target_iqn': 'iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BNDmfTXv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:44:42 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-8ed5c460-a7ed-4507-984e-1ed77c70cace tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:44:42 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-8ed5c460-a7ed-4507-984e-1ed77c70cace tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:44:42 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-8ed5c460-a7ed-4507-984e-1ed77c70cace tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:44:42 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:44:42 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:44:42 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[62740224-9e38-4a97-8435-ea33bbfb642a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f4c6cd96-5bb9-496e-aaa7-37f872cee704\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:44:42 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed5c460-a7ed-4507-984e-1ed77c70cace tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 12:44:42 user nova-compute[74960]: No targets found.
Nov 03 12:44:42 user nova-compute[74960]: iSNS:
Nov 03 12:44:42 user nova-compute[74960]: No targets found.
Nov 03 12:44:42 user nova-compute[74960]: STATIC:
Nov 03 12:44:42 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2
Nov 03 12:44:42 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:44:42 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:44:42 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:f4c6cd96-5bb9-496e-aaa7-37f872cee704
Nov 03 12:44:42 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:44:42 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:44:42 user nova-compute[74960]: FIRMWARE:
Nov 03 12:44:42 user nova-compute[74960]: No targets found.
Nov 03 12:44:42 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:44:42 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed5c460-a7ed-4507-984e-1ed77c70cace tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 12:44:42 user nova-compute[74960]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 12:44:42 user nova-compute[74960]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74960) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 12:44:42 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed5c460-a7ed-4507-984e-1ed77c70cace tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2', 0)] {{(pid=74960) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 12:44:42 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:44:42 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:44:42 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccfecaef-cef2-4a53-a1c3-c8acc0c8cf9f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4c6cd96-5bb9-496e-aaa7-37f872cee704\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:44:42 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:44:42 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:44:42 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d14ffb4-f434-4031-90ca-e21cf4259b3a]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4c6cd96-5bb9-496e-aaa7-37f872cee704 (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:44:42 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed5c460-a7ed-4507-984e-1ed77c70cace tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:44:42 user nova-compute[74960]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4c6cd96-5bb9-496e-aaa7-37f872cee704 (non-flash)
Nov 03 12:44:42 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:44:42 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed5c460-a7ed-4507-984e-1ed77c70cace tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 (non-flash)
Nov 03 12:44:42 user nova-compute[74960]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4c6cd96-5bb9-496e-aaa7-37f872cee704 (non-flash)
Nov 03 12:44:42 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:44:42 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed5c460-a7ed-4507-984e-1ed77c70cace tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9a8c5ec280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2'): ({'sdd'}, set())}) {{(pid=74960) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 12:44:42 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-8ed5c460-a7ed-4507-984e-1ed77c70cace tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Removing single pathed devices sdd {{(pid=74960) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 12:44:42 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:44:42 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:44:42 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[72832a97-78fa-48d7-a423-31da46800271]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:44:42 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:44:42 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:44:42 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[edc5b10e-2a9c-42a5-8379-713a1c58cda0]: (4, ('ok\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:44:42 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-8ed5c460-a7ed-4507-984e-1ed77c70cace tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Flushing IO for device /dev/sdd {{(pid=74960) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 12:44:42 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:44:42 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:44:42 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[a52a2955-54c0-4d8e-a001-277e05e78758]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:44:42 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-8ed5c460-a7ed-4507-984e-1ed77c70cace tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74960) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 12:44:42 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:44:42 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.063s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:44:42 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[72e3102a-acc6-4cc9-a33d-6ee7ef1b8f66]: (4, ('1', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:44:42 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-8ed5c460-a7ed-4507-984e-1ed77c70cace tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74960) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 12:44:42 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-8ed5c460-a7ed-4507-984e-1ed77c70cace tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] SCSI volumes sdd have been removed. {{(pid=74960) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 12:44:42 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed5c460-a7ed-4507-984e-1ed77c70cace tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2')] {{(pid=74960) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 12:44:42 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:44:42 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:44:42 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[9083771d-ef08-45a4-ac80-dd704fb56307]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:44:42 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed5c460-a7ed-4507-984e-1ed77c70cace tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:44:42 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 -p 172.16.0.220:3260 --logout {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:44:42 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:44:42 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[8034a0d5-add1-44ca-b3c1-379b25720491]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:44:42 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed5c460-a7ed-4507-984e-1ed77c70cace tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2, portal: 172.16.0.220,3260]
Nov 03 12:44:42 user nova-compute[74960]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2, portal: 172.16.0.220,3260] successful.
Nov 03 12:44:42 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:44:42 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 -p 172.16.0.220:3260 --op delete {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:44:42 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef532415-0078-4fe2-8af5-73cada8b32a2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:44:42 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[9512e861-6a8b-4d95-94f7-290c845a5845]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:44:42 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed5c460-a7ed-4507-984e-1ed77c70cace tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:44:42 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-8ed5c460-a7ed-4507-984e-1ed77c70cace tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.355s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:44:42 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed5c460-a7ed-4507-984e-1ed77c70cace tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] <== disconnect_volume: return (356ms) None {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:44:42 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ed5c460-a7ed-4507-984e-1ed77c70cace tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] Disconnected iSCSI Volume {{(pid=74960) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 12:44:42 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-8ed5c460-a7ed-4507-984e-1ed77c70cace tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] Deleting instance files /opt/stack/data/nova/instances/a6199681-f85e-4f55-966b-6ab3f17cd640_del
Nov 03 12:44:42 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-8ed5c460-a7ed-4507-984e-1ed77c70cace tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] Deletion of /opt/stack/data/nova/instances/a6199681-f85e-4f55-966b-6ab3f17cd640_del complete
Nov 03 12:44:42 user nova-compute[74960]: INFO nova.compute.manager [None req-8ed5c460-a7ed-4507-984e-1ed77c70cace tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] Took 1.28 seconds to destroy the instance on the hypervisor.
Nov 03 12:44:42 user nova-compute[74960]: DEBUG oslo.service.loopingcall [None req-8ed5c460-a7ed-4507-984e-1ed77c70cace tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74960) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 12:44:42 user nova-compute[74960]: DEBUG nova.compute.manager [-] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] Deallocating network for instance {{(pid=74960) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 12:44:42 user nova-compute[74960]: DEBUG nova.network.neutron [-] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] deallocate_for_instance() {{(pid=74960) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 12:44:43 user nova-compute[74960]: DEBUG nova.network.neutron [-] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] Updating instance_info_cache with network_info: [] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:44:43 user nova-compute[74960]: INFO nova.compute.manager [-] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] Took 0.51 seconds to deallocate network for instance.
Nov 03 12:44:43 user nova-compute[74960]: DEBUG nova.compute.manager [req-fb76710d-3ab8-40f1-9d3c-110d20e4d24b req-e30224bd-9ecb-4f77-971d-2397790187b6 service nova] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] Received event network-vif-deleted-40976ae5-5f49-4d8e-abd7-04dc0ce8f319 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:44:43 user nova-compute[74960]: DEBUG nova.compute.manager [req-6215630f-f19a-4749-985f-6646ddc9bca7 req-98e97c69-878d-4e0f-a146-1dcf376564e2 service nova] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] Received event network-vif-plugged-40976ae5-5f49-4d8e-abd7-04dc0ce8f319 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:44:43 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-6215630f-f19a-4749-985f-6646ddc9bca7 req-98e97c69-878d-4e0f-a146-1dcf376564e2 service nova] Acquiring lock "a6199681-f85e-4f55-966b-6ab3f17cd640-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:44:43 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-6215630f-f19a-4749-985f-6646ddc9bca7 req-98e97c69-878d-4e0f-a146-1dcf376564e2 service nova] Lock "a6199681-f85e-4f55-966b-6ab3f17cd640-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:44:43 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-6215630f-f19a-4749-985f-6646ddc9bca7 req-98e97c69-878d-4e0f-a146-1dcf376564e2 service nova] Lock "a6199681-f85e-4f55-966b-6ab3f17cd640-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:44:43 user nova-compute[74960]: DEBUG nova.compute.manager [req-6215630f-f19a-4749-985f-6646ddc9bca7 req-98e97c69-878d-4e0f-a146-1dcf376564e2 service nova] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] No waiting events found dispatching network-vif-plugged-40976ae5-5f49-4d8e-abd7-04dc0ce8f319 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:44:43 user nova-compute[74960]: WARNING nova.compute.manager [req-6215630f-f19a-4749-985f-6646ddc9bca7 req-98e97c69-878d-4e0f-a146-1dcf376564e2 service nova] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] Received unexpected event network-vif-plugged-40976ae5-5f49-4d8e-abd7-04dc0ce8f319 for instance with vm_state active and task_state deleting.
Nov 03 12:44:44 user nova-compute[74960]: INFO nova.compute.manager [None req-8ed5c460-a7ed-4507-984e-1ed77c70cace tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: a6199681-f85e-4f55-966b-6ab3f17cd640] Took 0.90 seconds to detach 1 volumes for instance.
Nov 03 12:44:44 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-8ed5c460-a7ed-4507-984e-1ed77c70cace tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:44:44 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-8ed5c460-a7ed-4507-984e-1ed77c70cace tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:44:44 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-8ed5c460-a7ed-4507-984e-1ed77c70cace tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:44:44 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-8ed5c460-a7ed-4507-984e-1ed77c70cace tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:44:44 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-8ed5c460-a7ed-4507-984e-1ed77c70cace tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.331s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:44:44 user nova-compute[74960]: INFO nova.scheduler.client.report [None req-8ed5c460-a7ed-4507-984e-1ed77c70cace tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Deleted allocations for instance a6199681-f85e-4f55-966b-6ab3f17cd640
Nov 03 12:44:44 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-8ed5c460-a7ed-4507-984e-1ed77c70cace tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Lock "a6199681-f85e-4f55-966b-6ab3f17cd640" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.263s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:44:47 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:44:50 user nova-compute[74960]: INFO nova.compute.manager [None req-c1ac2109-a476-4046-a986-4505902290c7 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] Unrescuing
Nov 03 12:44:50 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c1ac2109-a476-4046-a986-4505902290c7 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Acquiring lock "refresh_cache-3cfe99be-b74b-4fd3-a5d6-a94708992c5b" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:44:50 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c1ac2109-a476-4046-a986-4505902290c7 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Acquired lock "refresh_cache-3cfe99be-b74b-4fd3-a5d6-a94708992c5b" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:44:50 user nova-compute[74960]: DEBUG nova.network.neutron [None req-c1ac2109-a476-4046-a986-4505902290c7 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] Building network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 12:44:50 user nova-compute[74960]: DEBUG nova.network.neutron [None req-c1ac2109-a476-4046-a986-4505902290c7 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] Updating instance_info_cache with network_info: [{"id": "ad28ac84-3419-4701-90df-e93359da2c28", "address": "fa:16:3e:1f:4e:b6", "network": {"id": "9a9a848a-80be-4281-8554-8e28744073b3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1579909169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "434ce6c4b77342299a17e547a14e3918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad28ac84-34", "ovs_interfaceid": "ad28ac84-3419-4701-90df-e93359da2c28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:44:50 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-c1ac2109-a476-4046-a986-4505902290c7 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Releasing lock "refresh_cache-3cfe99be-b74b-4fd3-a5d6-a94708992c5b" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:44:50 user nova-compute[74960]: DEBUG nova.objects.instance [None req-c1ac2109-a476-4046-a986-4505902290c7 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Lazy-loading 'flavor' on Instance uuid 3cfe99be-b74b-4fd3-a5d6-a94708992c5b {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:44:50 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:44:51 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:44:51 user nova-compute[74960]: DEBUG nova.compute.manager [req-48282019-d867-4f3b-b847-cbba4bc43832 req-b0ed59cf-e2e8-44c8-b34d-b75261555be7 service nova] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] Received event network-vif-unplugged-ad28ac84-3419-4701-90df-e93359da2c28 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:44:51 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-48282019-d867-4f3b-b847-cbba4bc43832 req-b0ed59cf-e2e8-44c8-b34d-b75261555be7 service nova] Acquiring lock "3cfe99be-b74b-4fd3-a5d6-a94708992c5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:44:51 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-48282019-d867-4f3b-b847-cbba4bc43832 req-b0ed59cf-e2e8-44c8-b34d-b75261555be7 service nova] Lock "3cfe99be-b74b-4fd3-a5d6-a94708992c5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:44:51 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-48282019-d867-4f3b-b847-cbba4bc43832 req-b0ed59cf-e2e8-44c8-b34d-b75261555be7 service nova] Lock "3cfe99be-b74b-4fd3-a5d6-a94708992c5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:44:51 user nova-compute[74960]: DEBUG nova.compute.manager [req-48282019-d867-4f3b-b847-cbba4bc43832 req-b0ed59cf-e2e8-44c8-b34d-b75261555be7 service nova] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] No waiting events found dispatching network-vif-unplugged-ad28ac84-3419-4701-90df-e93359da2c28 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:44:51 user nova-compute[74960]: WARNING nova.compute.manager [req-48282019-d867-4f3b-b847-cbba4bc43832 req-b0ed59cf-e2e8-44c8-b34d-b75261555be7 service nova] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] Received unexpected event network-vif-unplugged-ad28ac84-3419-4701-90df-e93359da2c28 for instance with vm_state rescued and task_state unrescuing.
Nov 03 12:44:51 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:44:51 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:44:51 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] Instance destroyed successfully.
Nov 03 12:44:52 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:44:52 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:44:52 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:44:52 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:44:52 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:44:52 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:44:53 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:44:53 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:44:53 user nova-compute[74960]: DEBUG nova.compute.manager [req-825e14ff-567a-4b39-9121-917aee303843 req-e0d84e97-91ac-4da9-8996-b48ca764d6b5 service nova] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] Received event network-vif-plugged-ad28ac84-3419-4701-90df-e93359da2c28 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:44:53 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-825e14ff-567a-4b39-9121-917aee303843 req-e0d84e97-91ac-4da9-8996-b48ca764d6b5 service nova] Acquiring lock "3cfe99be-b74b-4fd3-a5d6-a94708992c5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:44:53 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-825e14ff-567a-4b39-9121-917aee303843 req-e0d84e97-91ac-4da9-8996-b48ca764d6b5 service nova] Lock "3cfe99be-b74b-4fd3-a5d6-a94708992c5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:44:53 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-825e14ff-567a-4b39-9121-917aee303843 req-e0d84e97-91ac-4da9-8996-b48ca764d6b5 service nova] Lock "3cfe99be-b74b-4fd3-a5d6-a94708992c5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:44:53 user nova-compute[74960]: DEBUG nova.compute.manager [req-825e14ff-567a-4b39-9121-917aee303843 req-e0d84e97-91ac-4da9-8996-b48ca764d6b5 service nova] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] No waiting events found dispatching network-vif-plugged-ad28ac84-3419-4701-90df-e93359da2c28 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:44:53 user nova-compute[74960]: WARNING nova.compute.manager [req-825e14ff-567a-4b39-9121-917aee303843 req-e0d84e97-91ac-4da9-8996-b48ca764d6b5 service nova] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] Received unexpected event network-vif-plugged-ad28ac84-3419-4701-90df-e93359da2c28 for instance with vm_state rescued and task_state unrescuing.
Nov 03 12:44:53 user nova-compute[74960]: DEBUG nova.compute.manager [req-825e14ff-567a-4b39-9121-917aee303843 req-e0d84e97-91ac-4da9-8996-b48ca764d6b5 service nova] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] Received event network-vif-plugged-ad28ac84-3419-4701-90df-e93359da2c28 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:44:53 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-825e14ff-567a-4b39-9121-917aee303843 req-e0d84e97-91ac-4da9-8996-b48ca764d6b5 service nova] Acquiring lock "3cfe99be-b74b-4fd3-a5d6-a94708992c5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:44:53 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-825e14ff-567a-4b39-9121-917aee303843 req-e0d84e97-91ac-4da9-8996-b48ca764d6b5 service nova] Lock "3cfe99be-b74b-4fd3-a5d6-a94708992c5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:44:53 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-825e14ff-567a-4b39-9121-917aee303843 req-e0d84e97-91ac-4da9-8996-b48ca764d6b5 service nova] Lock "3cfe99be-b74b-4fd3-a5d6-a94708992c5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:44:53 user nova-compute[74960]: DEBUG nova.compute.manager [req-825e14ff-567a-4b39-9121-917aee303843 req-e0d84e97-91ac-4da9-8996-b48ca764d6b5 service nova] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] No waiting events found dispatching network-vif-plugged-ad28ac84-3419-4701-90df-e93359da2c28 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:44:53 user nova-compute[74960]: WARNING nova.compute.manager [req-825e14ff-567a-4b39-9121-917aee303843 req-e0d84e97-91ac-4da9-8996-b48ca764d6b5 service nova] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] Received unexpected event network-vif-plugged-ad28ac84-3419-4701-90df-e93359da2c28 for instance with vm_state rescued and task_state unrescuing.
Nov 03 12:44:53 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:44:55 user nova-compute[74960]: DEBUG nova.compute.manager [None req-c1ac2109-a476-4046-a986-4505902290c7 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] Checking state {{(pid=74960) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 12:44:55 user nova-compute[74960]: DEBUG nova.compute.manager [req-07e91b71-5fb2-4419-9300-c68bd8eba6e6 req-bd40f3fe-886c-496b-b59b-343e460d5dcb service nova] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] Received event network-vif-plugged-ad28ac84-3419-4701-90df-e93359da2c28 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:44:55 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-07e91b71-5fb2-4419-9300-c68bd8eba6e6 req-bd40f3fe-886c-496b-b59b-343e460d5dcb service nova] Acquiring lock "3cfe99be-b74b-4fd3-a5d6-a94708992c5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:44:55 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-07e91b71-5fb2-4419-9300-c68bd8eba6e6 req-bd40f3fe-886c-496b-b59b-343e460d5dcb service nova] Lock "3cfe99be-b74b-4fd3-a5d6-a94708992c5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:44:55 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-07e91b71-5fb2-4419-9300-c68bd8eba6e6 req-bd40f3fe-886c-496b-b59b-343e460d5dcb service nova] Lock "3cfe99be-b74b-4fd3-a5d6-a94708992c5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:44:55 user nova-compute[74960]: DEBUG nova.compute.manager [req-07e91b71-5fb2-4419-9300-c68bd8eba6e6 req-bd40f3fe-886c-496b-b59b-343e460d5dcb service nova] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] No waiting events found dispatching network-vif-plugged-ad28ac84-3419-4701-90df-e93359da2c28 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:44:55 user nova-compute[74960]: WARNING nova.compute.manager [req-07e91b71-5fb2-4419-9300-c68bd8eba6e6 req-bd40f3fe-886c-496b-b59b-343e460d5dcb service nova] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] Received unexpected event network-vif-plugged-ad28ac84-3419-4701-90df-e93359da2c28 for instance with vm_state active and task_state None.
Nov 03 12:44:57 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:44:57 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:44:58 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:44:58 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51ef5c56-3bb5-4b44-bdfb-eda1ddcb53eb tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: cce474db-fa6f-4670-9be7-88a3e62caa60] Calling os-brick to attach iSCSI Volume {{(pid=74960) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 12:44:58 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-51ef5c56-3bb5-4b44-bdfb-eda1ddcb53eb tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9aa420acb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ade00ce0-c0e8-4dba-b496-853713ed7ee5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cHmDtRSq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:44:58 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-51ef5c56-3bb5-4b44-bdfb-eda1ddcb53eb tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:44:58 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-51ef5c56-3bb5-4b44-bdfb-eda1ddcb53eb tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:44:58 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-51ef5c56-3bb5-4b44-bdfb-eda1ddcb53eb tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:44:58 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-51ef5c56-3bb5-4b44-bdfb-eda1ddcb53eb tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:44:58 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-51ef5c56-3bb5-4b44-bdfb-eda1ddcb53eb tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ade00ce0-c0e8-4dba-b496-853713ed7ee5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:44:58 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-51ef5c56-3bb5-4b44-bdfb-eda1ddcb53eb tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ade00ce0-c0e8-4dba-b496-853713ed7ee5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:44:58 user nova-compute[74960]: INFO os_brick.initiator.connectors.iscsi [None req-51ef5c56-3bb5-4b44-bdfb-eda1ddcb53eb tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 12:44:58 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ade00ce0-c0e8-4dba-b496-853713ed7ee5 -p 172.16.0.220:3260 {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:44:58 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ade00ce0-c0e8-4dba-b496-853713ed7ee5 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:44:58 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[539dc54e-18da-42b3-87e4-e35e394401d2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:44:58 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-51ef5c56-3bb5-4b44-bdfb-eda1ddcb53eb tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 12:44:58 user nova-compute[74960]:  {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:44:58 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ade00ce0-c0e8-4dba-b496-853713ed7ee5 -p 172.16.0.220:3260 --interface default --op new {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:44:58 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ade00ce0-c0e8-4dba-b496-853713ed7ee5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:44:58 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c974859-673c-4f68-989a-c7515e2fb7b5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ade00ce0-c0e8-4dba-b496-853713ed7ee5] added\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:44:58 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-51ef5c56-3bb5-4b44-bdfb-eda1ddcb53eb tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ade00ce0-c0e8-4dba-b496-853713ed7ee5] added
Nov 03 12:44:58 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:44:58 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ade00ce0-c0e8-4dba-b496-853713ed7ee5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:44:58 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ade00ce0-c0e8-4dba-b496-853713ed7ee5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.038s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:44:58 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[965c430d-b4a2-4386-a663-c3924ada7c4d]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:44:58 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-51ef5c56-3bb5-4b44-bdfb-eda1ddcb53eb tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:44:58 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ade00ce0-c0e8-4dba-b496-853713ed7ee5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:44:58 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ade00ce0-c0e8-4dba-b496-853713ed7ee5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:44:58 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2553b2e-2caa-45f4-a40b-83b168939114]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:44:58 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-51ef5c56-3bb5-4b44-bdfb-eda1ddcb53eb tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:44:58 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ade00ce0-c0e8-4dba-b496-853713ed7ee5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cHmDtRSq {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:44:58 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ade00ce0-c0e8-4dba-b496-853713ed7ee5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cHmDtRSq" returned: 0 in 0.028s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:44:58 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[c313b7da-eb50-434e-9be2-ec70f59869e7]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:44:58 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-51ef5c56-3bb5-4b44-bdfb-eda1ddcb53eb tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cHmDtRSq'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:44:58 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ade00ce0-c0e8-4dba-b496-853713ed7ee5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:44:58 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ade00ce0-c0e8-4dba-b496-853713ed7ee5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:44:58 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[c45d7412-5851-4978-96ee-1c51c6155a02]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:44:58 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-51ef5c56-3bb5-4b44-bdfb-eda1ddcb53eb tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:44:58 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:44:58 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:44:58 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3745057-3a10-462a-885c-2520720e2811]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4c6cd96-5bb9-496e-aaa7-37f872cee704 (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:44:58 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-51ef5c56-3bb5-4b44-bdfb-eda1ddcb53eb tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4c6cd96-5bb9-496e-aaa7-37f872cee704 (non-flash)
Nov 03 12:44:58 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:44:58 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-51ef5c56-3bb5-4b44-bdfb-eda1ddcb53eb tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4c6cd96-5bb9-496e-aaa7-37f872cee704 (non-flash)
Nov 03 12:44:58 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:44:58 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ade00ce0-c0e8-4dba-b496-853713ed7ee5 -p 172.16.0.220:3260 --login {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:44:58 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ade00ce0-c0e8-4dba-b496-853713ed7ee5 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:44:58 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5b9cdd4-d369-47ba-8b71-63b5e5b3d737]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ade00ce0-c0e8-4dba-b496-853713ed7ee5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ade00ce0-c0e8-4dba-b496-853713ed7ee5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:44:58 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-51ef5c56-3bb5-4b44-bdfb-eda1ddcb53eb tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ade00ce0-c0e8-4dba-b496-853713ed7ee5, portal: 172.16.0.220,3260]
Nov 03 12:44:58 user nova-compute[74960]: Login to [iface: default, target: iqn.2010-10.org.openstack:ade00ce0-c0e8-4dba-b496-853713ed7ee5, portal: 172.16.0.220,3260] successful.
Nov 03 12:44:58 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:44:58 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ade00ce0-c0e8-4dba-b496-853713ed7ee5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:44:58 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ade00ce0-c0e8-4dba-b496-853713ed7ee5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:44:58 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[6240bc88-d958-4777-b03c-dd40cc530567]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:44:58 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-51ef5c56-3bb5-4b44-bdfb-eda1ddcb53eb tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:44:58 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:44:58 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:44:58 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ed12903-766a-4865-b184-5648ad8750a9]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4c6cd96-5bb9-496e-aaa7-37f872cee704 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade00ce0-c0e8-4dba-b496-853713ed7ee5 (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:44:58 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-51ef5c56-3bb5-4b44-bdfb-eda1ddcb53eb tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4c6cd96-5bb9-496e-aaa7-37f872cee704 (non-flash)
Nov 03 12:44:58 user nova-compute[74960]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade00ce0-c0e8-4dba-b496-853713ed7ee5 (non-flash)
Nov 03 12:44:58 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:44:58 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-51ef5c56-3bb5-4b44-bdfb-eda1ddcb53eb tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4c6cd96-5bb9-496e-aaa7-37f872cee704 (non-flash)
Nov 03 12:44:58 user nova-compute[74960]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade00ce0-c0e8-4dba-b496-853713ed7ee5 (non-flash)
Nov 03 12:44:58 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:44:58 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-51ef5c56-3bb5-4b44-bdfb-eda1ddcb53eb tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ade00ce0-c0e8-4dba-b496-853713ed7ee5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.338s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:44:58 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-51ef5c56-3bb5-4b44-bdfb-eda1ddcb53eb tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Connected to 172.16.0.220:3260 {{(pid=74960) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 12:44:58 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-51ef5c56-3bb5-4b44-bdfb-eda1ddcb53eb tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] HCTL ('34', '-', '-', 0) found on session 40 with lun 0 {{(pid=74960) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 12:44:58 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-51ef5c56-3bb5-4b44-bdfb-eda1ddcb53eb tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74960) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 12:44:58 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:44:58 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:44:58 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[42ae54d8-6055-487b-be37-f4631c1ee78d]: (4, ('- - 0', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:44:58 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-51ef5c56-3bb5-4b44-bdfb-eda1ddcb53eb tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Searching for a device in session 40 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74960) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 12:44:58 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-51ef5c56-3bb5-4b44-bdfb-eda1ddcb53eb tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:ade00ce0-c0e8-4dba-b496-853713ed7ee5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cHmDtRSq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74960) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 12:44:58 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-24a1174b-182f-4a5d-9c7c-ac1a91605ef9 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Acquiring lock "35e02c80-f626-4918-93f1-6b9a7f778c7a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:44:58 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-24a1174b-182f-4a5d-9c7c-ac1a91605ef9 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Lock "35e02c80-f626-4918-93f1-6b9a7f778c7a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:44:58 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-24a1174b-182f-4a5d-9c7c-ac1a91605ef9 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Acquiring lock "35e02c80-f626-4918-93f1-6b9a7f778c7a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:44:58 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-24a1174b-182f-4a5d-9c7c-ac1a91605ef9 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Lock "35e02c80-f626-4918-93f1-6b9a7f778c7a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:44:58 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-24a1174b-182f-4a5d-9c7c-ac1a91605ef9 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Lock "35e02c80-f626-4918-93f1-6b9a7f778c7a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:44:58 user nova-compute[74960]: INFO nova.compute.manager [None req-24a1174b-182f-4a5d-9c7c-ac1a91605ef9 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a] Terminating instance
Nov 03 12:44:58 user nova-compute[74960]: DEBUG nova.compute.manager [None req-24a1174b-182f-4a5d-9c7c-ac1a91605ef9 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a] Start destroying the instance on the hypervisor. {{(pid=74960) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 12:44:58 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:44:59 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:44:59 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:44:59 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:44:59 user nova-compute[74960]: DEBUG nova.compute.manager [req-ec384ef4-c3fd-4ca7-9c9d-46f843a5ad2d req-e29f21e8-7d6c-4d92-8989-2c8918852de2 service nova] [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a] Received event network-vif-unplugged-4a3a2b1f-db29-441d-9bf9-7f429760ae05 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:44:59 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-ec384ef4-c3fd-4ca7-9c9d-46f843a5ad2d req-e29f21e8-7d6c-4d92-8989-2c8918852de2 service nova] Acquiring lock "35e02c80-f626-4918-93f1-6b9a7f778c7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:44:59 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-ec384ef4-c3fd-4ca7-9c9d-46f843a5ad2d req-e29f21e8-7d6c-4d92-8989-2c8918852de2 service nova] Lock "35e02c80-f626-4918-93f1-6b9a7f778c7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:44:59 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-ec384ef4-c3fd-4ca7-9c9d-46f843a5ad2d req-e29f21e8-7d6c-4d92-8989-2c8918852de2 service nova] Lock "35e02c80-f626-4918-93f1-6b9a7f778c7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:44:59 user nova-compute[74960]: DEBUG nova.compute.manager [req-ec384ef4-c3fd-4ca7-9c9d-46f843a5ad2d req-e29f21e8-7d6c-4d92-8989-2c8918852de2 service nova] [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a] No waiting events found dispatching network-vif-unplugged-4a3a2b1f-db29-441d-9bf9-7f429760ae05 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:44:59 user nova-compute[74960]: DEBUG nova.compute.manager [req-ec384ef4-c3fd-4ca7-9c9d-46f843a5ad2d req-e29f21e8-7d6c-4d92-8989-2c8918852de2 service nova] [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a] Received event network-vif-unplugged-4a3a2b1f-db29-441d-9bf9-7f429760ae05 for instance with task_state deleting. {{(pid=74960) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 12:44:59 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:44:59 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:44:59 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:44:59 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a] Instance destroyed successfully.
Nov 03 12:44:59 user nova-compute[74960]: DEBUG nova.objects.instance [None req-24a1174b-182f-4a5d-9c7c-ac1a91605ef9 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Lazy-loading 'resources' on Instance uuid 35e02c80-f626-4918-93f1-6b9a7f778c7a {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:44:59 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-24a1174b-182f-4a5d-9c7c-ac1a91605ef9 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:31:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1204616755',display_name='tempest-SnapshotDataIntegrityTests-server-1204616755',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1204616755',id=30,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA4Jmc6vxGmD+FIEny2/bl3nhg3cePb1r82d0CansePy/fKHfJbKeqOY+gqa40mFuFg144lW0d7DELGynXX6lCpAYv3wYVIdNjMT2D6N0Jcar3O1z7lnyYFUqxDHBYLzrA==',key_name='tempest-keypair-656749056',keypairs=<?>,launch_index=0,launched_at=2023-11-03T12:31:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='68a32002934044bfad2e4d84bc1b04ed',ramdisk_id='',reservation_id='r-05bwiepr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1334789549',owner_user_name='tempest-SnapshotDataIntegrityTests-1334789549-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T12:32:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f8cac126fe247829404265038cd2608',uuid=35e02c80-f626-4918-93f1-6b9a7f778c7a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4a3a2b1f-db29-441d-9bf9-7f429760ae05", "address": "fa:16:3e:26:d9:9a", "network": {"id": "40aa546e-b586-43f8-bfe3-99c3822fb320", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1884215412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68a32002934044bfad2e4d84bc1b04ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a3a2b1f-db", "ovs_interfaceid": "4a3a2b1f-db29-441d-9bf9-7f429760ae05", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 12:44:59 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-24a1174b-182f-4a5d-9c7c-ac1a91605ef9 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Converting VIF {"id": "4a3a2b1f-db29-441d-9bf9-7f429760ae05", "address": "fa:16:3e:26:d9:9a", "network": {"id": "40aa546e-b586-43f8-bfe3-99c3822fb320", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1884215412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68a32002934044bfad2e4d84bc1b04ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a3a2b1f-db", "ovs_interfaceid": "4a3a2b1f-db29-441d-9bf9-7f429760ae05", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:44:59 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-24a1174b-182f-4a5d-9c7c-ac1a91605ef9 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:26:d9:9a,bridge_name='br-int',has_traffic_filtering=True,id=4a3a2b1f-db29-441d-9bf9-7f429760ae05,network=Network(40aa546e-b586-43f8-bfe3-99c3822fb320),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a3a2b1f-db') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:44:59 user nova-compute[74960]: DEBUG os_vif [None req-24a1174b-182f-4a5d-9c7c-ac1a91605ef9 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:d9:9a,bridge_name='br-int',has_traffic_filtering=True,id=4a3a2b1f-db29-441d-9bf9-7f429760ae05,network=Network(40aa546e-b586-43f8-bfe3-99c3822fb320),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a3a2b1f-db') {{(pid=74960) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 12:44:59 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:44:59 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4a3a2b1f-db, bridge=br-int, if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:44:59 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:44:59 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:44:59 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:44:59 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:44:59 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5f20ca09-049e-4a1d-b2f7-a8dd480939d0) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:44:59 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:44:59 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:44:59 user nova-compute[74960]: INFO os_vif [None req-24a1174b-182f-4a5d-9c7c-ac1a91605ef9 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:d9:9a,bridge_name='br-int',has_traffic_filtering=True,id=4a3a2b1f-db29-441d-9bf9-7f429760ae05,network=Network(40aa546e-b586-43f8-bfe3-99c3822fb320),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a3a2b1f-db')
Nov 03 12:44:59 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-24a1174b-182f-4a5d-9c7c-ac1a91605ef9 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a] Deleting instance files /opt/stack/data/nova/instances/35e02c80-f626-4918-93f1-6b9a7f778c7a_del
Nov 03 12:44:59 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-24a1174b-182f-4a5d-9c7c-ac1a91605ef9 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a] Deletion of /opt/stack/data/nova/instances/35e02c80-f626-4918-93f1-6b9a7f778c7a_del complete
Nov 03 12:44:59 user nova-compute[74960]: INFO nova.compute.manager [None req-24a1174b-182f-4a5d-9c7c-ac1a91605ef9 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 03 12:44:59 user nova-compute[74960]: DEBUG oslo.service.loopingcall [None req-24a1174b-182f-4a5d-9c7c-ac1a91605ef9 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74960) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 12:44:59 user nova-compute[74960]: DEBUG nova.compute.manager [-] [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a] Deallocating network for instance {{(pid=74960) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 12:44:59 user nova-compute[74960]: DEBUG nova.network.neutron [-] [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a] deallocate_for_instance() {{(pid=74960) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 12:44:59 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-51ef5c56-3bb5-4b44-bdfb-eda1ddcb53eb tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.379s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:44:59 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-51ef5c56-3bb5-4b44-bdfb-eda1ddcb53eb tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] <== connect_volume: return (1380ms) {'type': 'block', 'scsi_wwn': '26633353531363337', 'path': '/dev/sdc'} {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:44:59 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51ef5c56-3bb5-4b44-bdfb-eda1ddcb53eb tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: cce474db-fa6f-4670-9be7-88a3e62caa60] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26633353531363337', 'path': '/dev/sdc'} {{(pid=74960) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 12:44:59 user nova-compute[74960]: DEBUG nova.objects.instance [None req-51ef5c56-3bb5-4b44-bdfb-eda1ddcb53eb tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Lazy-loading 'flavor' on Instance uuid cce474db-fa6f-4670-9be7-88a3e62caa60 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:44:59 user nova-compute[74960]: DEBUG nova.virt.libvirt.guest [None req-51ef5c56-3bb5-4b44-bdfb-eda1ddcb53eb tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] attach device xml: <disk type="block" device="disk">
Nov 03 12:44:59 user nova-compute[74960]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 12:44:59 user nova-compute[74960]:   <source dev="/dev/sdc"/>
Nov 03 12:44:59 user nova-compute[74960]:   <target dev="vdb" bus="virtio"/>
Nov 03 12:44:59 user nova-compute[74960]:   <serial>ade00ce0-c0e8-4dba-b496-853713ed7ee5</serial>
Nov 03 12:44:59 user nova-compute[74960]: </disk>
Nov 03 12:44:59 user nova-compute[74960]:  {{(pid=74960) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 03 12:45:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:45:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:45:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:45:00 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:45:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:45:00 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-51ef5c56-3bb5-4b44-bdfb-eda1ddcb53eb tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] No BDM found with device name vda, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:45:00 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-51ef5c56-3bb5-4b44-bdfb-eda1ddcb53eb tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:45:00 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-51ef5c56-3bb5-4b44-bdfb-eda1ddcb53eb tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] No VIF found with MAC fa:16:3e:de:f4:80, not building metadata {{(pid=74960) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 12:45:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:45:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:45:00 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-51ef5c56-3bb5-4b44-bdfb-eda1ddcb53eb tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Lock "cce474db-fa6f-4670-9be7-88a3e62caa60" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 42.283s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:45:01 user nova-compute[74960]: DEBUG nova.network.neutron [-] [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a] Updating instance_info_cache with network_info: [] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:45:01 user nova-compute[74960]: INFO nova.compute.manager [-] [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a] Took 1.29 seconds to deallocate network for instance.
Nov 03 12:45:01 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-24a1174b-182f-4a5d-9c7c-ac1a91605ef9 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:45:01 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-24a1174b-182f-4a5d-9c7c-ac1a91605ef9 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:45:01 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-24a1174b-182f-4a5d-9c7c-ac1a91605ef9 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:45:01 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-24a1174b-182f-4a5d-9c7c-ac1a91605ef9 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:45:01 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-24a1174b-182f-4a5d-9c7c-ac1a91605ef9 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.287s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:45:01 user nova-compute[74960]: DEBUG nova.compute.manager [req-af10f9cb-51e4-4f88-9c58-0d08822b9210 req-79347690-693f-42bd-b8fd-240fc72b26f3 service nova] [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a] Received event network-vif-plugged-4a3a2b1f-db29-441d-9bf9-7f429760ae05 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:45:01 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-af10f9cb-51e4-4f88-9c58-0d08822b9210 req-79347690-693f-42bd-b8fd-240fc72b26f3 service nova] Acquiring lock "35e02c80-f626-4918-93f1-6b9a7f778c7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:45:01 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-af10f9cb-51e4-4f88-9c58-0d08822b9210 req-79347690-693f-42bd-b8fd-240fc72b26f3 service nova] Lock "35e02c80-f626-4918-93f1-6b9a7f778c7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:45:01 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-af10f9cb-51e4-4f88-9c58-0d08822b9210 req-79347690-693f-42bd-b8fd-240fc72b26f3 service nova] Lock "35e02c80-f626-4918-93f1-6b9a7f778c7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:45:01 user nova-compute[74960]: DEBUG nova.compute.manager [req-af10f9cb-51e4-4f88-9c58-0d08822b9210 req-79347690-693f-42bd-b8fd-240fc72b26f3 service nova] [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a] No waiting events found dispatching network-vif-plugged-4a3a2b1f-db29-441d-9bf9-7f429760ae05 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:45:01 user nova-compute[74960]: WARNING nova.compute.manager [req-af10f9cb-51e4-4f88-9c58-0d08822b9210 req-79347690-693f-42bd-b8fd-240fc72b26f3 service nova] [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a] Received unexpected event network-vif-plugged-4a3a2b1f-db29-441d-9bf9-7f429760ae05 for instance with vm_state deleted and task_state None.
Nov 03 12:45:01 user nova-compute[74960]: DEBUG nova.compute.manager [req-af10f9cb-51e4-4f88-9c58-0d08822b9210 req-79347690-693f-42bd-b8fd-240fc72b26f3 service nova] [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a] Received event network-vif-plugged-4a3a2b1f-db29-441d-9bf9-7f429760ae05 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:45:01 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-af10f9cb-51e4-4f88-9c58-0d08822b9210 req-79347690-693f-42bd-b8fd-240fc72b26f3 service nova] Acquiring lock "35e02c80-f626-4918-93f1-6b9a7f778c7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:45:01 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-af10f9cb-51e4-4f88-9c58-0d08822b9210 req-79347690-693f-42bd-b8fd-240fc72b26f3 service nova] Lock "35e02c80-f626-4918-93f1-6b9a7f778c7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:45:01 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-af10f9cb-51e4-4f88-9c58-0d08822b9210 req-79347690-693f-42bd-b8fd-240fc72b26f3 service nova] Lock "35e02c80-f626-4918-93f1-6b9a7f778c7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:45:01 user nova-compute[74960]: DEBUG nova.compute.manager [req-af10f9cb-51e4-4f88-9c58-0d08822b9210 req-79347690-693f-42bd-b8fd-240fc72b26f3 service nova] [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a] No waiting events found dispatching network-vif-plugged-4a3a2b1f-db29-441d-9bf9-7f429760ae05 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:45:01 user nova-compute[74960]: WARNING nova.compute.manager [req-af10f9cb-51e4-4f88-9c58-0d08822b9210 req-79347690-693f-42bd-b8fd-240fc72b26f3 service nova] [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a] Received unexpected event network-vif-plugged-4a3a2b1f-db29-441d-9bf9-7f429760ae05 for instance with vm_state deleted and task_state None.
Nov 03 12:45:01 user nova-compute[74960]: DEBUG nova.compute.manager [req-af10f9cb-51e4-4f88-9c58-0d08822b9210 req-79347690-693f-42bd-b8fd-240fc72b26f3 service nova] [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a] Received event network-vif-plugged-4a3a2b1f-db29-441d-9bf9-7f429760ae05 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:45:01 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-af10f9cb-51e4-4f88-9c58-0d08822b9210 req-79347690-693f-42bd-b8fd-240fc72b26f3 service nova] Acquiring lock "35e02c80-f626-4918-93f1-6b9a7f778c7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:45:01 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-af10f9cb-51e4-4f88-9c58-0d08822b9210 req-79347690-693f-42bd-b8fd-240fc72b26f3 service nova] Lock "35e02c80-f626-4918-93f1-6b9a7f778c7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:45:01 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-af10f9cb-51e4-4f88-9c58-0d08822b9210 req-79347690-693f-42bd-b8fd-240fc72b26f3 service nova] Lock "35e02c80-f626-4918-93f1-6b9a7f778c7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:45:01 user nova-compute[74960]: DEBUG nova.compute.manager [req-af10f9cb-51e4-4f88-9c58-0d08822b9210 req-79347690-693f-42bd-b8fd-240fc72b26f3 service nova] [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a] No waiting events found dispatching network-vif-plugged-4a3a2b1f-db29-441d-9bf9-7f429760ae05 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:45:01 user nova-compute[74960]: WARNING nova.compute.manager [req-af10f9cb-51e4-4f88-9c58-0d08822b9210 req-79347690-693f-42bd-b8fd-240fc72b26f3 service nova] [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a] Received unexpected event network-vif-plugged-4a3a2b1f-db29-441d-9bf9-7f429760ae05 for instance with vm_state deleted and task_state None.
Nov 03 12:45:01 user nova-compute[74960]: DEBUG nova.compute.manager [req-af10f9cb-51e4-4f88-9c58-0d08822b9210 req-79347690-693f-42bd-b8fd-240fc72b26f3 service nova] [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a] Received event network-vif-unplugged-4a3a2b1f-db29-441d-9bf9-7f429760ae05 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:45:01 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-af10f9cb-51e4-4f88-9c58-0d08822b9210 req-79347690-693f-42bd-b8fd-240fc72b26f3 service nova] Acquiring lock "35e02c80-f626-4918-93f1-6b9a7f778c7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:45:01 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-af10f9cb-51e4-4f88-9c58-0d08822b9210 req-79347690-693f-42bd-b8fd-240fc72b26f3 service nova] Lock "35e02c80-f626-4918-93f1-6b9a7f778c7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:45:01 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-af10f9cb-51e4-4f88-9c58-0d08822b9210 req-79347690-693f-42bd-b8fd-240fc72b26f3 service nova] Lock "35e02c80-f626-4918-93f1-6b9a7f778c7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:45:01 user nova-compute[74960]: DEBUG nova.compute.manager [req-af10f9cb-51e4-4f88-9c58-0d08822b9210 req-79347690-693f-42bd-b8fd-240fc72b26f3 service nova] [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a] No waiting events found dispatching network-vif-unplugged-4a3a2b1f-db29-441d-9bf9-7f429760ae05 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:45:01 user nova-compute[74960]: WARNING nova.compute.manager [req-af10f9cb-51e4-4f88-9c58-0d08822b9210 req-79347690-693f-42bd-b8fd-240fc72b26f3 service nova] [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a] Received unexpected event network-vif-unplugged-4a3a2b1f-db29-441d-9bf9-7f429760ae05 for instance with vm_state deleted and task_state None.
Nov 03 12:45:01 user nova-compute[74960]: DEBUG nova.compute.manager [req-af10f9cb-51e4-4f88-9c58-0d08822b9210 req-79347690-693f-42bd-b8fd-240fc72b26f3 service nova] [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a] Received event network-vif-plugged-4a3a2b1f-db29-441d-9bf9-7f429760ae05 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:45:01 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-af10f9cb-51e4-4f88-9c58-0d08822b9210 req-79347690-693f-42bd-b8fd-240fc72b26f3 service nova] Acquiring lock "35e02c80-f626-4918-93f1-6b9a7f778c7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:45:01 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-af10f9cb-51e4-4f88-9c58-0d08822b9210 req-79347690-693f-42bd-b8fd-240fc72b26f3 service nova] Lock "35e02c80-f626-4918-93f1-6b9a7f778c7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:45:01 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-af10f9cb-51e4-4f88-9c58-0d08822b9210 req-79347690-693f-42bd-b8fd-240fc72b26f3 service nova] Lock "35e02c80-f626-4918-93f1-6b9a7f778c7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:45:01 user nova-compute[74960]: DEBUG nova.compute.manager [req-af10f9cb-51e4-4f88-9c58-0d08822b9210 req-79347690-693f-42bd-b8fd-240fc72b26f3 service nova] [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a] No waiting events found dispatching network-vif-plugged-4a3a2b1f-db29-441d-9bf9-7f429760ae05 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:45:01 user nova-compute[74960]: WARNING nova.compute.manager [req-af10f9cb-51e4-4f88-9c58-0d08822b9210 req-79347690-693f-42bd-b8fd-240fc72b26f3 service nova] [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a] Received unexpected event network-vif-plugged-4a3a2b1f-db29-441d-9bf9-7f429760ae05 for instance with vm_state deleted and task_state None.
Nov 03 12:45:01 user nova-compute[74960]: DEBUG nova.compute.manager [req-af10f9cb-51e4-4f88-9c58-0d08822b9210 req-79347690-693f-42bd-b8fd-240fc72b26f3 service nova] [instance: 35e02c80-f626-4918-93f1-6b9a7f778c7a] Received event network-vif-deleted-4a3a2b1f-db29-441d-9bf9-7f429760ae05 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:45:01 user nova-compute[74960]: INFO nova.scheduler.client.report [None req-24a1174b-182f-4a5d-9c7c-ac1a91605ef9 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Deleted allocations for instance 35e02c80-f626-4918-93f1-6b9a7f778c7a
Nov 03 12:45:01 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-24a1174b-182f-4a5d-9c7c-ac1a91605ef9 tempest-SnapshotDataIntegrityTests-1334789549 tempest-SnapshotDataIntegrityTests-1334789549-project-member] Lock "35e02c80-f626-4918-93f1-6b9a7f778c7a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.721s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:45:02 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:45:02 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:45:02 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:45:02 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:45:02 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:45:02 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:45:02 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Auditing locally available compute resources for user (node: user) {{(pid=74960) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 12:45:02 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cfe99be-b74b-4fd3-a5d6-a94708992c5b/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:45:02 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cfe99be-b74b-4fd3-a5d6-a94708992c5b/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:45:02 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cfe99be-b74b-4fd3-a5d6-a94708992c5b/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:45:02 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cfe99be-b74b-4fd3-a5d6-a94708992c5b/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:45:02 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74960) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 12:45:02 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f15f5f-8afa-4d7b-bb45-5887184f9ee5/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:45:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f15f5f-8afa-4d7b-bb45-5887184f9ee5/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:45:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f15f5f-8afa-4d7b-bb45-5887184f9ee5/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:45:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f15f5f-8afa-4d7b-bb45-5887184f9ee5/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:45:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47eb8ddf-590f-4ffa-87c8-377cf1ee0f67/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:45:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47eb8ddf-590f-4ffa-87c8-377cf1ee0f67/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:45:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47eb8ddf-590f-4ffa-87c8-377cf1ee0f67/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:45:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47eb8ddf-590f-4ffa-87c8-377cf1ee0f67/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:45:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60658b54-5e34-4a2b-be14-124e47e291c2/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:45:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60658b54-5e34-4a2b-be14-124e47e291c2/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:45:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60658b54-5e34-4a2b-be14-124e47e291c2/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:45:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60658b54-5e34-4a2b-be14-124e47e291c2/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:45:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk.rescue --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:45:04 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk.rescue --force-share --output=json" returned: 0 in 0.201s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:45:04 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk.rescue --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:45:04 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:45:04 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:45:04 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:45:04 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:45:04 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:45:04 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:45:04 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cce474db-fa6f-4670-9be7-88a3e62caa60/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:45:04 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cce474db-fa6f-4670-9be7-88a3e62caa60/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:45:04 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cce474db-fa6f-4670-9be7-88a3e62caa60/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:45:05 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cce474db-fa6f-4670-9be7-88a3e62caa60/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:45:05 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74960) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 12:45:05 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fe524ec-5fb2-4399-bc41-5898413ff9d4/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:45:05 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fe524ec-5fb2-4399-bc41-5898413ff9d4/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:45:05 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fe524ec-5fb2-4399-bc41-5898413ff9d4/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:45:05 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fe524ec-5fb2-4399-bc41-5898413ff9d4/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:45:05 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:45:05 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:45:05 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Hypervisor/Node resource view: name=user free_ram=8127MB free_disk=24.687957763671875GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74960) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 12:45:05 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:45:05 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:45:06 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 87f15f5f-8afa-4d7b-bb45-5887184f9ee5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:45:06 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:45:06 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:45:06 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 60658b54-5e34-4a2b-be14-124e47e291c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:45:06 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 3cfe99be-b74b-4fd3-a5d6-a94708992c5b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:45:06 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance cce474db-fa6f-4670-9be7-88a3e62caa60 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:45:06 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 6fe524ec-5fb2-4399-bc41-5898413ff9d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:45:06 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74960) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 12:45:06 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74960) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 12:45:06 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:45:06 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:45:06 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Compute_service record updated for user:user {{(pid=74960) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 12:45:06 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.371s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:45:08 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-81826da3-3dc6-45d8-a58e-56c6429e5bfd tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Acquiring lock "cce474db-fa6f-4670-9be7-88a3e62caa60" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:45:08 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-81826da3-3dc6-45d8-a58e-56c6429e5bfd tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Lock "cce474db-fa6f-4670-9be7-88a3e62caa60" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:45:08 user nova-compute[74960]: DEBUG nova.objects.instance [None req-81826da3-3dc6-45d8-a58e-56c6429e5bfd tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Lazy-loading 'flavor' on Instance uuid cce474db-fa6f-4670-9be7-88a3e62caa60 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:45:08 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-81826da3-3dc6-45d8-a58e-56c6429e5bfd tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Lock "cce474db-fa6f-4670-9be7-88a3e62caa60" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:45:08 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-81826da3-3dc6-45d8-a58e-56c6429e5bfd tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Acquiring lock "cce474db-fa6f-4670-9be7-88a3e62caa60" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:45:08 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-81826da3-3dc6-45d8-a58e-56c6429e5bfd tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Lock "cce474db-fa6f-4670-9be7-88a3e62caa60" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:45:08 user nova-compute[74960]: INFO nova.compute.manager [None req-81826da3-3dc6-45d8-a58e-56c6429e5bfd tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: cce474db-fa6f-4670-9be7-88a3e62caa60] Attaching volume 2ca2e1f1-1ec0-4d7f-a3d4-2f7830d0dbc9 to /dev/vdc
Nov 03 12:45:08 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:45:08 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Starting heal instance info cache {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 12:45:08 user nova-compute[74960]: DEBUG os_brick.utils [None req-81826da3-3dc6-45d8-a58e-56c6429e5bfd tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:45:08 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:45:08 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:45:08 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[b635966b-2738-4fba-a750-b4b5545e04b8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:75b8e219756\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:45:08 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:45:08 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:45:08 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[b61563cc-0958-420f-bac3-62dea08892ec]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:45:08 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:45:08 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:45:08 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[46eb177c-48ab-4ae9-b3df-546bb21e4571]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:45:08 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[273dee4d-c3a3-4924-9a47-6653e369509a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:45:08 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-81826da3-3dc6-45d8-a58e-56c6429e5bfd tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Running cmd (subprocess): nvme version {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:45:08 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-81826da3-3dc6-45d8-a58e-56c6429e5bfd tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] 'nvme version' failed. Not Retrying. {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 12:45:08 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "refresh_cache-47eb8ddf-590f-4ffa-87c8-377cf1ee0f67" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:45:08 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquired lock "refresh_cache-47eb8ddf-590f-4ffa-87c8-377cf1ee0f67" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:45:08 user nova-compute[74960]: DEBUG nova.network.neutron [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67] Forcefully refreshing network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 12:45:08 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.nvmeof [None req-81826da3-3dc6-45d8-a58e-56c6429e5bfd tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] nvme not present on system {{(pid=74960) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 12:45:08 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:45:08 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 12:45:08 user nova-compute[74960]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 12:45:08 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd8c930c-9a9d-45bf-b026-657e9d9bc34f]: (4, '') {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:45:08 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-81826da3-3dc6-45d8-a58e-56c6429e5bfd tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74960) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 12:45:08 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-81826da3-3dc6-45d8-a58e-56c6429e5bfd tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74960) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 12:45:08 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-81826da3-3dc6-45d8-a58e-56c6429e5bfd tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] LIGHTOS: no hostnqn found. {{(pid=74960) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 12:45:08 user nova-compute[74960]: DEBUG os_brick.utils [None req-81826da3-3dc6-45d8-a58e-56c6429e5bfd tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:75b8e219756', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:45:08 user nova-compute[74960]: DEBUG nova.virt.block_device [None req-81826da3-3dc6-45d8-a58e-56c6429e5bfd tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: cce474db-fa6f-4670-9be7-88a3e62caa60] Updating existing volume attachment record: 425ae7f3-007e-43bc-a414-b38942c88b4a {{(pid=74960) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 12:45:09 user nova-compute[74960]: DEBUG nova.network.neutron [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67] Updating instance_info_cache with network_info: [{"id": "844c85e9-5021-433d-9f93-530ec193e265", "address": "fa:16:3e:69:d8:32", "network": {"id": "9a9a848a-80be-4281-8554-8e28744073b3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1579909169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "434ce6c4b77342299a17e547a14e3918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap844c85e9-50", "ovs_interfaceid": "844c85e9-5021-433d-9f93-530ec193e265", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:45:09 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Releasing lock "refresh_cache-47eb8ddf-590f-4ffa-87c8-377cf1ee0f67" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:45:09 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67] Updated the network info_cache for instance {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 12:45:09 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:45:09 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:45:09 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:45:09 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74960) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 12:45:09 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:45:10 user nova-compute[74960]: DEBUG nova.compute.manager [req-97f948f2-55d4-49bc-b007-a726865f6253 req-b2533984-1d39-405e-a942-de77dbb7fdae service nova] [instance: 6fe524ec-5fb2-4399-bc41-5898413ff9d4] Received event network-changed-348e9fcf-472e-432b-b7f5-a706b7f5c4e2 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:45:10 user nova-compute[74960]: DEBUG nova.compute.manager [req-97f948f2-55d4-49bc-b007-a726865f6253 req-b2533984-1d39-405e-a942-de77dbb7fdae service nova] [instance: 6fe524ec-5fb2-4399-bc41-5898413ff9d4] Refreshing instance network info cache due to event network-changed-348e9fcf-472e-432b-b7f5-a706b7f5c4e2. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 12:45:10 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-97f948f2-55d4-49bc-b007-a726865f6253 req-b2533984-1d39-405e-a942-de77dbb7fdae service nova] Acquiring lock "refresh_cache-6fe524ec-5fb2-4399-bc41-5898413ff9d4" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:45:10 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-97f948f2-55d4-49bc-b007-a726865f6253 req-b2533984-1d39-405e-a942-de77dbb7fdae service nova] Acquired lock "refresh_cache-6fe524ec-5fb2-4399-bc41-5898413ff9d4" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:45:10 user nova-compute[74960]: DEBUG nova.network.neutron [req-97f948f2-55d4-49bc-b007-a726865f6253 req-b2533984-1d39-405e-a942-de77dbb7fdae service nova] [instance: 6fe524ec-5fb2-4399-bc41-5898413ff9d4] Refreshing network info cache for port 348e9fcf-472e-432b-b7f5-a706b7f5c4e2 {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 12:45:10 user nova-compute[74960]: DEBUG nova.network.neutron [req-97f948f2-55d4-49bc-b007-a726865f6253 req-b2533984-1d39-405e-a942-de77dbb7fdae service nova] [instance: 6fe524ec-5fb2-4399-bc41-5898413ff9d4] Updated VIF entry in instance network info cache for port 348e9fcf-472e-432b-b7f5-a706b7f5c4e2. {{(pid=74960) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 12:45:10 user nova-compute[74960]: DEBUG nova.network.neutron [req-97f948f2-55d4-49bc-b007-a726865f6253 req-b2533984-1d39-405e-a942-de77dbb7fdae service nova] [instance: 6fe524ec-5fb2-4399-bc41-5898413ff9d4] Updating instance_info_cache with network_info: [{"id": "348e9fcf-472e-432b-b7f5-a706b7f5c4e2", "address": "fa:16:3e:2d:7c:be", "network": {"id": "6c29b2f1-0c30-45d5-ade3-f792d5af7037", "bridge": "br-int", "label": "tempest-TestStampPattern-1770578791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df8ca5bb565b48648e39e6c128f54a57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap348e9fcf-47", "ovs_interfaceid": "348e9fcf-472e-432b-b7f5-a706b7f5c4e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:45:10 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-97f948f2-55d4-49bc-b007-a726865f6253 req-b2533984-1d39-405e-a942-de77dbb7fdae service nova] Releasing lock "refresh_cache-6fe524ec-5fb2-4399-bc41-5898413ff9d4" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:45:10 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-1f0c7fd9-45c5-4302-9a3b-6e94dff576fe tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Acquiring lock "6fe524ec-5fb2-4399-bc41-5898413ff9d4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:45:10 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-1f0c7fd9-45c5-4302-9a3b-6e94dff576fe tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Lock "6fe524ec-5fb2-4399-bc41-5898413ff9d4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:45:10 user nova-compute[74960]: DEBUG nova.objects.instance [None req-1f0c7fd9-45c5-4302-9a3b-6e94dff576fe tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Lazy-loading 'flavor' on Instance uuid 6fe524ec-5fb2-4399-bc41-5898413ff9d4 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:45:10 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-1f0c7fd9-45c5-4302-9a3b-6e94dff576fe tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Lock "6fe524ec-5fb2-4399-bc41-5898413ff9d4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:45:11 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-1f0c7fd9-45c5-4302-9a3b-6e94dff576fe tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Acquiring lock "6fe524ec-5fb2-4399-bc41-5898413ff9d4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:45:11 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-1f0c7fd9-45c5-4302-9a3b-6e94dff576fe tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Lock "6fe524ec-5fb2-4399-bc41-5898413ff9d4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:45:11 user nova-compute[74960]: INFO nova.compute.manager [None req-1f0c7fd9-45c5-4302-9a3b-6e94dff576fe tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] [instance: 6fe524ec-5fb2-4399-bc41-5898413ff9d4] Attaching volume 19275544-a880-4e5e-8ce6-312415cdbedb to /dev/vdb
Nov 03 12:45:11 user nova-compute[74960]: DEBUG os_brick.utils [None req-1f0c7fd9-45c5-4302-9a3b-6e94dff576fe tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:45:11 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:45:11 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:45:11 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8c5f0dc-ab16-4b9d-a1be-a33743a9673d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:75b8e219756\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:45:11 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:45:11 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:45:11 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[a149f8f0-7789-40af-bca2-9d8dc3f02c80]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:45:11 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:45:11 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:45:11 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[64b973b2-c078-413c-83d1-34261ef931ca]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:45:11 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[516d8faa-088e-4b5c-8508-8d202365f0fa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:45:11 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-1f0c7fd9-45c5-4302-9a3b-6e94dff576fe tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Running cmd (subprocess): nvme version {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:45:11 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-1f0c7fd9-45c5-4302-9a3b-6e94dff576fe tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] 'nvme version' failed. Not Retrying. {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 12:45:11 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1f0c7fd9-45c5-4302-9a3b-6e94dff576fe tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] nvme not present on system {{(pid=74960) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 12:45:11 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:45:11 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 12:45:11 user nova-compute[74960]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 12:45:11 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[8940e512-dddd-4a5b-9180-c736af98960f]: (4, '') {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:45:11 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-1f0c7fd9-45c5-4302-9a3b-6e94dff576fe tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74960) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 12:45:11 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-1f0c7fd9-45c5-4302-9a3b-6e94dff576fe tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74960) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 12:45:11 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-1f0c7fd9-45c5-4302-9a3b-6e94dff576fe tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] LIGHTOS: no hostnqn found. {{(pid=74960) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 12:45:11 user nova-compute[74960]: DEBUG os_brick.utils [None req-1f0c7fd9-45c5-4302-9a3b-6e94dff576fe tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:75b8e219756', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:45:11 user nova-compute[74960]: DEBUG nova.virt.block_device [None req-1f0c7fd9-45c5-4302-9a3b-6e94dff576fe tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] [instance: 6fe524ec-5fb2-4399-bc41-5898413ff9d4] Updating existing volume attachment record: db37c7e8-5680-447d-b219-621ee2c400ff {{(pid=74960) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 12:45:13 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:45:14 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:45:17 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:45:18 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:45:19 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:45:23 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:45:24 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:45:28 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81826da3-3dc6-45d8-a58e-56c6429e5bfd tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: cce474db-fa6f-4670-9be7-88a3e62caa60] Calling os-brick to attach iSCSI Volume {{(pid=74960) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 12:45:28 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-81826da3-3dc6-45d8-a58e-56c6429e5bfd tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9aa420acb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2ca2e1f1-1ec0-4d7f-a3d4-2f7830d0dbc9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JvNkWiLH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:45:28 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-81826da3-3dc6-45d8-a58e-56c6429e5bfd tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:45:28 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-81826da3-3dc6-45d8-a58e-56c6429e5bfd tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:45:28 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-81826da3-3dc6-45d8-a58e-56c6429e5bfd tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:45:28 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-81826da3-3dc6-45d8-a58e-56c6429e5bfd tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:45:28 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-81826da3-3dc6-45d8-a58e-56c6429e5bfd tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ca2e1f1-1ec0-4d7f-a3d4-2f7830d0dbc9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:45:28 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-81826da3-3dc6-45d8-a58e-56c6429e5bfd tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ca2e1f1-1ec0-4d7f-a3d4-2f7830d0dbc9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:45:28 user nova-compute[74960]: INFO os_brick.initiator.connectors.iscsi [None req-81826da3-3dc6-45d8-a58e-56c6429e5bfd tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 12:45:28 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ca2e1f1-1ec0-4d7f-a3d4-2f7830d0dbc9 -p 172.16.0.220:3260 {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:45:28 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ca2e1f1-1ec0-4d7f-a3d4-2f7830d0dbc9 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:45:28 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e5a0a8-9439-4dad-9c73-cea614ff183b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:45:28 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-81826da3-3dc6-45d8-a58e-56c6429e5bfd tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 12:45:28 user nova-compute[74960]:  {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:45:28 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ca2e1f1-1ec0-4d7f-a3d4-2f7830d0dbc9 -p 172.16.0.220:3260 --interface default --op new {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:45:28 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ca2e1f1-1ec0-4d7f-a3d4-2f7830d0dbc9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:45:28 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[8915560b-ae65-4a89-b772-ce5f1821b473]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2ca2e1f1-1ec0-4d7f-a3d4-2f7830d0dbc9] added\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:45:28 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-81826da3-3dc6-45d8-a58e-56c6429e5bfd tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2ca2e1f1-1ec0-4d7f-a3d4-2f7830d0dbc9] added
Nov 03 12:45:28 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:45:28 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ca2e1f1-1ec0-4d7f-a3d4-2f7830d0dbc9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:45:28 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ca2e1f1-1ec0-4d7f-a3d4-2f7830d0dbc9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:45:28 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[17359213-a162-452e-8d26-db2d337c7bf6]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:45:28 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-81826da3-3dc6-45d8-a58e-56c6429e5bfd tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:45:28 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ca2e1f1-1ec0-4d7f-a3d4-2f7830d0dbc9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:45:28 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ca2e1f1-1ec0-4d7f-a3d4-2f7830d0dbc9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:45:28 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f347a3d-d571-48f0-944b-958c7549114b]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:45:28 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-81826da3-3dc6-45d8-a58e-56c6429e5bfd tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:45:28 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ca2e1f1-1ec0-4d7f-a3d4-2f7830d0dbc9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JvNkWiLH {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:45:28 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ca2e1f1-1ec0-4d7f-a3d4-2f7830d0dbc9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JvNkWiLH" returned: 0 in 0.021s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:45:28 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[f190cf33-35da-4337-97d3-140f6dc5716e]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:45:28 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-81826da3-3dc6-45d8-a58e-56c6429e5bfd tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JvNkWiLH'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:45:28 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ca2e1f1-1ec0-4d7f-a3d4-2f7830d0dbc9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:45:28 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ca2e1f1-1ec0-4d7f-a3d4-2f7830d0dbc9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:45:28 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dd8320a-6a7c-439c-a3b2-a99ccdf34b12]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:45:28 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-81826da3-3dc6-45d8-a58e-56c6429e5bfd tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:45:28 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:45:28 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:45:28 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dc07d89-390a-4309-b7f0-9617fcc25476]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4c6cd96-5bb9-496e-aaa7-37f872cee704 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade00ce0-c0e8-4dba-b496-853713ed7ee5 (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:45:28 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-81826da3-3dc6-45d8-a58e-56c6429e5bfd tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4c6cd96-5bb9-496e-aaa7-37f872cee704 (non-flash)
Nov 03 12:45:28 user nova-compute[74960]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade00ce0-c0e8-4dba-b496-853713ed7ee5 (non-flash)
Nov 03 12:45:28 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:45:28 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-81826da3-3dc6-45d8-a58e-56c6429e5bfd tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4c6cd96-5bb9-496e-aaa7-37f872cee704 (non-flash)
Nov 03 12:45:28 user nova-compute[74960]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade00ce0-c0e8-4dba-b496-853713ed7ee5 (non-flash)
Nov 03 12:45:28 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:45:28 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ca2e1f1-1ec0-4d7f-a3d4-2f7830d0dbc9 -p 172.16.0.220:3260 --login {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:45:28 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ca2e1f1-1ec0-4d7f-a3d4-2f7830d0dbc9 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:45:28 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9679b98-01be-43fd-8802-2b02be5f4865]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2ca2e1f1-1ec0-4d7f-a3d4-2f7830d0dbc9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2ca2e1f1-1ec0-4d7f-a3d4-2f7830d0dbc9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:45:28 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-81826da3-3dc6-45d8-a58e-56c6429e5bfd tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2ca2e1f1-1ec0-4d7f-a3d4-2f7830d0dbc9, portal: 172.16.0.220,3260]
Nov 03 12:45:28 user nova-compute[74960]: Login to [iface: default, target: iqn.2010-10.org.openstack:2ca2e1f1-1ec0-4d7f-a3d4-2f7830d0dbc9, portal: 172.16.0.220,3260] successful.
Nov 03 12:45:28 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:45:28 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ca2e1f1-1ec0-4d7f-a3d4-2f7830d0dbc9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:45:28 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ca2e1f1-1ec0-4d7f-a3d4-2f7830d0dbc9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:45:28 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[d261d51d-c94f-46ed-9dbf-1ca68ac632a4]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:45:28 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-81826da3-3dc6-45d8-a58e-56c6429e5bfd tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:45:28 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:45:28 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:45:28 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0ded64a-6c9b-444a-9f40-bd100206259e]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4c6cd96-5bb9-496e-aaa7-37f872cee704 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade00ce0-c0e8-4dba-b496-853713ed7ee5 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca2e1f1-1ec0-4d7f-a3d4-2f7830d0dbc9 (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:45:28 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-81826da3-3dc6-45d8-a58e-56c6429e5bfd tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4c6cd96-5bb9-496e-aaa7-37f872cee704 (non-flash)
Nov 03 12:45:28 user nova-compute[74960]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade00ce0-c0e8-4dba-b496-853713ed7ee5 (non-flash)
Nov 03 12:45:28 user nova-compute[74960]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca2e1f1-1ec0-4d7f-a3d4-2f7830d0dbc9 (non-flash)
Nov 03 12:45:28 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:45:28 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-81826da3-3dc6-45d8-a58e-56c6429e5bfd tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4c6cd96-5bb9-496e-aaa7-37f872cee704 (non-flash)
Nov 03 12:45:28 user nova-compute[74960]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade00ce0-c0e8-4dba-b496-853713ed7ee5 (non-flash)
Nov 03 12:45:28 user nova-compute[74960]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca2e1f1-1ec0-4d7f-a3d4-2f7830d0dbc9 (non-flash)
Nov 03 12:45:28 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:45:28 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-81826da3-3dc6-45d8-a58e-56c6429e5bfd tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ca2e1f1-1ec0-4d7f-a3d4-2f7830d0dbc9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:45:28 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-81826da3-3dc6-45d8-a58e-56c6429e5bfd tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Connected to 172.16.0.220:3260 {{(pid=74960) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 12:45:28 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-81826da3-3dc6-45d8-a58e-56c6429e5bfd tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] HCTL ('35', '-', '-', 0) found on session 41 with lun 0 {{(pid=74960) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 12:45:28 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-81826da3-3dc6-45d8-a58e-56c6429e5bfd tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74960) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 12:45:28 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:45:28 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:45:28 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5ae72fe-85ad-4a66-8312-9ef47d1b5cad]: (4, ('- - 0', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:45:28 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-81826da3-3dc6-45d8-a58e-56c6429e5bfd tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Searching for a device in session 41 and hctl ['35', '*', '*', 0] yield: None {{(pid=74960) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 12:45:28 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:45:29 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-81826da3-3dc6-45d8-a58e-56c6429e5bfd tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Searching for a device in session 41 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74960) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 12:45:29 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-81826da3-3dc6-45d8-a58e-56c6429e5bfd tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:2ca2e1f1-1ec0-4d7f-a3d4-2f7830d0dbc9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JvNkWiLH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74960) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 12:45:29 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-81826da3-3dc6-45d8-a58e-56c6429e5bfd tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.312s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:45:29 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-81826da3-3dc6-45d8-a58e-56c6429e5bfd tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] <== connect_volume: return (1313ms) {'type': 'block', 'scsi_wwn': '23964663430613630', 'path': '/dev/sdd'} {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:45:29 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81826da3-3dc6-45d8-a58e-56c6429e5bfd tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: cce474db-fa6f-4670-9be7-88a3e62caa60] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23964663430613630', 'path': '/dev/sdd'} {{(pid=74960) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 12:45:29 user nova-compute[74960]: DEBUG nova.objects.instance [None req-81826da3-3dc6-45d8-a58e-56c6429e5bfd tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Lazy-loading 'flavor' on Instance uuid cce474db-fa6f-4670-9be7-88a3e62caa60 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:45:29 user nova-compute[74960]: DEBUG nova.virt.libvirt.guest [None req-81826da3-3dc6-45d8-a58e-56c6429e5bfd tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] attach device xml: <disk type="block" device="disk">
Nov 03 12:45:29 user nova-compute[74960]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 12:45:29 user nova-compute[74960]:   <source dev="/dev/sdd"/>
Nov 03 12:45:29 user nova-compute[74960]:   <target dev="vdc" bus="virtio"/>
Nov 03 12:45:29 user nova-compute[74960]:   <serial>2ca2e1f1-1ec0-4d7f-a3d4-2f7830d0dbc9</serial>
Nov 03 12:45:29 user nova-compute[74960]: </disk>
Nov 03 12:45:29 user nova-compute[74960]:  {{(pid=74960) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 03 12:45:29 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:45:29 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-81826da3-3dc6-45d8-a58e-56c6429e5bfd tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] No BDM found with device name vda, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:45:29 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-81826da3-3dc6-45d8-a58e-56c6429e5bfd tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:45:29 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-81826da3-3dc6-45d8-a58e-56c6429e5bfd tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:45:29 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-81826da3-3dc6-45d8-a58e-56c6429e5bfd tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] No VIF found with MAC fa:16:3e:de:f4:80, not building metadata {{(pid=74960) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 12:45:30 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-81826da3-3dc6-45d8-a58e-56c6429e5bfd tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Lock "cce474db-fa6f-4670-9be7-88a3e62caa60" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.842s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:45:30 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f0c7fd9-45c5-4302-9a3b-6e94dff576fe tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] [instance: 6fe524ec-5fb2-4399-bc41-5898413ff9d4] Calling os-brick to attach iSCSI Volume {{(pid=74960) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 12:45:30 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f0c7fd9-45c5-4302-9a3b-6e94dff576fe tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9aa420acb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:19275544-a880-4e5e-8ce6-312415cdbedb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'peXRGjTS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:45:30 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-1f0c7fd9-45c5-4302-9a3b-6e94dff576fe tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:45:30 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-1f0c7fd9-45c5-4302-9a3b-6e94dff576fe tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:45:30 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-1f0c7fd9-45c5-4302-9a3b-6e94dff576fe tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:45:30 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-1f0c7fd9-45c5-4302-9a3b-6e94dff576fe tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:45:30 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-1f0c7fd9-45c5-4302-9a3b-6e94dff576fe tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19275544-a880-4e5e-8ce6-312415cdbedb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:45:30 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-1f0c7fd9-45c5-4302-9a3b-6e94dff576fe tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19275544-a880-4e5e-8ce6-312415cdbedb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:45:30 user nova-compute[74960]: INFO os_brick.initiator.connectors.iscsi [None req-1f0c7fd9-45c5-4302-9a3b-6e94dff576fe tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 12:45:30 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19275544-a880-4e5e-8ce6-312415cdbedb -p 172.16.0.220:3260 {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:45:30 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19275544-a880-4e5e-8ce6-312415cdbedb -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:45:30 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[e399c7fe-432b-4b92-b28e-5d9ef86f1b3e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:45:30 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f0c7fd9-45c5-4302-9a3b-6e94dff576fe tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 12:45:30 user nova-compute[74960]:  {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:45:30 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19275544-a880-4e5e-8ce6-312415cdbedb -p 172.16.0.220:3260 --interface default --op new {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:45:30 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19275544-a880-4e5e-8ce6-312415cdbedb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:45:30 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[3276ac37-b294-4b28-b533-75ed83bedce2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:19275544-a880-4e5e-8ce6-312415cdbedb] added\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:45:30 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f0c7fd9-45c5-4302-9a3b-6e94dff576fe tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:19275544-a880-4e5e-8ce6-312415cdbedb] added
Nov 03 12:45:30 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:45:30 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19275544-a880-4e5e-8ce6-312415cdbedb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:45:30 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19275544-a880-4e5e-8ce6-312415cdbedb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:45:30 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[8af84444-ca3d-437b-982d-3db8e3246edb]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:45:30 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f0c7fd9-45c5-4302-9a3b-6e94dff576fe tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:45:30 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19275544-a880-4e5e-8ce6-312415cdbedb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:45:30 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19275544-a880-4e5e-8ce6-312415cdbedb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:45:30 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[19fc0aab-3214-4780-8b38-e76707b868fb]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:45:30 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f0c7fd9-45c5-4302-9a3b-6e94dff576fe tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:45:30 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19275544-a880-4e5e-8ce6-312415cdbedb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v peXRGjTS {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:45:30 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19275544-a880-4e5e-8ce6-312415cdbedb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v peXRGjTS" returned: 0 in 0.017s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:45:30 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f85efcc-5bf5-4485-9e7c-33b9166e1885]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:45:30 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f0c7fd9-45c5-4302-9a3b-6e94dff576fe tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'peXRGjTS'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:45:30 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19275544-a880-4e5e-8ce6-312415cdbedb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:45:30 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19275544-a880-4e5e-8ce6-312415cdbedb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:45:30 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e710603-0bbf-46d4-be12-0705cb6b3865]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:45:30 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f0c7fd9-45c5-4302-9a3b-6e94dff576fe tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:45:30 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:45:30 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:45:30 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[330c4444-c5f9-4174-bf66-45715f9e37a1]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4c6cd96-5bb9-496e-aaa7-37f872cee704 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade00ce0-c0e8-4dba-b496-853713ed7ee5 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca2e1f1-1ec0-4d7f-a3d4-2f7830d0dbc9 (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:45:30 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f0c7fd9-45c5-4302-9a3b-6e94dff576fe tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4c6cd96-5bb9-496e-aaa7-37f872cee704 (non-flash)
Nov 03 12:45:30 user nova-compute[74960]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade00ce0-c0e8-4dba-b496-853713ed7ee5 (non-flash)
Nov 03 12:45:30 user nova-compute[74960]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca2e1f1-1ec0-4d7f-a3d4-2f7830d0dbc9 (non-flash)
Nov 03 12:45:30 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:45:30 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f0c7fd9-45c5-4302-9a3b-6e94dff576fe tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4c6cd96-5bb9-496e-aaa7-37f872cee704 (non-flash)
Nov 03 12:45:30 user nova-compute[74960]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade00ce0-c0e8-4dba-b496-853713ed7ee5 (non-flash)
Nov 03 12:45:30 user nova-compute[74960]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca2e1f1-1ec0-4d7f-a3d4-2f7830d0dbc9 (non-flash)
Nov 03 12:45:30 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:45:30 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19275544-a880-4e5e-8ce6-312415cdbedb -p 172.16.0.220:3260 --login {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:45:30 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19275544-a880-4e5e-8ce6-312415cdbedb -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:45:30 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[d81622d7-0bda-42b8-992d-ff65c056a6ce]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:19275544-a880-4e5e-8ce6-312415cdbedb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:19275544-a880-4e5e-8ce6-312415cdbedb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:45:30 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f0c7fd9-45c5-4302-9a3b-6e94dff576fe tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:19275544-a880-4e5e-8ce6-312415cdbedb, portal: 172.16.0.220,3260]
Nov 03 12:45:30 user nova-compute[74960]: Login to [iface: default, target: iqn.2010-10.org.openstack:19275544-a880-4e5e-8ce6-312415cdbedb, portal: 172.16.0.220,3260] successful.
Nov 03 12:45:30 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:45:30 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19275544-a880-4e5e-8ce6-312415cdbedb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:45:30 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19275544-a880-4e5e-8ce6-312415cdbedb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:45:30 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[a139d177-3e30-487e-a7bb-2f699780f458]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:45:30 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f0c7fd9-45c5-4302-9a3b-6e94dff576fe tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:45:30 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:45:30 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:45:30 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a671ed-f4f0-42c5-9e35-c51ccdf663ab]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4c6cd96-5bb9-496e-aaa7-37f872cee704 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade00ce0-c0e8-4dba-b496-853713ed7ee5 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca2e1f1-1ec0-4d7f-a3d4-2f7830d0dbc9 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19275544-a880-4e5e-8ce6-312415cdbedb (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:45:30 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f0c7fd9-45c5-4302-9a3b-6e94dff576fe tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4c6cd96-5bb9-496e-aaa7-37f872cee704 (non-flash)
Nov 03 12:45:30 user nova-compute[74960]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade00ce0-c0e8-4dba-b496-853713ed7ee5 (non-flash)
Nov 03 12:45:30 user nova-compute[74960]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca2e1f1-1ec0-4d7f-a3d4-2f7830d0dbc9 (non-flash)
Nov 03 12:45:30 user nova-compute[74960]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19275544-a880-4e5e-8ce6-312415cdbedb (non-flash)
Nov 03 12:45:30 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:45:30 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f0c7fd9-45c5-4302-9a3b-6e94dff576fe tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4c6cd96-5bb9-496e-aaa7-37f872cee704 (non-flash)
Nov 03 12:45:30 user nova-compute[74960]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade00ce0-c0e8-4dba-b496-853713ed7ee5 (non-flash)
Nov 03 12:45:30 user nova-compute[74960]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca2e1f1-1ec0-4d7f-a3d4-2f7830d0dbc9 (non-flash)
Nov 03 12:45:30 user nova-compute[74960]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19275544-a880-4e5e-8ce6-312415cdbedb (non-flash)
Nov 03 12:45:30 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:45:30 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-1f0c7fd9-45c5-4302-9a3b-6e94dff576fe tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19275544-a880-4e5e-8ce6-312415cdbedb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:45:30 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f0c7fd9-45c5-4302-9a3b-6e94dff576fe tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Connected to 172.16.0.220:3260 {{(pid=74960) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 12:45:30 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-1f0c7fd9-45c5-4302-9a3b-6e94dff576fe tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] HCTL ('36', '-', '-', 0) found on session 42 with lun 0 {{(pid=74960) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 12:45:30 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-1f0c7fd9-45c5-4302-9a3b-6e94dff576fe tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74960) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 12:45:30 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:45:30 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:45:30 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c4101f1-aafb-4e84-a579-99c5cbe44003]: (4, ('- - 0', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:45:30 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-1f0c7fd9-45c5-4302-9a3b-6e94dff576fe tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Searching for a device in session 42 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74960) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 12:45:30 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f0c7fd9-45c5-4302-9a3b-6e94dff576fe tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:19275544-a880-4e5e-8ce6-312415cdbedb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'peXRGjTS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74960) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 12:45:31 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-789f78f3-6cb4-498c-9926-68a75aa71a9b tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Acquiring lock "cce474db-fa6f-4670-9be7-88a3e62caa60" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:45:31 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-789f78f3-6cb4-498c-9926-68a75aa71a9b tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Lock "cce474db-fa6f-4670-9be7-88a3e62caa60" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:45:31 user nova-compute[74960]: INFO nova.compute.manager [None req-789f78f3-6cb4-498c-9926-68a75aa71a9b tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: cce474db-fa6f-4670-9be7-88a3e62caa60] Detaching volume ade00ce0-c0e8-4dba-b496-853713ed7ee5
Nov 03 12:45:31 user nova-compute[74960]: INFO nova.virt.block_device [None req-789f78f3-6cb4-498c-9926-68a75aa71a9b tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: cce474db-fa6f-4670-9be7-88a3e62caa60] Attempting to driver detach volume ade00ce0-c0e8-4dba-b496-853713ed7ee5 from mountpoint /dev/vdb
Nov 03 12:45:31 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-789f78f3-6cb4-498c-9926-68a75aa71a9b tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Attempting to detach device vdb from instance cce474db-fa6f-4670-9be7-88a3e62caa60 from the persistent domain config. {{(pid=74960) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 03 12:45:31 user nova-compute[74960]: DEBUG nova.virt.libvirt.guest [None req-789f78f3-6cb4-498c-9926-68a75aa71a9b tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 12:45:31 user nova-compute[74960]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 12:45:31 user nova-compute[74960]:   <source dev="/dev/sdc"/>
Nov 03 12:45:31 user nova-compute[74960]:   <target dev="vdb" bus="virtio"/>
Nov 03 12:45:31 user nova-compute[74960]:   <serial>ade00ce0-c0e8-4dba-b496-853713ed7ee5</serial>
Nov 03 12:45:31 user nova-compute[74960]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 12:45:31 user nova-compute[74960]: </disk>
Nov 03 12:45:31 user nova-compute[74960]:  {{(pid=74960) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 12:45:31 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-789f78f3-6cb4-498c-9926-68a75aa71a9b tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Successfully detached device vdb from instance cce474db-fa6f-4670-9be7-88a3e62caa60 from the persistent domain config.
Nov 03 12:45:31 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-789f78f3-6cb4-498c-9926-68a75aa71a9b tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cce474db-fa6f-4670-9be7-88a3e62caa60 from the live domain config. {{(pid=74960) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 03 12:45:31 user nova-compute[74960]: DEBUG nova.virt.libvirt.guest [None req-789f78f3-6cb4-498c-9926-68a75aa71a9b tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 12:45:31 user nova-compute[74960]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 12:45:31 user nova-compute[74960]:   <source dev="/dev/sdc"/>
Nov 03 12:45:31 user nova-compute[74960]:   <target dev="vdb" bus="virtio"/>
Nov 03 12:45:31 user nova-compute[74960]:   <serial>ade00ce0-c0e8-4dba-b496-853713ed7ee5</serial>
Nov 03 12:45:31 user nova-compute[74960]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 12:45:31 user nova-compute[74960]: </disk>
Nov 03 12:45:31 user nova-compute[74960]:  {{(pid=74960) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 12:45:31 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-789f78f3-6cb4-498c-9926-68a75aa71a9b tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cce474db-fa6f-4670-9be7-88a3e62caa60 {{(pid=74960) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 03 12:45:31 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-1f0c7fd9-45c5-4302-9a3b-6e94dff576fe tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.297s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:45:31 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f0c7fd9-45c5-4302-9a3b-6e94dff576fe tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] <== connect_volume: return (1299ms) {'type': 'block', 'scsi_wwn': '26138303930363662', 'path': '/dev/sde'} {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:45:31 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f0c7fd9-45c5-4302-9a3b-6e94dff576fe tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] [instance: 6fe524ec-5fb2-4399-bc41-5898413ff9d4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26138303930363662', 'path': '/dev/sde'} {{(pid=74960) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 12:45:31 user nova-compute[74960]: DEBUG nova.objects.instance [None req-1f0c7fd9-45c5-4302-9a3b-6e94dff576fe tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Lazy-loading 'flavor' on Instance uuid 6fe524ec-5fb2-4399-bc41-5898413ff9d4 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:45:31 user nova-compute[74960]: DEBUG nova.virt.libvirt.guest [None req-1f0c7fd9-45c5-4302-9a3b-6e94dff576fe tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] attach device xml: <disk type="block" device="disk">
Nov 03 12:45:31 user nova-compute[74960]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 12:45:31 user nova-compute[74960]:   <source dev="/dev/sde"/>
Nov 03 12:45:31 user nova-compute[74960]:   <target dev="vdb" bus="virtio"/>
Nov 03 12:45:31 user nova-compute[74960]:   <serial>19275544-a880-4e5e-8ce6-312415cdbedb</serial>
Nov 03 12:45:31 user nova-compute[74960]: </disk>
Nov 03 12:45:31 user nova-compute[74960]:  {{(pid=74960) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 03 12:45:32 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-1f0c7fd9-45c5-4302-9a3b-6e94dff576fe tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] No BDM found with device name vda, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:45:32 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-1f0c7fd9-45c5-4302-9a3b-6e94dff576fe tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:45:32 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-1f0c7fd9-45c5-4302-9a3b-6e94dff576fe tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] No VIF found with MAC fa:16:3e:2d:7c:be, not building metadata {{(pid=74960) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 12:45:32 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-d39c7792-4744-4c89-b2a7-93eb12d648d6 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Acquiring lock "87f15f5f-8afa-4d7b-bb45-5887184f9ee5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:45:32 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-d39c7792-4744-4c89-b2a7-93eb12d648d6 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Lock "87f15f5f-8afa-4d7b-bb45-5887184f9ee5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:45:32 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-d39c7792-4744-4c89-b2a7-93eb12d648d6 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Acquiring lock "87f15f5f-8afa-4d7b-bb45-5887184f9ee5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:45:32 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-d39c7792-4744-4c89-b2a7-93eb12d648d6 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Lock "87f15f5f-8afa-4d7b-bb45-5887184f9ee5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:45:32 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-d39c7792-4744-4c89-b2a7-93eb12d648d6 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Lock "87f15f5f-8afa-4d7b-bb45-5887184f9ee5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:45:32 user nova-compute[74960]: INFO nova.compute.manager [None req-d39c7792-4744-4c89-b2a7-93eb12d648d6 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: 87f15f5f-8afa-4d7b-bb45-5887184f9ee5] Terminating instance
Nov 03 12:45:32 user nova-compute[74960]: DEBUG nova.compute.manager [None req-d39c7792-4744-4c89-b2a7-93eb12d648d6 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: 87f15f5f-8afa-4d7b-bb45-5887184f9ee5] Start destroying the instance on the hypervisor. {{(pid=74960) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 12:45:32 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-1f0c7fd9-45c5-4302-9a3b-6e94dff576fe tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Lock "6fe524ec-5fb2-4399-bc41-5898413ff9d4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.339s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:45:32 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:45:32 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:45:32 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:45:32 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:45:32 user nova-compute[74960]: DEBUG nova.compute.manager [req-759e3459-8ccf-4865-b9d8-c10875f29696 req-e1fd7242-4169-4c98-a037-23f5c7463e8b service nova] [instance: 87f15f5f-8afa-4d7b-bb45-5887184f9ee5] Received event network-vif-unplugged-4a12f8bf-1920-4e7a-afec-9b716b73ff63 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:45:32 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-759e3459-8ccf-4865-b9d8-c10875f29696 req-e1fd7242-4169-4c98-a037-23f5c7463e8b service nova] Acquiring lock "87f15f5f-8afa-4d7b-bb45-5887184f9ee5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:45:32 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-759e3459-8ccf-4865-b9d8-c10875f29696 req-e1fd7242-4169-4c98-a037-23f5c7463e8b service nova] Lock "87f15f5f-8afa-4d7b-bb45-5887184f9ee5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:45:32 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-759e3459-8ccf-4865-b9d8-c10875f29696 req-e1fd7242-4169-4c98-a037-23f5c7463e8b service nova] Lock "87f15f5f-8afa-4d7b-bb45-5887184f9ee5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:45:32 user nova-compute[74960]: DEBUG nova.compute.manager [req-759e3459-8ccf-4865-b9d8-c10875f29696 req-e1fd7242-4169-4c98-a037-23f5c7463e8b service nova] [instance: 87f15f5f-8afa-4d7b-bb45-5887184f9ee5] No waiting events found dispatching network-vif-unplugged-4a12f8bf-1920-4e7a-afec-9b716b73ff63 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:45:32 user nova-compute[74960]: DEBUG nova.compute.manager [req-759e3459-8ccf-4865-b9d8-c10875f29696 req-e1fd7242-4169-4c98-a037-23f5c7463e8b service nova] [instance: 87f15f5f-8afa-4d7b-bb45-5887184f9ee5] Received event network-vif-unplugged-4a12f8bf-1920-4e7a-afec-9b716b73ff63 for instance with task_state deleting. {{(pid=74960) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 12:45:32 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: 87f15f5f-8afa-4d7b-bb45-5887184f9ee5] Instance destroyed successfully.
Nov 03 12:45:32 user nova-compute[74960]: DEBUG nova.objects.instance [None req-d39c7792-4744-4c89-b2a7-93eb12d648d6 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Lazy-loading 'resources' on Instance uuid 87f15f5f-8afa-4d7b-bb45-5887184f9ee5 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:45:32 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-d39c7792-4744-4c89-b2a7-93eb12d648d6 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:25:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1850575870',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1850575870',id=20,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-03T12:25:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dbc95d68d5e147e1953c855169b17091',ramdisk_id='',reservation_id='r-lmzfgdct',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-195954071',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T12:26:59Z,user_data=None,user_id='c473215929044a108c9fc4d6327dfc3d',uuid=87f15f5f-8afa-4d7b-bb45-5887184f9ee5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4a12f8bf-1920-4e7a-afec-9b716b73ff63", "address": "fa:16:3e:be:f4:7d", "network": {"id": "dec66832-56d5-4d68-b11f-8e8eed38f045", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-79099436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc95d68d5e147e1953c855169b17091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a12f8bf-19", "ovs_interfaceid": "4a12f8bf-1920-4e7a-afec-9b716b73ff63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 12:45:32 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-d39c7792-4744-4c89-b2a7-93eb12d648d6 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Converting VIF {"id": "4a12f8bf-1920-4e7a-afec-9b716b73ff63", "address": "fa:16:3e:be:f4:7d", "network": {"id": "dec66832-56d5-4d68-b11f-8e8eed38f045", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-79099436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc95d68d5e147e1953c855169b17091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a12f8bf-19", "ovs_interfaceid": "4a12f8bf-1920-4e7a-afec-9b716b73ff63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:45:32 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-d39c7792-4744-4c89-b2a7-93eb12d648d6 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:be:f4:7d,bridge_name='br-int',has_traffic_filtering=True,id=4a12f8bf-1920-4e7a-afec-9b716b73ff63,network=Network(dec66832-56d5-4d68-b11f-8e8eed38f045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a12f8bf-19') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:45:32 user nova-compute[74960]: DEBUG os_vif [None req-d39c7792-4744-4c89-b2a7-93eb12d648d6 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:be:f4:7d,bridge_name='br-int',has_traffic_filtering=True,id=4a12f8bf-1920-4e7a-afec-9b716b73ff63,network=Network(dec66832-56d5-4d68-b11f-8e8eed38f045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a12f8bf-19') {{(pid=74960) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 12:45:32 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:45:32 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4a12f8bf-19, bridge=br-int, if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:45:32 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:45:32 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:45:32 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:45:32 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=97ed9f45-a8d5-4787-99cc-8d0a275d786a) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:45:32 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:45:32 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:45:32 user nova-compute[74960]: INFO os_vif [None req-d39c7792-4744-4c89-b2a7-93eb12d648d6 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:be:f4:7d,bridge_name='br-int',has_traffic_filtering=True,id=4a12f8bf-1920-4e7a-afec-9b716b73ff63,network=Network(dec66832-56d5-4d68-b11f-8e8eed38f045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a12f8bf-19')
Nov 03 12:45:32 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-d39c7792-4744-4c89-b2a7-93eb12d648d6 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: 87f15f5f-8afa-4d7b-bb45-5887184f9ee5] Deleting instance files /opt/stack/data/nova/instances/87f15f5f-8afa-4d7b-bb45-5887184f9ee5_del
Nov 03 12:45:32 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-d39c7792-4744-4c89-b2a7-93eb12d648d6 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: 87f15f5f-8afa-4d7b-bb45-5887184f9ee5] Deletion of /opt/stack/data/nova/instances/87f15f5f-8afa-4d7b-bb45-5887184f9ee5_del complete
Nov 03 12:45:33 user nova-compute[74960]: INFO nova.compute.manager [None req-d39c7792-4744-4c89-b2a7-93eb12d648d6 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] [instance: 87f15f5f-8afa-4d7b-bb45-5887184f9ee5] Took 0.70 seconds to destroy the instance on the hypervisor.
Nov 03 12:45:33 user nova-compute[74960]: DEBUG oslo.service.loopingcall [None req-d39c7792-4744-4c89-b2a7-93eb12d648d6 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74960) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 12:45:33 user nova-compute[74960]: DEBUG nova.compute.manager [-] [instance: 87f15f5f-8afa-4d7b-bb45-5887184f9ee5] Deallocating network for instance {{(pid=74960) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 12:45:33 user nova-compute[74960]: DEBUG nova.network.neutron [-] [instance: 87f15f5f-8afa-4d7b-bb45-5887184f9ee5] deallocate_for_instance() {{(pid=74960) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 12:45:33 user nova-compute[74960]: DEBUG nova.network.neutron [-] [instance: 87f15f5f-8afa-4d7b-bb45-5887184f9ee5] Updating instance_info_cache with network_info: [] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:45:33 user nova-compute[74960]: INFO nova.compute.manager [-] [instance: 87f15f5f-8afa-4d7b-bb45-5887184f9ee5] Took 0.45 seconds to deallocate network for instance.
Nov 03 12:45:33 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-d39c7792-4744-4c89-b2a7-93eb12d648d6 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:45:33 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-d39c7792-4744-4c89-b2a7-93eb12d648d6 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:45:33 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-d39c7792-4744-4c89-b2a7-93eb12d648d6 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:45:33 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-d39c7792-4744-4c89-b2a7-93eb12d648d6 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:45:33 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-d39c7792-4744-4c89-b2a7-93eb12d648d6 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.249s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:45:33 user nova-compute[74960]: INFO nova.scheduler.client.report [None req-d39c7792-4744-4c89-b2a7-93eb12d648d6 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Deleted allocations for instance 87f15f5f-8afa-4d7b-bb45-5887184f9ee5
Nov 03 12:45:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:45:33 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-d39c7792-4744-4c89-b2a7-93eb12d648d6 tempest-ServerBootFromVolumeStableRescueTest-195954071 tempest-ServerBootFromVolumeStableRescueTest-195954071-project-member] Lock "87f15f5f-8afa-4d7b-bb45-5887184f9ee5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.578s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:45:34 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-e931e91a-a232-4ca0-bb5e-c38895abef6f tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Acquiring lock "6fe524ec-5fb2-4399-bc41-5898413ff9d4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:45:34 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-e931e91a-a232-4ca0-bb5e-c38895abef6f tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Lock "6fe524ec-5fb2-4399-bc41-5898413ff9d4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:45:34 user nova-compute[74960]: INFO nova.compute.manager [None req-e931e91a-a232-4ca0-bb5e-c38895abef6f tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] [instance: 6fe524ec-5fb2-4399-bc41-5898413ff9d4] Detaching volume 19275544-a880-4e5e-8ce6-312415cdbedb
Nov 03 12:45:34 user nova-compute[74960]: INFO nova.virt.block_device [None req-e931e91a-a232-4ca0-bb5e-c38895abef6f tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] [instance: 6fe524ec-5fb2-4399-bc41-5898413ff9d4] Attempting to driver detach volume 19275544-a880-4e5e-8ce6-312415cdbedb from mountpoint /dev/vdb
Nov 03 12:45:34 user nova-compute[74960]: DEBUG nova.compute.manager [req-6b53764f-e6d6-4766-a469-4a913d3bb050 req-78cdc635-ef87-4846-8d5f-8f4393582544 service nova] [instance: 87f15f5f-8afa-4d7b-bb45-5887184f9ee5] Received event network-vif-plugged-4a12f8bf-1920-4e7a-afec-9b716b73ff63 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:45:34 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-6b53764f-e6d6-4766-a469-4a913d3bb050 req-78cdc635-ef87-4846-8d5f-8f4393582544 service nova] Acquiring lock "87f15f5f-8afa-4d7b-bb45-5887184f9ee5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:45:34 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-6b53764f-e6d6-4766-a469-4a913d3bb050 req-78cdc635-ef87-4846-8d5f-8f4393582544 service nova] Lock "87f15f5f-8afa-4d7b-bb45-5887184f9ee5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:45:34 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-6b53764f-e6d6-4766-a469-4a913d3bb050 req-78cdc635-ef87-4846-8d5f-8f4393582544 service nova] Lock "87f15f5f-8afa-4d7b-bb45-5887184f9ee5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:45:34 user nova-compute[74960]: DEBUG nova.compute.manager [req-6b53764f-e6d6-4766-a469-4a913d3bb050 req-78cdc635-ef87-4846-8d5f-8f4393582544 service nova] [instance: 87f15f5f-8afa-4d7b-bb45-5887184f9ee5] No waiting events found dispatching network-vif-plugged-4a12f8bf-1920-4e7a-afec-9b716b73ff63 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:45:34 user nova-compute[74960]: WARNING nova.compute.manager [req-6b53764f-e6d6-4766-a469-4a913d3bb050 req-78cdc635-ef87-4846-8d5f-8f4393582544 service nova] [instance: 87f15f5f-8afa-4d7b-bb45-5887184f9ee5] Received unexpected event network-vif-plugged-4a12f8bf-1920-4e7a-afec-9b716b73ff63 for instance with vm_state deleted and task_state None.
Nov 03 12:45:34 user nova-compute[74960]: DEBUG nova.compute.manager [req-6b53764f-e6d6-4766-a469-4a913d3bb050 req-78cdc635-ef87-4846-8d5f-8f4393582544 service nova] [instance: 87f15f5f-8afa-4d7b-bb45-5887184f9ee5] Received event network-vif-deleted-4a12f8bf-1920-4e7a-afec-9b716b73ff63 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:45:34 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-e931e91a-a232-4ca0-bb5e-c38895abef6f tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Attempting to detach device vdb from instance 6fe524ec-5fb2-4399-bc41-5898413ff9d4 from the persistent domain config. {{(pid=74960) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 03 12:45:34 user nova-compute[74960]: DEBUG nova.virt.libvirt.guest [None req-e931e91a-a232-4ca0-bb5e-c38895abef6f tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 12:45:34 user nova-compute[74960]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 12:45:34 user nova-compute[74960]:   <source dev="/dev/sde"/>
Nov 03 12:45:34 user nova-compute[74960]:   <target dev="vdb" bus="virtio"/>
Nov 03 12:45:34 user nova-compute[74960]:   <serial>19275544-a880-4e5e-8ce6-312415cdbedb</serial>
Nov 03 12:45:34 user nova-compute[74960]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 12:45:34 user nova-compute[74960]: </disk>
Nov 03 12:45:34 user nova-compute[74960]:  {{(pid=74960) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 12:45:34 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-e931e91a-a232-4ca0-bb5e-c38895abef6f tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Successfully detached device vdb from instance 6fe524ec-5fb2-4399-bc41-5898413ff9d4 from the persistent domain config.
Nov 03 12:45:34 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-e931e91a-a232-4ca0-bb5e-c38895abef6f tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6fe524ec-5fb2-4399-bc41-5898413ff9d4 from the live domain config. {{(pid=74960) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 03 12:45:34 user nova-compute[74960]: DEBUG nova.virt.libvirt.guest [None req-e931e91a-a232-4ca0-bb5e-c38895abef6f tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 12:45:34 user nova-compute[74960]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 12:45:34 user nova-compute[74960]:   <source dev="/dev/sde"/>
Nov 03 12:45:34 user nova-compute[74960]:   <target dev="vdb" bus="virtio"/>
Nov 03 12:45:34 user nova-compute[74960]:   <serial>19275544-a880-4e5e-8ce6-312415cdbedb</serial>
Nov 03 12:45:34 user nova-compute[74960]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 12:45:34 user nova-compute[74960]: </disk>
Nov 03 12:45:34 user nova-compute[74960]:  {{(pid=74960) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 12:45:35 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-e931e91a-a232-4ca0-bb5e-c38895abef6f tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6fe524ec-5fb2-4399-bc41-5898413ff9d4 {{(pid=74960) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 03 12:45:37 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:45:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:45:42 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:45:43 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:45:47 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:45:50 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:45:51 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-789f78f3-6cb4-498c-9926-68a75aa71a9b tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance cce474db-fa6f-4670-9be7-88a3e62caa60 is timed out.
Nov 03 12:45:51 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-789f78f3-6cb4-498c-9926-68a75aa71a9b tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Successfully detached device vdb from instance cce474db-fa6f-4670-9be7-88a3e62caa60 from the live domain config.
Nov 03 12:45:51 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-789f78f3-6cb4-498c-9926-68a75aa71a9b tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: cce474db-fa6f-4670-9be7-88a3e62caa60] calling os-brick to detach iSCSI Volume {{(pid=74960) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 12:45:51 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-789f78f3-6cb4-498c-9926-68a75aa71a9b tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9aa420acb0>, {'target_iqn': 'iqn.2010-10.org.openstack:ade00ce0-c0e8-4dba-b496-853713ed7ee5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cHmDtRSq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:45:51 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-789f78f3-6cb4-498c-9926-68a75aa71a9b tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:45:51 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-789f78f3-6cb4-498c-9926-68a75aa71a9b tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:45:51 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-789f78f3-6cb4-498c-9926-68a75aa71a9b tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:45:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:45:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:45:51 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[d37322d4-1448-47f6-a2d6-c6bd472282ee]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:19275544-a880-4e5e-8ce6-312415cdbedb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ca2e1f1-1ec0-4d7f-a3d4-2f7830d0dbc9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f4c6cd96-5bb9-496e-aaa7-37f872cee704\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ade00ce0-c0e8-4dba-b496-853713ed7ee5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:45:51 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-789f78f3-6cb4-498c-9926-68a75aa71a9b tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 12:45:51 user nova-compute[74960]: No targets found.
Nov 03 12:45:51 user nova-compute[74960]: iSNS:
Nov 03 12:45:51 user nova-compute[74960]: No targets found.
Nov 03 12:45:51 user nova-compute[74960]: STATIC:
Nov 03 12:45:51 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:19275544-a880-4e5e-8ce6-312415cdbedb
Nov 03 12:45:51 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:45:51 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:45:51 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:2ca2e1f1-1ec0-4d7f-a3d4-2f7830d0dbc9
Nov 03 12:45:51 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:45:51 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:45:51 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:f4c6cd96-5bb9-496e-aaa7-37f872cee704
Nov 03 12:45:51 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:45:51 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:45:51 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:ade00ce0-c0e8-4dba-b496-853713ed7ee5
Nov 03 12:45:51 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:45:51 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:45:51 user nova-compute[74960]: FIRMWARE:
Nov 03 12:45:51 user nova-compute[74960]: No targets found.
Nov 03 12:45:51 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:45:51 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-789f78f3-6cb4-498c-9926-68a75aa71a9b tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 12:45:51 user nova-compute[74960]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 12:45:51 user nova-compute[74960]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74960) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 12:45:51 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-789f78f3-6cb4-498c-9926-68a75aa71a9b tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ade00ce0-c0e8-4dba-b496-853713ed7ee5', 0)] {{(pid=74960) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 12:45:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:45:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:45:51 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[1672f012-92a2-45d6-8788-b062eee09362]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19275544-a880-4e5e-8ce6-312415cdbedb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ca2e1f1-1ec0-4d7f-a3d4-2f7830d0dbc9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ade00ce0-c0e8-4dba-b496-853713ed7ee5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4c6cd96-5bb9-496e-aaa7-37f872cee704\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:45:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:45:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:45:51 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[708bb19c-7e58-42da-b7f9-3453649c5d52]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4c6cd96-5bb9-496e-aaa7-37f872cee704 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade00ce0-c0e8-4dba-b496-853713ed7ee5 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca2e1f1-1ec0-4d7f-a3d4-2f7830d0dbc9 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19275544-a880-4e5e-8ce6-312415cdbedb (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:45:51 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-789f78f3-6cb4-498c-9926-68a75aa71a9b tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4c6cd96-5bb9-496e-aaa7-37f872cee704 (non-flash)
Nov 03 12:45:51 user nova-compute[74960]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade00ce0-c0e8-4dba-b496-853713ed7ee5 (non-flash)
Nov 03 12:45:51 user nova-compute[74960]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca2e1f1-1ec0-4d7f-a3d4-2f7830d0dbc9 (non-flash)
Nov 03 12:45:51 user nova-compute[74960]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19275544-a880-4e5e-8ce6-312415cdbedb (non-flash)
Nov 03 12:45:51 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:45:51 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-789f78f3-6cb4-498c-9926-68a75aa71a9b tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4c6cd96-5bb9-496e-aaa7-37f872cee704 (non-flash)
Nov 03 12:45:51 user nova-compute[74960]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade00ce0-c0e8-4dba-b496-853713ed7ee5 (non-flash)
Nov 03 12:45:51 user nova-compute[74960]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca2e1f1-1ec0-4d7f-a3d4-2f7830d0dbc9 (non-flash)
Nov 03 12:45:51 user nova-compute[74960]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19275544-a880-4e5e-8ce6-312415cdbedb (non-flash)
Nov 03 12:45:51 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:45:51 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-789f78f3-6cb4-498c-9926-68a75aa71a9b tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9aac256e60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ade00ce0-c0e8-4dba-b496-853713ed7ee5'): ({'sdc'}, set())}) {{(pid=74960) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 12:45:51 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-789f78f3-6cb4-498c-9926-68a75aa71a9b tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Removing single pathed devices sdc {{(pid=74960) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 12:45:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:45:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:45:51 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fe1569b-8936-42c9-af9f-6000a1dd53bf]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:45:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:45:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:45:51 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[00903d39-a38a-4e4c-a7c5-c54c19196f42]: (4, ('ok\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:45:51 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-789f78f3-6cb4-498c-9926-68a75aa71a9b tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Flushing IO for device /dev/sdc {{(pid=74960) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 12:45:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:45:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:45:51 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[64901076-a1bf-4dbe-899a-7601b68fc1d9]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:45:51 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-789f78f3-6cb4-498c-9926-68a75aa71a9b tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74960) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 12:45:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:45:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:45:51 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[90aea732-1eb6-4578-8fbd-be0caa729132]: (4, ('1', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:45:51 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-789f78f3-6cb4-498c-9926-68a75aa71a9b tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74960) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 12:45:51 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-789f78f3-6cb4-498c-9926-68a75aa71a9b tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] SCSI volumes sdc have been removed. {{(pid=74960) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 12:45:51 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-789f78f3-6cb4-498c-9926-68a75aa71a9b tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ade00ce0-c0e8-4dba-b496-853713ed7ee5')] {{(pid=74960) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 12:45:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ade00ce0-c0e8-4dba-b496-853713ed7ee5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:45:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ade00ce0-c0e8-4dba-b496-853713ed7ee5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:45:51 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad1b70b7-c983-4e57-acb1-56c2c001ea20]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:45:51 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-789f78f3-6cb4-498c-9926-68a75aa71a9b tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:45:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ade00ce0-c0e8-4dba-b496-853713ed7ee5 -p 172.16.0.220:3260 --logout {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:45:52 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ade00ce0-c0e8-4dba-b496-853713ed7ee5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:45:52 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[edeb1b7a-b3d7-41d2-a6ec-35b76aea37cc]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:ade00ce0-c0e8-4dba-b496-853713ed7ee5, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:ade00ce0-c0e8-4dba-b496-853713ed7ee5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:45:52 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-789f78f3-6cb4-498c-9926-68a75aa71a9b tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:ade00ce0-c0e8-4dba-b496-853713ed7ee5, portal: 172.16.0.220,3260]
Nov 03 12:45:52 user nova-compute[74960]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:ade00ce0-c0e8-4dba-b496-853713ed7ee5, portal: 172.16.0.220,3260] successful.
Nov 03 12:45:52 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:45:52 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ade00ce0-c0e8-4dba-b496-853713ed7ee5 -p 172.16.0.220:3260 --op delete {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:45:52 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ade00ce0-c0e8-4dba-b496-853713ed7ee5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:45:52 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1ef152a-afad-4b2c-aaca-ae9ff623b989]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:45:52 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-789f78f3-6cb4-498c-9926-68a75aa71a9b tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:45:52 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-789f78f3-6cb4-498c-9926-68a75aa71a9b tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:45:52 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-789f78f3-6cb4-498c-9926-68a75aa71a9b tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] <== disconnect_volume: return (290ms) None {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:45:52 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-789f78f3-6cb4-498c-9926-68a75aa71a9b tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: cce474db-fa6f-4670-9be7-88a3e62caa60] Disconnected iSCSI Volume {{(pid=74960) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 12:45:52 user nova-compute[74960]: DEBUG nova.objects.instance [None req-789f78f3-6cb4-498c-9926-68a75aa71a9b tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Lazy-loading 'flavor' on Instance uuid cce474db-fa6f-4670-9be7-88a3e62caa60 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:45:52 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:45:52 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-789f78f3-6cb4-498c-9926-68a75aa71a9b tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Lock "cce474db-fa6f-4670-9be7-88a3e62caa60" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.761s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:45:52 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:45:53 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-71276e75-64ba-4e47-a89f-96a611907ffb tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Acquiring lock "cce474db-fa6f-4670-9be7-88a3e62caa60" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:45:53 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-71276e75-64ba-4e47-a89f-96a611907ffb tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Lock "cce474db-fa6f-4670-9be7-88a3e62caa60" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:45:53 user nova-compute[74960]: INFO nova.compute.manager [None req-71276e75-64ba-4e47-a89f-96a611907ffb tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: cce474db-fa6f-4670-9be7-88a3e62caa60] Detaching volume 2ca2e1f1-1ec0-4d7f-a3d4-2f7830d0dbc9
Nov 03 12:45:53 user nova-compute[74960]: INFO nova.virt.block_device [None req-71276e75-64ba-4e47-a89f-96a611907ffb tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: cce474db-fa6f-4670-9be7-88a3e62caa60] Attempting to driver detach volume 2ca2e1f1-1ec0-4d7f-a3d4-2f7830d0dbc9 from mountpoint /dev/vdc
Nov 03 12:45:53 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-71276e75-64ba-4e47-a89f-96a611907ffb tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Attempting to detach device vdc from instance cce474db-fa6f-4670-9be7-88a3e62caa60 from the persistent domain config. {{(pid=74960) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 03 12:45:53 user nova-compute[74960]: DEBUG nova.virt.libvirt.guest [None req-71276e75-64ba-4e47-a89f-96a611907ffb tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 12:45:53 user nova-compute[74960]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 12:45:53 user nova-compute[74960]:   <source dev="/dev/sdd"/>
Nov 03 12:45:53 user nova-compute[74960]:   <target dev="vdc" bus="virtio"/>
Nov 03 12:45:53 user nova-compute[74960]:   <serial>2ca2e1f1-1ec0-4d7f-a3d4-2f7830d0dbc9</serial>
Nov 03 12:45:53 user nova-compute[74960]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 03 12:45:53 user nova-compute[74960]: </disk>
Nov 03 12:45:53 user nova-compute[74960]:  {{(pid=74960) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 12:45:53 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-71276e75-64ba-4e47-a89f-96a611907ffb tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Successfully detached device vdc from instance cce474db-fa6f-4670-9be7-88a3e62caa60 from the persistent domain config.
Nov 03 12:45:53 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-71276e75-64ba-4e47-a89f-96a611907ffb tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance cce474db-fa6f-4670-9be7-88a3e62caa60 from the live domain config. {{(pid=74960) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 03 12:45:53 user nova-compute[74960]: DEBUG nova.virt.libvirt.guest [None req-71276e75-64ba-4e47-a89f-96a611907ffb tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 12:45:53 user nova-compute[74960]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 12:45:53 user nova-compute[74960]:   <source dev="/dev/sdd"/>
Nov 03 12:45:53 user nova-compute[74960]:   <target dev="vdc" bus="virtio"/>
Nov 03 12:45:53 user nova-compute[74960]:   <serial>2ca2e1f1-1ec0-4d7f-a3d4-2f7830d0dbc9</serial>
Nov 03 12:45:53 user nova-compute[74960]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 03 12:45:53 user nova-compute[74960]: </disk>
Nov 03 12:45:53 user nova-compute[74960]:  {{(pid=74960) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 12:45:54 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-71276e75-64ba-4e47-a89f-96a611907ffb tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance cce474db-fa6f-4670-9be7-88a3e62caa60 {{(pid=74960) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 03 12:45:55 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-e931e91a-a232-4ca0-bb5e-c38895abef6f tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 6fe524ec-5fb2-4399-bc41-5898413ff9d4 is timed out.
Nov 03 12:45:55 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-e931e91a-a232-4ca0-bb5e-c38895abef6f tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Successfully detached device vdb from instance 6fe524ec-5fb2-4399-bc41-5898413ff9d4 from the live domain config.
Nov 03 12:45:55 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e931e91a-a232-4ca0-bb5e-c38895abef6f tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] [instance: 6fe524ec-5fb2-4399-bc41-5898413ff9d4] calling os-brick to detach iSCSI Volume {{(pid=74960) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 12:45:55 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-e931e91a-a232-4ca0-bb5e-c38895abef6f tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9aa420acb0>, {'target_iqn': 'iqn.2010-10.org.openstack:19275544-a880-4e5e-8ce6-312415cdbedb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'peXRGjTS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:45:55 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-e931e91a-a232-4ca0-bb5e-c38895abef6f tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:45:55 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-e931e91a-a232-4ca0-bb5e-c38895abef6f tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:45:55 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-e931e91a-a232-4ca0-bb5e-c38895abef6f tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:45:55 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:45:55 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:45:55 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[22409474-fd41-40b9-aa22-5679cf7ea617]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:19275544-a880-4e5e-8ce6-312415cdbedb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ca2e1f1-1ec0-4d7f-a3d4-2f7830d0dbc9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f4c6cd96-5bb9-496e-aaa7-37f872cee704\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:45:55 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-e931e91a-a232-4ca0-bb5e-c38895abef6f tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 12:45:55 user nova-compute[74960]: No targets found.
Nov 03 12:45:55 user nova-compute[74960]: iSNS:
Nov 03 12:45:55 user nova-compute[74960]: No targets found.
Nov 03 12:45:55 user nova-compute[74960]: STATIC:
Nov 03 12:45:55 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:19275544-a880-4e5e-8ce6-312415cdbedb
Nov 03 12:45:55 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:45:55 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:45:55 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:2ca2e1f1-1ec0-4d7f-a3d4-2f7830d0dbc9
Nov 03 12:45:55 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:45:55 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:45:55 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:f4c6cd96-5bb9-496e-aaa7-37f872cee704
Nov 03 12:45:55 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:45:55 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:45:55 user nova-compute[74960]: FIRMWARE:
Nov 03 12:45:55 user nova-compute[74960]: No targets found.
Nov 03 12:45:55 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:45:55 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-e931e91a-a232-4ca0-bb5e-c38895abef6f tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 12:45:55 user nova-compute[74960]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 12:45:55 user nova-compute[74960]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74960) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 12:45:55 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-e931e91a-a232-4ca0-bb5e-c38895abef6f tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19275544-a880-4e5e-8ce6-312415cdbedb', 0)] {{(pid=74960) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 12:45:55 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:45:55 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:45:55 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7cdeac4-ad17-41a6-8e35-8acd71288d63]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19275544-a880-4e5e-8ce6-312415cdbedb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ca2e1f1-1ec0-4d7f-a3d4-2f7830d0dbc9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4c6cd96-5bb9-496e-aaa7-37f872cee704\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:45:55 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:45:55 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:45:55 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[268178fa-dfdf-4d1a-bd78-9cf736189cca]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4c6cd96-5bb9-496e-aaa7-37f872cee704 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca2e1f1-1ec0-4d7f-a3d4-2f7830d0dbc9 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19275544-a880-4e5e-8ce6-312415cdbedb (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:45:55 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-e931e91a-a232-4ca0-bb5e-c38895abef6f tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4c6cd96-5bb9-496e-aaa7-37f872cee704 (non-flash)
Nov 03 12:45:55 user nova-compute[74960]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca2e1f1-1ec0-4d7f-a3d4-2f7830d0dbc9 (non-flash)
Nov 03 12:45:55 user nova-compute[74960]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19275544-a880-4e5e-8ce6-312415cdbedb (non-flash)
Nov 03 12:45:55 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:45:55 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-e931e91a-a232-4ca0-bb5e-c38895abef6f tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4c6cd96-5bb9-496e-aaa7-37f872cee704 (non-flash)
Nov 03 12:45:55 user nova-compute[74960]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca2e1f1-1ec0-4d7f-a3d4-2f7830d0dbc9 (non-flash)
Nov 03 12:45:55 user nova-compute[74960]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19275544-a880-4e5e-8ce6-312415cdbedb (non-flash)
Nov 03 12:45:55 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:45:55 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-e931e91a-a232-4ca0-bb5e-c38895abef6f tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9a8c35d870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19275544-a880-4e5e-8ce6-312415cdbedb'): ({'sde'}, set())}) {{(pid=74960) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 12:45:55 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-e931e91a-a232-4ca0-bb5e-c38895abef6f tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Removing single pathed devices sde {{(pid=74960) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 12:45:55 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:45:55 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:45:55 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7d39137-21b5-451c-8340-74998f31f923]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:45:55 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:45:55 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:45:55 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[e161fe0e-29e3-4037-afd3-4a0ea2f45c4e]: (4, ('ok\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:45:55 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-e931e91a-a232-4ca0-bb5e-c38895abef6f tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Flushing IO for device /dev/sde {{(pid=74960) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 12:45:55 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:45:55 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:45:55 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[17694dda-518f-4711-a0e3-98222295de5b]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:45:55 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-e931e91a-a232-4ca0-bb5e-c38895abef6f tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74960) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 12:45:55 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:45:55 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.050s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:45:55 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f5a9657-34b0-49fe-b2cb-f2a4cc7038ac]: (4, ('1', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:45:55 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-e931e91a-a232-4ca0-bb5e-c38895abef6f tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74960) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 12:45:55 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-e931e91a-a232-4ca0-bb5e-c38895abef6f tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] SCSI volumes sde have been removed. {{(pid=74960) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 12:45:55 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-e931e91a-a232-4ca0-bb5e-c38895abef6f tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19275544-a880-4e5e-8ce6-312415cdbedb')] {{(pid=74960) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 12:45:55 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19275544-a880-4e5e-8ce6-312415cdbedb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:45:55 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19275544-a880-4e5e-8ce6-312415cdbedb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:45:55 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[afec47e6-2c00-4fd8-862b-eb6b8d7daacf]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:45:55 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-e931e91a-a232-4ca0-bb5e-c38895abef6f tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:45:55 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19275544-a880-4e5e-8ce6-312415cdbedb -p 172.16.0.220:3260 --logout {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:45:55 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19275544-a880-4e5e-8ce6-312415cdbedb -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:45:55 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1ab2e2c-5257-4b47-bbcf-cb595fb8a61a]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:19275544-a880-4e5e-8ce6-312415cdbedb, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:19275544-a880-4e5e-8ce6-312415cdbedb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:45:55 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-e931e91a-a232-4ca0-bb5e-c38895abef6f tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:19275544-a880-4e5e-8ce6-312415cdbedb, portal: 172.16.0.220,3260]
Nov 03 12:45:55 user nova-compute[74960]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:19275544-a880-4e5e-8ce6-312415cdbedb, portal: 172.16.0.220,3260] successful.
Nov 03 12:45:55 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:45:55 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19275544-a880-4e5e-8ce6-312415cdbedb -p 172.16.0.220:3260 --op delete {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:45:55 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19275544-a880-4e5e-8ce6-312415cdbedb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:45:55 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd5ffd43-2e39-4463-ad76-5c4584be4163]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:45:55 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-e931e91a-a232-4ca0-bb5e-c38895abef6f tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:45:55 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-e931e91a-a232-4ca0-bb5e-c38895abef6f tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:45:55 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-e931e91a-a232-4ca0-bb5e-c38895abef6f tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] <== disconnect_volume: return (296ms) None {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:45:55 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e931e91a-a232-4ca0-bb5e-c38895abef6f tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] [instance: 6fe524ec-5fb2-4399-bc41-5898413ff9d4] Disconnected iSCSI Volume {{(pid=74960) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 12:45:56 user nova-compute[74960]: DEBUG nova.objects.instance [None req-e931e91a-a232-4ca0-bb5e-c38895abef6f tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Lazy-loading 'flavor' on Instance uuid 6fe524ec-5fb2-4399-bc41-5898413ff9d4 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:45:56 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-e931e91a-a232-4ca0-bb5e-c38895abef6f tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Lock "6fe524ec-5fb2-4399-bc41-5898413ff9d4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.820s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:45:56 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:45:57 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:45:59 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:46:02 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:46:02 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:46:03 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:46:03 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:46:03 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:46:03 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:46:03 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Auditing locally available compute resources for user (node: user) {{(pid=74960) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 12:46:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cfe99be-b74b-4fd3-a5d6-a94708992c5b/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:46:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cfe99be-b74b-4fd3-a5d6-a94708992c5b/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:46:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cfe99be-b74b-4fd3-a5d6-a94708992c5b/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:46:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cfe99be-b74b-4fd3-a5d6-a94708992c5b/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:46:03 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74960) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 12:46:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47eb8ddf-590f-4ffa-87c8-377cf1ee0f67/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:46:04 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47eb8ddf-590f-4ffa-87c8-377cf1ee0f67/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:46:04 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47eb8ddf-590f-4ffa-87c8-377cf1ee0f67/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:46:04 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47eb8ddf-590f-4ffa-87c8-377cf1ee0f67/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:46:04 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60658b54-5e34-4a2b-be14-124e47e291c2/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:46:04 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60658b54-5e34-4a2b-be14-124e47e291c2/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:46:04 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60658b54-5e34-4a2b-be14-124e47e291c2/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:46:04 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60658b54-5e34-4a2b-be14-124e47e291c2/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:46:04 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk.rescue --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:46:04 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:46:04 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk.rescue --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:46:04 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:46:04 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:46:05 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:46:05 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:46:05 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:46:05 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cce474db-fa6f-4670-9be7-88a3e62caa60/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:46:05 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cce474db-fa6f-4670-9be7-88a3e62caa60/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:46:05 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cce474db-fa6f-4670-9be7-88a3e62caa60/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:46:05 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cce474db-fa6f-4670-9be7-88a3e62caa60/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:46:05 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fe524ec-5fb2-4399-bc41-5898413ff9d4/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:46:05 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fe524ec-5fb2-4399-bc41-5898413ff9d4/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:46:05 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fe524ec-5fb2-4399-bc41-5898413ff9d4/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:46:06 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fe524ec-5fb2-4399-bc41-5898413ff9d4/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:46:06 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:46:06 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:46:06 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Hypervisor/Node resource view: name=user free_ram=8419MB free_disk=24.799739837646484GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74960) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 12:46:06 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:46:06 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:46:06 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:46:06 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:46:06 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 60658b54-5e34-4a2b-be14-124e47e291c2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:46:06 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 3cfe99be-b74b-4fd3-a5d6-a94708992c5b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:46:06 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance cce474db-fa6f-4670-9be7-88a3e62caa60 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:46:06 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 6fe524ec-5fb2-4399-bc41-5898413ff9d4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:46:06 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74960) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 12:46:06 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74960) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 12:46:06 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:46:06 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:46:06 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Compute_service record updated for user:user {{(pid=74960) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 12:46:06 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.365s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:46:07 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:46:07 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Starting heal instance info cache {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 12:46:07 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:46:08 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "refresh_cache-b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:46:08 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquired lock "refresh_cache-b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:46:08 user nova-compute[74960]: DEBUG nova.network.neutron [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d] Forcefully refreshing network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 12:46:08 user nova-compute[74960]: DEBUG nova.network.neutron [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d] Updating instance_info_cache with network_info: [{"id": "b0f443c5-8a12-41fd-9275-81b88b3c08fd", "address": "fa:16:3e:68:31:70", "network": {"id": "9a9a848a-80be-4281-8554-8e28744073b3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1579909169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "434ce6c4b77342299a17e547a14e3918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0f443c5-8a", "ovs_interfaceid": "b0f443c5-8a12-41fd-9275-81b88b3c08fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:46:08 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Releasing lock "refresh_cache-b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:46:08 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d] Updated the network info_cache for instance {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 12:46:08 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:46:08 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:46:08 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:46:08 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:46:08 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:46:08 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74960) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 12:46:12 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:46:14 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-71276e75-64ba-4e47-a89f-96a611907ffb tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance cce474db-fa6f-4670-9be7-88a3e62caa60 is timed out.
Nov 03 12:46:14 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-71276e75-64ba-4e47-a89f-96a611907ffb tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Successfully detached device vdc from instance cce474db-fa6f-4670-9be7-88a3e62caa60 from the live domain config.
Nov 03 12:46:14 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71276e75-64ba-4e47-a89f-96a611907ffb tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: cce474db-fa6f-4670-9be7-88a3e62caa60] calling os-brick to detach iSCSI Volume {{(pid=74960) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 12:46:14 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-71276e75-64ba-4e47-a89f-96a611907ffb tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9aa420acb0>, {'target_iqn': 'iqn.2010-10.org.openstack:2ca2e1f1-1ec0-4d7f-a3d4-2f7830d0dbc9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JvNkWiLH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:46:14 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-71276e75-64ba-4e47-a89f-96a611907ffb tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:46:14 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-71276e75-64ba-4e47-a89f-96a611907ffb tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:46:14 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-71276e75-64ba-4e47-a89f-96a611907ffb tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:46:14 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:46:14 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:46:14 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e463d6d-40fa-45ec-a134-9ab491042f43]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2ca2e1f1-1ec0-4d7f-a3d4-2f7830d0dbc9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f4c6cd96-5bb9-496e-aaa7-37f872cee704\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:46:14 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-71276e75-64ba-4e47-a89f-96a611907ffb tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 12:46:14 user nova-compute[74960]: No targets found.
Nov 03 12:46:14 user nova-compute[74960]: iSNS:
Nov 03 12:46:14 user nova-compute[74960]: No targets found.
Nov 03 12:46:14 user nova-compute[74960]: STATIC:
Nov 03 12:46:14 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:2ca2e1f1-1ec0-4d7f-a3d4-2f7830d0dbc9
Nov 03 12:46:14 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:46:14 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:46:14 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:f4c6cd96-5bb9-496e-aaa7-37f872cee704
Nov 03 12:46:14 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:46:14 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:46:14 user nova-compute[74960]: FIRMWARE:
Nov 03 12:46:14 user nova-compute[74960]: No targets found.
Nov 03 12:46:14 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:46:14 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-71276e75-64ba-4e47-a89f-96a611907ffb tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 12:46:14 user nova-compute[74960]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 12:46:14 user nova-compute[74960]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74960) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 12:46:14 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-71276e75-64ba-4e47-a89f-96a611907ffb tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ca2e1f1-1ec0-4d7f-a3d4-2f7830d0dbc9', 0)] {{(pid=74960) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 12:46:14 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:46:14 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:46:14 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8f6d035-4ba2-40a0-bdc0-fee570f1162b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ca2e1f1-1ec0-4d7f-a3d4-2f7830d0dbc9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4c6cd96-5bb9-496e-aaa7-37f872cee704\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:46:14 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:46:14 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:46:14 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[40a8604b-4dd7-4f01-ae74-80399a67e297]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4c6cd96-5bb9-496e-aaa7-37f872cee704 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca2e1f1-1ec0-4d7f-a3d4-2f7830d0dbc9 (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:46:14 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-71276e75-64ba-4e47-a89f-96a611907ffb tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4c6cd96-5bb9-496e-aaa7-37f872cee704 (non-flash)
Nov 03 12:46:14 user nova-compute[74960]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca2e1f1-1ec0-4d7f-a3d4-2f7830d0dbc9 (non-flash)
Nov 03 12:46:14 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:46:14 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-71276e75-64ba-4e47-a89f-96a611907ffb tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4c6cd96-5bb9-496e-aaa7-37f872cee704 (non-flash)
Nov 03 12:46:14 user nova-compute[74960]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca2e1f1-1ec0-4d7f-a3d4-2f7830d0dbc9 (non-flash)
Nov 03 12:46:14 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:46:14 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-71276e75-64ba-4e47-a89f-96a611907ffb tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9a8c5eed40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ca2e1f1-1ec0-4d7f-a3d4-2f7830d0dbc9'): ({'sdd'}, set())}) {{(pid=74960) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 12:46:14 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-71276e75-64ba-4e47-a89f-96a611907ffb tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Removing single pathed devices sdd {{(pid=74960) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 12:46:14 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:46:14 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:46:14 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[18749e36-1b75-4881-93dd-045710f614d3]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:46:14 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:46:14 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:46:14 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[e27a4da1-e8c2-4b4a-8f38-1565e16b371f]: (4, ('ok\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:46:14 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-71276e75-64ba-4e47-a89f-96a611907ffb tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Flushing IO for device /dev/sdd {{(pid=74960) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 12:46:14 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:46:14 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:46:14 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[76af36ff-1542-44c5-b5a0-7ef6eadb96b6]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:46:14 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-71276e75-64ba-4e47-a89f-96a611907ffb tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74960) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 12:46:14 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:46:14 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.035s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:46:14 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[a01b1150-89da-4d05-b2ef-79936e0af4d7]: (4, ('1', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:46:14 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-71276e75-64ba-4e47-a89f-96a611907ffb tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74960) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 12:46:14 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-71276e75-64ba-4e47-a89f-96a611907ffb tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] SCSI volumes sdd have been removed. {{(pid=74960) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 12:46:14 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-71276e75-64ba-4e47-a89f-96a611907ffb tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ca2e1f1-1ec0-4d7f-a3d4-2f7830d0dbc9')] {{(pid=74960) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 12:46:14 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ca2e1f1-1ec0-4d7f-a3d4-2f7830d0dbc9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:46:14 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ca2e1f1-1ec0-4d7f-a3d4-2f7830d0dbc9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:46:14 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[f586bf78-77aa-4c43-94dd-a16189f329be]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:46:14 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-71276e75-64ba-4e47-a89f-96a611907ffb tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:46:14 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ca2e1f1-1ec0-4d7f-a3d4-2f7830d0dbc9 -p 172.16.0.220:3260 --logout {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:46:14 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ca2e1f1-1ec0-4d7f-a3d4-2f7830d0dbc9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:46:14 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0c3f5c1-6763-4698-b8df-90efbc2a8069]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:2ca2e1f1-1ec0-4d7f-a3d4-2f7830d0dbc9, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:2ca2e1f1-1ec0-4d7f-a3d4-2f7830d0dbc9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:46:14 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-71276e75-64ba-4e47-a89f-96a611907ffb tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:2ca2e1f1-1ec0-4d7f-a3d4-2f7830d0dbc9, portal: 172.16.0.220,3260]
Nov 03 12:46:14 user nova-compute[74960]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:2ca2e1f1-1ec0-4d7f-a3d4-2f7830d0dbc9, portal: 172.16.0.220,3260] successful.
Nov 03 12:46:14 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:46:14 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ca2e1f1-1ec0-4d7f-a3d4-2f7830d0dbc9 -p 172.16.0.220:3260 --op delete {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:46:14 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ca2e1f1-1ec0-4d7f-a3d4-2f7830d0dbc9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:46:14 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8a5486e-413c-4848-9fbb-70ecbcd794da]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:46:14 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-71276e75-64ba-4e47-a89f-96a611907ffb tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:46:14 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-71276e75-64ba-4e47-a89f-96a611907ffb tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.268s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:46:14 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-71276e75-64ba-4e47-a89f-96a611907ffb tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] <== disconnect_volume: return (269ms) None {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:46:14 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71276e75-64ba-4e47-a89f-96a611907ffb tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: cce474db-fa6f-4670-9be7-88a3e62caa60] Disconnected iSCSI Volume {{(pid=74960) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 12:46:15 user nova-compute[74960]: DEBUG nova.objects.instance [None req-71276e75-64ba-4e47-a89f-96a611907ffb tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Lazy-loading 'flavor' on Instance uuid cce474db-fa6f-4670-9be7-88a3e62caa60 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:46:15 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-71276e75-64ba-4e47-a89f-96a611907ffb tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Lock "cce474db-fa6f-4670-9be7-88a3e62caa60" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.689s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:46:16 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-e11ce51d-fc80-47a5-b5d2-872a99702d21 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Acquiring lock "cce474db-fa6f-4670-9be7-88a3e62caa60" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:46:16 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-e11ce51d-fc80-47a5-b5d2-872a99702d21 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Lock "cce474db-fa6f-4670-9be7-88a3e62caa60" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:46:16 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-e11ce51d-fc80-47a5-b5d2-872a99702d21 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Acquiring lock "cce474db-fa6f-4670-9be7-88a3e62caa60-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:46:16 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-e11ce51d-fc80-47a5-b5d2-872a99702d21 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Lock "cce474db-fa6f-4670-9be7-88a3e62caa60-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:46:16 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-e11ce51d-fc80-47a5-b5d2-872a99702d21 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Lock "cce474db-fa6f-4670-9be7-88a3e62caa60-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:46:16 user nova-compute[74960]: INFO nova.compute.manager [None req-e11ce51d-fc80-47a5-b5d2-872a99702d21 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: cce474db-fa6f-4670-9be7-88a3e62caa60] Terminating instance
Nov 03 12:46:16 user nova-compute[74960]: DEBUG nova.compute.manager [None req-e11ce51d-fc80-47a5-b5d2-872a99702d21 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: cce474db-fa6f-4670-9be7-88a3e62caa60] Start destroying the instance on the hypervisor. {{(pid=74960) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 12:46:16 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:46:16 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:46:16 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:46:16 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:46:16 user nova-compute[74960]: DEBUG nova.compute.manager [req-8e2f2cf0-232b-47ae-86fd-8aeed5d4fc61 req-4a0df1a2-40ad-44d3-a2bd-76bcdab06621 service nova] [instance: cce474db-fa6f-4670-9be7-88a3e62caa60] Received event network-vif-unplugged-92da7392-5a28-47ec-96d5-a976824a2318 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:46:16 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-8e2f2cf0-232b-47ae-86fd-8aeed5d4fc61 req-4a0df1a2-40ad-44d3-a2bd-76bcdab06621 service nova] Acquiring lock "cce474db-fa6f-4670-9be7-88a3e62caa60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:46:16 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-8e2f2cf0-232b-47ae-86fd-8aeed5d4fc61 req-4a0df1a2-40ad-44d3-a2bd-76bcdab06621 service nova] Lock "cce474db-fa6f-4670-9be7-88a3e62caa60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:46:16 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-8e2f2cf0-232b-47ae-86fd-8aeed5d4fc61 req-4a0df1a2-40ad-44d3-a2bd-76bcdab06621 service nova] Lock "cce474db-fa6f-4670-9be7-88a3e62caa60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:46:16 user nova-compute[74960]: DEBUG nova.compute.manager [req-8e2f2cf0-232b-47ae-86fd-8aeed5d4fc61 req-4a0df1a2-40ad-44d3-a2bd-76bcdab06621 service nova] [instance: cce474db-fa6f-4670-9be7-88a3e62caa60] No waiting events found dispatching network-vif-unplugged-92da7392-5a28-47ec-96d5-a976824a2318 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:46:16 user nova-compute[74960]: DEBUG nova.compute.manager [req-8e2f2cf0-232b-47ae-86fd-8aeed5d4fc61 req-4a0df1a2-40ad-44d3-a2bd-76bcdab06621 service nova] [instance: cce474db-fa6f-4670-9be7-88a3e62caa60] Received event network-vif-unplugged-92da7392-5a28-47ec-96d5-a976824a2318 for instance with task_state deleting. {{(pid=74960) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 12:46:17 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:46:17 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:46:17 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: cce474db-fa6f-4670-9be7-88a3e62caa60] Instance destroyed successfully.
Nov 03 12:46:17 user nova-compute[74960]: DEBUG nova.objects.instance [None req-e11ce51d-fc80-47a5-b5d2-872a99702d21 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Lazy-loading 'resources' on Instance uuid cce474db-fa6f-4670-9be7-88a3e62caa60 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:46:17 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-e11ce51d-fc80-47a5-b5d2-872a99702d21 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:42:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-629060934',display_name='tempest-AttachVolumeTestJSON-server-629060934',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-629060934',id=41,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA8bl/AFIVmNmMMOGMbdAsqlWThR2423PzcvOu83z5vOXMkzGj9R0/u4CtDNGExEqEHN7eVDGokWYtZ+5GqDA6b3aGze6/kTD/hX8wM1t59hVNVpA6Evz+KOxnrw0gLVQw==',key_name='tempest-keypair-1051873060',keypairs=<?>,launch_index=0,launched_at=2023-11-03T12:42:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a9160afcfdb74ba2aad7bc79e628e96f',ramdisk_id='',reservation_id='r-9fzpw8w1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-847320603',owner_user_name='tempest-AttachVolumeTestJSON-847320603-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T12:42:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c599d8677454b60b9434689322a6de2',uuid=cce474db-fa6f-4670-9be7-88a3e62caa60,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "92da7392-5a28-47ec-96d5-a976824a2318", "address": "fa:16:3e:de:f4:80", "network": {"id": "3eaeac55-9eb7-4301-b5a7-d13735656d8e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-826950903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9160afcfdb74ba2aad7bc79e628e96f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92da7392-5a", "ovs_interfaceid": "92da7392-5a28-47ec-96d5-a976824a2318", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 12:46:17 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-e11ce51d-fc80-47a5-b5d2-872a99702d21 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Converting VIF {"id": "92da7392-5a28-47ec-96d5-a976824a2318", "address": "fa:16:3e:de:f4:80", "network": {"id": "3eaeac55-9eb7-4301-b5a7-d13735656d8e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-826950903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9160afcfdb74ba2aad7bc79e628e96f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92da7392-5a", "ovs_interfaceid": "92da7392-5a28-47ec-96d5-a976824a2318", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:46:17 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-e11ce51d-fc80-47a5-b5d2-872a99702d21 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:de:f4:80,bridge_name='br-int',has_traffic_filtering=True,id=92da7392-5a28-47ec-96d5-a976824a2318,network=Network(3eaeac55-9eb7-4301-b5a7-d13735656d8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92da7392-5a') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:46:17 user nova-compute[74960]: DEBUG os_vif [None req-e11ce51d-fc80-47a5-b5d2-872a99702d21 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:f4:80,bridge_name='br-int',has_traffic_filtering=True,id=92da7392-5a28-47ec-96d5-a976824a2318,network=Network(3eaeac55-9eb7-4301-b5a7-d13735656d8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92da7392-5a') {{(pid=74960) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 12:46:17 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:46:17 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap92da7392-5a, bridge=br-int, if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:46:17 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:46:17 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:46:17 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:46:17 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9b87cc13-2156-49c2-ab24-98c46444ca06) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:46:17 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:46:17 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:46:17 user nova-compute[74960]: INFO os_vif [None req-e11ce51d-fc80-47a5-b5d2-872a99702d21 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:f4:80,bridge_name='br-int',has_traffic_filtering=True,id=92da7392-5a28-47ec-96d5-a976824a2318,network=Network(3eaeac55-9eb7-4301-b5a7-d13735656d8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92da7392-5a')
Nov 03 12:46:17 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-e11ce51d-fc80-47a5-b5d2-872a99702d21 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: cce474db-fa6f-4670-9be7-88a3e62caa60] Deleting instance files /opt/stack/data/nova/instances/cce474db-fa6f-4670-9be7-88a3e62caa60_del
Nov 03 12:46:17 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-e11ce51d-fc80-47a5-b5d2-872a99702d21 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: cce474db-fa6f-4670-9be7-88a3e62caa60] Deletion of /opt/stack/data/nova/instances/cce474db-fa6f-4670-9be7-88a3e62caa60_del complete
Nov 03 12:46:17 user nova-compute[74960]: INFO nova.compute.manager [None req-e11ce51d-fc80-47a5-b5d2-872a99702d21 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] [instance: cce474db-fa6f-4670-9be7-88a3e62caa60] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 03 12:46:17 user nova-compute[74960]: DEBUG oslo.service.loopingcall [None req-e11ce51d-fc80-47a5-b5d2-872a99702d21 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74960) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 12:46:17 user nova-compute[74960]: DEBUG nova.compute.manager [-] [instance: cce474db-fa6f-4670-9be7-88a3e62caa60] Deallocating network for instance {{(pid=74960) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 12:46:17 user nova-compute[74960]: DEBUG nova.network.neutron [-] [instance: cce474db-fa6f-4670-9be7-88a3e62caa60] deallocate_for_instance() {{(pid=74960) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 12:46:18 user nova-compute[74960]: DEBUG nova.network.neutron [-] [instance: cce474db-fa6f-4670-9be7-88a3e62caa60] Updating instance_info_cache with network_info: [] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:46:18 user nova-compute[74960]: INFO nova.compute.manager [-] [instance: cce474db-fa6f-4670-9be7-88a3e62caa60] Took 1.17 seconds to deallocate network for instance.
Nov 03 12:46:18 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-e11ce51d-fc80-47a5-b5d2-872a99702d21 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:46:18 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-e11ce51d-fc80-47a5-b5d2-872a99702d21 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:46:18 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-e11ce51d-fc80-47a5-b5d2-872a99702d21 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:46:18 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-e11ce51d-fc80-47a5-b5d2-872a99702d21 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:46:18 user nova-compute[74960]: DEBUG nova.compute.manager [req-40c8471e-6402-4bf8-813b-901b41e2d0f0 req-236a1ce8-37c8-4af6-b544-9b50e0ec8b36 service nova] [instance: cce474db-fa6f-4670-9be7-88a3e62caa60] Received event network-vif-plugged-92da7392-5a28-47ec-96d5-a976824a2318 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:46:18 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-40c8471e-6402-4bf8-813b-901b41e2d0f0 req-236a1ce8-37c8-4af6-b544-9b50e0ec8b36 service nova] Acquiring lock "cce474db-fa6f-4670-9be7-88a3e62caa60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:46:18 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-40c8471e-6402-4bf8-813b-901b41e2d0f0 req-236a1ce8-37c8-4af6-b544-9b50e0ec8b36 service nova] Lock "cce474db-fa6f-4670-9be7-88a3e62caa60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:46:18 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-40c8471e-6402-4bf8-813b-901b41e2d0f0 req-236a1ce8-37c8-4af6-b544-9b50e0ec8b36 service nova] Lock "cce474db-fa6f-4670-9be7-88a3e62caa60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:46:18 user nova-compute[74960]: DEBUG nova.compute.manager [req-40c8471e-6402-4bf8-813b-901b41e2d0f0 req-236a1ce8-37c8-4af6-b544-9b50e0ec8b36 service nova] [instance: cce474db-fa6f-4670-9be7-88a3e62caa60] No waiting events found dispatching network-vif-plugged-92da7392-5a28-47ec-96d5-a976824a2318 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:46:18 user nova-compute[74960]: WARNING nova.compute.manager [req-40c8471e-6402-4bf8-813b-901b41e2d0f0 req-236a1ce8-37c8-4af6-b544-9b50e0ec8b36 service nova] [instance: cce474db-fa6f-4670-9be7-88a3e62caa60] Received unexpected event network-vif-plugged-92da7392-5a28-47ec-96d5-a976824a2318 for instance with vm_state deleted and task_state None.
Nov 03 12:46:18 user nova-compute[74960]: DEBUG nova.compute.manager [req-40c8471e-6402-4bf8-813b-901b41e2d0f0 req-236a1ce8-37c8-4af6-b544-9b50e0ec8b36 service nova] [instance: cce474db-fa6f-4670-9be7-88a3e62caa60] Received event network-vif-deleted-92da7392-5a28-47ec-96d5-a976824a2318 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:46:18 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-e11ce51d-fc80-47a5-b5d2-872a99702d21 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.306s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:46:19 user nova-compute[74960]: INFO nova.scheduler.client.report [None req-e11ce51d-fc80-47a5-b5d2-872a99702d21 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Deleted allocations for instance cce474db-fa6f-4670-9be7-88a3e62caa60
Nov 03 12:46:19 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-e11ce51d-fc80-47a5-b5d2-872a99702d21 tempest-AttachVolumeTestJSON-847320603 tempest-AttachVolumeTestJSON-847320603-project-member] Lock "cce474db-fa6f-4670-9be7-88a3e62caa60" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.581s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:46:22 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:46:25 user nova-compute[74960]: DEBUG nova.compute.manager [req-883bc443-7901-47f0-9f7f-ad4e5a9ab7f0 req-19ac74d0-9920-4b32-b237-f4a05b85d8a8 service nova] [instance: 6fe524ec-5fb2-4399-bc41-5898413ff9d4] Received event network-changed-348e9fcf-472e-432b-b7f5-a706b7f5c4e2 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:46:25 user nova-compute[74960]: DEBUG nova.compute.manager [req-883bc443-7901-47f0-9f7f-ad4e5a9ab7f0 req-19ac74d0-9920-4b32-b237-f4a05b85d8a8 service nova] [instance: 6fe524ec-5fb2-4399-bc41-5898413ff9d4] Refreshing instance network info cache due to event network-changed-348e9fcf-472e-432b-b7f5-a706b7f5c4e2. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 12:46:25 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-883bc443-7901-47f0-9f7f-ad4e5a9ab7f0 req-19ac74d0-9920-4b32-b237-f4a05b85d8a8 service nova] Acquiring lock "refresh_cache-6fe524ec-5fb2-4399-bc41-5898413ff9d4" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:46:25 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-883bc443-7901-47f0-9f7f-ad4e5a9ab7f0 req-19ac74d0-9920-4b32-b237-f4a05b85d8a8 service nova] Acquired lock "refresh_cache-6fe524ec-5fb2-4399-bc41-5898413ff9d4" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:46:25 user nova-compute[74960]: DEBUG nova.network.neutron [req-883bc443-7901-47f0-9f7f-ad4e5a9ab7f0 req-19ac74d0-9920-4b32-b237-f4a05b85d8a8 service nova] [instance: 6fe524ec-5fb2-4399-bc41-5898413ff9d4] Refreshing network info cache for port 348e9fcf-472e-432b-b7f5-a706b7f5c4e2 {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 12:46:25 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:46:25 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-4c19b848-4956-4696-93ea-2b468f676f5c tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Acquiring lock "6fe524ec-5fb2-4399-bc41-5898413ff9d4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:46:25 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-4c19b848-4956-4696-93ea-2b468f676f5c tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Lock "6fe524ec-5fb2-4399-bc41-5898413ff9d4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.006s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:46:25 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-4c19b848-4956-4696-93ea-2b468f676f5c tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Acquiring lock "6fe524ec-5fb2-4399-bc41-5898413ff9d4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:46:25 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-4c19b848-4956-4696-93ea-2b468f676f5c tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Lock "6fe524ec-5fb2-4399-bc41-5898413ff9d4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:46:25 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-4c19b848-4956-4696-93ea-2b468f676f5c tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Lock "6fe524ec-5fb2-4399-bc41-5898413ff9d4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:46:25 user nova-compute[74960]: INFO nova.compute.manager [None req-4c19b848-4956-4696-93ea-2b468f676f5c tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] [instance: 6fe524ec-5fb2-4399-bc41-5898413ff9d4] Terminating instance
Nov 03 12:46:25 user nova-compute[74960]: DEBUG nova.compute.manager [None req-4c19b848-4956-4696-93ea-2b468f676f5c tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] [instance: 6fe524ec-5fb2-4399-bc41-5898413ff9d4] Start destroying the instance on the hypervisor. {{(pid=74960) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 12:46:25 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:46:25 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:46:25 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:46:25 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:46:25 user nova-compute[74960]: DEBUG nova.compute.manager [req-68092bb1-26fc-4203-a546-ecfd2bf3506b req-96821cda-055c-4458-b636-48ff79001278 service nova] [instance: 6fe524ec-5fb2-4399-bc41-5898413ff9d4] Received event network-vif-unplugged-348e9fcf-472e-432b-b7f5-a706b7f5c4e2 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:46:25 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-68092bb1-26fc-4203-a546-ecfd2bf3506b req-96821cda-055c-4458-b636-48ff79001278 service nova] Acquiring lock "6fe524ec-5fb2-4399-bc41-5898413ff9d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:46:25 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-68092bb1-26fc-4203-a546-ecfd2bf3506b req-96821cda-055c-4458-b636-48ff79001278 service nova] Lock "6fe524ec-5fb2-4399-bc41-5898413ff9d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:46:25 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-68092bb1-26fc-4203-a546-ecfd2bf3506b req-96821cda-055c-4458-b636-48ff79001278 service nova] Lock "6fe524ec-5fb2-4399-bc41-5898413ff9d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:46:25 user nova-compute[74960]: DEBUG nova.compute.manager [req-68092bb1-26fc-4203-a546-ecfd2bf3506b req-96821cda-055c-4458-b636-48ff79001278 service nova] [instance: 6fe524ec-5fb2-4399-bc41-5898413ff9d4] No waiting events found dispatching network-vif-unplugged-348e9fcf-472e-432b-b7f5-a706b7f5c4e2 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:46:25 user nova-compute[74960]: DEBUG nova.compute.manager [req-68092bb1-26fc-4203-a546-ecfd2bf3506b req-96821cda-055c-4458-b636-48ff79001278 service nova] [instance: 6fe524ec-5fb2-4399-bc41-5898413ff9d4] Received event network-vif-unplugged-348e9fcf-472e-432b-b7f5-a706b7f5c4e2 for instance with task_state deleting. {{(pid=74960) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 12:46:26 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: 6fe524ec-5fb2-4399-bc41-5898413ff9d4] Instance destroyed successfully.
Nov 03 12:46:26 user nova-compute[74960]: DEBUG nova.objects.instance [None req-4c19b848-4956-4696-93ea-2b468f676f5c tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Lazy-loading 'resources' on Instance uuid 6fe524ec-5fb2-4399-bc41-5898413ff9d4 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:46:26 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-4c19b848-4956-4696-93ea-2b468f676f5c tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:43:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-751503575',display_name='tempest-TestStampPattern-server-751503575',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-751503575',id=42,image_ref='d0a4a243-c0c8-4512-a9e4-c72c43357702',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOVJGiA8+WxYV0H4D5A8tW82c36Y66O0cQc4FMiKT0kp3U+xT9R3wjcl8Y9oz6PsAiIG74/EBNibsdR8g5KJgAe/YXLGMoJSdUpoQNRjhz9zQdfyFtfcNImepV7xlRbyrw==',key_name='tempest-TestStampPattern-2145016267',keypairs=<?>,launch_index=0,launched_at=2023-11-03T12:43:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='df8ca5bb565b48648e39e6c128f54a57',ramdisk_id='',reservation_id='r-3r53fnq2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='60658b54-5e34-4a2b-be14-124e47e291c2',image_min_disk='1',image_min_ram='0',image_owner_id='df8ca5bb565b48648e39e6c128f54a57',image_owner_project_name='tempest-TestStampPattern-1528534742',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1528534742-project-member',image_user_id='946ef9f0f5d04f43bc8c248de57d6566',owner_project_name='tempest-TestStampPattern-1528534742',owner_user_name='tempest-TestStampPattern-1528534742-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T12:43:26Z,user_data=None,user_id='946ef9f0f5d04f43bc8c248de57d6566',uuid=6fe524ec-5fb2-4399-bc41-5898413ff9d4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "348e9fcf-472e-432b-b7f5-a706b7f5c4e2", "address": "fa:16:3e:2d:7c:be", "network": {"id": "6c29b2f1-0c30-45d5-ade3-f792d5af7037", "bridge": "br-int", "label": "tempest-TestStampPattern-1770578791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df8ca5bb565b48648e39e6c128f54a57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap348e9fcf-47", "ovs_interfaceid": "348e9fcf-472e-432b-b7f5-a706b7f5c4e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 12:46:26 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-4c19b848-4956-4696-93ea-2b468f676f5c tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Converting VIF {"id": "348e9fcf-472e-432b-b7f5-a706b7f5c4e2", "address": "fa:16:3e:2d:7c:be", "network": {"id": "6c29b2f1-0c30-45d5-ade3-f792d5af7037", "bridge": "br-int", "label": "tempest-TestStampPattern-1770578791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df8ca5bb565b48648e39e6c128f54a57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap348e9fcf-47", "ovs_interfaceid": "348e9fcf-472e-432b-b7f5-a706b7f5c4e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:46:26 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-4c19b848-4956-4696-93ea-2b468f676f5c tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2d:7c:be,bridge_name='br-int',has_traffic_filtering=True,id=348e9fcf-472e-432b-b7f5-a706b7f5c4e2,network=Network(6c29b2f1-0c30-45d5-ade3-f792d5af7037),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap348e9fcf-47') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:46:26 user nova-compute[74960]: DEBUG os_vif [None req-4c19b848-4956-4696-93ea-2b468f676f5c tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2d:7c:be,bridge_name='br-int',has_traffic_filtering=True,id=348e9fcf-472e-432b-b7f5-a706b7f5c4e2,network=Network(6c29b2f1-0c30-45d5-ade3-f792d5af7037),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap348e9fcf-47') {{(pid=74960) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 12:46:26 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:46:26 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap348e9fcf-47, bridge=br-int, if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:46:26 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:46:26 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:46:26 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:46:26 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c2a490a8-bf5a-40f6-af92-cf9d3feca448) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:46:26 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:46:26 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:46:26 user nova-compute[74960]: DEBUG nova.network.neutron [req-883bc443-7901-47f0-9f7f-ad4e5a9ab7f0 req-19ac74d0-9920-4b32-b237-f4a05b85d8a8 service nova] [instance: 6fe524ec-5fb2-4399-bc41-5898413ff9d4] Updated VIF entry in instance network info cache for port 348e9fcf-472e-432b-b7f5-a706b7f5c4e2. {{(pid=74960) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 12:46:26 user nova-compute[74960]: DEBUG nova.network.neutron [req-883bc443-7901-47f0-9f7f-ad4e5a9ab7f0 req-19ac74d0-9920-4b32-b237-f4a05b85d8a8 service nova] [instance: 6fe524ec-5fb2-4399-bc41-5898413ff9d4] Updating instance_info_cache with network_info: [{"id": "348e9fcf-472e-432b-b7f5-a706b7f5c4e2", "address": "fa:16:3e:2d:7c:be", "network": {"id": "6c29b2f1-0c30-45d5-ade3-f792d5af7037", "bridge": "br-int", "label": "tempest-TestStampPattern-1770578791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df8ca5bb565b48648e39e6c128f54a57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap348e9fcf-47", "ovs_interfaceid": "348e9fcf-472e-432b-b7f5-a706b7f5c4e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:46:26 user nova-compute[74960]: INFO os_vif [None req-4c19b848-4956-4696-93ea-2b468f676f5c tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2d:7c:be,bridge_name='br-int',has_traffic_filtering=True,id=348e9fcf-472e-432b-b7f5-a706b7f5c4e2,network=Network(6c29b2f1-0c30-45d5-ade3-f792d5af7037),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap348e9fcf-47')
Nov 03 12:46:26 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-4c19b848-4956-4696-93ea-2b468f676f5c tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] [instance: 6fe524ec-5fb2-4399-bc41-5898413ff9d4] Deleting instance files /opt/stack/data/nova/instances/6fe524ec-5fb2-4399-bc41-5898413ff9d4_del
Nov 03 12:46:26 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-4c19b848-4956-4696-93ea-2b468f676f5c tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] [instance: 6fe524ec-5fb2-4399-bc41-5898413ff9d4] Deletion of /opt/stack/data/nova/instances/6fe524ec-5fb2-4399-bc41-5898413ff9d4_del complete
Nov 03 12:46:26 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-883bc443-7901-47f0-9f7f-ad4e5a9ab7f0 req-19ac74d0-9920-4b32-b237-f4a05b85d8a8 service nova] Releasing lock "refresh_cache-6fe524ec-5fb2-4399-bc41-5898413ff9d4" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:46:26 user nova-compute[74960]: INFO nova.compute.manager [None req-4c19b848-4956-4696-93ea-2b468f676f5c tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] [instance: 6fe524ec-5fb2-4399-bc41-5898413ff9d4] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 03 12:46:26 user nova-compute[74960]: DEBUG oslo.service.loopingcall [None req-4c19b848-4956-4696-93ea-2b468f676f5c tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74960) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 12:46:26 user nova-compute[74960]: DEBUG nova.compute.manager [-] [instance: 6fe524ec-5fb2-4399-bc41-5898413ff9d4] Deallocating network for instance {{(pid=74960) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 12:46:26 user nova-compute[74960]: DEBUG nova.network.neutron [-] [instance: 6fe524ec-5fb2-4399-bc41-5898413ff9d4] deallocate_for_instance() {{(pid=74960) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 12:46:26 user nova-compute[74960]: DEBUG nova.network.neutron [-] [instance: 6fe524ec-5fb2-4399-bc41-5898413ff9d4] Updating instance_info_cache with network_info: [] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:46:26 user nova-compute[74960]: INFO nova.compute.manager [-] [instance: 6fe524ec-5fb2-4399-bc41-5898413ff9d4] Took 0.49 seconds to deallocate network for instance.
Nov 03 12:46:26 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-4c19b848-4956-4696-93ea-2b468f676f5c tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:46:26 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-4c19b848-4956-4696-93ea-2b468f676f5c tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:46:26 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-4c19b848-4956-4696-93ea-2b468f676f5c tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:46:26 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-4c19b848-4956-4696-93ea-2b468f676f5c tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:46:26 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-4c19b848-4956-4696-93ea-2b468f676f5c tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.217s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:46:26 user nova-compute[74960]: INFO nova.scheduler.client.report [None req-4c19b848-4956-4696-93ea-2b468f676f5c tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Deleted allocations for instance 6fe524ec-5fb2-4399-bc41-5898413ff9d4
Nov 03 12:46:27 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-4c19b848-4956-4696-93ea-2b468f676f5c tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Lock "6fe524ec-5fb2-4399-bc41-5898413ff9d4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.749s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:46:27 user nova-compute[74960]: DEBUG nova.compute.manager [req-fc01627a-dc5e-4b1a-8d30-f25350acfb3e req-6d13b2c2-9a01-4332-b225-b428693eafd4 service nova] [instance: 6fe524ec-5fb2-4399-bc41-5898413ff9d4] Received event network-vif-plugged-348e9fcf-472e-432b-b7f5-a706b7f5c4e2 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:46:27 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-fc01627a-dc5e-4b1a-8d30-f25350acfb3e req-6d13b2c2-9a01-4332-b225-b428693eafd4 service nova] Acquiring lock "6fe524ec-5fb2-4399-bc41-5898413ff9d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:46:27 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-fc01627a-dc5e-4b1a-8d30-f25350acfb3e req-6d13b2c2-9a01-4332-b225-b428693eafd4 service nova] Lock "6fe524ec-5fb2-4399-bc41-5898413ff9d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:46:27 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-fc01627a-dc5e-4b1a-8d30-f25350acfb3e req-6d13b2c2-9a01-4332-b225-b428693eafd4 service nova] Lock "6fe524ec-5fb2-4399-bc41-5898413ff9d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:46:27 user nova-compute[74960]: DEBUG nova.compute.manager [req-fc01627a-dc5e-4b1a-8d30-f25350acfb3e req-6d13b2c2-9a01-4332-b225-b428693eafd4 service nova] [instance: 6fe524ec-5fb2-4399-bc41-5898413ff9d4] No waiting events found dispatching network-vif-plugged-348e9fcf-472e-432b-b7f5-a706b7f5c4e2 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:46:27 user nova-compute[74960]: WARNING nova.compute.manager [req-fc01627a-dc5e-4b1a-8d30-f25350acfb3e req-6d13b2c2-9a01-4332-b225-b428693eafd4 service nova] [instance: 6fe524ec-5fb2-4399-bc41-5898413ff9d4] Received unexpected event network-vif-plugged-348e9fcf-472e-432b-b7f5-a706b7f5c4e2 for instance with vm_state deleted and task_state None.
Nov 03 12:46:27 user nova-compute[74960]: DEBUG nova.compute.manager [req-fc01627a-dc5e-4b1a-8d30-f25350acfb3e req-6d13b2c2-9a01-4332-b225-b428693eafd4 service nova] [instance: 6fe524ec-5fb2-4399-bc41-5898413ff9d4] Received event network-vif-deleted-348e9fcf-472e-432b-b7f5-a706b7f5c4e2 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:46:31 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:46:36 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:46:41 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:46:42 user nova-compute[74960]: DEBUG nova.compute.manager [req-5de7e9d5-c679-419a-9b32-1d8d3e0c19dd req-b74d0801-035f-41b7-8183-01644928a4f7 service nova] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] Received event network-changed-ad28ac84-3419-4701-90df-e93359da2c28 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:46:42 user nova-compute[74960]: DEBUG nova.compute.manager [req-5de7e9d5-c679-419a-9b32-1d8d3e0c19dd req-b74d0801-035f-41b7-8183-01644928a4f7 service nova] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] Refreshing instance network info cache due to event network-changed-ad28ac84-3419-4701-90df-e93359da2c28. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 12:46:42 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-5de7e9d5-c679-419a-9b32-1d8d3e0c19dd req-b74d0801-035f-41b7-8183-01644928a4f7 service nova] Acquiring lock "refresh_cache-3cfe99be-b74b-4fd3-a5d6-a94708992c5b" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:46:42 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-5de7e9d5-c679-419a-9b32-1d8d3e0c19dd req-b74d0801-035f-41b7-8183-01644928a4f7 service nova] Acquired lock "refresh_cache-3cfe99be-b74b-4fd3-a5d6-a94708992c5b" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:46:42 user nova-compute[74960]: DEBUG nova.network.neutron [req-5de7e9d5-c679-419a-9b32-1d8d3e0c19dd req-b74d0801-035f-41b7-8183-01644928a4f7 service nova] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] Refreshing network info cache for port ad28ac84-3419-4701-90df-e93359da2c28 {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 12:46:42 user nova-compute[74960]: DEBUG nova.network.neutron [req-5de7e9d5-c679-419a-9b32-1d8d3e0c19dd req-b74d0801-035f-41b7-8183-01644928a4f7 service nova] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] Updated VIF entry in instance network info cache for port ad28ac84-3419-4701-90df-e93359da2c28. {{(pid=74960) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 12:46:42 user nova-compute[74960]: DEBUG nova.network.neutron [req-5de7e9d5-c679-419a-9b32-1d8d3e0c19dd req-b74d0801-035f-41b7-8183-01644928a4f7 service nova] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] Updating instance_info_cache with network_info: [{"id": "ad28ac84-3419-4701-90df-e93359da2c28", "address": "fa:16:3e:1f:4e:b6", "network": {"id": "9a9a848a-80be-4281-8554-8e28744073b3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1579909169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "434ce6c4b77342299a17e547a14e3918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad28ac84-34", "ovs_interfaceid": "ad28ac84-3419-4701-90df-e93359da2c28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:46:42 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-5de7e9d5-c679-419a-9b32-1d8d3e0c19dd req-b74d0801-035f-41b7-8183-01644928a4f7 service nova] Releasing lock "refresh_cache-3cfe99be-b74b-4fd3-a5d6-a94708992c5b" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:46:42 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-eba80401-e7fc-4f6e-adaa-8f9ee50052ba tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Acquiring lock "3cfe99be-b74b-4fd3-a5d6-a94708992c5b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:46:42 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-eba80401-e7fc-4f6e-adaa-8f9ee50052ba tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Lock "3cfe99be-b74b-4fd3-a5d6-a94708992c5b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:46:42 user nova-compute[74960]: INFO nova.compute.manager [None req-eba80401-e7fc-4f6e-adaa-8f9ee50052ba tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] Detaching volume f4c6cd96-5bb9-496e-aaa7-37f872cee704
Nov 03 12:46:43 user nova-compute[74960]: INFO nova.virt.block_device [None req-eba80401-e7fc-4f6e-adaa-8f9ee50052ba tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] Attempting to driver detach volume f4c6cd96-5bb9-496e-aaa7-37f872cee704 from mountpoint /dev/vdb
Nov 03 12:46:43 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-eba80401-e7fc-4f6e-adaa-8f9ee50052ba tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Attempting to detach device vdb from instance 3cfe99be-b74b-4fd3-a5d6-a94708992c5b from the persistent domain config. {{(pid=74960) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 03 12:46:43 user nova-compute[74960]: DEBUG nova.virt.libvirt.guest [None req-eba80401-e7fc-4f6e-adaa-8f9ee50052ba tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 12:46:43 user nova-compute[74960]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 12:46:43 user nova-compute[74960]:   <source dev="/dev/sdb"/>
Nov 03 12:46:43 user nova-compute[74960]:   <target dev="vdb" bus="virtio"/>
Nov 03 12:46:43 user nova-compute[74960]:   <serial>f4c6cd96-5bb9-496e-aaa7-37f872cee704</serial>
Nov 03 12:46:43 user nova-compute[74960]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 12:46:43 user nova-compute[74960]: </disk>
Nov 03 12:46:43 user nova-compute[74960]:  {{(pid=74960) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 12:46:43 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-eba80401-e7fc-4f6e-adaa-8f9ee50052ba tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Successfully detached device vdb from instance 3cfe99be-b74b-4fd3-a5d6-a94708992c5b from the persistent domain config.
Nov 03 12:46:43 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-eba80401-e7fc-4f6e-adaa-8f9ee50052ba tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3cfe99be-b74b-4fd3-a5d6-a94708992c5b from the live domain config. {{(pid=74960) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 03 12:46:43 user nova-compute[74960]: DEBUG nova.virt.libvirt.guest [None req-eba80401-e7fc-4f6e-adaa-8f9ee50052ba tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 12:46:43 user nova-compute[74960]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 12:46:43 user nova-compute[74960]:   <source dev="/dev/sdb"/>
Nov 03 12:46:43 user nova-compute[74960]:   <target dev="vdb" bus="virtio"/>
Nov 03 12:46:43 user nova-compute[74960]:   <serial>f4c6cd96-5bb9-496e-aaa7-37f872cee704</serial>
Nov 03 12:46:43 user nova-compute[74960]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 12:46:43 user nova-compute[74960]: </disk>
Nov 03 12:46:43 user nova-compute[74960]:  {{(pid=74960) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 12:46:43 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-eba80401-e7fc-4f6e-adaa-8f9ee50052ba tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3cfe99be-b74b-4fd3-a5d6-a94708992c5b {{(pid=74960) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 03 12:46:43 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:46:44 user nova-compute[74960]: DEBUG nova.compute.manager [req-23c190b9-d177-440f-80de-bcd5339c65c0 req-59ec3a41-49b5-4392-9870-7385bf8b88f3 service nova] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] Received event network-changed-ad28ac84-3419-4701-90df-e93359da2c28 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:46:44 user nova-compute[74960]: DEBUG nova.compute.manager [req-23c190b9-d177-440f-80de-bcd5339c65c0 req-59ec3a41-49b5-4392-9870-7385bf8b88f3 service nova] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] Refreshing instance network info cache due to event network-changed-ad28ac84-3419-4701-90df-e93359da2c28. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 12:46:44 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-23c190b9-d177-440f-80de-bcd5339c65c0 req-59ec3a41-49b5-4392-9870-7385bf8b88f3 service nova] Acquiring lock "refresh_cache-3cfe99be-b74b-4fd3-a5d6-a94708992c5b" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:46:44 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-23c190b9-d177-440f-80de-bcd5339c65c0 req-59ec3a41-49b5-4392-9870-7385bf8b88f3 service nova] Acquired lock "refresh_cache-3cfe99be-b74b-4fd3-a5d6-a94708992c5b" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:46:44 user nova-compute[74960]: DEBUG nova.network.neutron [req-23c190b9-d177-440f-80de-bcd5339c65c0 req-59ec3a41-49b5-4392-9870-7385bf8b88f3 service nova] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] Refreshing network info cache for port ad28ac84-3419-4701-90df-e93359da2c28 {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 12:46:45 user nova-compute[74960]: DEBUG nova.network.neutron [req-23c190b9-d177-440f-80de-bcd5339c65c0 req-59ec3a41-49b5-4392-9870-7385bf8b88f3 service nova] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] Updated VIF entry in instance network info cache for port ad28ac84-3419-4701-90df-e93359da2c28. {{(pid=74960) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 12:46:45 user nova-compute[74960]: DEBUG nova.network.neutron [req-23c190b9-d177-440f-80de-bcd5339c65c0 req-59ec3a41-49b5-4392-9870-7385bf8b88f3 service nova] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] Updating instance_info_cache with network_info: [{"id": "ad28ac84-3419-4701-90df-e93359da2c28", "address": "fa:16:3e:1f:4e:b6", "network": {"id": "9a9a848a-80be-4281-8554-8e28744073b3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1579909169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "434ce6c4b77342299a17e547a14e3918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad28ac84-34", "ovs_interfaceid": "ad28ac84-3419-4701-90df-e93359da2c28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:46:45 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-23c190b9-d177-440f-80de-bcd5339c65c0 req-59ec3a41-49b5-4392-9870-7385bf8b88f3 service nova] Releasing lock "refresh_cache-3cfe99be-b74b-4fd3-a5d6-a94708992c5b" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:46:46 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:46:51 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:46:56 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:47:00 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:47:01 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:47:01 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:47:01 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74960) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 12:47:01 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74960) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 12:47:01 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74960) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 12:47:01 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:47:02 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:47:03 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:47:03 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:47:03 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:47:03 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:47:03 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Auditing locally available compute resources for user (node: user) {{(pid=74960) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 12:47:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cfe99be-b74b-4fd3-a5d6-a94708992c5b/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:47:03 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-eba80401-e7fc-4f6e-adaa-8f9ee50052ba tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 3cfe99be-b74b-4fd3-a5d6-a94708992c5b is timed out.
Nov 03 12:47:03 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-eba80401-e7fc-4f6e-adaa-8f9ee50052ba tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Successfully detached device vdb from instance 3cfe99be-b74b-4fd3-a5d6-a94708992c5b from the live domain config.
Nov 03 12:47:03 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eba80401-e7fc-4f6e-adaa-8f9ee50052ba tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] calling os-brick to detach iSCSI Volume {{(pid=74960) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 12:47:03 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-eba80401-e7fc-4f6e-adaa-8f9ee50052ba tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9aa420acb0>, {'target_iqn': 'iqn.2010-10.org.openstack:f4c6cd96-5bb9-496e-aaa7-37f872cee704', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LepNhaHS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:47:03 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-eba80401-e7fc-4f6e-adaa-8f9ee50052ba tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:47:03 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-eba80401-e7fc-4f6e-adaa-8f9ee50052ba tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:47:03 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-eba80401-e7fc-4f6e-adaa-8f9ee50052ba tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:47:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:47:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:47:03 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb4f14e-c466-4442-b5ff-a7c6da3b8890]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f4c6cd96-5bb9-496e-aaa7-37f872cee704\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:47:03 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-eba80401-e7fc-4f6e-adaa-8f9ee50052ba tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 12:47:03 user nova-compute[74960]: No targets found.
Nov 03 12:47:03 user nova-compute[74960]: iSNS:
Nov 03 12:47:03 user nova-compute[74960]: No targets found.
Nov 03 12:47:03 user nova-compute[74960]: STATIC:
Nov 03 12:47:03 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:f4c6cd96-5bb9-496e-aaa7-37f872cee704
Nov 03 12:47:03 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:47:03 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:47:03 user nova-compute[74960]: FIRMWARE:
Nov 03 12:47:03 user nova-compute[74960]: No targets found.
Nov 03 12:47:03 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:47:03 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-eba80401-e7fc-4f6e-adaa-8f9ee50052ba tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 12:47:03 user nova-compute[74960]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 12:47:03 user nova-compute[74960]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74960) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 12:47:03 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-eba80401-e7fc-4f6e-adaa-8f9ee50052ba tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f4c6cd96-5bb9-496e-aaa7-37f872cee704', 0)] {{(pid=74960) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 12:47:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:47:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:47:03 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[b09f1bb9-8564-459c-8a67-307651928369]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4c6cd96-5bb9-496e-aaa7-37f872cee704\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:47:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:47:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:47:03 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a73b6a7-970f-42f4-9b97-ecc81f99a7e6]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4c6cd96-5bb9-496e-aaa7-37f872cee704 (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:47:03 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-eba80401-e7fc-4f6e-adaa-8f9ee50052ba tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4c6cd96-5bb9-496e-aaa7-37f872cee704 (non-flash)
Nov 03 12:47:03 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:47:03 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-eba80401-e7fc-4f6e-adaa-8f9ee50052ba tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4c6cd96-5bb9-496e-aaa7-37f872cee704 (non-flash)
Nov 03 12:47:03 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:47:03 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-eba80401-e7fc-4f6e-adaa-8f9ee50052ba tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9a8c43f250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f4c6cd96-5bb9-496e-aaa7-37f872cee704'): ({'sdb'}, set())}) {{(pid=74960) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 12:47:03 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-eba80401-e7fc-4f6e-adaa-8f9ee50052ba tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Removing single pathed devices sdb {{(pid=74960) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 12:47:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:47:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:47:03 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[35f7b7ec-f8cc-4a24-bdaf-dd8363e7869d]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:47:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:47:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:47:03 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[556e1343-09bc-46d4-88f4-eaf2538d4f6a]: (4, ('ok\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:47:03 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-eba80401-e7fc-4f6e-adaa-8f9ee50052ba tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Flushing IO for device /dev/sdb {{(pid=74960) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 12:47:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:47:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:47:03 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[44128edd-f841-4544-abc2-e0afb7e62d29]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:47:03 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-eba80401-e7fc-4f6e-adaa-8f9ee50052ba tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74960) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 12:47:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:47:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cfe99be-b74b-4fd3-a5d6-a94708992c5b/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:47:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cfe99be-b74b-4fd3-a5d6-a94708992c5b/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:47:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.033s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:47:03 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f5262c5-45de-4716-8e6c-1b7182161926]: (4, ('1', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:47:03 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-eba80401-e7fc-4f6e-adaa-8f9ee50052ba tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74960) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 12:47:03 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-eba80401-e7fc-4f6e-adaa-8f9ee50052ba tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] SCSI volumes sdb have been removed. {{(pid=74960) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 12:47:03 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-eba80401-e7fc-4f6e-adaa-8f9ee50052ba tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f4c6cd96-5bb9-496e-aaa7-37f872cee704')] {{(pid=74960) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 12:47:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4c6cd96-5bb9-496e-aaa7-37f872cee704 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:47:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4c6cd96-5bb9-496e-aaa7-37f872cee704 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:47:03 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[84e5b450-0388-4485-ab58-31536cb5c59e]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:47:03 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-eba80401-e7fc-4f6e-adaa-8f9ee50052ba tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:47:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4c6cd96-5bb9-496e-aaa7-37f872cee704 -p 172.16.0.220:3260 --logout {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:47:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4c6cd96-5bb9-496e-aaa7-37f872cee704 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:47:03 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[22c350d8-a507-4278-b5f2-05803eb00aa6]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:f4c6cd96-5bb9-496e-aaa7-37f872cee704, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:f4c6cd96-5bb9-496e-aaa7-37f872cee704, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:47:03 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-eba80401-e7fc-4f6e-adaa-8f9ee50052ba tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:f4c6cd96-5bb9-496e-aaa7-37f872cee704, portal: 172.16.0.220,3260]
Nov 03 12:47:03 user nova-compute[74960]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:f4c6cd96-5bb9-496e-aaa7-37f872cee704, portal: 172.16.0.220,3260] successful.
Nov 03 12:47:03 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:47:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4c6cd96-5bb9-496e-aaa7-37f872cee704 -p 172.16.0.220:3260 --op delete {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:47:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4c6cd96-5bb9-496e-aaa7-37f872cee704 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:47:03 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a9a95c-b546-4eeb-a4d7-39d9d2b04311]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:47:03 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-eba80401-e7fc-4f6e-adaa-8f9ee50052ba tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:47:03 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-eba80401-e7fc-4f6e-adaa-8f9ee50052ba tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.283s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:47:03 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-eba80401-e7fc-4f6e-adaa-8f9ee50052ba tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] <== disconnect_volume: return (284ms) None {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:47:03 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eba80401-e7fc-4f6e-adaa-8f9ee50052ba tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] Disconnected iSCSI Volume {{(pid=74960) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 12:47:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cfe99be-b74b-4fd3-a5d6-a94708992c5b/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:47:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47eb8ddf-590f-4ffa-87c8-377cf1ee0f67/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:47:04 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47eb8ddf-590f-4ffa-87c8-377cf1ee0f67/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:47:04 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47eb8ddf-590f-4ffa-87c8-377cf1ee0f67/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:47:04 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47eb8ddf-590f-4ffa-87c8-377cf1ee0f67/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:47:04 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60658b54-5e34-4a2b-be14-124e47e291c2/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:47:04 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60658b54-5e34-4a2b-be14-124e47e291c2/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:47:04 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60658b54-5e34-4a2b-be14-124e47e291c2/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:47:04 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60658b54-5e34-4a2b-be14-124e47e291c2/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:47:04 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk.rescue --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:47:04 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:47:04 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk.rescue --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:47:04 user nova-compute[74960]: DEBUG nova.objects.instance [None req-eba80401-e7fc-4f6e-adaa-8f9ee50052ba tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Lazy-loading 'flavor' on Instance uuid 3cfe99be-b74b-4fd3-a5d6-a94708992c5b {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:47:04 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-eba80401-e7fc-4f6e-adaa-8f9ee50052ba tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Lock "3cfe99be-b74b-4fd3-a5d6-a94708992c5b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.917s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:47:04 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:47:04 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:47:05 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:47:05 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:47:05 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:47:05 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:47:05 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:47:05 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Hypervisor/Node resource view: name=user free_ram=8647MB free_disk=24.826927185058594GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74960) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 12:47:05 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:47:05 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:47:05 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:47:05 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:47:05 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 60658b54-5e34-4a2b-be14-124e47e291c2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:47:05 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 3cfe99be-b74b-4fd3-a5d6-a94708992c5b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:47:05 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74960) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 12:47:05 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74960) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 12:47:05 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:47:05 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:47:05 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Compute_service record updated for user:user {{(pid=74960) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 12:47:05 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.268s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:47:06 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:47:08 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:47:08 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Starting heal instance info cache {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 12:47:09 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "refresh_cache-60658b54-5e34-4a2b-be14-124e47e291c2" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:47:09 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquired lock "refresh_cache-60658b54-5e34-4a2b-be14-124e47e291c2" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:47:09 user nova-compute[74960]: DEBUG nova.network.neutron [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: 60658b54-5e34-4a2b-be14-124e47e291c2] Forcefully refreshing network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 12:47:09 user nova-compute[74960]: DEBUG nova.network.neutron [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: 60658b54-5e34-4a2b-be14-124e47e291c2] Updating instance_info_cache with network_info: [{"id": "70b66449-7eef-45c1-a3b1-69e50370ed0b", "address": "fa:16:3e:8f:d3:55", "network": {"id": "6c29b2f1-0c30-45d5-ade3-f792d5af7037", "bridge": "br-int", "label": "tempest-TestStampPattern-1770578791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df8ca5bb565b48648e39e6c128f54a57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70b66449-7e", "ovs_interfaceid": "70b66449-7eef-45c1-a3b1-69e50370ed0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:47:09 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Releasing lock "refresh_cache-60658b54-5e34-4a2b-be14-124e47e291c2" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:47:09 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: 60658b54-5e34-4a2b-be14-124e47e291c2] Updated the network info_cache for instance {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 12:47:09 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:47:09 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:47:09 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:47:09 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:47:09 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:47:09 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74960) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 12:47:11 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:47:11 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:47:11 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74960) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 12:47:11 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74960) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 12:47:11 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74960) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 12:47:11 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:47:16 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:47:19 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:47:21 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:47:26 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:47:26 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:47:31 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:47:33 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-a98a1758-607b-4de6-8c49-e0dd73647c66 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Acquiring lock "3cfe99be-b74b-4fd3-a5d6-a94708992c5b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:47:33 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-a98a1758-607b-4de6-8c49-e0dd73647c66 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Lock "3cfe99be-b74b-4fd3-a5d6-a94708992c5b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:47:33 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-a98a1758-607b-4de6-8c49-e0dd73647c66 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Acquiring lock "3cfe99be-b74b-4fd3-a5d6-a94708992c5b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:47:33 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-a98a1758-607b-4de6-8c49-e0dd73647c66 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Lock "3cfe99be-b74b-4fd3-a5d6-a94708992c5b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:47:33 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-a98a1758-607b-4de6-8c49-e0dd73647c66 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Lock "3cfe99be-b74b-4fd3-a5d6-a94708992c5b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:47:33 user nova-compute[74960]: INFO nova.compute.manager [None req-a98a1758-607b-4de6-8c49-e0dd73647c66 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] Terminating instance
Nov 03 12:47:33 user nova-compute[74960]: DEBUG nova.compute.manager [None req-a98a1758-607b-4de6-8c49-e0dd73647c66 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] Start destroying the instance on the hypervisor. {{(pid=74960) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 12:47:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:47:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:47:33 user nova-compute[74960]: DEBUG nova.compute.manager [req-fff98f54-3cd9-4558-ba6b-cf942aba1d72 req-4055461d-e305-4af7-894e-c2bcbac0b75c service nova] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] Received event network-vif-unplugged-ad28ac84-3419-4701-90df-e93359da2c28 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:47:33 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-fff98f54-3cd9-4558-ba6b-cf942aba1d72 req-4055461d-e305-4af7-894e-c2bcbac0b75c service nova] Acquiring lock "3cfe99be-b74b-4fd3-a5d6-a94708992c5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:47:33 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-fff98f54-3cd9-4558-ba6b-cf942aba1d72 req-4055461d-e305-4af7-894e-c2bcbac0b75c service nova] Lock "3cfe99be-b74b-4fd3-a5d6-a94708992c5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:47:33 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-fff98f54-3cd9-4558-ba6b-cf942aba1d72 req-4055461d-e305-4af7-894e-c2bcbac0b75c service nova] Lock "3cfe99be-b74b-4fd3-a5d6-a94708992c5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:47:33 user nova-compute[74960]: DEBUG nova.compute.manager [req-fff98f54-3cd9-4558-ba6b-cf942aba1d72 req-4055461d-e305-4af7-894e-c2bcbac0b75c service nova] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] No waiting events found dispatching network-vif-unplugged-ad28ac84-3419-4701-90df-e93359da2c28 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:47:33 user nova-compute[74960]: DEBUG nova.compute.manager [req-fff98f54-3cd9-4558-ba6b-cf942aba1d72 req-4055461d-e305-4af7-894e-c2bcbac0b75c service nova] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] Received event network-vif-unplugged-ad28ac84-3419-4701-90df-e93359da2c28 for instance with task_state deleting. {{(pid=74960) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 12:47:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:47:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:47:34 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] Instance destroyed successfully.
Nov 03 12:47:34 user nova-compute[74960]: DEBUG nova.objects.instance [None req-a98a1758-607b-4de6-8c49-e0dd73647c66 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Lazy-loading 'resources' on Instance uuid 3cfe99be-b74b-4fd3-a5d6-a94708992c5b {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:47:34 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-a98a1758-607b-4de6-8c49-e0dd73647c66 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:40:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1884980457',display_name='tempest-ServerRescueNegativeTestJSON-server-1884980457',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1884980457',id=40,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMAPMnFd1JRN0E4yOaz+7M9XDigELBr/MyBa4o6iI8rumzVsQU30J0F61h3Gx9Yw2QtcQXEUTWFuTmbBZuwDvVSgVUx/2raFWAzK21Wh2+8Wr1ogAAMcu8n8DGpouEmeFw==',key_name='tempest-keypair-1713845316',keypairs=<?>,launch_index=0,launched_at=2023-11-03T12:43:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='434ce6c4b77342299a17e547a14e3918',ramdisk_id='',reservation_id='r-oiu8hz60',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1678469488',owner_user_name='tempest-ServerRescueNegativeTestJSON-1678469488-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T12:44:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82a995b6307c4ba0b4cf8d5ede286a6c',uuid=3cfe99be-b74b-4fd3-a5d6-a94708992c5b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ad28ac84-3419-4701-90df-e93359da2c28", "address": "fa:16:3e:1f:4e:b6", "network": {"id": "9a9a848a-80be-4281-8554-8e28744073b3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1579909169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "434ce6c4b77342299a17e547a14e3918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad28ac84-34", "ovs_interfaceid": "ad28ac84-3419-4701-90df-e93359da2c28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 12:47:34 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-a98a1758-607b-4de6-8c49-e0dd73647c66 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Converting VIF {"id": "ad28ac84-3419-4701-90df-e93359da2c28", "address": "fa:16:3e:1f:4e:b6", "network": {"id": "9a9a848a-80be-4281-8554-8e28744073b3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1579909169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "434ce6c4b77342299a17e547a14e3918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad28ac84-34", "ovs_interfaceid": "ad28ac84-3419-4701-90df-e93359da2c28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:47:34 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-a98a1758-607b-4de6-8c49-e0dd73647c66 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1f:4e:b6,bridge_name='br-int',has_traffic_filtering=True,id=ad28ac84-3419-4701-90df-e93359da2c28,network=Network(9a9a848a-80be-4281-8554-8e28744073b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad28ac84-34') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:47:34 user nova-compute[74960]: DEBUG os_vif [None req-a98a1758-607b-4de6-8c49-e0dd73647c66 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:4e:b6,bridge_name='br-int',has_traffic_filtering=True,id=ad28ac84-3419-4701-90df-e93359da2c28,network=Network(9a9a848a-80be-4281-8554-8e28744073b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad28ac84-34') {{(pid=74960) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 12:47:34 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:47:34 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapad28ac84-34, bridge=br-int, if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:47:34 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:47:34 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:47:34 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:47:34 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=993d46c2-9174-438c-b42f-52fc0a034ee6) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:47:34 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:47:34 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:47:34 user nova-compute[74960]: INFO os_vif [None req-a98a1758-607b-4de6-8c49-e0dd73647c66 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:4e:b6,bridge_name='br-int',has_traffic_filtering=True,id=ad28ac84-3419-4701-90df-e93359da2c28,network=Network(9a9a848a-80be-4281-8554-8e28744073b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad28ac84-34')
Nov 03 12:47:34 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-a98a1758-607b-4de6-8c49-e0dd73647c66 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] Deleting instance files /opt/stack/data/nova/instances/3cfe99be-b74b-4fd3-a5d6-a94708992c5b_del
Nov 03 12:47:34 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-a98a1758-607b-4de6-8c49-e0dd73647c66 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] Deletion of /opt/stack/data/nova/instances/3cfe99be-b74b-4fd3-a5d6-a94708992c5b_del complete
Nov 03 12:47:34 user nova-compute[74960]: INFO nova.compute.manager [None req-a98a1758-607b-4de6-8c49-e0dd73647c66 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 03 12:47:34 user nova-compute[74960]: DEBUG oslo.service.loopingcall [None req-a98a1758-607b-4de6-8c49-e0dd73647c66 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74960) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 12:47:34 user nova-compute[74960]: DEBUG nova.compute.manager [-] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] Deallocating network for instance {{(pid=74960) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 12:47:34 user nova-compute[74960]: DEBUG nova.network.neutron [-] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] deallocate_for_instance() {{(pid=74960) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 12:47:35 user nova-compute[74960]: DEBUG nova.network.neutron [-] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] Updating instance_info_cache with network_info: [] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:47:35 user nova-compute[74960]: INFO nova.compute.manager [-] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] Took 0.85 seconds to deallocate network for instance.
Nov 03 12:47:35 user nova-compute[74960]: DEBUG nova.compute.manager [req-f92c83d7-c61f-47ef-96c2-d53b25deabbe req-6e3c2ae1-ac19-4f34-add4-b9f12f723007 service nova] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] Received event network-vif-deleted-ad28ac84-3419-4701-90df-e93359da2c28 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:47:35 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-a98a1758-607b-4de6-8c49-e0dd73647c66 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:47:35 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-a98a1758-607b-4de6-8c49-e0dd73647c66 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:47:35 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-a98a1758-607b-4de6-8c49-e0dd73647c66 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:47:35 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-a98a1758-607b-4de6-8c49-e0dd73647c66 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:47:35 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-a98a1758-607b-4de6-8c49-e0dd73647c66 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.191s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:47:35 user nova-compute[74960]: INFO nova.scheduler.client.report [None req-a98a1758-607b-4de6-8c49-e0dd73647c66 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Deleted allocations for instance 3cfe99be-b74b-4fd3-a5d6-a94708992c5b
Nov 03 12:47:35 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-a98a1758-607b-4de6-8c49-e0dd73647c66 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Lock "3cfe99be-b74b-4fd3-a5d6-a94708992c5b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.136s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:47:35 user nova-compute[74960]: DEBUG nova.compute.manager [req-9d95cd19-0450-4680-b028-8de3ec79a924 req-ec918c9d-dfef-4c41-aea5-84eb67bb13b8 service nova] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] Received event network-vif-plugged-ad28ac84-3419-4701-90df-e93359da2c28 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:47:35 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-9d95cd19-0450-4680-b028-8de3ec79a924 req-ec918c9d-dfef-4c41-aea5-84eb67bb13b8 service nova] Acquiring lock "3cfe99be-b74b-4fd3-a5d6-a94708992c5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:47:35 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-9d95cd19-0450-4680-b028-8de3ec79a924 req-ec918c9d-dfef-4c41-aea5-84eb67bb13b8 service nova] Lock "3cfe99be-b74b-4fd3-a5d6-a94708992c5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:47:35 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-9d95cd19-0450-4680-b028-8de3ec79a924 req-ec918c9d-dfef-4c41-aea5-84eb67bb13b8 service nova] Lock "3cfe99be-b74b-4fd3-a5d6-a94708992c5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:47:35 user nova-compute[74960]: DEBUG nova.compute.manager [req-9d95cd19-0450-4680-b028-8de3ec79a924 req-ec918c9d-dfef-4c41-aea5-84eb67bb13b8 service nova] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] No waiting events found dispatching network-vif-plugged-ad28ac84-3419-4701-90df-e93359da2c28 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:47:35 user nova-compute[74960]: WARNING nova.compute.manager [req-9d95cd19-0450-4680-b028-8de3ec79a924 req-ec918c9d-dfef-4c41-aea5-84eb67bb13b8 service nova] [instance: 3cfe99be-b74b-4fd3-a5d6-a94708992c5b] Received unexpected event network-vif-plugged-ad28ac84-3419-4701-90df-e93359da2c28 for instance with vm_state deleted and task_state None.
Nov 03 12:47:39 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:47:44 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:47:49 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:47:54 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:47:54 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:47:54 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74960) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 12:47:54 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74960) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 12:47:54 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74960) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 12:47:54 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:47:59 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:48:00 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:48:03 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:48:03 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:48:03 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:48:03 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:48:03 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:48:03 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Auditing locally available compute resources for user (node: user) {{(pid=74960) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 12:48:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47eb8ddf-590f-4ffa-87c8-377cf1ee0f67/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:48:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47eb8ddf-590f-4ffa-87c8-377cf1ee0f67/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:48:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47eb8ddf-590f-4ffa-87c8-377cf1ee0f67/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:48:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47eb8ddf-590f-4ffa-87c8-377cf1ee0f67/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:48:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60658b54-5e34-4a2b-be14-124e47e291c2/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:48:04 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60658b54-5e34-4a2b-be14-124e47e291c2/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:48:04 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60658b54-5e34-4a2b-be14-124e47e291c2/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:48:04 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:48:04 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60658b54-5e34-4a2b-be14-124e47e291c2/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:48:04 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk.rescue --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:48:04 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:48:04 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk.rescue --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:48:04 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:48:04 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:48:04 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:48:04 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:48:04 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:48:05 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:48:05 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:48:05 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Hypervisor/Node resource view: name=user free_ram=8713MB free_disk=24.94188690185547GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74960) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 12:48:05 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:48:05 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:48:05 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:48:05 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:48:05 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 60658b54-5e34-4a2b-be14-124e47e291c2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:48:05 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74960) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 12:48:05 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74960) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 12:48:05 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:48:05 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:48:05 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Compute_service record updated for user:user {{(pid=74960) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 12:48:05 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.319s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:48:05 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:48:08 user nova-compute[74960]: DEBUG nova.compute.manager [req-fa384c7f-c880-4afc-b3d4-7b48b266c310 req-4d16b156-9645-4475-9553-8046a30d4d4e service nova] [instance: 60658b54-5e34-4a2b-be14-124e47e291c2] Received event network-changed-70b66449-7eef-45c1-a3b1-69e50370ed0b {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:48:08 user nova-compute[74960]: DEBUG nova.compute.manager [req-fa384c7f-c880-4afc-b3d4-7b48b266c310 req-4d16b156-9645-4475-9553-8046a30d4d4e service nova] [instance: 60658b54-5e34-4a2b-be14-124e47e291c2] Refreshing instance network info cache due to event network-changed-70b66449-7eef-45c1-a3b1-69e50370ed0b. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 12:48:08 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-fa384c7f-c880-4afc-b3d4-7b48b266c310 req-4d16b156-9645-4475-9553-8046a30d4d4e service nova] Acquiring lock "refresh_cache-60658b54-5e34-4a2b-be14-124e47e291c2" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:48:08 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-fa384c7f-c880-4afc-b3d4-7b48b266c310 req-4d16b156-9645-4475-9553-8046a30d4d4e service nova] Acquired lock "refresh_cache-60658b54-5e34-4a2b-be14-124e47e291c2" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:48:08 user nova-compute[74960]: DEBUG nova.network.neutron [req-fa384c7f-c880-4afc-b3d4-7b48b266c310 req-4d16b156-9645-4475-9553-8046a30d4d4e service nova] [instance: 60658b54-5e34-4a2b-be14-124e47e291c2] Refreshing network info cache for port 70b66449-7eef-45c1-a3b1-69e50370ed0b {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 12:48:09 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-8ce0e36b-a9ab-45a4-940f-20918ef369d1 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Acquiring lock "60658b54-5e34-4a2b-be14-124e47e291c2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:48:09 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-8ce0e36b-a9ab-45a4-940f-20918ef369d1 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Lock "60658b54-5e34-4a2b-be14-124e47e291c2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:48:09 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-8ce0e36b-a9ab-45a4-940f-20918ef369d1 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Acquiring lock "60658b54-5e34-4a2b-be14-124e47e291c2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:48:09 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-8ce0e36b-a9ab-45a4-940f-20918ef369d1 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Lock "60658b54-5e34-4a2b-be14-124e47e291c2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:48:09 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-8ce0e36b-a9ab-45a4-940f-20918ef369d1 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Lock "60658b54-5e34-4a2b-be14-124e47e291c2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:48:09 user nova-compute[74960]: INFO nova.compute.manager [None req-8ce0e36b-a9ab-45a4-940f-20918ef369d1 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] [instance: 60658b54-5e34-4a2b-be14-124e47e291c2] Terminating instance
Nov 03 12:48:09 user nova-compute[74960]: DEBUG nova.compute.manager [None req-8ce0e36b-a9ab-45a4-940f-20918ef369d1 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] [instance: 60658b54-5e34-4a2b-be14-124e47e291c2] Start destroying the instance on the hypervisor. {{(pid=74960) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 12:48:09 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:48:09 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:48:09 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:48:09 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:48:09 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:48:09 user nova-compute[74960]: DEBUG nova.network.neutron [req-fa384c7f-c880-4afc-b3d4-7b48b266c310 req-4d16b156-9645-4475-9553-8046a30d4d4e service nova] [instance: 60658b54-5e34-4a2b-be14-124e47e291c2] Updated VIF entry in instance network info cache for port 70b66449-7eef-45c1-a3b1-69e50370ed0b. {{(pid=74960) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 12:48:09 user nova-compute[74960]: DEBUG nova.network.neutron [req-fa384c7f-c880-4afc-b3d4-7b48b266c310 req-4d16b156-9645-4475-9553-8046a30d4d4e service nova] [instance: 60658b54-5e34-4a2b-be14-124e47e291c2] Updating instance_info_cache with network_info: [{"id": "70b66449-7eef-45c1-a3b1-69e50370ed0b", "address": "fa:16:3e:8f:d3:55", "network": {"id": "6c29b2f1-0c30-45d5-ade3-f792d5af7037", "bridge": "br-int", "label": "tempest-TestStampPattern-1770578791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df8ca5bb565b48648e39e6c128f54a57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70b66449-7e", "ovs_interfaceid": "70b66449-7eef-45c1-a3b1-69e50370ed0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:48:09 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-fa384c7f-c880-4afc-b3d4-7b48b266c310 req-4d16b156-9645-4475-9553-8046a30d4d4e service nova] Releasing lock "refresh_cache-60658b54-5e34-4a2b-be14-124e47e291c2" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:48:09 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:48:09 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Starting heal instance info cache {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 12:48:09 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Didn't find any instances for network info cache update. {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 03 12:48:09 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:48:09 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:48:09 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:48:09 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:48:09 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: 60658b54-5e34-4a2b-be14-124e47e291c2] Instance destroyed successfully.
Nov 03 12:48:09 user nova-compute[74960]: DEBUG nova.objects.instance [None req-8ce0e36b-a9ab-45a4-940f-20918ef369d1 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Lazy-loading 'resources' on Instance uuid 60658b54-5e34-4a2b-be14-124e47e291c2 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:48:09 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-8ce0e36b-a9ab-45a4-940f-20918ef369d1 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:39:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-429799797',display_name='tempest-TestStampPattern-server-429799797',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-429799797',id=39,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOVJGiA8+WxYV0H4D5A8tW82c36Y66O0cQc4FMiKT0kp3U+xT9R3wjcl8Y9oz6PsAiIG74/EBNibsdR8g5KJgAe/YXLGMoJSdUpoQNRjhz9zQdfyFtfcNImepV7xlRbyrw==',key_name='tempest-TestStampPattern-2145016267',keypairs=<?>,launch_index=0,launched_at=2023-11-03T12:39:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='df8ca5bb565b48648e39e6c128f54a57',ramdisk_id='',reservation_id='r-v0d1u5pn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1528534742',owner_user_name='tempest-TestStampPattern-1528534742-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T12:43:15Z,user_data=None,user_id='946ef9f0f5d04f43bc8c248de57d6566',uuid=60658b54-5e34-4a2b-be14-124e47e291c2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "70b66449-7eef-45c1-a3b1-69e50370ed0b", "address": "fa:16:3e:8f:d3:55", "network": {"id": "6c29b2f1-0c30-45d5-ade3-f792d5af7037", "bridge": "br-int", "label": "tempest-TestStampPattern-1770578791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df8ca5bb565b48648e39e6c128f54a57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70b66449-7e", "ovs_interfaceid": "70b66449-7eef-45c1-a3b1-69e50370ed0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 12:48:09 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-8ce0e36b-a9ab-45a4-940f-20918ef369d1 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Converting VIF {"id": "70b66449-7eef-45c1-a3b1-69e50370ed0b", "address": "fa:16:3e:8f:d3:55", "network": {"id": "6c29b2f1-0c30-45d5-ade3-f792d5af7037", "bridge": "br-int", "label": "tempest-TestStampPattern-1770578791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df8ca5bb565b48648e39e6c128f54a57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70b66449-7e", "ovs_interfaceid": "70b66449-7eef-45c1-a3b1-69e50370ed0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:48:09 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-8ce0e36b-a9ab-45a4-940f-20918ef369d1 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8f:d3:55,bridge_name='br-int',has_traffic_filtering=True,id=70b66449-7eef-45c1-a3b1-69e50370ed0b,network=Network(6c29b2f1-0c30-45d5-ade3-f792d5af7037),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70b66449-7e') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:48:09 user nova-compute[74960]: DEBUG os_vif [None req-8ce0e36b-a9ab-45a4-940f-20918ef369d1 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:d3:55,bridge_name='br-int',has_traffic_filtering=True,id=70b66449-7eef-45c1-a3b1-69e50370ed0b,network=Network(6c29b2f1-0c30-45d5-ade3-f792d5af7037),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70b66449-7e') {{(pid=74960) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 12:48:09 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:48:09 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap70b66449-7e, bridge=br-int, if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:48:09 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:48:09 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:48:09 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:48:09 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2f27854a-eecd-4716-818d-d6a6bc620009) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:48:09 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:48:09 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:48:09 user nova-compute[74960]: INFO os_vif [None req-8ce0e36b-a9ab-45a4-940f-20918ef369d1 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:d3:55,bridge_name='br-int',has_traffic_filtering=True,id=70b66449-7eef-45c1-a3b1-69e50370ed0b,network=Network(6c29b2f1-0c30-45d5-ade3-f792d5af7037),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70b66449-7e')
Nov 03 12:48:09 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-8ce0e36b-a9ab-45a4-940f-20918ef369d1 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] [instance: 60658b54-5e34-4a2b-be14-124e47e291c2] Deleting instance files /opt/stack/data/nova/instances/60658b54-5e34-4a2b-be14-124e47e291c2_del
Nov 03 12:48:09 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-8ce0e36b-a9ab-45a4-940f-20918ef369d1 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] [instance: 60658b54-5e34-4a2b-be14-124e47e291c2] Deletion of /opt/stack/data/nova/instances/60658b54-5e34-4a2b-be14-124e47e291c2_del complete
Nov 03 12:48:10 user nova-compute[74960]: INFO nova.compute.manager [None req-8ce0e36b-a9ab-45a4-940f-20918ef369d1 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] [instance: 60658b54-5e34-4a2b-be14-124e47e291c2] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 03 12:48:10 user nova-compute[74960]: DEBUG oslo.service.loopingcall [None req-8ce0e36b-a9ab-45a4-940f-20918ef369d1 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74960) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 12:48:10 user nova-compute[74960]: DEBUG nova.compute.manager [-] [instance: 60658b54-5e34-4a2b-be14-124e47e291c2] Deallocating network for instance {{(pid=74960) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 12:48:10 user nova-compute[74960]: DEBUG nova.network.neutron [-] [instance: 60658b54-5e34-4a2b-be14-124e47e291c2] deallocate_for_instance() {{(pid=74960) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 12:48:10 user nova-compute[74960]: DEBUG nova.network.neutron [-] [instance: 60658b54-5e34-4a2b-be14-124e47e291c2] Updating instance_info_cache with network_info: [] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:48:10 user nova-compute[74960]: INFO nova.compute.manager [-] [instance: 60658b54-5e34-4a2b-be14-124e47e291c2] Took 0.54 seconds to deallocate network for instance.
Nov 03 12:48:10 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-8ce0e36b-a9ab-45a4-940f-20918ef369d1 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:48:10 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-8ce0e36b-a9ab-45a4-940f-20918ef369d1 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:48:10 user nova-compute[74960]: DEBUG nova.compute.manager [req-e2b54423-c87a-41dc-8f4e-b248f1ddbc53 req-dfbbe751-f911-48bc-ae94-f4a154c6cb6c service nova] [instance: 60658b54-5e34-4a2b-be14-124e47e291c2] Received event network-vif-deleted-70b66449-7eef-45c1-a3b1-69e50370ed0b {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:48:10 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-8ce0e36b-a9ab-45a4-940f-20918ef369d1 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Refreshing inventories for resource provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 03 12:48:10 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-8ce0e36b-a9ab-45a4-940f-20918ef369d1 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Updating ProviderTree inventory for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 03 12:48:10 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-8ce0e36b-a9ab-45a4-940f-20918ef369d1 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Updating inventory in ProviderTree for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 03 12:48:10 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-8ce0e36b-a9ab-45a4-940f-20918ef369d1 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Refreshing aggregate associations for resource provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0, aggregates: None {{(pid=74960) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 03 12:48:10 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-8ce0e36b-a9ab-45a4-940f-20918ef369d1 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Refreshing trait associations for resource provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0, traits: COMPUTE_NODE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE41,HW_CPU_X86_SSSE3,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_DEVICE_TAGGING,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_QXL {{(pid=74960) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 03 12:48:11 user nova-compute[74960]: DEBUG nova.compute.manager [req-fa1d94a5-bb93-4d24-9116-edd0ee40b07f req-dae49fa6-9d71-46a6-8f7a-b66af2bea7b9 service nova] [instance: 60658b54-5e34-4a2b-be14-124e47e291c2] Received event network-vif-unplugged-70b66449-7eef-45c1-a3b1-69e50370ed0b {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:48:11 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-fa1d94a5-bb93-4d24-9116-edd0ee40b07f req-dae49fa6-9d71-46a6-8f7a-b66af2bea7b9 service nova] Acquiring lock "60658b54-5e34-4a2b-be14-124e47e291c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:48:11 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-fa1d94a5-bb93-4d24-9116-edd0ee40b07f req-dae49fa6-9d71-46a6-8f7a-b66af2bea7b9 service nova] Lock "60658b54-5e34-4a2b-be14-124e47e291c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:48:11 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-fa1d94a5-bb93-4d24-9116-edd0ee40b07f req-dae49fa6-9d71-46a6-8f7a-b66af2bea7b9 service nova] Lock "60658b54-5e34-4a2b-be14-124e47e291c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:48:11 user nova-compute[74960]: DEBUG nova.compute.manager [req-fa1d94a5-bb93-4d24-9116-edd0ee40b07f req-dae49fa6-9d71-46a6-8f7a-b66af2bea7b9 service nova] [instance: 60658b54-5e34-4a2b-be14-124e47e291c2] No waiting events found dispatching network-vif-unplugged-70b66449-7eef-45c1-a3b1-69e50370ed0b {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:48:11 user nova-compute[74960]: WARNING nova.compute.manager [req-fa1d94a5-bb93-4d24-9116-edd0ee40b07f req-dae49fa6-9d71-46a6-8f7a-b66af2bea7b9 service nova] [instance: 60658b54-5e34-4a2b-be14-124e47e291c2] Received unexpected event network-vif-unplugged-70b66449-7eef-45c1-a3b1-69e50370ed0b for instance with vm_state deleted and task_state None.
Nov 03 12:48:11 user nova-compute[74960]: DEBUG nova.compute.manager [req-fa1d94a5-bb93-4d24-9116-edd0ee40b07f req-dae49fa6-9d71-46a6-8f7a-b66af2bea7b9 service nova] [instance: 60658b54-5e34-4a2b-be14-124e47e291c2] Received event network-vif-plugged-70b66449-7eef-45c1-a3b1-69e50370ed0b {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:48:11 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-fa1d94a5-bb93-4d24-9116-edd0ee40b07f req-dae49fa6-9d71-46a6-8f7a-b66af2bea7b9 service nova] Acquiring lock "60658b54-5e34-4a2b-be14-124e47e291c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:48:11 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-fa1d94a5-bb93-4d24-9116-edd0ee40b07f req-dae49fa6-9d71-46a6-8f7a-b66af2bea7b9 service nova] Lock "60658b54-5e34-4a2b-be14-124e47e291c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:48:11 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-fa1d94a5-bb93-4d24-9116-edd0ee40b07f req-dae49fa6-9d71-46a6-8f7a-b66af2bea7b9 service nova] Lock "60658b54-5e34-4a2b-be14-124e47e291c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:48:11 user nova-compute[74960]: DEBUG nova.compute.manager [req-fa1d94a5-bb93-4d24-9116-edd0ee40b07f req-dae49fa6-9d71-46a6-8f7a-b66af2bea7b9 service nova] [instance: 60658b54-5e34-4a2b-be14-124e47e291c2] No waiting events found dispatching network-vif-plugged-70b66449-7eef-45c1-a3b1-69e50370ed0b {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:48:11 user nova-compute[74960]: WARNING nova.compute.manager [req-fa1d94a5-bb93-4d24-9116-edd0ee40b07f req-dae49fa6-9d71-46a6-8f7a-b66af2bea7b9 service nova] [instance: 60658b54-5e34-4a2b-be14-124e47e291c2] Received unexpected event network-vif-plugged-70b66449-7eef-45c1-a3b1-69e50370ed0b for instance with vm_state deleted and task_state None.
Nov 03 12:48:11 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-8ce0e36b-a9ab-45a4-940f-20918ef369d1 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:48:11 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-8ce0e36b-a9ab-45a4-940f-20918ef369d1 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:48:11 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-8ce0e36b-a9ab-45a4-940f-20918ef369d1 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.454s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:48:11 user nova-compute[74960]: INFO nova.scheduler.client.report [None req-8ce0e36b-a9ab-45a4-940f-20918ef369d1 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Deleted allocations for instance 60658b54-5e34-4a2b-be14-124e47e291c2
Nov 03 12:48:11 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-8ce0e36b-a9ab-45a4-940f-20918ef369d1 tempest-TestStampPattern-1528534742 tempest-TestStampPattern-1528534742-project-member] Lock "60658b54-5e34-4a2b-be14-124e47e291c2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.146s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:48:11 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:48:11 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74960) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 12:48:14 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:48:15 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:48:15 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Cleaning up deleted instances {{(pid=74960) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 03 12:48:15 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] There are 0 instances to clean {{(pid=74960) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 03 12:48:19 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:48:20 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:48:22 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:48:22 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Cleaning up deleted instances with incomplete migration  {{(pid=74960) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 03 12:48:24 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:48:29 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:48:34 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:48:39 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:48:44 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:48:46 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:48:46 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-62c5e4de-fe47-4b50-b3d7-8f8945ffd1f0 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Acquiring lock "b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:48:46 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-62c5e4de-fe47-4b50-b3d7-8f8945ffd1f0 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Lock "b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:48:46 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-62c5e4de-fe47-4b50-b3d7-8f8945ffd1f0 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Acquiring lock "b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:48:46 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-62c5e4de-fe47-4b50-b3d7-8f8945ffd1f0 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Lock "b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:48:46 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-62c5e4de-fe47-4b50-b3d7-8f8945ffd1f0 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Lock "b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:48:46 user nova-compute[74960]: INFO nova.compute.manager [None req-62c5e4de-fe47-4b50-b3d7-8f8945ffd1f0 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d] Terminating instance
Nov 03 12:48:46 user nova-compute[74960]: DEBUG nova.compute.manager [None req-62c5e4de-fe47-4b50-b3d7-8f8945ffd1f0 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d] Start destroying the instance on the hypervisor. {{(pid=74960) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 12:48:47 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:48:47 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:48:47 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:48:47 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:48:47 user nova-compute[74960]: DEBUG nova.compute.manager [req-a354480d-54df-46d5-b3ac-26af832693ef req-400fab7b-da27-4ec6-8da2-bb40ef03092c service nova] [instance: b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d] Received event network-vif-unplugged-b0f443c5-8a12-41fd-9275-81b88b3c08fd {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:48:47 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-a354480d-54df-46d5-b3ac-26af832693ef req-400fab7b-da27-4ec6-8da2-bb40ef03092c service nova] Acquiring lock "b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:48:47 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-a354480d-54df-46d5-b3ac-26af832693ef req-400fab7b-da27-4ec6-8da2-bb40ef03092c service nova] Lock "b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:48:47 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-a354480d-54df-46d5-b3ac-26af832693ef req-400fab7b-da27-4ec6-8da2-bb40ef03092c service nova] Lock "b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:48:47 user nova-compute[74960]: DEBUG nova.compute.manager [req-a354480d-54df-46d5-b3ac-26af832693ef req-400fab7b-da27-4ec6-8da2-bb40ef03092c service nova] [instance: b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d] No waiting events found dispatching network-vif-unplugged-b0f443c5-8a12-41fd-9275-81b88b3c08fd {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:48:47 user nova-compute[74960]: DEBUG nova.compute.manager [req-a354480d-54df-46d5-b3ac-26af832693ef req-400fab7b-da27-4ec6-8da2-bb40ef03092c service nova] [instance: b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d] Received event network-vif-unplugged-b0f443c5-8a12-41fd-9275-81b88b3c08fd for instance with task_state deleting. {{(pid=74960) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 12:48:47 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:48:47 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:48:47 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d] Instance destroyed successfully.
Nov 03 12:48:47 user nova-compute[74960]: DEBUG nova.objects.instance [None req-62c5e4de-fe47-4b50-b3d7-8f8945ffd1f0 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Lazy-loading 'resources' on Instance uuid b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:48:47 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-62c5e4de-fe47-4b50-b3d7-8f8945ffd1f0 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:32:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1585096232',display_name='tempest-ServerRescueNegativeTestJSON-server-1585096232',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1585096232',id=32,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-03T12:34:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='434ce6c4b77342299a17e547a14e3918',ramdisk_id='',reservation_id='r-qfzcokmy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1678469488',owner_user_name='tempest-ServerRescueNegativeTestJSON-1678469488-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T12:34:01Z,user_data=None,user_id='82a995b6307c4ba0b4cf8d5ede286a6c',uuid=b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "b0f443c5-8a12-41fd-9275-81b88b3c08fd", "address": "fa:16:3e:68:31:70", "network": {"id": "9a9a848a-80be-4281-8554-8e28744073b3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1579909169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "434ce6c4b77342299a17e547a14e3918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0f443c5-8a", "ovs_interfaceid": "b0f443c5-8a12-41fd-9275-81b88b3c08fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 12:48:47 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-62c5e4de-fe47-4b50-b3d7-8f8945ffd1f0 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Converting VIF {"id": "b0f443c5-8a12-41fd-9275-81b88b3c08fd", "address": "fa:16:3e:68:31:70", "network": {"id": "9a9a848a-80be-4281-8554-8e28744073b3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1579909169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "434ce6c4b77342299a17e547a14e3918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0f443c5-8a", "ovs_interfaceid": "b0f443c5-8a12-41fd-9275-81b88b3c08fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:48:47 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-62c5e4de-fe47-4b50-b3d7-8f8945ffd1f0 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:68:31:70,bridge_name='br-int',has_traffic_filtering=True,id=b0f443c5-8a12-41fd-9275-81b88b3c08fd,network=Network(9a9a848a-80be-4281-8554-8e28744073b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0f443c5-8a') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:48:47 user nova-compute[74960]: DEBUG os_vif [None req-62c5e4de-fe47-4b50-b3d7-8f8945ffd1f0 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:68:31:70,bridge_name='br-int',has_traffic_filtering=True,id=b0f443c5-8a12-41fd-9275-81b88b3c08fd,network=Network(9a9a848a-80be-4281-8554-8e28744073b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0f443c5-8a') {{(pid=74960) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 12:48:47 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:48:47 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb0f443c5-8a, bridge=br-int, if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:48:47 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:48:47 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:48:47 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:48:47 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fb4c27e8-594e-474b-87e6-f6f56f926402) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:48:47 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:48:47 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:48:47 user nova-compute[74960]: INFO os_vif [None req-62c5e4de-fe47-4b50-b3d7-8f8945ffd1f0 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:68:31:70,bridge_name='br-int',has_traffic_filtering=True,id=b0f443c5-8a12-41fd-9275-81b88b3c08fd,network=Network(9a9a848a-80be-4281-8554-8e28744073b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0f443c5-8a')
Nov 03 12:48:47 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-62c5e4de-fe47-4b50-b3d7-8f8945ffd1f0 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d] Deleting instance files /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d_del
Nov 03 12:48:47 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-62c5e4de-fe47-4b50-b3d7-8f8945ffd1f0 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d] Deletion of /opt/stack/data/nova/instances/b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d_del complete
Nov 03 12:48:47 user nova-compute[74960]: INFO nova.compute.manager [None req-62c5e4de-fe47-4b50-b3d7-8f8945ffd1f0 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 03 12:48:47 user nova-compute[74960]: DEBUG oslo.service.loopingcall [None req-62c5e4de-fe47-4b50-b3d7-8f8945ffd1f0 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74960) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 12:48:47 user nova-compute[74960]: DEBUG nova.compute.manager [-] [instance: b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d] Deallocating network for instance {{(pid=74960) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 12:48:47 user nova-compute[74960]: DEBUG nova.network.neutron [-] [instance: b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d] deallocate_for_instance() {{(pid=74960) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 12:48:48 user nova-compute[74960]: DEBUG nova.network.neutron [-] [instance: b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d] Updating instance_info_cache with network_info: [] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:48:48 user nova-compute[74960]: INFO nova.compute.manager [-] [instance: b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d] Took 0.57 seconds to deallocate network for instance.
Nov 03 12:48:48 user nova-compute[74960]: DEBUG nova.compute.manager [req-c1f53308-870f-44a5-9cd4-800214947c0a req-5f17a923-5000-42ef-84a6-b5d5c4185671 service nova] [instance: b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d] Received event network-vif-deleted-b0f443c5-8a12-41fd-9275-81b88b3c08fd {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:48:48 user nova-compute[74960]: INFO nova.compute.manager [req-c1f53308-870f-44a5-9cd4-800214947c0a req-5f17a923-5000-42ef-84a6-b5d5c4185671 service nova] [instance: b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d] Neutron deleted interface b0f443c5-8a12-41fd-9275-81b88b3c08fd; detaching it from the instance and deleting it from the info cache
Nov 03 12:48:48 user nova-compute[74960]: DEBUG nova.network.neutron [req-c1f53308-870f-44a5-9cd4-800214947c0a req-5f17a923-5000-42ef-84a6-b5d5c4185671 service nova] [instance: b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d] Updating instance_info_cache with network_info: [] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:48:48 user nova-compute[74960]: DEBUG nova.compute.manager [req-c1f53308-870f-44a5-9cd4-800214947c0a req-5f17a923-5000-42ef-84a6-b5d5c4185671 service nova] [instance: b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d] Detach interface failed, port_id=b0f443c5-8a12-41fd-9275-81b88b3c08fd, reason: Instance b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d could not be found. {{(pid=74960) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 03 12:48:48 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-62c5e4de-fe47-4b50-b3d7-8f8945ffd1f0 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:48:48 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-62c5e4de-fe47-4b50-b3d7-8f8945ffd1f0 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:48:48 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-62c5e4de-fe47-4b50-b3d7-8f8945ffd1f0 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:48:48 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-62c5e4de-fe47-4b50-b3d7-8f8945ffd1f0 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:48:48 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-62c5e4de-fe47-4b50-b3d7-8f8945ffd1f0 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.254s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:48:48 user nova-compute[74960]: INFO nova.scheduler.client.report [None req-62c5e4de-fe47-4b50-b3d7-8f8945ffd1f0 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Deleted allocations for instance b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d
Nov 03 12:48:48 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-62c5e4de-fe47-4b50-b3d7-8f8945ffd1f0 tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Lock "b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.973s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:48:49 user nova-compute[74960]: DEBUG nova.compute.manager [req-0f9d2393-7efd-4c86-b9c0-29f92c558437 req-88c94892-d67b-4481-a0a0-33c16e2bb30b service nova] [instance: b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d] Received event network-vif-plugged-b0f443c5-8a12-41fd-9275-81b88b3c08fd {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:48:49 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-0f9d2393-7efd-4c86-b9c0-29f92c558437 req-88c94892-d67b-4481-a0a0-33c16e2bb30b service nova] Acquiring lock "b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:48:49 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-0f9d2393-7efd-4c86-b9c0-29f92c558437 req-88c94892-d67b-4481-a0a0-33c16e2bb30b service nova] Lock "b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:48:49 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-0f9d2393-7efd-4c86-b9c0-29f92c558437 req-88c94892-d67b-4481-a0a0-33c16e2bb30b service nova] Lock "b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:48:49 user nova-compute[74960]: DEBUG nova.compute.manager [req-0f9d2393-7efd-4c86-b9c0-29f92c558437 req-88c94892-d67b-4481-a0a0-33c16e2bb30b service nova] [instance: b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d] No waiting events found dispatching network-vif-plugged-b0f443c5-8a12-41fd-9275-81b88b3c08fd {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:48:49 user nova-compute[74960]: WARNING nova.compute.manager [req-0f9d2393-7efd-4c86-b9c0-29f92c558437 req-88c94892-d67b-4481-a0a0-33c16e2bb30b service nova] [instance: b9ef1936-d411-4fa3-a9ad-6cb7f09bab0d] Received unexpected event network-vif-plugged-b0f443c5-8a12-41fd-9275-81b88b3c08fd for instance with vm_state deleted and task_state None.
Nov 03 12:48:52 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:48:57 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:49:01 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:49:02 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:49:04 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:49:04 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:49:04 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:49:04 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:49:04 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Auditing locally available compute resources for user (node: user) {{(pid=74960) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 12:49:04 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47eb8ddf-590f-4ffa-87c8-377cf1ee0f67/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:49:04 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47eb8ddf-590f-4ffa-87c8-377cf1ee0f67/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:49:04 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47eb8ddf-590f-4ffa-87c8-377cf1ee0f67/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:49:04 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47eb8ddf-590f-4ffa-87c8-377cf1ee0f67/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:49:05 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:49:05 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:49:05 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Hypervisor/Node resource view: name=user free_ram=8883MB free_disk=24.99472427368164GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74960) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 12:49:05 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:49:05 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:49:05 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:49:05 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74960) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 12:49:05 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74960) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 12:49:05 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:49:05 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:49:05 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Compute_service record updated for user:user {{(pid=74960) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 12:49:05 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.229s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:49:06 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:49:07 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:49:07 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:49:09 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:49:09 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:49:10 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:49:10 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Starting heal instance info cache {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 12:49:10 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Rebuilding the list of instances to heal {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 03 12:49:10 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "refresh_cache-47eb8ddf-590f-4ffa-87c8-377cf1ee0f67" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:49:10 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquired lock "refresh_cache-47eb8ddf-590f-4ffa-87c8-377cf1ee0f67" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:49:10 user nova-compute[74960]: DEBUG nova.network.neutron [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67] Forcefully refreshing network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 12:49:10 user nova-compute[74960]: DEBUG nova.objects.instance [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lazy-loading 'info_cache' on Instance uuid 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:49:10 user nova-compute[74960]: DEBUG nova.network.neutron [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67] Updating instance_info_cache with network_info: [{"id": "844c85e9-5021-433d-9f93-530ec193e265", "address": "fa:16:3e:69:d8:32", "network": {"id": "9a9a848a-80be-4281-8554-8e28744073b3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1579909169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "434ce6c4b77342299a17e547a14e3918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap844c85e9-50", "ovs_interfaceid": "844c85e9-5021-433d-9f93-530ec193e265", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:49:10 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Releasing lock "refresh_cache-47eb8ddf-590f-4ffa-87c8-377cf1ee0f67" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:49:10 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67] Updated the network info_cache for instance {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 12:49:10 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:49:12 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:49:13 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:49:13 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74960) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 12:49:15 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:49:17 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:49:18 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:49:20 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:49:22 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:49:25 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:49:27 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:49:28 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:49:28 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:49:32 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:49:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:49:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:49:35 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:49:37 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-3c2203ee-aad5-480d-8b49-a3996f8a022e tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Acquiring lock "47eb8ddf-590f-4ffa-87c8-377cf1ee0f67" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:49:37 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-3c2203ee-aad5-480d-8b49-a3996f8a022e tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Lock "47eb8ddf-590f-4ffa-87c8-377cf1ee0f67" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:49:37 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-3c2203ee-aad5-480d-8b49-a3996f8a022e tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Acquiring lock "47eb8ddf-590f-4ffa-87c8-377cf1ee0f67-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:49:37 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-3c2203ee-aad5-480d-8b49-a3996f8a022e tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Lock "47eb8ddf-590f-4ffa-87c8-377cf1ee0f67-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.005s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:49:37 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-3c2203ee-aad5-480d-8b49-a3996f8a022e tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Lock "47eb8ddf-590f-4ffa-87c8-377cf1ee0f67-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.003s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:49:37 user nova-compute[74960]: INFO nova.compute.manager [None req-3c2203ee-aad5-480d-8b49-a3996f8a022e tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67] Terminating instance
Nov 03 12:49:37 user nova-compute[74960]: DEBUG nova.compute.manager [None req-3c2203ee-aad5-480d-8b49-a3996f8a022e tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67] Start destroying the instance on the hypervisor. {{(pid=74960) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 12:49:37 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:49:37 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:49:37 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:49:37 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:49:37 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:49:37 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:49:38 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67] Instance destroyed successfully.
Nov 03 12:49:38 user nova-compute[74960]: DEBUG nova.objects.instance [None req-3c2203ee-aad5-480d-8b49-a3996f8a022e tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Lazy-loading 'resources' on Instance uuid 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:49:38 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-3c2203ee-aad5-480d-8b49-a3996f8a022e tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:32:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-12909418',display_name='tempest-ServerRescueNegativeTestJSON-server-12909418',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-12909418',id=31,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-03T12:37:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='434ce6c4b77342299a17e547a14e3918',ramdisk_id='',reservation_id='r-wi42y0oc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1678469488',owner_user_name='tempest-ServerRescueNegativeTestJSON-1678469488-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T12:38:53Z,user_data=None,user_id='82a995b6307c4ba0b4cf8d5ede286a6c',uuid=47eb8ddf-590f-4ffa-87c8-377cf1ee0f67,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "844c85e9-5021-433d-9f93-530ec193e265", "address": "fa:16:3e:69:d8:32", "network": {"id": "9a9a848a-80be-4281-8554-8e28744073b3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1579909169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "434ce6c4b77342299a17e547a14e3918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap844c85e9-50", "ovs_interfaceid": "844c85e9-5021-433d-9f93-530ec193e265", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 12:49:38 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-3c2203ee-aad5-480d-8b49-a3996f8a022e tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Converting VIF {"id": "844c85e9-5021-433d-9f93-530ec193e265", "address": "fa:16:3e:69:d8:32", "network": {"id": "9a9a848a-80be-4281-8554-8e28744073b3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1579909169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "434ce6c4b77342299a17e547a14e3918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap844c85e9-50", "ovs_interfaceid": "844c85e9-5021-433d-9f93-530ec193e265", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:49:38 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-3c2203ee-aad5-480d-8b49-a3996f8a022e tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:69:d8:32,bridge_name='br-int',has_traffic_filtering=True,id=844c85e9-5021-433d-9f93-530ec193e265,network=Network(9a9a848a-80be-4281-8554-8e28744073b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap844c85e9-50') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:49:38 user nova-compute[74960]: DEBUG os_vif [None req-3c2203ee-aad5-480d-8b49-a3996f8a022e tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:69:d8:32,bridge_name='br-int',has_traffic_filtering=True,id=844c85e9-5021-433d-9f93-530ec193e265,network=Network(9a9a848a-80be-4281-8554-8e28744073b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap844c85e9-50') {{(pid=74960) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 12:49:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:49:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap844c85e9-50, bridge=br-int, if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:49:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:49:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:49:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:49:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d53c2036-cfa6-4ff8-92b8-28086128e470) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:49:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:49:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:49:38 user nova-compute[74960]: INFO os_vif [None req-3c2203ee-aad5-480d-8b49-a3996f8a022e tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:69:d8:32,bridge_name='br-int',has_traffic_filtering=True,id=844c85e9-5021-433d-9f93-530ec193e265,network=Network(9a9a848a-80be-4281-8554-8e28744073b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap844c85e9-50')
Nov 03 12:49:38 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-3c2203ee-aad5-480d-8b49-a3996f8a022e tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67] Deleting instance files /opt/stack/data/nova/instances/47eb8ddf-590f-4ffa-87c8-377cf1ee0f67_del
Nov 03 12:49:38 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-3c2203ee-aad5-480d-8b49-a3996f8a022e tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67] Deletion of /opt/stack/data/nova/instances/47eb8ddf-590f-4ffa-87c8-377cf1ee0f67_del complete
Nov 03 12:49:38 user nova-compute[74960]: INFO nova.compute.manager [None req-3c2203ee-aad5-480d-8b49-a3996f8a022e tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] [instance: 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 03 12:49:38 user nova-compute[74960]: DEBUG oslo.service.loopingcall [None req-3c2203ee-aad5-480d-8b49-a3996f8a022e tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74960) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 12:49:38 user nova-compute[74960]: DEBUG nova.compute.manager [-] [instance: 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67] Deallocating network for instance {{(pid=74960) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 12:49:38 user nova-compute[74960]: DEBUG nova.network.neutron [-] [instance: 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67] deallocate_for_instance() {{(pid=74960) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 12:49:38 user nova-compute[74960]: DEBUG nova.network.neutron [-] [instance: 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67] Updating instance_info_cache with network_info: [] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:49:38 user nova-compute[74960]: INFO nova.compute.manager [-] [instance: 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67] Took 0.53 seconds to deallocate network for instance.
Nov 03 12:49:38 user nova-compute[74960]: DEBUG nova.compute.manager [req-58f9a13e-316c-49de-95a3-c70c857a9aca req-98dd45dd-ba62-4360-bf88-4f9e6de153c5 service nova] [instance: 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67] Received event network-vif-deleted-844c85e9-5021-433d-9f93-530ec193e265 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:49:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:49:39 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-3c2203ee-aad5-480d-8b49-a3996f8a022e tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:49:39 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-3c2203ee-aad5-480d-8b49-a3996f8a022e tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:49:39 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-3c2203ee-aad5-480d-8b49-a3996f8a022e tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:49:39 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-3c2203ee-aad5-480d-8b49-a3996f8a022e tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:49:39 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-3c2203ee-aad5-480d-8b49-a3996f8a022e tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.135s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:49:39 user nova-compute[74960]: INFO nova.scheduler.client.report [None req-3c2203ee-aad5-480d-8b49-a3996f8a022e tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Deleted allocations for instance 47eb8ddf-590f-4ffa-87c8-377cf1ee0f67
Nov 03 12:49:39 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-3c2203ee-aad5-480d-8b49-a3996f8a022e tempest-ServerRescueNegativeTestJSON-1678469488 tempest-ServerRescueNegativeTestJSON-1678469488-project-member] Lock "47eb8ddf-590f-4ffa-87c8-377cf1ee0f67" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.806s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:49:43 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:49:43 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:49:48 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:49:48 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:49:53 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:49:58 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:49:58 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:50:01 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:50:03 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:50:05 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:50:06 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:50:06 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:50:06 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:50:06 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:50:06 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Auditing locally available compute resources for user (node: user) {{(pid=74960) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 12:50:06 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:50:06 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:50:06 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Hypervisor/Node resource view: name=user free_ram=9030MB free_disk=25.01070785522461GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74960) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 12:50:06 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:50:06 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:50:06 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74960) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 12:50:06 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74960) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 12:50:06 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:50:06 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:50:06 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Compute_service record updated for user:user {{(pid=74960) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 12:50:06 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.140s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:50:08 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:50:08 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:50:08 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:50:10 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:50:11 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:50:11 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Starting heal instance info cache {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 12:50:11 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Rebuilding the list of instances to heal {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 03 12:50:11 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Didn't find any instances for network info cache update. {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 03 12:50:11 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:50:11 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:50:13 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:50:13 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:50:13 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74960) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 12:50:17 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:50:18 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:50:22 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Acquiring lock "fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:50:22 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lock "fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:50:22 user nova-compute[74960]: DEBUG nova.compute.manager [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16] Starting instance... {{(pid=74960) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 12:50:22 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:50:22 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:50:22 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74960) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 12:50:22 user nova-compute[74960]: INFO nova.compute.claims [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16] Claim successful on node user
Nov 03 12:50:22 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:50:22 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:50:22 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.219s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:50:22 user nova-compute[74960]: DEBUG nova.compute.manager [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16] Start building networks asynchronously for instance. {{(pid=74960) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 12:50:22 user nova-compute[74960]: DEBUG nova.compute.manager [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16] Allocating IP information in the background. {{(pid=74960) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 12:50:22 user nova-compute[74960]: DEBUG nova.network.neutron [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16] allocate_for_instance() {{(pid=74960) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 12:50:22 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 12:50:22 user nova-compute[74960]: DEBUG nova.compute.manager [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16] Start building block device mappings for instance. {{(pid=74960) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 12:50:23 user nova-compute[74960]: DEBUG nova.policy [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '067a3f33438b4112b818b91ecb4dd0d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd64f3d9dae8f45bcb2e0677a0076ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74960) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 12:50:23 user nova-compute[74960]: INFO nova.virt.block_device [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16] Booting with volume snapshot 0ebe8e7d-eae2-41c7-87ae-28533b9c4011 at /dev/vda
Nov 03 12:50:23 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:50:23 user nova-compute[74960]: DEBUG nova.network.neutron [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16] Successfully created port: 6866b484-fc17-4720-b6c3-ee8e6faa1c81 {{(pid=74960) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 12:50:24 user nova-compute[74960]: DEBUG nova.network.neutron [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16] Successfully updated port: 6866b484-fc17-4720-b6c3-ee8e6faa1c81 {{(pid=74960) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 12:50:24 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Acquiring lock "refresh_cache-fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:50:24 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Acquired lock "refresh_cache-fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:50:24 user nova-compute[74960]: DEBUG nova.network.neutron [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16] Building network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 12:50:24 user nova-compute[74960]: DEBUG nova.compute.manager [req-ef84dbd3-d82f-4835-b3c2-1bec51e6de0a req-6f589106-dee7-4066-8b72-6edd0d2887aa service nova] [instance: fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16] Received event network-changed-6866b484-fc17-4720-b6c3-ee8e6faa1c81 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:50:24 user nova-compute[74960]: DEBUG nova.compute.manager [req-ef84dbd3-d82f-4835-b3c2-1bec51e6de0a req-6f589106-dee7-4066-8b72-6edd0d2887aa service nova] [instance: fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16] Refreshing instance network info cache due to event network-changed-6866b484-fc17-4720-b6c3-ee8e6faa1c81. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 12:50:24 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-ef84dbd3-d82f-4835-b3c2-1bec51e6de0a req-6f589106-dee7-4066-8b72-6edd0d2887aa service nova] Acquiring lock "refresh_cache-fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:50:24 user nova-compute[74960]: DEBUG nova.network.neutron [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16] Instance cache missing network info. {{(pid=74960) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 12:50:24 user nova-compute[74960]: DEBUG nova.network.neutron [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16] Updating instance_info_cache with network_info: [{"id": "6866b484-fc17-4720-b6c3-ee8e6faa1c81", "address": "fa:16:3e:f5:ce:e0", "network": {"id": "8e985ab3-9852-4f07-8b5c-19f7bf113939", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781795302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d64f3d9dae8f45bcb2e0677a0076ed64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6866b484-fc", "ovs_interfaceid": "6866b484-fc17-4720-b6c3-ee8e6faa1c81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:50:24 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Releasing lock "refresh_cache-fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:50:24 user nova-compute[74960]: DEBUG nova.compute.manager [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16] Instance network_info: |[{"id": "6866b484-fc17-4720-b6c3-ee8e6faa1c81", "address": "fa:16:3e:f5:ce:e0", "network": {"id": "8e985ab3-9852-4f07-8b5c-19f7bf113939", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781795302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d64f3d9dae8f45bcb2e0677a0076ed64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6866b484-fc", "ovs_interfaceid": "6866b484-fc17-4720-b6c3-ee8e6faa1c81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74960) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 12:50:24 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-ef84dbd3-d82f-4835-b3c2-1bec51e6de0a req-6f589106-dee7-4066-8b72-6edd0d2887aa service nova] Acquired lock "refresh_cache-fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:50:24 user nova-compute[74960]: DEBUG nova.network.neutron [req-ef84dbd3-d82f-4835-b3c2-1bec51e6de0a req-6f589106-dee7-4066-8b72-6edd0d2887aa service nova] [instance: fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16] Refreshing network info cache for port 6866b484-fc17-4720-b6c3-ee8e6faa1c81 {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 12:50:25 user nova-compute[74960]: DEBUG nova.network.neutron [req-ef84dbd3-d82f-4835-b3c2-1bec51e6de0a req-6f589106-dee7-4066-8b72-6edd0d2887aa service nova] [instance: fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16] Updated VIF entry in instance network info cache for port 6866b484-fc17-4720-b6c3-ee8e6faa1c81. {{(pid=74960) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 12:50:25 user nova-compute[74960]: DEBUG nova.network.neutron [req-ef84dbd3-d82f-4835-b3c2-1bec51e6de0a req-6f589106-dee7-4066-8b72-6edd0d2887aa service nova] [instance: fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16] Updating instance_info_cache with network_info: [{"id": "6866b484-fc17-4720-b6c3-ee8e6faa1c81", "address": "fa:16:3e:f5:ce:e0", "network": {"id": "8e985ab3-9852-4f07-8b5c-19f7bf113939", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781795302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d64f3d9dae8f45bcb2e0677a0076ed64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6866b484-fc", "ovs_interfaceid": "6866b484-fc17-4720-b6c3-ee8e6faa1c81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:50:25 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-ef84dbd3-d82f-4835-b3c2-1bec51e6de0a req-6f589106-dee7-4066-8b72-6edd0d2887aa service nova] Releasing lock "refresh_cache-fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:50:28 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:50:28 user nova-compute[74960]: DEBUG os_brick.utils [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:50:28 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:50:28 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:50:28 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a7ebcef-5482-4c49-919b-923e6fb22bda]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:75b8e219756\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:50:28 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:50:28 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:50:28 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[74cb6d3b-6ab4-45d6-bd1d-32e839cc1b6c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:50:28 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:50:28 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:50:28 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[1099695e-ea21-442e-8761-0a09c7781953]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:50:28 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[db195a77-252b-451d-9d89-6a8d2ce39457]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:50:28 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Running cmd (subprocess): nvme version {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:50:28 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] 'nvme version' failed. Not Retrying. {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 12:50:28 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.nvmeof [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] nvme not present on system {{(pid=74960) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 12:50:28 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:50:28 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 12:50:28 user nova-compute[74960]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 12:50:28 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[50fb67dc-bb3b-4644-acff-7fc35d1d7a98]: (4, '') {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:50:28 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74960) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 12:50:28 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74960) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 12:50:28 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] LIGHTOS: no hostnqn found. {{(pid=74960) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 12:50:28 user nova-compute[74960]: DEBUG os_brick.utils [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:75b8e219756', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:50:28 user nova-compute[74960]: DEBUG nova.virt.block_device [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16] Updating existing volume attachment record: 5459530f-8960-46e4-8e90-b47afe67b022 {{(pid=74960) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 12:50:30 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:50:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:50:37 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:50:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:50:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:50:39 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:50:42 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-83915d5c-470e-4091-ab22-1435db931c8a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Acquiring lock "5ede59da-37c6-4162-9e79-318f1a4a8aeb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:50:42 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-83915d5c-470e-4091-ab22-1435db931c8a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Lock "5ede59da-37c6-4162-9e79-318f1a4a8aeb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:50:42 user nova-compute[74960]: DEBUG nova.compute.manager [None req-83915d5c-470e-4091-ab22-1435db931c8a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 5ede59da-37c6-4162-9e79-318f1a4a8aeb] Starting instance... {{(pid=74960) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 12:50:42 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-83915d5c-470e-4091-ab22-1435db931c8a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:50:42 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-83915d5c-470e-4091-ab22-1435db931c8a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:50:42 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-83915d5c-470e-4091-ab22-1435db931c8a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74960) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 12:50:42 user nova-compute[74960]: INFO nova.compute.claims [None req-83915d5c-470e-4091-ab22-1435db931c8a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 5ede59da-37c6-4162-9e79-318f1a4a8aeb] Claim successful on node user
Nov 03 12:50:42 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-83915d5c-470e-4091-ab22-1435db931c8a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:50:42 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-83915d5c-470e-4091-ab22-1435db931c8a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:50:42 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-83915d5c-470e-4091-ab22-1435db931c8a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.261s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:50:42 user nova-compute[74960]: DEBUG nova.compute.manager [None req-83915d5c-470e-4091-ab22-1435db931c8a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 5ede59da-37c6-4162-9e79-318f1a4a8aeb] Start building networks asynchronously for instance. {{(pid=74960) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 12:50:42 user nova-compute[74960]: DEBUG nova.compute.manager [None req-83915d5c-470e-4091-ab22-1435db931c8a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 5ede59da-37c6-4162-9e79-318f1a4a8aeb] Allocating IP information in the background. {{(pid=74960) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 12:50:42 user nova-compute[74960]: DEBUG nova.network.neutron [None req-83915d5c-470e-4091-ab22-1435db931c8a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 5ede59da-37c6-4162-9e79-318f1a4a8aeb] allocate_for_instance() {{(pid=74960) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 12:50:42 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-83915d5c-470e-4091-ab22-1435db931c8a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 5ede59da-37c6-4162-9e79-318f1a4a8aeb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 12:50:42 user nova-compute[74960]: DEBUG nova.compute.manager [None req-83915d5c-470e-4091-ab22-1435db931c8a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 5ede59da-37c6-4162-9e79-318f1a4a8aeb] Start building block device mappings for instance. {{(pid=74960) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 12:50:42 user nova-compute[74960]: DEBUG nova.policy [None req-83915d5c-470e-4091-ab22-1435db931c8a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c934e7c00ddd450087f904666473c0b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '255349fa349045ad8a554d3f818cdd2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74960) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 12:50:42 user nova-compute[74960]: DEBUG nova.compute.manager [None req-83915d5c-470e-4091-ab22-1435db931c8a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 5ede59da-37c6-4162-9e79-318f1a4a8aeb] Start spawning the instance on the hypervisor. {{(pid=74960) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 12:50:42 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-83915d5c-470e-4091-ab22-1435db931c8a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 5ede59da-37c6-4162-9e79-318f1a4a8aeb] Creating instance directory {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 12:50:42 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-83915d5c-470e-4091-ab22-1435db931c8a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 5ede59da-37c6-4162-9e79-318f1a4a8aeb] Creating image(s)
Nov 03 12:50:42 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-83915d5c-470e-4091-ab22-1435db931c8a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Acquiring lock "/opt/stack/data/nova/instances/5ede59da-37c6-4162-9e79-318f1a4a8aeb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:50:42 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-83915d5c-470e-4091-ab22-1435db931c8a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Lock "/opt/stack/data/nova/instances/5ede59da-37c6-4162-9e79-318f1a4a8aeb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:50:42 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-83915d5c-470e-4091-ab22-1435db931c8a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Lock "/opt/stack/data/nova/instances/5ede59da-37c6-4162-9e79-318f1a4a8aeb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:50:42 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-83915d5c-470e-4091-ab22-1435db931c8a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:50:43 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-83915d5c-470e-4091-ab22-1435db931c8a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.170s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:50:43 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-83915d5c-470e-4091-ab22-1435db931c8a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Acquiring lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:50:43 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-83915d5c-470e-4091-ab22-1435db931c8a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:50:43 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-83915d5c-470e-4091-ab22-1435db931c8a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:50:43 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-83915d5c-470e-4091-ab22-1435db931c8a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.173s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:50:43 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-83915d5c-470e-4091-ab22-1435db931c8a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910,backing_fmt=raw /opt/stack/data/nova/instances/5ede59da-37c6-4162-9e79-318f1a4a8aeb/disk 1073741824 {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:50:43 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:50:43 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-83915d5c-470e-4091-ab22-1435db931c8a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910,backing_fmt=raw /opt/stack/data/nova/instances/5ede59da-37c6-4162-9e79-318f1a4a8aeb/disk 1073741824" returned: 0 in 0.068s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:50:43 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-83915d5c-470e-4091-ab22-1435db931c8a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:50:43 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-83915d5c-470e-4091-ab22-1435db931c8a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:50:43 user nova-compute[74960]: DEBUG nova.network.neutron [None req-83915d5c-470e-4091-ab22-1435db931c8a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 5ede59da-37c6-4162-9e79-318f1a4a8aeb] Successfully created port: 9f629e06-9020-4e4b-956e-d33d9417c2a6 {{(pid=74960) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 12:50:43 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-83915d5c-470e-4091-ab22-1435db931c8a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.181s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:50:43 user nova-compute[74960]: DEBUG nova.virt.disk.api [None req-83915d5c-470e-4091-ab22-1435db931c8a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5ede59da-37c6-4162-9e79-318f1a4a8aeb/disk. size=1073741824 {{(pid=74960) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 12:50:43 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-83915d5c-470e-4091-ab22-1435db931c8a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ede59da-37c6-4162-9e79-318f1a4a8aeb/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:50:43 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-83915d5c-470e-4091-ab22-1435db931c8a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ede59da-37c6-4162-9e79-318f1a4a8aeb/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:50:43 user nova-compute[74960]: DEBUG nova.virt.disk.api [None req-83915d5c-470e-4091-ab22-1435db931c8a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Cannot resize image /opt/stack/data/nova/instances/5ede59da-37c6-4162-9e79-318f1a4a8aeb/disk to a smaller size. {{(pid=74960) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 12:50:43 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-83915d5c-470e-4091-ab22-1435db931c8a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 5ede59da-37c6-4162-9e79-318f1a4a8aeb] Created local disks {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 12:50:43 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-83915d5c-470e-4091-ab22-1435db931c8a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 5ede59da-37c6-4162-9e79-318f1a4a8aeb] Ensure instance console log exists: /opt/stack/data/nova/instances/5ede59da-37c6-4162-9e79-318f1a4a8aeb/console.log {{(pid=74960) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 12:50:43 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-83915d5c-470e-4091-ab22-1435db931c8a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:50:43 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-83915d5c-470e-4091-ab22-1435db931c8a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:50:43 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-83915d5c-470e-4091-ab22-1435db931c8a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:50:43 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:50:44 user nova-compute[74960]: DEBUG nova.network.neutron [None req-83915d5c-470e-4091-ab22-1435db931c8a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 5ede59da-37c6-4162-9e79-318f1a4a8aeb] Successfully updated port: 9f629e06-9020-4e4b-956e-d33d9417c2a6 {{(pid=74960) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 12:50:44 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-83915d5c-470e-4091-ab22-1435db931c8a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Acquiring lock "refresh_cache-5ede59da-37c6-4162-9e79-318f1a4a8aeb" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:50:44 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-83915d5c-470e-4091-ab22-1435db931c8a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Acquired lock "refresh_cache-5ede59da-37c6-4162-9e79-318f1a4a8aeb" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:50:44 user nova-compute[74960]: DEBUG nova.network.neutron [None req-83915d5c-470e-4091-ab22-1435db931c8a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 5ede59da-37c6-4162-9e79-318f1a4a8aeb] Building network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 12:50:44 user nova-compute[74960]: DEBUG nova.compute.manager [req-72cac1c6-5269-4498-9cba-5446e4d1aa24 req-83484029-e45b-41c7-9120-73c244716bf6 service nova] [instance: 5ede59da-37c6-4162-9e79-318f1a4a8aeb] Received event network-changed-9f629e06-9020-4e4b-956e-d33d9417c2a6 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:50:44 user nova-compute[74960]: DEBUG nova.compute.manager [req-72cac1c6-5269-4498-9cba-5446e4d1aa24 req-83484029-e45b-41c7-9120-73c244716bf6 service nova] [instance: 5ede59da-37c6-4162-9e79-318f1a4a8aeb] Refreshing instance network info cache due to event network-changed-9f629e06-9020-4e4b-956e-d33d9417c2a6. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 12:50:44 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-72cac1c6-5269-4498-9cba-5446e4d1aa24 req-83484029-e45b-41c7-9120-73c244716bf6 service nova] Acquiring lock "refresh_cache-5ede59da-37c6-4162-9e79-318f1a4a8aeb" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:50:44 user nova-compute[74960]: DEBUG nova.network.neutron [None req-83915d5c-470e-4091-ab22-1435db931c8a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 5ede59da-37c6-4162-9e79-318f1a4a8aeb] Instance cache missing network info. {{(pid=74960) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 12:50:44 user nova-compute[74960]: DEBUG nova.network.neutron [None req-83915d5c-470e-4091-ab22-1435db931c8a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 5ede59da-37c6-4162-9e79-318f1a4a8aeb] Updating instance_info_cache with network_info: [{"id": "9f629e06-9020-4e4b-956e-d33d9417c2a6", "address": "fa:16:3e:1e:78:99", "network": {"id": "c50fc382-c1b9-49d8-8e38-ac681cbbcffd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1465428328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "255349fa349045ad8a554d3f818cdd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f629e06-90", "ovs_interfaceid": "9f629e06-9020-4e4b-956e-d33d9417c2a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:50:44 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-83915d5c-470e-4091-ab22-1435db931c8a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Releasing lock "refresh_cache-5ede59da-37c6-4162-9e79-318f1a4a8aeb" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:50:44 user nova-compute[74960]: DEBUG nova.compute.manager [None req-83915d5c-470e-4091-ab22-1435db931c8a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 5ede59da-37c6-4162-9e79-318f1a4a8aeb] Instance network_info: |[{"id": "9f629e06-9020-4e4b-956e-d33d9417c2a6", "address": "fa:16:3e:1e:78:99", "network": {"id": "c50fc382-c1b9-49d8-8e38-ac681cbbcffd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1465428328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "255349fa349045ad8a554d3f818cdd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f629e06-90", "ovs_interfaceid": "9f629e06-9020-4e4b-956e-d33d9417c2a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74960) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 12:50:44 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-72cac1c6-5269-4498-9cba-5446e4d1aa24 req-83484029-e45b-41c7-9120-73c244716bf6 service nova] Acquired lock "refresh_cache-5ede59da-37c6-4162-9e79-318f1a4a8aeb" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:50:44 user nova-compute[74960]: DEBUG nova.network.neutron [req-72cac1c6-5269-4498-9cba-5446e4d1aa24 req-83484029-e45b-41c7-9120-73c244716bf6 service nova] [instance: 5ede59da-37c6-4162-9e79-318f1a4a8aeb] Refreshing network info cache for port 9f629e06-9020-4e4b-956e-d33d9417c2a6 {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 12:50:44 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-83915d5c-470e-4091-ab22-1435db931c8a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 5ede59da-37c6-4162-9e79-318f1a4a8aeb] Start _get_guest_xml network_info=[{"id": "9f629e06-9020-4e4b-956e-d33d9417c2a6", "address": "fa:16:3e:1e:78:99", "network": {"id": "c50fc382-c1b9-49d8-8e38-ac681cbbcffd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1465428328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "255349fa349045ad8a554d3f818cdd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f629e06-90", "ovs_interfaceid": "9f629e06-9020-4e4b-956e-d33d9417c2a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=549f51ba-ac69-494b-8de1-34635aa2d7cf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='63ee9c80c632442fb0379f47b784bd20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T12:13:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'image_id': '549f51ba-ac69-494b-8de1-34635aa2d7cf'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 12:50:44 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-83915d5c-470e-4091-ab22-1435db931c8a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:50:44 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-83915d5c-470e-4091-ab22-1435db931c8a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:50:44 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-83915d5c-470e-4091-ab22-1435db931c8a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 12:50:44 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-83915d5c-470e-4091-ab22-1435db931c8a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] CPU controller missing on host. {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 12:50:44 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-83915d5c-470e-4091-ab22-1435db931c8a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 12:50:44 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-83915d5c-470e-4091-ab22-1435db931c8a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] CPU controller found on host. {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 12:50:44 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-83915d5c-470e-4091-ab22-1435db931c8a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74960) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 12:50:44 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-83915d5c-470e-4091-ab22-1435db931c8a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=549f51ba-ac69-494b-8de1-34635aa2d7cf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='63ee9c80c632442fb0379f47b784bd20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T12:13:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 12:50:44 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-83915d5c-470e-4091-ab22-1435db931c8a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Flavor limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 12:50:44 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-83915d5c-470e-4091-ab22-1435db931c8a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Image limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 12:50:44 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-83915d5c-470e-4091-ab22-1435db931c8a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Flavor pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 12:50:44 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-83915d5c-470e-4091-ab22-1435db931c8a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Image pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 12:50:44 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-83915d5c-470e-4091-ab22-1435db931c8a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 12:50:44 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-83915d5c-470e-4091-ab22-1435db931c8a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 12:50:44 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-83915d5c-470e-4091-ab22-1435db931c8a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 12:50:44 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-83915d5c-470e-4091-ab22-1435db931c8a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Got 1 possible topologies {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 12:50:44 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-83915d5c-470e-4091-ab22-1435db931c8a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 12:50:44 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-83915d5c-470e-4091-ab22-1435db931c8a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 12:50:44 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-83915d5c-470e-4091-ab22-1435db931c8a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:50:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-338784767',display_name='tempest-AttachVolumeNegativeTest-server-338784767',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-338784767',id=44,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNEcwNAKbZkDes6JIMlXxZkZb8VbR+5R10kuvGfO590jhfPZvkrV/gXJ2MebZDVJUIVwDNQ4vCWRJFk6YU30MSzdOcwFB7LjyA3TyaHVmV588YCWuGCaS4LcPH+zFqUDXg==',key_name='tempest-keypair-674514535',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='255349fa349045ad8a554d3f818cdd2e',ramdisk_id='',reservation_id='r-9pz7ay4e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-787890049',owner_user_name='tempest-AttachVolumeNegativeTest-787890049-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:50:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c934e7c00ddd450087f904666473c0b4',uuid=5ede59da-37c6-4162-9e79-318f1a4a8aeb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9f629e06-9020-4e4b-956e-d33d9417c2a6", "address": "fa:16:3e:1e:78:99", "network": {"id": "c50fc382-c1b9-49d8-8e38-ac681cbbcffd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1465428328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "255349fa349045ad8a554d3f818cdd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f629e06-90", "ovs_interfaceid": "9f629e06-9020-4e4b-956e-d33d9417c2a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74960) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 12:50:44 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-83915d5c-470e-4091-ab22-1435db931c8a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Converting VIF {"id": "9f629e06-9020-4e4b-956e-d33d9417c2a6", "address": "fa:16:3e:1e:78:99", "network": {"id": "c50fc382-c1b9-49d8-8e38-ac681cbbcffd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1465428328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "255349fa349045ad8a554d3f818cdd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f629e06-90", "ovs_interfaceid": "9f629e06-9020-4e4b-956e-d33d9417c2a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:50:44 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-83915d5c-470e-4091-ab22-1435db931c8a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:78:99,bridge_name='br-int',has_traffic_filtering=True,id=9f629e06-9020-4e4b-956e-d33d9417c2a6,network=Network(c50fc382-c1b9-49d8-8e38-ac681cbbcffd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f629e06-90') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:50:44 user nova-compute[74960]: DEBUG nova.objects.instance [None req-83915d5c-470e-4091-ab22-1435db931c8a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Lazy-loading 'pci_devices' on Instance uuid 5ede59da-37c6-4162-9e79-318f1a4a8aeb {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:50:44 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-83915d5c-470e-4091-ab22-1435db931c8a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 5ede59da-37c6-4162-9e79-318f1a4a8aeb] End _get_guest_xml xml=<domain type="kvm">
Nov 03 12:50:44 user nova-compute[74960]:   <uuid>5ede59da-37c6-4162-9e79-318f1a4a8aeb</uuid>
Nov 03 12:50:44 user nova-compute[74960]:   <name>instance-0000002c</name>
Nov 03 12:50:44 user nova-compute[74960]:   <memory>524288</memory>
Nov 03 12:50:44 user nova-compute[74960]:   <vcpu>1</vcpu>
Nov 03 12:50:44 user nova-compute[74960]:   <metadata>
Nov 03 12:50:44 user nova-compute[74960]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 12:50:44 user nova-compute[74960]:       <nova:package version="0.0.0"/>
Nov 03 12:50:44 user nova-compute[74960]:       <nova:name>tempest-AttachVolumeNegativeTest-server-338784767</nova:name>
Nov 03 12:50:44 user nova-compute[74960]:       <nova:creationTime>2023-11-03 12:50:44</nova:creationTime>
Nov 03 12:50:44 user nova-compute[74960]:       <nova:flavor name="m1.tiny">
Nov 03 12:50:44 user nova-compute[74960]:         <nova:memory>512</nova:memory>
Nov 03 12:50:44 user nova-compute[74960]:         <nova:disk>1</nova:disk>
Nov 03 12:50:44 user nova-compute[74960]:         <nova:swap>0</nova:swap>
Nov 03 12:50:44 user nova-compute[74960]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 12:50:44 user nova-compute[74960]:         <nova:vcpus>1</nova:vcpus>
Nov 03 12:50:44 user nova-compute[74960]:       </nova:flavor>
Nov 03 12:50:44 user nova-compute[74960]:       <nova:owner>
Nov 03 12:50:44 user nova-compute[74960]:         <nova:user uuid="c934e7c00ddd450087f904666473c0b4">tempest-AttachVolumeNegativeTest-787890049-project-member</nova:user>
Nov 03 12:50:44 user nova-compute[74960]:         <nova:project uuid="255349fa349045ad8a554d3f818cdd2e">tempest-AttachVolumeNegativeTest-787890049</nova:project>
Nov 03 12:50:44 user nova-compute[74960]:       </nova:owner>
Nov 03 12:50:44 user nova-compute[74960]:       <nova:root type="image" uuid="549f51ba-ac69-494b-8de1-34635aa2d7cf"/>
Nov 03 12:50:44 user nova-compute[74960]:       <nova:ports>
Nov 03 12:50:44 user nova-compute[74960]:         <nova:port uuid="9f629e06-9020-4e4b-956e-d33d9417c2a6">
Nov 03 12:50:44 user nova-compute[74960]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 03 12:50:44 user nova-compute[74960]:         </nova:port>
Nov 03 12:50:44 user nova-compute[74960]:       </nova:ports>
Nov 03 12:50:44 user nova-compute[74960]:     </nova:instance>
Nov 03 12:50:44 user nova-compute[74960]:   </metadata>
Nov 03 12:50:44 user nova-compute[74960]:   <sysinfo type="smbios">
Nov 03 12:50:44 user nova-compute[74960]:     <system>
Nov 03 12:50:44 user nova-compute[74960]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 12:50:44 user nova-compute[74960]:       <entry name="product">OpenStack Nova</entry>
Nov 03 12:50:44 user nova-compute[74960]:       <entry name="version">0.0.0</entry>
Nov 03 12:50:44 user nova-compute[74960]:       <entry name="serial">5ede59da-37c6-4162-9e79-318f1a4a8aeb</entry>
Nov 03 12:50:44 user nova-compute[74960]:       <entry name="uuid">5ede59da-37c6-4162-9e79-318f1a4a8aeb</entry>
Nov 03 12:50:44 user nova-compute[74960]:       <entry name="family">Virtual Machine</entry>
Nov 03 12:50:44 user nova-compute[74960]:     </system>
Nov 03 12:50:44 user nova-compute[74960]:   </sysinfo>
Nov 03 12:50:44 user nova-compute[74960]:   <os>
Nov 03 12:50:44 user nova-compute[74960]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 12:50:44 user nova-compute[74960]:     <boot dev="hd"/>
Nov 03 12:50:44 user nova-compute[74960]:     <smbios mode="sysinfo"/>
Nov 03 12:50:44 user nova-compute[74960]:   </os>
Nov 03 12:50:44 user nova-compute[74960]:   <features>
Nov 03 12:50:44 user nova-compute[74960]:     <acpi/>
Nov 03 12:50:44 user nova-compute[74960]:     <apic/>
Nov 03 12:50:44 user nova-compute[74960]:     <vmcoreinfo/>
Nov 03 12:50:44 user nova-compute[74960]:   </features>
Nov 03 12:50:44 user nova-compute[74960]:   <clock offset="utc">
Nov 03 12:50:44 user nova-compute[74960]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 12:50:44 user nova-compute[74960]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 12:50:44 user nova-compute[74960]:     <timer name="hpet" present="no"/>
Nov 03 12:50:44 user nova-compute[74960]:   </clock>
Nov 03 12:50:44 user nova-compute[74960]:   <cpu mode="custom" match="exact">
Nov 03 12:50:44 user nova-compute[74960]:     <model>Nehalem</model>
Nov 03 12:50:44 user nova-compute[74960]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 12:50:44 user nova-compute[74960]:   </cpu>
Nov 03 12:50:44 user nova-compute[74960]:   <devices>
Nov 03 12:50:44 user nova-compute[74960]:     <disk type="file" device="disk">
Nov 03 12:50:44 user nova-compute[74960]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 12:50:44 user nova-compute[74960]:       <source file="/opt/stack/data/nova/instances/5ede59da-37c6-4162-9e79-318f1a4a8aeb/disk"/>
Nov 03 12:50:44 user nova-compute[74960]:       <target dev="vda" bus="virtio"/>
Nov 03 12:50:44 user nova-compute[74960]:     </disk>
Nov 03 12:50:44 user nova-compute[74960]:     <interface type="ethernet">
Nov 03 12:50:44 user nova-compute[74960]:       <mac address="fa:16:3e:1e:78:99"/>
Nov 03 12:50:44 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:50:44 user nova-compute[74960]:       <mtu size="1442"/>
Nov 03 12:50:44 user nova-compute[74960]:       <target dev="tap9f629e06-90"/>
Nov 03 12:50:44 user nova-compute[74960]:     </interface>
Nov 03 12:50:44 user nova-compute[74960]:     <serial type="pty">
Nov 03 12:50:44 user nova-compute[74960]:       <log file="/opt/stack/data/nova/instances/5ede59da-37c6-4162-9e79-318f1a4a8aeb/console.log" append="off"/>
Nov 03 12:50:44 user nova-compute[74960]:     </serial>
Nov 03 12:50:44 user nova-compute[74960]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 12:50:44 user nova-compute[74960]:     <video>
Nov 03 12:50:44 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:50:44 user nova-compute[74960]:     </video>
Nov 03 12:50:44 user nova-compute[74960]:     <rng model="virtio">
Nov 03 12:50:44 user nova-compute[74960]:       <backend model="random">/dev/urandom</backend>
Nov 03 12:50:44 user nova-compute[74960]:     </rng>
Nov 03 12:50:44 user nova-compute[74960]:     <controller type="usb" index="0" model="none"/>
Nov 03 12:50:44 user nova-compute[74960]:     <memballoon model="virtio">
Nov 03 12:50:44 user nova-compute[74960]:       <stats period="10"/>
Nov 03 12:50:44 user nova-compute[74960]:     </memballoon>
Nov 03 12:50:44 user nova-compute[74960]:   </devices>
Nov 03 12:50:44 user nova-compute[74960]: </domain>
Nov 03 12:50:44 user nova-compute[74960]:  {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 12:50:44 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-83915d5c-470e-4091-ab22-1435db931c8a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:50:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-338784767',display_name='tempest-AttachVolumeNegativeTest-server-338784767',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-338784767',id=44,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNEcwNAKbZkDes6JIMlXxZkZb8VbR+5R10kuvGfO590jhfPZvkrV/gXJ2MebZDVJUIVwDNQ4vCWRJFk6YU30MSzdOcwFB7LjyA3TyaHVmV588YCWuGCaS4LcPH+zFqUDXg==',key_name='tempest-keypair-674514535',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='255349fa349045ad8a554d3f818cdd2e',ramdisk_id='',reservation_id='r-9pz7ay4e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-787890049',owner_user_name='tempest-AttachVolumeNegativeTest-787890049-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:50:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c934e7c00ddd450087f904666473c0b4',uuid=5ede59da-37c6-4162-9e79-318f1a4a8aeb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9f629e06-9020-4e4b-956e-d33d9417c2a6", "address": "fa:16:3e:1e:78:99", "network": {"id": "c50fc382-c1b9-49d8-8e38-ac681cbbcffd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1465428328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "255349fa349045ad8a554d3f818cdd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f629e06-90", "ovs_interfaceid": "9f629e06-9020-4e4b-956e-d33d9417c2a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 12:50:44 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-83915d5c-470e-4091-ab22-1435db931c8a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Converting VIF {"id": "9f629e06-9020-4e4b-956e-d33d9417c2a6", "address": "fa:16:3e:1e:78:99", "network": {"id": "c50fc382-c1b9-49d8-8e38-ac681cbbcffd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1465428328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "255349fa349045ad8a554d3f818cdd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f629e06-90", "ovs_interfaceid": "9f629e06-9020-4e4b-956e-d33d9417c2a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:50:44 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-83915d5c-470e-4091-ab22-1435db931c8a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:78:99,bridge_name='br-int',has_traffic_filtering=True,id=9f629e06-9020-4e4b-956e-d33d9417c2a6,network=Network(c50fc382-c1b9-49d8-8e38-ac681cbbcffd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f629e06-90') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:50:44 user nova-compute[74960]: DEBUG os_vif [None req-83915d5c-470e-4091-ab22-1435db931c8a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:78:99,bridge_name='br-int',has_traffic_filtering=True,id=9f629e06-9020-4e4b-956e-d33d9417c2a6,network=Network(c50fc382-c1b9-49d8-8e38-ac681cbbcffd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f629e06-90') {{(pid=74960) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 12:50:44 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:50:44 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:50:44 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 12:50:44 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:50:44 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '98e69011-7a51-5a7f-b835-f35b9fe492ad', '_type': 'linux-noop'}}, row=False) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:50:44 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:50:44 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:50:44 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:50:44 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9f629e06-90, may_exist=True, interface_attrs={}) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:50:44 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9f629e06-90, col_values=(('qos', UUID('2e42010b-cde4-4a6f-9bb7-002cc442ca7e')),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:50:44 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9f629e06-90, col_values=(('external_ids', {'iface-id': '9f629e06-9020-4e4b-956e-d33d9417c2a6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1e:78:99', 'vm-uuid': '5ede59da-37c6-4162-9e79-318f1a4a8aeb'}),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:50:44 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:50:44 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:50:44 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:50:44 user nova-compute[74960]: INFO os_vif [None req-83915d5c-470e-4091-ab22-1435db931c8a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:78:99,bridge_name='br-int',has_traffic_filtering=True,id=9f629e06-9020-4e4b-956e-d33d9417c2a6,network=Network(c50fc382-c1b9-49d8-8e38-ac681cbbcffd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f629e06-90')
Nov 03 12:50:44 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-83915d5c-470e-4091-ab22-1435db931c8a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] No BDM found with device name vda, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:50:44 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-83915d5c-470e-4091-ab22-1435db931c8a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] No VIF found with MAC fa:16:3e:1e:78:99, not building metadata {{(pid=74960) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 12:50:44 user nova-compute[74960]: DEBUG nova.network.neutron [req-72cac1c6-5269-4498-9cba-5446e4d1aa24 req-83484029-e45b-41c7-9120-73c244716bf6 service nova] [instance: 5ede59da-37c6-4162-9e79-318f1a4a8aeb] Updated VIF entry in instance network info cache for port 9f629e06-9020-4e4b-956e-d33d9417c2a6. {{(pid=74960) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 12:50:44 user nova-compute[74960]: DEBUG nova.network.neutron [req-72cac1c6-5269-4498-9cba-5446e4d1aa24 req-83484029-e45b-41c7-9120-73c244716bf6 service nova] [instance: 5ede59da-37c6-4162-9e79-318f1a4a8aeb] Updating instance_info_cache with network_info: [{"id": "9f629e06-9020-4e4b-956e-d33d9417c2a6", "address": "fa:16:3e:1e:78:99", "network": {"id": "c50fc382-c1b9-49d8-8e38-ac681cbbcffd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1465428328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "255349fa349045ad8a554d3f818cdd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f629e06-90", "ovs_interfaceid": "9f629e06-9020-4e4b-956e-d33d9417c2a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:50:44 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-72cac1c6-5269-4498-9cba-5446e4d1aa24 req-83484029-e45b-41c7-9120-73c244716bf6 service nova] Releasing lock "refresh_cache-5ede59da-37c6-4162-9e79-318f1a4a8aeb" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:50:45 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:50:45 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:50:45 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:50:45 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:50:46 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:50:46 user nova-compute[74960]: DEBUG nova.compute.manager [req-914a34c0-f33a-4f9f-bd1f-ab1bc42556ec req-4d3c6ed6-0586-496e-8e48-57c7345c00bb service nova] [instance: 5ede59da-37c6-4162-9e79-318f1a4a8aeb] Received event network-vif-plugged-9f629e06-9020-4e4b-956e-d33d9417c2a6 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:50:46 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-914a34c0-f33a-4f9f-bd1f-ab1bc42556ec req-4d3c6ed6-0586-496e-8e48-57c7345c00bb service nova] Acquiring lock "5ede59da-37c6-4162-9e79-318f1a4a8aeb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:50:46 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-914a34c0-f33a-4f9f-bd1f-ab1bc42556ec req-4d3c6ed6-0586-496e-8e48-57c7345c00bb service nova] Lock "5ede59da-37c6-4162-9e79-318f1a4a8aeb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:50:46 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-914a34c0-f33a-4f9f-bd1f-ab1bc42556ec req-4d3c6ed6-0586-496e-8e48-57c7345c00bb service nova] Lock "5ede59da-37c6-4162-9e79-318f1a4a8aeb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:50:46 user nova-compute[74960]: DEBUG nova.compute.manager [req-914a34c0-f33a-4f9f-bd1f-ab1bc42556ec req-4d3c6ed6-0586-496e-8e48-57c7345c00bb service nova] [instance: 5ede59da-37c6-4162-9e79-318f1a4a8aeb] No waiting events found dispatching network-vif-plugged-9f629e06-9020-4e4b-956e-d33d9417c2a6 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:50:46 user nova-compute[74960]: WARNING nova.compute.manager [req-914a34c0-f33a-4f9f-bd1f-ab1bc42556ec req-4d3c6ed6-0586-496e-8e48-57c7345c00bb service nova] [instance: 5ede59da-37c6-4162-9e79-318f1a4a8aeb] Received unexpected event network-vif-plugged-9f629e06-9020-4e4b-956e-d33d9417c2a6 for instance with vm_state building and task_state spawning.
Nov 03 12:50:46 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:50:46 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:50:46 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:50:48 user nova-compute[74960]: DEBUG nova.compute.manager [req-ac976bcb-2e92-4172-b549-b12b66b904d3 req-22841b13-8f3a-4807-b62f-4dde2390fb19 service nova] [instance: 5ede59da-37c6-4162-9e79-318f1a4a8aeb] Received event network-vif-plugged-9f629e06-9020-4e4b-956e-d33d9417c2a6 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:50:48 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-ac976bcb-2e92-4172-b549-b12b66b904d3 req-22841b13-8f3a-4807-b62f-4dde2390fb19 service nova] Acquiring lock "5ede59da-37c6-4162-9e79-318f1a4a8aeb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:50:48 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-ac976bcb-2e92-4172-b549-b12b66b904d3 req-22841b13-8f3a-4807-b62f-4dde2390fb19 service nova] Lock "5ede59da-37c6-4162-9e79-318f1a4a8aeb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:50:48 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-ac976bcb-2e92-4172-b549-b12b66b904d3 req-22841b13-8f3a-4807-b62f-4dde2390fb19 service nova] Lock "5ede59da-37c6-4162-9e79-318f1a4a8aeb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:50:48 user nova-compute[74960]: DEBUG nova.compute.manager [req-ac976bcb-2e92-4172-b549-b12b66b904d3 req-22841b13-8f3a-4807-b62f-4dde2390fb19 service nova] [instance: 5ede59da-37c6-4162-9e79-318f1a4a8aeb] No waiting events found dispatching network-vif-plugged-9f629e06-9020-4e4b-956e-d33d9417c2a6 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:50:48 user nova-compute[74960]: WARNING nova.compute.manager [req-ac976bcb-2e92-4172-b549-b12b66b904d3 req-22841b13-8f3a-4807-b62f-4dde2390fb19 service nova] [instance: 5ede59da-37c6-4162-9e79-318f1a4a8aeb] Received unexpected event network-vif-plugged-9f629e06-9020-4e4b-956e-d33d9417c2a6 for instance with vm_state building and task_state spawning.
Nov 03 12:50:48 user nova-compute[74960]: DEBUG nova.compute.manager [None req-83915d5c-470e-4091-ab22-1435db931c8a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 5ede59da-37c6-4162-9e79-318f1a4a8aeb] Instance event wait completed in 0 seconds for  {{(pid=74960) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 12:50:48 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-83915d5c-470e-4091-ab22-1435db931c8a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 5ede59da-37c6-4162-9e79-318f1a4a8aeb] Guest created on hypervisor {{(pid=74960) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 12:50:48 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: 5ede59da-37c6-4162-9e79-318f1a4a8aeb] Instance spawned successfully.
Nov 03 12:50:48 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-83915d5c-470e-4091-ab22-1435db931c8a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 5ede59da-37c6-4162-9e79-318f1a4a8aeb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 12:50:48 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-83915d5c-470e-4091-ab22-1435db931c8a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 5ede59da-37c6-4162-9e79-318f1a4a8aeb] Found default for hw_cdrom_bus of ide {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:50:48 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-83915d5c-470e-4091-ab22-1435db931c8a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 5ede59da-37c6-4162-9e79-318f1a4a8aeb] Found default for hw_disk_bus of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:50:48 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-83915d5c-470e-4091-ab22-1435db931c8a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 5ede59da-37c6-4162-9e79-318f1a4a8aeb] Found default for hw_input_bus of None {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:50:48 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-83915d5c-470e-4091-ab22-1435db931c8a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 5ede59da-37c6-4162-9e79-318f1a4a8aeb] Found default for hw_pointer_model of None {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:50:48 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-83915d5c-470e-4091-ab22-1435db931c8a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 5ede59da-37c6-4162-9e79-318f1a4a8aeb] Found default for hw_video_model of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:50:48 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-83915d5c-470e-4091-ab22-1435db931c8a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 5ede59da-37c6-4162-9e79-318f1a4a8aeb] Found default for hw_vif_model of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:50:48 user nova-compute[74960]: INFO nova.compute.manager [None req-83915d5c-470e-4091-ab22-1435db931c8a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 5ede59da-37c6-4162-9e79-318f1a4a8aeb] Took 5.44 seconds to spawn the instance on the hypervisor.
Nov 03 12:50:48 user nova-compute[74960]: DEBUG nova.compute.manager [None req-83915d5c-470e-4091-ab22-1435db931c8a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 5ede59da-37c6-4162-9e79-318f1a4a8aeb] Checking state {{(pid=74960) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 12:50:48 user nova-compute[74960]: INFO nova.compute.manager [None req-83915d5c-470e-4091-ab22-1435db931c8a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 5ede59da-37c6-4162-9e79-318f1a4a8aeb] Took 6.03 seconds to build instance.
Nov 03 12:50:48 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-83915d5c-470e-4091-ab22-1435db931c8a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Lock "5ede59da-37c6-4162-9e79-318f1a4a8aeb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.142s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:50:48 user nova-compute[74960]: DEBUG nova.compute.manager [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16] Start spawning the instance on the hypervisor. {{(pid=74960) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 12:50:48 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16] Creating instance directory {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 12:50:48 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16] Creating image(s)
Nov 03 12:50:48 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16] Did not create local disks {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 03 12:50:48 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16] Ensure instance console log exists: /opt/stack/data/nova/instances/fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16/console.log {{(pid=74960) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 12:50:48 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:50:48 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:50:48 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:50:48 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16] Start _get_guest_xml network_info=[{"id": "6866b484-fc17-4720-b6c3-ee8e6faa1c81", "address": "fa:16:3e:f5:ce:e0", "network": {"id": "8e985ab3-9852-4f07-8b5c-19f7bf113939", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781795302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d64f3d9dae8f45bcb2e0677a0076ed64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6866b484-fc", "ovs_interfaceid": "6866b484-fc17-4720-b6c3-ee8e6faa1c81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:97a7f016-de98-4566-b613-a8616c269b19', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pbrKVzec', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16', 'attached_at': '', 'detached_at': '', 'volume_id': '97a7f016-de98-4566-b613-a8616c269b19', 'serial': '97a7f016-de98-4566-b613-a8616c269b19'}, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'device_type': 'disk', 'attachment_id': '5459530f-8960-46e4-8e90-b47afe67b022', 'boot_index': 0, 'guest_format': None, 'volume_type': None} {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 12:50:48 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:50:48 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:50:48 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 12:50:48 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] CPU controller missing on host. {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 12:50:48 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 12:50:48 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] CPU controller found on host. {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 12:50:48 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74960) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 12:50:48 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 12:50:48 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Flavor limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 12:50:48 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Image limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 12:50:48 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Flavor pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 12:50:48 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Image pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 12:50:48 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 12:50:48 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 12:50:48 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 12:50:48 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Got 1 possible topologies {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 12:50:48 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 12:50:48 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 12:50:48 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16] Calling os-brick to attach iSCSI Volume {{(pid=74960) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 12:50:48 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9aa420acb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:97a7f016-de98-4566-b613-a8616c269b19', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pbrKVzec', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:50:48 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:50:48 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:50:48 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:50:48 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:50:48 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:97a7f016-de98-4566-b613-a8616c269b19" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:50:48 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:97a7f016-de98-4566-b613-a8616c269b19" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:50:48 user nova-compute[74960]: INFO os_brick.initiator.connectors.iscsi [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 12:50:48 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97a7f016-de98-4566-b613-a8616c269b19 -p 172.16.0.220:3260 {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:50:48 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97a7f016-de98-4566-b613-a8616c269b19 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:50:48 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e1e044e-5f4f-4c8b-ad02-06a4333253df]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:50:48 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 12:50:48 user nova-compute[74960]:  {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:50:48 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97a7f016-de98-4566-b613-a8616c269b19 -p 172.16.0.220:3260 --interface default --op new {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:50:48 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97a7f016-de98-4566-b613-a8616c269b19 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.042s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:50:48 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[00f571ac-b6ab-4ef6-8b8d-251c3d833970]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:97a7f016-de98-4566-b613-a8616c269b19] added\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:50:48 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:97a7f016-de98-4566-b613-a8616c269b19] added
Nov 03 12:50:48 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:50:48 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97a7f016-de98-4566-b613-a8616c269b19 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:50:48 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97a7f016-de98-4566-b613-a8616c269b19 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.228s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:50:48 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5a7dfac-4412-4710-863b-aa213d62636a]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:50:48 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:50:48 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:50:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97a7f016-de98-4566-b613-a8616c269b19 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:50:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97a7f016-de98-4566-b613-a8616c269b19 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:50:49 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[59548d12-bcb7-4690-9ee9-589ae0d93589]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:50:49 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:50:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97a7f016-de98-4566-b613-a8616c269b19 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pbrKVzec {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:50:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97a7f016-de98-4566-b613-a8616c269b19 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pbrKVzec" returned: 0 in 0.024s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:50:49 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[93d8430a-c85e-43ca-b28f-16b732d1de8f]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:50:49 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pbrKVzec'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:50:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97a7f016-de98-4566-b613-a8616c269b19 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:50:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97a7f016-de98-4566-b613-a8616c269b19 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:50:49 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b539155-875b-45b8-8186-ab784e752298]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:50:49 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:50:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:50:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:50:49 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3ee1be6-cc34-4a2c-b97e-562cf1a6d403]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:50:49 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 03 12:50:49 user nova-compute[74960]:  {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:50:49 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 03 12:50:49 user nova-compute[74960]:  {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:50:49 user nova-compute[74960]: WARNING os_brick.initiator.connectors.iscsi [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 03 12:50:49 user nova-compute[74960]: 
Nov 03 12:50:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97a7f016-de98-4566-b613-a8616c269b19 -p 172.16.0.220:3260 --login {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:50:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97a7f016-de98-4566-b613-a8616c269b19 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:50:49 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff933afc-ab29-4ab9-a156-c479633ded27]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:97a7f016-de98-4566-b613-a8616c269b19, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:97a7f016-de98-4566-b613-a8616c269b19, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:50:49 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:97a7f016-de98-4566-b613-a8616c269b19, portal: 172.16.0.220,3260]
Nov 03 12:50:49 user nova-compute[74960]: Login to [iface: default, target: iqn.2010-10.org.openstack:97a7f016-de98-4566-b613-a8616c269b19, portal: 172.16.0.220,3260] successful.
Nov 03 12:50:49 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:50:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97a7f016-de98-4566-b613-a8616c269b19 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:50:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97a7f016-de98-4566-b613-a8616c269b19 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:50:49 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a187d7a-e5d1-4b99-86a0-ec952bbd31d3]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:50:49 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:50:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:50:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:50:49 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[b36007ce-3972-42c1-8aa6-15eb83bcd0bd]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97a7f016-de98-4566-b613-a8616c269b19 (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:50:49 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97a7f016-de98-4566-b613-a8616c269b19 (non-flash)
Nov 03 12:50:49 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:50:49 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97a7f016-de98-4566-b613-a8616c269b19 (non-flash)
Nov 03 12:50:49 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:50:49 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:97a7f016-de98-4566-b613-a8616c269b19" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.534s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:50:49 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Connected to 172.16.0.220:3260 {{(pid=74960) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 12:50:49 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] HCTL ('33', '-', '-', 0) found on session 43 with lun 0 {{(pid=74960) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 12:50:49 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74960) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 12:50:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:50:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:50:49 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fd8f638-efaf-4788-8d66-2c0f30d4189a]: (4, ('- - 0', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:50:49 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Searching for a device in session 43 and hctl ['33', '*', '*', 0] yield: None {{(pid=74960) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 12:50:49 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:50:50 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Searching for a device in session 43 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74960) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 12:50:50 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:97a7f016-de98-4566-b613-a8616c269b19', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pbrKVzec', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74960) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 12:50:50 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.566s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:50:50 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] <== connect_volume: return (1568ms) {'type': 'block', 'scsi_wwn': '26361623735303637', 'path': '/dev/sdb'} {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:50:50 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26361623735303637', 'path': '/dev/sdb'} {{(pid=74960) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 12:50:50 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:50:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-368606023',display_name='tempest-TestVolumeBootPattern-server-368606023',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-368606023',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d64f3d9dae8f45bcb2e0677a0076ed64',ramdisk_id='',reservation_id='r-vshfztsm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1795947051',owner_user_name='tempest-TestVolumeBootPattern-1795947051-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:50:23Z,user_data=None,user_id='067a3f33438b4112b818b91ecb4dd0d2',uuid=fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6866b484-fc17-4720-b6c3-ee8e6faa1c81", "address": "fa:16:3e:f5:ce:e0", "network": {"id": "8e985ab3-9852-4f07-8b5c-19f7bf113939", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781795302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d64f3d9dae8f45bcb2e0677a0076ed64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6866b484-fc", "ovs_interfaceid": "6866b484-fc17-4720-b6c3-ee8e6faa1c81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74960) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 12:50:50 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Converting VIF {"id": "6866b484-fc17-4720-b6c3-ee8e6faa1c81", "address": "fa:16:3e:f5:ce:e0", "network": {"id": "8e985ab3-9852-4f07-8b5c-19f7bf113939", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781795302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d64f3d9dae8f45bcb2e0677a0076ed64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6866b484-fc", "ovs_interfaceid": "6866b484-fc17-4720-b6c3-ee8e6faa1c81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:50:50 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:ce:e0,bridge_name='br-int',has_traffic_filtering=True,id=6866b484-fc17-4720-b6c3-ee8e6faa1c81,network=Network(8e985ab3-9852-4f07-8b5c-19f7bf113939),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6866b484-fc') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:50:50 user nova-compute[74960]: DEBUG nova.objects.instance [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lazy-loading 'pci_devices' on Instance uuid fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:50:50 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16] End _get_guest_xml xml=<domain type="kvm">
Nov 03 12:50:50 user nova-compute[74960]:   <uuid>fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16</uuid>
Nov 03 12:50:50 user nova-compute[74960]:   <name>instance-0000002b</name>
Nov 03 12:50:50 user nova-compute[74960]:   <memory>524288</memory>
Nov 03 12:50:50 user nova-compute[74960]:   <vcpu>1</vcpu>
Nov 03 12:50:50 user nova-compute[74960]:   <metadata>
Nov 03 12:50:50 user nova-compute[74960]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 12:50:50 user nova-compute[74960]:       <nova:package version="0.0.0"/>
Nov 03 12:50:50 user nova-compute[74960]:       <nova:name>tempest-TestVolumeBootPattern-server-368606023</nova:name>
Nov 03 12:50:50 user nova-compute[74960]:       <nova:creationTime>2023-11-03 12:50:48</nova:creationTime>
Nov 03 12:50:50 user nova-compute[74960]:       <nova:flavor name="m1.tiny">
Nov 03 12:50:50 user nova-compute[74960]:         <nova:memory>512</nova:memory>
Nov 03 12:50:50 user nova-compute[74960]:         <nova:disk>1</nova:disk>
Nov 03 12:50:50 user nova-compute[74960]:         <nova:swap>0</nova:swap>
Nov 03 12:50:50 user nova-compute[74960]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 12:50:50 user nova-compute[74960]:         <nova:vcpus>1</nova:vcpus>
Nov 03 12:50:50 user nova-compute[74960]:       </nova:flavor>
Nov 03 12:50:50 user nova-compute[74960]:       <nova:owner>
Nov 03 12:50:50 user nova-compute[74960]:         <nova:user uuid="067a3f33438b4112b818b91ecb4dd0d2">tempest-TestVolumeBootPattern-1795947051-project-member</nova:user>
Nov 03 12:50:50 user nova-compute[74960]:         <nova:project uuid="d64f3d9dae8f45bcb2e0677a0076ed64">tempest-TestVolumeBootPattern-1795947051</nova:project>
Nov 03 12:50:50 user nova-compute[74960]:       </nova:owner>
Nov 03 12:50:50 user nova-compute[74960]:       <nova:ports>
Nov 03 12:50:50 user nova-compute[74960]:         <nova:port uuid="6866b484-fc17-4720-b6c3-ee8e6faa1c81">
Nov 03 12:50:50 user nova-compute[74960]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 03 12:50:50 user nova-compute[74960]:         </nova:port>
Nov 03 12:50:50 user nova-compute[74960]:       </nova:ports>
Nov 03 12:50:50 user nova-compute[74960]:     </nova:instance>
Nov 03 12:50:50 user nova-compute[74960]:   </metadata>
Nov 03 12:50:50 user nova-compute[74960]:   <sysinfo type="smbios">
Nov 03 12:50:50 user nova-compute[74960]:     <system>
Nov 03 12:50:50 user nova-compute[74960]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 12:50:50 user nova-compute[74960]:       <entry name="product">OpenStack Nova</entry>
Nov 03 12:50:50 user nova-compute[74960]:       <entry name="version">0.0.0</entry>
Nov 03 12:50:50 user nova-compute[74960]:       <entry name="serial">fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16</entry>
Nov 03 12:50:50 user nova-compute[74960]:       <entry name="uuid">fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16</entry>
Nov 03 12:50:50 user nova-compute[74960]:       <entry name="family">Virtual Machine</entry>
Nov 03 12:50:50 user nova-compute[74960]:     </system>
Nov 03 12:50:50 user nova-compute[74960]:   </sysinfo>
Nov 03 12:50:50 user nova-compute[74960]:   <os>
Nov 03 12:50:50 user nova-compute[74960]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 12:50:50 user nova-compute[74960]:     <boot dev="hd"/>
Nov 03 12:50:50 user nova-compute[74960]:     <smbios mode="sysinfo"/>
Nov 03 12:50:50 user nova-compute[74960]:   </os>
Nov 03 12:50:50 user nova-compute[74960]:   <features>
Nov 03 12:50:50 user nova-compute[74960]:     <acpi/>
Nov 03 12:50:50 user nova-compute[74960]:     <apic/>
Nov 03 12:50:50 user nova-compute[74960]:     <vmcoreinfo/>
Nov 03 12:50:50 user nova-compute[74960]:   </features>
Nov 03 12:50:50 user nova-compute[74960]:   <clock offset="utc">
Nov 03 12:50:50 user nova-compute[74960]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 12:50:50 user nova-compute[74960]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 12:50:50 user nova-compute[74960]:     <timer name="hpet" present="no"/>
Nov 03 12:50:50 user nova-compute[74960]:   </clock>
Nov 03 12:50:50 user nova-compute[74960]:   <cpu mode="custom" match="exact">
Nov 03 12:50:50 user nova-compute[74960]:     <model>Nehalem</model>
Nov 03 12:50:50 user nova-compute[74960]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 12:50:50 user nova-compute[74960]:   </cpu>
Nov 03 12:50:50 user nova-compute[74960]:   <devices>
Nov 03 12:50:50 user nova-compute[74960]:     <disk type="block" device="disk">
Nov 03 12:50:50 user nova-compute[74960]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 12:50:50 user nova-compute[74960]:       <source dev="/dev/sdb"/>
Nov 03 12:50:50 user nova-compute[74960]:       <target dev="vda" bus="virtio"/>
Nov 03 12:50:50 user nova-compute[74960]:       <serial>97a7f016-de98-4566-b613-a8616c269b19</serial>
Nov 03 12:50:50 user nova-compute[74960]:     </disk>
Nov 03 12:50:50 user nova-compute[74960]:     <interface type="ethernet">
Nov 03 12:50:50 user nova-compute[74960]:       <mac address="fa:16:3e:f5:ce:e0"/>
Nov 03 12:50:50 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:50:50 user nova-compute[74960]:       <mtu size="1442"/>
Nov 03 12:50:50 user nova-compute[74960]:       <target dev="tap6866b484-fc"/>
Nov 03 12:50:50 user nova-compute[74960]:     </interface>
Nov 03 12:50:50 user nova-compute[74960]:     <serial type="pty">
Nov 03 12:50:50 user nova-compute[74960]:       <log file="/opt/stack/data/nova/instances/fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16/console.log" append="off"/>
Nov 03 12:50:50 user nova-compute[74960]:     </serial>
Nov 03 12:50:50 user nova-compute[74960]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 12:50:50 user nova-compute[74960]:     <video>
Nov 03 12:50:50 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:50:50 user nova-compute[74960]:     </video>
Nov 03 12:50:50 user nova-compute[74960]:     <rng model="virtio">
Nov 03 12:50:50 user nova-compute[74960]:       <backend model="random">/dev/urandom</backend>
Nov 03 12:50:50 user nova-compute[74960]:     </rng>
Nov 03 12:50:50 user nova-compute[74960]:     <controller type="usb" index="0" model="none"/>
Nov 03 12:50:50 user nova-compute[74960]:     <memballoon model="virtio">
Nov 03 12:50:50 user nova-compute[74960]:       <stats period="10"/>
Nov 03 12:50:50 user nova-compute[74960]:     </memballoon>
Nov 03 12:50:50 user nova-compute[74960]:   </devices>
Nov 03 12:50:50 user nova-compute[74960]: </domain>
Nov 03 12:50:50 user nova-compute[74960]:  {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 12:50:50 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:50:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-368606023',display_name='tempest-TestVolumeBootPattern-server-368606023',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-368606023',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d64f3d9dae8f45bcb2e0677a0076ed64',ramdisk_id='',reservation_id='r-vshfztsm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1795947051',owner_user_name='tempest-TestVolumeBootPattern-1795947051-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:50:23Z,user_data=None,user_id='067a3f33438b4112b818b91ecb4dd0d2',uuid=fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6866b484-fc17-4720-b6c3-ee8e6faa1c81", "address": "fa:16:3e:f5:ce:e0", "network": {"id": "8e985ab3-9852-4f07-8b5c-19f7bf113939", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781795302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d64f3d9dae8f45bcb2e0677a0076ed64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6866b484-fc", "ovs_interfaceid": "6866b484-fc17-4720-b6c3-ee8e6faa1c81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 12:50:50 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Converting VIF {"id": "6866b484-fc17-4720-b6c3-ee8e6faa1c81", "address": "fa:16:3e:f5:ce:e0", "network": {"id": "8e985ab3-9852-4f07-8b5c-19f7bf113939", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781795302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d64f3d9dae8f45bcb2e0677a0076ed64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6866b484-fc", "ovs_interfaceid": "6866b484-fc17-4720-b6c3-ee8e6faa1c81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:50:50 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:ce:e0,bridge_name='br-int',has_traffic_filtering=True,id=6866b484-fc17-4720-b6c3-ee8e6faa1c81,network=Network(8e985ab3-9852-4f07-8b5c-19f7bf113939),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6866b484-fc') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:50:50 user nova-compute[74960]: DEBUG os_vif [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:ce:e0,bridge_name='br-int',has_traffic_filtering=True,id=6866b484-fc17-4720-b6c3-ee8e6faa1c81,network=Network(8e985ab3-9852-4f07-8b5c-19f7bf113939),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6866b484-fc') {{(pid=74960) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 12:50:50 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:50:50 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:50:50 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 12:50:50 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:50:50 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '00d3c1f2-469d-5bd5-98bc-0a5177c0aac9', '_type': 'linux-noop'}}, row=False) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:50:50 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:50:50 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:50:50 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:50:50 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6866b484-fc, may_exist=True, interface_attrs={}) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:50:50 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6866b484-fc, col_values=(('qos', UUID('947119f4-8209-40bb-86e4-ab4650bb2133')),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:50:50 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6866b484-fc, col_values=(('external_ids', {'iface-id': '6866b484-fc17-4720-b6c3-ee8e6faa1c81', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f5:ce:e0', 'vm-uuid': 'fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16'}),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:50:50 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:50:50 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:50:50 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:50:50 user nova-compute[74960]: INFO os_vif [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:ce:e0,bridge_name='br-int',has_traffic_filtering=True,id=6866b484-fc17-4720-b6c3-ee8e6faa1c81,network=Network(8e985ab3-9852-4f07-8b5c-19f7bf113939),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6866b484-fc')
Nov 03 12:50:50 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] No BDM found with device name vda, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:50:50 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] No VIF found with MAC fa:16:3e:f5:ce:e0, not building metadata {{(pid=74960) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 12:50:51 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:50:51 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:50:51 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:50:51 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:50:52 user nova-compute[74960]: DEBUG nova.compute.manager [req-0f3e5be0-2bfd-486b-a2b1-0da077783fe1 req-342f2179-29c5-4023-aca9-ebd5dc5d70a5 service nova] [instance: fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16] Received event network-vif-plugged-6866b484-fc17-4720-b6c3-ee8e6faa1c81 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:50:52 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-0f3e5be0-2bfd-486b-a2b1-0da077783fe1 req-342f2179-29c5-4023-aca9-ebd5dc5d70a5 service nova] Acquiring lock "fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:50:52 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-0f3e5be0-2bfd-486b-a2b1-0da077783fe1 req-342f2179-29c5-4023-aca9-ebd5dc5d70a5 service nova] Lock "fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:50:52 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-0f3e5be0-2bfd-486b-a2b1-0da077783fe1 req-342f2179-29c5-4023-aca9-ebd5dc5d70a5 service nova] Lock "fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:50:52 user nova-compute[74960]: DEBUG nova.compute.manager [req-0f3e5be0-2bfd-486b-a2b1-0da077783fe1 req-342f2179-29c5-4023-aca9-ebd5dc5d70a5 service nova] [instance: fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16] No waiting events found dispatching network-vif-plugged-6866b484-fc17-4720-b6c3-ee8e6faa1c81 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:50:52 user nova-compute[74960]: WARNING nova.compute.manager [req-0f3e5be0-2bfd-486b-a2b1-0da077783fe1 req-342f2179-29c5-4023-aca9-ebd5dc5d70a5 service nova] [instance: fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16] Received unexpected event network-vif-plugged-6866b484-fc17-4720-b6c3-ee8e6faa1c81 for instance with vm_state building and task_state spawning.
Nov 03 12:50:52 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:50:52 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:50:52 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:50:53 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:50:54 user nova-compute[74960]: DEBUG nova.compute.manager [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16] Instance event wait completed in 0 seconds for  {{(pid=74960) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 12:50:54 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16] Guest created on hypervisor {{(pid=74960) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 12:50:54 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16] Instance spawned successfully.
Nov 03 12:50:54 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 12:50:54 user nova-compute[74960]: DEBUG nova.compute.manager [req-d2a8112e-bf8c-4d03-8c96-7d8ea45952dd req-bb6b8076-e852-4b94-b23a-f3e7f6bd567c service nova] [instance: fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16] Received event network-vif-plugged-6866b484-fc17-4720-b6c3-ee8e6faa1c81 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:50:54 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-d2a8112e-bf8c-4d03-8c96-7d8ea45952dd req-bb6b8076-e852-4b94-b23a-f3e7f6bd567c service nova] Acquiring lock "fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:50:54 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-d2a8112e-bf8c-4d03-8c96-7d8ea45952dd req-bb6b8076-e852-4b94-b23a-f3e7f6bd567c service nova] Lock "fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:50:54 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-d2a8112e-bf8c-4d03-8c96-7d8ea45952dd req-bb6b8076-e852-4b94-b23a-f3e7f6bd567c service nova] Lock "fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:50:54 user nova-compute[74960]: DEBUG nova.compute.manager [req-d2a8112e-bf8c-4d03-8c96-7d8ea45952dd req-bb6b8076-e852-4b94-b23a-f3e7f6bd567c service nova] [instance: fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16] No waiting events found dispatching network-vif-plugged-6866b484-fc17-4720-b6c3-ee8e6faa1c81 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:50:54 user nova-compute[74960]: WARNING nova.compute.manager [req-d2a8112e-bf8c-4d03-8c96-7d8ea45952dd req-bb6b8076-e852-4b94-b23a-f3e7f6bd567c service nova] [instance: fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16] Received unexpected event network-vif-plugged-6866b484-fc17-4720-b6c3-ee8e6faa1c81 for instance with vm_state building and task_state spawning.
Nov 03 12:50:54 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16] Found default for hw_cdrom_bus of ide {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:50:54 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16] Found default for hw_disk_bus of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:50:54 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16] Found default for hw_input_bus of None {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:50:54 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16] Found default for hw_pointer_model of None {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:50:54 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16] Found default for hw_video_model of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:50:54 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16] Found default for hw_vif_model of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:50:54 user nova-compute[74960]: INFO nova.compute.manager [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16] Took 5.63 seconds to spawn the instance on the hypervisor.
Nov 03 12:50:54 user nova-compute[74960]: DEBUG nova.compute.manager [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16] Checking state {{(pid=74960) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 12:50:54 user nova-compute[74960]: INFO nova.compute.manager [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16] Took 31.74 seconds to build instance.
Nov 03 12:50:54 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-015d7063-158a-423b-b29e-8b26287140ee tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lock "fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 31.837s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:50:55 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:50:58 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:51:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:51:01 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:51:04 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:51:05 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:51:05 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:51:07 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:51:07 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:51:07 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:51:07 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:51:07 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Auditing locally available compute resources for user (node: user) {{(pid=74960) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 12:51:07 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74960) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 12:51:07 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ede59da-37c6-4162-9e79-318f1a4a8aeb/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:51:07 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ede59da-37c6-4162-9e79-318f1a4a8aeb/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:51:07 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ede59da-37c6-4162-9e79-318f1a4a8aeb/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:51:08 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ede59da-37c6-4162-9e79-318f1a4a8aeb/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:51:08 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:51:08 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:51:08 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Hypervisor/Node resource view: name=user free_ram=8616MB free_disk=24.97986602783203GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74960) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 12:51:08 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:51:08 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:51:08 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:51:08 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 5ede59da-37c6-4162-9e79-318f1a4a8aeb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:51:08 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74960) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 12:51:08 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74960) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 12:51:08 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:51:08 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:51:08 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Compute_service record updated for user:user {{(pid=74960) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 12:51:08 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.298s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:51:09 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:51:10 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:51:10 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:51:10 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:51:11 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:51:12 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:51:13 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:51:13 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Starting heal instance info cache {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 12:51:13 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Rebuilding the list of instances to heal {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 03 12:51:13 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "refresh_cache-fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:51:13 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquired lock "refresh_cache-fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:51:13 user nova-compute[74960]: DEBUG nova.network.neutron [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16] Forcefully refreshing network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 12:51:13 user nova-compute[74960]: DEBUG nova.objects.instance [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lazy-loading 'info_cache' on Instance uuid fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:51:13 user nova-compute[74960]: DEBUG nova.network.neutron [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16] Updating instance_info_cache with network_info: [{"id": "6866b484-fc17-4720-b6c3-ee8e6faa1c81", "address": "fa:16:3e:f5:ce:e0", "network": {"id": "8e985ab3-9852-4f07-8b5c-19f7bf113939", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781795302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d64f3d9dae8f45bcb2e0677a0076ed64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6866b484-fc", "ovs_interfaceid": "6866b484-fc17-4720-b6c3-ee8e6faa1c81", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:51:13 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Releasing lock "refresh_cache-fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:51:13 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16] Updated the network info_cache for instance {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 12:51:13 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:51:13 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74960) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 12:51:14 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:51:15 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:51:19 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:51:20 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:51:21 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:51:24 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:51:25 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:51:29 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:51:30 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:51:35 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:51:40 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:51:45 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:51:49 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:51:50 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:51:55 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:52:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:52:02 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:52:05 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:52:06 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:52:07 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:52:07 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:52:07 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:52:07 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:52:07 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Auditing locally available compute resources for user (node: user) {{(pid=74960) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 12:52:07 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74960) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 12:52:07 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ede59da-37c6-4162-9e79-318f1a4a8aeb/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:52:07 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ede59da-37c6-4162-9e79-318f1a4a8aeb/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:52:07 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ede59da-37c6-4162-9e79-318f1a4a8aeb/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:52:07 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ede59da-37c6-4162-9e79-318f1a4a8aeb/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:52:08 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:52:08 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:52:08 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Hypervisor/Node resource view: name=user free_ram=8892MB free_disk=24.976688385009766GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74960) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 12:52:08 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:52:08 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:52:08 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:52:08 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 5ede59da-37c6-4162-9e79-318f1a4a8aeb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:52:08 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74960) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 12:52:08 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74960) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 12:52:08 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:52:08 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:52:08 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Compute_service record updated for user:user {{(pid=74960) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 12:52:08 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.191s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:52:10 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:52:11 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:52:12 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:52:12 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:52:12 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:52:13 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-7072ef75-4ba2-43b9-b169-240350e91cd3 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Acquiring lock "fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:52:13 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-7072ef75-4ba2-43b9-b169-240350e91cd3 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lock "fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:52:13 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-7072ef75-4ba2-43b9-b169-240350e91cd3 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Acquiring lock "fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:52:13 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-7072ef75-4ba2-43b9-b169-240350e91cd3 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lock "fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:52:13 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-7072ef75-4ba2-43b9-b169-240350e91cd3 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lock "fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:52:13 user nova-compute[74960]: INFO nova.compute.manager [None req-7072ef75-4ba2-43b9-b169-240350e91cd3 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16] Terminating instance
Nov 03 12:52:13 user nova-compute[74960]: DEBUG nova.compute.manager [None req-7072ef75-4ba2-43b9-b169-240350e91cd3 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16] Start destroying the instance on the hypervisor. {{(pid=74960) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 12:52:13 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:52:13 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:52:13 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:52:13 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:52:13 user nova-compute[74960]: DEBUG nova.compute.manager [req-bba60f1a-e11f-4278-abf1-30e7efe4331f req-e94d06f0-fb44-4d40-9615-1e8f3b578229 service nova] [instance: fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16] Received event network-vif-unplugged-6866b484-fc17-4720-b6c3-ee8e6faa1c81 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:52:13 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-bba60f1a-e11f-4278-abf1-30e7efe4331f req-e94d06f0-fb44-4d40-9615-1e8f3b578229 service nova] Acquiring lock "fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:52:13 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-bba60f1a-e11f-4278-abf1-30e7efe4331f req-e94d06f0-fb44-4d40-9615-1e8f3b578229 service nova] Lock "fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:52:13 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-bba60f1a-e11f-4278-abf1-30e7efe4331f req-e94d06f0-fb44-4d40-9615-1e8f3b578229 service nova] Lock "fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:52:13 user nova-compute[74960]: DEBUG nova.compute.manager [req-bba60f1a-e11f-4278-abf1-30e7efe4331f req-e94d06f0-fb44-4d40-9615-1e8f3b578229 service nova] [instance: fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16] No waiting events found dispatching network-vif-unplugged-6866b484-fc17-4720-b6c3-ee8e6faa1c81 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:52:13 user nova-compute[74960]: DEBUG nova.compute.manager [req-bba60f1a-e11f-4278-abf1-30e7efe4331f req-e94d06f0-fb44-4d40-9615-1e8f3b578229 service nova] [instance: fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16] Received event network-vif-unplugged-6866b484-fc17-4720-b6c3-ee8e6faa1c81 for instance with task_state deleting. {{(pid=74960) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 12:52:14 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16] Instance destroyed successfully.
Nov 03 12:52:14 user nova-compute[74960]: DEBUG nova.objects.instance [None req-7072ef75-4ba2-43b9-b169-240350e91cd3 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lazy-loading 'resources' on Instance uuid fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:52:14 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-7072ef75-4ba2-43b9-b169-240350e91cd3 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:50:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-368606023',display_name='tempest-TestVolumeBootPattern-server-368606023',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-368606023',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-03T12:50:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d64f3d9dae8f45bcb2e0677a0076ed64',ramdisk_id='',reservation_id='r-vshfztsm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1795947051',owner_user_name='tempest-TestVolumeBootPattern-1795947051-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T12:50:54Z,user_data=None,user_id='067a3f33438b4112b818b91ecb4dd0d2',uuid=fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6866b484-fc17-4720-b6c3-ee8e6faa1c81", "address": "fa:16:3e:f5:ce:e0", "network": {"id": "8e985ab3-9852-4f07-8b5c-19f7bf113939", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781795302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d64f3d9dae8f45bcb2e0677a0076ed64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6866b484-fc", "ovs_interfaceid": "6866b484-fc17-4720-b6c3-ee8e6faa1c81", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 12:52:14 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-7072ef75-4ba2-43b9-b169-240350e91cd3 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Converting VIF {"id": "6866b484-fc17-4720-b6c3-ee8e6faa1c81", "address": "fa:16:3e:f5:ce:e0", "network": {"id": "8e985ab3-9852-4f07-8b5c-19f7bf113939", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781795302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d64f3d9dae8f45bcb2e0677a0076ed64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6866b484-fc", "ovs_interfaceid": "6866b484-fc17-4720-b6c3-ee8e6faa1c81", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:52:14 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-7072ef75-4ba2-43b9-b169-240350e91cd3 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f5:ce:e0,bridge_name='br-int',has_traffic_filtering=True,id=6866b484-fc17-4720-b6c3-ee8e6faa1c81,network=Network(8e985ab3-9852-4f07-8b5c-19f7bf113939),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6866b484-fc') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:52:14 user nova-compute[74960]: DEBUG os_vif [None req-7072ef75-4ba2-43b9-b169-240350e91cd3 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:ce:e0,bridge_name='br-int',has_traffic_filtering=True,id=6866b484-fc17-4720-b6c3-ee8e6faa1c81,network=Network(8e985ab3-9852-4f07-8b5c-19f7bf113939),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6866b484-fc') {{(pid=74960) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 12:52:14 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:52:14 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6866b484-fc, bridge=br-int, if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:52:14 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:52:14 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:52:14 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:52:14 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=947119f4-8209-40bb-86e4-ab4650bb2133) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:52:14 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:52:14 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:52:14 user nova-compute[74960]: INFO os_vif [None req-7072ef75-4ba2-43b9-b169-240350e91cd3 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:ce:e0,bridge_name='br-int',has_traffic_filtering=True,id=6866b484-fc17-4720-b6c3-ee8e6faa1c81,network=Network(8e985ab3-9852-4f07-8b5c-19f7bf113939),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6866b484-fc')
Nov 03 12:52:14 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7072ef75-4ba2-43b9-b169-240350e91cd3 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16] calling os-brick to detach iSCSI Volume {{(pid=74960) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 12:52:14 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-7072ef75-4ba2-43b9-b169-240350e91cd3 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9aa420acb0>, {'target_iqn': 'iqn.2010-10.org.openstack:97a7f016-de98-4566-b613-a8616c269b19', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pbrKVzec', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:52:14 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-7072ef75-4ba2-43b9-b169-240350e91cd3 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:52:14 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-7072ef75-4ba2-43b9-b169-240350e91cd3 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:52:14 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-7072ef75-4ba2-43b9-b169-240350e91cd3 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:52:14 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:52:14 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:52:14 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[0859efe6-349b-495b-8dd1-7743f49fb5f7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:97a7f016-de98-4566-b613-a8616c269b19\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:52:14 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-7072ef75-4ba2-43b9-b169-240350e91cd3 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 12:52:14 user nova-compute[74960]: No targets found.
Nov 03 12:52:14 user nova-compute[74960]: iSNS:
Nov 03 12:52:14 user nova-compute[74960]: No targets found.
Nov 03 12:52:14 user nova-compute[74960]: STATIC:
Nov 03 12:52:14 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:97a7f016-de98-4566-b613-a8616c269b19
Nov 03 12:52:14 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:52:14 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:52:14 user nova-compute[74960]: FIRMWARE:
Nov 03 12:52:14 user nova-compute[74960]: No targets found.
Nov 03 12:52:14 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:52:14 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-7072ef75-4ba2-43b9-b169-240350e91cd3 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 12:52:14 user nova-compute[74960]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 12:52:14 user nova-compute[74960]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74960) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 12:52:14 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-7072ef75-4ba2-43b9-b169-240350e91cd3 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:97a7f016-de98-4566-b613-a8616c269b19', 0)] {{(pid=74960) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 12:52:14 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:52:14 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:52:14 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff5e605b-34f9-452f-96e3-eddb72ab7bdb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97a7f016-de98-4566-b613-a8616c269b19\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:52:14 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:52:14 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:52:14 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a9e9880-f471-4841-b679-5b41d8a8a13a]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97a7f016-de98-4566-b613-a8616c269b19 (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:52:14 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-7072ef75-4ba2-43b9-b169-240350e91cd3 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97a7f016-de98-4566-b613-a8616c269b19 (non-flash)
Nov 03 12:52:14 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:52:14 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-7072ef75-4ba2-43b9-b169-240350e91cd3 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97a7f016-de98-4566-b613-a8616c269b19 (non-flash)
Nov 03 12:52:14 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:52:14 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-7072ef75-4ba2-43b9-b169-240350e91cd3 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9a8c43cd30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:97a7f016-de98-4566-b613-a8616c269b19'): ({'sdb'}, set())}) {{(pid=74960) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 12:52:14 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-7072ef75-4ba2-43b9-b169-240350e91cd3 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Removing single pathed devices sdb {{(pid=74960) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 12:52:14 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:52:14 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:52:14 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[beabb673-7fc8-4d72-aeb1-aa809813e809]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:52:14 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:52:14 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:52:14 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[60c5ff8b-0080-4e45-9265-15db2e95fa2a]: (4, ('ok\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:52:14 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-7072ef75-4ba2-43b9-b169-240350e91cd3 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Flushing IO for device /dev/sdb {{(pid=74960) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 12:52:14 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:52:14 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:52:14 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[5541ffed-eab4-4abb-b890-460d0ea9457a]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:52:14 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-7072ef75-4ba2-43b9-b169-240350e91cd3 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74960) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 12:52:14 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:52:14 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:52:14 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[65e68791-7554-4089-b356-b8f02333da56]: (4, ('1', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:52:14 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-7072ef75-4ba2-43b9-b169-240350e91cd3 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74960) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 12:52:14 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-7072ef75-4ba2-43b9-b169-240350e91cd3 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] SCSI volumes sdb have been removed. {{(pid=74960) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 12:52:14 user nova-compute[74960]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_6bb5f76c', '/dev/disk/by-id/scsi-26361623735303637', '/dev/disk/by-id/scsi-1SCST_BIO6bb5f76c-cab75067e9a1de17') {{(pid=86167) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 03 12:52:14 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[123f2f25-38d7-4774-b969-63bbe40c2f83]: (4, None) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:52:14 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-7072ef75-4ba2-43b9-b169-240350e91cd3 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:97a7f016-de98-4566-b613-a8616c269b19')] {{(pid=74960) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 12:52:14 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97a7f016-de98-4566-b613-a8616c269b19 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:52:14 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97a7f016-de98-4566-b613-a8616c269b19 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:52:14 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c07a94c-e782-4473-830b-b6c3584b613e]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:52:14 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-7072ef75-4ba2-43b9-b169-240350e91cd3 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:52:14 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97a7f016-de98-4566-b613-a8616c269b19 -p 172.16.0.220:3260 --logout {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:52:14 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:52:14 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Starting heal instance info cache {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 12:52:14 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97a7f016-de98-4566-b613-a8616c269b19 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:52:14 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8a059fe-d992-40cb-b859-0cd465970482]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:97a7f016-de98-4566-b613-a8616c269b19, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:97a7f016-de98-4566-b613-a8616c269b19, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:52:14 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-7072ef75-4ba2-43b9-b169-240350e91cd3 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:97a7f016-de98-4566-b613-a8616c269b19, portal: 172.16.0.220,3260]
Nov 03 12:52:14 user nova-compute[74960]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:97a7f016-de98-4566-b613-a8616c269b19, portal: 172.16.0.220,3260] successful.
Nov 03 12:52:14 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:52:14 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97a7f016-de98-4566-b613-a8616c269b19 -p 172.16.0.220:3260 --op delete {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:52:14 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97a7f016-de98-4566-b613-a8616c269b19 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:52:14 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[00955816-f212-441d-9c2f-1a899f7a01ec]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:52:14 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-7072ef75-4ba2-43b9-b169-240350e91cd3 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:52:14 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-7072ef75-4ba2-43b9-b169-240350e91cd3 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.277s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:52:14 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-7072ef75-4ba2-43b9-b169-240350e91cd3 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] <== disconnect_volume: return (279ms) None {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:52:14 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7072ef75-4ba2-43b9-b169-240350e91cd3 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16] Disconnected iSCSI Volume {{(pid=74960) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 12:52:14 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-7072ef75-4ba2-43b9-b169-240350e91cd3 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16] Deleting instance files /opt/stack/data/nova/instances/fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16_del
Nov 03 12:52:14 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-7072ef75-4ba2-43b9-b169-240350e91cd3 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16] Deletion of /opt/stack/data/nova/instances/fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16_del complete
Nov 03 12:52:14 user nova-compute[74960]: INFO nova.compute.manager [None req-7072ef75-4ba2-43b9-b169-240350e91cd3 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16] Took 1.11 seconds to destroy the instance on the hypervisor.
Nov 03 12:52:14 user nova-compute[74960]: DEBUG oslo.service.loopingcall [None req-7072ef75-4ba2-43b9-b169-240350e91cd3 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74960) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 12:52:14 user nova-compute[74960]: DEBUG nova.compute.manager [-] [instance: fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16] Deallocating network for instance {{(pid=74960) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 12:52:14 user nova-compute[74960]: DEBUG nova.network.neutron [-] [instance: fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16] deallocate_for_instance() {{(pid=74960) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 12:52:14 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "refresh_cache-5ede59da-37c6-4162-9e79-318f1a4a8aeb" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:52:14 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquired lock "refresh_cache-5ede59da-37c6-4162-9e79-318f1a4a8aeb" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:52:14 user nova-compute[74960]: DEBUG nova.network.neutron [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: 5ede59da-37c6-4162-9e79-318f1a4a8aeb] Forcefully refreshing network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 12:52:15 user nova-compute[74960]: DEBUG nova.network.neutron [-] [instance: fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16] Updating instance_info_cache with network_info: [] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:52:15 user nova-compute[74960]: DEBUG nova.network.neutron [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: 5ede59da-37c6-4162-9e79-318f1a4a8aeb] Updating instance_info_cache with network_info: [{"id": "9f629e06-9020-4e4b-956e-d33d9417c2a6", "address": "fa:16:3e:1e:78:99", "network": {"id": "c50fc382-c1b9-49d8-8e38-ac681cbbcffd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1465428328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "255349fa349045ad8a554d3f818cdd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f629e06-90", "ovs_interfaceid": "9f629e06-9020-4e4b-956e-d33d9417c2a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:52:15 user nova-compute[74960]: INFO nova.compute.manager [-] [instance: fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16] Took 0.54 seconds to deallocate network for instance.
Nov 03 12:52:15 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Releasing lock "refresh_cache-5ede59da-37c6-4162-9e79-318f1a4a8aeb" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:52:15 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: 5ede59da-37c6-4162-9e79-318f1a4a8aeb] Updated the network info_cache for instance {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 12:52:15 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:52:15 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74960) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 12:52:15 user nova-compute[74960]: DEBUG nova.compute.manager [req-fc272593-c4fc-415e-b2a5-1244f4add4b0 req-f40af647-d259-44b4-89a5-2f29161381ef service nova] [instance: fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16] Received event network-vif-plugged-6866b484-fc17-4720-b6c3-ee8e6faa1c81 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:52:15 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-fc272593-c4fc-415e-b2a5-1244f4add4b0 req-f40af647-d259-44b4-89a5-2f29161381ef service nova] Acquiring lock "fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:52:15 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-fc272593-c4fc-415e-b2a5-1244f4add4b0 req-f40af647-d259-44b4-89a5-2f29161381ef service nova] Lock "fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:52:15 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-fc272593-c4fc-415e-b2a5-1244f4add4b0 req-f40af647-d259-44b4-89a5-2f29161381ef service nova] Lock "fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:52:15 user nova-compute[74960]: DEBUG nova.compute.manager [req-fc272593-c4fc-415e-b2a5-1244f4add4b0 req-f40af647-d259-44b4-89a5-2f29161381ef service nova] [instance: fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16] No waiting events found dispatching network-vif-plugged-6866b484-fc17-4720-b6c3-ee8e6faa1c81 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:52:15 user nova-compute[74960]: WARNING nova.compute.manager [req-fc272593-c4fc-415e-b2a5-1244f4add4b0 req-f40af647-d259-44b4-89a5-2f29161381ef service nova] [instance: fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16] Received unexpected event network-vif-plugged-6866b484-fc17-4720-b6c3-ee8e6faa1c81 for instance with vm_state active and task_state deleting.
Nov 03 12:52:15 user nova-compute[74960]: DEBUG nova.compute.manager [req-fc272593-c4fc-415e-b2a5-1244f4add4b0 req-f40af647-d259-44b4-89a5-2f29161381ef service nova] [instance: fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16] Received event network-vif-deleted-6866b484-fc17-4720-b6c3-ee8e6faa1c81 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:52:15 user nova-compute[74960]: INFO nova.compute.manager [None req-7072ef75-4ba2-43b9-b169-240350e91cd3 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16] Took 0.81 seconds to detach 1 volumes for instance.
Nov 03 12:52:15 user nova-compute[74960]: DEBUG nova.compute.manager [None req-7072ef75-4ba2-43b9-b169-240350e91cd3 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16] Deleting volume: 97a7f016-de98-4566-b613-a8616c269b19 {{(pid=74960) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 03 12:52:15 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-7072ef75-4ba2-43b9-b169-240350e91cd3 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:52:15 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-7072ef75-4ba2-43b9-b169-240350e91cd3 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:52:16 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-7072ef75-4ba2-43b9-b169-240350e91cd3 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:52:16 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-7072ef75-4ba2-43b9-b169-240350e91cd3 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:52:16 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-7072ef75-4ba2-43b9-b169-240350e91cd3 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.152s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:52:16 user nova-compute[74960]: INFO nova.scheduler.client.report [None req-7072ef75-4ba2-43b9-b169-240350e91cd3 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Deleted allocations for instance fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16
Nov 03 12:52:16 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-7072ef75-4ba2-43b9-b169-240350e91cd3 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lock "fc0cb8b8-cdd4-4eb4-92ba-79c7e35b0d16" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.876s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:52:19 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:52:24 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:52:29 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:52:33 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:52:33 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:52:33 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:52:33 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:52:33 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:52:33 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:52:33 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:52:33 user nova-compute[74960]: DEBUG nova.compute.manager [req-b8c97817-0d35-4eb1-ab13-be6263b8d4bd req-9eb091bc-c2ff-490c-aef9-c249030c334e service nova] [instance: 5ede59da-37c6-4162-9e79-318f1a4a8aeb] Received event network-changed-9f629e06-9020-4e4b-956e-d33d9417c2a6 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:52:33 user nova-compute[74960]: DEBUG nova.compute.manager [req-b8c97817-0d35-4eb1-ab13-be6263b8d4bd req-9eb091bc-c2ff-490c-aef9-c249030c334e service nova] [instance: 5ede59da-37c6-4162-9e79-318f1a4a8aeb] Refreshing instance network info cache due to event network-changed-9f629e06-9020-4e4b-956e-d33d9417c2a6. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 12:52:33 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-b8c97817-0d35-4eb1-ab13-be6263b8d4bd req-9eb091bc-c2ff-490c-aef9-c249030c334e service nova] Acquiring lock "refresh_cache-5ede59da-37c6-4162-9e79-318f1a4a8aeb" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:52:33 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-b8c97817-0d35-4eb1-ab13-be6263b8d4bd req-9eb091bc-c2ff-490c-aef9-c249030c334e service nova] Acquired lock "refresh_cache-5ede59da-37c6-4162-9e79-318f1a4a8aeb" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:52:33 user nova-compute[74960]: DEBUG nova.network.neutron [req-b8c97817-0d35-4eb1-ab13-be6263b8d4bd req-9eb091bc-c2ff-490c-aef9-c249030c334e service nova] [instance: 5ede59da-37c6-4162-9e79-318f1a4a8aeb] Refreshing network info cache for port 9f629e06-9020-4e4b-956e-d33d9417c2a6 {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 12:52:33 user nova-compute[74960]: DEBUG nova.virt.libvirt.imagecache [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Verify base images {{(pid=74960) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 03 12:52:33 user nova-compute[74960]: DEBUG nova.virt.libvirt.imagecache [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Image id 549f51ba-ac69-494b-8de1-34635aa2d7cf yields fingerprint e6dd2218c84de2ab995a2e9c530d865cc558f910 {{(pid=74960) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 03 12:52:33 user nova-compute[74960]: INFO nova.virt.libvirt.imagecache [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] image 549f51ba-ac69-494b-8de1-34635aa2d7cf at (/opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910): checking
Nov 03 12:52:33 user nova-compute[74960]: DEBUG nova.virt.libvirt.imagecache [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] image 549f51ba-ac69-494b-8de1-34635aa2d7cf at (/opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910): image is in use {{(pid=74960) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 03 12:52:33 user nova-compute[74960]: DEBUG nova.virt.libvirt.imagecache [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=74960) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 03 12:52:33 user nova-compute[74960]: DEBUG nova.virt.libvirt.imagecache [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] 5ede59da-37c6-4162-9e79-318f1a4a8aeb is a valid instance name {{(pid=74960) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 03 12:52:33 user nova-compute[74960]: DEBUG nova.virt.libvirt.imagecache [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] 5ede59da-37c6-4162-9e79-318f1a4a8aeb has a disk file {{(pid=74960) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 03 12:52:33 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ede59da-37c6-4162-9e79-318f1a4a8aeb/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:52:33 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ede59da-37c6-4162-9e79-318f1a4a8aeb/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:52:33 user nova-compute[74960]: DEBUG nova.virt.libvirt.imagecache [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 5ede59da-37c6-4162-9e79-318f1a4a8aeb is backed by e6dd2218c84de2ab995a2e9c530d865cc558f910 {{(pid=74960) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 03 12:52:33 user nova-compute[74960]: WARNING nova.virt.libvirt.imagecache [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Unknown base file: /opt/stack/data/nova/instances/_base/98ff57db1069e799a7e32024ace676f6d7c1f767
Nov 03 12:52:33 user nova-compute[74960]: WARNING nova.virt.libvirt.imagecache [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Unknown base file: /opt/stack/data/nova/instances/_base/c57948025419588ca82f919dadb057e60fc123d9
Nov 03 12:52:33 user nova-compute[74960]: WARNING nova.virt.libvirt.imagecache [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Unknown base file: /opt/stack/data/nova/instances/_base/40928fe67a462526e212953cfebd65bd57921145
Nov 03 12:52:33 user nova-compute[74960]: WARNING nova.virt.libvirt.imagecache [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Unknown base file: /opt/stack/data/nova/instances/_base/79688a154c30e83742a9b59c51b2a68a7c95a9b0
Nov 03 12:52:33 user nova-compute[74960]: WARNING nova.virt.libvirt.imagecache [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Unknown base file: /opt/stack/data/nova/instances/_base/c582bb77920948ae2db7e57ee5cc6dbc38c14a24
Nov 03 12:52:33 user nova-compute[74960]: WARNING nova.virt.libvirt.imagecache [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Unknown base file: /opt/stack/data/nova/instances/_base/88077c15ad6d6301757c88bf53ad916fdacc70f0
Nov 03 12:52:33 user nova-compute[74960]: WARNING nova.virt.libvirt.imagecache [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Unknown base file: /opt/stack/data/nova/instances/_base/900987749872ba3cca2aaec0ad1ec322ab474b04
Nov 03 12:52:33 user nova-compute[74960]: WARNING nova.virt.libvirt.imagecache [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Unknown base file: /opt/stack/data/nova/instances/_base/95eaee271a42362ade595e1bcb5dde2063ccad30
Nov 03 12:52:33 user nova-compute[74960]: WARNING nova.virt.libvirt.imagecache [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Unknown base file: /opt/stack/data/nova/instances/_base/21782977f2ca10f55b0849c8717736f9d23ded60
Nov 03 12:52:33 user nova-compute[74960]: INFO nova.virt.libvirt.imagecache [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Active base files: /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910
Nov 03 12:52:33 user nova-compute[74960]: INFO nova.virt.libvirt.imagecache [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Removable base files: /opt/stack/data/nova/instances/_base/98ff57db1069e799a7e32024ace676f6d7c1f767 /opt/stack/data/nova/instances/_base/c57948025419588ca82f919dadb057e60fc123d9 /opt/stack/data/nova/instances/_base/40928fe67a462526e212953cfebd65bd57921145 /opt/stack/data/nova/instances/_base/79688a154c30e83742a9b59c51b2a68a7c95a9b0 /opt/stack/data/nova/instances/_base/c582bb77920948ae2db7e57ee5cc6dbc38c14a24 /opt/stack/data/nova/instances/_base/88077c15ad6d6301757c88bf53ad916fdacc70f0 /opt/stack/data/nova/instances/_base/900987749872ba3cca2aaec0ad1ec322ab474b04 /opt/stack/data/nova/instances/_base/95eaee271a42362ade595e1bcb5dde2063ccad30 /opt/stack/data/nova/instances/_base/21782977f2ca10f55b0849c8717736f9d23ded60
Nov 03 12:52:33 user nova-compute[74960]: INFO nova.virt.libvirt.imagecache [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/98ff57db1069e799a7e32024ace676f6d7c1f767
Nov 03 12:52:33 user nova-compute[74960]: INFO nova.virt.libvirt.imagecache [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/c57948025419588ca82f919dadb057e60fc123d9
Nov 03 12:52:33 user nova-compute[74960]: INFO nova.virt.libvirt.imagecache [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/40928fe67a462526e212953cfebd65bd57921145
Nov 03 12:52:33 user nova-compute[74960]: INFO nova.virt.libvirt.imagecache [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/79688a154c30e83742a9b59c51b2a68a7c95a9b0
Nov 03 12:52:33 user nova-compute[74960]: INFO nova.virt.libvirt.imagecache [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/c582bb77920948ae2db7e57ee5cc6dbc38c14a24
Nov 03 12:52:33 user nova-compute[74960]: INFO nova.virt.libvirt.imagecache [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/88077c15ad6d6301757c88bf53ad916fdacc70f0
Nov 03 12:52:33 user nova-compute[74960]: INFO nova.virt.libvirt.imagecache [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/900987749872ba3cca2aaec0ad1ec322ab474b04
Nov 03 12:52:33 user nova-compute[74960]: INFO nova.virt.libvirt.imagecache [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/95eaee271a42362ade595e1bcb5dde2063ccad30
Nov 03 12:52:33 user nova-compute[74960]: INFO nova.virt.libvirt.imagecache [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/21782977f2ca10f55b0849c8717736f9d23ded60
Nov 03 12:52:33 user nova-compute[74960]: DEBUG nova.virt.libvirt.imagecache [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Verification complete {{(pid=74960) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 03 12:52:33 user nova-compute[74960]: DEBUG nova.virt.libvirt.imagecache [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Verify swap images {{(pid=74960) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 03 12:52:33 user nova-compute[74960]: DEBUG nova.virt.libvirt.imagecache [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Verify ephemeral images {{(pid=74960) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 03 12:52:34 user nova-compute[74960]: DEBUG nova.network.neutron [req-b8c97817-0d35-4eb1-ab13-be6263b8d4bd req-9eb091bc-c2ff-490c-aef9-c249030c334e service nova] [instance: 5ede59da-37c6-4162-9e79-318f1a4a8aeb] Updated VIF entry in instance network info cache for port 9f629e06-9020-4e4b-956e-d33d9417c2a6. {{(pid=74960) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 12:52:34 user nova-compute[74960]: DEBUG nova.network.neutron [req-b8c97817-0d35-4eb1-ab13-be6263b8d4bd req-9eb091bc-c2ff-490c-aef9-c249030c334e service nova] [instance: 5ede59da-37c6-4162-9e79-318f1a4a8aeb] Updating instance_info_cache with network_info: [{"id": "9f629e06-9020-4e4b-956e-d33d9417c2a6", "address": "fa:16:3e:1e:78:99", "network": {"id": "c50fc382-c1b9-49d8-8e38-ac681cbbcffd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1465428328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "255349fa349045ad8a554d3f818cdd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f629e06-90", "ovs_interfaceid": "9f629e06-9020-4e4b-956e-d33d9417c2a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:52:34 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:52:34 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-b8c97817-0d35-4eb1-ab13-be6263b8d4bd req-9eb091bc-c2ff-490c-aef9-c249030c334e service nova] Releasing lock "refresh_cache-5ede59da-37c6-4162-9e79-318f1a4a8aeb" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:52:34 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:52:39 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:52:39 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:52:40 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-523b8a1e-a7dc-4edc-86fc-17a1b682c93a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Acquiring lock "5ede59da-37c6-4162-9e79-318f1a4a8aeb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:52:40 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-523b8a1e-a7dc-4edc-86fc-17a1b682c93a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Lock "5ede59da-37c6-4162-9e79-318f1a4a8aeb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:52:40 user nova-compute[74960]: DEBUG nova.objects.instance [None req-523b8a1e-a7dc-4edc-86fc-17a1b682c93a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Lazy-loading 'flavor' on Instance uuid 5ede59da-37c6-4162-9e79-318f1a4a8aeb {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:52:40 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-523b8a1e-a7dc-4edc-86fc-17a1b682c93a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Lock "5ede59da-37c6-4162-9e79-318f1a4a8aeb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:52:40 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-523b8a1e-a7dc-4edc-86fc-17a1b682c93a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Acquiring lock "5ede59da-37c6-4162-9e79-318f1a4a8aeb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:52:40 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-523b8a1e-a7dc-4edc-86fc-17a1b682c93a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Lock "5ede59da-37c6-4162-9e79-318f1a4a8aeb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:52:40 user nova-compute[74960]: INFO nova.compute.manager [None req-523b8a1e-a7dc-4edc-86fc-17a1b682c93a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 5ede59da-37c6-4162-9e79-318f1a4a8aeb] Attaching volume ff103612-61ef-4872-a7ab-daaee737fae2 to /dev/vdb
Nov 03 12:52:40 user nova-compute[74960]: DEBUG os_brick.utils [None req-523b8a1e-a7dc-4edc-86fc-17a1b682c93a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:52:40 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:52:40 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:52:40 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3bc7008-b71f-42e3-99fa-28be30806028]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:75b8e219756\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:52:40 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:52:40 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:52:40 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[336ee0e9-7f56-44e5-b006-2bba1a4ed800]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:52:40 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:52:40 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:52:40 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[2913da37-b465-4b2b-bffa-86e8e71e4295]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:52:40 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[98eb043c-b4d5-48d4-bcc6-443ba9cc5ead]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:52:40 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-523b8a1e-a7dc-4edc-86fc-17a1b682c93a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Running cmd (subprocess): nvme version {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:52:40 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-523b8a1e-a7dc-4edc-86fc-17a1b682c93a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] 'nvme version' failed. Not Retrying. {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 12:52:40 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.nvmeof [None req-523b8a1e-a7dc-4edc-86fc-17a1b682c93a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] nvme not present on system {{(pid=74960) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 12:52:40 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:52:40 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 12:52:40 user nova-compute[74960]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 12:52:40 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[5729a02f-5137-4101-b95f-a93d84a86639]: (4, '') {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:52:40 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-523b8a1e-a7dc-4edc-86fc-17a1b682c93a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74960) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 12:52:40 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-523b8a1e-a7dc-4edc-86fc-17a1b682c93a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74960) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 12:52:40 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-523b8a1e-a7dc-4edc-86fc-17a1b682c93a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] LIGHTOS: no hostnqn found. {{(pid=74960) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 12:52:40 user nova-compute[74960]: DEBUG os_brick.utils [None req-523b8a1e-a7dc-4edc-86fc-17a1b682c93a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:75b8e219756', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:52:40 user nova-compute[74960]: DEBUG nova.virt.block_device [None req-523b8a1e-a7dc-4edc-86fc-17a1b682c93a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 5ede59da-37c6-4162-9e79-318f1a4a8aeb] Updating existing volume attachment record: 7d19fc9d-be2c-4006-9426-665800cf2c2c {{(pid=74960) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 12:52:44 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:52:44 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:52:49 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:52:49 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:52:54 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:52:58 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-523b8a1e-a7dc-4edc-86fc-17a1b682c93a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 5ede59da-37c6-4162-9e79-318f1a4a8aeb] Calling os-brick to attach iSCSI Volume {{(pid=74960) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 12:52:58 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-523b8a1e-a7dc-4edc-86fc-17a1b682c93a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9aa420acb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ff103612-61ef-4872-a7ab-daaee737fae2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZinUBDJA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:52:58 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-523b8a1e-a7dc-4edc-86fc-17a1b682c93a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:52:58 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-523b8a1e-a7dc-4edc-86fc-17a1b682c93a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:52:58 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-523b8a1e-a7dc-4edc-86fc-17a1b682c93a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:52:58 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-523b8a1e-a7dc-4edc-86fc-17a1b682c93a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:52:58 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-523b8a1e-a7dc-4edc-86fc-17a1b682c93a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff103612-61ef-4872-a7ab-daaee737fae2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:52:58 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-523b8a1e-a7dc-4edc-86fc-17a1b682c93a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff103612-61ef-4872-a7ab-daaee737fae2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:52:58 user nova-compute[74960]: INFO os_brick.initiator.connectors.iscsi [None req-523b8a1e-a7dc-4edc-86fc-17a1b682c93a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 12:52:58 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff103612-61ef-4872-a7ab-daaee737fae2 -p 172.16.0.220:3260 {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:52:59 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff103612-61ef-4872-a7ab-daaee737fae2 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:52:59 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef3a9fd2-eb9a-484a-b453-0e0b3e237c8e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:52:59 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-523b8a1e-a7dc-4edc-86fc-17a1b682c93a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 12:52:59 user nova-compute[74960]:  {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:52:59 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff103612-61ef-4872-a7ab-daaee737fae2 -p 172.16.0.220:3260 --interface default --op new {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:52:59 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff103612-61ef-4872-a7ab-daaee737fae2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:52:59 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b1bfc57-9ceb-4b55-97f3-4440066162de]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ff103612-61ef-4872-a7ab-daaee737fae2] added\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:52:59 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-523b8a1e-a7dc-4edc-86fc-17a1b682c93a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ff103612-61ef-4872-a7ab-daaee737fae2] added
Nov 03 12:52:59 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:52:59 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff103612-61ef-4872-a7ab-daaee737fae2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:52:59 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff103612-61ef-4872-a7ab-daaee737fae2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:52:59 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[be03c275-0821-4d78-8835-4ac8a5351a5a]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:52:59 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-523b8a1e-a7dc-4edc-86fc-17a1b682c93a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:52:59 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff103612-61ef-4872-a7ab-daaee737fae2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:52:59 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff103612-61ef-4872-a7ab-daaee737fae2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:52:59 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9e6c00f-64f3-45d0-a2c2-2fb7b038130b]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:52:59 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-523b8a1e-a7dc-4edc-86fc-17a1b682c93a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:52:59 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff103612-61ef-4872-a7ab-daaee737fae2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZinUBDJA {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:52:59 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff103612-61ef-4872-a7ab-daaee737fae2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZinUBDJA" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:52:59 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[22594a82-26cc-4d3d-ac5d-ba5e1683b598]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:52:59 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-523b8a1e-a7dc-4edc-86fc-17a1b682c93a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZinUBDJA'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:52:59 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff103612-61ef-4872-a7ab-daaee737fae2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:52:59 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff103612-61ef-4872-a7ab-daaee737fae2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:52:59 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[b14b89f0-3ead-4a44-aaef-85ff863a14f2]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:52:59 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-523b8a1e-a7dc-4edc-86fc-17a1b682c93a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:52:59 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:52:59 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:52:59 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[6366c2b1-52d5-4a4c-8c3f-ee2992a09cd7]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:52:59 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-523b8a1e-a7dc-4edc-86fc-17a1b682c93a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 03 12:52:59 user nova-compute[74960]:  {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:52:59 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-523b8a1e-a7dc-4edc-86fc-17a1b682c93a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 03 12:52:59 user nova-compute[74960]:  {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:52:59 user nova-compute[74960]: WARNING os_brick.initiator.connectors.iscsi [None req-523b8a1e-a7dc-4edc-86fc-17a1b682c93a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 03 12:52:59 user nova-compute[74960]: 
Nov 03 12:52:59 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff103612-61ef-4872-a7ab-daaee737fae2 -p 172.16.0.220:3260 --login {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:52:59 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:52:59 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff103612-61ef-4872-a7ab-daaee737fae2 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:52:59 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[e301a6de-d988-4c40-957d-7e6e9ef33c4c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ff103612-61ef-4872-a7ab-daaee737fae2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ff103612-61ef-4872-a7ab-daaee737fae2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:52:59 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-523b8a1e-a7dc-4edc-86fc-17a1b682c93a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ff103612-61ef-4872-a7ab-daaee737fae2, portal: 172.16.0.220,3260]
Nov 03 12:52:59 user nova-compute[74960]: Login to [iface: default, target: iqn.2010-10.org.openstack:ff103612-61ef-4872-a7ab-daaee737fae2, portal: 172.16.0.220,3260] successful.
Nov 03 12:52:59 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:52:59 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff103612-61ef-4872-a7ab-daaee737fae2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:52:59 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff103612-61ef-4872-a7ab-daaee737fae2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:52:59 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2e92f44-4f84-4189-8d4b-334bff0bfc65]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:52:59 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-523b8a1e-a7dc-4edc-86fc-17a1b682c93a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:52:59 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:52:59 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:52:59 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[ede9412f-1f4c-4728-9931-ce9db43db99a]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff103612-61ef-4872-a7ab-daaee737fae2 (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:52:59 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-523b8a1e-a7dc-4edc-86fc-17a1b682c93a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff103612-61ef-4872-a7ab-daaee737fae2 (non-flash)
Nov 03 12:52:59 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:52:59 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-523b8a1e-a7dc-4edc-86fc-17a1b682c93a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff103612-61ef-4872-a7ab-daaee737fae2 (non-flash)
Nov 03 12:52:59 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:52:59 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-523b8a1e-a7dc-4edc-86fc-17a1b682c93a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff103612-61ef-4872-a7ab-daaee737fae2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.236s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:52:59 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-523b8a1e-a7dc-4edc-86fc-17a1b682c93a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Connected to 172.16.0.220:3260 {{(pid=74960) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 12:52:59 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-523b8a1e-a7dc-4edc-86fc-17a1b682c93a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] HCTL ('33', '-', '-', 0) found on session 44 with lun 0 {{(pid=74960) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 12:52:59 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-523b8a1e-a7dc-4edc-86fc-17a1b682c93a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74960) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 12:52:59 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:52:59 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:52:59 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbe73b30-a8fe-4ec8-9c31-69343e24ab23]: (4, ('- - 0', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:52:59 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-523b8a1e-a7dc-4edc-86fc-17a1b682c93a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74960) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 12:52:59 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-523b8a1e-a7dc-4edc-86fc-17a1b682c93a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ff103612-61ef-4872-a7ab-daaee737fae2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZinUBDJA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74960) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 12:53:00 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-523b8a1e-a7dc-4edc-86fc-17a1b682c93a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.265s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:53:00 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-523b8a1e-a7dc-4edc-86fc-17a1b682c93a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] <== connect_volume: return (1267ms) {'type': 'block', 'scsi_wwn': '23862393464333735', 'path': '/dev/sdb'} {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:53:00 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-523b8a1e-a7dc-4edc-86fc-17a1b682c93a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 5ede59da-37c6-4162-9e79-318f1a4a8aeb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23862393464333735', 'path': '/dev/sdb'} {{(pid=74960) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 12:53:00 user nova-compute[74960]: DEBUG nova.objects.instance [None req-523b8a1e-a7dc-4edc-86fc-17a1b682c93a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Lazy-loading 'flavor' on Instance uuid 5ede59da-37c6-4162-9e79-318f1a4a8aeb {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:53:00 user nova-compute[74960]: DEBUG nova.virt.libvirt.guest [None req-523b8a1e-a7dc-4edc-86fc-17a1b682c93a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] attach device xml: <disk type="block" device="disk">
Nov 03 12:53:00 user nova-compute[74960]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 12:53:00 user nova-compute[74960]:   <source dev="/dev/sdb"/>
Nov 03 12:53:00 user nova-compute[74960]:   <target dev="vdb" bus="virtio"/>
Nov 03 12:53:00 user nova-compute[74960]:   <serial>ff103612-61ef-4872-a7ab-daaee737fae2</serial>
Nov 03 12:53:00 user nova-compute[74960]: </disk>
Nov 03 12:53:00 user nova-compute[74960]:  {{(pid=74960) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 03 12:53:00 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-523b8a1e-a7dc-4edc-86fc-17a1b682c93a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] No BDM found with device name vda, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:53:00 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-523b8a1e-a7dc-4edc-86fc-17a1b682c93a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:53:00 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-523b8a1e-a7dc-4edc-86fc-17a1b682c93a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] No VIF found with MAC fa:16:3e:1e:78:99, not building metadata {{(pid=74960) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 12:53:00 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-523b8a1e-a7dc-4edc-86fc-17a1b682c93a tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Lock "5ede59da-37c6-4162-9e79-318f1a4a8aeb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.397s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:53:02 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:53:02 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:53:04 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:53:04 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-3cca5e11-da2f-4268-b4c5-51d57b7bd4b6 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Acquiring lock "26effa86-ee05-485a-8339-e1579435da51" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:53:04 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-3cca5e11-da2f-4268-b4c5-51d57b7bd4b6 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Lock "26effa86-ee05-485a-8339-e1579435da51" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:53:04 user nova-compute[74960]: DEBUG nova.compute.manager [None req-3cca5e11-da2f-4268-b4c5-51d57b7bd4b6 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 26effa86-ee05-485a-8339-e1579435da51] Starting instance... {{(pid=74960) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 12:53:04 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-3cca5e11-da2f-4268-b4c5-51d57b7bd4b6 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:53:04 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-3cca5e11-da2f-4268-b4c5-51d57b7bd4b6 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:53:04 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-3cca5e11-da2f-4268-b4c5-51d57b7bd4b6 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74960) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 12:53:04 user nova-compute[74960]: INFO nova.compute.claims [None req-3cca5e11-da2f-4268-b4c5-51d57b7bd4b6 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 26effa86-ee05-485a-8339-e1579435da51] Claim successful on node user
Nov 03 12:53:04 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-3cca5e11-da2f-4268-b4c5-51d57b7bd4b6 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:53:04 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-3cca5e11-da2f-4268-b4c5-51d57b7bd4b6 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:53:04 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-3cca5e11-da2f-4268-b4c5-51d57b7bd4b6 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.255s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:53:04 user nova-compute[74960]: DEBUG nova.compute.manager [None req-3cca5e11-da2f-4268-b4c5-51d57b7bd4b6 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 26effa86-ee05-485a-8339-e1579435da51] Start building networks asynchronously for instance. {{(pid=74960) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 12:53:04 user nova-compute[74960]: DEBUG nova.compute.manager [None req-3cca5e11-da2f-4268-b4c5-51d57b7bd4b6 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 26effa86-ee05-485a-8339-e1579435da51] Allocating IP information in the background. {{(pid=74960) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 12:53:04 user nova-compute[74960]: DEBUG nova.network.neutron [None req-3cca5e11-da2f-4268-b4c5-51d57b7bd4b6 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 26effa86-ee05-485a-8339-e1579435da51] allocate_for_instance() {{(pid=74960) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 12:53:04 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-3cca5e11-da2f-4268-b4c5-51d57b7bd4b6 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 26effa86-ee05-485a-8339-e1579435da51] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 12:53:04 user nova-compute[74960]: DEBUG nova.compute.manager [None req-3cca5e11-da2f-4268-b4c5-51d57b7bd4b6 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 26effa86-ee05-485a-8339-e1579435da51] Start building block device mappings for instance. {{(pid=74960) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 12:53:04 user nova-compute[74960]: DEBUG nova.policy [None req-3cca5e11-da2f-4268-b4c5-51d57b7bd4b6 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c934e7c00ddd450087f904666473c0b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '255349fa349045ad8a554d3f818cdd2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74960) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 12:53:04 user nova-compute[74960]: DEBUG nova.compute.manager [None req-3cca5e11-da2f-4268-b4c5-51d57b7bd4b6 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 26effa86-ee05-485a-8339-e1579435da51] Start spawning the instance on the hypervisor. {{(pid=74960) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 12:53:04 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-3cca5e11-da2f-4268-b4c5-51d57b7bd4b6 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 26effa86-ee05-485a-8339-e1579435da51] Creating instance directory {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 12:53:04 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-3cca5e11-da2f-4268-b4c5-51d57b7bd4b6 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 26effa86-ee05-485a-8339-e1579435da51] Creating image(s)
Nov 03 12:53:04 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-3cca5e11-da2f-4268-b4c5-51d57b7bd4b6 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Acquiring lock "/opt/stack/data/nova/instances/26effa86-ee05-485a-8339-e1579435da51/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:53:04 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-3cca5e11-da2f-4268-b4c5-51d57b7bd4b6 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Lock "/opt/stack/data/nova/instances/26effa86-ee05-485a-8339-e1579435da51/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:53:04 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-3cca5e11-da2f-4268-b4c5-51d57b7bd4b6 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Lock "/opt/stack/data/nova/instances/26effa86-ee05-485a-8339-e1579435da51/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:53:04 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-3cca5e11-da2f-4268-b4c5-51d57b7bd4b6 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:53:05 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-3cca5e11-da2f-4268-b4c5-51d57b7bd4b6 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.180s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:53:05 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-3cca5e11-da2f-4268-b4c5-51d57b7bd4b6 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Acquiring lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:53:05 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-3cca5e11-da2f-4268-b4c5-51d57b7bd4b6 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:53:05 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-3cca5e11-da2f-4268-b4c5-51d57b7bd4b6 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:53:05 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-3cca5e11-da2f-4268-b4c5-51d57b7bd4b6 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.175s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:53:05 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-3cca5e11-da2f-4268-b4c5-51d57b7bd4b6 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910,backing_fmt=raw /opt/stack/data/nova/instances/26effa86-ee05-485a-8339-e1579435da51/disk 1073741824 {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:53:05 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-3cca5e11-da2f-4268-b4c5-51d57b7bd4b6 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910,backing_fmt=raw /opt/stack/data/nova/instances/26effa86-ee05-485a-8339-e1579435da51/disk 1073741824" returned: 0 in 0.050s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:53:05 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-3cca5e11-da2f-4268-b4c5-51d57b7bd4b6 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:53:05 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-3cca5e11-da2f-4268-b4c5-51d57b7bd4b6 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:53:05 user nova-compute[74960]: DEBUG nova.network.neutron [None req-3cca5e11-da2f-4268-b4c5-51d57b7bd4b6 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 26effa86-ee05-485a-8339-e1579435da51] Successfully created port: 9185fdc5-7093-4cac-b998-33f9cc958a6e {{(pid=74960) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 12:53:05 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-3cca5e11-da2f-4268-b4c5-51d57b7bd4b6 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.186s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:53:05 user nova-compute[74960]: DEBUG nova.virt.disk.api [None req-3cca5e11-da2f-4268-b4c5-51d57b7bd4b6 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Checking if we can resize image /opt/stack/data/nova/instances/26effa86-ee05-485a-8339-e1579435da51/disk. size=1073741824 {{(pid=74960) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 12:53:05 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-3cca5e11-da2f-4268-b4c5-51d57b7bd4b6 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26effa86-ee05-485a-8339-e1579435da51/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:53:05 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-3cca5e11-da2f-4268-b4c5-51d57b7bd4b6 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26effa86-ee05-485a-8339-e1579435da51/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:53:05 user nova-compute[74960]: DEBUG nova.virt.disk.api [None req-3cca5e11-da2f-4268-b4c5-51d57b7bd4b6 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Cannot resize image /opt/stack/data/nova/instances/26effa86-ee05-485a-8339-e1579435da51/disk to a smaller size. {{(pid=74960) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 12:53:05 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-3cca5e11-da2f-4268-b4c5-51d57b7bd4b6 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 26effa86-ee05-485a-8339-e1579435da51] Created local disks {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 12:53:05 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-3cca5e11-da2f-4268-b4c5-51d57b7bd4b6 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 26effa86-ee05-485a-8339-e1579435da51] Ensure instance console log exists: /opt/stack/data/nova/instances/26effa86-ee05-485a-8339-e1579435da51/console.log {{(pid=74960) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 12:53:05 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-3cca5e11-da2f-4268-b4c5-51d57b7bd4b6 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:53:05 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-3cca5e11-da2f-4268-b4c5-51d57b7bd4b6 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:53:05 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-3cca5e11-da2f-4268-b4c5-51d57b7bd4b6 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:53:06 user nova-compute[74960]: DEBUG nova.network.neutron [None req-3cca5e11-da2f-4268-b4c5-51d57b7bd4b6 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 26effa86-ee05-485a-8339-e1579435da51] Successfully updated port: 9185fdc5-7093-4cac-b998-33f9cc958a6e {{(pid=74960) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 12:53:06 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-3cca5e11-da2f-4268-b4c5-51d57b7bd4b6 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Acquiring lock "refresh_cache-26effa86-ee05-485a-8339-e1579435da51" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:53:06 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-3cca5e11-da2f-4268-b4c5-51d57b7bd4b6 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Acquired lock "refresh_cache-26effa86-ee05-485a-8339-e1579435da51" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:53:06 user nova-compute[74960]: DEBUG nova.network.neutron [None req-3cca5e11-da2f-4268-b4c5-51d57b7bd4b6 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 26effa86-ee05-485a-8339-e1579435da51] Building network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 12:53:06 user nova-compute[74960]: DEBUG nova.compute.manager [req-b957a171-a9af-494d-bf1b-353eda783c10 req-243426fa-d8f8-44c3-9b24-6c7f5733aaed service nova] [instance: 26effa86-ee05-485a-8339-e1579435da51] Received event network-changed-9185fdc5-7093-4cac-b998-33f9cc958a6e {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:53:06 user nova-compute[74960]: DEBUG nova.compute.manager [req-b957a171-a9af-494d-bf1b-353eda783c10 req-243426fa-d8f8-44c3-9b24-6c7f5733aaed service nova] [instance: 26effa86-ee05-485a-8339-e1579435da51] Refreshing instance network info cache due to event network-changed-9185fdc5-7093-4cac-b998-33f9cc958a6e. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 12:53:06 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-b957a171-a9af-494d-bf1b-353eda783c10 req-243426fa-d8f8-44c3-9b24-6c7f5733aaed service nova] Acquiring lock "refresh_cache-26effa86-ee05-485a-8339-e1579435da51" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:53:06 user nova-compute[74960]: DEBUG nova.network.neutron [None req-3cca5e11-da2f-4268-b4c5-51d57b7bd4b6 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 26effa86-ee05-485a-8339-e1579435da51] Instance cache missing network info. {{(pid=74960) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 12:53:06 user nova-compute[74960]: DEBUG nova.network.neutron [None req-3cca5e11-da2f-4268-b4c5-51d57b7bd4b6 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 26effa86-ee05-485a-8339-e1579435da51] Updating instance_info_cache with network_info: [{"id": "9185fdc5-7093-4cac-b998-33f9cc958a6e", "address": "fa:16:3e:be:49:86", "network": {"id": "c50fc382-c1b9-49d8-8e38-ac681cbbcffd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1465428328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "255349fa349045ad8a554d3f818cdd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9185fdc5-70", "ovs_interfaceid": "9185fdc5-7093-4cac-b998-33f9cc958a6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:53:06 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-3cca5e11-da2f-4268-b4c5-51d57b7bd4b6 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Releasing lock "refresh_cache-26effa86-ee05-485a-8339-e1579435da51" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:53:06 user nova-compute[74960]: DEBUG nova.compute.manager [None req-3cca5e11-da2f-4268-b4c5-51d57b7bd4b6 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 26effa86-ee05-485a-8339-e1579435da51] Instance network_info: |[{"id": "9185fdc5-7093-4cac-b998-33f9cc958a6e", "address": "fa:16:3e:be:49:86", "network": {"id": "c50fc382-c1b9-49d8-8e38-ac681cbbcffd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1465428328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "255349fa349045ad8a554d3f818cdd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9185fdc5-70", "ovs_interfaceid": "9185fdc5-7093-4cac-b998-33f9cc958a6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74960) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 12:53:06 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-b957a171-a9af-494d-bf1b-353eda783c10 req-243426fa-d8f8-44c3-9b24-6c7f5733aaed service nova] Acquired lock "refresh_cache-26effa86-ee05-485a-8339-e1579435da51" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:53:06 user nova-compute[74960]: DEBUG nova.network.neutron [req-b957a171-a9af-494d-bf1b-353eda783c10 req-243426fa-d8f8-44c3-9b24-6c7f5733aaed service nova] [instance: 26effa86-ee05-485a-8339-e1579435da51] Refreshing network info cache for port 9185fdc5-7093-4cac-b998-33f9cc958a6e {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 12:53:06 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-3cca5e11-da2f-4268-b4c5-51d57b7bd4b6 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 26effa86-ee05-485a-8339-e1579435da51] Start _get_guest_xml network_info=[{"id": "9185fdc5-7093-4cac-b998-33f9cc958a6e", "address": "fa:16:3e:be:49:86", "network": {"id": "c50fc382-c1b9-49d8-8e38-ac681cbbcffd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1465428328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "255349fa349045ad8a554d3f818cdd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9185fdc5-70", "ovs_interfaceid": "9185fdc5-7093-4cac-b998-33f9cc958a6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=549f51ba-ac69-494b-8de1-34635aa2d7cf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='63ee9c80c632442fb0379f47b784bd20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T12:13:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'image_id': '549f51ba-ac69-494b-8de1-34635aa2d7cf'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 12:53:06 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-3cca5e11-da2f-4268-b4c5-51d57b7bd4b6 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:53:06 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-3cca5e11-da2f-4268-b4c5-51d57b7bd4b6 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:53:06 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-3cca5e11-da2f-4268-b4c5-51d57b7bd4b6 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 12:53:06 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-3cca5e11-da2f-4268-b4c5-51d57b7bd4b6 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] CPU controller missing on host. {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 12:53:06 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-3cca5e11-da2f-4268-b4c5-51d57b7bd4b6 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 12:53:06 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-3cca5e11-da2f-4268-b4c5-51d57b7bd4b6 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] CPU controller found on host. {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 12:53:06 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-3cca5e11-da2f-4268-b4c5-51d57b7bd4b6 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74960) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 12:53:06 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-3cca5e11-da2f-4268-b4c5-51d57b7bd4b6 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=549f51ba-ac69-494b-8de1-34635aa2d7cf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='63ee9c80c632442fb0379f47b784bd20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T12:13:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 12:53:06 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-3cca5e11-da2f-4268-b4c5-51d57b7bd4b6 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Flavor limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 12:53:06 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-3cca5e11-da2f-4268-b4c5-51d57b7bd4b6 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Image limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 12:53:06 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-3cca5e11-da2f-4268-b4c5-51d57b7bd4b6 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Flavor pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 12:53:06 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-3cca5e11-da2f-4268-b4c5-51d57b7bd4b6 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Image pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 12:53:06 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-3cca5e11-da2f-4268-b4c5-51d57b7bd4b6 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 12:53:06 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-3cca5e11-da2f-4268-b4c5-51d57b7bd4b6 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 12:53:06 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-3cca5e11-da2f-4268-b4c5-51d57b7bd4b6 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 12:53:06 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-3cca5e11-da2f-4268-b4c5-51d57b7bd4b6 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Got 1 possible topologies {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 12:53:06 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-3cca5e11-da2f-4268-b4c5-51d57b7bd4b6 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 12:53:06 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-3cca5e11-da2f-4268-b4c5-51d57b7bd4b6 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 12:53:06 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-3cca5e11-da2f-4268-b4c5-51d57b7bd4b6 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:53:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1641673670',display_name='tempest-AttachVolumeNegativeTest-server-1641673670',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1641673670',id=45,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCkZAGtbfDPDIgrjeQ1mKxm1BYmkYKnACn28blRxCrD13wzqPb0pYP9uOiACjDEdK7OPStqKrRBghPZ/amB5D8B/0alQD1b6TLtbFlYgc1+srhLQgl7T3rh/2+A+x4kIQQ==',key_name='tempest-keypair-807986590',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='255349fa349045ad8a554d3f818cdd2e',ramdisk_id='',reservation_id='r-uv2cibeq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-787890049',owner_user_name='tempest-AttachVolumeNegativeTest-787890049-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:53:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c934e7c00ddd450087f904666473c0b4',uuid=26effa86-ee05-485a-8339-e1579435da51,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9185fdc5-7093-4cac-b998-33f9cc958a6e", "address": "fa:16:3e:be:49:86", "network": {"id": "c50fc382-c1b9-49d8-8e38-ac681cbbcffd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1465428328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "255349fa349045ad8a554d3f818cdd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9185fdc5-70", "ovs_interfaceid": "9185fdc5-7093-4cac-b998-33f9cc958a6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74960) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 12:53:06 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-3cca5e11-da2f-4268-b4c5-51d57b7bd4b6 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Converting VIF {"id": "9185fdc5-7093-4cac-b998-33f9cc958a6e", "address": "fa:16:3e:be:49:86", "network": {"id": "c50fc382-c1b9-49d8-8e38-ac681cbbcffd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1465428328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "255349fa349045ad8a554d3f818cdd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9185fdc5-70", "ovs_interfaceid": "9185fdc5-7093-4cac-b998-33f9cc958a6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:53:06 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-3cca5e11-da2f-4268-b4c5-51d57b7bd4b6 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:49:86,bridge_name='br-int',has_traffic_filtering=True,id=9185fdc5-7093-4cac-b998-33f9cc958a6e,network=Network(c50fc382-c1b9-49d8-8e38-ac681cbbcffd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9185fdc5-70') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:53:06 user nova-compute[74960]: DEBUG nova.objects.instance [None req-3cca5e11-da2f-4268-b4c5-51d57b7bd4b6 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Lazy-loading 'pci_devices' on Instance uuid 26effa86-ee05-485a-8339-e1579435da51 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:53:06 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-3cca5e11-da2f-4268-b4c5-51d57b7bd4b6 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 26effa86-ee05-485a-8339-e1579435da51] End _get_guest_xml xml=<domain type="kvm">
Nov 03 12:53:06 user nova-compute[74960]:   <uuid>26effa86-ee05-485a-8339-e1579435da51</uuid>
Nov 03 12:53:06 user nova-compute[74960]:   <name>instance-0000002d</name>
Nov 03 12:53:06 user nova-compute[74960]:   <memory>524288</memory>
Nov 03 12:53:06 user nova-compute[74960]:   <vcpu>1</vcpu>
Nov 03 12:53:06 user nova-compute[74960]:   <metadata>
Nov 03 12:53:06 user nova-compute[74960]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 12:53:06 user nova-compute[74960]:       <nova:package version="0.0.0"/>
Nov 03 12:53:06 user nova-compute[74960]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1641673670</nova:name>
Nov 03 12:53:06 user nova-compute[74960]:       <nova:creationTime>2023-11-03 12:53:06</nova:creationTime>
Nov 03 12:53:06 user nova-compute[74960]:       <nova:flavor name="m1.tiny">
Nov 03 12:53:06 user nova-compute[74960]:         <nova:memory>512</nova:memory>
Nov 03 12:53:06 user nova-compute[74960]:         <nova:disk>1</nova:disk>
Nov 03 12:53:06 user nova-compute[74960]:         <nova:swap>0</nova:swap>
Nov 03 12:53:06 user nova-compute[74960]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 12:53:06 user nova-compute[74960]:         <nova:vcpus>1</nova:vcpus>
Nov 03 12:53:06 user nova-compute[74960]:       </nova:flavor>
Nov 03 12:53:06 user nova-compute[74960]:       <nova:owner>
Nov 03 12:53:06 user nova-compute[74960]:         <nova:user uuid="c934e7c00ddd450087f904666473c0b4">tempest-AttachVolumeNegativeTest-787890049-project-member</nova:user>
Nov 03 12:53:06 user nova-compute[74960]:         <nova:project uuid="255349fa349045ad8a554d3f818cdd2e">tempest-AttachVolumeNegativeTest-787890049</nova:project>
Nov 03 12:53:06 user nova-compute[74960]:       </nova:owner>
Nov 03 12:53:06 user nova-compute[74960]:       <nova:root type="image" uuid="549f51ba-ac69-494b-8de1-34635aa2d7cf"/>
Nov 03 12:53:06 user nova-compute[74960]:       <nova:ports>
Nov 03 12:53:06 user nova-compute[74960]:         <nova:port uuid="9185fdc5-7093-4cac-b998-33f9cc958a6e">
Nov 03 12:53:06 user nova-compute[74960]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 03 12:53:06 user nova-compute[74960]:         </nova:port>
Nov 03 12:53:06 user nova-compute[74960]:       </nova:ports>
Nov 03 12:53:06 user nova-compute[74960]:     </nova:instance>
Nov 03 12:53:06 user nova-compute[74960]:   </metadata>
Nov 03 12:53:06 user nova-compute[74960]:   <sysinfo type="smbios">
Nov 03 12:53:06 user nova-compute[74960]:     <system>
Nov 03 12:53:06 user nova-compute[74960]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 12:53:06 user nova-compute[74960]:       <entry name="product">OpenStack Nova</entry>
Nov 03 12:53:06 user nova-compute[74960]:       <entry name="version">0.0.0</entry>
Nov 03 12:53:06 user nova-compute[74960]:       <entry name="serial">26effa86-ee05-485a-8339-e1579435da51</entry>
Nov 03 12:53:06 user nova-compute[74960]:       <entry name="uuid">26effa86-ee05-485a-8339-e1579435da51</entry>
Nov 03 12:53:06 user nova-compute[74960]:       <entry name="family">Virtual Machine</entry>
Nov 03 12:53:06 user nova-compute[74960]:     </system>
Nov 03 12:53:06 user nova-compute[74960]:   </sysinfo>
Nov 03 12:53:06 user nova-compute[74960]:   <os>
Nov 03 12:53:06 user nova-compute[74960]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 12:53:06 user nova-compute[74960]:     <boot dev="hd"/>
Nov 03 12:53:06 user nova-compute[74960]:     <smbios mode="sysinfo"/>
Nov 03 12:53:06 user nova-compute[74960]:   </os>
Nov 03 12:53:06 user nova-compute[74960]:   <features>
Nov 03 12:53:06 user nova-compute[74960]:     <acpi/>
Nov 03 12:53:06 user nova-compute[74960]:     <apic/>
Nov 03 12:53:06 user nova-compute[74960]:     <vmcoreinfo/>
Nov 03 12:53:06 user nova-compute[74960]:   </features>
Nov 03 12:53:06 user nova-compute[74960]:   <clock offset="utc">
Nov 03 12:53:06 user nova-compute[74960]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 12:53:06 user nova-compute[74960]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 12:53:06 user nova-compute[74960]:     <timer name="hpet" present="no"/>
Nov 03 12:53:06 user nova-compute[74960]:   </clock>
Nov 03 12:53:06 user nova-compute[74960]:   <cpu mode="custom" match="exact">
Nov 03 12:53:06 user nova-compute[74960]:     <model>Nehalem</model>
Nov 03 12:53:06 user nova-compute[74960]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 12:53:06 user nova-compute[74960]:   </cpu>
Nov 03 12:53:06 user nova-compute[74960]:   <devices>
Nov 03 12:53:06 user nova-compute[74960]:     <disk type="file" device="disk">
Nov 03 12:53:06 user nova-compute[74960]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 12:53:06 user nova-compute[74960]:       <source file="/opt/stack/data/nova/instances/26effa86-ee05-485a-8339-e1579435da51/disk"/>
Nov 03 12:53:06 user nova-compute[74960]:       <target dev="vda" bus="virtio"/>
Nov 03 12:53:06 user nova-compute[74960]:     </disk>
Nov 03 12:53:06 user nova-compute[74960]:     <interface type="ethernet">
Nov 03 12:53:06 user nova-compute[74960]:       <mac address="fa:16:3e:be:49:86"/>
Nov 03 12:53:06 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:53:06 user nova-compute[74960]:       <mtu size="1442"/>
Nov 03 12:53:06 user nova-compute[74960]:       <target dev="tap9185fdc5-70"/>
Nov 03 12:53:06 user nova-compute[74960]:     </interface>
Nov 03 12:53:06 user nova-compute[74960]:     <serial type="pty">
Nov 03 12:53:06 user nova-compute[74960]:       <log file="/opt/stack/data/nova/instances/26effa86-ee05-485a-8339-e1579435da51/console.log" append="off"/>
Nov 03 12:53:06 user nova-compute[74960]:     </serial>
Nov 03 12:53:06 user nova-compute[74960]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 12:53:06 user nova-compute[74960]:     <video>
Nov 03 12:53:06 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:53:06 user nova-compute[74960]:     </video>
Nov 03 12:53:06 user nova-compute[74960]:     <rng model="virtio">
Nov 03 12:53:06 user nova-compute[74960]:       <backend model="random">/dev/urandom</backend>
Nov 03 12:53:06 user nova-compute[74960]:     </rng>
Nov 03 12:53:06 user nova-compute[74960]:     <controller type="usb" index="0" model="none"/>
Nov 03 12:53:06 user nova-compute[74960]:     <memballoon model="virtio">
Nov 03 12:53:06 user nova-compute[74960]:       <stats period="10"/>
Nov 03 12:53:06 user nova-compute[74960]:     </memballoon>
Nov 03 12:53:06 user nova-compute[74960]:   </devices>
Nov 03 12:53:06 user nova-compute[74960]: </domain>
Nov 03 12:53:06 user nova-compute[74960]:  {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 12:53:06 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-3cca5e11-da2f-4268-b4c5-51d57b7bd4b6 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:53:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1641673670',display_name='tempest-AttachVolumeNegativeTest-server-1641673670',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1641673670',id=45,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCkZAGtbfDPDIgrjeQ1mKxm1BYmkYKnACn28blRxCrD13wzqPb0pYP9uOiACjDEdK7OPStqKrRBghPZ/amB5D8B/0alQD1b6TLtbFlYgc1+srhLQgl7T3rh/2+A+x4kIQQ==',key_name='tempest-keypair-807986590',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='255349fa349045ad8a554d3f818cdd2e',ramdisk_id='',reservation_id='r-uv2cibeq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-787890049',owner_user_name='tempest-AttachVolumeNegativeTest-787890049-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:53:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c934e7c00ddd450087f904666473c0b4',uuid=26effa86-ee05-485a-8339-e1579435da51,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9185fdc5-7093-4cac-b998-33f9cc958a6e", "address": "fa:16:3e:be:49:86", "network": {"id": "c50fc382-c1b9-49d8-8e38-ac681cbbcffd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1465428328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "255349fa349045ad8a554d3f818cdd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9185fdc5-70", "ovs_interfaceid": "9185fdc5-7093-4cac-b998-33f9cc958a6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 12:53:06 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-3cca5e11-da2f-4268-b4c5-51d57b7bd4b6 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Converting VIF {"id": "9185fdc5-7093-4cac-b998-33f9cc958a6e", "address": "fa:16:3e:be:49:86", "network": {"id": "c50fc382-c1b9-49d8-8e38-ac681cbbcffd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1465428328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "255349fa349045ad8a554d3f818cdd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9185fdc5-70", "ovs_interfaceid": "9185fdc5-7093-4cac-b998-33f9cc958a6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:53:06 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-3cca5e11-da2f-4268-b4c5-51d57b7bd4b6 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:49:86,bridge_name='br-int',has_traffic_filtering=True,id=9185fdc5-7093-4cac-b998-33f9cc958a6e,network=Network(c50fc382-c1b9-49d8-8e38-ac681cbbcffd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9185fdc5-70') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:53:06 user nova-compute[74960]: DEBUG os_vif [None req-3cca5e11-da2f-4268-b4c5-51d57b7bd4b6 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:49:86,bridge_name='br-int',has_traffic_filtering=True,id=9185fdc5-7093-4cac-b998-33f9cc958a6e,network=Network(c50fc382-c1b9-49d8-8e38-ac681cbbcffd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9185fdc5-70') {{(pid=74960) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 12:53:06 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:53:06 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:53:06 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 12:53:06 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:53:06 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '662607ea-c8c0-5f29-985b-3a3d0af6d807', '_type': 'linux-noop'}}, row=False) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:53:06 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:53:06 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:53:06 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:53:06 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9185fdc5-70, may_exist=True, interface_attrs={}) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:53:06 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9185fdc5-70, col_values=(('qos', UUID('d9ca2af1-c6d3-4d38-b6ae-eb5a8679130e')),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:53:06 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9185fdc5-70, col_values=(('external_ids', {'iface-id': '9185fdc5-7093-4cac-b998-33f9cc958a6e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:be:49:86', 'vm-uuid': '26effa86-ee05-485a-8339-e1579435da51'}),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:53:06 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:53:06 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:53:06 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:53:06 user nova-compute[74960]: INFO os_vif [None req-3cca5e11-da2f-4268-b4c5-51d57b7bd4b6 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:49:86,bridge_name='br-int',has_traffic_filtering=True,id=9185fdc5-7093-4cac-b998-33f9cc958a6e,network=Network(c50fc382-c1b9-49d8-8e38-ac681cbbcffd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9185fdc5-70')
Nov 03 12:53:07 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-3cca5e11-da2f-4268-b4c5-51d57b7bd4b6 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] No BDM found with device name vda, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:53:07 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-3cca5e11-da2f-4268-b4c5-51d57b7bd4b6 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] No VIF found with MAC fa:16:3e:be:49:86, not building metadata {{(pid=74960) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 12:53:07 user nova-compute[74960]: DEBUG nova.network.neutron [req-b957a171-a9af-494d-bf1b-353eda783c10 req-243426fa-d8f8-44c3-9b24-6c7f5733aaed service nova] [instance: 26effa86-ee05-485a-8339-e1579435da51] Updated VIF entry in instance network info cache for port 9185fdc5-7093-4cac-b998-33f9cc958a6e. {{(pid=74960) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 12:53:07 user nova-compute[74960]: DEBUG nova.network.neutron [req-b957a171-a9af-494d-bf1b-353eda783c10 req-243426fa-d8f8-44c3-9b24-6c7f5733aaed service nova] [instance: 26effa86-ee05-485a-8339-e1579435da51] Updating instance_info_cache with network_info: [{"id": "9185fdc5-7093-4cac-b998-33f9cc958a6e", "address": "fa:16:3e:be:49:86", "network": {"id": "c50fc382-c1b9-49d8-8e38-ac681cbbcffd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1465428328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "255349fa349045ad8a554d3f818cdd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9185fdc5-70", "ovs_interfaceid": "9185fdc5-7093-4cac-b998-33f9cc958a6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:53:07 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-b957a171-a9af-494d-bf1b-353eda783c10 req-243426fa-d8f8-44c3-9b24-6c7f5733aaed service nova] Releasing lock "refresh_cache-26effa86-ee05-485a-8339-e1579435da51" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:53:07 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:53:07 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:53:07 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:53:07 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:53:07 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:53:07 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Auditing locally available compute resources for user (node: user) {{(pid=74960) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 12:53:08 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:53:08 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:53:08 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:53:08 user nova-compute[74960]: DEBUG nova.compute.manager [req-fc45fe18-7bbd-4cc3-8262-5760b34eb0bc req-967145bd-41af-48bc-ac92-974139df57f0 service nova] [instance: 26effa86-ee05-485a-8339-e1579435da51] Received event network-vif-plugged-9185fdc5-7093-4cac-b998-33f9cc958a6e {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:53:08 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-fc45fe18-7bbd-4cc3-8262-5760b34eb0bc req-967145bd-41af-48bc-ac92-974139df57f0 service nova] Acquiring lock "26effa86-ee05-485a-8339-e1579435da51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:53:08 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-fc45fe18-7bbd-4cc3-8262-5760b34eb0bc req-967145bd-41af-48bc-ac92-974139df57f0 service nova] Lock "26effa86-ee05-485a-8339-e1579435da51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:53:08 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-fc45fe18-7bbd-4cc3-8262-5760b34eb0bc req-967145bd-41af-48bc-ac92-974139df57f0 service nova] Lock "26effa86-ee05-485a-8339-e1579435da51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:53:08 user nova-compute[74960]: DEBUG nova.compute.manager [req-fc45fe18-7bbd-4cc3-8262-5760b34eb0bc req-967145bd-41af-48bc-ac92-974139df57f0 service nova] [instance: 26effa86-ee05-485a-8339-e1579435da51] No waiting events found dispatching network-vif-plugged-9185fdc5-7093-4cac-b998-33f9cc958a6e {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:53:08 user nova-compute[74960]: WARNING nova.compute.manager [req-fc45fe18-7bbd-4cc3-8262-5760b34eb0bc req-967145bd-41af-48bc-ac92-974139df57f0 service nova] [instance: 26effa86-ee05-485a-8339-e1579435da51] Received unexpected event network-vif-plugged-9185fdc5-7093-4cac-b998-33f9cc958a6e for instance with vm_state building and task_state spawning.
Nov 03 12:53:08 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:53:08 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:53:08 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26effa86-ee05-485a-8339-e1579435da51/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:53:08 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26effa86-ee05-485a-8339-e1579435da51/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:53:08 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26effa86-ee05-485a-8339-e1579435da51/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:53:09 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:53:09 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26effa86-ee05-485a-8339-e1579435da51/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:53:09 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ede59da-37c6-4162-9e79-318f1a4a8aeb/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:53:09 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ede59da-37c6-4162-9e79-318f1a4a8aeb/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:53:09 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ede59da-37c6-4162-9e79-318f1a4a8aeb/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:53:09 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ede59da-37c6-4162-9e79-318f1a4a8aeb/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:53:09 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74960) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 12:53:09 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:53:09 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:53:09 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Hypervisor/Node resource view: name=user free_ram=8975MB free_disk=24.966880798339844GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74960) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 12:53:09 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:53:09 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:53:10 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 5ede59da-37c6-4162-9e79-318f1a4a8aeb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:53:10 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 26effa86-ee05-485a-8339-e1579435da51 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:53:10 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74960) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 12:53:10 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74960) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 12:53:10 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:53:10 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:53:10 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Compute_service record updated for user:user {{(pid=74960) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 12:53:10 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.376s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:53:10 user nova-compute[74960]: DEBUG nova.compute.manager [None req-3cca5e11-da2f-4268-b4c5-51d57b7bd4b6 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 26effa86-ee05-485a-8339-e1579435da51] Instance event wait completed in 0 seconds for  {{(pid=74960) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 12:53:10 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-3cca5e11-da2f-4268-b4c5-51d57b7bd4b6 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 26effa86-ee05-485a-8339-e1579435da51] Guest created on hypervisor {{(pid=74960) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 12:53:10 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: 26effa86-ee05-485a-8339-e1579435da51] Instance spawned successfully.
Nov 03 12:53:10 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-3cca5e11-da2f-4268-b4c5-51d57b7bd4b6 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 26effa86-ee05-485a-8339-e1579435da51] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 12:53:10 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-3cca5e11-da2f-4268-b4c5-51d57b7bd4b6 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 26effa86-ee05-485a-8339-e1579435da51] Found default for hw_cdrom_bus of ide {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:53:10 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-3cca5e11-da2f-4268-b4c5-51d57b7bd4b6 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 26effa86-ee05-485a-8339-e1579435da51] Found default for hw_disk_bus of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:53:10 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-3cca5e11-da2f-4268-b4c5-51d57b7bd4b6 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 26effa86-ee05-485a-8339-e1579435da51] Found default for hw_input_bus of None {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:53:10 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-3cca5e11-da2f-4268-b4c5-51d57b7bd4b6 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 26effa86-ee05-485a-8339-e1579435da51] Found default for hw_pointer_model of None {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:53:10 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-3cca5e11-da2f-4268-b4c5-51d57b7bd4b6 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 26effa86-ee05-485a-8339-e1579435da51] Found default for hw_video_model of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:53:10 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-3cca5e11-da2f-4268-b4c5-51d57b7bd4b6 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 26effa86-ee05-485a-8339-e1579435da51] Found default for hw_vif_model of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:53:10 user nova-compute[74960]: INFO nova.compute.manager [None req-3cca5e11-da2f-4268-b4c5-51d57b7bd4b6 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 26effa86-ee05-485a-8339-e1579435da51] Took 5.53 seconds to spawn the instance on the hypervisor.
Nov 03 12:53:10 user nova-compute[74960]: DEBUG nova.compute.manager [None req-3cca5e11-da2f-4268-b4c5-51d57b7bd4b6 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 26effa86-ee05-485a-8339-e1579435da51] Checking state {{(pid=74960) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 12:53:10 user nova-compute[74960]: DEBUG nova.compute.manager [req-dab8addb-8949-4bf7-8542-cc17e5c6fbed req-a25c3061-6b17-47b4-baf7-da0ec5204de4 service nova] [instance: 26effa86-ee05-485a-8339-e1579435da51] Received event network-vif-plugged-9185fdc5-7093-4cac-b998-33f9cc958a6e {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:53:10 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-dab8addb-8949-4bf7-8542-cc17e5c6fbed req-a25c3061-6b17-47b4-baf7-da0ec5204de4 service nova] Acquiring lock "26effa86-ee05-485a-8339-e1579435da51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:53:10 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-dab8addb-8949-4bf7-8542-cc17e5c6fbed req-a25c3061-6b17-47b4-baf7-da0ec5204de4 service nova] Lock "26effa86-ee05-485a-8339-e1579435da51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:53:10 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-dab8addb-8949-4bf7-8542-cc17e5c6fbed req-a25c3061-6b17-47b4-baf7-da0ec5204de4 service nova] Lock "26effa86-ee05-485a-8339-e1579435da51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:53:10 user nova-compute[74960]: DEBUG nova.compute.manager [req-dab8addb-8949-4bf7-8542-cc17e5c6fbed req-a25c3061-6b17-47b4-baf7-da0ec5204de4 service nova] [instance: 26effa86-ee05-485a-8339-e1579435da51] No waiting events found dispatching network-vif-plugged-9185fdc5-7093-4cac-b998-33f9cc958a6e {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:53:10 user nova-compute[74960]: WARNING nova.compute.manager [req-dab8addb-8949-4bf7-8542-cc17e5c6fbed req-a25c3061-6b17-47b4-baf7-da0ec5204de4 service nova] [instance: 26effa86-ee05-485a-8339-e1579435da51] Received unexpected event network-vif-plugged-9185fdc5-7093-4cac-b998-33f9cc958a6e for instance with vm_state building and task_state spawning.
Nov 03 12:53:10 user nova-compute[74960]: INFO nova.compute.manager [None req-3cca5e11-da2f-4268-b4c5-51d57b7bd4b6 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 26effa86-ee05-485a-8339-e1579435da51] Took 6.11 seconds to build instance.
Nov 03 12:53:10 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-3cca5e11-da2f-4268-b4c5-51d57b7bd4b6 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Lock "26effa86-ee05-485a-8339-e1579435da51" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.201s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:53:11 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:53:13 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:53:13 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:53:13 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:53:13 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:53:14 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:53:14 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:53:14 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74960) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 12:53:15 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:53:15 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Starting heal instance info cache {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 12:53:15 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Rebuilding the list of instances to heal {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 03 12:53:15 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "refresh_cache-5ede59da-37c6-4162-9e79-318f1a4a8aeb" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:53:15 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquired lock "refresh_cache-5ede59da-37c6-4162-9e79-318f1a4a8aeb" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:53:15 user nova-compute[74960]: DEBUG nova.network.neutron [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: 5ede59da-37c6-4162-9e79-318f1a4a8aeb] Forcefully refreshing network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 12:53:15 user nova-compute[74960]: DEBUG nova.objects.instance [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lazy-loading 'info_cache' on Instance uuid 5ede59da-37c6-4162-9e79-318f1a4a8aeb {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:53:15 user nova-compute[74960]: DEBUG nova.network.neutron [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: 5ede59da-37c6-4162-9e79-318f1a4a8aeb] Updating instance_info_cache with network_info: [{"id": "9f629e06-9020-4e4b-956e-d33d9417c2a6", "address": "fa:16:3e:1e:78:99", "network": {"id": "c50fc382-c1b9-49d8-8e38-ac681cbbcffd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1465428328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "255349fa349045ad8a554d3f818cdd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f629e06-90", "ovs_interfaceid": "9f629e06-9020-4e4b-956e-d33d9417c2a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:53:15 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Releasing lock "refresh_cache-5ede59da-37c6-4162-9e79-318f1a4a8aeb" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:53:15 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: 5ede59da-37c6-4162-9e79-318f1a4a8aeb] Updated the network info_cache for instance {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 12:53:16 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:53:16 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:53:16 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=74960) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 12:53:16 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74960) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 12:53:16 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74960) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 12:53:16 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:53:19 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:53:19 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Cleaning up deleted instances {{(pid=74960) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 03 12:53:19 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] There are 0 instances to clean {{(pid=74960) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 03 12:53:21 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:53:21 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:53:21 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74960) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 12:53:21 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74960) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 12:53:21 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74960) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 12:53:21 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:53:23 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:53:23 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Cleaning up deleted instances with incomplete migration  {{(pid=74960) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 03 12:53:25 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:53:26 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:53:29 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:53:31 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:53:34 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:53:36 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:53:39 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:53:41 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:53:42 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Acquiring lock "69d4b583-82eb-4c2f-ad42-f0028d04f6a6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:53:42 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lock "69d4b583-82eb-4c2f-ad42-f0028d04f6a6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:53:42 user nova-compute[74960]: DEBUG nova.compute.manager [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 69d4b583-82eb-4c2f-ad42-f0028d04f6a6] Starting instance... {{(pid=74960) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 12:53:42 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:53:42 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:53:42 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74960) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 12:53:42 user nova-compute[74960]: INFO nova.compute.claims [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 69d4b583-82eb-4c2f-ad42-f0028d04f6a6] Claim successful on node user
Nov 03 12:53:42 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Refreshing inventories for resource provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 03 12:53:42 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Updating ProviderTree inventory for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 03 12:53:42 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Updating inventory in ProviderTree for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 03 12:53:42 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Refreshing aggregate associations for resource provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0, aggregates: None {{(pid=74960) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 03 12:53:42 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Refreshing trait associations for resource provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0, traits: COMPUTE_NODE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE41,HW_CPU_X86_SSSE3,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_DEVICE_TAGGING,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_QXL {{(pid=74960) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 03 12:53:43 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:53:43 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:53:43 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.550s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:53:43 user nova-compute[74960]: DEBUG nova.compute.manager [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 69d4b583-82eb-4c2f-ad42-f0028d04f6a6] Start building networks asynchronously for instance. {{(pid=74960) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 12:53:43 user nova-compute[74960]: DEBUG nova.compute.manager [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 69d4b583-82eb-4c2f-ad42-f0028d04f6a6] Allocating IP information in the background. {{(pid=74960) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 12:53:43 user nova-compute[74960]: DEBUG nova.network.neutron [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 69d4b583-82eb-4c2f-ad42-f0028d04f6a6] allocate_for_instance() {{(pid=74960) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 12:53:43 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 69d4b583-82eb-4c2f-ad42-f0028d04f6a6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 12:53:43 user nova-compute[74960]: DEBUG nova.compute.manager [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 69d4b583-82eb-4c2f-ad42-f0028d04f6a6] Start building block device mappings for instance. {{(pid=74960) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 12:53:43 user nova-compute[74960]: DEBUG nova.policy [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '067a3f33438b4112b818b91ecb4dd0d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd64f3d9dae8f45bcb2e0677a0076ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74960) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 12:53:43 user nova-compute[74960]: INFO nova.virt.block_device [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 69d4b583-82eb-4c2f-ad42-f0028d04f6a6] Booting with volume f84524e4-0a06-482a-8b65-afd5dccfd016 at /dev/vda
Nov 03 12:53:43 user nova-compute[74960]: DEBUG os_brick.utils [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:53:43 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:53:43 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:53:43 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa345e75-33b2-4f95-a6ec-076bf5ea46be]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:75b8e219756\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:53:43 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:53:43 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:53:43 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fff1d43-04d1-467c-bfee-5ea0c02119c2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:53:43 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:53:43 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:53:43 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c986839-dbf9-40c2-8118-402ff1fc8230]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:53:43 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6b81e40-3155-4200-aa77-255a6ad27ca5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:53:43 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Running cmd (subprocess): nvme version {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:53:43 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] 'nvme version' failed. Not Retrying. {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 12:53:43 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] nvme not present on system {{(pid=74960) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 12:53:43 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:53:43 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 12:53:43 user nova-compute[74960]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 12:53:43 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[6713bb38-ebba-4fe8-9bfe-0d90d1bec5fa]: (4, '') {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:53:43 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74960) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 12:53:43 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74960) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 12:53:43 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] LIGHTOS: no hostnqn found. {{(pid=74960) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 12:53:43 user nova-compute[74960]: DEBUG os_brick.utils [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:75b8e219756', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:53:43 user nova-compute[74960]: DEBUG nova.virt.block_device [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 69d4b583-82eb-4c2f-ad42-f0028d04f6a6] Updating existing volume attachment record: eae0e4fc-4ec4-48c9-94bb-ccae29009e14 {{(pid=74960) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 12:53:43 user nova-compute[74960]: DEBUG nova.network.neutron [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 69d4b583-82eb-4c2f-ad42-f0028d04f6a6] Successfully created port: 41b38ec9-5f6b-4451-83c6-1944cd2b80b5 {{(pid=74960) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 12:53:44 user nova-compute[74960]: DEBUG nova.network.neutron [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 69d4b583-82eb-4c2f-ad42-f0028d04f6a6] Successfully updated port: 41b38ec9-5f6b-4451-83c6-1944cd2b80b5 {{(pid=74960) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 12:53:44 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Acquiring lock "refresh_cache-69d4b583-82eb-4c2f-ad42-f0028d04f6a6" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:53:44 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Acquired lock "refresh_cache-69d4b583-82eb-4c2f-ad42-f0028d04f6a6" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:53:44 user nova-compute[74960]: DEBUG nova.network.neutron [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 69d4b583-82eb-4c2f-ad42-f0028d04f6a6] Building network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 12:53:44 user nova-compute[74960]: DEBUG nova.compute.manager [req-5a0c7d7f-1357-418c-bd61-99ad93d7e811 req-a7ee0cd1-408d-411d-b275-be509e203f9f service nova] [instance: 69d4b583-82eb-4c2f-ad42-f0028d04f6a6] Received event network-changed-41b38ec9-5f6b-4451-83c6-1944cd2b80b5 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:53:44 user nova-compute[74960]: DEBUG nova.compute.manager [req-5a0c7d7f-1357-418c-bd61-99ad93d7e811 req-a7ee0cd1-408d-411d-b275-be509e203f9f service nova] [instance: 69d4b583-82eb-4c2f-ad42-f0028d04f6a6] Refreshing instance network info cache due to event network-changed-41b38ec9-5f6b-4451-83c6-1944cd2b80b5. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 12:53:44 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-5a0c7d7f-1357-418c-bd61-99ad93d7e811 req-a7ee0cd1-408d-411d-b275-be509e203f9f service nova] Acquiring lock "refresh_cache-69d4b583-82eb-4c2f-ad42-f0028d04f6a6" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:53:44 user nova-compute[74960]: DEBUG nova.network.neutron [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 69d4b583-82eb-4c2f-ad42-f0028d04f6a6] Instance cache missing network info. {{(pid=74960) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 12:53:44 user nova-compute[74960]: DEBUG nova.network.neutron [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 69d4b583-82eb-4c2f-ad42-f0028d04f6a6] Updating instance_info_cache with network_info: [{"id": "41b38ec9-5f6b-4451-83c6-1944cd2b80b5", "address": "fa:16:3e:5d:2f:62", "network": {"id": "8e985ab3-9852-4f07-8b5c-19f7bf113939", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781795302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d64f3d9dae8f45bcb2e0677a0076ed64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41b38ec9-5f", "ovs_interfaceid": "41b38ec9-5f6b-4451-83c6-1944cd2b80b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:53:44 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Releasing lock "refresh_cache-69d4b583-82eb-4c2f-ad42-f0028d04f6a6" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:53:44 user nova-compute[74960]: DEBUG nova.compute.manager [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 69d4b583-82eb-4c2f-ad42-f0028d04f6a6] Instance network_info: |[{"id": "41b38ec9-5f6b-4451-83c6-1944cd2b80b5", "address": "fa:16:3e:5d:2f:62", "network": {"id": "8e985ab3-9852-4f07-8b5c-19f7bf113939", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781795302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d64f3d9dae8f45bcb2e0677a0076ed64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41b38ec9-5f", "ovs_interfaceid": "41b38ec9-5f6b-4451-83c6-1944cd2b80b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74960) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 12:53:44 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-5a0c7d7f-1357-418c-bd61-99ad93d7e811 req-a7ee0cd1-408d-411d-b275-be509e203f9f service nova] Acquired lock "refresh_cache-69d4b583-82eb-4c2f-ad42-f0028d04f6a6" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:53:44 user nova-compute[74960]: DEBUG nova.network.neutron [req-5a0c7d7f-1357-418c-bd61-99ad93d7e811 req-a7ee0cd1-408d-411d-b275-be509e203f9f service nova] [instance: 69d4b583-82eb-4c2f-ad42-f0028d04f6a6] Refreshing network info cache for port 41b38ec9-5f6b-4451-83c6-1944cd2b80b5 {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 12:53:45 user nova-compute[74960]: DEBUG nova.network.neutron [req-5a0c7d7f-1357-418c-bd61-99ad93d7e811 req-a7ee0cd1-408d-411d-b275-be509e203f9f service nova] [instance: 69d4b583-82eb-4c2f-ad42-f0028d04f6a6] Updated VIF entry in instance network info cache for port 41b38ec9-5f6b-4451-83c6-1944cd2b80b5. {{(pid=74960) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 12:53:45 user nova-compute[74960]: DEBUG nova.network.neutron [req-5a0c7d7f-1357-418c-bd61-99ad93d7e811 req-a7ee0cd1-408d-411d-b275-be509e203f9f service nova] [instance: 69d4b583-82eb-4c2f-ad42-f0028d04f6a6] Updating instance_info_cache with network_info: [{"id": "41b38ec9-5f6b-4451-83c6-1944cd2b80b5", "address": "fa:16:3e:5d:2f:62", "network": {"id": "8e985ab3-9852-4f07-8b5c-19f7bf113939", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781795302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d64f3d9dae8f45bcb2e0677a0076ed64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41b38ec9-5f", "ovs_interfaceid": "41b38ec9-5f6b-4451-83c6-1944cd2b80b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:53:45 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-5a0c7d7f-1357-418c-bd61-99ad93d7e811 req-a7ee0cd1-408d-411d-b275-be509e203f9f service nova] Releasing lock "refresh_cache-69d4b583-82eb-4c2f-ad42-f0028d04f6a6" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:53:46 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._sync_power_states {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:53:46 user nova-compute[74960]: WARNING nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] While synchronizing instance power states, found 3 instances in the database and 2 instances on the hypervisor.
Nov 03 12:53:46 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Triggering sync for uuid 5ede59da-37c6-4162-9e79-318f1a4a8aeb {{(pid=74960) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 12:53:46 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Triggering sync for uuid 26effa86-ee05-485a-8339-e1579435da51 {{(pid=74960) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 12:53:46 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Triggering sync for uuid 69d4b583-82eb-4c2f-ad42-f0028d04f6a6 {{(pid=74960) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 12:53:46 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "5ede59da-37c6-4162-9e79-318f1a4a8aeb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:53:46 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "5ede59da-37c6-4162-9e79-318f1a4a8aeb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:53:46 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "26effa86-ee05-485a-8339-e1579435da51" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:53:46 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "26effa86-ee05-485a-8339-e1579435da51" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:53:46 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "69d4b583-82eb-4c2f-ad42-f0028d04f6a6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:53:46 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "26effa86-ee05-485a-8339-e1579435da51" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:53:46 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "5ede59da-37c6-4162-9e79-318f1a4a8aeb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.037s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:53:46 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:53:51 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:53:56 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:53:56 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:53:56 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74960) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 12:53:56 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74960) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 12:53:56 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74960) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 12:53:56 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:54:01 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:54:02 user nova-compute[74960]: DEBUG nova.compute.manager [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 69d4b583-82eb-4c2f-ad42-f0028d04f6a6] Start spawning the instance on the hypervisor. {{(pid=74960) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 12:54:02 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 69d4b583-82eb-4c2f-ad42-f0028d04f6a6] Creating instance directory {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 12:54:02 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 69d4b583-82eb-4c2f-ad42-f0028d04f6a6] Creating image(s)
Nov 03 12:54:02 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 69d4b583-82eb-4c2f-ad42-f0028d04f6a6] Did not create local disks {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 03 12:54:02 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 69d4b583-82eb-4c2f-ad42-f0028d04f6a6] Ensure instance console log exists: /opt/stack/data/nova/instances/69d4b583-82eb-4c2f-ad42-f0028d04f6a6/console.log {{(pid=74960) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 12:54:02 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:54:02 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:54:02 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:54:02 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 69d4b583-82eb-4c2f-ad42-f0028d04f6a6] Start _get_guest_xml network_info=[{"id": "41b38ec9-5f6b-4451-83c6-1944cd2b80b5", "address": "fa:16:3e:5d:2f:62", "network": {"id": "8e985ab3-9852-4f07-8b5c-19f7bf113939", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781795302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d64f3d9dae8f45bcb2e0677a0076ed64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41b38ec9-5f", "ovs_interfaceid": "41b38ec9-5f6b-4451-83c6-1944cd2b80b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f84524e4-0a06-482a-8b65-afd5dccfd016', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EFiySMGT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '69d4b583-82eb-4c2f-ad42-f0028d04f6a6', 'attached_at': '', 'detached_at': '', 'volume_id': 'f84524e4-0a06-482a-8b65-afd5dccfd016', 'serial': 'f84524e4-0a06-482a-8b65-afd5dccfd016'}, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'device_type': 'disk', 'attachment_id': 'eae0e4fc-4ec4-48c9-94bb-ccae29009e14', 'boot_index': 0, 'guest_format': None, 'volume_type': None} {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 12:54:02 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:54:02 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:54:02 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 12:54:02 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] CPU controller missing on host. {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 12:54:02 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 12:54:02 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] CPU controller found on host. {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 12:54:02 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74960) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 12:54:02 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 12:54:02 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Flavor limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 12:54:02 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Image limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 12:54:02 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Flavor pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 12:54:02 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Image pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 12:54:02 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 12:54:02 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 12:54:02 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 12:54:02 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Got 1 possible topologies {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 12:54:02 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 12:54:02 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 12:54:02 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 69d4b583-82eb-4c2f-ad42-f0028d04f6a6] Calling os-brick to attach iSCSI Volume {{(pid=74960) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 12:54:02 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9aa420acb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f84524e4-0a06-482a-8b65-afd5dccfd016', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EFiySMGT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:54:02 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:54:02 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:54:02 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:54:02 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:54:02 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f84524e4-0a06-482a-8b65-afd5dccfd016" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:54:02 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f84524e4-0a06-482a-8b65-afd5dccfd016" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:54:02 user nova-compute[74960]: INFO os_brick.initiator.connectors.iscsi [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 12:54:02 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f84524e4-0a06-482a-8b65-afd5dccfd016 -p 172.16.0.220:3260 {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:54:02 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f84524e4-0a06-482a-8b65-afd5dccfd016 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:54:02 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[68c97a78-6d1f-40ab-a422-940eee466a5b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:54:02 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 12:54:02 user nova-compute[74960]:  {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:54:02 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f84524e4-0a06-482a-8b65-afd5dccfd016 -p 172.16.0.220:3260 --interface default --op new {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:54:02 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f84524e4-0a06-482a-8b65-afd5dccfd016 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:54:02 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[41491dfd-c2a1-4332-9f72-af7f67f4d65e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f84524e4-0a06-482a-8b65-afd5dccfd016] added\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:54:02 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f84524e4-0a06-482a-8b65-afd5dccfd016] added
Nov 03 12:54:02 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:54:02 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f84524e4-0a06-482a-8b65-afd5dccfd016 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:54:02 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f84524e4-0a06-482a-8b65-afd5dccfd016 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:54:02 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[2292c72c-2a71-46e6-bccf-5519d832012a]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:54:02 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:54:02 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f84524e4-0a06-482a-8b65-afd5dccfd016 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:54:02 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f84524e4-0a06-482a-8b65-afd5dccfd016 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:54:02 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[075fc0e5-af4c-4935-ae50-c56dae279e40]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:54:02 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:54:02 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f84524e4-0a06-482a-8b65-afd5dccfd016 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EFiySMGT {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:54:02 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f84524e4-0a06-482a-8b65-afd5dccfd016 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EFiySMGT" returned: 0 in 0.202s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:54:02 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[376fe30c-3957-463c-91dc-dc5885af44ef]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:54:02 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EFiySMGT'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:54:02 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f84524e4-0a06-482a-8b65-afd5dccfd016 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:54:02 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f84524e4-0a06-482a-8b65-afd5dccfd016 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:54:02 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecdddc58-6f62-4fd2-bd8b-3978a99940c2]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:54:02 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:54:02 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:54:02 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:54:02 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[523d1fca-c5f6-4e77-a450-23d9b3962ac1]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff103612-61ef-4872-a7ab-daaee737fae2 (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:54:02 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff103612-61ef-4872-a7ab-daaee737fae2 (non-flash)
Nov 03 12:54:02 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:54:02 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff103612-61ef-4872-a7ab-daaee737fae2 (non-flash)
Nov 03 12:54:02 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:54:02 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f84524e4-0a06-482a-8b65-afd5dccfd016 -p 172.16.0.220:3260 --login {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:54:02 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f84524e4-0a06-482a-8b65-afd5dccfd016 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:54:02 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[28489308-2e2f-4a95-9792-bd6623c1dd96]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f84524e4-0a06-482a-8b65-afd5dccfd016, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f84524e4-0a06-482a-8b65-afd5dccfd016, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:54:02 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f84524e4-0a06-482a-8b65-afd5dccfd016, portal: 172.16.0.220,3260]
Nov 03 12:54:02 user nova-compute[74960]: Login to [iface: default, target: iqn.2010-10.org.openstack:f84524e4-0a06-482a-8b65-afd5dccfd016, portal: 172.16.0.220,3260] successful.
Nov 03 12:54:02 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:54:02 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f84524e4-0a06-482a-8b65-afd5dccfd016 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:54:02 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f84524e4-0a06-482a-8b65-afd5dccfd016 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:54:02 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[15858bd1-af0e-45e1-93fe-3fe6721e94b8]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:54:02 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:54:02 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:54:02 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:54:02 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eabe6b4-e705-4f83-a170-39b80c0bfab6]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff103612-61ef-4872-a7ab-daaee737fae2 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84524e4-0a06-482a-8b65-afd5dccfd016 (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:54:02 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff103612-61ef-4872-a7ab-daaee737fae2 (non-flash)
Nov 03 12:54:02 user nova-compute[74960]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84524e4-0a06-482a-8b65-afd5dccfd016 (non-flash)
Nov 03 12:54:02 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:54:02 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff103612-61ef-4872-a7ab-daaee737fae2 (non-flash)
Nov 03 12:54:02 user nova-compute[74960]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84524e4-0a06-482a-8b65-afd5dccfd016 (non-flash)
Nov 03 12:54:02 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:54:02 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f84524e4-0a06-482a-8b65-afd5dccfd016" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.439s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:54:02 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Connected to 172.16.0.220:3260 {{(pid=74960) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 12:54:02 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] HCTL ('34', '-', '-', 0) found on session 45 with lun 0 {{(pid=74960) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 12:54:02 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74960) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 12:54:02 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:54:02 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:54:02 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd44673d-e83c-4590-ba49-db5559f8b52e]: (4, ('- - 0', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:54:02 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Searching for a device in session 45 and hctl ['34', '*', '*', 0] yield: None {{(pid=74960) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 12:54:03 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Searching for a device in session 45 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74960) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 12:54:03 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:f84524e4-0a06-482a-8b65-afd5dccfd016', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EFiySMGT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74960) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 12:54:03 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.469s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:54:03 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] <== connect_volume: return (1471ms) {'type': 'block', 'scsi_wwn': '23031356132343465', 'path': '/dev/sdc'} {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:54:03 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 69d4b583-82eb-4c2f-ad42-f0028d04f6a6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23031356132343465', 'path': '/dev/sdc'} {{(pid=74960) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 12:54:03 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:53:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1907471302',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1907471302',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1907471302',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHNIvMowv4N5Hr7boLFUJWG09vM5BWpS0/8i3NAupRbpEzNR1AD2rqndAddLLOm90KgfA15HExh0dn+Huen2oFlm7l/34LDy6nf98FMRsW4SztCoGbdEriXg3pbspyj/Yw==',key_name='tempest-keypair-1847594103',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d64f3d9dae8f45bcb2e0677a0076ed64',ramdisk_id='',reservation_id='r-hj0yqfz2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1795947051',owner_user_name='tempest-TestVolumeBootPattern-1795947051-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:53:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='067a3f33438b4112b818b91ecb4dd0d2',uuid=69d4b583-82eb-4c2f-ad42-f0028d04f6a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "41b38ec9-5f6b-4451-83c6-1944cd2b80b5", "address": "fa:16:3e:5d:2f:62", "network": {"id": "8e985ab3-9852-4f07-8b5c-19f7bf113939", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781795302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d64f3d9dae8f45bcb2e0677a0076ed64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41b38ec9-5f", "ovs_interfaceid": "41b38ec9-5f6b-4451-83c6-1944cd2b80b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74960) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 12:54:03 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Converting VIF {"id": "41b38ec9-5f6b-4451-83c6-1944cd2b80b5", "address": "fa:16:3e:5d:2f:62", "network": {"id": "8e985ab3-9852-4f07-8b5c-19f7bf113939", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781795302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d64f3d9dae8f45bcb2e0677a0076ed64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41b38ec9-5f", "ovs_interfaceid": "41b38ec9-5f6b-4451-83c6-1944cd2b80b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:54:03 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:2f:62,bridge_name='br-int',has_traffic_filtering=True,id=41b38ec9-5f6b-4451-83c6-1944cd2b80b5,network=Network(8e985ab3-9852-4f07-8b5c-19f7bf113939),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41b38ec9-5f') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:54:03 user nova-compute[74960]: DEBUG nova.objects.instance [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lazy-loading 'pci_devices' on Instance uuid 69d4b583-82eb-4c2f-ad42-f0028d04f6a6 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:54:03 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 69d4b583-82eb-4c2f-ad42-f0028d04f6a6] End _get_guest_xml xml=<domain type="kvm">
Nov 03 12:54:03 user nova-compute[74960]:   <uuid>69d4b583-82eb-4c2f-ad42-f0028d04f6a6</uuid>
Nov 03 12:54:03 user nova-compute[74960]:   <name>instance-0000002e</name>
Nov 03 12:54:03 user nova-compute[74960]:   <memory>524288</memory>
Nov 03 12:54:03 user nova-compute[74960]:   <vcpu>1</vcpu>
Nov 03 12:54:03 user nova-compute[74960]:   <metadata>
Nov 03 12:54:03 user nova-compute[74960]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 12:54:03 user nova-compute[74960]:       <nova:package version="0.0.0"/>
Nov 03 12:54:03 user nova-compute[74960]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1907471302</nova:name>
Nov 03 12:54:03 user nova-compute[74960]:       <nova:creationTime>2023-11-03 12:54:02</nova:creationTime>
Nov 03 12:54:03 user nova-compute[74960]:       <nova:flavor name="m1.tiny">
Nov 03 12:54:03 user nova-compute[74960]:         <nova:memory>512</nova:memory>
Nov 03 12:54:03 user nova-compute[74960]:         <nova:disk>1</nova:disk>
Nov 03 12:54:03 user nova-compute[74960]:         <nova:swap>0</nova:swap>
Nov 03 12:54:03 user nova-compute[74960]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 12:54:03 user nova-compute[74960]:         <nova:vcpus>1</nova:vcpus>
Nov 03 12:54:03 user nova-compute[74960]:       </nova:flavor>
Nov 03 12:54:03 user nova-compute[74960]:       <nova:owner>
Nov 03 12:54:03 user nova-compute[74960]:         <nova:user uuid="067a3f33438b4112b818b91ecb4dd0d2">tempest-TestVolumeBootPattern-1795947051-project-member</nova:user>
Nov 03 12:54:03 user nova-compute[74960]:         <nova:project uuid="d64f3d9dae8f45bcb2e0677a0076ed64">tempest-TestVolumeBootPattern-1795947051</nova:project>
Nov 03 12:54:03 user nova-compute[74960]:       </nova:owner>
Nov 03 12:54:03 user nova-compute[74960]:       <nova:ports>
Nov 03 12:54:03 user nova-compute[74960]:         <nova:port uuid="41b38ec9-5f6b-4451-83c6-1944cd2b80b5">
Nov 03 12:54:03 user nova-compute[74960]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 03 12:54:03 user nova-compute[74960]:         </nova:port>
Nov 03 12:54:03 user nova-compute[74960]:       </nova:ports>
Nov 03 12:54:03 user nova-compute[74960]:     </nova:instance>
Nov 03 12:54:03 user nova-compute[74960]:   </metadata>
Nov 03 12:54:03 user nova-compute[74960]:   <sysinfo type="smbios">
Nov 03 12:54:03 user nova-compute[74960]:     <system>
Nov 03 12:54:03 user nova-compute[74960]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 12:54:03 user nova-compute[74960]:       <entry name="product">OpenStack Nova</entry>
Nov 03 12:54:03 user nova-compute[74960]:       <entry name="version">0.0.0</entry>
Nov 03 12:54:03 user nova-compute[74960]:       <entry name="serial">69d4b583-82eb-4c2f-ad42-f0028d04f6a6</entry>
Nov 03 12:54:03 user nova-compute[74960]:       <entry name="uuid">69d4b583-82eb-4c2f-ad42-f0028d04f6a6</entry>
Nov 03 12:54:03 user nova-compute[74960]:       <entry name="family">Virtual Machine</entry>
Nov 03 12:54:03 user nova-compute[74960]:     </system>
Nov 03 12:54:03 user nova-compute[74960]:   </sysinfo>
Nov 03 12:54:03 user nova-compute[74960]:   <os>
Nov 03 12:54:03 user nova-compute[74960]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 12:54:03 user nova-compute[74960]:     <boot dev="hd"/>
Nov 03 12:54:03 user nova-compute[74960]:     <smbios mode="sysinfo"/>
Nov 03 12:54:03 user nova-compute[74960]:   </os>
Nov 03 12:54:03 user nova-compute[74960]:   <features>
Nov 03 12:54:03 user nova-compute[74960]:     <acpi/>
Nov 03 12:54:03 user nova-compute[74960]:     <apic/>
Nov 03 12:54:03 user nova-compute[74960]:     <vmcoreinfo/>
Nov 03 12:54:03 user nova-compute[74960]:   </features>
Nov 03 12:54:03 user nova-compute[74960]:   <clock offset="utc">
Nov 03 12:54:03 user nova-compute[74960]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 12:54:03 user nova-compute[74960]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 12:54:03 user nova-compute[74960]:     <timer name="hpet" present="no"/>
Nov 03 12:54:03 user nova-compute[74960]:   </clock>
Nov 03 12:54:03 user nova-compute[74960]:   <cpu mode="custom" match="exact">
Nov 03 12:54:03 user nova-compute[74960]:     <model>Nehalem</model>
Nov 03 12:54:03 user nova-compute[74960]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 12:54:03 user nova-compute[74960]:   </cpu>
Nov 03 12:54:03 user nova-compute[74960]:   <devices>
Nov 03 12:54:03 user nova-compute[74960]:     <disk type="block" device="disk">
Nov 03 12:54:03 user nova-compute[74960]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 12:54:03 user nova-compute[74960]:       <source dev="/dev/sdc"/>
Nov 03 12:54:03 user nova-compute[74960]:       <target dev="vda" bus="virtio"/>
Nov 03 12:54:03 user nova-compute[74960]:       <serial>f84524e4-0a06-482a-8b65-afd5dccfd016</serial>
Nov 03 12:54:03 user nova-compute[74960]:     </disk>
Nov 03 12:54:03 user nova-compute[74960]:     <interface type="ethernet">
Nov 03 12:54:03 user nova-compute[74960]:       <mac address="fa:16:3e:5d:2f:62"/>
Nov 03 12:54:03 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:54:03 user nova-compute[74960]:       <mtu size="1442"/>
Nov 03 12:54:03 user nova-compute[74960]:       <target dev="tap41b38ec9-5f"/>
Nov 03 12:54:03 user nova-compute[74960]:     </interface>
Nov 03 12:54:03 user nova-compute[74960]:     <serial type="pty">
Nov 03 12:54:03 user nova-compute[74960]:       <log file="/opt/stack/data/nova/instances/69d4b583-82eb-4c2f-ad42-f0028d04f6a6/console.log" append="off"/>
Nov 03 12:54:03 user nova-compute[74960]:     </serial>
Nov 03 12:54:03 user nova-compute[74960]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 12:54:03 user nova-compute[74960]:     <video>
Nov 03 12:54:03 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:54:03 user nova-compute[74960]:     </video>
Nov 03 12:54:03 user nova-compute[74960]:     <rng model="virtio">
Nov 03 12:54:03 user nova-compute[74960]:       <backend model="random">/dev/urandom</backend>
Nov 03 12:54:03 user nova-compute[74960]:     </rng>
Nov 03 12:54:03 user nova-compute[74960]:     <controller type="usb" index="0" model="none"/>
Nov 03 12:54:03 user nova-compute[74960]:     <memballoon model="virtio">
Nov 03 12:54:03 user nova-compute[74960]:       <stats period="10"/>
Nov 03 12:54:03 user nova-compute[74960]:     </memballoon>
Nov 03 12:54:03 user nova-compute[74960]:   </devices>
Nov 03 12:54:03 user nova-compute[74960]: </domain>
Nov 03 12:54:03 user nova-compute[74960]:  {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 12:54:03 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:53:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1907471302',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1907471302',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1907471302',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHNIvMowv4N5Hr7boLFUJWG09vM5BWpS0/8i3NAupRbpEzNR1AD2rqndAddLLOm90KgfA15HExh0dn+Huen2oFlm7l/34LDy6nf98FMRsW4SztCoGbdEriXg3pbspyj/Yw==',key_name='tempest-keypair-1847594103',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d64f3d9dae8f45bcb2e0677a0076ed64',ramdisk_id='',reservation_id='r-hj0yqfz2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1795947051',owner_user_name='tempest-TestVolumeBootPattern-1795947051-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:53:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='067a3f33438b4112b818b91ecb4dd0d2',uuid=69d4b583-82eb-4c2f-ad42-f0028d04f6a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "41b38ec9-5f6b-4451-83c6-1944cd2b80b5", "address": "fa:16:3e:5d:2f:62", "network": {"id": "8e985ab3-9852-4f07-8b5c-19f7bf113939", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781795302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d64f3d9dae8f45bcb2e0677a0076ed64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41b38ec9-5f", "ovs_interfaceid": "41b38ec9-5f6b-4451-83c6-1944cd2b80b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 12:54:03 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Converting VIF {"id": "41b38ec9-5f6b-4451-83c6-1944cd2b80b5", "address": "fa:16:3e:5d:2f:62", "network": {"id": "8e985ab3-9852-4f07-8b5c-19f7bf113939", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781795302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d64f3d9dae8f45bcb2e0677a0076ed64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41b38ec9-5f", "ovs_interfaceid": "41b38ec9-5f6b-4451-83c6-1944cd2b80b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:54:03 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:2f:62,bridge_name='br-int',has_traffic_filtering=True,id=41b38ec9-5f6b-4451-83c6-1944cd2b80b5,network=Network(8e985ab3-9852-4f07-8b5c-19f7bf113939),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41b38ec9-5f') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:54:03 user nova-compute[74960]: DEBUG os_vif [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:2f:62,bridge_name='br-int',has_traffic_filtering=True,id=41b38ec9-5f6b-4451-83c6-1944cd2b80b5,network=Network(8e985ab3-9852-4f07-8b5c-19f7bf113939),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41b38ec9-5f') {{(pid=74960) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 12:54:03 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:54:03 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:54:03 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 12:54:03 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:54:03 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd71c95ca-2d23-50af-8bbf-a3f9316a2c55', '_type': 'linux-noop'}}, row=False) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:54:03 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:54:03 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:54:03 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap41b38ec9-5f, may_exist=True, interface_attrs={}) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:54:03 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap41b38ec9-5f, col_values=(('qos', UUID('2ff8b136-d67c-4989-9c09-dc92868b6da4')),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:54:03 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap41b38ec9-5f, col_values=(('external_ids', {'iface-id': '41b38ec9-5f6b-4451-83c6-1944cd2b80b5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5d:2f:62', 'vm-uuid': '69d4b583-82eb-4c2f-ad42-f0028d04f6a6'}),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:54:03 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:54:03 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:54:03 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:54:03 user nova-compute[74960]: INFO os_vif [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:2f:62,bridge_name='br-int',has_traffic_filtering=True,id=41b38ec9-5f6b-4451-83c6-1944cd2b80b5,network=Network(8e985ab3-9852-4f07-8b5c-19f7bf113939),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41b38ec9-5f')
Nov 03 12:54:04 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] No BDM found with device name vda, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:54:04 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] No VIF found with MAC fa:16:3e:5d:2f:62, not building metadata {{(pid=74960) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 12:54:04 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:54:05 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:54:05 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:54:05 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:54:05 user nova-compute[74960]: DEBUG nova.compute.manager [req-922e7318-358c-48a1-b8cf-885ecca285af req-8b1f2717-81d5-497f-94df-f4c15ced1267 service nova] [instance: 69d4b583-82eb-4c2f-ad42-f0028d04f6a6] Received event network-vif-plugged-41b38ec9-5f6b-4451-83c6-1944cd2b80b5 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:54:05 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-922e7318-358c-48a1-b8cf-885ecca285af req-8b1f2717-81d5-497f-94df-f4c15ced1267 service nova] Acquiring lock "69d4b583-82eb-4c2f-ad42-f0028d04f6a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:54:05 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-922e7318-358c-48a1-b8cf-885ecca285af req-8b1f2717-81d5-497f-94df-f4c15ced1267 service nova] Lock "69d4b583-82eb-4c2f-ad42-f0028d04f6a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:54:05 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-922e7318-358c-48a1-b8cf-885ecca285af req-8b1f2717-81d5-497f-94df-f4c15ced1267 service nova] Lock "69d4b583-82eb-4c2f-ad42-f0028d04f6a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:54:05 user nova-compute[74960]: DEBUG nova.compute.manager [req-922e7318-358c-48a1-b8cf-885ecca285af req-8b1f2717-81d5-497f-94df-f4c15ced1267 service nova] [instance: 69d4b583-82eb-4c2f-ad42-f0028d04f6a6] No waiting events found dispatching network-vif-plugged-41b38ec9-5f6b-4451-83c6-1944cd2b80b5 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:54:05 user nova-compute[74960]: WARNING nova.compute.manager [req-922e7318-358c-48a1-b8cf-885ecca285af req-8b1f2717-81d5-497f-94df-f4c15ced1267 service nova] [instance: 69d4b583-82eb-4c2f-ad42-f0028d04f6a6] Received unexpected event network-vif-plugged-41b38ec9-5f6b-4451-83c6-1944cd2b80b5 for instance with vm_state building and task_state spawning.
Nov 03 12:54:05 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:54:05 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:54:05 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:54:07 user nova-compute[74960]: DEBUG nova.compute.manager [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 69d4b583-82eb-4c2f-ad42-f0028d04f6a6] Instance event wait completed in 0 seconds for  {{(pid=74960) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 12:54:07 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 69d4b583-82eb-4c2f-ad42-f0028d04f6a6] Guest created on hypervisor {{(pid=74960) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 12:54:07 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: 69d4b583-82eb-4c2f-ad42-f0028d04f6a6] Instance spawned successfully.
Nov 03 12:54:07 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 69d4b583-82eb-4c2f-ad42-f0028d04f6a6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 12:54:07 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 69d4b583-82eb-4c2f-ad42-f0028d04f6a6] Found default for hw_cdrom_bus of ide {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:54:07 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 69d4b583-82eb-4c2f-ad42-f0028d04f6a6] Found default for hw_disk_bus of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:54:07 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 69d4b583-82eb-4c2f-ad42-f0028d04f6a6] Found default for hw_input_bus of None {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:54:07 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 69d4b583-82eb-4c2f-ad42-f0028d04f6a6] Found default for hw_pointer_model of None {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:54:07 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 69d4b583-82eb-4c2f-ad42-f0028d04f6a6] Found default for hw_video_model of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:54:07 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 69d4b583-82eb-4c2f-ad42-f0028d04f6a6] Found default for hw_vif_model of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:54:07 user nova-compute[74960]: INFO nova.compute.manager [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 69d4b583-82eb-4c2f-ad42-f0028d04f6a6] Took 5.07 seconds to spawn the instance on the hypervisor.
Nov 03 12:54:07 user nova-compute[74960]: DEBUG nova.compute.manager [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 69d4b583-82eb-4c2f-ad42-f0028d04f6a6] Checking state {{(pid=74960) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 12:54:07 user nova-compute[74960]: INFO nova.compute.manager [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 69d4b583-82eb-4c2f-ad42-f0028d04f6a6] Took 24.97 seconds to build instance.
Nov 03 12:54:07 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-7c49d14b-ab85-4e68-bb27-e6e43206671a tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lock "69d4b583-82eb-4c2f-ad42-f0028d04f6a6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 25.060s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:54:07 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "69d4b583-82eb-4c2f-ad42-f0028d04f6a6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 20.697s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:54:07 user nova-compute[74960]: INFO nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: 69d4b583-82eb-4c2f-ad42-f0028d04f6a6] During sync_power_state the instance has a pending task (block_device_mapping). Skip.
Nov 03 12:54:07 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "69d4b583-82eb-4c2f-ad42-f0028d04f6a6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:54:07 user nova-compute[74960]: DEBUG nova.compute.manager [req-3b579713-d37b-48b9-aeb1-68d873614e0f req-7d00da78-7643-48c0-b862-2bfc6d390ef2 service nova] [instance: 69d4b583-82eb-4c2f-ad42-f0028d04f6a6] Received event network-vif-plugged-41b38ec9-5f6b-4451-83c6-1944cd2b80b5 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:54:07 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-3b579713-d37b-48b9-aeb1-68d873614e0f req-7d00da78-7643-48c0-b862-2bfc6d390ef2 service nova] Acquiring lock "69d4b583-82eb-4c2f-ad42-f0028d04f6a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:54:07 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-3b579713-d37b-48b9-aeb1-68d873614e0f req-7d00da78-7643-48c0-b862-2bfc6d390ef2 service nova] Lock "69d4b583-82eb-4c2f-ad42-f0028d04f6a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:54:07 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-3b579713-d37b-48b9-aeb1-68d873614e0f req-7d00da78-7643-48c0-b862-2bfc6d390ef2 service nova] Lock "69d4b583-82eb-4c2f-ad42-f0028d04f6a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:54:07 user nova-compute[74960]: DEBUG nova.compute.manager [req-3b579713-d37b-48b9-aeb1-68d873614e0f req-7d00da78-7643-48c0-b862-2bfc6d390ef2 service nova] [instance: 69d4b583-82eb-4c2f-ad42-f0028d04f6a6] No waiting events found dispatching network-vif-plugged-41b38ec9-5f6b-4451-83c6-1944cd2b80b5 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:54:07 user nova-compute[74960]: WARNING nova.compute.manager [req-3b579713-d37b-48b9-aeb1-68d873614e0f req-7d00da78-7643-48c0-b862-2bfc6d390ef2 service nova] [instance: 69d4b583-82eb-4c2f-ad42-f0028d04f6a6] Received unexpected event network-vif-plugged-41b38ec9-5f6b-4451-83c6-1944cd2b80b5 for instance with vm_state active and task_state None.
Nov 03 12:54:08 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:54:09 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:54:09 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:54:09 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:54:09 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:54:09 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:54:09 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:54:09 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Auditing locally available compute resources for user (node: user) {{(pid=74960) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 12:54:09 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26effa86-ee05-485a-8339-e1579435da51/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:54:09 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26effa86-ee05-485a-8339-e1579435da51/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:54:09 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26effa86-ee05-485a-8339-e1579435da51/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:54:09 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26effa86-ee05-485a-8339-e1579435da51/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:54:09 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74960) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 12:54:09 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ede59da-37c6-4162-9e79-318f1a4a8aeb/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:54:10 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ede59da-37c6-4162-9e79-318f1a4a8aeb/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:54:10 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ede59da-37c6-4162-9e79-318f1a4a8aeb/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:54:10 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ede59da-37c6-4162-9e79-318f1a4a8aeb/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:54:10 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74960) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 12:54:10 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:54:10 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:54:10 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Hypervisor/Node resource view: name=user free_ram=8820MB free_disk=24.936359405517578GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74960) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 12:54:10 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:54:10 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:54:10 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 5ede59da-37c6-4162-9e79-318f1a4a8aeb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:54:10 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 26effa86-ee05-485a-8339-e1579435da51 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:54:10 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 69d4b583-82eb-4c2f-ad42-f0028d04f6a6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:54:10 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74960) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 12:54:10 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74960) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 12:54:10 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:54:10 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:54:10 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Compute_service record updated for user:user {{(pid=74960) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 12:54:10 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.243s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:54:13 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:54:14 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:54:14 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:54:14 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:54:14 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:54:15 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:54:15 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74960) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 12:54:17 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:54:17 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Starting heal instance info cache {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 12:54:17 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "refresh_cache-26effa86-ee05-485a-8339-e1579435da51" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:54:17 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquired lock "refresh_cache-26effa86-ee05-485a-8339-e1579435da51" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:54:17 user nova-compute[74960]: DEBUG nova.network.neutron [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: 26effa86-ee05-485a-8339-e1579435da51] Forcefully refreshing network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 12:54:17 user nova-compute[74960]: DEBUG nova.network.neutron [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: 26effa86-ee05-485a-8339-e1579435da51] Updating instance_info_cache with network_info: [{"id": "9185fdc5-7093-4cac-b998-33f9cc958a6e", "address": "fa:16:3e:be:49:86", "network": {"id": "c50fc382-c1b9-49d8-8e38-ac681cbbcffd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1465428328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "255349fa349045ad8a554d3f818cdd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9185fdc5-70", "ovs_interfaceid": "9185fdc5-7093-4cac-b998-33f9cc958a6e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:54:17 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Releasing lock "refresh_cache-26effa86-ee05-485a-8339-e1579435da51" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:54:17 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: 26effa86-ee05-485a-8339-e1579435da51] Updated the network info_cache for instance {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 12:54:18 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:54:18 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:54:18 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74960) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 12:54:18 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74960) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 12:54:18 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74960) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 12:54:18 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:54:23 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:54:23 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:54:23 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74960) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 12:54:23 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74960) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 12:54:23 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74960) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 12:54:23 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:54:24 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:54:28 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:54:29 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:54:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:54:34 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:54:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:54:39 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:54:43 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:54:48 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:54:49 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:54:49 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74960) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 12:54:49 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74960) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 12:54:49 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74960) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 12:54:49 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:54:54 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:54:54 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:54:54 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74960) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 12:54:54 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74960) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 12:54:54 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74960) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 12:54:54 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:54:55 user nova-compute[74960]: DEBUG nova.compute.manager [req-149b1c0a-48c5-4387-8cef-53f045d14eaa req-7fec8b2d-184e-4dfe-b755-a7ade6a96a90 service nova] [instance: 26effa86-ee05-485a-8339-e1579435da51] Received event network-changed-9185fdc5-7093-4cac-b998-33f9cc958a6e {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:54:55 user nova-compute[74960]: DEBUG nova.compute.manager [req-149b1c0a-48c5-4387-8cef-53f045d14eaa req-7fec8b2d-184e-4dfe-b755-a7ade6a96a90 service nova] [instance: 26effa86-ee05-485a-8339-e1579435da51] Refreshing instance network info cache due to event network-changed-9185fdc5-7093-4cac-b998-33f9cc958a6e. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 12:54:55 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-149b1c0a-48c5-4387-8cef-53f045d14eaa req-7fec8b2d-184e-4dfe-b755-a7ade6a96a90 service nova] Acquiring lock "refresh_cache-26effa86-ee05-485a-8339-e1579435da51" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:54:55 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-149b1c0a-48c5-4387-8cef-53f045d14eaa req-7fec8b2d-184e-4dfe-b755-a7ade6a96a90 service nova] Acquired lock "refresh_cache-26effa86-ee05-485a-8339-e1579435da51" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:54:55 user nova-compute[74960]: DEBUG nova.network.neutron [req-149b1c0a-48c5-4387-8cef-53f045d14eaa req-7fec8b2d-184e-4dfe-b755-a7ade6a96a90 service nova] [instance: 26effa86-ee05-485a-8339-e1579435da51] Refreshing network info cache for port 9185fdc5-7093-4cac-b998-33f9cc958a6e {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 12:54:55 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-7f5299ee-63d3-4e38-8313-35a16986280e tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Acquiring lock "26effa86-ee05-485a-8339-e1579435da51" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:54:55 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-7f5299ee-63d3-4e38-8313-35a16986280e tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Lock "26effa86-ee05-485a-8339-e1579435da51" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:54:55 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-7f5299ee-63d3-4e38-8313-35a16986280e tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Acquiring lock "26effa86-ee05-485a-8339-e1579435da51-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:54:55 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-7f5299ee-63d3-4e38-8313-35a16986280e tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Lock "26effa86-ee05-485a-8339-e1579435da51-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:54:55 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-7f5299ee-63d3-4e38-8313-35a16986280e tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Lock "26effa86-ee05-485a-8339-e1579435da51-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:54:55 user nova-compute[74960]: INFO nova.compute.manager [None req-7f5299ee-63d3-4e38-8313-35a16986280e tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 26effa86-ee05-485a-8339-e1579435da51] Terminating instance
Nov 03 12:54:55 user nova-compute[74960]: DEBUG nova.compute.manager [None req-7f5299ee-63d3-4e38-8313-35a16986280e tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 26effa86-ee05-485a-8339-e1579435da51] Start destroying the instance on the hypervisor. {{(pid=74960) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 12:54:55 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:54:55 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:54:56 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:54:56 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:54:56 user nova-compute[74960]: DEBUG nova.network.neutron [req-149b1c0a-48c5-4387-8cef-53f045d14eaa req-7fec8b2d-184e-4dfe-b755-a7ade6a96a90 service nova] [instance: 26effa86-ee05-485a-8339-e1579435da51] Updated VIF entry in instance network info cache for port 9185fdc5-7093-4cac-b998-33f9cc958a6e. {{(pid=74960) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 12:54:56 user nova-compute[74960]: DEBUG nova.network.neutron [req-149b1c0a-48c5-4387-8cef-53f045d14eaa req-7fec8b2d-184e-4dfe-b755-a7ade6a96a90 service nova] [instance: 26effa86-ee05-485a-8339-e1579435da51] Updating instance_info_cache with network_info: [{"id": "9185fdc5-7093-4cac-b998-33f9cc958a6e", "address": "fa:16:3e:be:49:86", "network": {"id": "c50fc382-c1b9-49d8-8e38-ac681cbbcffd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1465428328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "255349fa349045ad8a554d3f818cdd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9185fdc5-70", "ovs_interfaceid": "9185fdc5-7093-4cac-b998-33f9cc958a6e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:54:56 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-149b1c0a-48c5-4387-8cef-53f045d14eaa req-7fec8b2d-184e-4dfe-b755-a7ade6a96a90 service nova] Releasing lock "refresh_cache-26effa86-ee05-485a-8339-e1579435da51" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:54:56 user nova-compute[74960]: DEBUG nova.compute.manager [req-a7313050-9a19-477d-be45-07f19267fd5f req-975ef327-10ca-44ff-bc25-6c932f258ad3 service nova] [instance: 26effa86-ee05-485a-8339-e1579435da51] Received event network-vif-unplugged-9185fdc5-7093-4cac-b998-33f9cc958a6e {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:54:56 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-a7313050-9a19-477d-be45-07f19267fd5f req-975ef327-10ca-44ff-bc25-6c932f258ad3 service nova] Acquiring lock "26effa86-ee05-485a-8339-e1579435da51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:54:56 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-a7313050-9a19-477d-be45-07f19267fd5f req-975ef327-10ca-44ff-bc25-6c932f258ad3 service nova] Lock "26effa86-ee05-485a-8339-e1579435da51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:54:56 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-a7313050-9a19-477d-be45-07f19267fd5f req-975ef327-10ca-44ff-bc25-6c932f258ad3 service nova] Lock "26effa86-ee05-485a-8339-e1579435da51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:54:56 user nova-compute[74960]: DEBUG nova.compute.manager [req-a7313050-9a19-477d-be45-07f19267fd5f req-975ef327-10ca-44ff-bc25-6c932f258ad3 service nova] [instance: 26effa86-ee05-485a-8339-e1579435da51] No waiting events found dispatching network-vif-unplugged-9185fdc5-7093-4cac-b998-33f9cc958a6e {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:54:56 user nova-compute[74960]: DEBUG nova.compute.manager [req-a7313050-9a19-477d-be45-07f19267fd5f req-975ef327-10ca-44ff-bc25-6c932f258ad3 service nova] [instance: 26effa86-ee05-485a-8339-e1579435da51] Received event network-vif-unplugged-9185fdc5-7093-4cac-b998-33f9cc958a6e for instance with task_state deleting. {{(pid=74960) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 12:54:56 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:54:56 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:54:56 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: 26effa86-ee05-485a-8339-e1579435da51] Instance destroyed successfully.
Nov 03 12:54:56 user nova-compute[74960]: DEBUG nova.objects.instance [None req-7f5299ee-63d3-4e38-8313-35a16986280e tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Lazy-loading 'resources' on Instance uuid 26effa86-ee05-485a-8339-e1579435da51 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:54:56 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-7f5299ee-63d3-4e38-8313-35a16986280e tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:53:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1641673670',display_name='tempest-AttachVolumeNegativeTest-server-1641673670',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1641673670',id=45,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCkZAGtbfDPDIgrjeQ1mKxm1BYmkYKnACn28blRxCrD13wzqPb0pYP9uOiACjDEdK7OPStqKrRBghPZ/amB5D8B/0alQD1b6TLtbFlYgc1+srhLQgl7T3rh/2+A+x4kIQQ==',key_name='tempest-keypair-807986590',keypairs=<?>,launch_index=0,launched_at=2023-11-03T12:53:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='255349fa349045ad8a554d3f818cdd2e',ramdisk_id='',reservation_id='r-uv2cibeq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-787890049',owner_user_name='tempest-AttachVolumeNegativeTest-787890049-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T12:53:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c934e7c00ddd450087f904666473c0b4',uuid=26effa86-ee05-485a-8339-e1579435da51,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9185fdc5-7093-4cac-b998-33f9cc958a6e", "address": "fa:16:3e:be:49:86", "network": {"id": "c50fc382-c1b9-49d8-8e38-ac681cbbcffd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1465428328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "255349fa349045ad8a554d3f818cdd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9185fdc5-70", "ovs_interfaceid": "9185fdc5-7093-4cac-b998-33f9cc958a6e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 12:54:56 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-7f5299ee-63d3-4e38-8313-35a16986280e tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Converting VIF {"id": "9185fdc5-7093-4cac-b998-33f9cc958a6e", "address": "fa:16:3e:be:49:86", "network": {"id": "c50fc382-c1b9-49d8-8e38-ac681cbbcffd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1465428328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "255349fa349045ad8a554d3f818cdd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9185fdc5-70", "ovs_interfaceid": "9185fdc5-7093-4cac-b998-33f9cc958a6e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:54:56 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-7f5299ee-63d3-4e38-8313-35a16986280e tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:be:49:86,bridge_name='br-int',has_traffic_filtering=True,id=9185fdc5-7093-4cac-b998-33f9cc958a6e,network=Network(c50fc382-c1b9-49d8-8e38-ac681cbbcffd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9185fdc5-70') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:54:56 user nova-compute[74960]: DEBUG os_vif [None req-7f5299ee-63d3-4e38-8313-35a16986280e tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:be:49:86,bridge_name='br-int',has_traffic_filtering=True,id=9185fdc5-7093-4cac-b998-33f9cc958a6e,network=Network(c50fc382-c1b9-49d8-8e38-ac681cbbcffd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9185fdc5-70') {{(pid=74960) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 12:54:56 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:54:56 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9185fdc5-70, bridge=br-int, if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:54:56 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:54:56 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:54:56 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:54:56 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d9ca2af1-c6d3-4d38-b6ae-eb5a8679130e) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:54:56 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:54:56 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:54:56 user nova-compute[74960]: INFO os_vif [None req-7f5299ee-63d3-4e38-8313-35a16986280e tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:be:49:86,bridge_name='br-int',has_traffic_filtering=True,id=9185fdc5-7093-4cac-b998-33f9cc958a6e,network=Network(c50fc382-c1b9-49d8-8e38-ac681cbbcffd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9185fdc5-70')
Nov 03 12:54:56 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-7f5299ee-63d3-4e38-8313-35a16986280e tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 26effa86-ee05-485a-8339-e1579435da51] Deleting instance files /opt/stack/data/nova/instances/26effa86-ee05-485a-8339-e1579435da51_del
Nov 03 12:54:56 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-7f5299ee-63d3-4e38-8313-35a16986280e tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 26effa86-ee05-485a-8339-e1579435da51] Deletion of /opt/stack/data/nova/instances/26effa86-ee05-485a-8339-e1579435da51_del complete
Nov 03 12:54:56 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:54:56 user nova-compute[74960]: INFO nova.compute.manager [None req-7f5299ee-63d3-4e38-8313-35a16986280e tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 26effa86-ee05-485a-8339-e1579435da51] Took 0.68 seconds to destroy the instance on the hypervisor.
Nov 03 12:54:56 user nova-compute[74960]: DEBUG oslo.service.loopingcall [None req-7f5299ee-63d3-4e38-8313-35a16986280e tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74960) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 12:54:56 user nova-compute[74960]: DEBUG nova.compute.manager [-] [instance: 26effa86-ee05-485a-8339-e1579435da51] Deallocating network for instance {{(pid=74960) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 12:54:56 user nova-compute[74960]: DEBUG nova.network.neutron [-] [instance: 26effa86-ee05-485a-8339-e1579435da51] deallocate_for_instance() {{(pid=74960) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 12:54:57 user nova-compute[74960]: DEBUG nova.network.neutron [-] [instance: 26effa86-ee05-485a-8339-e1579435da51] Updating instance_info_cache with network_info: [] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:54:57 user nova-compute[74960]: INFO nova.compute.manager [-] [instance: 26effa86-ee05-485a-8339-e1579435da51] Took 0.64 seconds to deallocate network for instance.
Nov 03 12:54:57 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-7f5299ee-63d3-4e38-8313-35a16986280e tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:54:57 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-7f5299ee-63d3-4e38-8313-35a16986280e tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:54:57 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-7f5299ee-63d3-4e38-8313-35a16986280e tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:54:57 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-7f5299ee-63d3-4e38-8313-35a16986280e tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:54:57 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-7f5299ee-63d3-4e38-8313-35a16986280e tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.157s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:54:57 user nova-compute[74960]: INFO nova.scheduler.client.report [None req-7f5299ee-63d3-4e38-8313-35a16986280e tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Deleted allocations for instance 26effa86-ee05-485a-8339-e1579435da51
Nov 03 12:54:57 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-7f5299ee-63d3-4e38-8313-35a16986280e tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Lock "26effa86-ee05-485a-8339-e1579435da51" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.008s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:54:58 user nova-compute[74960]: DEBUG nova.compute.manager [req-0c21a8f1-9819-41f3-847d-a06d47503d6d req-bfd43a02-4675-45f0-9e2b-ed380f24e559 service nova] [instance: 26effa86-ee05-485a-8339-e1579435da51] Received event network-vif-plugged-9185fdc5-7093-4cac-b998-33f9cc958a6e {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:54:58 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-0c21a8f1-9819-41f3-847d-a06d47503d6d req-bfd43a02-4675-45f0-9e2b-ed380f24e559 service nova] Acquiring lock "26effa86-ee05-485a-8339-e1579435da51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:54:58 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-0c21a8f1-9819-41f3-847d-a06d47503d6d req-bfd43a02-4675-45f0-9e2b-ed380f24e559 service nova] Lock "26effa86-ee05-485a-8339-e1579435da51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:54:58 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-0c21a8f1-9819-41f3-847d-a06d47503d6d req-bfd43a02-4675-45f0-9e2b-ed380f24e559 service nova] Lock "26effa86-ee05-485a-8339-e1579435da51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:54:58 user nova-compute[74960]: DEBUG nova.compute.manager [req-0c21a8f1-9819-41f3-847d-a06d47503d6d req-bfd43a02-4675-45f0-9e2b-ed380f24e559 service nova] [instance: 26effa86-ee05-485a-8339-e1579435da51] No waiting events found dispatching network-vif-plugged-9185fdc5-7093-4cac-b998-33f9cc958a6e {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:54:58 user nova-compute[74960]: WARNING nova.compute.manager [req-0c21a8f1-9819-41f3-847d-a06d47503d6d req-bfd43a02-4675-45f0-9e2b-ed380f24e559 service nova] [instance: 26effa86-ee05-485a-8339-e1579435da51] Received unexpected event network-vif-plugged-9185fdc5-7093-4cac-b998-33f9cc958a6e for instance with vm_state deleted and task_state None.
Nov 03 12:54:58 user nova-compute[74960]: DEBUG nova.compute.manager [req-0c21a8f1-9819-41f3-847d-a06d47503d6d req-bfd43a02-4675-45f0-9e2b-ed380f24e559 service nova] [instance: 26effa86-ee05-485a-8339-e1579435da51] Received event network-vif-deleted-9185fdc5-7093-4cac-b998-33f9cc958a6e {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:54:59 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:55:01 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:55:04 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:55:06 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:55:11 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:55:11 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:55:11 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:55:11 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:55:11 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:55:11 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:55:11 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Auditing locally available compute resources for user (node: user) {{(pid=74960) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 12:55:11 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74960) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 12:55:11 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ede59da-37c6-4162-9e79-318f1a4a8aeb/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:55:11 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ede59da-37c6-4162-9e79-318f1a4a8aeb/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:55:11 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ede59da-37c6-4162-9e79-318f1a4a8aeb/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:55:11 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ede59da-37c6-4162-9e79-318f1a4a8aeb/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:55:11 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74960) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 12:55:12 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:55:12 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:55:12 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Hypervisor/Node resource view: name=user free_ram=8897MB free_disk=24.963348388671875GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74960) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 12:55:12 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:55:12 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:55:12 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 5ede59da-37c6-4162-9e79-318f1a4a8aeb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:55:12 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 69d4b583-82eb-4c2f-ad42-f0028d04f6a6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:55:12 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74960) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 12:55:12 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74960) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 12:55:12 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:55:12 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:55:12 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Compute_service record updated for user:user {{(pid=74960) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 12:55:12 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.251s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:55:15 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:55:15 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:55:15 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:55:16 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:55:16 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:55:16 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74960) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 12:55:16 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:55:19 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:55:19 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Starting heal instance info cache {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 12:55:19 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Rebuilding the list of instances to heal {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 03 12:55:19 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "refresh_cache-5ede59da-37c6-4162-9e79-318f1a4a8aeb" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:55:19 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquired lock "refresh_cache-5ede59da-37c6-4162-9e79-318f1a4a8aeb" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:55:19 user nova-compute[74960]: DEBUG nova.network.neutron [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: 5ede59da-37c6-4162-9e79-318f1a4a8aeb] Forcefully refreshing network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 12:55:19 user nova-compute[74960]: DEBUG nova.objects.instance [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lazy-loading 'info_cache' on Instance uuid 5ede59da-37c6-4162-9e79-318f1a4a8aeb {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:55:20 user nova-compute[74960]: DEBUG nova.network.neutron [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: 5ede59da-37c6-4162-9e79-318f1a4a8aeb] Updating instance_info_cache with network_info: [{"id": "9f629e06-9020-4e4b-956e-d33d9417c2a6", "address": "fa:16:3e:1e:78:99", "network": {"id": "c50fc382-c1b9-49d8-8e38-ac681cbbcffd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1465428328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "255349fa349045ad8a554d3f818cdd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f629e06-90", "ovs_interfaceid": "9f629e06-9020-4e4b-956e-d33d9417c2a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:55:20 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Releasing lock "refresh_cache-5ede59da-37c6-4162-9e79-318f1a4a8aeb" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:55:20 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: 5ede59da-37c6-4162-9e79-318f1a4a8aeb] Updated the network info_cache for instance {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 12:55:21 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:55:26 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:55:31 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:55:31 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:55:33 user nova-compute[74960]: DEBUG nova.compute.manager [req-10ed305e-be1c-4816-b60a-19b6fca247d2 req-f7bf060e-af23-46c8-9348-4c82fe5f455e service nova] [instance: 69d4b583-82eb-4c2f-ad42-f0028d04f6a6] Received event network-changed-41b38ec9-5f6b-4451-83c6-1944cd2b80b5 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:55:33 user nova-compute[74960]: DEBUG nova.compute.manager [req-10ed305e-be1c-4816-b60a-19b6fca247d2 req-f7bf060e-af23-46c8-9348-4c82fe5f455e service nova] [instance: 69d4b583-82eb-4c2f-ad42-f0028d04f6a6] Refreshing instance network info cache due to event network-changed-41b38ec9-5f6b-4451-83c6-1944cd2b80b5. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 12:55:33 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-10ed305e-be1c-4816-b60a-19b6fca247d2 req-f7bf060e-af23-46c8-9348-4c82fe5f455e service nova] Acquiring lock "refresh_cache-69d4b583-82eb-4c2f-ad42-f0028d04f6a6" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:55:33 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-10ed305e-be1c-4816-b60a-19b6fca247d2 req-f7bf060e-af23-46c8-9348-4c82fe5f455e service nova] Acquired lock "refresh_cache-69d4b583-82eb-4c2f-ad42-f0028d04f6a6" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:55:33 user nova-compute[74960]: DEBUG nova.network.neutron [req-10ed305e-be1c-4816-b60a-19b6fca247d2 req-f7bf060e-af23-46c8-9348-4c82fe5f455e service nova] [instance: 69d4b583-82eb-4c2f-ad42-f0028d04f6a6] Refreshing network info cache for port 41b38ec9-5f6b-4451-83c6-1944cd2b80b5 {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 12:55:33 user nova-compute[74960]: DEBUG nova.network.neutron [req-10ed305e-be1c-4816-b60a-19b6fca247d2 req-f7bf060e-af23-46c8-9348-4c82fe5f455e service nova] [instance: 69d4b583-82eb-4c2f-ad42-f0028d04f6a6] Updated VIF entry in instance network info cache for port 41b38ec9-5f6b-4451-83c6-1944cd2b80b5. {{(pid=74960) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 12:55:33 user nova-compute[74960]: DEBUG nova.network.neutron [req-10ed305e-be1c-4816-b60a-19b6fca247d2 req-f7bf060e-af23-46c8-9348-4c82fe5f455e service nova] [instance: 69d4b583-82eb-4c2f-ad42-f0028d04f6a6] Updating instance_info_cache with network_info: [{"id": "41b38ec9-5f6b-4451-83c6-1944cd2b80b5", "address": "fa:16:3e:5d:2f:62", "network": {"id": "8e985ab3-9852-4f07-8b5c-19f7bf113939", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781795302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d64f3d9dae8f45bcb2e0677a0076ed64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41b38ec9-5f", "ovs_interfaceid": "41b38ec9-5f6b-4451-83c6-1944cd2b80b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:55:33 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-10ed305e-be1c-4816-b60a-19b6fca247d2 req-f7bf060e-af23-46c8-9348-4c82fe5f455e service nova] Releasing lock "refresh_cache-69d4b583-82eb-4c2f-ad42-f0028d04f6a6" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:55:34 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:55:36 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:55:39 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:55:41 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:55:44 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:55:45 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:55:46 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:55:47 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-060ef2d9-e1d6-4147-ae94-5481a1e083fd tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Acquiring lock "5ede59da-37c6-4162-9e79-318f1a4a8aeb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:55:47 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-060ef2d9-e1d6-4147-ae94-5481a1e083fd tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Lock "5ede59da-37c6-4162-9e79-318f1a4a8aeb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:55:47 user nova-compute[74960]: INFO nova.compute.manager [None req-060ef2d9-e1d6-4147-ae94-5481a1e083fd tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 5ede59da-37c6-4162-9e79-318f1a4a8aeb] Detaching volume ff103612-61ef-4872-a7ab-daaee737fae2
Nov 03 12:55:47 user nova-compute[74960]: INFO nova.virt.block_device [None req-060ef2d9-e1d6-4147-ae94-5481a1e083fd tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 5ede59da-37c6-4162-9e79-318f1a4a8aeb] Attempting to driver detach volume ff103612-61ef-4872-a7ab-daaee737fae2 from mountpoint /dev/vdb
Nov 03 12:55:47 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-060ef2d9-e1d6-4147-ae94-5481a1e083fd tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Attempting to detach device vdb from instance 5ede59da-37c6-4162-9e79-318f1a4a8aeb from the persistent domain config. {{(pid=74960) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 03 12:55:47 user nova-compute[74960]: DEBUG nova.virt.libvirt.guest [None req-060ef2d9-e1d6-4147-ae94-5481a1e083fd tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 12:55:47 user nova-compute[74960]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 12:55:47 user nova-compute[74960]:   <source dev="/dev/sdb"/>
Nov 03 12:55:47 user nova-compute[74960]:   <target dev="vdb" bus="virtio"/>
Nov 03 12:55:47 user nova-compute[74960]:   <serial>ff103612-61ef-4872-a7ab-daaee737fae2</serial>
Nov 03 12:55:47 user nova-compute[74960]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 12:55:47 user nova-compute[74960]: </disk>
Nov 03 12:55:47 user nova-compute[74960]:  {{(pid=74960) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 12:55:47 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-060ef2d9-e1d6-4147-ae94-5481a1e083fd tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Successfully detached device vdb from instance 5ede59da-37c6-4162-9e79-318f1a4a8aeb from the persistent domain config.
Nov 03 12:55:47 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-060ef2d9-e1d6-4147-ae94-5481a1e083fd tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5ede59da-37c6-4162-9e79-318f1a4a8aeb from the live domain config. {{(pid=74960) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 03 12:55:47 user nova-compute[74960]: DEBUG nova.virt.libvirt.guest [None req-060ef2d9-e1d6-4147-ae94-5481a1e083fd tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 12:55:47 user nova-compute[74960]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 12:55:47 user nova-compute[74960]:   <source dev="/dev/sdb"/>
Nov 03 12:55:47 user nova-compute[74960]:   <target dev="vdb" bus="virtio"/>
Nov 03 12:55:47 user nova-compute[74960]:   <serial>ff103612-61ef-4872-a7ab-daaee737fae2</serial>
Nov 03 12:55:47 user nova-compute[74960]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 12:55:47 user nova-compute[74960]: </disk>
Nov 03 12:55:47 user nova-compute[74960]:  {{(pid=74960) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 12:55:47 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-060ef2d9-e1d6-4147-ae94-5481a1e083fd tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5ede59da-37c6-4162-9e79-318f1a4a8aeb {{(pid=74960) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 03 12:55:47 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-72315ff7-64bb-47b5-9f17-6ba0e60c128d tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Acquiring lock "57ef7196-fc41-4908-b736-e450062af8b9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:55:47 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-72315ff7-64bb-47b5-9f17-6ba0e60c128d tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lock "57ef7196-fc41-4908-b736-e450062af8b9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:55:47 user nova-compute[74960]: DEBUG nova.compute.manager [None req-72315ff7-64bb-47b5-9f17-6ba0e60c128d tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 57ef7196-fc41-4908-b736-e450062af8b9] Starting instance... {{(pid=74960) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 12:55:47 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-72315ff7-64bb-47b5-9f17-6ba0e60c128d tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:55:47 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-72315ff7-64bb-47b5-9f17-6ba0e60c128d tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:55:47 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-72315ff7-64bb-47b5-9f17-6ba0e60c128d tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74960) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 12:55:47 user nova-compute[74960]: INFO nova.compute.claims [None req-72315ff7-64bb-47b5-9f17-6ba0e60c128d tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 57ef7196-fc41-4908-b736-e450062af8b9] Claim successful on node user
Nov 03 12:55:48 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-72315ff7-64bb-47b5-9f17-6ba0e60c128d tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:55:48 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-72315ff7-64bb-47b5-9f17-6ba0e60c128d tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:55:48 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-72315ff7-64bb-47b5-9f17-6ba0e60c128d tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.305s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:55:48 user nova-compute[74960]: DEBUG nova.compute.manager [None req-72315ff7-64bb-47b5-9f17-6ba0e60c128d tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 57ef7196-fc41-4908-b736-e450062af8b9] Start building networks asynchronously for instance. {{(pid=74960) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 12:55:48 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-72315ff7-64bb-47b5-9f17-6ba0e60c128d tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 57ef7196-fc41-4908-b736-e450062af8b9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 12:55:48 user nova-compute[74960]: DEBUG nova.compute.manager [None req-72315ff7-64bb-47b5-9f17-6ba0e60c128d tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 57ef7196-fc41-4908-b736-e450062af8b9] Allocating IP information in the background. {{(pid=74960) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 12:55:48 user nova-compute[74960]: DEBUG nova.network.neutron [None req-72315ff7-64bb-47b5-9f17-6ba0e60c128d tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 57ef7196-fc41-4908-b736-e450062af8b9] allocate_for_instance() {{(pid=74960) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 12:55:48 user nova-compute[74960]: DEBUG nova.compute.manager [None req-72315ff7-64bb-47b5-9f17-6ba0e60c128d tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 57ef7196-fc41-4908-b736-e450062af8b9] Start building block device mappings for instance. {{(pid=74960) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 12:55:48 user nova-compute[74960]: INFO nova.virt.block_device [None req-72315ff7-64bb-47b5-9f17-6ba0e60c128d tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 57ef7196-fc41-4908-b736-e450062af8b9] Booting with volume snapshot 20161f28-5932-4a82-9a71-f444e6b5c651 at /dev/vda
Nov 03 12:55:48 user nova-compute[74960]: DEBUG nova.policy [None req-72315ff7-64bb-47b5-9f17-6ba0e60c128d tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '067a3f33438b4112b818b91ecb4dd0d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd64f3d9dae8f45bcb2e0677a0076ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74960) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 12:55:48 user nova-compute[74960]: DEBUG nova.network.neutron [None req-72315ff7-64bb-47b5-9f17-6ba0e60c128d tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 57ef7196-fc41-4908-b736-e450062af8b9] Successfully created port: cdb25946-24f2-4251-9208-93dee5791093 {{(pid=74960) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 12:55:49 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:55:49 user nova-compute[74960]: DEBUG nova.network.neutron [None req-72315ff7-64bb-47b5-9f17-6ba0e60c128d tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 57ef7196-fc41-4908-b736-e450062af8b9] Successfully updated port: cdb25946-24f2-4251-9208-93dee5791093 {{(pid=74960) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 12:55:49 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-72315ff7-64bb-47b5-9f17-6ba0e60c128d tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Acquiring lock "refresh_cache-57ef7196-fc41-4908-b736-e450062af8b9" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:55:49 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-72315ff7-64bb-47b5-9f17-6ba0e60c128d tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Acquired lock "refresh_cache-57ef7196-fc41-4908-b736-e450062af8b9" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:55:49 user nova-compute[74960]: DEBUG nova.network.neutron [None req-72315ff7-64bb-47b5-9f17-6ba0e60c128d tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 57ef7196-fc41-4908-b736-e450062af8b9] Building network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 12:55:49 user nova-compute[74960]: DEBUG nova.compute.manager [req-c315849b-6d36-47fc-b051-8ad6ccdf3a4f req-52e11772-5114-451e-90a6-f1eac4970c7b service nova] [instance: 57ef7196-fc41-4908-b736-e450062af8b9] Received event network-changed-cdb25946-24f2-4251-9208-93dee5791093 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:55:49 user nova-compute[74960]: DEBUG nova.compute.manager [req-c315849b-6d36-47fc-b051-8ad6ccdf3a4f req-52e11772-5114-451e-90a6-f1eac4970c7b service nova] [instance: 57ef7196-fc41-4908-b736-e450062af8b9] Refreshing instance network info cache due to event network-changed-cdb25946-24f2-4251-9208-93dee5791093. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 12:55:49 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-c315849b-6d36-47fc-b051-8ad6ccdf3a4f req-52e11772-5114-451e-90a6-f1eac4970c7b service nova] Acquiring lock "refresh_cache-57ef7196-fc41-4908-b736-e450062af8b9" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:55:49 user nova-compute[74960]: DEBUG nova.network.neutron [None req-72315ff7-64bb-47b5-9f17-6ba0e60c128d tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 57ef7196-fc41-4908-b736-e450062af8b9] Instance cache missing network info. {{(pid=74960) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 12:55:50 user nova-compute[74960]: DEBUG nova.network.neutron [None req-72315ff7-64bb-47b5-9f17-6ba0e60c128d tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 57ef7196-fc41-4908-b736-e450062af8b9] Updating instance_info_cache with network_info: [{"id": "cdb25946-24f2-4251-9208-93dee5791093", "address": "fa:16:3e:4a:44:45", "network": {"id": "8e985ab3-9852-4f07-8b5c-19f7bf113939", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781795302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d64f3d9dae8f45bcb2e0677a0076ed64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdb25946-24", "ovs_interfaceid": "cdb25946-24f2-4251-9208-93dee5791093", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:55:50 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-72315ff7-64bb-47b5-9f17-6ba0e60c128d tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Releasing lock "refresh_cache-57ef7196-fc41-4908-b736-e450062af8b9" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:55:50 user nova-compute[74960]: DEBUG nova.compute.manager [None req-72315ff7-64bb-47b5-9f17-6ba0e60c128d tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 57ef7196-fc41-4908-b736-e450062af8b9] Instance network_info: |[{"id": "cdb25946-24f2-4251-9208-93dee5791093", "address": "fa:16:3e:4a:44:45", "network": {"id": "8e985ab3-9852-4f07-8b5c-19f7bf113939", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781795302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d64f3d9dae8f45bcb2e0677a0076ed64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdb25946-24", "ovs_interfaceid": "cdb25946-24f2-4251-9208-93dee5791093", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74960) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 12:55:50 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-c315849b-6d36-47fc-b051-8ad6ccdf3a4f req-52e11772-5114-451e-90a6-f1eac4970c7b service nova] Acquired lock "refresh_cache-57ef7196-fc41-4908-b736-e450062af8b9" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:55:50 user nova-compute[74960]: DEBUG nova.network.neutron [req-c315849b-6d36-47fc-b051-8ad6ccdf3a4f req-52e11772-5114-451e-90a6-f1eac4970c7b service nova] [instance: 57ef7196-fc41-4908-b736-e450062af8b9] Refreshing network info cache for port cdb25946-24f2-4251-9208-93dee5791093 {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 12:55:50 user nova-compute[74960]: DEBUG nova.network.neutron [req-c315849b-6d36-47fc-b051-8ad6ccdf3a4f req-52e11772-5114-451e-90a6-f1eac4970c7b service nova] [instance: 57ef7196-fc41-4908-b736-e450062af8b9] Updated VIF entry in instance network info cache for port cdb25946-24f2-4251-9208-93dee5791093. {{(pid=74960) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 12:55:50 user nova-compute[74960]: DEBUG nova.network.neutron [req-c315849b-6d36-47fc-b051-8ad6ccdf3a4f req-52e11772-5114-451e-90a6-f1eac4970c7b service nova] [instance: 57ef7196-fc41-4908-b736-e450062af8b9] Updating instance_info_cache with network_info: [{"id": "cdb25946-24f2-4251-9208-93dee5791093", "address": "fa:16:3e:4a:44:45", "network": {"id": "8e985ab3-9852-4f07-8b5c-19f7bf113939", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781795302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d64f3d9dae8f45bcb2e0677a0076ed64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdb25946-24", "ovs_interfaceid": "cdb25946-24f2-4251-9208-93dee5791093", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:55:50 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-c315849b-6d36-47fc-b051-8ad6ccdf3a4f req-52e11772-5114-451e-90a6-f1eac4970c7b service nova] Releasing lock "refresh_cache-57ef7196-fc41-4908-b736-e450062af8b9" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:55:51 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:55:54 user nova-compute[74960]: DEBUG os_brick.utils [None req-72315ff7-64bb-47b5-9f17-6ba0e60c128d tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:55:54 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:55:54 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:55:54 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd1b5b79-2a59-4fbb-bee0-2831639303bd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:75b8e219756\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:55:54 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:55:54 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:55:54 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc533d88-5e44-4301-bf31-d2875ac6b6a8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:55:54 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:55:54 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:55:54 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8d1bb50-c014-4ff6-ac9e-16be3b9c2464]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:55:54 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf05f06d-e537-4562-9d2b-b80fab94e85c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:55:54 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-72315ff7-64bb-47b5-9f17-6ba0e60c128d tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Running cmd (subprocess): nvme version {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:55:54 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-72315ff7-64bb-47b5-9f17-6ba0e60c128d tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] 'nvme version' failed. Not Retrying. {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 12:55:54 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.nvmeof [None req-72315ff7-64bb-47b5-9f17-6ba0e60c128d tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] nvme not present on system {{(pid=74960) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 12:55:54 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:55:54 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 12:55:54 user nova-compute[74960]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 12:55:54 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[6799e14e-ef7c-4a05-9eab-ec24f4391835]: (4, '') {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:55:54 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-72315ff7-64bb-47b5-9f17-6ba0e60c128d tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74960) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 12:55:54 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-72315ff7-64bb-47b5-9f17-6ba0e60c128d tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74960) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 12:55:54 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-72315ff7-64bb-47b5-9f17-6ba0e60c128d tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] LIGHTOS: no hostnqn found. {{(pid=74960) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 12:55:54 user nova-compute[74960]: DEBUG os_brick.utils [None req-72315ff7-64bb-47b5-9f17-6ba0e60c128d tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:75b8e219756', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:55:54 user nova-compute[74960]: DEBUG nova.virt.block_device [None req-72315ff7-64bb-47b5-9f17-6ba0e60c128d tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 57ef7196-fc41-4908-b736-e450062af8b9] Updating existing volume attachment record: 837d0700-be0a-4b87-93e5-0d1ec362a619 {{(pid=74960) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 12:55:56 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:56:01 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:56:06 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:56:06 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:56:07 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-060ef2d9-e1d6-4147-ae94-5481a1e083fd tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5ede59da-37c6-4162-9e79-318f1a4a8aeb is timed out.
Nov 03 12:56:07 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-060ef2d9-e1d6-4147-ae94-5481a1e083fd tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Successfully detached device vdb from instance 5ede59da-37c6-4162-9e79-318f1a4a8aeb from the live domain config.
Nov 03 12:56:07 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-060ef2d9-e1d6-4147-ae94-5481a1e083fd tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 5ede59da-37c6-4162-9e79-318f1a4a8aeb] calling os-brick to detach iSCSI Volume {{(pid=74960) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 12:56:07 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-060ef2d9-e1d6-4147-ae94-5481a1e083fd tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9aa420acb0>, {'target_iqn': 'iqn.2010-10.org.openstack:ff103612-61ef-4872-a7ab-daaee737fae2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZinUBDJA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:56:07 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-060ef2d9-e1d6-4147-ae94-5481a1e083fd tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:56:07 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-060ef2d9-e1d6-4147-ae94-5481a1e083fd tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:56:07 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-060ef2d9-e1d6-4147-ae94-5481a1e083fd tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:56:07 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:56:07 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:56:07 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d744e4a-929b-47c4-8673-47ff2b16df5e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ff103612-61ef-4872-a7ab-daaee737fae2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f84524e4-0a06-482a-8b65-afd5dccfd016\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:56:07 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-060ef2d9-e1d6-4147-ae94-5481a1e083fd tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 12:56:07 user nova-compute[74960]: No targets found.
Nov 03 12:56:07 user nova-compute[74960]: iSNS:
Nov 03 12:56:07 user nova-compute[74960]: No targets found.
Nov 03 12:56:07 user nova-compute[74960]: STATIC:
Nov 03 12:56:07 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:ff103612-61ef-4872-a7ab-daaee737fae2
Nov 03 12:56:07 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:56:07 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:56:07 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:f84524e4-0a06-482a-8b65-afd5dccfd016
Nov 03 12:56:07 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:56:07 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:56:07 user nova-compute[74960]: FIRMWARE:
Nov 03 12:56:07 user nova-compute[74960]: No targets found.
Nov 03 12:56:07 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:56:07 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-060ef2d9-e1d6-4147-ae94-5481a1e083fd tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 12:56:07 user nova-compute[74960]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 12:56:07 user nova-compute[74960]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74960) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 12:56:07 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-060ef2d9-e1d6-4147-ae94-5481a1e083fd tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ff103612-61ef-4872-a7ab-daaee737fae2', 0)] {{(pid=74960) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 12:56:07 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:56:07 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:56:07 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb5abadb-5a42-4359-8011-b7b5937c72b6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f84524e4-0a06-482a-8b65-afd5dccfd016\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff103612-61ef-4872-a7ab-daaee737fae2\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:56:07 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:56:07 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:56:07 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc6a9a85-1592-4291-96af-a7c9fd077e95]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff103612-61ef-4872-a7ab-daaee737fae2 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84524e4-0a06-482a-8b65-afd5dccfd016 (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:56:07 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-060ef2d9-e1d6-4147-ae94-5481a1e083fd tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff103612-61ef-4872-a7ab-daaee737fae2 (non-flash)
Nov 03 12:56:07 user nova-compute[74960]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84524e4-0a06-482a-8b65-afd5dccfd016 (non-flash)
Nov 03 12:56:07 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:56:07 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-060ef2d9-e1d6-4147-ae94-5481a1e083fd tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff103612-61ef-4872-a7ab-daaee737fae2 (non-flash)
Nov 03 12:56:07 user nova-compute[74960]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84524e4-0a06-482a-8b65-afd5dccfd016 (non-flash)
Nov 03 12:56:07 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:56:07 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-060ef2d9-e1d6-4147-ae94-5481a1e083fd tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9a8c35e290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ff103612-61ef-4872-a7ab-daaee737fae2'): ({'sdb'}, set())}) {{(pid=74960) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 12:56:07 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-060ef2d9-e1d6-4147-ae94-5481a1e083fd tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Removing single pathed devices sdb {{(pid=74960) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 12:56:07 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:56:07 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:56:07 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a96b7dd-6428-49cc-9636-ce29925c35ea]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:56:07 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:56:07 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:56:07 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b8c8567-1708-4902-926e-7e2660f16f4c]: (4, ('ok\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:56:07 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-060ef2d9-e1d6-4147-ae94-5481a1e083fd tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Flushing IO for device /dev/sdb {{(pid=74960) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 12:56:07 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:56:07 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:56:07 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[948016c4-caa6-49fb-a7a4-6ec29501b628]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:56:07 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-060ef2d9-e1d6-4147-ae94-5481a1e083fd tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74960) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 12:56:07 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:56:07 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:56:07 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[62631ba5-1b55-4bc8-b704-692eaa77ccf3]: (4, ('1', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:56:07 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-060ef2d9-e1d6-4147-ae94-5481a1e083fd tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74960) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 12:56:07 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-060ef2d9-e1d6-4147-ae94-5481a1e083fd tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] SCSI volumes sdb have been removed. {{(pid=74960) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 12:56:07 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-060ef2d9-e1d6-4147-ae94-5481a1e083fd tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ff103612-61ef-4872-a7ab-daaee737fae2')] {{(pid=74960) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 12:56:07 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff103612-61ef-4872-a7ab-daaee737fae2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:56:07 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff103612-61ef-4872-a7ab-daaee737fae2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.096s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:56:07 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cfbb1ed-5bc4-4136-a708-2cd94055b9b0]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:56:08 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-060ef2d9-e1d6-4147-ae94-5481a1e083fd tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:56:08 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff103612-61ef-4872-a7ab-daaee737fae2 -p 172.16.0.220:3260 --logout {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:56:08 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff103612-61ef-4872-a7ab-daaee737fae2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:56:08 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fe71c7b-fc68-4fee-8515-c7257f0b82c7]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:ff103612-61ef-4872-a7ab-daaee737fae2, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:ff103612-61ef-4872-a7ab-daaee737fae2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:56:08 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-060ef2d9-e1d6-4147-ae94-5481a1e083fd tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:ff103612-61ef-4872-a7ab-daaee737fae2, portal: 172.16.0.220,3260]
Nov 03 12:56:08 user nova-compute[74960]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:ff103612-61ef-4872-a7ab-daaee737fae2, portal: 172.16.0.220,3260] successful.
Nov 03 12:56:08 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:56:08 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff103612-61ef-4872-a7ab-daaee737fae2 -p 172.16.0.220:3260 --op delete {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:56:08 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff103612-61ef-4872-a7ab-daaee737fae2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:56:08 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff53b0d3-c409-44ac-bfee-9d8dd64aea72]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:56:08 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-060ef2d9-e1d6-4147-ae94-5481a1e083fd tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:56:08 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-060ef2d9-e1d6-4147-ae94-5481a1e083fd tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.369s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:56:08 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-060ef2d9-e1d6-4147-ae94-5481a1e083fd tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] <== disconnect_volume: return (370ms) None {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:56:08 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-060ef2d9-e1d6-4147-ae94-5481a1e083fd tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 5ede59da-37c6-4162-9e79-318f1a4a8aeb] Disconnected iSCSI Volume {{(pid=74960) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 12:56:08 user nova-compute[74960]: DEBUG nova.objects.instance [None req-060ef2d9-e1d6-4147-ae94-5481a1e083fd tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Lazy-loading 'flavor' on Instance uuid 5ede59da-37c6-4162-9e79-318f1a4a8aeb {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:56:09 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-060ef2d9-e1d6-4147-ae94-5481a1e083fd tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Lock "5ede59da-37c6-4162-9e79-318f1a4a8aeb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.883s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:56:09 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:56:11 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:56:11 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:56:13 user nova-compute[74960]: DEBUG nova.compute.manager [None req-72315ff7-64bb-47b5-9f17-6ba0e60c128d tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 57ef7196-fc41-4908-b736-e450062af8b9] Start spawning the instance on the hypervisor. {{(pid=74960) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 12:56:13 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-72315ff7-64bb-47b5-9f17-6ba0e60c128d tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 57ef7196-fc41-4908-b736-e450062af8b9] Creating instance directory {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 12:56:13 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-72315ff7-64bb-47b5-9f17-6ba0e60c128d tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 57ef7196-fc41-4908-b736-e450062af8b9] Creating image(s)
Nov 03 12:56:13 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-72315ff7-64bb-47b5-9f17-6ba0e60c128d tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 57ef7196-fc41-4908-b736-e450062af8b9] Did not create local disks {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 03 12:56:13 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-72315ff7-64bb-47b5-9f17-6ba0e60c128d tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 57ef7196-fc41-4908-b736-e450062af8b9] Ensure instance console log exists: /opt/stack/data/nova/instances/57ef7196-fc41-4908-b736-e450062af8b9/console.log {{(pid=74960) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 12:56:13 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-72315ff7-64bb-47b5-9f17-6ba0e60c128d tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:56:13 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-72315ff7-64bb-47b5-9f17-6ba0e60c128d tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:56:13 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-72315ff7-64bb-47b5-9f17-6ba0e60c128d tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:56:13 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-72315ff7-64bb-47b5-9f17-6ba0e60c128d tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 57ef7196-fc41-4908-b736-e450062af8b9] Start _get_guest_xml network_info=[{"id": "cdb25946-24f2-4251-9208-93dee5791093", "address": "fa:16:3e:4a:44:45", "network": {"id": "8e985ab3-9852-4f07-8b5c-19f7bf113939", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781795302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d64f3d9dae8f45bcb2e0677a0076ed64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdb25946-24", "ovs_interfaceid": "cdb25946-24f2-4251-9208-93dee5791093", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-03T12:55:35Z,direct_url=<?>,disk_format='qcow2',id=4c0dbb93-6e09-467a-9ec6-a8208adb7d47,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1576103460',owner='d64f3d9dae8f45bcb2e0677a0076ed64',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-03T12:55:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:db55b697-39c5-4df2-bea4-d925a4461ab2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ETfVzNPl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '57ef7196-fc41-4908-b736-e450062af8b9', 'attached_at': '', 'detached_at': '', 'volume_id': 'db55b697-39c5-4df2-bea4-d925a4461ab2', 'serial': 'db55b697-39c5-4df2-bea4-d925a4461ab2'}, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'device_type': 'disk', 'attachment_id': '837d0700-be0a-4b87-93e5-0d1ec362a619', 'boot_index': 0, 'guest_format': None, 'volume_type': None} {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 12:56:13 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-72315ff7-64bb-47b5-9f17-6ba0e60c128d tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:56:13 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-72315ff7-64bb-47b5-9f17-6ba0e60c128d tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:56:13 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-72315ff7-64bb-47b5-9f17-6ba0e60c128d tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 12:56:13 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-72315ff7-64bb-47b5-9f17-6ba0e60c128d tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] CPU controller missing on host. {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 12:56:13 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-72315ff7-64bb-47b5-9f17-6ba0e60c128d tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 12:56:13 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-72315ff7-64bb-47b5-9f17-6ba0e60c128d tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] CPU controller found on host. {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 12:56:13 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-72315ff7-64bb-47b5-9f17-6ba0e60c128d tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74960) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 12:56:13 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-72315ff7-64bb-47b5-9f17-6ba0e60c128d tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-03T12:55:35Z,direct_url=<?>,disk_format='qcow2',id=4c0dbb93-6e09-467a-9ec6-a8208adb7d47,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1576103460',owner='d64f3d9dae8f45bcb2e0677a0076ed64',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-03T12:55:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 12:56:13 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-72315ff7-64bb-47b5-9f17-6ba0e60c128d tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Flavor limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 12:56:13 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-72315ff7-64bb-47b5-9f17-6ba0e60c128d tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Image limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 12:56:13 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-72315ff7-64bb-47b5-9f17-6ba0e60c128d tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Flavor pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 12:56:13 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-72315ff7-64bb-47b5-9f17-6ba0e60c128d tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Image pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 12:56:13 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-72315ff7-64bb-47b5-9f17-6ba0e60c128d tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 12:56:13 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-72315ff7-64bb-47b5-9f17-6ba0e60c128d tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 12:56:13 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-72315ff7-64bb-47b5-9f17-6ba0e60c128d tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 12:56:13 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-72315ff7-64bb-47b5-9f17-6ba0e60c128d tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Got 1 possible topologies {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 12:56:13 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-72315ff7-64bb-47b5-9f17-6ba0e60c128d tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 12:56:13 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-72315ff7-64bb-47b5-9f17-6ba0e60c128d tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 12:56:13 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72315ff7-64bb-47b5-9f17-6ba0e60c128d tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 57ef7196-fc41-4908-b736-e450062af8b9] Calling os-brick to attach iSCSI Volume {{(pid=74960) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 12:56:13 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-72315ff7-64bb-47b5-9f17-6ba0e60c128d tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9aa420acb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:db55b697-39c5-4df2-bea4-d925a4461ab2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ETfVzNPl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:56:13 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-72315ff7-64bb-47b5-9f17-6ba0e60c128d tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:56:13 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-72315ff7-64bb-47b5-9f17-6ba0e60c128d tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:56:13 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-72315ff7-64bb-47b5-9f17-6ba0e60c128d tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:56:13 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-72315ff7-64bb-47b5-9f17-6ba0e60c128d tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:56:13 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-72315ff7-64bb-47b5-9f17-6ba0e60c128d tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db55b697-39c5-4df2-bea4-d925a4461ab2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:56:13 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-72315ff7-64bb-47b5-9f17-6ba0e60c128d tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db55b697-39c5-4df2-bea4-d925a4461ab2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:56:13 user nova-compute[74960]: INFO os_brick.initiator.connectors.iscsi [None req-72315ff7-64bb-47b5-9f17-6ba0e60c128d tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 12:56:13 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db55b697-39c5-4df2-bea4-d925a4461ab2 -p 172.16.0.220:3260 {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:56:13 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db55b697-39c5-4df2-bea4-d925a4461ab2 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:56:13 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f7c1421-b036-4881-8870-ab4a4742024d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:56:13 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-72315ff7-64bb-47b5-9f17-6ba0e60c128d tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 12:56:13 user nova-compute[74960]:  {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:56:13 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db55b697-39c5-4df2-bea4-d925a4461ab2 -p 172.16.0.220:3260 --interface default --op new {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:56:13 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db55b697-39c5-4df2-bea4-d925a4461ab2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:56:13 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f5f22ff-03ac-4c2e-afb8-78bb697ddecc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:db55b697-39c5-4df2-bea4-d925a4461ab2] added\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:56:13 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-72315ff7-64bb-47b5-9f17-6ba0e60c128d tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:db55b697-39c5-4df2-bea4-d925a4461ab2] added
Nov 03 12:56:13 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:56:13 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db55b697-39c5-4df2-bea4-d925a4461ab2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:56:13 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:56:13 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:56:13 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:56:13 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:56:13 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Auditing locally available compute resources for user (node: user) {{(pid=74960) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 12:56:13 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db55b697-39c5-4df2-bea4-d925a4461ab2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:56:13 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[00b11dac-618a-46a2-bf17-1d31a16a6655]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:56:13 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-72315ff7-64bb-47b5-9f17-6ba0e60c128d tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:56:13 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db55b697-39c5-4df2-bea4-d925a4461ab2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:56:13 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db55b697-39c5-4df2-bea4-d925a4461ab2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:56:13 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f768a59-0792-4674-a8f7-33e475bdb105]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:56:13 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-72315ff7-64bb-47b5-9f17-6ba0e60c128d tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:56:13 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db55b697-39c5-4df2-bea4-d925a4461ab2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ETfVzNPl {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:56:13 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db55b697-39c5-4df2-bea4-d925a4461ab2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ETfVzNPl" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:56:13 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fdcf735-4d94-4021-9ab9-c19f03662465]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:56:13 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-72315ff7-64bb-47b5-9f17-6ba0e60c128d tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ETfVzNPl'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:56:13 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db55b697-39c5-4df2-bea4-d925a4461ab2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:56:13 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db55b697-39c5-4df2-bea4-d925a4461ab2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:56:13 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e2aa791-82d2-479b-8181-650fdd151874]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:56:13 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-72315ff7-64bb-47b5-9f17-6ba0e60c128d tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:56:13 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:56:13 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74960) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 12:56:13 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ede59da-37c6-4162-9e79-318f1a4a8aeb/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:56:13 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:56:13 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfabaa3d-a52c-489f-80be-cd9e73cb05da]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84524e4-0a06-482a-8b65-afd5dccfd016 (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:56:13 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-72315ff7-64bb-47b5-9f17-6ba0e60c128d tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84524e4-0a06-482a-8b65-afd5dccfd016 (non-flash)
Nov 03 12:56:13 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:56:13 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-72315ff7-64bb-47b5-9f17-6ba0e60c128d tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84524e4-0a06-482a-8b65-afd5dccfd016 (non-flash)
Nov 03 12:56:13 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:56:13 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db55b697-39c5-4df2-bea4-d925a4461ab2 -p 172.16.0.220:3260 --login {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:56:13 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db55b697-39c5-4df2-bea4-d925a4461ab2 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:56:13 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[d87b9dc4-ff83-4dee-a552-133147734c7e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:db55b697-39c5-4df2-bea4-d925a4461ab2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:db55b697-39c5-4df2-bea4-d925a4461ab2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:56:13 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-72315ff7-64bb-47b5-9f17-6ba0e60c128d tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:db55b697-39c5-4df2-bea4-d925a4461ab2, portal: 172.16.0.220,3260]
Nov 03 12:56:13 user nova-compute[74960]: Login to [iface: default, target: iqn.2010-10.org.openstack:db55b697-39c5-4df2-bea4-d925a4461ab2, portal: 172.16.0.220,3260] successful.
Nov 03 12:56:13 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:56:13 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db55b697-39c5-4df2-bea4-d925a4461ab2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:56:13 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db55b697-39c5-4df2-bea4-d925a4461ab2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:56:13 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fd28a15-eb61-434e-89f2-616860b26127]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:56:13 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-72315ff7-64bb-47b5-9f17-6ba0e60c128d tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:56:13 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:56:13 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:56:13 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f576cd5-d9a9-414e-aad0-cf0e7c964aa4]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84524e4-0a06-482a-8b65-afd5dccfd016 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db55b697-39c5-4df2-bea4-d925a4461ab2 (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:56:13 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-72315ff7-64bb-47b5-9f17-6ba0e60c128d tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84524e4-0a06-482a-8b65-afd5dccfd016 (non-flash)
Nov 03 12:56:13 user nova-compute[74960]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db55b697-39c5-4df2-bea4-d925a4461ab2 (non-flash)
Nov 03 12:56:13 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:56:13 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-72315ff7-64bb-47b5-9f17-6ba0e60c128d tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84524e4-0a06-482a-8b65-afd5dccfd016 (non-flash)
Nov 03 12:56:13 user nova-compute[74960]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db55b697-39c5-4df2-bea4-d925a4461ab2 (non-flash)
Nov 03 12:56:13 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:56:13 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-72315ff7-64bb-47b5-9f17-6ba0e60c128d tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db55b697-39c5-4df2-bea4-d925a4461ab2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.315s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:56:13 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-72315ff7-64bb-47b5-9f17-6ba0e60c128d tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Connected to 172.16.0.220:3260 {{(pid=74960) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 12:56:13 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-72315ff7-64bb-47b5-9f17-6ba0e60c128d tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] HCTL ('33', '-', '-', 0) found on session 46 with lun 0 {{(pid=74960) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 12:56:13 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-72315ff7-64bb-47b5-9f17-6ba0e60c128d tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74960) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 12:56:13 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:56:13 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:56:13 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[80784c1d-6634-46ef-9e14-de8a773a34f3]: (4, ('- - 0', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:56:13 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-72315ff7-64bb-47b5-9f17-6ba0e60c128d tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Searching for a device in session 46 and hctl ['33', '*', '*', 0] yield: None {{(pid=74960) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 12:56:13 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ede59da-37c6-4162-9e79-318f1a4a8aeb/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:56:13 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ede59da-37c6-4162-9e79-318f1a4a8aeb/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:56:13 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ede59da-37c6-4162-9e79-318f1a4a8aeb/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:56:14 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:56:14 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:56:14 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Hypervisor/Node resource view: name=user free_ram=8908MB free_disk=24.9617919921875GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74960) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 12:56:14 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:56:14 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:56:14 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 5ede59da-37c6-4162-9e79-318f1a4a8aeb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:56:14 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 69d4b583-82eb-4c2f-ad42-f0028d04f6a6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:56:14 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 57ef7196-fc41-4908-b736-e450062af8b9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:56:14 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74960) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 12:56:14 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74960) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 12:56:14 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:56:14 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:56:14 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Compute_service record updated for user:user {{(pid=74960) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 12:56:14 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.247s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:56:14 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-72315ff7-64bb-47b5-9f17-6ba0e60c128d tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Searching for a device in session 46 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74960) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 12:56:14 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-72315ff7-64bb-47b5-9f17-6ba0e60c128d tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:db55b697-39c5-4df2-bea4-d925a4461ab2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ETfVzNPl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74960) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 12:56:14 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-72315ff7-64bb-47b5-9f17-6ba0e60c128d tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.345s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:56:14 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-72315ff7-64bb-47b5-9f17-6ba0e60c128d tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] <== connect_volume: return (1346ms) {'type': 'block', 'scsi_wwn': '23963646365393237', 'path': '/dev/sdb'} {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:56:14 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72315ff7-64bb-47b5-9f17-6ba0e60c128d tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 57ef7196-fc41-4908-b736-e450062af8b9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23963646365393237', 'path': '/dev/sdb'} {{(pid=74960) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 12:56:14 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-72315ff7-64bb-47b5-9f17-6ba0e60c128d tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:55:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-2123879412',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-2123879412',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-2123879412',id=47,image_ref='4c0dbb93-6e09-467a-9ec6-a8208adb7d47',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGVfi9YQhBX9BGD6E7ov/5xfiE1lMVKuIUYwYA5MlZUolYztKSy1LOigss9ItDErFivSjlSO8z9yXupA+Y7d4ba9LJ2NVWqVo2uR1iOKsBbhnJZ6JWxUwGCI0Ye4bh3ueQ==',key_name='tempest-keypair-1745228905',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d64f3d9dae8f45bcb2e0677a0076ed64',ramdisk_id='',reservation_id='r-0fmwcod0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1795947051',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1795947051-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1795947051',owner_user_name='tempest-TestVolumeBootPattern-1795947051-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:55:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='067a3f33438b4112b818b91ecb4dd0d2',uuid=57ef7196-fc41-4908-b736-e450062af8b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cdb25946-24f2-4251-9208-93dee5791093", "address": "fa:16:3e:4a:44:45", "network": {"id": "8e985ab3-9852-4f07-8b5c-19f7bf113939", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781795302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d64f3d9dae8f45bcb2e0677a0076ed64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdb25946-24", "ovs_interfaceid": "cdb25946-24f2-4251-9208-93dee5791093", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74960) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 12:56:14 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-72315ff7-64bb-47b5-9f17-6ba0e60c128d tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Converting VIF {"id": "cdb25946-24f2-4251-9208-93dee5791093", "address": "fa:16:3e:4a:44:45", "network": {"id": "8e985ab3-9852-4f07-8b5c-19f7bf113939", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781795302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d64f3d9dae8f45bcb2e0677a0076ed64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdb25946-24", "ovs_interfaceid": "cdb25946-24f2-4251-9208-93dee5791093", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:56:14 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-72315ff7-64bb-47b5-9f17-6ba0e60c128d tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:44:45,bridge_name='br-int',has_traffic_filtering=True,id=cdb25946-24f2-4251-9208-93dee5791093,network=Network(8e985ab3-9852-4f07-8b5c-19f7bf113939),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdb25946-24') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:56:14 user nova-compute[74960]: DEBUG nova.objects.instance [None req-72315ff7-64bb-47b5-9f17-6ba0e60c128d tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lazy-loading 'pci_devices' on Instance uuid 57ef7196-fc41-4908-b736-e450062af8b9 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:56:14 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-72315ff7-64bb-47b5-9f17-6ba0e60c128d tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 57ef7196-fc41-4908-b736-e450062af8b9] End _get_guest_xml xml=<domain type="kvm">
Nov 03 12:56:14 user nova-compute[74960]:   <uuid>57ef7196-fc41-4908-b736-e450062af8b9</uuid>
Nov 03 12:56:14 user nova-compute[74960]:   <name>instance-0000002f</name>
Nov 03 12:56:14 user nova-compute[74960]:   <memory>524288</memory>
Nov 03 12:56:14 user nova-compute[74960]:   <vcpu>1</vcpu>
Nov 03 12:56:14 user nova-compute[74960]:   <metadata>
Nov 03 12:56:14 user nova-compute[74960]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 12:56:14 user nova-compute[74960]:       <nova:package version="0.0.0"/>
Nov 03 12:56:14 user nova-compute[74960]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-2123879412</nova:name>
Nov 03 12:56:14 user nova-compute[74960]:       <nova:creationTime>2023-11-03 12:56:13</nova:creationTime>
Nov 03 12:56:14 user nova-compute[74960]:       <nova:flavor name="m1.tiny">
Nov 03 12:56:14 user nova-compute[74960]:         <nova:memory>512</nova:memory>
Nov 03 12:56:14 user nova-compute[74960]:         <nova:disk>1</nova:disk>
Nov 03 12:56:14 user nova-compute[74960]:         <nova:swap>0</nova:swap>
Nov 03 12:56:14 user nova-compute[74960]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 12:56:14 user nova-compute[74960]:         <nova:vcpus>1</nova:vcpus>
Nov 03 12:56:14 user nova-compute[74960]:       </nova:flavor>
Nov 03 12:56:14 user nova-compute[74960]:       <nova:owner>
Nov 03 12:56:14 user nova-compute[74960]:         <nova:user uuid="067a3f33438b4112b818b91ecb4dd0d2">tempest-TestVolumeBootPattern-1795947051-project-member</nova:user>
Nov 03 12:56:14 user nova-compute[74960]:         <nova:project uuid="d64f3d9dae8f45bcb2e0677a0076ed64">tempest-TestVolumeBootPattern-1795947051</nova:project>
Nov 03 12:56:14 user nova-compute[74960]:       </nova:owner>
Nov 03 12:56:14 user nova-compute[74960]:       <nova:root type="image" uuid="4c0dbb93-6e09-467a-9ec6-a8208adb7d47"/>
Nov 03 12:56:14 user nova-compute[74960]:       <nova:ports>
Nov 03 12:56:14 user nova-compute[74960]:         <nova:port uuid="cdb25946-24f2-4251-9208-93dee5791093">
Nov 03 12:56:14 user nova-compute[74960]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 03 12:56:14 user nova-compute[74960]:         </nova:port>
Nov 03 12:56:14 user nova-compute[74960]:       </nova:ports>
Nov 03 12:56:14 user nova-compute[74960]:     </nova:instance>
Nov 03 12:56:14 user nova-compute[74960]:   </metadata>
Nov 03 12:56:14 user nova-compute[74960]:   <sysinfo type="smbios">
Nov 03 12:56:14 user nova-compute[74960]:     <system>
Nov 03 12:56:14 user nova-compute[74960]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 12:56:14 user nova-compute[74960]:       <entry name="product">OpenStack Nova</entry>
Nov 03 12:56:14 user nova-compute[74960]:       <entry name="version">0.0.0</entry>
Nov 03 12:56:14 user nova-compute[74960]:       <entry name="serial">57ef7196-fc41-4908-b736-e450062af8b9</entry>
Nov 03 12:56:14 user nova-compute[74960]:       <entry name="uuid">57ef7196-fc41-4908-b736-e450062af8b9</entry>
Nov 03 12:56:14 user nova-compute[74960]:       <entry name="family">Virtual Machine</entry>
Nov 03 12:56:14 user nova-compute[74960]:     </system>
Nov 03 12:56:14 user nova-compute[74960]:   </sysinfo>
Nov 03 12:56:14 user nova-compute[74960]:   <os>
Nov 03 12:56:14 user nova-compute[74960]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 12:56:14 user nova-compute[74960]:     <boot dev="hd"/>
Nov 03 12:56:14 user nova-compute[74960]:     <smbios mode="sysinfo"/>
Nov 03 12:56:14 user nova-compute[74960]:   </os>
Nov 03 12:56:14 user nova-compute[74960]:   <features>
Nov 03 12:56:14 user nova-compute[74960]:     <acpi/>
Nov 03 12:56:14 user nova-compute[74960]:     <apic/>
Nov 03 12:56:14 user nova-compute[74960]:     <vmcoreinfo/>
Nov 03 12:56:14 user nova-compute[74960]:   </features>
Nov 03 12:56:14 user nova-compute[74960]:   <clock offset="utc">
Nov 03 12:56:14 user nova-compute[74960]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 12:56:14 user nova-compute[74960]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 12:56:14 user nova-compute[74960]:     <timer name="hpet" present="no"/>
Nov 03 12:56:14 user nova-compute[74960]:   </clock>
Nov 03 12:56:14 user nova-compute[74960]:   <cpu mode="custom" match="exact">
Nov 03 12:56:14 user nova-compute[74960]:     <model>Nehalem</model>
Nov 03 12:56:14 user nova-compute[74960]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 12:56:14 user nova-compute[74960]:   </cpu>
Nov 03 12:56:14 user nova-compute[74960]:   <devices>
Nov 03 12:56:14 user nova-compute[74960]:     <disk type="block" device="disk">
Nov 03 12:56:14 user nova-compute[74960]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 12:56:14 user nova-compute[74960]:       <source dev="/dev/sdb"/>
Nov 03 12:56:14 user nova-compute[74960]:       <target dev="vda" bus="virtio"/>
Nov 03 12:56:14 user nova-compute[74960]:       <serial>db55b697-39c5-4df2-bea4-d925a4461ab2</serial>
Nov 03 12:56:14 user nova-compute[74960]:     </disk>
Nov 03 12:56:14 user nova-compute[74960]:     <interface type="ethernet">
Nov 03 12:56:14 user nova-compute[74960]:       <mac address="fa:16:3e:4a:44:45"/>
Nov 03 12:56:14 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:56:14 user nova-compute[74960]:       <mtu size="1442"/>
Nov 03 12:56:14 user nova-compute[74960]:       <target dev="tapcdb25946-24"/>
Nov 03 12:56:14 user nova-compute[74960]:     </interface>
Nov 03 12:56:14 user nova-compute[74960]:     <serial type="pty">
Nov 03 12:56:14 user nova-compute[74960]:       <log file="/opt/stack/data/nova/instances/57ef7196-fc41-4908-b736-e450062af8b9/console.log" append="off"/>
Nov 03 12:56:14 user nova-compute[74960]:     </serial>
Nov 03 12:56:14 user nova-compute[74960]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 12:56:14 user nova-compute[74960]:     <video>
Nov 03 12:56:14 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:56:14 user nova-compute[74960]:     </video>
Nov 03 12:56:14 user nova-compute[74960]:     <rng model="virtio">
Nov 03 12:56:14 user nova-compute[74960]:       <backend model="random">/dev/urandom</backend>
Nov 03 12:56:14 user nova-compute[74960]:     </rng>
Nov 03 12:56:14 user nova-compute[74960]:     <controller type="usb" index="0" model="none"/>
Nov 03 12:56:14 user nova-compute[74960]:     <memballoon model="virtio">
Nov 03 12:56:14 user nova-compute[74960]:       <stats period="10"/>
Nov 03 12:56:14 user nova-compute[74960]:     </memballoon>
Nov 03 12:56:14 user nova-compute[74960]:   </devices>
Nov 03 12:56:14 user nova-compute[74960]: </domain>
Nov 03 12:56:14 user nova-compute[74960]:  {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 12:56:14 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-72315ff7-64bb-47b5-9f17-6ba0e60c128d tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:55:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-2123879412',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-2123879412',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-2123879412',id=47,image_ref='4c0dbb93-6e09-467a-9ec6-a8208adb7d47',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGVfi9YQhBX9BGD6E7ov/5xfiE1lMVKuIUYwYA5MlZUolYztKSy1LOigss9ItDErFivSjlSO8z9yXupA+Y7d4ba9LJ2NVWqVo2uR1iOKsBbhnJZ6JWxUwGCI0Ye4bh3ueQ==',key_name='tempest-keypair-1745228905',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d64f3d9dae8f45bcb2e0677a0076ed64',ramdisk_id='',reservation_id='r-0fmwcod0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1795947051',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1795947051-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1795947051',owner_user_name='tempest-TestVolumeBootPattern-1795947051-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:55:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='067a3f33438b4112b818b91ecb4dd0d2',uuid=57ef7196-fc41-4908-b736-e450062af8b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cdb25946-24f2-4251-9208-93dee5791093", "address": "fa:16:3e:4a:44:45", "network": {"id": "8e985ab3-9852-4f07-8b5c-19f7bf113939", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781795302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d64f3d9dae8f45bcb2e0677a0076ed64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdb25946-24", "ovs_interfaceid": "cdb25946-24f2-4251-9208-93dee5791093", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 12:56:14 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-72315ff7-64bb-47b5-9f17-6ba0e60c128d tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Converting VIF {"id": "cdb25946-24f2-4251-9208-93dee5791093", "address": "fa:16:3e:4a:44:45", "network": {"id": "8e985ab3-9852-4f07-8b5c-19f7bf113939", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781795302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d64f3d9dae8f45bcb2e0677a0076ed64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdb25946-24", "ovs_interfaceid": "cdb25946-24f2-4251-9208-93dee5791093", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:56:14 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-72315ff7-64bb-47b5-9f17-6ba0e60c128d tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:44:45,bridge_name='br-int',has_traffic_filtering=True,id=cdb25946-24f2-4251-9208-93dee5791093,network=Network(8e985ab3-9852-4f07-8b5c-19f7bf113939),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdb25946-24') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:56:14 user nova-compute[74960]: DEBUG os_vif [None req-72315ff7-64bb-47b5-9f17-6ba0e60c128d tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:44:45,bridge_name='br-int',has_traffic_filtering=True,id=cdb25946-24f2-4251-9208-93dee5791093,network=Network(8e985ab3-9852-4f07-8b5c-19f7bf113939),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdb25946-24') {{(pid=74960) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 12:56:14 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:56:14 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:56:14 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 12:56:14 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:56:14 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fedca09a-ad1f-565e-86c0-70eca7b73e80', '_type': 'linux-noop'}}, row=False) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:56:14 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:56:14 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:56:14 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:56:14 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcdb25946-24, may_exist=True, interface_attrs={}) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:56:14 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcdb25946-24, col_values=(('qos', UUID('ebc50d29-1446-4b09-b425-87e29069632e')),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:56:14 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcdb25946-24, col_values=(('external_ids', {'iface-id': 'cdb25946-24f2-4251-9208-93dee5791093', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4a:44:45', 'vm-uuid': '57ef7196-fc41-4908-b736-e450062af8b9'}),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:56:14 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:56:14 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:56:14 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:56:14 user nova-compute[74960]: INFO os_vif [None req-72315ff7-64bb-47b5-9f17-6ba0e60c128d tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:44:45,bridge_name='br-int',has_traffic_filtering=True,id=cdb25946-24f2-4251-9208-93dee5791093,network=Network(8e985ab3-9852-4f07-8b5c-19f7bf113939),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdb25946-24')
Nov 03 12:56:14 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-72315ff7-64bb-47b5-9f17-6ba0e60c128d tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] No BDM found with device name vda, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:56:14 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-72315ff7-64bb-47b5-9f17-6ba0e60c128d tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] No VIF found with MAC fa:16:3e:4a:44:45, not building metadata {{(pid=74960) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 12:56:15 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:56:15 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:56:15 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:56:16 user nova-compute[74960]: DEBUG nova.compute.manager [req-d714f53c-f0e7-4699-8813-7672494131ca req-c2c5018e-44d3-442c-a1d3-ff55eb69eea5 service nova] [instance: 57ef7196-fc41-4908-b736-e450062af8b9] Received event network-vif-plugged-cdb25946-24f2-4251-9208-93dee5791093 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:56:16 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-d714f53c-f0e7-4699-8813-7672494131ca req-c2c5018e-44d3-442c-a1d3-ff55eb69eea5 service nova] Acquiring lock "57ef7196-fc41-4908-b736-e450062af8b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:56:16 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-d714f53c-f0e7-4699-8813-7672494131ca req-c2c5018e-44d3-442c-a1d3-ff55eb69eea5 service nova] Lock "57ef7196-fc41-4908-b736-e450062af8b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:56:16 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-d714f53c-f0e7-4699-8813-7672494131ca req-c2c5018e-44d3-442c-a1d3-ff55eb69eea5 service nova] Lock "57ef7196-fc41-4908-b736-e450062af8b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:56:16 user nova-compute[74960]: DEBUG nova.compute.manager [req-d714f53c-f0e7-4699-8813-7672494131ca req-c2c5018e-44d3-442c-a1d3-ff55eb69eea5 service nova] [instance: 57ef7196-fc41-4908-b736-e450062af8b9] No waiting events found dispatching network-vif-plugged-cdb25946-24f2-4251-9208-93dee5791093 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:56:16 user nova-compute[74960]: WARNING nova.compute.manager [req-d714f53c-f0e7-4699-8813-7672494131ca req-c2c5018e-44d3-442c-a1d3-ff55eb69eea5 service nova] [instance: 57ef7196-fc41-4908-b736-e450062af8b9] Received unexpected event network-vif-plugged-cdb25946-24f2-4251-9208-93dee5791093 for instance with vm_state building and task_state spawning.
Nov 03 12:56:16 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:56:17 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:56:17 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:56:17 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:56:17 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:56:18 user nova-compute[74960]: DEBUG nova.compute.manager [None req-72315ff7-64bb-47b5-9f17-6ba0e60c128d tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 57ef7196-fc41-4908-b736-e450062af8b9] Instance event wait completed in 0 seconds for  {{(pid=74960) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 12:56:18 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-72315ff7-64bb-47b5-9f17-6ba0e60c128d tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 57ef7196-fc41-4908-b736-e450062af8b9] Guest created on hypervisor {{(pid=74960) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 12:56:18 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: 57ef7196-fc41-4908-b736-e450062af8b9] Instance spawned successfully.
Nov 03 12:56:18 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-72315ff7-64bb-47b5-9f17-6ba0e60c128d tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 57ef7196-fc41-4908-b736-e450062af8b9] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 12:56:18 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-72315ff7-64bb-47b5-9f17-6ba0e60c128d tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 57ef7196-fc41-4908-b736-e450062af8b9] Found default for hw_input_bus of None {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:56:18 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-72315ff7-64bb-47b5-9f17-6ba0e60c128d tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 57ef7196-fc41-4908-b736-e450062af8b9] Found default for hw_pointer_model of None {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:56:18 user nova-compute[74960]: INFO nova.compute.manager [None req-72315ff7-64bb-47b5-9f17-6ba0e60c128d tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 57ef7196-fc41-4908-b736-e450062af8b9] Took 4.86 seconds to spawn the instance on the hypervisor.
Nov 03 12:56:18 user nova-compute[74960]: DEBUG nova.compute.manager [None req-72315ff7-64bb-47b5-9f17-6ba0e60c128d tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 57ef7196-fc41-4908-b736-e450062af8b9] Checking state {{(pid=74960) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 12:56:18 user nova-compute[74960]: INFO nova.compute.manager [None req-72315ff7-64bb-47b5-9f17-6ba0e60c128d tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 57ef7196-fc41-4908-b736-e450062af8b9] Took 30.34 seconds to build instance.
Nov 03 12:56:18 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-72315ff7-64bb-47b5-9f17-6ba0e60c128d tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lock "57ef7196-fc41-4908-b736-e450062af8b9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 30.434s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:56:18 user nova-compute[74960]: DEBUG nova.compute.manager [req-0b6d3796-c88e-4441-b815-403565afcf45 req-c820c0f4-2506-40bb-afc8-4c34ecac2655 service nova] [instance: 57ef7196-fc41-4908-b736-e450062af8b9] Received event network-vif-plugged-cdb25946-24f2-4251-9208-93dee5791093 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:56:18 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-0b6d3796-c88e-4441-b815-403565afcf45 req-c820c0f4-2506-40bb-afc8-4c34ecac2655 service nova] Acquiring lock "57ef7196-fc41-4908-b736-e450062af8b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:56:18 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-0b6d3796-c88e-4441-b815-403565afcf45 req-c820c0f4-2506-40bb-afc8-4c34ecac2655 service nova] Lock "57ef7196-fc41-4908-b736-e450062af8b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:56:18 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-0b6d3796-c88e-4441-b815-403565afcf45 req-c820c0f4-2506-40bb-afc8-4c34ecac2655 service nova] Lock "57ef7196-fc41-4908-b736-e450062af8b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:56:18 user nova-compute[74960]: DEBUG nova.compute.manager [req-0b6d3796-c88e-4441-b815-403565afcf45 req-c820c0f4-2506-40bb-afc8-4c34ecac2655 service nova] [instance: 57ef7196-fc41-4908-b736-e450062af8b9] No waiting events found dispatching network-vif-plugged-cdb25946-24f2-4251-9208-93dee5791093 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:56:18 user nova-compute[74960]: WARNING nova.compute.manager [req-0b6d3796-c88e-4441-b815-403565afcf45 req-c820c0f4-2506-40bb-afc8-4c34ecac2655 service nova] [instance: 57ef7196-fc41-4908-b736-e450062af8b9] Received unexpected event network-vif-plugged-cdb25946-24f2-4251-9208-93dee5791093 for instance with vm_state active and task_state None.
Nov 03 12:56:18 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:56:18 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74960) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 12:56:19 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:56:19 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:56:19 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Starting heal instance info cache {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 12:56:19 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "refresh_cache-69d4b583-82eb-4c2f-ad42-f0028d04f6a6" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:56:19 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquired lock "refresh_cache-69d4b583-82eb-4c2f-ad42-f0028d04f6a6" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:56:19 user nova-compute[74960]: DEBUG nova.network.neutron [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: 69d4b583-82eb-4c2f-ad42-f0028d04f6a6] Forcefully refreshing network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 12:56:19 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:56:19 user nova-compute[74960]: DEBUG nova.network.neutron [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: 69d4b583-82eb-4c2f-ad42-f0028d04f6a6] Updating instance_info_cache with network_info: [{"id": "41b38ec9-5f6b-4451-83c6-1944cd2b80b5", "address": "fa:16:3e:5d:2f:62", "network": {"id": "8e985ab3-9852-4f07-8b5c-19f7bf113939", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781795302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d64f3d9dae8f45bcb2e0677a0076ed64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41b38ec9-5f", "ovs_interfaceid": "41b38ec9-5f6b-4451-83c6-1944cd2b80b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:56:19 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Releasing lock "refresh_cache-69d4b583-82eb-4c2f-ad42-f0028d04f6a6" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:56:19 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: 69d4b583-82eb-4c2f-ad42-f0028d04f6a6] Updated the network info_cache for instance {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 12:56:24 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:56:24 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:56:24 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74960) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 12:56:24 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74960) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 12:56:24 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74960) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 12:56:24 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:56:29 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:56:34 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:56:34 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:56:37 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-ca6d7f04-ee6d-473e-9a00-9c5565535560 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Acquiring lock "5ede59da-37c6-4162-9e79-318f1a4a8aeb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:56:37 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-ca6d7f04-ee6d-473e-9a00-9c5565535560 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Lock "5ede59da-37c6-4162-9e79-318f1a4a8aeb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:56:37 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-ca6d7f04-ee6d-473e-9a00-9c5565535560 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Acquiring lock "5ede59da-37c6-4162-9e79-318f1a4a8aeb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:56:37 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-ca6d7f04-ee6d-473e-9a00-9c5565535560 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Lock "5ede59da-37c6-4162-9e79-318f1a4a8aeb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:56:37 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-ca6d7f04-ee6d-473e-9a00-9c5565535560 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Lock "5ede59da-37c6-4162-9e79-318f1a4a8aeb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:56:37 user nova-compute[74960]: INFO nova.compute.manager [None req-ca6d7f04-ee6d-473e-9a00-9c5565535560 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 5ede59da-37c6-4162-9e79-318f1a4a8aeb] Terminating instance
Nov 03 12:56:37 user nova-compute[74960]: DEBUG nova.compute.manager [None req-ca6d7f04-ee6d-473e-9a00-9c5565535560 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 5ede59da-37c6-4162-9e79-318f1a4a8aeb] Start destroying the instance on the hypervisor. {{(pid=74960) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 12:56:37 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:56:37 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:56:37 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:56:37 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:56:37 user nova-compute[74960]: DEBUG nova.compute.manager [req-a8bac99d-a20f-42c6-a630-7582cba9013f req-3ee30344-09f7-4e41-a3a3-2b418a029d54 service nova] [instance: 5ede59da-37c6-4162-9e79-318f1a4a8aeb] Received event network-vif-unplugged-9f629e06-9020-4e4b-956e-d33d9417c2a6 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:56:37 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-a8bac99d-a20f-42c6-a630-7582cba9013f req-3ee30344-09f7-4e41-a3a3-2b418a029d54 service nova] Acquiring lock "5ede59da-37c6-4162-9e79-318f1a4a8aeb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:56:37 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-a8bac99d-a20f-42c6-a630-7582cba9013f req-3ee30344-09f7-4e41-a3a3-2b418a029d54 service nova] Lock "5ede59da-37c6-4162-9e79-318f1a4a8aeb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:56:37 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-a8bac99d-a20f-42c6-a630-7582cba9013f req-3ee30344-09f7-4e41-a3a3-2b418a029d54 service nova] Lock "5ede59da-37c6-4162-9e79-318f1a4a8aeb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:56:37 user nova-compute[74960]: DEBUG nova.compute.manager [req-a8bac99d-a20f-42c6-a630-7582cba9013f req-3ee30344-09f7-4e41-a3a3-2b418a029d54 service nova] [instance: 5ede59da-37c6-4162-9e79-318f1a4a8aeb] No waiting events found dispatching network-vif-unplugged-9f629e06-9020-4e4b-956e-d33d9417c2a6 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:56:37 user nova-compute[74960]: DEBUG nova.compute.manager [req-a8bac99d-a20f-42c6-a630-7582cba9013f req-3ee30344-09f7-4e41-a3a3-2b418a029d54 service nova] [instance: 5ede59da-37c6-4162-9e79-318f1a4a8aeb] Received event network-vif-unplugged-9f629e06-9020-4e4b-956e-d33d9417c2a6 for instance with task_state deleting. {{(pid=74960) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 12:56:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:56:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:56:38 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: 5ede59da-37c6-4162-9e79-318f1a4a8aeb] Instance destroyed successfully.
Nov 03 12:56:38 user nova-compute[74960]: DEBUG nova.objects.instance [None req-ca6d7f04-ee6d-473e-9a00-9c5565535560 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Lazy-loading 'resources' on Instance uuid 5ede59da-37c6-4162-9e79-318f1a4a8aeb {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:56:38 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-ca6d7f04-ee6d-473e-9a00-9c5565535560 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:50:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-338784767',display_name='tempest-AttachVolumeNegativeTest-server-338784767',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-338784767',id=44,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNEcwNAKbZkDes6JIMlXxZkZb8VbR+5R10kuvGfO590jhfPZvkrV/gXJ2MebZDVJUIVwDNQ4vCWRJFk6YU30MSzdOcwFB7LjyA3TyaHVmV588YCWuGCaS4LcPH+zFqUDXg==',key_name='tempest-keypair-674514535',keypairs=<?>,launch_index=0,launched_at=2023-11-03T12:50:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='255349fa349045ad8a554d3f818cdd2e',ramdisk_id='',reservation_id='r-9pz7ay4e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-787890049',owner_user_name='tempest-AttachVolumeNegativeTest-787890049-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T12:50:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c934e7c00ddd450087f904666473c0b4',uuid=5ede59da-37c6-4162-9e79-318f1a4a8aeb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9f629e06-9020-4e4b-956e-d33d9417c2a6", "address": "fa:16:3e:1e:78:99", "network": {"id": "c50fc382-c1b9-49d8-8e38-ac681cbbcffd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1465428328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "255349fa349045ad8a554d3f818cdd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f629e06-90", "ovs_interfaceid": "9f629e06-9020-4e4b-956e-d33d9417c2a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 12:56:38 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-ca6d7f04-ee6d-473e-9a00-9c5565535560 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Converting VIF {"id": "9f629e06-9020-4e4b-956e-d33d9417c2a6", "address": "fa:16:3e:1e:78:99", "network": {"id": "c50fc382-c1b9-49d8-8e38-ac681cbbcffd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1465428328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "255349fa349045ad8a554d3f818cdd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f629e06-90", "ovs_interfaceid": "9f629e06-9020-4e4b-956e-d33d9417c2a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:56:38 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-ca6d7f04-ee6d-473e-9a00-9c5565535560 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1e:78:99,bridge_name='br-int',has_traffic_filtering=True,id=9f629e06-9020-4e4b-956e-d33d9417c2a6,network=Network(c50fc382-c1b9-49d8-8e38-ac681cbbcffd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f629e06-90') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:56:38 user nova-compute[74960]: DEBUG os_vif [None req-ca6d7f04-ee6d-473e-9a00-9c5565535560 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1e:78:99,bridge_name='br-int',has_traffic_filtering=True,id=9f629e06-9020-4e4b-956e-d33d9417c2a6,network=Network(c50fc382-c1b9-49d8-8e38-ac681cbbcffd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f629e06-90') {{(pid=74960) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 12:56:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:56:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9f629e06-90, bridge=br-int, if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:56:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:56:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:56:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:56:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2e42010b-cde4-4a6f-9bb7-002cc442ca7e) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:56:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:56:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:56:38 user nova-compute[74960]: INFO os_vif [None req-ca6d7f04-ee6d-473e-9a00-9c5565535560 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1e:78:99,bridge_name='br-int',has_traffic_filtering=True,id=9f629e06-9020-4e4b-956e-d33d9417c2a6,network=Network(c50fc382-c1b9-49d8-8e38-ac681cbbcffd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f629e06-90')
Nov 03 12:56:38 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-ca6d7f04-ee6d-473e-9a00-9c5565535560 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 5ede59da-37c6-4162-9e79-318f1a4a8aeb] Deleting instance files /opt/stack/data/nova/instances/5ede59da-37c6-4162-9e79-318f1a4a8aeb_del
Nov 03 12:56:38 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-ca6d7f04-ee6d-473e-9a00-9c5565535560 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 5ede59da-37c6-4162-9e79-318f1a4a8aeb] Deletion of /opt/stack/data/nova/instances/5ede59da-37c6-4162-9e79-318f1a4a8aeb_del complete
Nov 03 12:56:38 user nova-compute[74960]: INFO nova.compute.manager [None req-ca6d7f04-ee6d-473e-9a00-9c5565535560 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 5ede59da-37c6-4162-9e79-318f1a4a8aeb] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 03 12:56:38 user nova-compute[74960]: DEBUG oslo.service.loopingcall [None req-ca6d7f04-ee6d-473e-9a00-9c5565535560 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74960) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 12:56:38 user nova-compute[74960]: DEBUG nova.compute.manager [-] [instance: 5ede59da-37c6-4162-9e79-318f1a4a8aeb] Deallocating network for instance {{(pid=74960) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 12:56:38 user nova-compute[74960]: DEBUG nova.network.neutron [-] [instance: 5ede59da-37c6-4162-9e79-318f1a4a8aeb] deallocate_for_instance() {{(pid=74960) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 12:56:39 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:56:39 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:56:39 user nova-compute[74960]: DEBUG nova.network.neutron [-] [instance: 5ede59da-37c6-4162-9e79-318f1a4a8aeb] Updating instance_info_cache with network_info: [] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:56:39 user nova-compute[74960]: INFO nova.compute.manager [-] [instance: 5ede59da-37c6-4162-9e79-318f1a4a8aeb] Took 0.69 seconds to deallocate network for instance.
Nov 03 12:56:39 user nova-compute[74960]: DEBUG nova.compute.manager [req-ad0700d1-aa9a-4789-bd1e-90d6416e0f34 req-9978e885-8208-4276-9aa8-cd8782b47e6f service nova] [instance: 5ede59da-37c6-4162-9e79-318f1a4a8aeb] Received event network-vif-deleted-9f629e06-9020-4e4b-956e-d33d9417c2a6 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:56:39 user nova-compute[74960]: INFO nova.compute.manager [req-ad0700d1-aa9a-4789-bd1e-90d6416e0f34 req-9978e885-8208-4276-9aa8-cd8782b47e6f service nova] [instance: 5ede59da-37c6-4162-9e79-318f1a4a8aeb] Neutron deleted interface 9f629e06-9020-4e4b-956e-d33d9417c2a6; detaching it from the instance and deleting it from the info cache
Nov 03 12:56:39 user nova-compute[74960]: DEBUG nova.network.neutron [req-ad0700d1-aa9a-4789-bd1e-90d6416e0f34 req-9978e885-8208-4276-9aa8-cd8782b47e6f service nova] [instance: 5ede59da-37c6-4162-9e79-318f1a4a8aeb] Updating instance_info_cache with network_info: [] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:56:39 user nova-compute[74960]: DEBUG nova.compute.manager [req-ad0700d1-aa9a-4789-bd1e-90d6416e0f34 req-9978e885-8208-4276-9aa8-cd8782b47e6f service nova] [instance: 5ede59da-37c6-4162-9e79-318f1a4a8aeb] Detach interface failed, port_id=9f629e06-9020-4e4b-956e-d33d9417c2a6, reason: Instance 5ede59da-37c6-4162-9e79-318f1a4a8aeb could not be found. {{(pid=74960) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 03 12:56:39 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-ca6d7f04-ee6d-473e-9a00-9c5565535560 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:56:39 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-ca6d7f04-ee6d-473e-9a00-9c5565535560 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:56:39 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-ca6d7f04-ee6d-473e-9a00-9c5565535560 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:56:39 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-ca6d7f04-ee6d-473e-9a00-9c5565535560 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:56:39 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-ca6d7f04-ee6d-473e-9a00-9c5565535560 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.147s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:56:39 user nova-compute[74960]: INFO nova.scheduler.client.report [None req-ca6d7f04-ee6d-473e-9a00-9c5565535560 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Deleted allocations for instance 5ede59da-37c6-4162-9e79-318f1a4a8aeb
Nov 03 12:56:39 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-ca6d7f04-ee6d-473e-9a00-9c5565535560 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Lock "5ede59da-37c6-4162-9e79-318f1a4a8aeb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.930s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:56:39 user nova-compute[74960]: DEBUG nova.compute.manager [req-62021d9e-5f6b-4ffe-8a59-bf83c9968efa req-e5f51697-4969-46b3-952d-fee8dd4b1aee service nova] [instance: 5ede59da-37c6-4162-9e79-318f1a4a8aeb] Received event network-vif-plugged-9f629e06-9020-4e4b-956e-d33d9417c2a6 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:56:39 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-62021d9e-5f6b-4ffe-8a59-bf83c9968efa req-e5f51697-4969-46b3-952d-fee8dd4b1aee service nova] Acquiring lock "5ede59da-37c6-4162-9e79-318f1a4a8aeb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:56:39 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-62021d9e-5f6b-4ffe-8a59-bf83c9968efa req-e5f51697-4969-46b3-952d-fee8dd4b1aee service nova] Lock "5ede59da-37c6-4162-9e79-318f1a4a8aeb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:56:39 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-62021d9e-5f6b-4ffe-8a59-bf83c9968efa req-e5f51697-4969-46b3-952d-fee8dd4b1aee service nova] Lock "5ede59da-37c6-4162-9e79-318f1a4a8aeb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:56:39 user nova-compute[74960]: DEBUG nova.compute.manager [req-62021d9e-5f6b-4ffe-8a59-bf83c9968efa req-e5f51697-4969-46b3-952d-fee8dd4b1aee service nova] [instance: 5ede59da-37c6-4162-9e79-318f1a4a8aeb] No waiting events found dispatching network-vif-plugged-9f629e06-9020-4e4b-956e-d33d9417c2a6 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:56:39 user nova-compute[74960]: WARNING nova.compute.manager [req-62021d9e-5f6b-4ffe-8a59-bf83c9968efa req-e5f51697-4969-46b3-952d-fee8dd4b1aee service nova] [instance: 5ede59da-37c6-4162-9e79-318f1a4a8aeb] Received unexpected event network-vif-plugged-9f629e06-9020-4e4b-956e-d33d9417c2a6 for instance with vm_state deleted and task_state None.
Nov 03 12:56:43 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:56:44 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:56:48 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:56:49 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:56:53 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:56:58 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:56:58 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:56:58 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74960) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 12:56:58 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74960) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 12:56:58 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74960) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 12:56:58 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:57:03 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:57:06 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:57:08 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:57:13 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:57:13 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:57:13 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:57:13 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:57:13 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:57:13 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Auditing locally available compute resources for user (node: user) {{(pid=74960) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 12:57:13 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:57:13 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74960) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 12:57:13 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74960) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 12:57:13 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:57:13 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:57:13 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Hypervisor/Node resource view: name=user free_ram=8890MB free_disk=24.98828125GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74960) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 12:57:13 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:57:13 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:57:13 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 69d4b583-82eb-4c2f-ad42-f0028d04f6a6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:57:13 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 57ef7196-fc41-4908-b736-e450062af8b9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:57:13 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74960) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 12:57:13 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74960) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 12:57:13 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:57:13 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:57:14 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Compute_service record updated for user:user {{(pid=74960) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 12:57:14 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.200s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:57:18 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:57:18 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:57:18 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:57:18 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:57:18 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:57:19 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:57:19 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74960) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 12:57:21 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:57:21 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Starting heal instance info cache {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 12:57:21 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Rebuilding the list of instances to heal {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 03 12:57:21 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "refresh_cache-69d4b583-82eb-4c2f-ad42-f0028d04f6a6" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:57:21 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquired lock "refresh_cache-69d4b583-82eb-4c2f-ad42-f0028d04f6a6" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:57:21 user nova-compute[74960]: DEBUG nova.network.neutron [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: 69d4b583-82eb-4c2f-ad42-f0028d04f6a6] Forcefully refreshing network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 12:57:21 user nova-compute[74960]: DEBUG nova.objects.instance [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lazy-loading 'info_cache' on Instance uuid 69d4b583-82eb-4c2f-ad42-f0028d04f6a6 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:57:21 user nova-compute[74960]: DEBUG nova.network.neutron [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: 69d4b583-82eb-4c2f-ad42-f0028d04f6a6] Updating instance_info_cache with network_info: [{"id": "41b38ec9-5f6b-4451-83c6-1944cd2b80b5", "address": "fa:16:3e:5d:2f:62", "network": {"id": "8e985ab3-9852-4f07-8b5c-19f7bf113939", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781795302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d64f3d9dae8f45bcb2e0677a0076ed64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41b38ec9-5f", "ovs_interfaceid": "41b38ec9-5f6b-4451-83c6-1944cd2b80b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:57:21 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Releasing lock "refresh_cache-69d4b583-82eb-4c2f-ad42-f0028d04f6a6" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:57:21 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: 69d4b583-82eb-4c2f-ad42-f0028d04f6a6] Updated the network info_cache for instance {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 12:57:23 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:57:28 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:57:28 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:57:31 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-5b8e134b-acef-42a6-91c5-aa09b16e9c86 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Acquiring lock "61204546-6d78-4f0b-80ed-91eed8943fca" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:57:31 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-5b8e134b-acef-42a6-91c5-aa09b16e9c86 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Lock "61204546-6d78-4f0b-80ed-91eed8943fca" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:57:31 user nova-compute[74960]: DEBUG nova.compute.manager [None req-5b8e134b-acef-42a6-91c5-aa09b16e9c86 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 61204546-6d78-4f0b-80ed-91eed8943fca] Starting instance... {{(pid=74960) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 12:57:31 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-5b8e134b-acef-42a6-91c5-aa09b16e9c86 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:57:31 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-5b8e134b-acef-42a6-91c5-aa09b16e9c86 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:57:31 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-5b8e134b-acef-42a6-91c5-aa09b16e9c86 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74960) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 12:57:31 user nova-compute[74960]: INFO nova.compute.claims [None req-5b8e134b-acef-42a6-91c5-aa09b16e9c86 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 61204546-6d78-4f0b-80ed-91eed8943fca] Claim successful on node user
Nov 03 12:57:31 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-5b8e134b-acef-42a6-91c5-aa09b16e9c86 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:57:31 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-5b8e134b-acef-42a6-91c5-aa09b16e9c86 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:57:31 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-5b8e134b-acef-42a6-91c5-aa09b16e9c86 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.229s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:57:31 user nova-compute[74960]: DEBUG nova.compute.manager [None req-5b8e134b-acef-42a6-91c5-aa09b16e9c86 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 61204546-6d78-4f0b-80ed-91eed8943fca] Start building networks asynchronously for instance. {{(pid=74960) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 12:57:31 user nova-compute[74960]: DEBUG nova.compute.manager [None req-5b8e134b-acef-42a6-91c5-aa09b16e9c86 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 61204546-6d78-4f0b-80ed-91eed8943fca] Allocating IP information in the background. {{(pid=74960) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 12:57:31 user nova-compute[74960]: DEBUG nova.network.neutron [None req-5b8e134b-acef-42a6-91c5-aa09b16e9c86 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 61204546-6d78-4f0b-80ed-91eed8943fca] allocate_for_instance() {{(pid=74960) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 12:57:31 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-5b8e134b-acef-42a6-91c5-aa09b16e9c86 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 61204546-6d78-4f0b-80ed-91eed8943fca] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 12:57:31 user nova-compute[74960]: DEBUG nova.compute.manager [None req-5b8e134b-acef-42a6-91c5-aa09b16e9c86 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 61204546-6d78-4f0b-80ed-91eed8943fca] Start building block device mappings for instance. {{(pid=74960) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 12:57:31 user nova-compute[74960]: DEBUG nova.policy [None req-5b8e134b-acef-42a6-91c5-aa09b16e9c86 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c934e7c00ddd450087f904666473c0b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '255349fa349045ad8a554d3f818cdd2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74960) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 12:57:31 user nova-compute[74960]: DEBUG nova.compute.manager [None req-5b8e134b-acef-42a6-91c5-aa09b16e9c86 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 61204546-6d78-4f0b-80ed-91eed8943fca] Start spawning the instance on the hypervisor. {{(pid=74960) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 12:57:31 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-5b8e134b-acef-42a6-91c5-aa09b16e9c86 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 61204546-6d78-4f0b-80ed-91eed8943fca] Creating instance directory {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 12:57:31 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-5b8e134b-acef-42a6-91c5-aa09b16e9c86 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 61204546-6d78-4f0b-80ed-91eed8943fca] Creating image(s)
Nov 03 12:57:31 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-5b8e134b-acef-42a6-91c5-aa09b16e9c86 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Acquiring lock "/opt/stack/data/nova/instances/61204546-6d78-4f0b-80ed-91eed8943fca/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:57:31 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-5b8e134b-acef-42a6-91c5-aa09b16e9c86 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Lock "/opt/stack/data/nova/instances/61204546-6d78-4f0b-80ed-91eed8943fca/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:57:31 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-5b8e134b-acef-42a6-91c5-aa09b16e9c86 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Lock "/opt/stack/data/nova/instances/61204546-6d78-4f0b-80ed-91eed8943fca/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:57:31 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-5b8e134b-acef-42a6-91c5-aa09b16e9c86 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:57:32 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-5b8e134b-acef-42a6-91c5-aa09b16e9c86 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.181s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:57:32 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-5b8e134b-acef-42a6-91c5-aa09b16e9c86 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Acquiring lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:57:32 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-5b8e134b-acef-42a6-91c5-aa09b16e9c86 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:57:32 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-5b8e134b-acef-42a6-91c5-aa09b16e9c86 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:57:32 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-5b8e134b-acef-42a6-91c5-aa09b16e9c86 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.170s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:57:32 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-5b8e134b-acef-42a6-91c5-aa09b16e9c86 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910,backing_fmt=raw /opt/stack/data/nova/instances/61204546-6d78-4f0b-80ed-91eed8943fca/disk 1073741824 {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:57:32 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-5b8e134b-acef-42a6-91c5-aa09b16e9c86 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910,backing_fmt=raw /opt/stack/data/nova/instances/61204546-6d78-4f0b-80ed-91eed8943fca/disk 1073741824" returned: 0 in 0.049s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:57:32 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-5b8e134b-acef-42a6-91c5-aa09b16e9c86 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.226s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:57:32 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-5b8e134b-acef-42a6-91c5-aa09b16e9c86 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:57:32 user nova-compute[74960]: DEBUG nova.network.neutron [None req-5b8e134b-acef-42a6-91c5-aa09b16e9c86 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 61204546-6d78-4f0b-80ed-91eed8943fca] Successfully created port: 15f819d0-a4dc-4061-adbe-c9882a4832ea {{(pid=74960) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 12:57:32 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-5b8e134b-acef-42a6-91c5-aa09b16e9c86 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.183s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:57:32 user nova-compute[74960]: DEBUG nova.virt.disk.api [None req-5b8e134b-acef-42a6-91c5-aa09b16e9c86 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Checking if we can resize image /opt/stack/data/nova/instances/61204546-6d78-4f0b-80ed-91eed8943fca/disk. size=1073741824 {{(pid=74960) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 12:57:32 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-5b8e134b-acef-42a6-91c5-aa09b16e9c86 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204546-6d78-4f0b-80ed-91eed8943fca/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:57:32 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-5b8e134b-acef-42a6-91c5-aa09b16e9c86 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204546-6d78-4f0b-80ed-91eed8943fca/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:57:32 user nova-compute[74960]: DEBUG nova.virt.disk.api [None req-5b8e134b-acef-42a6-91c5-aa09b16e9c86 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Cannot resize image /opt/stack/data/nova/instances/61204546-6d78-4f0b-80ed-91eed8943fca/disk to a smaller size. {{(pid=74960) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 12:57:32 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-5b8e134b-acef-42a6-91c5-aa09b16e9c86 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 61204546-6d78-4f0b-80ed-91eed8943fca] Created local disks {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 12:57:32 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-5b8e134b-acef-42a6-91c5-aa09b16e9c86 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 61204546-6d78-4f0b-80ed-91eed8943fca] Ensure instance console log exists: /opt/stack/data/nova/instances/61204546-6d78-4f0b-80ed-91eed8943fca/console.log {{(pid=74960) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 12:57:32 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-5b8e134b-acef-42a6-91c5-aa09b16e9c86 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:57:32 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-5b8e134b-acef-42a6-91c5-aa09b16e9c86 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:57:32 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-5b8e134b-acef-42a6-91c5-aa09b16e9c86 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:57:33 user nova-compute[74960]: DEBUG nova.network.neutron [None req-5b8e134b-acef-42a6-91c5-aa09b16e9c86 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 61204546-6d78-4f0b-80ed-91eed8943fca] Successfully updated port: 15f819d0-a4dc-4061-adbe-c9882a4832ea {{(pid=74960) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 12:57:33 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-5b8e134b-acef-42a6-91c5-aa09b16e9c86 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Acquiring lock "refresh_cache-61204546-6d78-4f0b-80ed-91eed8943fca" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:57:33 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-5b8e134b-acef-42a6-91c5-aa09b16e9c86 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Acquired lock "refresh_cache-61204546-6d78-4f0b-80ed-91eed8943fca" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:57:33 user nova-compute[74960]: DEBUG nova.network.neutron [None req-5b8e134b-acef-42a6-91c5-aa09b16e9c86 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 61204546-6d78-4f0b-80ed-91eed8943fca] Building network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 12:57:33 user nova-compute[74960]: DEBUG nova.compute.manager [req-78334027-f144-40be-b2dc-a0e548769d3c req-9c7a605d-8731-4b34-8e55-5ca5a81b6eb5 service nova] [instance: 61204546-6d78-4f0b-80ed-91eed8943fca] Received event network-changed-15f819d0-a4dc-4061-adbe-c9882a4832ea {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:57:33 user nova-compute[74960]: DEBUG nova.compute.manager [req-78334027-f144-40be-b2dc-a0e548769d3c req-9c7a605d-8731-4b34-8e55-5ca5a81b6eb5 service nova] [instance: 61204546-6d78-4f0b-80ed-91eed8943fca] Refreshing instance network info cache due to event network-changed-15f819d0-a4dc-4061-adbe-c9882a4832ea. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 12:57:33 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-78334027-f144-40be-b2dc-a0e548769d3c req-9c7a605d-8731-4b34-8e55-5ca5a81b6eb5 service nova] Acquiring lock "refresh_cache-61204546-6d78-4f0b-80ed-91eed8943fca" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:57:33 user nova-compute[74960]: DEBUG nova.network.neutron [None req-5b8e134b-acef-42a6-91c5-aa09b16e9c86 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 61204546-6d78-4f0b-80ed-91eed8943fca] Instance cache missing network info. {{(pid=74960) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 12:57:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:57:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:57:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74960) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 12:57:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74960) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 12:57:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74960) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 12:57:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:57:33 user nova-compute[74960]: DEBUG nova.network.neutron [None req-5b8e134b-acef-42a6-91c5-aa09b16e9c86 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 61204546-6d78-4f0b-80ed-91eed8943fca] Updating instance_info_cache with network_info: [{"id": "15f819d0-a4dc-4061-adbe-c9882a4832ea", "address": "fa:16:3e:95:b0:7b", "network": {"id": "c50fc382-c1b9-49d8-8e38-ac681cbbcffd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1465428328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "255349fa349045ad8a554d3f818cdd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15f819d0-a4", "ovs_interfaceid": "15f819d0-a4dc-4061-adbe-c9882a4832ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:57:33 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-5b8e134b-acef-42a6-91c5-aa09b16e9c86 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Releasing lock "refresh_cache-61204546-6d78-4f0b-80ed-91eed8943fca" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:57:33 user nova-compute[74960]: DEBUG nova.compute.manager [None req-5b8e134b-acef-42a6-91c5-aa09b16e9c86 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 61204546-6d78-4f0b-80ed-91eed8943fca] Instance network_info: |[{"id": "15f819d0-a4dc-4061-adbe-c9882a4832ea", "address": "fa:16:3e:95:b0:7b", "network": {"id": "c50fc382-c1b9-49d8-8e38-ac681cbbcffd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1465428328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "255349fa349045ad8a554d3f818cdd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15f819d0-a4", "ovs_interfaceid": "15f819d0-a4dc-4061-adbe-c9882a4832ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74960) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 12:57:33 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-78334027-f144-40be-b2dc-a0e548769d3c req-9c7a605d-8731-4b34-8e55-5ca5a81b6eb5 service nova] Acquired lock "refresh_cache-61204546-6d78-4f0b-80ed-91eed8943fca" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:57:33 user nova-compute[74960]: DEBUG nova.network.neutron [req-78334027-f144-40be-b2dc-a0e548769d3c req-9c7a605d-8731-4b34-8e55-5ca5a81b6eb5 service nova] [instance: 61204546-6d78-4f0b-80ed-91eed8943fca] Refreshing network info cache for port 15f819d0-a4dc-4061-adbe-c9882a4832ea {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 12:57:33 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-5b8e134b-acef-42a6-91c5-aa09b16e9c86 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 61204546-6d78-4f0b-80ed-91eed8943fca] Start _get_guest_xml network_info=[{"id": "15f819d0-a4dc-4061-adbe-c9882a4832ea", "address": "fa:16:3e:95:b0:7b", "network": {"id": "c50fc382-c1b9-49d8-8e38-ac681cbbcffd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1465428328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "255349fa349045ad8a554d3f818cdd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15f819d0-a4", "ovs_interfaceid": "15f819d0-a4dc-4061-adbe-c9882a4832ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=549f51ba-ac69-494b-8de1-34635aa2d7cf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='63ee9c80c632442fb0379f47b784bd20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T12:13:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'image_id': '549f51ba-ac69-494b-8de1-34635aa2d7cf'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 12:57:33 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-5b8e134b-acef-42a6-91c5-aa09b16e9c86 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:57:33 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-5b8e134b-acef-42a6-91c5-aa09b16e9c86 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:57:33 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-5b8e134b-acef-42a6-91c5-aa09b16e9c86 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 12:57:33 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-5b8e134b-acef-42a6-91c5-aa09b16e9c86 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] CPU controller missing on host. {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 12:57:33 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-5b8e134b-acef-42a6-91c5-aa09b16e9c86 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 12:57:33 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-5b8e134b-acef-42a6-91c5-aa09b16e9c86 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] CPU controller found on host. {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 12:57:33 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-5b8e134b-acef-42a6-91c5-aa09b16e9c86 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74960) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 12:57:33 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-5b8e134b-acef-42a6-91c5-aa09b16e9c86 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=549f51ba-ac69-494b-8de1-34635aa2d7cf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='63ee9c80c632442fb0379f47b784bd20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T12:13:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 12:57:33 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-5b8e134b-acef-42a6-91c5-aa09b16e9c86 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Flavor limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 12:57:33 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-5b8e134b-acef-42a6-91c5-aa09b16e9c86 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Image limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 12:57:33 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-5b8e134b-acef-42a6-91c5-aa09b16e9c86 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Flavor pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 12:57:33 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-5b8e134b-acef-42a6-91c5-aa09b16e9c86 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Image pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 12:57:33 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-5b8e134b-acef-42a6-91c5-aa09b16e9c86 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 12:57:33 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-5b8e134b-acef-42a6-91c5-aa09b16e9c86 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 12:57:33 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-5b8e134b-acef-42a6-91c5-aa09b16e9c86 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 12:57:33 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-5b8e134b-acef-42a6-91c5-aa09b16e9c86 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Got 1 possible topologies {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 12:57:33 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-5b8e134b-acef-42a6-91c5-aa09b16e9c86 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 12:57:33 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-5b8e134b-acef-42a6-91c5-aa09b16e9c86 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 12:57:33 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-5b8e134b-acef-42a6-91c5-aa09b16e9c86 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:57:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-463884316',display_name='tempest-AttachVolumeNegativeTest-server-463884316',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-463884316',id=48,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBET78hRoaEhMVsau6YD3rCunlURf2De1+AqxvpVzXPPOpfhOlkMnnr901aGNyqYrrWtzW7CGpwwNamnP92gyNciZfoSUdkVtPZMl9ajDYz3Ry5WZS6jWtR0onWQMc7R9cA==',key_name='tempest-keypair-921939513',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='255349fa349045ad8a554d3f818cdd2e',ramdisk_id='',reservation_id='r-eliitjv8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-787890049',owner_user_name='tempest-AttachVolumeNegativeTest-787890049-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:57:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c934e7c00ddd450087f904666473c0b4',uuid=61204546-6d78-4f0b-80ed-91eed8943fca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "15f819d0-a4dc-4061-adbe-c9882a4832ea", "address": "fa:16:3e:95:b0:7b", "network": {"id": "c50fc382-c1b9-49d8-8e38-ac681cbbcffd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1465428328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "255349fa349045ad8a554d3f818cdd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15f819d0-a4", "ovs_interfaceid": "15f819d0-a4dc-4061-adbe-c9882a4832ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74960) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 12:57:33 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-5b8e134b-acef-42a6-91c5-aa09b16e9c86 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Converting VIF {"id": "15f819d0-a4dc-4061-adbe-c9882a4832ea", "address": "fa:16:3e:95:b0:7b", "network": {"id": "c50fc382-c1b9-49d8-8e38-ac681cbbcffd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1465428328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "255349fa349045ad8a554d3f818cdd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15f819d0-a4", "ovs_interfaceid": "15f819d0-a4dc-4061-adbe-c9882a4832ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:57:33 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-5b8e134b-acef-42a6-91c5-aa09b16e9c86 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:b0:7b,bridge_name='br-int',has_traffic_filtering=True,id=15f819d0-a4dc-4061-adbe-c9882a4832ea,network=Network(c50fc382-c1b9-49d8-8e38-ac681cbbcffd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15f819d0-a4') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:57:33 user nova-compute[74960]: DEBUG nova.objects.instance [None req-5b8e134b-acef-42a6-91c5-aa09b16e9c86 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Lazy-loading 'pci_devices' on Instance uuid 61204546-6d78-4f0b-80ed-91eed8943fca {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:57:33 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-5b8e134b-acef-42a6-91c5-aa09b16e9c86 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 61204546-6d78-4f0b-80ed-91eed8943fca] End _get_guest_xml xml=<domain type="kvm">
Nov 03 12:57:33 user nova-compute[74960]:   <uuid>61204546-6d78-4f0b-80ed-91eed8943fca</uuid>
Nov 03 12:57:33 user nova-compute[74960]:   <name>instance-00000030</name>
Nov 03 12:57:33 user nova-compute[74960]:   <memory>524288</memory>
Nov 03 12:57:33 user nova-compute[74960]:   <vcpu>1</vcpu>
Nov 03 12:57:33 user nova-compute[74960]:   <metadata>
Nov 03 12:57:33 user nova-compute[74960]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 12:57:33 user nova-compute[74960]:       <nova:package version="0.0.0"/>
Nov 03 12:57:33 user nova-compute[74960]:       <nova:name>tempest-AttachVolumeNegativeTest-server-463884316</nova:name>
Nov 03 12:57:33 user nova-compute[74960]:       <nova:creationTime>2023-11-03 12:57:33</nova:creationTime>
Nov 03 12:57:33 user nova-compute[74960]:       <nova:flavor name="m1.tiny">
Nov 03 12:57:33 user nova-compute[74960]:         <nova:memory>512</nova:memory>
Nov 03 12:57:33 user nova-compute[74960]:         <nova:disk>1</nova:disk>
Nov 03 12:57:33 user nova-compute[74960]:         <nova:swap>0</nova:swap>
Nov 03 12:57:33 user nova-compute[74960]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 12:57:33 user nova-compute[74960]:         <nova:vcpus>1</nova:vcpus>
Nov 03 12:57:33 user nova-compute[74960]:       </nova:flavor>
Nov 03 12:57:33 user nova-compute[74960]:       <nova:owner>
Nov 03 12:57:33 user nova-compute[74960]:         <nova:user uuid="c934e7c00ddd450087f904666473c0b4">tempest-AttachVolumeNegativeTest-787890049-project-member</nova:user>
Nov 03 12:57:33 user nova-compute[74960]:         <nova:project uuid="255349fa349045ad8a554d3f818cdd2e">tempest-AttachVolumeNegativeTest-787890049</nova:project>
Nov 03 12:57:33 user nova-compute[74960]:       </nova:owner>
Nov 03 12:57:33 user nova-compute[74960]:       <nova:root type="image" uuid="549f51ba-ac69-494b-8de1-34635aa2d7cf"/>
Nov 03 12:57:33 user nova-compute[74960]:       <nova:ports>
Nov 03 12:57:33 user nova-compute[74960]:         <nova:port uuid="15f819d0-a4dc-4061-adbe-c9882a4832ea">
Nov 03 12:57:33 user nova-compute[74960]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 03 12:57:33 user nova-compute[74960]:         </nova:port>
Nov 03 12:57:33 user nova-compute[74960]:       </nova:ports>
Nov 03 12:57:33 user nova-compute[74960]:     </nova:instance>
Nov 03 12:57:33 user nova-compute[74960]:   </metadata>
Nov 03 12:57:33 user nova-compute[74960]:   <sysinfo type="smbios">
Nov 03 12:57:33 user nova-compute[74960]:     <system>
Nov 03 12:57:33 user nova-compute[74960]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 12:57:33 user nova-compute[74960]:       <entry name="product">OpenStack Nova</entry>
Nov 03 12:57:33 user nova-compute[74960]:       <entry name="version">0.0.0</entry>
Nov 03 12:57:33 user nova-compute[74960]:       <entry name="serial">61204546-6d78-4f0b-80ed-91eed8943fca</entry>
Nov 03 12:57:33 user nova-compute[74960]:       <entry name="uuid">61204546-6d78-4f0b-80ed-91eed8943fca</entry>
Nov 03 12:57:33 user nova-compute[74960]:       <entry name="family">Virtual Machine</entry>
Nov 03 12:57:33 user nova-compute[74960]:     </system>
Nov 03 12:57:33 user nova-compute[74960]:   </sysinfo>
Nov 03 12:57:33 user nova-compute[74960]:   <os>
Nov 03 12:57:33 user nova-compute[74960]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 12:57:33 user nova-compute[74960]:     <boot dev="hd"/>
Nov 03 12:57:33 user nova-compute[74960]:     <smbios mode="sysinfo"/>
Nov 03 12:57:33 user nova-compute[74960]:   </os>
Nov 03 12:57:33 user nova-compute[74960]:   <features>
Nov 03 12:57:33 user nova-compute[74960]:     <acpi/>
Nov 03 12:57:33 user nova-compute[74960]:     <apic/>
Nov 03 12:57:33 user nova-compute[74960]:     <vmcoreinfo/>
Nov 03 12:57:33 user nova-compute[74960]:   </features>
Nov 03 12:57:33 user nova-compute[74960]:   <clock offset="utc">
Nov 03 12:57:33 user nova-compute[74960]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 12:57:33 user nova-compute[74960]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 12:57:33 user nova-compute[74960]:     <timer name="hpet" present="no"/>
Nov 03 12:57:33 user nova-compute[74960]:   </clock>
Nov 03 12:57:33 user nova-compute[74960]:   <cpu mode="custom" match="exact">
Nov 03 12:57:33 user nova-compute[74960]:     <model>Nehalem</model>
Nov 03 12:57:33 user nova-compute[74960]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 12:57:33 user nova-compute[74960]:   </cpu>
Nov 03 12:57:33 user nova-compute[74960]:   <devices>
Nov 03 12:57:33 user nova-compute[74960]:     <disk type="file" device="disk">
Nov 03 12:57:33 user nova-compute[74960]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 12:57:33 user nova-compute[74960]:       <source file="/opt/stack/data/nova/instances/61204546-6d78-4f0b-80ed-91eed8943fca/disk"/>
Nov 03 12:57:33 user nova-compute[74960]:       <target dev="vda" bus="virtio"/>
Nov 03 12:57:33 user nova-compute[74960]:     </disk>
Nov 03 12:57:33 user nova-compute[74960]:     <interface type="ethernet">
Nov 03 12:57:33 user nova-compute[74960]:       <mac address="fa:16:3e:95:b0:7b"/>
Nov 03 12:57:33 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:57:33 user nova-compute[74960]:       <mtu size="1442"/>
Nov 03 12:57:33 user nova-compute[74960]:       <target dev="tap15f819d0-a4"/>
Nov 03 12:57:33 user nova-compute[74960]:     </interface>
Nov 03 12:57:33 user nova-compute[74960]:     <serial type="pty">
Nov 03 12:57:33 user nova-compute[74960]:       <log file="/opt/stack/data/nova/instances/61204546-6d78-4f0b-80ed-91eed8943fca/console.log" append="off"/>
Nov 03 12:57:33 user nova-compute[74960]:     </serial>
Nov 03 12:57:33 user nova-compute[74960]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 12:57:33 user nova-compute[74960]:     <video>
Nov 03 12:57:33 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 12:57:33 user nova-compute[74960]:     </video>
Nov 03 12:57:33 user nova-compute[74960]:     <rng model="virtio">
Nov 03 12:57:33 user nova-compute[74960]:       <backend model="random">/dev/urandom</backend>
Nov 03 12:57:33 user nova-compute[74960]:     </rng>
Nov 03 12:57:33 user nova-compute[74960]:     <controller type="usb" index="0" model="none"/>
Nov 03 12:57:33 user nova-compute[74960]:     <memballoon model="virtio">
Nov 03 12:57:33 user nova-compute[74960]:       <stats period="10"/>
Nov 03 12:57:33 user nova-compute[74960]:     </memballoon>
Nov 03 12:57:33 user nova-compute[74960]:   </devices>
Nov 03 12:57:33 user nova-compute[74960]: </domain>
Nov 03 12:57:33 user nova-compute[74960]:  {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 12:57:33 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-5b8e134b-acef-42a6-91c5-aa09b16e9c86 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:57:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-463884316',display_name='tempest-AttachVolumeNegativeTest-server-463884316',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-463884316',id=48,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBET78hRoaEhMVsau6YD3rCunlURf2De1+AqxvpVzXPPOpfhOlkMnnr901aGNyqYrrWtzW7CGpwwNamnP92gyNciZfoSUdkVtPZMl9ajDYz3Ry5WZS6jWtR0onWQMc7R9cA==',key_name='tempest-keypair-921939513',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='255349fa349045ad8a554d3f818cdd2e',ramdisk_id='',reservation_id='r-eliitjv8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-787890049',owner_user_name='tempest-AttachVolumeNegativeTest-787890049-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:57:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c934e7c00ddd450087f904666473c0b4',uuid=61204546-6d78-4f0b-80ed-91eed8943fca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "15f819d0-a4dc-4061-adbe-c9882a4832ea", "address": "fa:16:3e:95:b0:7b", "network": {"id": "c50fc382-c1b9-49d8-8e38-ac681cbbcffd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1465428328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "255349fa349045ad8a554d3f818cdd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15f819d0-a4", "ovs_interfaceid": "15f819d0-a4dc-4061-adbe-c9882a4832ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 12:57:33 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-5b8e134b-acef-42a6-91c5-aa09b16e9c86 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Converting VIF {"id": "15f819d0-a4dc-4061-adbe-c9882a4832ea", "address": "fa:16:3e:95:b0:7b", "network": {"id": "c50fc382-c1b9-49d8-8e38-ac681cbbcffd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1465428328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "255349fa349045ad8a554d3f818cdd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15f819d0-a4", "ovs_interfaceid": "15f819d0-a4dc-4061-adbe-c9882a4832ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:57:33 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-5b8e134b-acef-42a6-91c5-aa09b16e9c86 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:b0:7b,bridge_name='br-int',has_traffic_filtering=True,id=15f819d0-a4dc-4061-adbe-c9882a4832ea,network=Network(c50fc382-c1b9-49d8-8e38-ac681cbbcffd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15f819d0-a4') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:57:33 user nova-compute[74960]: DEBUG os_vif [None req-5b8e134b-acef-42a6-91c5-aa09b16e9c86 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:b0:7b,bridge_name='br-int',has_traffic_filtering=True,id=15f819d0-a4dc-4061-adbe-c9882a4832ea,network=Network(c50fc382-c1b9-49d8-8e38-ac681cbbcffd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15f819d0-a4') {{(pid=74960) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 12:57:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:57:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:57:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 12:57:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:57:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f0091d6f-0281-5a5e-88aa-8f5d86ef0a16', '_type': 'linux-noop'}}, row=False) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:57:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:57:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:57:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:57:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap15f819d0-a4, may_exist=True, interface_attrs={}) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:57:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap15f819d0-a4, col_values=(('qos', UUID('dbd5e873-d48b-4b9d-b682-31fdb0d74fec')),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:57:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap15f819d0-a4, col_values=(('external_ids', {'iface-id': '15f819d0-a4dc-4061-adbe-c9882a4832ea', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:95:b0:7b', 'vm-uuid': '61204546-6d78-4f0b-80ed-91eed8943fca'}),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:57:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:57:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:57:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:57:33 user nova-compute[74960]: INFO os_vif [None req-5b8e134b-acef-42a6-91c5-aa09b16e9c86 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:b0:7b,bridge_name='br-int',has_traffic_filtering=True,id=15f819d0-a4dc-4061-adbe-c9882a4832ea,network=Network(c50fc382-c1b9-49d8-8e38-ac681cbbcffd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15f819d0-a4')
Nov 03 12:57:33 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-5b8e134b-acef-42a6-91c5-aa09b16e9c86 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] No BDM found with device name vda, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:57:33 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-5b8e134b-acef-42a6-91c5-aa09b16e9c86 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] No VIF found with MAC fa:16:3e:95:b0:7b, not building metadata {{(pid=74960) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 12:57:33 user nova-compute[74960]: DEBUG nova.network.neutron [req-78334027-f144-40be-b2dc-a0e548769d3c req-9c7a605d-8731-4b34-8e55-5ca5a81b6eb5 service nova] [instance: 61204546-6d78-4f0b-80ed-91eed8943fca] Updated VIF entry in instance network info cache for port 15f819d0-a4dc-4061-adbe-c9882a4832ea. {{(pid=74960) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 12:57:33 user nova-compute[74960]: DEBUG nova.network.neutron [req-78334027-f144-40be-b2dc-a0e548769d3c req-9c7a605d-8731-4b34-8e55-5ca5a81b6eb5 service nova] [instance: 61204546-6d78-4f0b-80ed-91eed8943fca] Updating instance_info_cache with network_info: [{"id": "15f819d0-a4dc-4061-adbe-c9882a4832ea", "address": "fa:16:3e:95:b0:7b", "network": {"id": "c50fc382-c1b9-49d8-8e38-ac681cbbcffd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1465428328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "255349fa349045ad8a554d3f818cdd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15f819d0-a4", "ovs_interfaceid": "15f819d0-a4dc-4061-adbe-c9882a4832ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:57:33 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-78334027-f144-40be-b2dc-a0e548769d3c req-9c7a605d-8731-4b34-8e55-5ca5a81b6eb5 service nova] Releasing lock "refresh_cache-61204546-6d78-4f0b-80ed-91eed8943fca" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:57:34 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:57:34 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:57:34 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:57:34 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:57:35 user nova-compute[74960]: DEBUG nova.compute.manager [req-5f2271d9-684f-4a64-ac7f-928e7241f2e2 req-6dba02a0-b9d5-4fe6-b1c2-79e9fc0a9ed8 service nova] [instance: 61204546-6d78-4f0b-80ed-91eed8943fca] Received event network-vif-plugged-15f819d0-a4dc-4061-adbe-c9882a4832ea {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:57:35 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-5f2271d9-684f-4a64-ac7f-928e7241f2e2 req-6dba02a0-b9d5-4fe6-b1c2-79e9fc0a9ed8 service nova] Acquiring lock "61204546-6d78-4f0b-80ed-91eed8943fca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:57:35 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-5f2271d9-684f-4a64-ac7f-928e7241f2e2 req-6dba02a0-b9d5-4fe6-b1c2-79e9fc0a9ed8 service nova] Lock "61204546-6d78-4f0b-80ed-91eed8943fca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:57:35 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-5f2271d9-684f-4a64-ac7f-928e7241f2e2 req-6dba02a0-b9d5-4fe6-b1c2-79e9fc0a9ed8 service nova] Lock "61204546-6d78-4f0b-80ed-91eed8943fca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:57:35 user nova-compute[74960]: DEBUG nova.compute.manager [req-5f2271d9-684f-4a64-ac7f-928e7241f2e2 req-6dba02a0-b9d5-4fe6-b1c2-79e9fc0a9ed8 service nova] [instance: 61204546-6d78-4f0b-80ed-91eed8943fca] No waiting events found dispatching network-vif-plugged-15f819d0-a4dc-4061-adbe-c9882a4832ea {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:57:35 user nova-compute[74960]: WARNING nova.compute.manager [req-5f2271d9-684f-4a64-ac7f-928e7241f2e2 req-6dba02a0-b9d5-4fe6-b1c2-79e9fc0a9ed8 service nova] [instance: 61204546-6d78-4f0b-80ed-91eed8943fca] Received unexpected event network-vif-plugged-15f819d0-a4dc-4061-adbe-c9882a4832ea for instance with vm_state building and task_state spawning.
Nov 03 12:57:35 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:57:35 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:57:35 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:57:37 user nova-compute[74960]: DEBUG nova.compute.manager [None req-5b8e134b-acef-42a6-91c5-aa09b16e9c86 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 61204546-6d78-4f0b-80ed-91eed8943fca] Instance event wait completed in 0 seconds for  {{(pid=74960) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 12:57:37 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-5b8e134b-acef-42a6-91c5-aa09b16e9c86 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 61204546-6d78-4f0b-80ed-91eed8943fca] Guest created on hypervisor {{(pid=74960) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 12:57:37 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: 61204546-6d78-4f0b-80ed-91eed8943fca] Instance spawned successfully.
Nov 03 12:57:37 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-5b8e134b-acef-42a6-91c5-aa09b16e9c86 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 61204546-6d78-4f0b-80ed-91eed8943fca] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 12:57:37 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-5b8e134b-acef-42a6-91c5-aa09b16e9c86 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 61204546-6d78-4f0b-80ed-91eed8943fca] Found default for hw_cdrom_bus of ide {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:57:37 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-5b8e134b-acef-42a6-91c5-aa09b16e9c86 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 61204546-6d78-4f0b-80ed-91eed8943fca] Found default for hw_disk_bus of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:57:37 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-5b8e134b-acef-42a6-91c5-aa09b16e9c86 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 61204546-6d78-4f0b-80ed-91eed8943fca] Found default for hw_input_bus of None {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:57:37 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-5b8e134b-acef-42a6-91c5-aa09b16e9c86 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 61204546-6d78-4f0b-80ed-91eed8943fca] Found default for hw_pointer_model of None {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:57:37 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-5b8e134b-acef-42a6-91c5-aa09b16e9c86 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 61204546-6d78-4f0b-80ed-91eed8943fca] Found default for hw_video_model of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:57:37 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-5b8e134b-acef-42a6-91c5-aa09b16e9c86 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 61204546-6d78-4f0b-80ed-91eed8943fca] Found default for hw_vif_model of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 12:57:37 user nova-compute[74960]: INFO nova.compute.manager [None req-5b8e134b-acef-42a6-91c5-aa09b16e9c86 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 61204546-6d78-4f0b-80ed-91eed8943fca] Took 5.21 seconds to spawn the instance on the hypervisor.
Nov 03 12:57:37 user nova-compute[74960]: DEBUG nova.compute.manager [None req-5b8e134b-acef-42a6-91c5-aa09b16e9c86 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 61204546-6d78-4f0b-80ed-91eed8943fca] Checking state {{(pid=74960) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 12:57:37 user nova-compute[74960]: INFO nova.compute.manager [None req-5b8e134b-acef-42a6-91c5-aa09b16e9c86 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 61204546-6d78-4f0b-80ed-91eed8943fca] Took 5.76 seconds to build instance.
Nov 03 12:57:37 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-5b8e134b-acef-42a6-91c5-aa09b16e9c86 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Lock "61204546-6d78-4f0b-80ed-91eed8943fca" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.866s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:57:37 user nova-compute[74960]: DEBUG nova.compute.manager [req-9600d3f2-3ce1-42b1-85af-4bb156956045 req-2169c72f-a19a-42d9-9c90-65090dd473ce service nova] [instance: 61204546-6d78-4f0b-80ed-91eed8943fca] Received event network-vif-plugged-15f819d0-a4dc-4061-adbe-c9882a4832ea {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:57:37 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-9600d3f2-3ce1-42b1-85af-4bb156956045 req-2169c72f-a19a-42d9-9c90-65090dd473ce service nova] Acquiring lock "61204546-6d78-4f0b-80ed-91eed8943fca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:57:37 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-9600d3f2-3ce1-42b1-85af-4bb156956045 req-2169c72f-a19a-42d9-9c90-65090dd473ce service nova] Lock "61204546-6d78-4f0b-80ed-91eed8943fca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:57:37 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-9600d3f2-3ce1-42b1-85af-4bb156956045 req-2169c72f-a19a-42d9-9c90-65090dd473ce service nova] Lock "61204546-6d78-4f0b-80ed-91eed8943fca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:57:37 user nova-compute[74960]: DEBUG nova.compute.manager [req-9600d3f2-3ce1-42b1-85af-4bb156956045 req-2169c72f-a19a-42d9-9c90-65090dd473ce service nova] [instance: 61204546-6d78-4f0b-80ed-91eed8943fca] No waiting events found dispatching network-vif-plugged-15f819d0-a4dc-4061-adbe-c9882a4832ea {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:57:37 user nova-compute[74960]: WARNING nova.compute.manager [req-9600d3f2-3ce1-42b1-85af-4bb156956045 req-2169c72f-a19a-42d9-9c90-65090dd473ce service nova] [instance: 61204546-6d78-4f0b-80ed-91eed8943fca] Received unexpected event network-vif-plugged-15f819d0-a4dc-4061-adbe-c9882a4832ea for instance with vm_state active and task_state None.
Nov 03 12:57:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:57:39 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:57:39 user nova-compute[74960]: DEBUG nova.compute.manager [req-23edd509-5430-44bf-af9b-cd0fe407956c req-6016d75f-1e94-47fa-bc08-433899d509f3 service nova] [instance: 57ef7196-fc41-4908-b736-e450062af8b9] Received event network-changed-cdb25946-24f2-4251-9208-93dee5791093 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:57:39 user nova-compute[74960]: DEBUG nova.compute.manager [req-23edd509-5430-44bf-af9b-cd0fe407956c req-6016d75f-1e94-47fa-bc08-433899d509f3 service nova] [instance: 57ef7196-fc41-4908-b736-e450062af8b9] Refreshing instance network info cache due to event network-changed-cdb25946-24f2-4251-9208-93dee5791093. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 12:57:39 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-23edd509-5430-44bf-af9b-cd0fe407956c req-6016d75f-1e94-47fa-bc08-433899d509f3 service nova] Acquiring lock "refresh_cache-57ef7196-fc41-4908-b736-e450062af8b9" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:57:39 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-23edd509-5430-44bf-af9b-cd0fe407956c req-6016d75f-1e94-47fa-bc08-433899d509f3 service nova] Acquired lock "refresh_cache-57ef7196-fc41-4908-b736-e450062af8b9" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:57:39 user nova-compute[74960]: DEBUG nova.network.neutron [req-23edd509-5430-44bf-af9b-cd0fe407956c req-6016d75f-1e94-47fa-bc08-433899d509f3 service nova] [instance: 57ef7196-fc41-4908-b736-e450062af8b9] Refreshing network info cache for port cdb25946-24f2-4251-9208-93dee5791093 {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 12:57:39 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-0b85d374-0998-4452-8753-58e4b0347d21 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Acquiring lock "57ef7196-fc41-4908-b736-e450062af8b9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:57:39 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-0b85d374-0998-4452-8753-58e4b0347d21 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lock "57ef7196-fc41-4908-b736-e450062af8b9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:57:39 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-0b85d374-0998-4452-8753-58e4b0347d21 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Acquiring lock "57ef7196-fc41-4908-b736-e450062af8b9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:57:39 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-0b85d374-0998-4452-8753-58e4b0347d21 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lock "57ef7196-fc41-4908-b736-e450062af8b9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:57:39 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-0b85d374-0998-4452-8753-58e4b0347d21 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lock "57ef7196-fc41-4908-b736-e450062af8b9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:57:39 user nova-compute[74960]: INFO nova.compute.manager [None req-0b85d374-0998-4452-8753-58e4b0347d21 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 57ef7196-fc41-4908-b736-e450062af8b9] Terminating instance
Nov 03 12:57:39 user nova-compute[74960]: DEBUG nova.compute.manager [None req-0b85d374-0998-4452-8753-58e4b0347d21 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 57ef7196-fc41-4908-b736-e450062af8b9] Start destroying the instance on the hypervisor. {{(pid=74960) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 12:57:39 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:57:39 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:57:39 user nova-compute[74960]: DEBUG nova.network.neutron [req-23edd509-5430-44bf-af9b-cd0fe407956c req-6016d75f-1e94-47fa-bc08-433899d509f3 service nova] [instance: 57ef7196-fc41-4908-b736-e450062af8b9] Updated VIF entry in instance network info cache for port cdb25946-24f2-4251-9208-93dee5791093. {{(pid=74960) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 12:57:39 user nova-compute[74960]: DEBUG nova.network.neutron [req-23edd509-5430-44bf-af9b-cd0fe407956c req-6016d75f-1e94-47fa-bc08-433899d509f3 service nova] [instance: 57ef7196-fc41-4908-b736-e450062af8b9] Updating instance_info_cache with network_info: [{"id": "cdb25946-24f2-4251-9208-93dee5791093", "address": "fa:16:3e:4a:44:45", "network": {"id": "8e985ab3-9852-4f07-8b5c-19f7bf113939", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781795302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d64f3d9dae8f45bcb2e0677a0076ed64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdb25946-24", "ovs_interfaceid": "cdb25946-24f2-4251-9208-93dee5791093", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:57:39 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-23edd509-5430-44bf-af9b-cd0fe407956c req-6016d75f-1e94-47fa-bc08-433899d509f3 service nova] Releasing lock "refresh_cache-57ef7196-fc41-4908-b736-e450062af8b9" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:57:39 user nova-compute[74960]: DEBUG nova.compute.manager [req-ee523517-8da4-479a-85b0-fea0362874bf req-130d7087-e99d-44c6-9881-1f12d3f13ed5 service nova] [instance: 57ef7196-fc41-4908-b736-e450062af8b9] Received event network-vif-unplugged-cdb25946-24f2-4251-9208-93dee5791093 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:57:39 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-ee523517-8da4-479a-85b0-fea0362874bf req-130d7087-e99d-44c6-9881-1f12d3f13ed5 service nova] Acquiring lock "57ef7196-fc41-4908-b736-e450062af8b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:57:39 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-ee523517-8da4-479a-85b0-fea0362874bf req-130d7087-e99d-44c6-9881-1f12d3f13ed5 service nova] Lock "57ef7196-fc41-4908-b736-e450062af8b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:57:39 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-ee523517-8da4-479a-85b0-fea0362874bf req-130d7087-e99d-44c6-9881-1f12d3f13ed5 service nova] Lock "57ef7196-fc41-4908-b736-e450062af8b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:57:39 user nova-compute[74960]: DEBUG nova.compute.manager [req-ee523517-8da4-479a-85b0-fea0362874bf req-130d7087-e99d-44c6-9881-1f12d3f13ed5 service nova] [instance: 57ef7196-fc41-4908-b736-e450062af8b9] No waiting events found dispatching network-vif-unplugged-cdb25946-24f2-4251-9208-93dee5791093 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:57:39 user nova-compute[74960]: DEBUG nova.compute.manager [req-ee523517-8da4-479a-85b0-fea0362874bf req-130d7087-e99d-44c6-9881-1f12d3f13ed5 service nova] [instance: 57ef7196-fc41-4908-b736-e450062af8b9] Received event network-vif-unplugged-cdb25946-24f2-4251-9208-93dee5791093 for instance with task_state deleting. {{(pid=74960) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 12:57:39 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:57:39 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:57:40 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: 57ef7196-fc41-4908-b736-e450062af8b9] Instance destroyed successfully.
Nov 03 12:57:40 user nova-compute[74960]: DEBUG nova.objects.instance [None req-0b85d374-0998-4452-8753-58e4b0347d21 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lazy-loading 'resources' on Instance uuid 57ef7196-fc41-4908-b736-e450062af8b9 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:57:40 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-0b85d374-0998-4452-8753-58e4b0347d21 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:55:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-2123879412',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-2123879412',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-2123879412',id=47,image_ref='4c0dbb93-6e09-467a-9ec6-a8208adb7d47',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGVfi9YQhBX9BGD6E7ov/5xfiE1lMVKuIUYwYA5MlZUolYztKSy1LOigss9ItDErFivSjlSO8z9yXupA+Y7d4ba9LJ2NVWqVo2uR1iOKsBbhnJZ6JWxUwGCI0Ye4bh3ueQ==',key_name='tempest-keypair-1745228905',keypairs=<?>,launch_index=0,launched_at=2023-11-03T12:56:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d64f3d9dae8f45bcb2e0677a0076ed64',ramdisk_id='',reservation_id='r-0fmwcod0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1795947051',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1795947051-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1795947051',owner_user_name='tempest-TestVolumeBootPattern-1795947051-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T12:56:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='067a3f33438b4112b818b91ecb4dd0d2',uuid=57ef7196-fc41-4908-b736-e450062af8b9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cdb25946-24f2-4251-9208-93dee5791093", "address": "fa:16:3e:4a:44:45", "network": {"id": "8e985ab3-9852-4f07-8b5c-19f7bf113939", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781795302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d64f3d9dae8f45bcb2e0677a0076ed64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdb25946-24", "ovs_interfaceid": "cdb25946-24f2-4251-9208-93dee5791093", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 12:57:40 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-0b85d374-0998-4452-8753-58e4b0347d21 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Converting VIF {"id": "cdb25946-24f2-4251-9208-93dee5791093", "address": "fa:16:3e:4a:44:45", "network": {"id": "8e985ab3-9852-4f07-8b5c-19f7bf113939", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781795302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d64f3d9dae8f45bcb2e0677a0076ed64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdb25946-24", "ovs_interfaceid": "cdb25946-24f2-4251-9208-93dee5791093", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:57:40 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-0b85d374-0998-4452-8753-58e4b0347d21 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:44:45,bridge_name='br-int',has_traffic_filtering=True,id=cdb25946-24f2-4251-9208-93dee5791093,network=Network(8e985ab3-9852-4f07-8b5c-19f7bf113939),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdb25946-24') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:57:40 user nova-compute[74960]: DEBUG os_vif [None req-0b85d374-0998-4452-8753-58e4b0347d21 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:44:45,bridge_name='br-int',has_traffic_filtering=True,id=cdb25946-24f2-4251-9208-93dee5791093,network=Network(8e985ab3-9852-4f07-8b5c-19f7bf113939),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdb25946-24') {{(pid=74960) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 12:57:40 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:57:40 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcdb25946-24, bridge=br-int, if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:57:40 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:57:40 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:57:40 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ebc50d29-1446-4b09-b425-87e29069632e) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:57:40 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:57:40 user nova-compute[74960]: INFO os_vif [None req-0b85d374-0998-4452-8753-58e4b0347d21 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:44:45,bridge_name='br-int',has_traffic_filtering=True,id=cdb25946-24f2-4251-9208-93dee5791093,network=Network(8e985ab3-9852-4f07-8b5c-19f7bf113939),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdb25946-24')
Nov 03 12:57:40 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b85d374-0998-4452-8753-58e4b0347d21 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 57ef7196-fc41-4908-b736-e450062af8b9] calling os-brick to detach iSCSI Volume {{(pid=74960) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 12:57:40 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b85d374-0998-4452-8753-58e4b0347d21 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9aa420acb0>, {'target_iqn': 'iqn.2010-10.org.openstack:db55b697-39c5-4df2-bea4-d925a4461ab2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ETfVzNPl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:57:40 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-0b85d374-0998-4452-8753-58e4b0347d21 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:57:40 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-0b85d374-0998-4452-8753-58e4b0347d21 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:57:40 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-0b85d374-0998-4452-8753-58e4b0347d21 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:57:40 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:57:40 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:57:40 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[0059963d-981e-4179-a10a-c2108135db1d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:db55b697-39c5-4df2-bea4-d925a4461ab2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f84524e4-0a06-482a-8b65-afd5dccfd016\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:57:40 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b85d374-0998-4452-8753-58e4b0347d21 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 12:57:40 user nova-compute[74960]: No targets found.
Nov 03 12:57:40 user nova-compute[74960]: iSNS:
Nov 03 12:57:40 user nova-compute[74960]: No targets found.
Nov 03 12:57:40 user nova-compute[74960]: STATIC:
Nov 03 12:57:40 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:db55b697-39c5-4df2-bea4-d925a4461ab2
Nov 03 12:57:40 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:57:40 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:57:40 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:f84524e4-0a06-482a-8b65-afd5dccfd016
Nov 03 12:57:40 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:57:40 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:57:40 user nova-compute[74960]: FIRMWARE:
Nov 03 12:57:40 user nova-compute[74960]: No targets found.
Nov 03 12:57:40 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:57:40 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b85d374-0998-4452-8753-58e4b0347d21 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 12:57:40 user nova-compute[74960]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 12:57:40 user nova-compute[74960]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74960) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 12:57:40 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b85d374-0998-4452-8753-58e4b0347d21 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db55b697-39c5-4df2-bea4-d925a4461ab2', 0)] {{(pid=74960) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 12:57:40 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:57:40 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:57:40 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ce89903-616d-402e-869b-1dc42f8b2c7c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db55b697-39c5-4df2-bea4-d925a4461ab2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f84524e4-0a06-482a-8b65-afd5dccfd016\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:57:40 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:57:40 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:57:40 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd2de03-88c6-4d21-8ac7-12a38c89bd7f]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84524e4-0a06-482a-8b65-afd5dccfd016 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db55b697-39c5-4df2-bea4-d925a4461ab2 (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:57:40 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b85d374-0998-4452-8753-58e4b0347d21 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84524e4-0a06-482a-8b65-afd5dccfd016 (non-flash)
Nov 03 12:57:40 user nova-compute[74960]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db55b697-39c5-4df2-bea4-d925a4461ab2 (non-flash)
Nov 03 12:57:40 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:57:40 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b85d374-0998-4452-8753-58e4b0347d21 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84524e4-0a06-482a-8b65-afd5dccfd016 (non-flash)
Nov 03 12:57:40 user nova-compute[74960]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db55b697-39c5-4df2-bea4-d925a4461ab2 (non-flash)
Nov 03 12:57:40 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:57:40 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b85d374-0998-4452-8753-58e4b0347d21 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9a8c47f520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db55b697-39c5-4df2-bea4-d925a4461ab2'): ({'sdb'}, set())}) {{(pid=74960) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 12:57:40 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-0b85d374-0998-4452-8753-58e4b0347d21 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Removing single pathed devices sdb {{(pid=74960) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 12:57:40 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:57:40 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:57:40 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[d394dcf6-dfc1-4e1d-96a8-a2d3ec892384]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:57:40 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:57:40 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:57:40 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb46a4e5-348b-4dae-a61c-2d01e480d9ce]: (4, ('ok\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:57:40 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-0b85d374-0998-4452-8753-58e4b0347d21 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Flushing IO for device /dev/sdb {{(pid=74960) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 12:57:40 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:57:40 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:57:40 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[904c8361-5b81-4ade-88b3-be2f43335431]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:57:40 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-0b85d374-0998-4452-8753-58e4b0347d21 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74960) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 12:57:40 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:57:40 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:57:40 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7d0eb3f-2f78-45fa-8229-926d76684fbb]: (4, ('1', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:57:40 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-0b85d374-0998-4452-8753-58e4b0347d21 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74960) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 12:57:40 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-0b85d374-0998-4452-8753-58e4b0347d21 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] SCSI volumes sdb have been removed. {{(pid=74960) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 12:57:40 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b85d374-0998-4452-8753-58e4b0347d21 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db55b697-39c5-4df2-bea4-d925a4461ab2')] {{(pid=74960) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 12:57:40 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db55b697-39c5-4df2-bea4-d925a4461ab2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:57:40 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db55b697-39c5-4df2-bea4-d925a4461ab2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:57:40 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[76394cc9-30b2-46ab-9e70-83b2bb3118eb]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:57:40 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b85d374-0998-4452-8753-58e4b0347d21 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:57:40 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db55b697-39c5-4df2-bea4-d925a4461ab2 -p 172.16.0.220:3260 --logout {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:57:40 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db55b697-39c5-4df2-bea4-d925a4461ab2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:57:40 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d437adf-7d0f-4171-8324-727d26dfd582]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:db55b697-39c5-4df2-bea4-d925a4461ab2, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:db55b697-39c5-4df2-bea4-d925a4461ab2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:57:40 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b85d374-0998-4452-8753-58e4b0347d21 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:db55b697-39c5-4df2-bea4-d925a4461ab2, portal: 172.16.0.220,3260]
Nov 03 12:57:40 user nova-compute[74960]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:db55b697-39c5-4df2-bea4-d925a4461ab2, portal: 172.16.0.220,3260] successful.
Nov 03 12:57:40 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:57:40 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db55b697-39c5-4df2-bea4-d925a4461ab2 -p 172.16.0.220:3260 --op delete {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:57:40 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db55b697-39c5-4df2-bea4-d925a4461ab2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:57:40 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[83c6e973-adab-4353-93e8-b46145d4d939]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:57:40 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b85d374-0998-4452-8753-58e4b0347d21 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:57:40 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-0b85d374-0998-4452-8753-58e4b0347d21 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:57:40 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b85d374-0998-4452-8753-58e4b0347d21 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] <== disconnect_volume: return (307ms) None {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:57:40 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b85d374-0998-4452-8753-58e4b0347d21 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 57ef7196-fc41-4908-b736-e450062af8b9] Disconnected iSCSI Volume {{(pid=74960) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 12:57:40 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-0b85d374-0998-4452-8753-58e4b0347d21 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 57ef7196-fc41-4908-b736-e450062af8b9] Deleting instance files /opt/stack/data/nova/instances/57ef7196-fc41-4908-b736-e450062af8b9_del
Nov 03 12:57:40 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-0b85d374-0998-4452-8753-58e4b0347d21 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 57ef7196-fc41-4908-b736-e450062af8b9] Deletion of /opt/stack/data/nova/instances/57ef7196-fc41-4908-b736-e450062af8b9_del complete
Nov 03 12:57:40 user nova-compute[74960]: INFO nova.compute.manager [None req-0b85d374-0998-4452-8753-58e4b0347d21 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 57ef7196-fc41-4908-b736-e450062af8b9] Took 1.20 seconds to destroy the instance on the hypervisor.
Nov 03 12:57:40 user nova-compute[74960]: DEBUG oslo.service.loopingcall [None req-0b85d374-0998-4452-8753-58e4b0347d21 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74960) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 12:57:40 user nova-compute[74960]: DEBUG nova.compute.manager [-] [instance: 57ef7196-fc41-4908-b736-e450062af8b9] Deallocating network for instance {{(pid=74960) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 12:57:40 user nova-compute[74960]: DEBUG nova.network.neutron [-] [instance: 57ef7196-fc41-4908-b736-e450062af8b9] deallocate_for_instance() {{(pid=74960) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 12:57:41 user nova-compute[74960]: DEBUG nova.network.neutron [-] [instance: 57ef7196-fc41-4908-b736-e450062af8b9] Updating instance_info_cache with network_info: [] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:57:41 user nova-compute[74960]: INFO nova.compute.manager [-] [instance: 57ef7196-fc41-4908-b736-e450062af8b9] Took 0.77 seconds to deallocate network for instance.
Nov 03 12:57:41 user nova-compute[74960]: DEBUG nova.compute.manager [req-74ef3272-7f43-4bdb-828e-a5f07c048a49 req-51f8f1d6-be06-4381-ac6e-a41252efe840 service nova] [instance: 57ef7196-fc41-4908-b736-e450062af8b9] Received event network-vif-deleted-cdb25946-24f2-4251-9208-93dee5791093 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:57:41 user nova-compute[74960]: DEBUG nova.compute.manager [req-3a0a359a-2295-4e94-8e0b-b49aaa024015 req-2bc589d2-6bf0-4838-aff1-69a794307fae service nova] [instance: 57ef7196-fc41-4908-b736-e450062af8b9] Received event network-vif-plugged-cdb25946-24f2-4251-9208-93dee5791093 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:57:41 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-3a0a359a-2295-4e94-8e0b-b49aaa024015 req-2bc589d2-6bf0-4838-aff1-69a794307fae service nova] Acquiring lock "57ef7196-fc41-4908-b736-e450062af8b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:57:41 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-3a0a359a-2295-4e94-8e0b-b49aaa024015 req-2bc589d2-6bf0-4838-aff1-69a794307fae service nova] Lock "57ef7196-fc41-4908-b736-e450062af8b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:57:41 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-3a0a359a-2295-4e94-8e0b-b49aaa024015 req-2bc589d2-6bf0-4838-aff1-69a794307fae service nova] Lock "57ef7196-fc41-4908-b736-e450062af8b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:57:41 user nova-compute[74960]: DEBUG nova.compute.manager [req-3a0a359a-2295-4e94-8e0b-b49aaa024015 req-2bc589d2-6bf0-4838-aff1-69a794307fae service nova] [instance: 57ef7196-fc41-4908-b736-e450062af8b9] No waiting events found dispatching network-vif-plugged-cdb25946-24f2-4251-9208-93dee5791093 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:57:41 user nova-compute[74960]: WARNING nova.compute.manager [req-3a0a359a-2295-4e94-8e0b-b49aaa024015 req-2bc589d2-6bf0-4838-aff1-69a794307fae service nova] [instance: 57ef7196-fc41-4908-b736-e450062af8b9] Received unexpected event network-vif-plugged-cdb25946-24f2-4251-9208-93dee5791093 for instance with vm_state active and task_state deleting.
Nov 03 12:57:42 user nova-compute[74960]: INFO nova.compute.manager [None req-0b85d374-0998-4452-8753-58e4b0347d21 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 57ef7196-fc41-4908-b736-e450062af8b9] Took 0.95 seconds to detach 1 volumes for instance.
Nov 03 12:57:42 user nova-compute[74960]: DEBUG nova.compute.manager [None req-0b85d374-0998-4452-8753-58e4b0347d21 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 57ef7196-fc41-4908-b736-e450062af8b9] Deleting volume: db55b697-39c5-4df2-bea4-d925a4461ab2 {{(pid=74960) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 03 12:57:42 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-0b85d374-0998-4452-8753-58e4b0347d21 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:57:42 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-0b85d374-0998-4452-8753-58e4b0347d21 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:57:42 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-0b85d374-0998-4452-8753-58e4b0347d21 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:57:42 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-0b85d374-0998-4452-8753-58e4b0347d21 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:57:42 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-0b85d374-0998-4452-8753-58e4b0347d21 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.209s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:57:42 user nova-compute[74960]: INFO nova.scheduler.client.report [None req-0b85d374-0998-4452-8753-58e4b0347d21 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Deleted allocations for instance 57ef7196-fc41-4908-b736-e450062af8b9
Nov 03 12:57:42 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-0b85d374-0998-4452-8753-58e4b0347d21 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lock "57ef7196-fc41-4908-b736-e450062af8b9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.380s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:57:44 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:57:45 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:57:50 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:57:50 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:57:50 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74960) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 12:57:50 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74960) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 12:57:50 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74960) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 12:57:50 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:57:54 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:57:55 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:57:59 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:58:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:58:04 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:58:05 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:58:08 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:58:10 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:58:15 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:58:15 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:58:15 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:58:15 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:58:15 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:58:15 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Auditing locally available compute resources for user (node: user) {{(pid=74960) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 12:58:15 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:58:15 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204546-6d78-4f0b-80ed-91eed8943fca/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:58:15 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204546-6d78-4f0b-80ed-91eed8943fca/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:58:15 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204546-6d78-4f0b-80ed-91eed8943fca/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:58:15 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204546-6d78-4f0b-80ed-91eed8943fca/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:58:15 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74960) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 12:58:16 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:58:16 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:58:16 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Hypervisor/Node resource view: name=user free_ram=8835MB free_disk=24.950424194335938GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74960) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 12:58:16 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:58:16 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:58:16 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 69d4b583-82eb-4c2f-ad42-f0028d04f6a6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:58:16 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 61204546-6d78-4f0b-80ed-91eed8943fca actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:58:16 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74960) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 12:58:16 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74960) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 12:58:16 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:58:16 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:58:16 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Compute_service record updated for user:user {{(pid=74960) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 12:58:16 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.308s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:58:18 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:58:18 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:58:20 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:58:20 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:58:20 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:58:21 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:58:21 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74960) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 12:58:23 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:58:23 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Starting heal instance info cache {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 12:58:23 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Didn't find any instances for network info cache update. {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 03 12:58:25 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:58:26 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:58:28 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:58:28 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Cleaning up deleted instances with incomplete migration  {{(pid=74960) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 03 12:58:30 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:58:33 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:58:33 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Cleaning up deleted instances {{(pid=74960) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 03 12:58:33 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] There are 0 instances to clean {{(pid=74960) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 03 12:58:35 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:58:40 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:58:40 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:58:40 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74960) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 12:58:40 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74960) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 12:58:40 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74960) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 12:58:40 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:58:40 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-4b3a4dbd-aa10-4a50-b582-7ade290fd5dc tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Acquiring lock "69d4b583-82eb-4c2f-ad42-f0028d04f6a6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:58:40 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-4b3a4dbd-aa10-4a50-b582-7ade290fd5dc tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lock "69d4b583-82eb-4c2f-ad42-f0028d04f6a6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:58:40 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-4b3a4dbd-aa10-4a50-b582-7ade290fd5dc tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Acquiring lock "69d4b583-82eb-4c2f-ad42-f0028d04f6a6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:58:40 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-4b3a4dbd-aa10-4a50-b582-7ade290fd5dc tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lock "69d4b583-82eb-4c2f-ad42-f0028d04f6a6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:58:40 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-4b3a4dbd-aa10-4a50-b582-7ade290fd5dc tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lock "69d4b583-82eb-4c2f-ad42-f0028d04f6a6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:58:40 user nova-compute[74960]: INFO nova.compute.manager [None req-4b3a4dbd-aa10-4a50-b582-7ade290fd5dc tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 69d4b583-82eb-4c2f-ad42-f0028d04f6a6] Terminating instance
Nov 03 12:58:40 user nova-compute[74960]: DEBUG nova.compute.manager [None req-4b3a4dbd-aa10-4a50-b582-7ade290fd5dc tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 69d4b583-82eb-4c2f-ad42-f0028d04f6a6] Start destroying the instance on the hypervisor. {{(pid=74960) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 12:58:40 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:58:40 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:58:40 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:58:40 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:58:40 user nova-compute[74960]: DEBUG nova.compute.manager [req-ffeee2ab-8716-4715-a267-0dbe06e79a5e req-30bb5971-addd-48fb-9ad3-79ee8a721891 service nova] [instance: 69d4b583-82eb-4c2f-ad42-f0028d04f6a6] Received event network-vif-unplugged-41b38ec9-5f6b-4451-83c6-1944cd2b80b5 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:58:40 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-ffeee2ab-8716-4715-a267-0dbe06e79a5e req-30bb5971-addd-48fb-9ad3-79ee8a721891 service nova] Acquiring lock "69d4b583-82eb-4c2f-ad42-f0028d04f6a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:58:40 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-ffeee2ab-8716-4715-a267-0dbe06e79a5e req-30bb5971-addd-48fb-9ad3-79ee8a721891 service nova] Lock "69d4b583-82eb-4c2f-ad42-f0028d04f6a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:58:40 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-ffeee2ab-8716-4715-a267-0dbe06e79a5e req-30bb5971-addd-48fb-9ad3-79ee8a721891 service nova] Lock "69d4b583-82eb-4c2f-ad42-f0028d04f6a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:58:40 user nova-compute[74960]: DEBUG nova.compute.manager [req-ffeee2ab-8716-4715-a267-0dbe06e79a5e req-30bb5971-addd-48fb-9ad3-79ee8a721891 service nova] [instance: 69d4b583-82eb-4c2f-ad42-f0028d04f6a6] No waiting events found dispatching network-vif-unplugged-41b38ec9-5f6b-4451-83c6-1944cd2b80b5 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:58:40 user nova-compute[74960]: DEBUG nova.compute.manager [req-ffeee2ab-8716-4715-a267-0dbe06e79a5e req-30bb5971-addd-48fb-9ad3-79ee8a721891 service nova] [instance: 69d4b583-82eb-4c2f-ad42-f0028d04f6a6] Received event network-vif-unplugged-41b38ec9-5f6b-4451-83c6-1944cd2b80b5 for instance with task_state deleting. {{(pid=74960) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 12:58:41 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:58:41 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: 69d4b583-82eb-4c2f-ad42-f0028d04f6a6] Instance destroyed successfully.
Nov 03 12:58:41 user nova-compute[74960]: DEBUG nova.objects.instance [None req-4b3a4dbd-aa10-4a50-b582-7ade290fd5dc tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lazy-loading 'resources' on Instance uuid 69d4b583-82eb-4c2f-ad42-f0028d04f6a6 {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:58:41 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-4b3a4dbd-aa10-4a50-b582-7ade290fd5dc tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:53:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1907471302',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1907471302',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1907471302',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHNIvMowv4N5Hr7boLFUJWG09vM5BWpS0/8i3NAupRbpEzNR1AD2rqndAddLLOm90KgfA15HExh0dn+Huen2oFlm7l/34LDy6nf98FMRsW4SztCoGbdEriXg3pbspyj/Yw==',key_name='tempest-keypair-1847594103',keypairs=<?>,launch_index=0,launched_at=2023-11-03T12:54:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d64f3d9dae8f45bcb2e0677a0076ed64',ramdisk_id='',reservation_id='r-hj0yqfz2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1795947051',owner_user_name='tempest-TestVolumeBootPattern-1795947051-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T12:54:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='067a3f33438b4112b818b91ecb4dd0d2',uuid=69d4b583-82eb-4c2f-ad42-f0028d04f6a6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "41b38ec9-5f6b-4451-83c6-1944cd2b80b5", "address": "fa:16:3e:5d:2f:62", "network": {"id": "8e985ab3-9852-4f07-8b5c-19f7bf113939", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781795302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d64f3d9dae8f45bcb2e0677a0076ed64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41b38ec9-5f", "ovs_interfaceid": "41b38ec9-5f6b-4451-83c6-1944cd2b80b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 12:58:41 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-4b3a4dbd-aa10-4a50-b582-7ade290fd5dc tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Converting VIF {"id": "41b38ec9-5f6b-4451-83c6-1944cd2b80b5", "address": "fa:16:3e:5d:2f:62", "network": {"id": "8e985ab3-9852-4f07-8b5c-19f7bf113939", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781795302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d64f3d9dae8f45bcb2e0677a0076ed64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41b38ec9-5f", "ovs_interfaceid": "41b38ec9-5f6b-4451-83c6-1944cd2b80b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 12:58:41 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-4b3a4dbd-aa10-4a50-b582-7ade290fd5dc tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5d:2f:62,bridge_name='br-int',has_traffic_filtering=True,id=41b38ec9-5f6b-4451-83c6-1944cd2b80b5,network=Network(8e985ab3-9852-4f07-8b5c-19f7bf113939),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41b38ec9-5f') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 12:58:41 user nova-compute[74960]: DEBUG os_vif [None req-4b3a4dbd-aa10-4a50-b582-7ade290fd5dc tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:2f:62,bridge_name='br-int',has_traffic_filtering=True,id=41b38ec9-5f6b-4451-83c6-1944cd2b80b5,network=Network(8e985ab3-9852-4f07-8b5c-19f7bf113939),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41b38ec9-5f') {{(pid=74960) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 12:58:41 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:58:41 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap41b38ec9-5f, bridge=br-int, if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:58:41 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:58:41 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:58:41 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:58:41 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2ff8b136-d67c-4989-9c09-dc92868b6da4) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 12:58:41 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:58:41 user nova-compute[74960]: INFO os_vif [None req-4b3a4dbd-aa10-4a50-b582-7ade290fd5dc tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:2f:62,bridge_name='br-int',has_traffic_filtering=True,id=41b38ec9-5f6b-4451-83c6-1944cd2b80b5,network=Network(8e985ab3-9852-4f07-8b5c-19f7bf113939),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41b38ec9-5f')
Nov 03 12:58:41 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b3a4dbd-aa10-4a50-b582-7ade290fd5dc tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 69d4b583-82eb-4c2f-ad42-f0028d04f6a6] calling os-brick to detach iSCSI Volume {{(pid=74960) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 12:58:41 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3a4dbd-aa10-4a50-b582-7ade290fd5dc tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9aa420acb0>, {'target_iqn': 'iqn.2010-10.org.openstack:f84524e4-0a06-482a-8b65-afd5dccfd016', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EFiySMGT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:58:41 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-4b3a4dbd-aa10-4a50-b582-7ade290fd5dc tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:58:41 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-4b3a4dbd-aa10-4a50-b582-7ade290fd5dc tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:58:41 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-4b3a4dbd-aa10-4a50-b582-7ade290fd5dc tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:58:41 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:58:41 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:58:41 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ee45205-270d-411f-a8d0-6db012cfd274]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f84524e4-0a06-482a-8b65-afd5dccfd016\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:58:41 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3a4dbd-aa10-4a50-b582-7ade290fd5dc tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 12:58:41 user nova-compute[74960]: No targets found.
Nov 03 12:58:41 user nova-compute[74960]: iSNS:
Nov 03 12:58:41 user nova-compute[74960]: No targets found.
Nov 03 12:58:41 user nova-compute[74960]: STATIC:
Nov 03 12:58:41 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:f84524e4-0a06-482a-8b65-afd5dccfd016
Nov 03 12:58:41 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 12:58:41 user nova-compute[74960]:                 Iface Name: default
Nov 03 12:58:41 user nova-compute[74960]: FIRMWARE:
Nov 03 12:58:41 user nova-compute[74960]: No targets found.
Nov 03 12:58:41 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:58:41 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3a4dbd-aa10-4a50-b582-7ade290fd5dc tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 12:58:41 user nova-compute[74960]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 12:58:41 user nova-compute[74960]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74960) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 12:58:41 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3a4dbd-aa10-4a50-b582-7ade290fd5dc tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f84524e4-0a06-482a-8b65-afd5dccfd016', 0)] {{(pid=74960) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 12:58:41 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:58:41 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:58:41 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb7a2e52-c47e-4594-bdab-721b16d62e05]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f84524e4-0a06-482a-8b65-afd5dccfd016\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:58:41 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:58:41 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:58:41 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[da08a274-6108-4810-b5e9-24852643bd55]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84524e4-0a06-482a-8b65-afd5dccfd016 (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:58:41 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3a4dbd-aa10-4a50-b582-7ade290fd5dc tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84524e4-0a06-482a-8b65-afd5dccfd016 (non-flash)
Nov 03 12:58:41 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:58:41 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3a4dbd-aa10-4a50-b582-7ade290fd5dc tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84524e4-0a06-482a-8b65-afd5dccfd016 (non-flash)
Nov 03 12:58:41 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:58:41 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3a4dbd-aa10-4a50-b582-7ade290fd5dc tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9a8c405ab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f84524e4-0a06-482a-8b65-afd5dccfd016'): ({'sdc'}, set())}) {{(pid=74960) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 12:58:41 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-4b3a4dbd-aa10-4a50-b582-7ade290fd5dc tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Removing single pathed devices sdc {{(pid=74960) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 12:58:41 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:58:41 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:58:41 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4ab2f58-8ec4-47fc-b436-cfaeb0ff2d14]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:58:41 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:58:41 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:58:41 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8c9a0a5-ebb2-4e78-997d-9c2de4200b9f]: (4, ('ok\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:58:41 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-4b3a4dbd-aa10-4a50-b582-7ade290fd5dc tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Flushing IO for device /dev/sdc {{(pid=74960) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 12:58:41 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:58:41 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:58:41 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[60eb6c5e-7193-44c7-ab5a-1c7d1a294941]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:58:41 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-4b3a4dbd-aa10-4a50-b582-7ade290fd5dc tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74960) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 12:58:41 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:58:41 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:58:41 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b972ad8-d6d6-4936-b5fc-465a6b561a7a]: (4, ('1', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:58:41 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-4b3a4dbd-aa10-4a50-b582-7ade290fd5dc tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74960) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 12:58:41 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-4b3a4dbd-aa10-4a50-b582-7ade290fd5dc tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] SCSI volumes sdc have been removed. {{(pid=74960) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 12:58:41 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3a4dbd-aa10-4a50-b582-7ade290fd5dc tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f84524e4-0a06-482a-8b65-afd5dccfd016')] {{(pid=74960) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 12:58:41 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f84524e4-0a06-482a-8b65-afd5dccfd016 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:58:41 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f84524e4-0a06-482a-8b65-afd5dccfd016 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:58:41 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[44819c36-18a4-485c-9fbb-52b642425d7a]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:58:41 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3a4dbd-aa10-4a50-b582-7ade290fd5dc tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:58:41 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f84524e4-0a06-482a-8b65-afd5dccfd016 -p 172.16.0.220:3260 --logout {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:58:41 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f84524e4-0a06-482a-8b65-afd5dccfd016 -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:58:41 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc0a2627-a002-4ca0-bf6f-9a5b4d7cd25d]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:f84524e4-0a06-482a-8b65-afd5dccfd016, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:f84524e4-0a06-482a-8b65-afd5dccfd016, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:58:41 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3a4dbd-aa10-4a50-b582-7ade290fd5dc tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:f84524e4-0a06-482a-8b65-afd5dccfd016, portal: 172.16.0.220,3260]
Nov 03 12:58:41 user nova-compute[74960]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:f84524e4-0a06-482a-8b65-afd5dccfd016, portal: 172.16.0.220,3260] successful.
Nov 03 12:58:41 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:58:41 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f84524e4-0a06-482a-8b65-afd5dccfd016 -p 172.16.0.220:3260 --op delete {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:58:41 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f84524e4-0a06-482a-8b65-afd5dccfd016 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:58:41 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[93bac145-51bc-497c-ac19-39c92bfe7b4e]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:58:41 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3a4dbd-aa10-4a50-b582-7ade290fd5dc tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:58:41 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-4b3a4dbd-aa10-4a50-b582-7ade290fd5dc tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:58:41 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3a4dbd-aa10-4a50-b582-7ade290fd5dc tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] <== disconnect_volume: return (288ms) None {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:58:41 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b3a4dbd-aa10-4a50-b582-7ade290fd5dc tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 69d4b583-82eb-4c2f-ad42-f0028d04f6a6] Disconnected iSCSI Volume {{(pid=74960) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 12:58:41 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-4b3a4dbd-aa10-4a50-b582-7ade290fd5dc tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 69d4b583-82eb-4c2f-ad42-f0028d04f6a6] Deleting instance files /opt/stack/data/nova/instances/69d4b583-82eb-4c2f-ad42-f0028d04f6a6_del
Nov 03 12:58:41 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-4b3a4dbd-aa10-4a50-b582-7ade290fd5dc tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 69d4b583-82eb-4c2f-ad42-f0028d04f6a6] Deletion of /opt/stack/data/nova/instances/69d4b583-82eb-4c2f-ad42-f0028d04f6a6_del complete
Nov 03 12:58:41 user nova-compute[74960]: INFO nova.compute.manager [None req-4b3a4dbd-aa10-4a50-b582-7ade290fd5dc tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 69d4b583-82eb-4c2f-ad42-f0028d04f6a6] Took 1.13 seconds to destroy the instance on the hypervisor.
Nov 03 12:58:41 user nova-compute[74960]: DEBUG oslo.service.loopingcall [None req-4b3a4dbd-aa10-4a50-b582-7ade290fd5dc tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74960) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 12:58:41 user nova-compute[74960]: DEBUG nova.compute.manager [-] [instance: 69d4b583-82eb-4c2f-ad42-f0028d04f6a6] Deallocating network for instance {{(pid=74960) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 12:58:41 user nova-compute[74960]: DEBUG nova.network.neutron [-] [instance: 69d4b583-82eb-4c2f-ad42-f0028d04f6a6] deallocate_for_instance() {{(pid=74960) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 12:58:42 user nova-compute[74960]: DEBUG nova.network.neutron [-] [instance: 69d4b583-82eb-4c2f-ad42-f0028d04f6a6] Updating instance_info_cache with network_info: [] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:58:42 user nova-compute[74960]: INFO nova.compute.manager [-] [instance: 69d4b583-82eb-4c2f-ad42-f0028d04f6a6] Took 0.81 seconds to deallocate network for instance.
Nov 03 12:58:42 user nova-compute[74960]: DEBUG nova.compute.manager [req-8a24077a-7460-439d-b9f3-2d0c668868a3 req-5a252f99-aa99-49b8-a196-1da495a422a8 service nova] [instance: 69d4b583-82eb-4c2f-ad42-f0028d04f6a6] Received event network-vif-deleted-41b38ec9-5f6b-4451-83c6-1944cd2b80b5 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:58:42 user nova-compute[74960]: DEBUG nova.compute.manager [req-722fe91c-0d39-4106-bf9a-4f78db989dbb req-d6feacd7-cf14-41dd-b316-3744f6d69af0 service nova] [instance: 69d4b583-82eb-4c2f-ad42-f0028d04f6a6] Received event network-vif-plugged-41b38ec9-5f6b-4451-83c6-1944cd2b80b5 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:58:42 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-722fe91c-0d39-4106-bf9a-4f78db989dbb req-d6feacd7-cf14-41dd-b316-3744f6d69af0 service nova] Acquiring lock "69d4b583-82eb-4c2f-ad42-f0028d04f6a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:58:42 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-722fe91c-0d39-4106-bf9a-4f78db989dbb req-d6feacd7-cf14-41dd-b316-3744f6d69af0 service nova] Lock "69d4b583-82eb-4c2f-ad42-f0028d04f6a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:58:42 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-722fe91c-0d39-4106-bf9a-4f78db989dbb req-d6feacd7-cf14-41dd-b316-3744f6d69af0 service nova] Lock "69d4b583-82eb-4c2f-ad42-f0028d04f6a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:58:42 user nova-compute[74960]: DEBUG nova.compute.manager [req-722fe91c-0d39-4106-bf9a-4f78db989dbb req-d6feacd7-cf14-41dd-b316-3744f6d69af0 service nova] [instance: 69d4b583-82eb-4c2f-ad42-f0028d04f6a6] No waiting events found dispatching network-vif-plugged-41b38ec9-5f6b-4451-83c6-1944cd2b80b5 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 12:58:42 user nova-compute[74960]: WARNING nova.compute.manager [req-722fe91c-0d39-4106-bf9a-4f78db989dbb req-d6feacd7-cf14-41dd-b316-3744f6d69af0 service nova] [instance: 69d4b583-82eb-4c2f-ad42-f0028d04f6a6] Received unexpected event network-vif-plugged-41b38ec9-5f6b-4451-83c6-1944cd2b80b5 for instance with vm_state active and task_state deleting.
Nov 03 12:58:43 user nova-compute[74960]: INFO nova.compute.manager [None req-4b3a4dbd-aa10-4a50-b582-7ade290fd5dc tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 69d4b583-82eb-4c2f-ad42-f0028d04f6a6] Took 0.85 seconds to detach 1 volumes for instance.
Nov 03 12:58:43 user nova-compute[74960]: DEBUG nova.compute.manager [None req-4b3a4dbd-aa10-4a50-b582-7ade290fd5dc tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 69d4b583-82eb-4c2f-ad42-f0028d04f6a6] Deleting volume: f84524e4-0a06-482a-8b65-afd5dccfd016 {{(pid=74960) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 03 12:58:43 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-4b3a4dbd-aa10-4a50-b582-7ade290fd5dc tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:58:43 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-4b3a4dbd-aa10-4a50-b582-7ade290fd5dc tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:58:43 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-4b3a4dbd-aa10-4a50-b582-7ade290fd5dc tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Refreshing inventories for resource provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 03 12:58:43 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-4b3a4dbd-aa10-4a50-b582-7ade290fd5dc tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Updating ProviderTree inventory for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 03 12:58:43 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-4b3a4dbd-aa10-4a50-b582-7ade290fd5dc tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Updating inventory in ProviderTree for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 03 12:58:43 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-4b3a4dbd-aa10-4a50-b582-7ade290fd5dc tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Refreshing aggregate associations for resource provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0, aggregates: None {{(pid=74960) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 03 12:58:43 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-4b3a4dbd-aa10-4a50-b582-7ade290fd5dc tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Refreshing trait associations for resource provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0, traits: COMPUTE_NODE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE41,HW_CPU_X86_SSSE3,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_DEVICE_TAGGING,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_QXL {{(pid=74960) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 03 12:58:43 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-4b3a4dbd-aa10-4a50-b582-7ade290fd5dc tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:58:43 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-4b3a4dbd-aa10-4a50-b582-7ade290fd5dc tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:58:43 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-4b3a4dbd-aa10-4a50-b582-7ade290fd5dc tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.312s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:58:43 user nova-compute[74960]: INFO nova.scheduler.client.report [None req-4b3a4dbd-aa10-4a50-b582-7ade290fd5dc tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Deleted allocations for instance 69d4b583-82eb-4c2f-ad42-f0028d04f6a6
Nov 03 12:58:43 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-4b3a4dbd-aa10-4a50-b582-7ade290fd5dc tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lock "69d4b583-82eb-4c2f-ad42-f0028d04f6a6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.332s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:58:46 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:58:51 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:58:56 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:59:01 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:59:01 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:59:01 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74960) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 12:59:01 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74960) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 12:59:01 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74960) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 12:59:01 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:59:06 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:59:10 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:59:11 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:59:11 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:59:11 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74960) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 12:59:11 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74960) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 12:59:11 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74960) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 12:59:11 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:59:15 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:59:15 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:59:15 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:59:15 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:59:15 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Auditing locally available compute resources for user (node: user) {{(pid=74960) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 12:59:15 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204546-6d78-4f0b-80ed-91eed8943fca/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:59:15 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204546-6d78-4f0b-80ed-91eed8943fca/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:59:15 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204546-6d78-4f0b-80ed-91eed8943fca/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:59:15 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204546-6d78-4f0b-80ed-91eed8943fca/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:59:16 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:59:16 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 12:59:16 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Hypervisor/Node resource view: name=user free_ram=8976MB free_disk=24.94949722290039GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74960) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 12:59:16 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:59:16 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:59:16 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 61204546-6d78-4f0b-80ed-91eed8943fca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 12:59:16 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74960) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 12:59:16 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74960) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 12:59:16 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:59:16 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:59:16 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Compute_service record updated for user:user {{(pid=74960) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 12:59:16 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.218s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:59:16 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:59:18 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:59:19 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:59:19 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:59:21 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:59:21 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:59:21 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:59:21 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74960) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 12:59:21 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74960) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 12:59:21 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74960) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 12:59:21 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:59:22 user nova-compute[74960]: DEBUG nova.compute.manager [req-997d6de0-02ae-43a7-9d9d-d8e659a4631c req-619caec1-488c-4a84-ba78-c8133c55f0d9 service nova] [instance: 61204546-6d78-4f0b-80ed-91eed8943fca] Received event network-changed-15f819d0-a4dc-4061-adbe-c9882a4832ea {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:59:22 user nova-compute[74960]: DEBUG nova.compute.manager [req-997d6de0-02ae-43a7-9d9d-d8e659a4631c req-619caec1-488c-4a84-ba78-c8133c55f0d9 service nova] [instance: 61204546-6d78-4f0b-80ed-91eed8943fca] Refreshing instance network info cache due to event network-changed-15f819d0-a4dc-4061-adbe-c9882a4832ea. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 12:59:22 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-997d6de0-02ae-43a7-9d9d-d8e659a4631c req-619caec1-488c-4a84-ba78-c8133c55f0d9 service nova] Acquiring lock "refresh_cache-61204546-6d78-4f0b-80ed-91eed8943fca" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:59:22 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-997d6de0-02ae-43a7-9d9d-d8e659a4631c req-619caec1-488c-4a84-ba78-c8133c55f0d9 service nova] Acquired lock "refresh_cache-61204546-6d78-4f0b-80ed-91eed8943fca" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:59:22 user nova-compute[74960]: DEBUG nova.network.neutron [req-997d6de0-02ae-43a7-9d9d-d8e659a4631c req-619caec1-488c-4a84-ba78-c8133c55f0d9 service nova] [instance: 61204546-6d78-4f0b-80ed-91eed8943fca] Refreshing network info cache for port 15f819d0-a4dc-4061-adbe-c9882a4832ea {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 12:59:22 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:59:22 user nova-compute[74960]: DEBUG nova.network.neutron [req-997d6de0-02ae-43a7-9d9d-d8e659a4631c req-619caec1-488c-4a84-ba78-c8133c55f0d9 service nova] [instance: 61204546-6d78-4f0b-80ed-91eed8943fca] Updated VIF entry in instance network info cache for port 15f819d0-a4dc-4061-adbe-c9882a4832ea. {{(pid=74960) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 12:59:22 user nova-compute[74960]: DEBUG nova.network.neutron [req-997d6de0-02ae-43a7-9d9d-d8e659a4631c req-619caec1-488c-4a84-ba78-c8133c55f0d9 service nova] [instance: 61204546-6d78-4f0b-80ed-91eed8943fca] Updating instance_info_cache with network_info: [{"id": "15f819d0-a4dc-4061-adbe-c9882a4832ea", "address": "fa:16:3e:95:b0:7b", "network": {"id": "c50fc382-c1b9-49d8-8e38-ac681cbbcffd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1465428328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "255349fa349045ad8a554d3f818cdd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15f819d0-a4", "ovs_interfaceid": "15f819d0-a4dc-4061-adbe-c9882a4832ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:59:22 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-997d6de0-02ae-43a7-9d9d-d8e659a4631c req-619caec1-488c-4a84-ba78-c8133c55f0d9 service nova] Releasing lock "refresh_cache-61204546-6d78-4f0b-80ed-91eed8943fca" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:59:23 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:59:23 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74960) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 12:59:24 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:59:24 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:59:24 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Starting heal instance info cache {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 12:59:24 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Rebuilding the list of instances to heal {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 03 12:59:24 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "refresh_cache-61204546-6d78-4f0b-80ed-91eed8943fca" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:59:24 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquired lock "refresh_cache-61204546-6d78-4f0b-80ed-91eed8943fca" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:59:24 user nova-compute[74960]: DEBUG nova.network.neutron [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: 61204546-6d78-4f0b-80ed-91eed8943fca] Forcefully refreshing network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 12:59:24 user nova-compute[74960]: DEBUG nova.objects.instance [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lazy-loading 'info_cache' on Instance uuid 61204546-6d78-4f0b-80ed-91eed8943fca {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:59:24 user nova-compute[74960]: DEBUG nova.network.neutron [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: 61204546-6d78-4f0b-80ed-91eed8943fca] Updating instance_info_cache with network_info: [{"id": "15f819d0-a4dc-4061-adbe-c9882a4832ea", "address": "fa:16:3e:95:b0:7b", "network": {"id": "c50fc382-c1b9-49d8-8e38-ac681cbbcffd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1465428328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "255349fa349045ad8a554d3f818cdd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15f819d0-a4", "ovs_interfaceid": "15f819d0-a4dc-4061-adbe-c9882a4832ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:59:24 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Releasing lock "refresh_cache-61204546-6d78-4f0b-80ed-91eed8943fca" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:59:24 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: 61204546-6d78-4f0b-80ed-91eed8943fca] Updated the network info_cache for instance {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 12:59:26 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:59:29 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:59:29 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-5489ab09-f65f-47cc-bb2d-214e3a809169 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Acquiring lock "61204546-6d78-4f0b-80ed-91eed8943fca" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:59:29 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-5489ab09-f65f-47cc-bb2d-214e3a809169 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Lock "61204546-6d78-4f0b-80ed-91eed8943fca" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:59:29 user nova-compute[74960]: DEBUG nova.objects.instance [None req-5489ab09-f65f-47cc-bb2d-214e3a809169 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Lazy-loading 'flavor' on Instance uuid 61204546-6d78-4f0b-80ed-91eed8943fca {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:59:29 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-5489ab09-f65f-47cc-bb2d-214e3a809169 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Lock "61204546-6d78-4f0b-80ed-91eed8943fca" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:59:29 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-5489ab09-f65f-47cc-bb2d-214e3a809169 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Acquiring lock "61204546-6d78-4f0b-80ed-91eed8943fca" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:59:29 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-5489ab09-f65f-47cc-bb2d-214e3a809169 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Lock "61204546-6d78-4f0b-80ed-91eed8943fca" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:59:29 user nova-compute[74960]: INFO nova.compute.manager [None req-5489ab09-f65f-47cc-bb2d-214e3a809169 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 61204546-6d78-4f0b-80ed-91eed8943fca] Attaching volume 7989e6a7-e265-4c8c-8394-ab5e5d4309c7 to /dev/vdb
Nov 03 12:59:29 user nova-compute[74960]: DEBUG os_brick.utils [None req-5489ab09-f65f-47cc-bb2d-214e3a809169 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:59:29 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:59:29 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:59:29 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[85eff24d-8353-4263-b956-9f80e3b77321]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:75b8e219756\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:59:29 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:59:29 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:59:29 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[102d12c1-a9b5-4f4c-903e-4ada17870c2e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:59:29 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:59:29 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:59:29 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[48fe642e-74b2-40eb-951e-8b6c642db1e5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:59:29 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbfa3800-a01d-44a2-ba8f-21970d44007a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:59:29 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-5489ab09-f65f-47cc-bb2d-214e3a809169 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Running cmd (subprocess): nvme version {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:59:29 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-5489ab09-f65f-47cc-bb2d-214e3a809169 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] 'nvme version' failed. Not Retrying. {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 12:59:29 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5489ab09-f65f-47cc-bb2d-214e3a809169 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] nvme not present on system {{(pid=74960) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 12:59:29 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:59:29 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 12:59:29 user nova-compute[74960]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 12:59:29 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[225af9bc-dedb-46b3-9074-40faab4c2be5]: (4, '') {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:59:29 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-5489ab09-f65f-47cc-bb2d-214e3a809169 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74960) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 12:59:29 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-5489ab09-f65f-47cc-bb2d-214e3a809169 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74960) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 12:59:29 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-5489ab09-f65f-47cc-bb2d-214e3a809169 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] LIGHTOS: no hostnqn found. {{(pid=74960) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 12:59:29 user nova-compute[74960]: DEBUG os_brick.utils [None req-5489ab09-f65f-47cc-bb2d-214e3a809169 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:75b8e219756', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:59:29 user nova-compute[74960]: DEBUG nova.virt.block_device [None req-5489ab09-f65f-47cc-bb2d-214e3a809169 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 61204546-6d78-4f0b-80ed-91eed8943fca] Updating existing volume attachment record: f7be0d6c-af70-4fbe-b88e-4913a20d017c {{(pid=74960) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 12:59:31 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:59:31 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:59:35 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 12:59:36 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 12:59:36 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:59:36 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74960) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 12:59:36 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74960) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 12:59:36 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74960) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 12:59:36 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:59:39 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:59:41 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:59:46 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:59:48 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5489ab09-f65f-47cc-bb2d-214e3a809169 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 61204546-6d78-4f0b-80ed-91eed8943fca] Calling os-brick to attach iSCSI Volume {{(pid=74960) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 12:59:48 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-5489ab09-f65f-47cc-bb2d-214e3a809169 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9aa420acb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7989e6a7-e265-4c8c-8394-ab5e5d4309c7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xQaBKVHj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:59:48 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-5489ab09-f65f-47cc-bb2d-214e3a809169 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:59:48 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-5489ab09-f65f-47cc-bb2d-214e3a809169 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:59:48 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-5489ab09-f65f-47cc-bb2d-214e3a809169 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:59:48 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-5489ab09-f65f-47cc-bb2d-214e3a809169 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 12:59:48 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-5489ab09-f65f-47cc-bb2d-214e3a809169 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7989e6a7-e265-4c8c-8394-ab5e5d4309c7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 12:59:48 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-5489ab09-f65f-47cc-bb2d-214e3a809169 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7989e6a7-e265-4c8c-8394-ab5e5d4309c7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 12:59:48 user nova-compute[74960]: INFO os_brick.initiator.connectors.iscsi [None req-5489ab09-f65f-47cc-bb2d-214e3a809169 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 12:59:48 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7989e6a7-e265-4c8c-8394-ab5e5d4309c7 -p 172.16.0.220:3260 {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:59:48 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7989e6a7-e265-4c8c-8394-ab5e5d4309c7 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:59:48 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[9517d62d-fade-439f-8844-d215483c1481]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:59:48 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-5489ab09-f65f-47cc-bb2d-214e3a809169 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 12:59:48 user nova-compute[74960]:  {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:59:48 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7989e6a7-e265-4c8c-8394-ab5e5d4309c7 -p 172.16.0.220:3260 --interface default --op new {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:59:48 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7989e6a7-e265-4c8c-8394-ab5e5d4309c7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:59:48 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ec9b1a0-6f93-417c-bf7c-783f7de523ad]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7989e6a7-e265-4c8c-8394-ab5e5d4309c7] added\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:59:48 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-5489ab09-f65f-47cc-bb2d-214e3a809169 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7989e6a7-e265-4c8c-8394-ab5e5d4309c7] added
Nov 03 12:59:48 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:59:48 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7989e6a7-e265-4c8c-8394-ab5e5d4309c7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:59:48 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7989e6a7-e265-4c8c-8394-ab5e5d4309c7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:59:48 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[34621095-27b4-40f4-b61d-5478aea403f1]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:59:48 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-5489ab09-f65f-47cc-bb2d-214e3a809169 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:59:48 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7989e6a7-e265-4c8c-8394-ab5e5d4309c7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:59:48 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7989e6a7-e265-4c8c-8394-ab5e5d4309c7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:59:48 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e15600-93a0-49bc-a55c-af3e8423930a]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:59:48 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-5489ab09-f65f-47cc-bb2d-214e3a809169 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:59:48 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7989e6a7-e265-4c8c-8394-ab5e5d4309c7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xQaBKVHj {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:59:48 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7989e6a7-e265-4c8c-8394-ab5e5d4309c7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xQaBKVHj" returned: 0 in 0.016s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:59:48 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[001cb17f-03fa-411a-bf85-1784978150db]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:59:48 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-5489ab09-f65f-47cc-bb2d-214e3a809169 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xQaBKVHj'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:59:48 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7989e6a7-e265-4c8c-8394-ab5e5d4309c7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:59:48 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7989e6a7-e265-4c8c-8394-ab5e5d4309c7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:59:48 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[c54bad38-42fc-4669-9246-a811e285ff73]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:59:48 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-5489ab09-f65f-47cc-bb2d-214e3a809169 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:59:48 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:59:48 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:59:48 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ff1b15d-03bc-4975-a0e0-7239ccd1a600]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:59:48 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-5489ab09-f65f-47cc-bb2d-214e3a809169 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 03 12:59:48 user nova-compute[74960]:  {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:59:48 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-5489ab09-f65f-47cc-bb2d-214e3a809169 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 03 12:59:48 user nova-compute[74960]:  {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:59:48 user nova-compute[74960]: WARNING os_brick.initiator.connectors.iscsi [None req-5489ab09-f65f-47cc-bb2d-214e3a809169 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 03 12:59:48 user nova-compute[74960]: 
Nov 03 12:59:48 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7989e6a7-e265-4c8c-8394-ab5e5d4309c7 -p 172.16.0.220:3260 --login {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:59:48 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7989e6a7-e265-4c8c-8394-ab5e5d4309c7 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:59:48 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[f322a75e-7ab4-433d-9287-2e80fd1d8250]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7989e6a7-e265-4c8c-8394-ab5e5d4309c7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7989e6a7-e265-4c8c-8394-ab5e5d4309c7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:59:48 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-5489ab09-f65f-47cc-bb2d-214e3a809169 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7989e6a7-e265-4c8c-8394-ab5e5d4309c7, portal: 172.16.0.220,3260]
Nov 03 12:59:48 user nova-compute[74960]: Login to [iface: default, target: iqn.2010-10.org.openstack:7989e6a7-e265-4c8c-8394-ab5e5d4309c7, portal: 172.16.0.220,3260] successful.
Nov 03 12:59:48 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:59:48 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7989e6a7-e265-4c8c-8394-ab5e5d4309c7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:59:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7989e6a7-e265-4c8c-8394-ab5e5d4309c7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:59:49 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1370abe-ceff-4fa7-8c73-ca0dfc971efb]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:59:49 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-5489ab09-f65f-47cc-bb2d-214e3a809169 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 12:59:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:59:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:59:49 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e684baf-fc2d-48f8-9e9f-1a5a58f4805d]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7989e6a7-e265-4c8c-8394-ab5e5d4309c7 (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:59:49 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-5489ab09-f65f-47cc-bb2d-214e3a809169 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7989e6a7-e265-4c8c-8394-ab5e5d4309c7 (non-flash)
Nov 03 12:59:49 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 12:59:49 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-5489ab09-f65f-47cc-bb2d-214e3a809169 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7989e6a7-e265-4c8c-8394-ab5e5d4309c7 (non-flash)
Nov 03 12:59:49 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 12:59:49 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-5489ab09-f65f-47cc-bb2d-214e3a809169 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7989e6a7-e265-4c8c-8394-ab5e5d4309c7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.251s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:59:49 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-5489ab09-f65f-47cc-bb2d-214e3a809169 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Connected to 172.16.0.220:3260 {{(pid=74960) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 12:59:49 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-5489ab09-f65f-47cc-bb2d-214e3a809169 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] HCTL ('33', '-', '-', 0) found on session 47 with lun 0 {{(pid=74960) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 12:59:49 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-5489ab09-f65f-47cc-bb2d-214e3a809169 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74960) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 12:59:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:59:49 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:59:49 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4cdfc47-27fc-415b-8ae2-8d9dc1d37539]: (4, ('- - 0', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:59:49 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-5489ab09-f65f-47cc-bb2d-214e3a809169 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74960) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 12:59:49 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-5489ab09-f65f-47cc-bb2d-214e3a809169 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:7989e6a7-e265-4c8c-8394-ab5e5d4309c7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xQaBKVHj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74960) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 12:59:50 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-5489ab09-f65f-47cc-bb2d-214e3a809169 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.282s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 12:59:50 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-5489ab09-f65f-47cc-bb2d-214e3a809169 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] <== connect_volume: return (1284ms) {'type': 'block', 'scsi_wwn': '23138306132663633', 'path': '/dev/sdb'} {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:59:50 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5489ab09-f65f-47cc-bb2d-214e3a809169 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 61204546-6d78-4f0b-80ed-91eed8943fca] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23138306132663633', 'path': '/dev/sdb'} {{(pid=74960) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 12:59:50 user nova-compute[74960]: DEBUG nova.objects.instance [None req-5489ab09-f65f-47cc-bb2d-214e3a809169 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Lazy-loading 'flavor' on Instance uuid 61204546-6d78-4f0b-80ed-91eed8943fca {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 12:59:50 user nova-compute[74960]: DEBUG nova.virt.libvirt.guest [None req-5489ab09-f65f-47cc-bb2d-214e3a809169 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] attach device xml: <disk type="block" device="disk">
Nov 03 12:59:50 user nova-compute[74960]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 12:59:50 user nova-compute[74960]:   <source dev="/dev/sdb"/>
Nov 03 12:59:50 user nova-compute[74960]:   <target dev="vdb" bus="virtio"/>
Nov 03 12:59:50 user nova-compute[74960]:   <serial>7989e6a7-e265-4c8c-8394-ab5e5d4309c7</serial>
Nov 03 12:59:50 user nova-compute[74960]: </disk>
Nov 03 12:59:50 user nova-compute[74960]:  {{(pid=74960) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 03 12:59:50 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-5489ab09-f65f-47cc-bb2d-214e3a809169 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] No BDM found with device name vda, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:59:50 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-5489ab09-f65f-47cc-bb2d-214e3a809169 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 12:59:50 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-5489ab09-f65f-47cc-bb2d-214e3a809169 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] No VIF found with MAC fa:16:3e:95:b0:7b, not building metadata {{(pid=74960) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 12:59:50 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-5489ab09-f65f-47cc-bb2d-214e3a809169 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Lock "61204546-6d78-4f0b-80ed-91eed8943fca" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.465s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:59:51 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-0fe65b66-731d-44cc-bb79-9c82bb16eb56 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Acquiring lock "447cfd77-38cb-4696-b25e-3dd72d2d1adf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:59:51 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-0fe65b66-731d-44cc-bb79-9c82bb16eb56 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lock "447cfd77-38cb-4696-b25e-3dd72d2d1adf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:59:51 user nova-compute[74960]: DEBUG nova.compute.manager [None req-0fe65b66-731d-44cc-bb79-9c82bb16eb56 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 447cfd77-38cb-4696-b25e-3dd72d2d1adf] Starting instance... {{(pid=74960) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 12:59:51 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-0fe65b66-731d-44cc-bb79-9c82bb16eb56 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:59:51 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-0fe65b66-731d-44cc-bb79-9c82bb16eb56 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:59:51 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-0fe65b66-731d-44cc-bb79-9c82bb16eb56 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74960) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 12:59:51 user nova-compute[74960]: INFO nova.compute.claims [None req-0fe65b66-731d-44cc-bb79-9c82bb16eb56 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 447cfd77-38cb-4696-b25e-3dd72d2d1adf] Claim successful on node user
Nov 03 12:59:51 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:59:51 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-0fe65b66-731d-44cc-bb79-9c82bb16eb56 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 12:59:51 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-0fe65b66-731d-44cc-bb79-9c82bb16eb56 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 12:59:51 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-0fe65b66-731d-44cc-bb79-9c82bb16eb56 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.202s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 12:59:51 user nova-compute[74960]: DEBUG nova.compute.manager [None req-0fe65b66-731d-44cc-bb79-9c82bb16eb56 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 447cfd77-38cb-4696-b25e-3dd72d2d1adf] Start building networks asynchronously for instance. {{(pid=74960) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 12:59:51 user nova-compute[74960]: DEBUG nova.compute.manager [None req-0fe65b66-731d-44cc-bb79-9c82bb16eb56 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 447cfd77-38cb-4696-b25e-3dd72d2d1adf] Allocating IP information in the background. {{(pid=74960) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 12:59:51 user nova-compute[74960]: DEBUG nova.network.neutron [None req-0fe65b66-731d-44cc-bb79-9c82bb16eb56 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 447cfd77-38cb-4696-b25e-3dd72d2d1adf] allocate_for_instance() {{(pid=74960) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 12:59:51 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-0fe65b66-731d-44cc-bb79-9c82bb16eb56 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 447cfd77-38cb-4696-b25e-3dd72d2d1adf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 12:59:51 user nova-compute[74960]: DEBUG nova.compute.manager [None req-0fe65b66-731d-44cc-bb79-9c82bb16eb56 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 447cfd77-38cb-4696-b25e-3dd72d2d1adf] Start building block device mappings for instance. {{(pid=74960) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 12:59:51 user nova-compute[74960]: DEBUG nova.policy [None req-0fe65b66-731d-44cc-bb79-9c82bb16eb56 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '067a3f33438b4112b818b91ecb4dd0d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd64f3d9dae8f45bcb2e0677a0076ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74960) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 12:59:51 user nova-compute[74960]: INFO nova.virt.block_device [None req-0fe65b66-731d-44cc-bb79-9c82bb16eb56 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 447cfd77-38cb-4696-b25e-3dd72d2d1adf] Booting with volume 143d4bac-bf81-4e34-a5c2-30ed203b60d4 at /dev/vda
Nov 03 12:59:51 user nova-compute[74960]: DEBUG os_brick.utils [None req-0fe65b66-731d-44cc-bb79-9c82bb16eb56 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 12:59:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:59:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:59:51 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba7057e-58cc-46e4-94a3-10ebb3c8b6c4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:75b8e219756\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:59:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:59:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:59:51 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d211078-0839-4f3a-b5e2-9d2a2af78f5a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:59:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:59:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 12:59:51 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[e54f9109-ff67-4b64-9072-c5617adee5b2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:59:51 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[d26e69ed-a5ca-462c-a197-b65c3c8ed533]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:59:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-0fe65b66-731d-44cc-bb79-9c82bb16eb56 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Running cmd (subprocess): nvme version {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:59:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-0fe65b66-731d-44cc-bb79-9c82bb16eb56 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] 'nvme version' failed. Not Retrying. {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 12:59:51 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0fe65b66-731d-44cc-bb79-9c82bb16eb56 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] nvme not present on system {{(pid=74960) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 12:59:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 12:59:51 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 12:59:51 user nova-compute[74960]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 12:59:51 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[16d42bef-41e1-4551-9e0b-f65e15f1c4aa]: (4, '') {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 12:59:51 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-0fe65b66-731d-44cc-bb79-9c82bb16eb56 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74960) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 12:59:51 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-0fe65b66-731d-44cc-bb79-9c82bb16eb56 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74960) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 12:59:51 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-0fe65b66-731d-44cc-bb79-9c82bb16eb56 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] LIGHTOS: no hostnqn found. {{(pid=74960) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 12:59:51 user nova-compute[74960]: DEBUG os_brick.utils [None req-0fe65b66-731d-44cc-bb79-9c82bb16eb56 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:75b8e219756', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 12:59:51 user nova-compute[74960]: DEBUG nova.virt.block_device [None req-0fe65b66-731d-44cc-bb79-9c82bb16eb56 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 447cfd77-38cb-4696-b25e-3dd72d2d1adf] Updating existing volume attachment record: f48018d3-2f4e-43b4-baed-d2172864c487 {{(pid=74960) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 12:59:52 user nova-compute[74960]: DEBUG nova.network.neutron [None req-0fe65b66-731d-44cc-bb79-9c82bb16eb56 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 447cfd77-38cb-4696-b25e-3dd72d2d1adf] Successfully created port: 2b011242-2c0f-47cf-b1c6-e66bef17214b {{(pid=74960) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 12:59:52 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-d9a70cf3-d34c-4ca3-9f8e-d4fa540f1e25 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Acquiring lock "61204546-6d78-4f0b-80ed-91eed8943fca" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 12:59:52 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-d9a70cf3-d34c-4ca3-9f8e-d4fa540f1e25 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Lock "61204546-6d78-4f0b-80ed-91eed8943fca" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 12:59:52 user nova-compute[74960]: INFO nova.compute.manager [None req-d9a70cf3-d34c-4ca3-9f8e-d4fa540f1e25 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 61204546-6d78-4f0b-80ed-91eed8943fca] Detaching volume 7989e6a7-e265-4c8c-8394-ab5e5d4309c7
Nov 03 12:59:52 user nova-compute[74960]: INFO nova.virt.block_device [None req-d9a70cf3-d34c-4ca3-9f8e-d4fa540f1e25 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 61204546-6d78-4f0b-80ed-91eed8943fca] Attempting to driver detach volume 7989e6a7-e265-4c8c-8394-ab5e5d4309c7 from mountpoint /dev/vdb
Nov 03 12:59:52 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-d9a70cf3-d34c-4ca3-9f8e-d4fa540f1e25 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Attempting to detach device vdb from instance 61204546-6d78-4f0b-80ed-91eed8943fca from the persistent domain config. {{(pid=74960) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 03 12:59:52 user nova-compute[74960]: DEBUG nova.virt.libvirt.guest [None req-d9a70cf3-d34c-4ca3-9f8e-d4fa540f1e25 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 12:59:52 user nova-compute[74960]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 12:59:52 user nova-compute[74960]:   <source dev="/dev/sdb"/>
Nov 03 12:59:52 user nova-compute[74960]:   <target dev="vdb" bus="virtio"/>
Nov 03 12:59:52 user nova-compute[74960]:   <serial>7989e6a7-e265-4c8c-8394-ab5e5d4309c7</serial>
Nov 03 12:59:52 user nova-compute[74960]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 12:59:52 user nova-compute[74960]: </disk>
Nov 03 12:59:52 user nova-compute[74960]:  {{(pid=74960) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 12:59:52 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-d9a70cf3-d34c-4ca3-9f8e-d4fa540f1e25 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Successfully detached device vdb from instance 61204546-6d78-4f0b-80ed-91eed8943fca from the persistent domain config.
Nov 03 12:59:52 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-d9a70cf3-d34c-4ca3-9f8e-d4fa540f1e25 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 61204546-6d78-4f0b-80ed-91eed8943fca from the live domain config. {{(pid=74960) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 03 12:59:52 user nova-compute[74960]: DEBUG nova.virt.libvirt.guest [None req-d9a70cf3-d34c-4ca3-9f8e-d4fa540f1e25 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 12:59:52 user nova-compute[74960]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 12:59:52 user nova-compute[74960]:   <source dev="/dev/sdb"/>
Nov 03 12:59:52 user nova-compute[74960]:   <target dev="vdb" bus="virtio"/>
Nov 03 12:59:52 user nova-compute[74960]:   <serial>7989e6a7-e265-4c8c-8394-ab5e5d4309c7</serial>
Nov 03 12:59:52 user nova-compute[74960]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 12:59:52 user nova-compute[74960]: </disk>
Nov 03 12:59:52 user nova-compute[74960]:  {{(pid=74960) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 12:59:52 user nova-compute[74960]: DEBUG nova.network.neutron [None req-0fe65b66-731d-44cc-bb79-9c82bb16eb56 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 447cfd77-38cb-4696-b25e-3dd72d2d1adf] Successfully updated port: 2b011242-2c0f-47cf-b1c6-e66bef17214b {{(pid=74960) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 12:59:53 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-0fe65b66-731d-44cc-bb79-9c82bb16eb56 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Acquiring lock "refresh_cache-447cfd77-38cb-4696-b25e-3dd72d2d1adf" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:59:53 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-0fe65b66-731d-44cc-bb79-9c82bb16eb56 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Acquired lock "refresh_cache-447cfd77-38cb-4696-b25e-3dd72d2d1adf" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:59:53 user nova-compute[74960]: DEBUG nova.network.neutron [None req-0fe65b66-731d-44cc-bb79-9c82bb16eb56 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 447cfd77-38cb-4696-b25e-3dd72d2d1adf] Building network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 12:59:53 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-d9a70cf3-d34c-4ca3-9f8e-d4fa540f1e25 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 61204546-6d78-4f0b-80ed-91eed8943fca {{(pid=74960) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 03 12:59:53 user nova-compute[74960]: DEBUG nova.compute.manager [req-b7c961e1-6242-410b-881a-2bc99913cef8 req-4b9e8009-dd6a-4a2a-8567-45918e1e3698 service nova] [instance: 447cfd77-38cb-4696-b25e-3dd72d2d1adf] Received event network-changed-2b011242-2c0f-47cf-b1c6-e66bef17214b {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 12:59:53 user nova-compute[74960]: DEBUG nova.compute.manager [req-b7c961e1-6242-410b-881a-2bc99913cef8 req-4b9e8009-dd6a-4a2a-8567-45918e1e3698 service nova] [instance: 447cfd77-38cb-4696-b25e-3dd72d2d1adf] Refreshing instance network info cache due to event network-changed-2b011242-2c0f-47cf-b1c6-e66bef17214b. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 12:59:53 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-b7c961e1-6242-410b-881a-2bc99913cef8 req-4b9e8009-dd6a-4a2a-8567-45918e1e3698 service nova] Acquiring lock "refresh_cache-447cfd77-38cb-4696-b25e-3dd72d2d1adf" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 12:59:53 user nova-compute[74960]: DEBUG nova.network.neutron [None req-0fe65b66-731d-44cc-bb79-9c82bb16eb56 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 447cfd77-38cb-4696-b25e-3dd72d2d1adf] Instance cache missing network info. {{(pid=74960) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 12:59:53 user nova-compute[74960]: DEBUG nova.network.neutron [None req-0fe65b66-731d-44cc-bb79-9c82bb16eb56 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 447cfd77-38cb-4696-b25e-3dd72d2d1adf] Updating instance_info_cache with network_info: [{"id": "2b011242-2c0f-47cf-b1c6-e66bef17214b", "address": "fa:16:3e:65:ea:9e", "network": {"id": "8e985ab3-9852-4f07-8b5c-19f7bf113939", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781795302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d64f3d9dae8f45bcb2e0677a0076ed64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b011242-2c", "ovs_interfaceid": "2b011242-2c0f-47cf-b1c6-e66bef17214b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:59:53 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-0fe65b66-731d-44cc-bb79-9c82bb16eb56 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Releasing lock "refresh_cache-447cfd77-38cb-4696-b25e-3dd72d2d1adf" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:59:53 user nova-compute[74960]: DEBUG nova.compute.manager [None req-0fe65b66-731d-44cc-bb79-9c82bb16eb56 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 447cfd77-38cb-4696-b25e-3dd72d2d1adf] Instance network_info: |[{"id": "2b011242-2c0f-47cf-b1c6-e66bef17214b", "address": "fa:16:3e:65:ea:9e", "network": {"id": "8e985ab3-9852-4f07-8b5c-19f7bf113939", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781795302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d64f3d9dae8f45bcb2e0677a0076ed64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b011242-2c", "ovs_interfaceid": "2b011242-2c0f-47cf-b1c6-e66bef17214b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74960) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 12:59:53 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-b7c961e1-6242-410b-881a-2bc99913cef8 req-4b9e8009-dd6a-4a2a-8567-45918e1e3698 service nova] Acquired lock "refresh_cache-447cfd77-38cb-4696-b25e-3dd72d2d1adf" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 12:59:53 user nova-compute[74960]: DEBUG nova.network.neutron [req-b7c961e1-6242-410b-881a-2bc99913cef8 req-4b9e8009-dd6a-4a2a-8567-45918e1e3698 service nova] [instance: 447cfd77-38cb-4696-b25e-3dd72d2d1adf] Refreshing network info cache for port 2b011242-2c0f-47cf-b1c6-e66bef17214b {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 12:59:53 user nova-compute[74960]: DEBUG nova.network.neutron [req-b7c961e1-6242-410b-881a-2bc99913cef8 req-4b9e8009-dd6a-4a2a-8567-45918e1e3698 service nova] [instance: 447cfd77-38cb-4696-b25e-3dd72d2d1adf] Updated VIF entry in instance network info cache for port 2b011242-2c0f-47cf-b1c6-e66bef17214b. {{(pid=74960) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 12:59:53 user nova-compute[74960]: DEBUG nova.network.neutron [req-b7c961e1-6242-410b-881a-2bc99913cef8 req-4b9e8009-dd6a-4a2a-8567-45918e1e3698 service nova] [instance: 447cfd77-38cb-4696-b25e-3dd72d2d1adf] Updating instance_info_cache with network_info: [{"id": "2b011242-2c0f-47cf-b1c6-e66bef17214b", "address": "fa:16:3e:65:ea:9e", "network": {"id": "8e985ab3-9852-4f07-8b5c-19f7bf113939", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781795302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d64f3d9dae8f45bcb2e0677a0076ed64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b011242-2c", "ovs_interfaceid": "2b011242-2c0f-47cf-b1c6-e66bef17214b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 12:59:53 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-b7c961e1-6242-410b-881a-2bc99913cef8 req-4b9e8009-dd6a-4a2a-8567-45918e1e3698 service nova] Releasing lock "refresh_cache-447cfd77-38cb-4696-b25e-3dd72d2d1adf" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 12:59:54 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 12:59:56 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:00:01 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:00:01 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:00:01 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74960) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 13:00:01 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74960) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 13:00:01 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74960) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 13:00:01 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:00:06 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:00:10 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:00:11 user nova-compute[74960]: DEBUG nova.compute.manager [None req-0fe65b66-731d-44cc-bb79-9c82bb16eb56 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 447cfd77-38cb-4696-b25e-3dd72d2d1adf] Start spawning the instance on the hypervisor. {{(pid=74960) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 13:00:11 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-0fe65b66-731d-44cc-bb79-9c82bb16eb56 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 447cfd77-38cb-4696-b25e-3dd72d2d1adf] Creating instance directory {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 13:00:11 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-0fe65b66-731d-44cc-bb79-9c82bb16eb56 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 447cfd77-38cb-4696-b25e-3dd72d2d1adf] Creating image(s)
Nov 03 13:00:11 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-0fe65b66-731d-44cc-bb79-9c82bb16eb56 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 447cfd77-38cb-4696-b25e-3dd72d2d1adf] Did not create local disks {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 03 13:00:11 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-0fe65b66-731d-44cc-bb79-9c82bb16eb56 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 447cfd77-38cb-4696-b25e-3dd72d2d1adf] Ensure instance console log exists: /opt/stack/data/nova/instances/447cfd77-38cb-4696-b25e-3dd72d2d1adf/console.log {{(pid=74960) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 13:00:11 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-0fe65b66-731d-44cc-bb79-9c82bb16eb56 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:00:11 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-0fe65b66-731d-44cc-bb79-9c82bb16eb56 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:00:11 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-0fe65b66-731d-44cc-bb79-9c82bb16eb56 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:00:11 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-0fe65b66-731d-44cc-bb79-9c82bb16eb56 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 447cfd77-38cb-4696-b25e-3dd72d2d1adf] Start _get_guest_xml network_info=[{"id": "2b011242-2c0f-47cf-b1c6-e66bef17214b", "address": "fa:16:3e:65:ea:9e", "network": {"id": "8e985ab3-9852-4f07-8b5c-19f7bf113939", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781795302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d64f3d9dae8f45bcb2e0677a0076ed64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b011242-2c", "ovs_interfaceid": "2b011242-2c0f-47cf-b1c6-e66bef17214b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UEgVDteh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '447cfd77-38cb-4696-b25e-3dd72d2d1adf', 'attached_at': '', 'detached_at': '', 'volume_id': '143d4bac-bf81-4e34-a5c2-30ed203b60d4', 'serial': '143d4bac-bf81-4e34-a5c2-30ed203b60d4'}, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'device_type': 'disk', 'attachment_id': 'f48018d3-2f4e-43b4-baed-d2172864c487', 'boot_index': 0, 'guest_format': None, 'volume_type': None} {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 13:00:11 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-0fe65b66-731d-44cc-bb79-9c82bb16eb56 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:00:11 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-0fe65b66-731d-44cc-bb79-9c82bb16eb56 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:00:11 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-0fe65b66-731d-44cc-bb79-9c82bb16eb56 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 13:00:11 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-0fe65b66-731d-44cc-bb79-9c82bb16eb56 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] CPU controller missing on host. {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 13:00:11 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-0fe65b66-731d-44cc-bb79-9c82bb16eb56 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 13:00:11 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-0fe65b66-731d-44cc-bb79-9c82bb16eb56 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] CPU controller found on host. {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 13:00:11 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-0fe65b66-731d-44cc-bb79-9c82bb16eb56 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74960) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 13:00:11 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-0fe65b66-731d-44cc-bb79-9c82bb16eb56 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 13:00:11 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-0fe65b66-731d-44cc-bb79-9c82bb16eb56 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Flavor limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 13:00:11 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-0fe65b66-731d-44cc-bb79-9c82bb16eb56 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Image limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 13:00:11 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-0fe65b66-731d-44cc-bb79-9c82bb16eb56 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Flavor pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 13:00:11 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-0fe65b66-731d-44cc-bb79-9c82bb16eb56 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Image pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 13:00:11 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-0fe65b66-731d-44cc-bb79-9c82bb16eb56 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 13:00:11 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-0fe65b66-731d-44cc-bb79-9c82bb16eb56 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 13:00:11 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-0fe65b66-731d-44cc-bb79-9c82bb16eb56 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 13:00:11 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-0fe65b66-731d-44cc-bb79-9c82bb16eb56 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Got 1 possible topologies {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 13:00:11 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-0fe65b66-731d-44cc-bb79-9c82bb16eb56 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 13:00:11 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-0fe65b66-731d-44cc-bb79-9c82bb16eb56 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 13:00:11 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0fe65b66-731d-44cc-bb79-9c82bb16eb56 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 447cfd77-38cb-4696-b25e-3dd72d2d1adf] Calling os-brick to attach iSCSI Volume {{(pid=74960) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 13:00:11 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fe65b66-731d-44cc-bb79-9c82bb16eb56 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9aa420acb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UEgVDteh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 13:00:11 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-0fe65b66-731d-44cc-bb79-9c82bb16eb56 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 13:00:11 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-0fe65b66-731d-44cc-bb79-9c82bb16eb56 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 13:00:11 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-0fe65b66-731d-44cc-bb79-9c82bb16eb56 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 13:00:11 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-0fe65b66-731d-44cc-bb79-9c82bb16eb56 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 13:00:11 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-0fe65b66-731d-44cc-bb79-9c82bb16eb56 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 13:00:11 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-0fe65b66-731d-44cc-bb79-9c82bb16eb56 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 13:00:11 user nova-compute[74960]: INFO os_brick.initiator.connectors.iscsi [None req-0fe65b66-731d-44cc-bb79-9c82bb16eb56 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 13:00:11 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4 -p 172.16.0.220:3260 {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:00:11 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:00:11 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d0dee90-acc2-4532-8826-374f3138d5c3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:00:11 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fe65b66-731d-44cc-bb79-9c82bb16eb56 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 13:00:11 user nova-compute[74960]:  {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:00:11 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4 -p 172.16.0.220:3260 --interface default --op new {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:00:11 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:00:11 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[04a7bbac-2a0a-4790-a2f6-12d57a9325aa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4] added\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:00:11 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fe65b66-731d-44cc-bb79-9c82bb16eb56 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4] added
Nov 03 13:00:11 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:00:11 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:00:11 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:00:11 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c94167d-8ed7-4785-a01e-669e31700ab0]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:00:11 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fe65b66-731d-44cc-bb79-9c82bb16eb56 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:00:11 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:00:11 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:00:11 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[70ed1db9-f6c3-4cd6-b420-a4b7476a3fde]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:00:11 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fe65b66-731d-44cc-bb79-9c82bb16eb56 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:00:11 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UEgVDteh {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:00:11 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UEgVDteh" returned: 0 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:00:11 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[48949264-f2c5-44af-8b83-87592f46aa14]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:00:11 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fe65b66-731d-44cc-bb79-9c82bb16eb56 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UEgVDteh'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:00:11 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:00:11 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:00:11 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bd51fe5-31a1-4b77-82fe-02ef191f658c]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:00:11 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fe65b66-731d-44cc-bb79-9c82bb16eb56 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:00:11 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:00:11 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:00:11 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[d407f384-beaf-400a-a887-a85f6960d1cd]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7989e6a7-e265-4c8c-8394-ab5e5d4309c7 (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:00:11 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fe65b66-731d-44cc-bb79-9c82bb16eb56 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7989e6a7-e265-4c8c-8394-ab5e5d4309c7 (non-flash)
Nov 03 13:00:11 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 13:00:11 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fe65b66-731d-44cc-bb79-9c82bb16eb56 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7989e6a7-e265-4c8c-8394-ab5e5d4309c7 (non-flash)
Nov 03 13:00:11 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 13:00:11 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4 -p 172.16.0.220:3260 --login {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:00:11 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:00:11 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8329d2d-ba65-4a33-9f90-809cf32dcb72]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:00:11 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fe65b66-731d-44cc-bb79-9c82bb16eb56 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4, portal: 172.16.0.220,3260]
Nov 03 13:00:11 user nova-compute[74960]: Login to [iface: default, target: iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4, portal: 172.16.0.220,3260] successful.
Nov 03 13:00:11 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:00:11 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:00:11 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:00:11 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d4ce31e-f226-42de-a4f2-a9a0051dbfc0]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:00:11 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fe65b66-731d-44cc-bb79-9c82bb16eb56 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:00:11 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:00:11 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:00:11 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c831df7-8ce4-4ba5-9697-339027276bff]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7989e6a7-e265-4c8c-8394-ab5e5d4309c7 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4 (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:00:11 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fe65b66-731d-44cc-bb79-9c82bb16eb56 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7989e6a7-e265-4c8c-8394-ab5e5d4309c7 (non-flash)
Nov 03 13:00:11 user nova-compute[74960]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4 (non-flash)
Nov 03 13:00:11 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 13:00:11 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fe65b66-731d-44cc-bb79-9c82bb16eb56 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7989e6a7-e265-4c8c-8394-ab5e5d4309c7 (non-flash)
Nov 03 13:00:11 user nova-compute[74960]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4 (non-flash)
Nov 03 13:00:11 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 13:00:11 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-0fe65b66-731d-44cc-bb79-9c82bb16eb56 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 13:00:11 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fe65b66-731d-44cc-bb79-9c82bb16eb56 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Connected to 172.16.0.220:3260 {{(pid=74960) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 13:00:11 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-0fe65b66-731d-44cc-bb79-9c82bb16eb56 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] HCTL ('34', '-', '-', 0) found on session 48 with lun 0 {{(pid=74960) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 13:00:11 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-0fe65b66-731d-44cc-bb79-9c82bb16eb56 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74960) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 13:00:11 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:00:11 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:00:11 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d71b3a8-53ee-459e-9d36-1abcd7b4b817]: (4, ('- - 0', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:00:11 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-0fe65b66-731d-44cc-bb79-9c82bb16eb56 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Searching for a device in session 48 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74960) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 13:00:11 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fe65b66-731d-44cc-bb79-9c82bb16eb56 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UEgVDteh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74960) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 13:00:11 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:00:11 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:00:11 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74960) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 13:00:11 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74960) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 13:00:11 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74960) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 13:00:11 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:00:12 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-0fe65b66-731d-44cc-bb79-9c82bb16eb56 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 13:00:12 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fe65b66-731d-44cc-bb79-9c82bb16eb56 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '23864636566386535', 'path': '/dev/sdc'} {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 13:00:12 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0fe65b66-731d-44cc-bb79-9c82bb16eb56 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 447cfd77-38cb-4696-b25e-3dd72d2d1adf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23864636566386535', 'path': '/dev/sdc'} {{(pid=74960) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 13:00:12 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-0fe65b66-731d-44cc-bb79-9c82bb16eb56 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:59:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-283546554',display_name='tempest-TestVolumeBootPattern-server-283546554',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-283546554',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG58VBMUGF35creXkaeLlS45qeSpHByygSbALoDPLyAkX8z0vqLaGfOF/PdmxhlSuzswK/zmWz4mkAMsQnGwfeIg0PnI682GlW4AY7e0K4aRcKwMAhIAhksojQg6Tc/b4g==',key_name='tempest-TestVolumeBootPattern-178111993',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d64f3d9dae8f45bcb2e0677a0076ed64',ramdisk_id='',reservation_id='r-dr1dl9z7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1795947051',owner_user_name='tempest-TestVolumeBootPattern-1795947051-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:59:52Z,user_data=None,user_id='067a3f33438b4112b818b91ecb4dd0d2',uuid=447cfd77-38cb-4696-b25e-3dd72d2d1adf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2b011242-2c0f-47cf-b1c6-e66bef17214b", "address": "fa:16:3e:65:ea:9e", "network": {"id": "8e985ab3-9852-4f07-8b5c-19f7bf113939", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781795302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d64f3d9dae8f45bcb2e0677a0076ed64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b011242-2c", "ovs_interfaceid": "2b011242-2c0f-47cf-b1c6-e66bef17214b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74960) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 13:00:12 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-0fe65b66-731d-44cc-bb79-9c82bb16eb56 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Converting VIF {"id": "2b011242-2c0f-47cf-b1c6-e66bef17214b", "address": "fa:16:3e:65:ea:9e", "network": {"id": "8e985ab3-9852-4f07-8b5c-19f7bf113939", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781795302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d64f3d9dae8f45bcb2e0677a0076ed64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b011242-2c", "ovs_interfaceid": "2b011242-2c0f-47cf-b1c6-e66bef17214b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 13:00:12 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-0fe65b66-731d-44cc-bb79-9c82bb16eb56 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:ea:9e,bridge_name='br-int',has_traffic_filtering=True,id=2b011242-2c0f-47cf-b1c6-e66bef17214b,network=Network(8e985ab3-9852-4f07-8b5c-19f7bf113939),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b011242-2c') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 13:00:12 user nova-compute[74960]: DEBUG nova.objects.instance [None req-0fe65b66-731d-44cc-bb79-9c82bb16eb56 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lazy-loading 'pci_devices' on Instance uuid 447cfd77-38cb-4696-b25e-3dd72d2d1adf {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:00:12 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-0fe65b66-731d-44cc-bb79-9c82bb16eb56 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 447cfd77-38cb-4696-b25e-3dd72d2d1adf] End _get_guest_xml xml=<domain type="kvm">
Nov 03 13:00:12 user nova-compute[74960]:   <uuid>447cfd77-38cb-4696-b25e-3dd72d2d1adf</uuid>
Nov 03 13:00:12 user nova-compute[74960]:   <name>instance-00000031</name>
Nov 03 13:00:12 user nova-compute[74960]:   <memory>524288</memory>
Nov 03 13:00:12 user nova-compute[74960]:   <vcpu>1</vcpu>
Nov 03 13:00:12 user nova-compute[74960]:   <metadata>
Nov 03 13:00:12 user nova-compute[74960]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 13:00:12 user nova-compute[74960]:       <nova:package version="0.0.0"/>
Nov 03 13:00:12 user nova-compute[74960]:       <nova:name>tempest-TestVolumeBootPattern-server-283546554</nova:name>
Nov 03 13:00:12 user nova-compute[74960]:       <nova:creationTime>2023-11-03 13:00:11</nova:creationTime>
Nov 03 13:00:12 user nova-compute[74960]:       <nova:flavor name="m1.tiny">
Nov 03 13:00:12 user nova-compute[74960]:         <nova:memory>512</nova:memory>
Nov 03 13:00:12 user nova-compute[74960]:         <nova:disk>1</nova:disk>
Nov 03 13:00:12 user nova-compute[74960]:         <nova:swap>0</nova:swap>
Nov 03 13:00:12 user nova-compute[74960]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 13:00:12 user nova-compute[74960]:         <nova:vcpus>1</nova:vcpus>
Nov 03 13:00:12 user nova-compute[74960]:       </nova:flavor>
Nov 03 13:00:12 user nova-compute[74960]:       <nova:owner>
Nov 03 13:00:12 user nova-compute[74960]:         <nova:user uuid="067a3f33438b4112b818b91ecb4dd0d2">tempest-TestVolumeBootPattern-1795947051-project-member</nova:user>
Nov 03 13:00:12 user nova-compute[74960]:         <nova:project uuid="d64f3d9dae8f45bcb2e0677a0076ed64">tempest-TestVolumeBootPattern-1795947051</nova:project>
Nov 03 13:00:12 user nova-compute[74960]:       </nova:owner>
Nov 03 13:00:12 user nova-compute[74960]:       <nova:ports>
Nov 03 13:00:12 user nova-compute[74960]:         <nova:port uuid="2b011242-2c0f-47cf-b1c6-e66bef17214b">
Nov 03 13:00:12 user nova-compute[74960]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 03 13:00:12 user nova-compute[74960]:         </nova:port>
Nov 03 13:00:12 user nova-compute[74960]:       </nova:ports>
Nov 03 13:00:12 user nova-compute[74960]:     </nova:instance>
Nov 03 13:00:12 user nova-compute[74960]:   </metadata>
Nov 03 13:00:12 user nova-compute[74960]:   <sysinfo type="smbios">
Nov 03 13:00:12 user nova-compute[74960]:     <system>
Nov 03 13:00:12 user nova-compute[74960]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 13:00:12 user nova-compute[74960]:       <entry name="product">OpenStack Nova</entry>
Nov 03 13:00:12 user nova-compute[74960]:       <entry name="version">0.0.0</entry>
Nov 03 13:00:12 user nova-compute[74960]:       <entry name="serial">447cfd77-38cb-4696-b25e-3dd72d2d1adf</entry>
Nov 03 13:00:12 user nova-compute[74960]:       <entry name="uuid">447cfd77-38cb-4696-b25e-3dd72d2d1adf</entry>
Nov 03 13:00:12 user nova-compute[74960]:       <entry name="family">Virtual Machine</entry>
Nov 03 13:00:12 user nova-compute[74960]:     </system>
Nov 03 13:00:12 user nova-compute[74960]:   </sysinfo>
Nov 03 13:00:12 user nova-compute[74960]:   <os>
Nov 03 13:00:12 user nova-compute[74960]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 13:00:12 user nova-compute[74960]:     <boot dev="hd"/>
Nov 03 13:00:12 user nova-compute[74960]:     <smbios mode="sysinfo"/>
Nov 03 13:00:12 user nova-compute[74960]:   </os>
Nov 03 13:00:12 user nova-compute[74960]:   <features>
Nov 03 13:00:12 user nova-compute[74960]:     <acpi/>
Nov 03 13:00:12 user nova-compute[74960]:     <apic/>
Nov 03 13:00:12 user nova-compute[74960]:     <vmcoreinfo/>
Nov 03 13:00:12 user nova-compute[74960]:   </features>
Nov 03 13:00:12 user nova-compute[74960]:   <clock offset="utc">
Nov 03 13:00:12 user nova-compute[74960]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 13:00:12 user nova-compute[74960]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 13:00:12 user nova-compute[74960]:     <timer name="hpet" present="no"/>
Nov 03 13:00:12 user nova-compute[74960]:   </clock>
Nov 03 13:00:12 user nova-compute[74960]:   <cpu mode="custom" match="exact">
Nov 03 13:00:12 user nova-compute[74960]:     <model>Nehalem</model>
Nov 03 13:00:12 user nova-compute[74960]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 13:00:12 user nova-compute[74960]:   </cpu>
Nov 03 13:00:12 user nova-compute[74960]:   <devices>
Nov 03 13:00:12 user nova-compute[74960]:     <disk type="block" device="disk">
Nov 03 13:00:12 user nova-compute[74960]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 13:00:12 user nova-compute[74960]:       <source dev="/dev/sdc"/>
Nov 03 13:00:12 user nova-compute[74960]:       <target dev="vda" bus="virtio"/>
Nov 03 13:00:12 user nova-compute[74960]:       <serial>143d4bac-bf81-4e34-a5c2-30ed203b60d4</serial>
Nov 03 13:00:12 user nova-compute[74960]:     </disk>
Nov 03 13:00:12 user nova-compute[74960]:     <interface type="ethernet">
Nov 03 13:00:12 user nova-compute[74960]:       <mac address="fa:16:3e:65:ea:9e"/>
Nov 03 13:00:12 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 13:00:12 user nova-compute[74960]:       <mtu size="1442"/>
Nov 03 13:00:12 user nova-compute[74960]:       <target dev="tap2b011242-2c"/>
Nov 03 13:00:12 user nova-compute[74960]:     </interface>
Nov 03 13:00:12 user nova-compute[74960]:     <serial type="pty">
Nov 03 13:00:12 user nova-compute[74960]:       <log file="/opt/stack/data/nova/instances/447cfd77-38cb-4696-b25e-3dd72d2d1adf/console.log" append="off"/>
Nov 03 13:00:12 user nova-compute[74960]:     </serial>
Nov 03 13:00:12 user nova-compute[74960]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 13:00:12 user nova-compute[74960]:     <video>
Nov 03 13:00:12 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 13:00:12 user nova-compute[74960]:     </video>
Nov 03 13:00:12 user nova-compute[74960]:     <rng model="virtio">
Nov 03 13:00:12 user nova-compute[74960]:       <backend model="random">/dev/urandom</backend>
Nov 03 13:00:12 user nova-compute[74960]:     </rng>
Nov 03 13:00:12 user nova-compute[74960]:     <controller type="usb" index="0" model="none"/>
Nov 03 13:00:12 user nova-compute[74960]:     <memballoon model="virtio">
Nov 03 13:00:12 user nova-compute[74960]:       <stats period="10"/>
Nov 03 13:00:12 user nova-compute[74960]:     </memballoon>
Nov 03 13:00:12 user nova-compute[74960]:   </devices>
Nov 03 13:00:12 user nova-compute[74960]: </domain>
Nov 03 13:00:12 user nova-compute[74960]:  {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 13:00:12 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-0fe65b66-731d-44cc-bb79-9c82bb16eb56 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:59:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-283546554',display_name='tempest-TestVolumeBootPattern-server-283546554',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-283546554',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG58VBMUGF35creXkaeLlS45qeSpHByygSbALoDPLyAkX8z0vqLaGfOF/PdmxhlSuzswK/zmWz4mkAMsQnGwfeIg0PnI682GlW4AY7e0K4aRcKwMAhIAhksojQg6Tc/b4g==',key_name='tempest-TestVolumeBootPattern-178111993',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d64f3d9dae8f45bcb2e0677a0076ed64',ramdisk_id='',reservation_id='r-dr1dl9z7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1795947051',owner_user_name='tempest-TestVolumeBootPattern-1795947051-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T12:59:52Z,user_data=None,user_id='067a3f33438b4112b818b91ecb4dd0d2',uuid=447cfd77-38cb-4696-b25e-3dd72d2d1adf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2b011242-2c0f-47cf-b1c6-e66bef17214b", "address": "fa:16:3e:65:ea:9e", "network": {"id": "8e985ab3-9852-4f07-8b5c-19f7bf113939", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781795302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d64f3d9dae8f45bcb2e0677a0076ed64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b011242-2c", "ovs_interfaceid": "2b011242-2c0f-47cf-b1c6-e66bef17214b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 13:00:12 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-0fe65b66-731d-44cc-bb79-9c82bb16eb56 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Converting VIF {"id": "2b011242-2c0f-47cf-b1c6-e66bef17214b", "address": "fa:16:3e:65:ea:9e", "network": {"id": "8e985ab3-9852-4f07-8b5c-19f7bf113939", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781795302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d64f3d9dae8f45bcb2e0677a0076ed64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b011242-2c", "ovs_interfaceid": "2b011242-2c0f-47cf-b1c6-e66bef17214b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 13:00:12 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-0fe65b66-731d-44cc-bb79-9c82bb16eb56 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:ea:9e,bridge_name='br-int',has_traffic_filtering=True,id=2b011242-2c0f-47cf-b1c6-e66bef17214b,network=Network(8e985ab3-9852-4f07-8b5c-19f7bf113939),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b011242-2c') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 13:00:12 user nova-compute[74960]: DEBUG os_vif [None req-0fe65b66-731d-44cc-bb79-9c82bb16eb56 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:ea:9e,bridge_name='br-int',has_traffic_filtering=True,id=2b011242-2c0f-47cf-b1c6-e66bef17214b,network=Network(8e985ab3-9852-4f07-8b5c-19f7bf113939),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b011242-2c') {{(pid=74960) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 13:00:12 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:00:12 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:00:12 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 13:00:12 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:00:12 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2bdb75be-fd51-5378-be4e-228d08a65a0a', '_type': 'linux-noop'}}, row=False) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:00:12 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:00:12 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:00:12 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:00:12 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2b011242-2c, may_exist=True, interface_attrs={}) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:00:12 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2b011242-2c, col_values=(('qos', UUID('e923662c-327f-482f-94ce-dff4d1b15da9')),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:00:12 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2b011242-2c, col_values=(('external_ids', {'iface-id': '2b011242-2c0f-47cf-b1c6-e66bef17214b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:65:ea:9e', 'vm-uuid': '447cfd77-38cb-4696-b25e-3dd72d2d1adf'}),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:00:12 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:00:12 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:00:12 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:00:12 user nova-compute[74960]: INFO os_vif [None req-0fe65b66-731d-44cc-bb79-9c82bb16eb56 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:ea:9e,bridge_name='br-int',has_traffic_filtering=True,id=2b011242-2c0f-47cf-b1c6-e66bef17214b,network=Network(8e985ab3-9852-4f07-8b5c-19f7bf113939),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b011242-2c')
Nov 03 13:00:12 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-0fe65b66-731d-44cc-bb79-9c82bb16eb56 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] No BDM found with device name vda, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 13:00:12 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-0fe65b66-731d-44cc-bb79-9c82bb16eb56 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] No VIF found with MAC fa:16:3e:65:ea:9e, not building metadata {{(pid=74960) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 13:00:13 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-d9a70cf3-d34c-4ca3-9f8e-d4fa540f1e25 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 61204546-6d78-4f0b-80ed-91eed8943fca is timed out.
Nov 03 13:00:13 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-d9a70cf3-d34c-4ca3-9f8e-d4fa540f1e25 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Successfully detached device vdb from instance 61204546-6d78-4f0b-80ed-91eed8943fca from the live domain config.
Nov 03 13:00:13 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9a70cf3-d34c-4ca3-9f8e-d4fa540f1e25 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 61204546-6d78-4f0b-80ed-91eed8943fca] calling os-brick to detach iSCSI Volume {{(pid=74960) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 13:00:13 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9a70cf3-d34c-4ca3-9f8e-d4fa540f1e25 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9aa420acb0>, {'target_iqn': 'iqn.2010-10.org.openstack:7989e6a7-e265-4c8c-8394-ab5e5d4309c7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xQaBKVHj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 13:00:13 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-d9a70cf3-d34c-4ca3-9f8e-d4fa540f1e25 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 13:00:13 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-d9a70cf3-d34c-4ca3-9f8e-d4fa540f1e25 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 13:00:13 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-d9a70cf3-d34c-4ca3-9f8e-d4fa540f1e25 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 13:00:13 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:00:13 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:00:13 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e28b889-0e0a-4390-8237-732886db5529]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7989e6a7-e265-4c8c-8394-ab5e5d4309c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:00:13 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9a70cf3-d34c-4ca3-9f8e-d4fa540f1e25 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 13:00:13 user nova-compute[74960]: No targets found.
Nov 03 13:00:13 user nova-compute[74960]: iSNS:
Nov 03 13:00:13 user nova-compute[74960]: No targets found.
Nov 03 13:00:13 user nova-compute[74960]: STATIC:
Nov 03 13:00:13 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:7989e6a7-e265-4c8c-8394-ab5e5d4309c7
Nov 03 13:00:13 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 13:00:13 user nova-compute[74960]:                 Iface Name: default
Nov 03 13:00:13 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4
Nov 03 13:00:13 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 13:00:13 user nova-compute[74960]:                 Iface Name: default
Nov 03 13:00:13 user nova-compute[74960]: FIRMWARE:
Nov 03 13:00:13 user nova-compute[74960]: No targets found.
Nov 03 13:00:13 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 13:00:13 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9a70cf3-d34c-4ca3-9f8e-d4fa540f1e25 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 13:00:13 user nova-compute[74960]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 13:00:13 user nova-compute[74960]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74960) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 13:00:13 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9a70cf3-d34c-4ca3-9f8e-d4fa540f1e25 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7989e6a7-e265-4c8c-8394-ab5e5d4309c7', 0)] {{(pid=74960) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 13:00:13 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:00:13 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:00:13 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a6d8aad-708d-488a-8ae6-eb4da34cfe68]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7989e6a7-e265-4c8c-8394-ab5e5d4309c7\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:00:13 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:00:13 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:00:13 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[c78cdd4f-4a81-4225-a24e-4ec8c8446594]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7989e6a7-e265-4c8c-8394-ab5e5d4309c7 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4 (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:00:13 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9a70cf3-d34c-4ca3-9f8e-d4fa540f1e25 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7989e6a7-e265-4c8c-8394-ab5e5d4309c7 (non-flash)
Nov 03 13:00:13 user nova-compute[74960]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4 (non-flash)
Nov 03 13:00:13 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 13:00:13 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9a70cf3-d34c-4ca3-9f8e-d4fa540f1e25 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7989e6a7-e265-4c8c-8394-ab5e5d4309c7 (non-flash)
Nov 03 13:00:13 user nova-compute[74960]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4 (non-flash)
Nov 03 13:00:13 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 13:00:13 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9a70cf3-d34c-4ca3-9f8e-d4fa540f1e25 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9aa43b6e60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7989e6a7-e265-4c8c-8394-ab5e5d4309c7'): ({'sdb'}, set())}) {{(pid=74960) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 13:00:13 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-d9a70cf3-d34c-4ca3-9f8e-d4fa540f1e25 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Removing single pathed devices sdb {{(pid=74960) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 13:00:13 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:00:13 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:00:13 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[f728bdd4-b647-4cc3-b175-3c576cb7bb9d]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:00:13 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:00:13 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:00:13 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b94d1d5-dd53-4483-a33e-4bc3bc7a9f79]: (4, ('ok\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:00:13 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-d9a70cf3-d34c-4ca3-9f8e-d4fa540f1e25 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Flushing IO for device /dev/sdb {{(pid=74960) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 13:00:13 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:00:13 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:00:13 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[24b05a83-1c87-4cce-9e00-a0c6fde6c040]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:00:13 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-d9a70cf3-d34c-4ca3-9f8e-d4fa540f1e25 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74960) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 13:00:13 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:00:13 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:00:13 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac563c56-8061-4f16-b296-1e6d8446831b]: (4, ('1', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:00:13 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-d9a70cf3-d34c-4ca3-9f8e-d4fa540f1e25 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74960) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 13:00:13 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-d9a70cf3-d34c-4ca3-9f8e-d4fa540f1e25 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] SCSI volumes sdb have been removed. {{(pid=74960) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 13:00:13 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9a70cf3-d34c-4ca3-9f8e-d4fa540f1e25 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7989e6a7-e265-4c8c-8394-ab5e5d4309c7')] {{(pid=74960) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 13:00:13 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7989e6a7-e265-4c8c-8394-ab5e5d4309c7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:00:13 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7989e6a7-e265-4c8c-8394-ab5e5d4309c7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:00:13 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[b19ad2a5-06f0-4754-862f-1f343992fdf3]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:00:13 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9a70cf3-d34c-4ca3-9f8e-d4fa540f1e25 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:00:13 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7989e6a7-e265-4c8c-8394-ab5e5d4309c7 -p 172.16.0.220:3260 --logout {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:00:13 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7989e6a7-e265-4c8c-8394-ab5e5d4309c7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:00:13 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[f63f4654-3332-42c8-b4f6-36d6ba7256f6]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:7989e6a7-e265-4c8c-8394-ab5e5d4309c7, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:7989e6a7-e265-4c8c-8394-ab5e5d4309c7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:00:13 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9a70cf3-d34c-4ca3-9f8e-d4fa540f1e25 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:7989e6a7-e265-4c8c-8394-ab5e5d4309c7, portal: 172.16.0.220,3260]
Nov 03 13:00:13 user nova-compute[74960]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:7989e6a7-e265-4c8c-8394-ab5e5d4309c7, portal: 172.16.0.220,3260] successful.
Nov 03 13:00:13 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:00:13 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7989e6a7-e265-4c8c-8394-ab5e5d4309c7 -p 172.16.0.220:3260 --op delete {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:00:13 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7989e6a7-e265-4c8c-8394-ab5e5d4309c7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:00:13 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a4b130a-4923-4365-ab95-35f6b8cc09a7]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:00:13 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9a70cf3-d34c-4ca3-9f8e-d4fa540f1e25 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:00:13 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-d9a70cf3-d34c-4ca3-9f8e-d4fa540f1e25 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.286s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 13:00:13 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9a70cf3-d34c-4ca3-9f8e-d4fa540f1e25 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] <== disconnect_volume: return (286ms) None {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 13:00:13 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9a70cf3-d34c-4ca3-9f8e-d4fa540f1e25 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 61204546-6d78-4f0b-80ed-91eed8943fca] Disconnected iSCSI Volume {{(pid=74960) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 13:00:13 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:00:13 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:00:13 user nova-compute[74960]: DEBUG nova.compute.manager [req-ff1ed26f-b602-4bc2-af46-7fe8a16ae43b req-8fe2879d-be5d-43ff-9459-c2e14a8dc8cc service nova] [instance: 447cfd77-38cb-4696-b25e-3dd72d2d1adf] Received event network-vif-plugged-2b011242-2c0f-47cf-b1c6-e66bef17214b {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:00:13 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-ff1ed26f-b602-4bc2-af46-7fe8a16ae43b req-8fe2879d-be5d-43ff-9459-c2e14a8dc8cc service nova] Acquiring lock "447cfd77-38cb-4696-b25e-3dd72d2d1adf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:00:13 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-ff1ed26f-b602-4bc2-af46-7fe8a16ae43b req-8fe2879d-be5d-43ff-9459-c2e14a8dc8cc service nova] Lock "447cfd77-38cb-4696-b25e-3dd72d2d1adf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:00:13 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-ff1ed26f-b602-4bc2-af46-7fe8a16ae43b req-8fe2879d-be5d-43ff-9459-c2e14a8dc8cc service nova] Lock "447cfd77-38cb-4696-b25e-3dd72d2d1adf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:00:13 user nova-compute[74960]: DEBUG nova.compute.manager [req-ff1ed26f-b602-4bc2-af46-7fe8a16ae43b req-8fe2879d-be5d-43ff-9459-c2e14a8dc8cc service nova] [instance: 447cfd77-38cb-4696-b25e-3dd72d2d1adf] No waiting events found dispatching network-vif-plugged-2b011242-2c0f-47cf-b1c6-e66bef17214b {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:00:13 user nova-compute[74960]: WARNING nova.compute.manager [req-ff1ed26f-b602-4bc2-af46-7fe8a16ae43b req-8fe2879d-be5d-43ff-9459-c2e14a8dc8cc service nova] [instance: 447cfd77-38cb-4696-b25e-3dd72d2d1adf] Received unexpected event network-vif-plugged-2b011242-2c0f-47cf-b1c6-e66bef17214b for instance with vm_state building and task_state spawning.
Nov 03 13:00:14 user nova-compute[74960]: DEBUG nova.objects.instance [None req-d9a70cf3-d34c-4ca3-9f8e-d4fa540f1e25 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Lazy-loading 'flavor' on Instance uuid 61204546-6d78-4f0b-80ed-91eed8943fca {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:00:14 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-d9a70cf3-d34c-4ca3-9f8e-d4fa540f1e25 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Lock "61204546-6d78-4f0b-80ed-91eed8943fca" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.873s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:00:14 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:00:14 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:00:14 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:00:14 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:00:15 user nova-compute[74960]: DEBUG nova.compute.manager [None req-0fe65b66-731d-44cc-bb79-9c82bb16eb56 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 447cfd77-38cb-4696-b25e-3dd72d2d1adf] Instance event wait completed in 0 seconds for  {{(pid=74960) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 13:00:15 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-0fe65b66-731d-44cc-bb79-9c82bb16eb56 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 447cfd77-38cb-4696-b25e-3dd72d2d1adf] Guest created on hypervisor {{(pid=74960) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 13:00:15 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: 447cfd77-38cb-4696-b25e-3dd72d2d1adf] Instance spawned successfully.
Nov 03 13:00:15 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-0fe65b66-731d-44cc-bb79-9c82bb16eb56 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 447cfd77-38cb-4696-b25e-3dd72d2d1adf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 13:00:15 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-0fe65b66-731d-44cc-bb79-9c82bb16eb56 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 447cfd77-38cb-4696-b25e-3dd72d2d1adf] Found default for hw_cdrom_bus of ide {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:00:15 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-0fe65b66-731d-44cc-bb79-9c82bb16eb56 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 447cfd77-38cb-4696-b25e-3dd72d2d1adf] Found default for hw_disk_bus of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:00:15 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-0fe65b66-731d-44cc-bb79-9c82bb16eb56 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 447cfd77-38cb-4696-b25e-3dd72d2d1adf] Found default for hw_input_bus of None {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:00:15 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-0fe65b66-731d-44cc-bb79-9c82bb16eb56 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 447cfd77-38cb-4696-b25e-3dd72d2d1adf] Found default for hw_pointer_model of None {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:00:15 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-0fe65b66-731d-44cc-bb79-9c82bb16eb56 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 447cfd77-38cb-4696-b25e-3dd72d2d1adf] Found default for hw_video_model of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:00:15 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-0fe65b66-731d-44cc-bb79-9c82bb16eb56 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 447cfd77-38cb-4696-b25e-3dd72d2d1adf] Found default for hw_vif_model of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:00:15 user nova-compute[74960]: INFO nova.compute.manager [None req-0fe65b66-731d-44cc-bb79-9c82bb16eb56 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 447cfd77-38cb-4696-b25e-3dd72d2d1adf] Took 4.95 seconds to spawn the instance on the hypervisor.
Nov 03 13:00:15 user nova-compute[74960]: DEBUG nova.compute.manager [None req-0fe65b66-731d-44cc-bb79-9c82bb16eb56 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 447cfd77-38cb-4696-b25e-3dd72d2d1adf] Checking state {{(pid=74960) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 13:00:16 user nova-compute[74960]: DEBUG nova.compute.manager [req-f6681a0d-f160-4256-8b13-ecfc488d4904 req-88f5fe84-3e49-42ff-9506-adbcfd67cf42 service nova] [instance: 447cfd77-38cb-4696-b25e-3dd72d2d1adf] Received event network-vif-plugged-2b011242-2c0f-47cf-b1c6-e66bef17214b {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:00:16 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-f6681a0d-f160-4256-8b13-ecfc488d4904 req-88f5fe84-3e49-42ff-9506-adbcfd67cf42 service nova] Acquiring lock "447cfd77-38cb-4696-b25e-3dd72d2d1adf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:00:16 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-f6681a0d-f160-4256-8b13-ecfc488d4904 req-88f5fe84-3e49-42ff-9506-adbcfd67cf42 service nova] Lock "447cfd77-38cb-4696-b25e-3dd72d2d1adf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:00:16 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-f6681a0d-f160-4256-8b13-ecfc488d4904 req-88f5fe84-3e49-42ff-9506-adbcfd67cf42 service nova] Lock "447cfd77-38cb-4696-b25e-3dd72d2d1adf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:00:16 user nova-compute[74960]: DEBUG nova.compute.manager [req-f6681a0d-f160-4256-8b13-ecfc488d4904 req-88f5fe84-3e49-42ff-9506-adbcfd67cf42 service nova] [instance: 447cfd77-38cb-4696-b25e-3dd72d2d1adf] No waiting events found dispatching network-vif-plugged-2b011242-2c0f-47cf-b1c6-e66bef17214b {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:00:16 user nova-compute[74960]: WARNING nova.compute.manager [req-f6681a0d-f160-4256-8b13-ecfc488d4904 req-88f5fe84-3e49-42ff-9506-adbcfd67cf42 service nova] [instance: 447cfd77-38cb-4696-b25e-3dd72d2d1adf] Received unexpected event network-vif-plugged-2b011242-2c0f-47cf-b1c6-e66bef17214b for instance with vm_state building and task_state spawning.
Nov 03 13:00:16 user nova-compute[74960]: INFO nova.compute.manager [None req-0fe65b66-731d-44cc-bb79-9c82bb16eb56 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 447cfd77-38cb-4696-b25e-3dd72d2d1adf] Took 24.70 seconds to build instance.
Nov 03 13:00:16 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-0fe65b66-731d-44cc-bb79-9c82bb16eb56 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lock "447cfd77-38cb-4696-b25e-3dd72d2d1adf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 24.787s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:00:16 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:00:16 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:00:16 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:00:16 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:00:16 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Auditing locally available compute resources for user (node: user) {{(pid=74960) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 13:00:16 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204546-6d78-4f0b-80ed-91eed8943fca/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:00:16 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204546-6d78-4f0b-80ed-91eed8943fca/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:00:16 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204546-6d78-4f0b-80ed-91eed8943fca/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:00:16 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204546-6d78-4f0b-80ed-91eed8943fca/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:00:16 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74960) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 13:00:17 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:00:17 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:00:17 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Hypervisor/Node resource view: name=user free_ram=8913MB free_disk=24.946697235107422GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74960) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 13:00:17 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:00:17 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:00:17 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 61204546-6d78-4f0b-80ed-91eed8943fca actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:00:17 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 447cfd77-38cb-4696-b25e-3dd72d2d1adf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:00:17 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74960) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 13:00:17 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74960) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 13:00:17 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 13:00:17 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 13:00:17 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Compute_service record updated for user:user {{(pid=74960) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 13:00:17 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.216s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:00:17 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:00:19 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:00:20 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:00:20 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:00:21 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:00:22 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:00:22 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:00:23 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:00:23 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:00:23 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74960) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 13:00:24 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:00:24 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Starting heal instance info cache {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 13:00:24 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Rebuilding the list of instances to heal {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 03 13:00:24 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "refresh_cache-61204546-6d78-4f0b-80ed-91eed8943fca" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:00:24 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquired lock "refresh_cache-61204546-6d78-4f0b-80ed-91eed8943fca" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:00:24 user nova-compute[74960]: DEBUG nova.network.neutron [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: 61204546-6d78-4f0b-80ed-91eed8943fca] Forcefully refreshing network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 13:00:24 user nova-compute[74960]: DEBUG nova.objects.instance [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lazy-loading 'info_cache' on Instance uuid 61204546-6d78-4f0b-80ed-91eed8943fca {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:00:24 user nova-compute[74960]: DEBUG nova.network.neutron [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: 61204546-6d78-4f0b-80ed-91eed8943fca] Updating instance_info_cache with network_info: [{"id": "15f819d0-a4dc-4061-adbe-c9882a4832ea", "address": "fa:16:3e:95:b0:7b", "network": {"id": "c50fc382-c1b9-49d8-8e38-ac681cbbcffd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1465428328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "255349fa349045ad8a554d3f818cdd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15f819d0-a4", "ovs_interfaceid": "15f819d0-a4dc-4061-adbe-c9882a4832ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:00:24 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Releasing lock "refresh_cache-61204546-6d78-4f0b-80ed-91eed8943fca" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 13:00:24 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: 61204546-6d78-4f0b-80ed-91eed8943fca] Updated the network info_cache for instance {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 13:00:27 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:00:27 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:00:27 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74960) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 13:00:27 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74960) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 13:00:27 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74960) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 13:00:27 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:00:32 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:00:34 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:00:37 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:00:39 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:00:42 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:00:42 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-7a992314-543a-46a1-bc68-749cf6f75647 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Acquiring lock "61204546-6d78-4f0b-80ed-91eed8943fca" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:00:42 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-7a992314-543a-46a1-bc68-749cf6f75647 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Lock "61204546-6d78-4f0b-80ed-91eed8943fca" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:00:42 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-7a992314-543a-46a1-bc68-749cf6f75647 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Acquiring lock "61204546-6d78-4f0b-80ed-91eed8943fca-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:00:42 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-7a992314-543a-46a1-bc68-749cf6f75647 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Lock "61204546-6d78-4f0b-80ed-91eed8943fca-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:00:42 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-7a992314-543a-46a1-bc68-749cf6f75647 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Lock "61204546-6d78-4f0b-80ed-91eed8943fca-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:00:42 user nova-compute[74960]: INFO nova.compute.manager [None req-7a992314-543a-46a1-bc68-749cf6f75647 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 61204546-6d78-4f0b-80ed-91eed8943fca] Terminating instance
Nov 03 13:00:42 user nova-compute[74960]: DEBUG nova.compute.manager [None req-7a992314-543a-46a1-bc68-749cf6f75647 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 61204546-6d78-4f0b-80ed-91eed8943fca] Start destroying the instance on the hypervisor. {{(pid=74960) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 13:00:42 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:00:42 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:00:42 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:00:42 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:00:43 user nova-compute[74960]: DEBUG nova.compute.manager [req-8705850c-a304-4ab5-af3f-4d10e5de52ae req-b6985b2c-c861-4b36-a12c-8e608e354466 service nova] [instance: 61204546-6d78-4f0b-80ed-91eed8943fca] Received event network-vif-unplugged-15f819d0-a4dc-4061-adbe-c9882a4832ea {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:00:43 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-8705850c-a304-4ab5-af3f-4d10e5de52ae req-b6985b2c-c861-4b36-a12c-8e608e354466 service nova] Acquiring lock "61204546-6d78-4f0b-80ed-91eed8943fca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:00:43 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-8705850c-a304-4ab5-af3f-4d10e5de52ae req-b6985b2c-c861-4b36-a12c-8e608e354466 service nova] Lock "61204546-6d78-4f0b-80ed-91eed8943fca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:00:43 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-8705850c-a304-4ab5-af3f-4d10e5de52ae req-b6985b2c-c861-4b36-a12c-8e608e354466 service nova] Lock "61204546-6d78-4f0b-80ed-91eed8943fca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:00:43 user nova-compute[74960]: DEBUG nova.compute.manager [req-8705850c-a304-4ab5-af3f-4d10e5de52ae req-b6985b2c-c861-4b36-a12c-8e608e354466 service nova] [instance: 61204546-6d78-4f0b-80ed-91eed8943fca] No waiting events found dispatching network-vif-unplugged-15f819d0-a4dc-4061-adbe-c9882a4832ea {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:00:43 user nova-compute[74960]: DEBUG nova.compute.manager [req-8705850c-a304-4ab5-af3f-4d10e5de52ae req-b6985b2c-c861-4b36-a12c-8e608e354466 service nova] [instance: 61204546-6d78-4f0b-80ed-91eed8943fca] Received event network-vif-unplugged-15f819d0-a4dc-4061-adbe-c9882a4832ea for instance with task_state deleting. {{(pid=74960) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 13:00:43 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: 61204546-6d78-4f0b-80ed-91eed8943fca] Instance destroyed successfully.
Nov 03 13:00:43 user nova-compute[74960]: DEBUG nova.objects.instance [None req-7a992314-543a-46a1-bc68-749cf6f75647 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Lazy-loading 'resources' on Instance uuid 61204546-6d78-4f0b-80ed-91eed8943fca {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:00:43 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-7a992314-543a-46a1-bc68-749cf6f75647 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:57:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-463884316',display_name='tempest-AttachVolumeNegativeTest-server-463884316',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-463884316',id=48,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBET78hRoaEhMVsau6YD3rCunlURf2De1+AqxvpVzXPPOpfhOlkMnnr901aGNyqYrrWtzW7CGpwwNamnP92gyNciZfoSUdkVtPZMl9ajDYz3Ry5WZS6jWtR0onWQMc7R9cA==',key_name='tempest-keypair-921939513',keypairs=<?>,launch_index=0,launched_at=2023-11-03T12:57:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='255349fa349045ad8a554d3f818cdd2e',ramdisk_id='',reservation_id='r-eliitjv8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-787890049',owner_user_name='tempest-AttachVolumeNegativeTest-787890049-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T12:57:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c934e7c00ddd450087f904666473c0b4',uuid=61204546-6d78-4f0b-80ed-91eed8943fca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "15f819d0-a4dc-4061-adbe-c9882a4832ea", "address": "fa:16:3e:95:b0:7b", "network": {"id": "c50fc382-c1b9-49d8-8e38-ac681cbbcffd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1465428328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "255349fa349045ad8a554d3f818cdd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15f819d0-a4", "ovs_interfaceid": "15f819d0-a4dc-4061-adbe-c9882a4832ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 13:00:43 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-7a992314-543a-46a1-bc68-749cf6f75647 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Converting VIF {"id": "15f819d0-a4dc-4061-adbe-c9882a4832ea", "address": "fa:16:3e:95:b0:7b", "network": {"id": "c50fc382-c1b9-49d8-8e38-ac681cbbcffd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1465428328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "255349fa349045ad8a554d3f818cdd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15f819d0-a4", "ovs_interfaceid": "15f819d0-a4dc-4061-adbe-c9882a4832ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 13:00:43 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-7a992314-543a-46a1-bc68-749cf6f75647 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:95:b0:7b,bridge_name='br-int',has_traffic_filtering=True,id=15f819d0-a4dc-4061-adbe-c9882a4832ea,network=Network(c50fc382-c1b9-49d8-8e38-ac681cbbcffd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15f819d0-a4') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 13:00:43 user nova-compute[74960]: DEBUG os_vif [None req-7a992314-543a-46a1-bc68-749cf6f75647 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:95:b0:7b,bridge_name='br-int',has_traffic_filtering=True,id=15f819d0-a4dc-4061-adbe-c9882a4832ea,network=Network(c50fc382-c1b9-49d8-8e38-ac681cbbcffd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15f819d0-a4') {{(pid=74960) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 13:00:43 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:00:43 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap15f819d0-a4, bridge=br-int, if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:00:43 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:00:43 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:00:43 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:00:43 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dbd5e873-d48b-4b9d-b682-31fdb0d74fec) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:00:43 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:00:43 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:00:43 user nova-compute[74960]: INFO os_vif [None req-7a992314-543a-46a1-bc68-749cf6f75647 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:95:b0:7b,bridge_name='br-int',has_traffic_filtering=True,id=15f819d0-a4dc-4061-adbe-c9882a4832ea,network=Network(c50fc382-c1b9-49d8-8e38-ac681cbbcffd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15f819d0-a4')
Nov 03 13:00:43 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-7a992314-543a-46a1-bc68-749cf6f75647 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 61204546-6d78-4f0b-80ed-91eed8943fca] Deleting instance files /opt/stack/data/nova/instances/61204546-6d78-4f0b-80ed-91eed8943fca_del
Nov 03 13:00:43 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-7a992314-543a-46a1-bc68-749cf6f75647 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 61204546-6d78-4f0b-80ed-91eed8943fca] Deletion of /opt/stack/data/nova/instances/61204546-6d78-4f0b-80ed-91eed8943fca_del complete
Nov 03 13:00:43 user nova-compute[74960]: INFO nova.compute.manager [None req-7a992314-543a-46a1-bc68-749cf6f75647 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 61204546-6d78-4f0b-80ed-91eed8943fca] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 03 13:00:43 user nova-compute[74960]: DEBUG oslo.service.loopingcall [None req-7a992314-543a-46a1-bc68-749cf6f75647 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74960) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 13:00:43 user nova-compute[74960]: DEBUG nova.compute.manager [-] [instance: 61204546-6d78-4f0b-80ed-91eed8943fca] Deallocating network for instance {{(pid=74960) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 13:00:43 user nova-compute[74960]: DEBUG nova.network.neutron [-] [instance: 61204546-6d78-4f0b-80ed-91eed8943fca] deallocate_for_instance() {{(pid=74960) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 13:00:44 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:00:44 user nova-compute[74960]: DEBUG nova.network.neutron [-] [instance: 61204546-6d78-4f0b-80ed-91eed8943fca] Updating instance_info_cache with network_info: [] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:00:44 user nova-compute[74960]: INFO nova.compute.manager [-] [instance: 61204546-6d78-4f0b-80ed-91eed8943fca] Took 1.01 seconds to deallocate network for instance.
Nov 03 13:00:44 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-7a992314-543a-46a1-bc68-749cf6f75647 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:00:44 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-7a992314-543a-46a1-bc68-749cf6f75647 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:00:44 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-7a992314-543a-46a1-bc68-749cf6f75647 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 13:00:44 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-7a992314-543a-46a1-bc68-749cf6f75647 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 13:00:44 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-7a992314-543a-46a1-bc68-749cf6f75647 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.134s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:00:44 user nova-compute[74960]: INFO nova.scheduler.client.report [None req-7a992314-543a-46a1-bc68-749cf6f75647 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Deleted allocations for instance 61204546-6d78-4f0b-80ed-91eed8943fca
Nov 03 13:00:45 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-7a992314-543a-46a1-bc68-749cf6f75647 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Lock "61204546-6d78-4f0b-80ed-91eed8943fca" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.287s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:00:45 user nova-compute[74960]: DEBUG nova.compute.manager [req-dc1d1b5a-3887-45fa-b95b-18328a9c82d7 req-e7857c8d-9a46-45d7-a5e2-2893a65ac394 service nova] [instance: 61204546-6d78-4f0b-80ed-91eed8943fca] Received event network-vif-plugged-15f819d0-a4dc-4061-adbe-c9882a4832ea {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:00:45 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-dc1d1b5a-3887-45fa-b95b-18328a9c82d7 req-e7857c8d-9a46-45d7-a5e2-2893a65ac394 service nova] Acquiring lock "61204546-6d78-4f0b-80ed-91eed8943fca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:00:45 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-dc1d1b5a-3887-45fa-b95b-18328a9c82d7 req-e7857c8d-9a46-45d7-a5e2-2893a65ac394 service nova] Lock "61204546-6d78-4f0b-80ed-91eed8943fca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:00:45 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-dc1d1b5a-3887-45fa-b95b-18328a9c82d7 req-e7857c8d-9a46-45d7-a5e2-2893a65ac394 service nova] Lock "61204546-6d78-4f0b-80ed-91eed8943fca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:00:45 user nova-compute[74960]: DEBUG nova.compute.manager [req-dc1d1b5a-3887-45fa-b95b-18328a9c82d7 req-e7857c8d-9a46-45d7-a5e2-2893a65ac394 service nova] [instance: 61204546-6d78-4f0b-80ed-91eed8943fca] No waiting events found dispatching network-vif-plugged-15f819d0-a4dc-4061-adbe-c9882a4832ea {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:00:45 user nova-compute[74960]: WARNING nova.compute.manager [req-dc1d1b5a-3887-45fa-b95b-18328a9c82d7 req-e7857c8d-9a46-45d7-a5e2-2893a65ac394 service nova] [instance: 61204546-6d78-4f0b-80ed-91eed8943fca] Received unexpected event network-vif-plugged-15f819d0-a4dc-4061-adbe-c9882a4832ea for instance with vm_state deleted and task_state None.
Nov 03 13:00:45 user nova-compute[74960]: DEBUG nova.compute.manager [req-dc1d1b5a-3887-45fa-b95b-18328a9c82d7 req-e7857c8d-9a46-45d7-a5e2-2893a65ac394 service nova] [instance: 61204546-6d78-4f0b-80ed-91eed8943fca] Received event network-vif-deleted-15f819d0-a4dc-4061-adbe-c9882a4832ea {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:00:48 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:00:49 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:00:53 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:00:58 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:01:03 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:01:08 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:01:10 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:01:13 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:01:18 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:01:18 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:01:18 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:01:18 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:01:18 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Auditing locally available compute resources for user (node: user) {{(pid=74960) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 13:01:18 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74960) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 13:01:18 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:01:18 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:01:18 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:01:18 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Hypervisor/Node resource view: name=user free_ram=8970MB free_disk=24.97382354736328GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74960) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 13:01:18 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:01:18 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:01:18 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 447cfd77-38cb-4696-b25e-3dd72d2d1adf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:01:18 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74960) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 13:01:18 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74960) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 13:01:18 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 13:01:18 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 13:01:18 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Compute_service record updated for user:user {{(pid=74960) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 13:01:18 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.166s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:01:19 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:01:20 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:01:23 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:01:23 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:01:23 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:01:23 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:01:23 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74960) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 13:01:23 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74960) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 13:01:23 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74960) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 13:01:23 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:01:24 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:01:24 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Starting heal instance info cache {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 13:01:24 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "refresh_cache-447cfd77-38cb-4696-b25e-3dd72d2d1adf" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:01:24 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquired lock "refresh_cache-447cfd77-38cb-4696-b25e-3dd72d2d1adf" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:01:24 user nova-compute[74960]: DEBUG nova.network.neutron [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: 447cfd77-38cb-4696-b25e-3dd72d2d1adf] Forcefully refreshing network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 13:01:24 user nova-compute[74960]: DEBUG nova.network.neutron [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: 447cfd77-38cb-4696-b25e-3dd72d2d1adf] Updating instance_info_cache with network_info: [{"id": "2b011242-2c0f-47cf-b1c6-e66bef17214b", "address": "fa:16:3e:65:ea:9e", "network": {"id": "8e985ab3-9852-4f07-8b5c-19f7bf113939", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781795302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d64f3d9dae8f45bcb2e0677a0076ed64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b011242-2c", "ovs_interfaceid": "2b011242-2c0f-47cf-b1c6-e66bef17214b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:01:24 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Releasing lock "refresh_cache-447cfd77-38cb-4696-b25e-3dd72d2d1adf" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 13:01:24 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: 447cfd77-38cb-4696-b25e-3dd72d2d1adf] Updated the network info_cache for instance {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 13:01:24 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:01:24 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:01:24 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74960) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 13:01:28 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:01:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:01:33 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:01:36 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-a6720970-67db-436b-beed-ecdd84e6f8ea tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Acquiring lock "719e66bb-99ac-4e98-bf1c-182bf640c28d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:01:36 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-a6720970-67db-436b-beed-ecdd84e6f8ea tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Lock "719e66bb-99ac-4e98-bf1c-182bf640c28d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:01:36 user nova-compute[74960]: DEBUG nova.compute.manager [None req-a6720970-67db-436b-beed-ecdd84e6f8ea tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 719e66bb-99ac-4e98-bf1c-182bf640c28d] Starting instance... {{(pid=74960) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 13:01:36 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-a6720970-67db-436b-beed-ecdd84e6f8ea tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:01:36 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-a6720970-67db-436b-beed-ecdd84e6f8ea tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:01:36 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-a6720970-67db-436b-beed-ecdd84e6f8ea tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74960) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 13:01:36 user nova-compute[74960]: INFO nova.compute.claims [None req-a6720970-67db-436b-beed-ecdd84e6f8ea tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 719e66bb-99ac-4e98-bf1c-182bf640c28d] Claim successful on node user
Nov 03 13:01:36 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-a6720970-67db-436b-beed-ecdd84e6f8ea tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 13:01:36 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-a6720970-67db-436b-beed-ecdd84e6f8ea tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 13:01:36 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-a6720970-67db-436b-beed-ecdd84e6f8ea tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.224s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:01:36 user nova-compute[74960]: DEBUG nova.compute.manager [None req-a6720970-67db-436b-beed-ecdd84e6f8ea tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 719e66bb-99ac-4e98-bf1c-182bf640c28d] Start building networks asynchronously for instance. {{(pid=74960) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 13:01:37 user nova-compute[74960]: DEBUG nova.compute.manager [None req-a6720970-67db-436b-beed-ecdd84e6f8ea tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 719e66bb-99ac-4e98-bf1c-182bf640c28d] Allocating IP information in the background. {{(pid=74960) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 13:01:37 user nova-compute[74960]: DEBUG nova.network.neutron [None req-a6720970-67db-436b-beed-ecdd84e6f8ea tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 719e66bb-99ac-4e98-bf1c-182bf640c28d] allocate_for_instance() {{(pid=74960) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 13:01:37 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-a6720970-67db-436b-beed-ecdd84e6f8ea tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 719e66bb-99ac-4e98-bf1c-182bf640c28d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 13:01:37 user nova-compute[74960]: DEBUG nova.compute.manager [None req-a6720970-67db-436b-beed-ecdd84e6f8ea tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 719e66bb-99ac-4e98-bf1c-182bf640c28d] Start building block device mappings for instance. {{(pid=74960) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 13:01:37 user nova-compute[74960]: DEBUG nova.policy [None req-a6720970-67db-436b-beed-ecdd84e6f8ea tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c934e7c00ddd450087f904666473c0b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '255349fa349045ad8a554d3f818cdd2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74960) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 13:01:37 user nova-compute[74960]: DEBUG nova.compute.manager [None req-a6720970-67db-436b-beed-ecdd84e6f8ea tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 719e66bb-99ac-4e98-bf1c-182bf640c28d] Start spawning the instance on the hypervisor. {{(pid=74960) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 13:01:37 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-a6720970-67db-436b-beed-ecdd84e6f8ea tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 719e66bb-99ac-4e98-bf1c-182bf640c28d] Creating instance directory {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 13:01:37 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-a6720970-67db-436b-beed-ecdd84e6f8ea tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 719e66bb-99ac-4e98-bf1c-182bf640c28d] Creating image(s)
Nov 03 13:01:37 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-a6720970-67db-436b-beed-ecdd84e6f8ea tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Acquiring lock "/opt/stack/data/nova/instances/719e66bb-99ac-4e98-bf1c-182bf640c28d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:01:37 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-a6720970-67db-436b-beed-ecdd84e6f8ea tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Lock "/opt/stack/data/nova/instances/719e66bb-99ac-4e98-bf1c-182bf640c28d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:01:37 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-a6720970-67db-436b-beed-ecdd84e6f8ea tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Lock "/opt/stack/data/nova/instances/719e66bb-99ac-4e98-bf1c-182bf640c28d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.013s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:01:37 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-a6720970-67db-436b-beed-ecdd84e6f8ea tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:01:37 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-a6720970-67db-436b-beed-ecdd84e6f8ea tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.173s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:01:37 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-a6720970-67db-436b-beed-ecdd84e6f8ea tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Acquiring lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:01:37 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-a6720970-67db-436b-beed-ecdd84e6f8ea tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:01:37 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-a6720970-67db-436b-beed-ecdd84e6f8ea tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:01:37 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-a6720970-67db-436b-beed-ecdd84e6f8ea tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.173s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:01:37 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-a6720970-67db-436b-beed-ecdd84e6f8ea tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910,backing_fmt=raw /opt/stack/data/nova/instances/719e66bb-99ac-4e98-bf1c-182bf640c28d/disk 1073741824 {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:01:37 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-a6720970-67db-436b-beed-ecdd84e6f8ea tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910,backing_fmt=raw /opt/stack/data/nova/instances/719e66bb-99ac-4e98-bf1c-182bf640c28d/disk 1073741824" returned: 0 in 0.049s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:01:37 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-a6720970-67db-436b-beed-ecdd84e6f8ea tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Lock "e6dd2218c84de2ab995a2e9c530d865cc558f910" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:01:37 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-a6720970-67db-436b-beed-ecdd84e6f8ea tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:01:37 user nova-compute[74960]: DEBUG nova.network.neutron [None req-a6720970-67db-436b-beed-ecdd84e6f8ea tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 719e66bb-99ac-4e98-bf1c-182bf640c28d] Successfully created port: 18d94345-48c9-4540-8053-a26390fb823b {{(pid=74960) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 13:01:37 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-a6720970-67db-436b-beed-ecdd84e6f8ea tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6dd2218c84de2ab995a2e9c530d865cc558f910 --force-share --output=json" returned: 0 in 0.185s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:01:37 user nova-compute[74960]: DEBUG nova.virt.disk.api [None req-a6720970-67db-436b-beed-ecdd84e6f8ea tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Checking if we can resize image /opt/stack/data/nova/instances/719e66bb-99ac-4e98-bf1c-182bf640c28d/disk. size=1073741824 {{(pid=74960) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 13:01:37 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-a6720970-67db-436b-beed-ecdd84e6f8ea tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/719e66bb-99ac-4e98-bf1c-182bf640c28d/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:01:37 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:01:37 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-a6720970-67db-436b-beed-ecdd84e6f8ea tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/719e66bb-99ac-4e98-bf1c-182bf640c28d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:01:37 user nova-compute[74960]: DEBUG nova.virt.disk.api [None req-a6720970-67db-436b-beed-ecdd84e6f8ea tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Cannot resize image /opt/stack/data/nova/instances/719e66bb-99ac-4e98-bf1c-182bf640c28d/disk to a smaller size. {{(pid=74960) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 13:01:37 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-a6720970-67db-436b-beed-ecdd84e6f8ea tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 719e66bb-99ac-4e98-bf1c-182bf640c28d] Created local disks {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 13:01:37 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-a6720970-67db-436b-beed-ecdd84e6f8ea tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 719e66bb-99ac-4e98-bf1c-182bf640c28d] Ensure instance console log exists: /opt/stack/data/nova/instances/719e66bb-99ac-4e98-bf1c-182bf640c28d/console.log {{(pid=74960) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 13:01:37 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-a6720970-67db-436b-beed-ecdd84e6f8ea tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:01:37 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-a6720970-67db-436b-beed-ecdd84e6f8ea tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:01:37 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-a6720970-67db-436b-beed-ecdd84e6f8ea tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:01:38 user nova-compute[74960]: DEBUG nova.network.neutron [None req-a6720970-67db-436b-beed-ecdd84e6f8ea tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 719e66bb-99ac-4e98-bf1c-182bf640c28d] Successfully updated port: 18d94345-48c9-4540-8053-a26390fb823b {{(pid=74960) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 13:01:38 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-a6720970-67db-436b-beed-ecdd84e6f8ea tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Acquiring lock "refresh_cache-719e66bb-99ac-4e98-bf1c-182bf640c28d" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:01:38 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-a6720970-67db-436b-beed-ecdd84e6f8ea tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Acquired lock "refresh_cache-719e66bb-99ac-4e98-bf1c-182bf640c28d" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:01:38 user nova-compute[74960]: DEBUG nova.network.neutron [None req-a6720970-67db-436b-beed-ecdd84e6f8ea tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 719e66bb-99ac-4e98-bf1c-182bf640c28d] Building network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 13:01:38 user nova-compute[74960]: DEBUG nova.compute.manager [req-f75869f1-0f44-4ae1-a52b-11f4d108e06e req-6c2616f8-bf79-41ae-a489-21b7d51702b6 service nova] [instance: 719e66bb-99ac-4e98-bf1c-182bf640c28d] Received event network-changed-18d94345-48c9-4540-8053-a26390fb823b {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:01:38 user nova-compute[74960]: DEBUG nova.compute.manager [req-f75869f1-0f44-4ae1-a52b-11f4d108e06e req-6c2616f8-bf79-41ae-a489-21b7d51702b6 service nova] [instance: 719e66bb-99ac-4e98-bf1c-182bf640c28d] Refreshing instance network info cache due to event network-changed-18d94345-48c9-4540-8053-a26390fb823b. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 13:01:38 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-f75869f1-0f44-4ae1-a52b-11f4d108e06e req-6c2616f8-bf79-41ae-a489-21b7d51702b6 service nova] Acquiring lock "refresh_cache-719e66bb-99ac-4e98-bf1c-182bf640c28d" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:01:38 user nova-compute[74960]: DEBUG nova.network.neutron [None req-a6720970-67db-436b-beed-ecdd84e6f8ea tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 719e66bb-99ac-4e98-bf1c-182bf640c28d] Instance cache missing network info. {{(pid=74960) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 13:01:38 user nova-compute[74960]: DEBUG nova.network.neutron [None req-a6720970-67db-436b-beed-ecdd84e6f8ea tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 719e66bb-99ac-4e98-bf1c-182bf640c28d] Updating instance_info_cache with network_info: [{"id": "18d94345-48c9-4540-8053-a26390fb823b", "address": "fa:16:3e:97:86:d5", "network": {"id": "c50fc382-c1b9-49d8-8e38-ac681cbbcffd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1465428328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "255349fa349045ad8a554d3f818cdd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18d94345-48", "ovs_interfaceid": "18d94345-48c9-4540-8053-a26390fb823b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:01:38 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-a6720970-67db-436b-beed-ecdd84e6f8ea tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Releasing lock "refresh_cache-719e66bb-99ac-4e98-bf1c-182bf640c28d" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 13:01:38 user nova-compute[74960]: DEBUG nova.compute.manager [None req-a6720970-67db-436b-beed-ecdd84e6f8ea tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 719e66bb-99ac-4e98-bf1c-182bf640c28d] Instance network_info: |[{"id": "18d94345-48c9-4540-8053-a26390fb823b", "address": "fa:16:3e:97:86:d5", "network": {"id": "c50fc382-c1b9-49d8-8e38-ac681cbbcffd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1465428328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "255349fa349045ad8a554d3f818cdd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18d94345-48", "ovs_interfaceid": "18d94345-48c9-4540-8053-a26390fb823b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74960) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 13:01:38 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-f75869f1-0f44-4ae1-a52b-11f4d108e06e req-6c2616f8-bf79-41ae-a489-21b7d51702b6 service nova] Acquired lock "refresh_cache-719e66bb-99ac-4e98-bf1c-182bf640c28d" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:01:38 user nova-compute[74960]: DEBUG nova.network.neutron [req-f75869f1-0f44-4ae1-a52b-11f4d108e06e req-6c2616f8-bf79-41ae-a489-21b7d51702b6 service nova] [instance: 719e66bb-99ac-4e98-bf1c-182bf640c28d] Refreshing network info cache for port 18d94345-48c9-4540-8053-a26390fb823b {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 13:01:38 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-a6720970-67db-436b-beed-ecdd84e6f8ea tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 719e66bb-99ac-4e98-bf1c-182bf640c28d] Start _get_guest_xml network_info=[{"id": "18d94345-48c9-4540-8053-a26390fb823b", "address": "fa:16:3e:97:86:d5", "network": {"id": "c50fc382-c1b9-49d8-8e38-ac681cbbcffd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1465428328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "255349fa349045ad8a554d3f818cdd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18d94345-48", "ovs_interfaceid": "18d94345-48c9-4540-8053-a26390fb823b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=549f51ba-ac69-494b-8de1-34635aa2d7cf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='63ee9c80c632442fb0379f47b784bd20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T12:13:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'image_id': '549f51ba-ac69-494b-8de1-34635aa2d7cf'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 13:01:38 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-a6720970-67db-436b-beed-ecdd84e6f8ea tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:01:38 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-a6720970-67db-436b-beed-ecdd84e6f8ea tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:01:38 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-a6720970-67db-436b-beed-ecdd84e6f8ea tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 13:01:38 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-a6720970-67db-436b-beed-ecdd84e6f8ea tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] CPU controller missing on host. {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 13:01:38 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-a6720970-67db-436b-beed-ecdd84e6f8ea tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 13:01:38 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-a6720970-67db-436b-beed-ecdd84e6f8ea tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] CPU controller found on host. {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 13:01:38 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-a6720970-67db-436b-beed-ecdd84e6f8ea tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74960) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 13:01:38 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-a6720970-67db-436b-beed-ecdd84e6f8ea tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=549f51ba-ac69-494b-8de1-34635aa2d7cf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='63ee9c80c632442fb0379f47b784bd20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T12:13:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 13:01:38 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-a6720970-67db-436b-beed-ecdd84e6f8ea tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Flavor limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 13:01:38 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-a6720970-67db-436b-beed-ecdd84e6f8ea tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Image limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 13:01:38 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-a6720970-67db-436b-beed-ecdd84e6f8ea tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Flavor pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 13:01:38 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-a6720970-67db-436b-beed-ecdd84e6f8ea tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Image pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 13:01:38 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-a6720970-67db-436b-beed-ecdd84e6f8ea tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 13:01:38 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-a6720970-67db-436b-beed-ecdd84e6f8ea tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 13:01:38 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-a6720970-67db-436b-beed-ecdd84e6f8ea tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 13:01:38 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-a6720970-67db-436b-beed-ecdd84e6f8ea tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Got 1 possible topologies {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 13:01:38 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-a6720970-67db-436b-beed-ecdd84e6f8ea tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 13:01:38 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-a6720970-67db-436b-beed-ecdd84e6f8ea tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 13:01:38 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-a6720970-67db-436b-beed-ecdd84e6f8ea tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T13:01:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-805476514',display_name='tempest-AttachVolumeNegativeTest-server-805476514',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-805476514',id=50,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN063e5yabxy55T87pgOsS6KJBpPIu++Rm5GqiQBhGCLkvnPKHKO2tcU3SNED8ka6m1byD6pM5od2m6jNpFXV54fxDJyISZ/P3ZZT0ioM0mliy6j4+mfAOdyg6iq6FlVDQ==',key_name='tempest-keypair-169734245',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='255349fa349045ad8a554d3f818cdd2e',ramdisk_id='',reservation_id='r-6fki4di8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-787890049',owner_user_name='tempest-AttachVolumeNegativeTest-787890049-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T13:01:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c934e7c00ddd450087f904666473c0b4',uuid=719e66bb-99ac-4e98-bf1c-182bf640c28d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "18d94345-48c9-4540-8053-a26390fb823b", "address": "fa:16:3e:97:86:d5", "network": {"id": "c50fc382-c1b9-49d8-8e38-ac681cbbcffd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1465428328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "255349fa349045ad8a554d3f818cdd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18d94345-48", "ovs_interfaceid": "18d94345-48c9-4540-8053-a26390fb823b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74960) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 13:01:38 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-a6720970-67db-436b-beed-ecdd84e6f8ea tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Converting VIF {"id": "18d94345-48c9-4540-8053-a26390fb823b", "address": "fa:16:3e:97:86:d5", "network": {"id": "c50fc382-c1b9-49d8-8e38-ac681cbbcffd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1465428328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "255349fa349045ad8a554d3f818cdd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18d94345-48", "ovs_interfaceid": "18d94345-48c9-4540-8053-a26390fb823b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 13:01:38 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-a6720970-67db-436b-beed-ecdd84e6f8ea tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:86:d5,bridge_name='br-int',has_traffic_filtering=True,id=18d94345-48c9-4540-8053-a26390fb823b,network=Network(c50fc382-c1b9-49d8-8e38-ac681cbbcffd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18d94345-48') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 13:01:38 user nova-compute[74960]: DEBUG nova.objects.instance [None req-a6720970-67db-436b-beed-ecdd84e6f8ea tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Lazy-loading 'pci_devices' on Instance uuid 719e66bb-99ac-4e98-bf1c-182bf640c28d {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:01:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:01:38 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-a6720970-67db-436b-beed-ecdd84e6f8ea tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 719e66bb-99ac-4e98-bf1c-182bf640c28d] End _get_guest_xml xml=<domain type="kvm">
Nov 03 13:01:38 user nova-compute[74960]:   <uuid>719e66bb-99ac-4e98-bf1c-182bf640c28d</uuid>
Nov 03 13:01:38 user nova-compute[74960]:   <name>instance-00000032</name>
Nov 03 13:01:38 user nova-compute[74960]:   <memory>524288</memory>
Nov 03 13:01:38 user nova-compute[74960]:   <vcpu>1</vcpu>
Nov 03 13:01:38 user nova-compute[74960]:   <metadata>
Nov 03 13:01:38 user nova-compute[74960]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 13:01:38 user nova-compute[74960]:       <nova:package version="0.0.0"/>
Nov 03 13:01:38 user nova-compute[74960]:       <nova:name>tempest-AttachVolumeNegativeTest-server-805476514</nova:name>
Nov 03 13:01:38 user nova-compute[74960]:       <nova:creationTime>2023-11-03 13:01:38</nova:creationTime>
Nov 03 13:01:38 user nova-compute[74960]:       <nova:flavor name="m1.tiny">
Nov 03 13:01:38 user nova-compute[74960]:         <nova:memory>512</nova:memory>
Nov 03 13:01:38 user nova-compute[74960]:         <nova:disk>1</nova:disk>
Nov 03 13:01:38 user nova-compute[74960]:         <nova:swap>0</nova:swap>
Nov 03 13:01:38 user nova-compute[74960]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 13:01:38 user nova-compute[74960]:         <nova:vcpus>1</nova:vcpus>
Nov 03 13:01:38 user nova-compute[74960]:       </nova:flavor>
Nov 03 13:01:38 user nova-compute[74960]:       <nova:owner>
Nov 03 13:01:38 user nova-compute[74960]:         <nova:user uuid="c934e7c00ddd450087f904666473c0b4">tempest-AttachVolumeNegativeTest-787890049-project-member</nova:user>
Nov 03 13:01:38 user nova-compute[74960]:         <nova:project uuid="255349fa349045ad8a554d3f818cdd2e">tempest-AttachVolumeNegativeTest-787890049</nova:project>
Nov 03 13:01:38 user nova-compute[74960]:       </nova:owner>
Nov 03 13:01:38 user nova-compute[74960]:       <nova:root type="image" uuid="549f51ba-ac69-494b-8de1-34635aa2d7cf"/>
Nov 03 13:01:38 user nova-compute[74960]:       <nova:ports>
Nov 03 13:01:38 user nova-compute[74960]:         <nova:port uuid="18d94345-48c9-4540-8053-a26390fb823b">
Nov 03 13:01:38 user nova-compute[74960]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 03 13:01:38 user nova-compute[74960]:         </nova:port>
Nov 03 13:01:38 user nova-compute[74960]:       </nova:ports>
Nov 03 13:01:38 user nova-compute[74960]:     </nova:instance>
Nov 03 13:01:38 user nova-compute[74960]:   </metadata>
Nov 03 13:01:38 user nova-compute[74960]:   <sysinfo type="smbios">
Nov 03 13:01:38 user nova-compute[74960]:     <system>
Nov 03 13:01:38 user nova-compute[74960]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 13:01:38 user nova-compute[74960]:       <entry name="product">OpenStack Nova</entry>
Nov 03 13:01:38 user nova-compute[74960]:       <entry name="version">0.0.0</entry>
Nov 03 13:01:38 user nova-compute[74960]:       <entry name="serial">719e66bb-99ac-4e98-bf1c-182bf640c28d</entry>
Nov 03 13:01:38 user nova-compute[74960]:       <entry name="uuid">719e66bb-99ac-4e98-bf1c-182bf640c28d</entry>
Nov 03 13:01:38 user nova-compute[74960]:       <entry name="family">Virtual Machine</entry>
Nov 03 13:01:38 user nova-compute[74960]:     </system>
Nov 03 13:01:38 user nova-compute[74960]:   </sysinfo>
Nov 03 13:01:38 user nova-compute[74960]:   <os>
Nov 03 13:01:38 user nova-compute[74960]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 13:01:38 user nova-compute[74960]:     <boot dev="hd"/>
Nov 03 13:01:38 user nova-compute[74960]:     <smbios mode="sysinfo"/>
Nov 03 13:01:38 user nova-compute[74960]:   </os>
Nov 03 13:01:38 user nova-compute[74960]:   <features>
Nov 03 13:01:38 user nova-compute[74960]:     <acpi/>
Nov 03 13:01:38 user nova-compute[74960]:     <apic/>
Nov 03 13:01:38 user nova-compute[74960]:     <vmcoreinfo/>
Nov 03 13:01:38 user nova-compute[74960]:   </features>
Nov 03 13:01:38 user nova-compute[74960]:   <clock offset="utc">
Nov 03 13:01:38 user nova-compute[74960]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 13:01:38 user nova-compute[74960]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 13:01:38 user nova-compute[74960]:     <timer name="hpet" present="no"/>
Nov 03 13:01:38 user nova-compute[74960]:   </clock>
Nov 03 13:01:38 user nova-compute[74960]:   <cpu mode="custom" match="exact">
Nov 03 13:01:38 user nova-compute[74960]:     <model>Nehalem</model>
Nov 03 13:01:38 user nova-compute[74960]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 13:01:38 user nova-compute[74960]:   </cpu>
Nov 03 13:01:38 user nova-compute[74960]:   <devices>
Nov 03 13:01:38 user nova-compute[74960]:     <disk type="file" device="disk">
Nov 03 13:01:38 user nova-compute[74960]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 13:01:38 user nova-compute[74960]:       <source file="/opt/stack/data/nova/instances/719e66bb-99ac-4e98-bf1c-182bf640c28d/disk"/>
Nov 03 13:01:38 user nova-compute[74960]:       <target dev="vda" bus="virtio"/>
Nov 03 13:01:38 user nova-compute[74960]:     </disk>
Nov 03 13:01:38 user nova-compute[74960]:     <interface type="ethernet">
Nov 03 13:01:38 user nova-compute[74960]:       <mac address="fa:16:3e:97:86:d5"/>
Nov 03 13:01:38 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 13:01:38 user nova-compute[74960]:       <mtu size="1442"/>
Nov 03 13:01:38 user nova-compute[74960]:       <target dev="tap18d94345-48"/>
Nov 03 13:01:38 user nova-compute[74960]:     </interface>
Nov 03 13:01:38 user nova-compute[74960]:     <serial type="pty">
Nov 03 13:01:38 user nova-compute[74960]:       <log file="/opt/stack/data/nova/instances/719e66bb-99ac-4e98-bf1c-182bf640c28d/console.log" append="off"/>
Nov 03 13:01:38 user nova-compute[74960]:     </serial>
Nov 03 13:01:38 user nova-compute[74960]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 13:01:38 user nova-compute[74960]:     <video>
Nov 03 13:01:38 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 13:01:38 user nova-compute[74960]:     </video>
Nov 03 13:01:38 user nova-compute[74960]:     <rng model="virtio">
Nov 03 13:01:38 user nova-compute[74960]:       <backend model="random">/dev/urandom</backend>
Nov 03 13:01:38 user nova-compute[74960]:     </rng>
Nov 03 13:01:38 user nova-compute[74960]:     <controller type="usb" index="0" model="none"/>
Nov 03 13:01:38 user nova-compute[74960]:     <memballoon model="virtio">
Nov 03 13:01:38 user nova-compute[74960]:       <stats period="10"/>
Nov 03 13:01:38 user nova-compute[74960]:     </memballoon>
Nov 03 13:01:38 user nova-compute[74960]:   </devices>
Nov 03 13:01:38 user nova-compute[74960]: </domain>
Nov 03 13:01:38 user nova-compute[74960]:  {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 13:01:38 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-a6720970-67db-436b-beed-ecdd84e6f8ea tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T13:01:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-805476514',display_name='tempest-AttachVolumeNegativeTest-server-805476514',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-805476514',id=50,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN063e5yabxy55T87pgOsS6KJBpPIu++Rm5GqiQBhGCLkvnPKHKO2tcU3SNED8ka6m1byD6pM5od2m6jNpFXV54fxDJyISZ/P3ZZT0ioM0mliy6j4+mfAOdyg6iq6FlVDQ==',key_name='tempest-keypair-169734245',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='255349fa349045ad8a554d3f818cdd2e',ramdisk_id='',reservation_id='r-6fki4di8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-787890049',owner_user_name='tempest-AttachVolumeNegativeTest-787890049-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T13:01:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c934e7c00ddd450087f904666473c0b4',uuid=719e66bb-99ac-4e98-bf1c-182bf640c28d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "18d94345-48c9-4540-8053-a26390fb823b", "address": "fa:16:3e:97:86:d5", "network": {"id": "c50fc382-c1b9-49d8-8e38-ac681cbbcffd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1465428328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "255349fa349045ad8a554d3f818cdd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18d94345-48", "ovs_interfaceid": "18d94345-48c9-4540-8053-a26390fb823b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 13:01:38 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-a6720970-67db-436b-beed-ecdd84e6f8ea tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Converting VIF {"id": "18d94345-48c9-4540-8053-a26390fb823b", "address": "fa:16:3e:97:86:d5", "network": {"id": "c50fc382-c1b9-49d8-8e38-ac681cbbcffd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1465428328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "255349fa349045ad8a554d3f818cdd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18d94345-48", "ovs_interfaceid": "18d94345-48c9-4540-8053-a26390fb823b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 13:01:38 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-a6720970-67db-436b-beed-ecdd84e6f8ea tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:86:d5,bridge_name='br-int',has_traffic_filtering=True,id=18d94345-48c9-4540-8053-a26390fb823b,network=Network(c50fc382-c1b9-49d8-8e38-ac681cbbcffd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18d94345-48') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 13:01:38 user nova-compute[74960]: DEBUG os_vif [None req-a6720970-67db-436b-beed-ecdd84e6f8ea tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:86:d5,bridge_name='br-int',has_traffic_filtering=True,id=18d94345-48c9-4540-8053-a26390fb823b,network=Network(c50fc382-c1b9-49d8-8e38-ac681cbbcffd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18d94345-48') {{(pid=74960) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 13:01:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:01:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:01:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 13:01:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:01:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bdc501c3-b814-5235-b954-544f48d0b66a', '_type': 'linux-noop'}}, row=False) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:01:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:01:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:01:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:01:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap18d94345-48, may_exist=True, interface_attrs={}) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:01:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap18d94345-48, col_values=(('qos', UUID('2fc291a0-f192-40c0-8eaf-01d3189e7391')),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:01:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap18d94345-48, col_values=(('external_ids', {'iface-id': '18d94345-48c9-4540-8053-a26390fb823b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:97:86:d5', 'vm-uuid': '719e66bb-99ac-4e98-bf1c-182bf640c28d'}),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:01:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:01:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:01:38 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:01:38 user nova-compute[74960]: INFO os_vif [None req-a6720970-67db-436b-beed-ecdd84e6f8ea tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:86:d5,bridge_name='br-int',has_traffic_filtering=True,id=18d94345-48c9-4540-8053-a26390fb823b,network=Network(c50fc382-c1b9-49d8-8e38-ac681cbbcffd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18d94345-48')
Nov 03 13:01:38 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-a6720970-67db-436b-beed-ecdd84e6f8ea tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] No BDM found with device name vda, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 13:01:38 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-a6720970-67db-436b-beed-ecdd84e6f8ea tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] No VIF found with MAC fa:16:3e:97:86:d5, not building metadata {{(pid=74960) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 13:01:39 user nova-compute[74960]: DEBUG nova.network.neutron [req-f75869f1-0f44-4ae1-a52b-11f4d108e06e req-6c2616f8-bf79-41ae-a489-21b7d51702b6 service nova] [instance: 719e66bb-99ac-4e98-bf1c-182bf640c28d] Updated VIF entry in instance network info cache for port 18d94345-48c9-4540-8053-a26390fb823b. {{(pid=74960) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 13:01:39 user nova-compute[74960]: DEBUG nova.network.neutron [req-f75869f1-0f44-4ae1-a52b-11f4d108e06e req-6c2616f8-bf79-41ae-a489-21b7d51702b6 service nova] [instance: 719e66bb-99ac-4e98-bf1c-182bf640c28d] Updating instance_info_cache with network_info: [{"id": "18d94345-48c9-4540-8053-a26390fb823b", "address": "fa:16:3e:97:86:d5", "network": {"id": "c50fc382-c1b9-49d8-8e38-ac681cbbcffd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1465428328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "255349fa349045ad8a554d3f818cdd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18d94345-48", "ovs_interfaceid": "18d94345-48c9-4540-8053-a26390fb823b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:01:39 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-f75869f1-0f44-4ae1-a52b-11f4d108e06e req-6c2616f8-bf79-41ae-a489-21b7d51702b6 service nova] Releasing lock "refresh_cache-719e66bb-99ac-4e98-bf1c-182bf640c28d" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 13:01:40 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:01:40 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:01:40 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:01:40 user nova-compute[74960]: DEBUG nova.compute.manager [req-9ebd1be0-ee14-47f8-ac9a-2d2ea5bb8e29 req-b5bc5669-6c5a-4a01-b87e-b893dc3d2e82 service nova] [instance: 719e66bb-99ac-4e98-bf1c-182bf640c28d] Received event network-vif-plugged-18d94345-48c9-4540-8053-a26390fb823b {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:01:40 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-9ebd1be0-ee14-47f8-ac9a-2d2ea5bb8e29 req-b5bc5669-6c5a-4a01-b87e-b893dc3d2e82 service nova] Acquiring lock "719e66bb-99ac-4e98-bf1c-182bf640c28d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:01:40 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-9ebd1be0-ee14-47f8-ac9a-2d2ea5bb8e29 req-b5bc5669-6c5a-4a01-b87e-b893dc3d2e82 service nova] Lock "719e66bb-99ac-4e98-bf1c-182bf640c28d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:01:40 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-9ebd1be0-ee14-47f8-ac9a-2d2ea5bb8e29 req-b5bc5669-6c5a-4a01-b87e-b893dc3d2e82 service nova] Lock "719e66bb-99ac-4e98-bf1c-182bf640c28d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:01:40 user nova-compute[74960]: DEBUG nova.compute.manager [req-9ebd1be0-ee14-47f8-ac9a-2d2ea5bb8e29 req-b5bc5669-6c5a-4a01-b87e-b893dc3d2e82 service nova] [instance: 719e66bb-99ac-4e98-bf1c-182bf640c28d] No waiting events found dispatching network-vif-plugged-18d94345-48c9-4540-8053-a26390fb823b {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:01:40 user nova-compute[74960]: WARNING nova.compute.manager [req-9ebd1be0-ee14-47f8-ac9a-2d2ea5bb8e29 req-b5bc5669-6c5a-4a01-b87e-b893dc3d2e82 service nova] [instance: 719e66bb-99ac-4e98-bf1c-182bf640c28d] Received unexpected event network-vif-plugged-18d94345-48c9-4540-8053-a26390fb823b for instance with vm_state building and task_state spawning.
Nov 03 13:01:40 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:01:40 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:01:40 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:01:42 user nova-compute[74960]: DEBUG nova.compute.manager [None req-a6720970-67db-436b-beed-ecdd84e6f8ea tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 719e66bb-99ac-4e98-bf1c-182bf640c28d] Instance event wait completed in 0 seconds for  {{(pid=74960) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 13:01:42 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-a6720970-67db-436b-beed-ecdd84e6f8ea tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 719e66bb-99ac-4e98-bf1c-182bf640c28d] Guest created on hypervisor {{(pid=74960) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 13:01:42 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: 719e66bb-99ac-4e98-bf1c-182bf640c28d] Instance spawned successfully.
Nov 03 13:01:42 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-a6720970-67db-436b-beed-ecdd84e6f8ea tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 719e66bb-99ac-4e98-bf1c-182bf640c28d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 13:01:42 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-a6720970-67db-436b-beed-ecdd84e6f8ea tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 719e66bb-99ac-4e98-bf1c-182bf640c28d] Found default for hw_cdrom_bus of ide {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:01:42 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-a6720970-67db-436b-beed-ecdd84e6f8ea tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 719e66bb-99ac-4e98-bf1c-182bf640c28d] Found default for hw_disk_bus of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:01:42 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-a6720970-67db-436b-beed-ecdd84e6f8ea tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 719e66bb-99ac-4e98-bf1c-182bf640c28d] Found default for hw_input_bus of None {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:01:42 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-a6720970-67db-436b-beed-ecdd84e6f8ea tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 719e66bb-99ac-4e98-bf1c-182bf640c28d] Found default for hw_pointer_model of None {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:01:42 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-a6720970-67db-436b-beed-ecdd84e6f8ea tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 719e66bb-99ac-4e98-bf1c-182bf640c28d] Found default for hw_video_model of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:01:42 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-a6720970-67db-436b-beed-ecdd84e6f8ea tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 719e66bb-99ac-4e98-bf1c-182bf640c28d] Found default for hw_vif_model of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:01:42 user nova-compute[74960]: DEBUG nova.compute.manager [req-aa473b35-31b0-4dfa-bbfc-cd192d49cee0 req-c9b83d13-3a38-43ea-97f8-0cebdb1ff77a service nova] [instance: 719e66bb-99ac-4e98-bf1c-182bf640c28d] Received event network-vif-plugged-18d94345-48c9-4540-8053-a26390fb823b {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:01:42 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-aa473b35-31b0-4dfa-bbfc-cd192d49cee0 req-c9b83d13-3a38-43ea-97f8-0cebdb1ff77a service nova] Acquiring lock "719e66bb-99ac-4e98-bf1c-182bf640c28d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:01:42 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-aa473b35-31b0-4dfa-bbfc-cd192d49cee0 req-c9b83d13-3a38-43ea-97f8-0cebdb1ff77a service nova] Lock "719e66bb-99ac-4e98-bf1c-182bf640c28d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:01:42 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-aa473b35-31b0-4dfa-bbfc-cd192d49cee0 req-c9b83d13-3a38-43ea-97f8-0cebdb1ff77a service nova] Lock "719e66bb-99ac-4e98-bf1c-182bf640c28d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:01:42 user nova-compute[74960]: DEBUG nova.compute.manager [req-aa473b35-31b0-4dfa-bbfc-cd192d49cee0 req-c9b83d13-3a38-43ea-97f8-0cebdb1ff77a service nova] [instance: 719e66bb-99ac-4e98-bf1c-182bf640c28d] No waiting events found dispatching network-vif-plugged-18d94345-48c9-4540-8053-a26390fb823b {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:01:42 user nova-compute[74960]: WARNING nova.compute.manager [req-aa473b35-31b0-4dfa-bbfc-cd192d49cee0 req-c9b83d13-3a38-43ea-97f8-0cebdb1ff77a service nova] [instance: 719e66bb-99ac-4e98-bf1c-182bf640c28d] Received unexpected event network-vif-plugged-18d94345-48c9-4540-8053-a26390fb823b for instance with vm_state building and task_state spawning.
Nov 03 13:01:42 user nova-compute[74960]: INFO nova.compute.manager [None req-a6720970-67db-436b-beed-ecdd84e6f8ea tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 719e66bb-99ac-4e98-bf1c-182bf640c28d] Took 5.38 seconds to spawn the instance on the hypervisor.
Nov 03 13:01:42 user nova-compute[74960]: DEBUG nova.compute.manager [None req-a6720970-67db-436b-beed-ecdd84e6f8ea tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 719e66bb-99ac-4e98-bf1c-182bf640c28d] Checking state {{(pid=74960) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 13:01:42 user nova-compute[74960]: INFO nova.compute.manager [None req-a6720970-67db-436b-beed-ecdd84e6f8ea tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 719e66bb-99ac-4e98-bf1c-182bf640c28d] Took 5.96 seconds to build instance.
Nov 03 13:01:42 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-a6720970-67db-436b-beed-ecdd84e6f8ea tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Lock "719e66bb-99ac-4e98-bf1c-182bf640c28d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.069s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:01:43 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:01:43 user nova-compute[74960]: DEBUG nova.compute.manager [req-9d4c187c-f8c7-438c-b623-5d736a2e3c86 req-2b0290a1-f0b3-4980-900c-872ed9c70a8b service nova] [instance: 447cfd77-38cb-4696-b25e-3dd72d2d1adf] Received event network-changed-2b011242-2c0f-47cf-b1c6-e66bef17214b {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:01:43 user nova-compute[74960]: DEBUG nova.compute.manager [req-9d4c187c-f8c7-438c-b623-5d736a2e3c86 req-2b0290a1-f0b3-4980-900c-872ed9c70a8b service nova] [instance: 447cfd77-38cb-4696-b25e-3dd72d2d1adf] Refreshing instance network info cache due to event network-changed-2b011242-2c0f-47cf-b1c6-e66bef17214b. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 13:01:43 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-9d4c187c-f8c7-438c-b623-5d736a2e3c86 req-2b0290a1-f0b3-4980-900c-872ed9c70a8b service nova] Acquiring lock "refresh_cache-447cfd77-38cb-4696-b25e-3dd72d2d1adf" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:01:43 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-9d4c187c-f8c7-438c-b623-5d736a2e3c86 req-2b0290a1-f0b3-4980-900c-872ed9c70a8b service nova] Acquired lock "refresh_cache-447cfd77-38cb-4696-b25e-3dd72d2d1adf" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:01:43 user nova-compute[74960]: DEBUG nova.network.neutron [req-9d4c187c-f8c7-438c-b623-5d736a2e3c86 req-2b0290a1-f0b3-4980-900c-872ed9c70a8b service nova] [instance: 447cfd77-38cb-4696-b25e-3dd72d2d1adf] Refreshing network info cache for port 2b011242-2c0f-47cf-b1c6-e66bef17214b {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 13:01:44 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:01:44 user nova-compute[74960]: DEBUG nova.network.neutron [req-9d4c187c-f8c7-438c-b623-5d736a2e3c86 req-2b0290a1-f0b3-4980-900c-872ed9c70a8b service nova] [instance: 447cfd77-38cb-4696-b25e-3dd72d2d1adf] Updated VIF entry in instance network info cache for port 2b011242-2c0f-47cf-b1c6-e66bef17214b. {{(pid=74960) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 13:01:44 user nova-compute[74960]: DEBUG nova.network.neutron [req-9d4c187c-f8c7-438c-b623-5d736a2e3c86 req-2b0290a1-f0b3-4980-900c-872ed9c70a8b service nova] [instance: 447cfd77-38cb-4696-b25e-3dd72d2d1adf] Updating instance_info_cache with network_info: [{"id": "2b011242-2c0f-47cf-b1c6-e66bef17214b", "address": "fa:16:3e:65:ea:9e", "network": {"id": "8e985ab3-9852-4f07-8b5c-19f7bf113939", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781795302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d64f3d9dae8f45bcb2e0677a0076ed64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b011242-2c", "ovs_interfaceid": "2b011242-2c0f-47cf-b1c6-e66bef17214b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:01:44 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-8253a232-e7da-46c2-90ca-a82153c632fb tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Acquiring lock "447cfd77-38cb-4696-b25e-3dd72d2d1adf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:01:44 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-8253a232-e7da-46c2-90ca-a82153c632fb tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lock "447cfd77-38cb-4696-b25e-3dd72d2d1adf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:01:44 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-8253a232-e7da-46c2-90ca-a82153c632fb tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Acquiring lock "447cfd77-38cb-4696-b25e-3dd72d2d1adf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:01:44 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-8253a232-e7da-46c2-90ca-a82153c632fb tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lock "447cfd77-38cb-4696-b25e-3dd72d2d1adf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:01:44 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-8253a232-e7da-46c2-90ca-a82153c632fb tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lock "447cfd77-38cb-4696-b25e-3dd72d2d1adf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:01:44 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-9d4c187c-f8c7-438c-b623-5d736a2e3c86 req-2b0290a1-f0b3-4980-900c-872ed9c70a8b service nova] Releasing lock "refresh_cache-447cfd77-38cb-4696-b25e-3dd72d2d1adf" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 13:01:44 user nova-compute[74960]: INFO nova.compute.manager [None req-8253a232-e7da-46c2-90ca-a82153c632fb tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 447cfd77-38cb-4696-b25e-3dd72d2d1adf] Terminating instance
Nov 03 13:01:44 user nova-compute[74960]: DEBUG nova.compute.manager [None req-8253a232-e7da-46c2-90ca-a82153c632fb tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 447cfd77-38cb-4696-b25e-3dd72d2d1adf] Start destroying the instance on the hypervisor. {{(pid=74960) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 13:01:44 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:01:44 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:01:44 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:01:44 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:01:44 user nova-compute[74960]: DEBUG nova.compute.manager [req-d73d62a3-9ff8-4e54-8998-2d60e05d0a50 req-b8527b4b-a734-4586-b41e-6292387b118d service nova] [instance: 447cfd77-38cb-4696-b25e-3dd72d2d1adf] Received event network-vif-unplugged-2b011242-2c0f-47cf-b1c6-e66bef17214b {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:01:44 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-d73d62a3-9ff8-4e54-8998-2d60e05d0a50 req-b8527b4b-a734-4586-b41e-6292387b118d service nova] Acquiring lock "447cfd77-38cb-4696-b25e-3dd72d2d1adf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:01:44 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-d73d62a3-9ff8-4e54-8998-2d60e05d0a50 req-b8527b4b-a734-4586-b41e-6292387b118d service nova] Lock "447cfd77-38cb-4696-b25e-3dd72d2d1adf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.009s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:01:44 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-d73d62a3-9ff8-4e54-8998-2d60e05d0a50 req-b8527b4b-a734-4586-b41e-6292387b118d service nova] Lock "447cfd77-38cb-4696-b25e-3dd72d2d1adf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:01:44 user nova-compute[74960]: DEBUG nova.compute.manager [req-d73d62a3-9ff8-4e54-8998-2d60e05d0a50 req-b8527b4b-a734-4586-b41e-6292387b118d service nova] [instance: 447cfd77-38cb-4696-b25e-3dd72d2d1adf] No waiting events found dispatching network-vif-unplugged-2b011242-2c0f-47cf-b1c6-e66bef17214b {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:01:44 user nova-compute[74960]: DEBUG nova.compute.manager [req-d73d62a3-9ff8-4e54-8998-2d60e05d0a50 req-b8527b4b-a734-4586-b41e-6292387b118d service nova] [instance: 447cfd77-38cb-4696-b25e-3dd72d2d1adf] Received event network-vif-unplugged-2b011242-2c0f-47cf-b1c6-e66bef17214b for instance with task_state deleting. {{(pid=74960) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 13:01:45 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: 447cfd77-38cb-4696-b25e-3dd72d2d1adf] Instance destroyed successfully.
Nov 03 13:01:45 user nova-compute[74960]: DEBUG nova.objects.instance [None req-8253a232-e7da-46c2-90ca-a82153c632fb tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lazy-loading 'resources' on Instance uuid 447cfd77-38cb-4696-b25e-3dd72d2d1adf {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:01:45 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-8253a232-e7da-46c2-90ca-a82153c632fb tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T12:59:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-283546554',display_name='tempest-TestVolumeBootPattern-server-283546554',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-283546554',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG58VBMUGF35creXkaeLlS45qeSpHByygSbALoDPLyAkX8z0vqLaGfOF/PdmxhlSuzswK/zmWz4mkAMsQnGwfeIg0PnI682GlW4AY7e0K4aRcKwMAhIAhksojQg6Tc/b4g==',key_name='tempest-TestVolumeBootPattern-178111993',keypairs=<?>,launch_index=0,launched_at=2023-11-03T13:00:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d64f3d9dae8f45bcb2e0677a0076ed64',ramdisk_id='',reservation_id='r-dr1dl9z7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1795947051',owner_user_name='tempest-TestVolumeBootPattern-1795947051-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T13:00:16Z,user_data=None,user_id='067a3f33438b4112b818b91ecb4dd0d2',uuid=447cfd77-38cb-4696-b25e-3dd72d2d1adf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2b011242-2c0f-47cf-b1c6-e66bef17214b", "address": "fa:16:3e:65:ea:9e", "network": {"id": "8e985ab3-9852-4f07-8b5c-19f7bf113939", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781795302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d64f3d9dae8f45bcb2e0677a0076ed64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b011242-2c", "ovs_interfaceid": "2b011242-2c0f-47cf-b1c6-e66bef17214b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 13:01:45 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-8253a232-e7da-46c2-90ca-a82153c632fb tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Converting VIF {"id": "2b011242-2c0f-47cf-b1c6-e66bef17214b", "address": "fa:16:3e:65:ea:9e", "network": {"id": "8e985ab3-9852-4f07-8b5c-19f7bf113939", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781795302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d64f3d9dae8f45bcb2e0677a0076ed64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b011242-2c", "ovs_interfaceid": "2b011242-2c0f-47cf-b1c6-e66bef17214b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 13:01:45 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-8253a232-e7da-46c2-90ca-a82153c632fb tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:65:ea:9e,bridge_name='br-int',has_traffic_filtering=True,id=2b011242-2c0f-47cf-b1c6-e66bef17214b,network=Network(8e985ab3-9852-4f07-8b5c-19f7bf113939),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b011242-2c') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 13:01:45 user nova-compute[74960]: DEBUG os_vif [None req-8253a232-e7da-46c2-90ca-a82153c632fb tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:ea:9e,bridge_name='br-int',has_traffic_filtering=True,id=2b011242-2c0f-47cf-b1c6-e66bef17214b,network=Network(8e985ab3-9852-4f07-8b5c-19f7bf113939),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b011242-2c') {{(pid=74960) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 13:01:45 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:01:45 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2b011242-2c, bridge=br-int, if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:01:45 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:01:45 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:01:45 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:01:45 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e923662c-327f-482f-94ce-dff4d1b15da9) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:01:45 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:01:45 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:01:45 user nova-compute[74960]: INFO os_vif [None req-8253a232-e7da-46c2-90ca-a82153c632fb tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:ea:9e,bridge_name='br-int',has_traffic_filtering=True,id=2b011242-2c0f-47cf-b1c6-e66bef17214b,network=Network(8e985ab3-9852-4f07-8b5c-19f7bf113939),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b011242-2c')
Nov 03 13:01:45 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8253a232-e7da-46c2-90ca-a82153c632fb tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 447cfd77-38cb-4696-b25e-3dd72d2d1adf] calling os-brick to detach iSCSI Volume {{(pid=74960) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 13:01:45 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-8253a232-e7da-46c2-90ca-a82153c632fb tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9aa420acb0>, {'target_iqn': 'iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UEgVDteh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 13:01:45 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-8253a232-e7da-46c2-90ca-a82153c632fb tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 13:01:45 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-8253a232-e7da-46c2-90ca-a82153c632fb tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 13:01:45 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-8253a232-e7da-46c2-90ca-a82153c632fb tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 13:01:45 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:01:45 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:01:45 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bca811c-47e0-404b-9d56-3dc42bdeab58]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:01:45 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-8253a232-e7da-46c2-90ca-a82153c632fb tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 13:01:45 user nova-compute[74960]: No targets found.
Nov 03 13:01:45 user nova-compute[74960]: iSNS:
Nov 03 13:01:45 user nova-compute[74960]: No targets found.
Nov 03 13:01:45 user nova-compute[74960]: STATIC:
Nov 03 13:01:45 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4
Nov 03 13:01:45 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 13:01:45 user nova-compute[74960]:                 Iface Name: default
Nov 03 13:01:45 user nova-compute[74960]: FIRMWARE:
Nov 03 13:01:45 user nova-compute[74960]: No targets found.
Nov 03 13:01:45 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 13:01:45 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-8253a232-e7da-46c2-90ca-a82153c632fb tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 13:01:45 user nova-compute[74960]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 13:01:45 user nova-compute[74960]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74960) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 13:01:45 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-8253a232-e7da-46c2-90ca-a82153c632fb tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4', 0)] {{(pid=74960) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 13:01:45 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:01:45 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:01:45 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2d18079-8a6a-476c-9467-971bbdffa18f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:01:45 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:01:45 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:01:45 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[dce49e73-3305-4349-a969-02ac5f60d623]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4 (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:01:45 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-8253a232-e7da-46c2-90ca-a82153c632fb tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4 (non-flash)
Nov 03 13:01:45 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 13:01:45 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-8253a232-e7da-46c2-90ca-a82153c632fb tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4 (non-flash)
Nov 03 13:01:45 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 13:01:45 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-8253a232-e7da-46c2-90ca-a82153c632fb tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9a8c2596c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4'): ({'sdc'}, set())}) {{(pid=74960) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 13:01:45 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-8253a232-e7da-46c2-90ca-a82153c632fb tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Removing single pathed devices sdc {{(pid=74960) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 13:01:45 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:01:45 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:01:45 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[29aac7a4-3db4-41b5-9201-630b9342234c]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:01:45 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:01:45 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.025s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:01:45 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e207fad-152f-4225-b5a1-f78538bc4545]: (4, ('ok\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:01:45 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-8253a232-e7da-46c2-90ca-a82153c632fb tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Flushing IO for device /dev/sdc {{(pid=74960) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 13:01:45 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:01:45 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:01:45 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[565ad916-1665-4e8b-ab30-ebb6eb11582a]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:01:45 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-8253a232-e7da-46c2-90ca-a82153c632fb tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74960) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 13:01:45 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:01:45 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:01:45 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e7a7236-230b-418f-9f0e-643408191790]: (4, ('1', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:01:45 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-8253a232-e7da-46c2-90ca-a82153c632fb tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74960) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 13:01:45 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-8253a232-e7da-46c2-90ca-a82153c632fb tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] SCSI volumes sdc have been removed. {{(pid=74960) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 13:01:45 user nova-compute[74960]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO18ec9e2c-8dcef8e5fcf40453', '/dev/disk/by-id/scsi-23864636566386535', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_18ec9e2c') {{(pid=86167) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 03 13:01:45 user nova-compute[74960]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO18ec9e2c-8dcef8e5fcf40453
Nov 03 13:01:45 user nova-compute[74960]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23864636566386535
Nov 03 13:01:45 user nova-compute[74960]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_18ec9e2c
Nov 03 13:01:45 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[280a34a8-71f3-46f5-91c8-065f9b12ee18]: (4, None) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:01:45 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-8253a232-e7da-46c2-90ca-a82153c632fb tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4')] {{(pid=74960) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 13:01:45 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:01:45 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:01:45 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2936386-f70a-4a81-b336-2e1e4a29eb16]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:01:45 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-8253a232-e7da-46c2-90ca-a82153c632fb tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:01:45 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4 -p 172.16.0.220:3260 --logout {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:01:45 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:01:45 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[c97cfde6-daaf-45ce-be39-42869973a2be]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:01:45 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-8253a232-e7da-46c2-90ca-a82153c632fb tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4, portal: 172.16.0.220,3260]
Nov 03 13:01:45 user nova-compute[74960]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4, portal: 172.16.0.220,3260] successful.
Nov 03 13:01:45 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:01:45 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4 -p 172.16.0.220:3260 --op delete {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:01:45 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:01:45 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a2182b7-53ba-481c-9347-811b972e9ed4]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:01:45 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-8253a232-e7da-46c2-90ca-a82153c632fb tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:01:45 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-8253a232-e7da-46c2-90ca-a82153c632fb tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 13:01:45 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-8253a232-e7da-46c2-90ca-a82153c632fb tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] <== disconnect_volume: return (309ms) None {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 13:01:45 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8253a232-e7da-46c2-90ca-a82153c632fb tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 447cfd77-38cb-4696-b25e-3dd72d2d1adf] Disconnected iSCSI Volume {{(pid=74960) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 13:01:45 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-8253a232-e7da-46c2-90ca-a82153c632fb tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 447cfd77-38cb-4696-b25e-3dd72d2d1adf] Deleting instance files /opt/stack/data/nova/instances/447cfd77-38cb-4696-b25e-3dd72d2d1adf_del
Nov 03 13:01:45 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-8253a232-e7da-46c2-90ca-a82153c632fb tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 447cfd77-38cb-4696-b25e-3dd72d2d1adf] Deletion of /opt/stack/data/nova/instances/447cfd77-38cb-4696-b25e-3dd72d2d1adf_del complete
Nov 03 13:01:45 user nova-compute[74960]: INFO nova.compute.manager [None req-8253a232-e7da-46c2-90ca-a82153c632fb tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 447cfd77-38cb-4696-b25e-3dd72d2d1adf] Took 1.20 seconds to destroy the instance on the hypervisor.
Nov 03 13:01:45 user nova-compute[74960]: DEBUG oslo.service.loopingcall [None req-8253a232-e7da-46c2-90ca-a82153c632fb tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74960) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 13:01:45 user nova-compute[74960]: DEBUG nova.compute.manager [-] [instance: 447cfd77-38cb-4696-b25e-3dd72d2d1adf] Deallocating network for instance {{(pid=74960) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 13:01:45 user nova-compute[74960]: DEBUG nova.network.neutron [-] [instance: 447cfd77-38cb-4696-b25e-3dd72d2d1adf] deallocate_for_instance() {{(pid=74960) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 13:01:46 user nova-compute[74960]: DEBUG nova.network.neutron [-] [instance: 447cfd77-38cb-4696-b25e-3dd72d2d1adf] Updating instance_info_cache with network_info: [] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:01:46 user nova-compute[74960]: INFO nova.compute.manager [-] [instance: 447cfd77-38cb-4696-b25e-3dd72d2d1adf] Took 0.67 seconds to deallocate network for instance.
Nov 03 13:01:46 user nova-compute[74960]: DEBUG nova.compute.manager [req-106eb56f-1dc4-4fe4-847f-f0b5b7ad28af req-5ef53d49-dd9e-4d62-8bfd-cdf6c88d09dd service nova] [instance: 447cfd77-38cb-4696-b25e-3dd72d2d1adf] Received event network-vif-plugged-2b011242-2c0f-47cf-b1c6-e66bef17214b {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:01:46 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-106eb56f-1dc4-4fe4-847f-f0b5b7ad28af req-5ef53d49-dd9e-4d62-8bfd-cdf6c88d09dd service nova] Acquiring lock "447cfd77-38cb-4696-b25e-3dd72d2d1adf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:01:46 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-106eb56f-1dc4-4fe4-847f-f0b5b7ad28af req-5ef53d49-dd9e-4d62-8bfd-cdf6c88d09dd service nova] Lock "447cfd77-38cb-4696-b25e-3dd72d2d1adf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:01:46 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-106eb56f-1dc4-4fe4-847f-f0b5b7ad28af req-5ef53d49-dd9e-4d62-8bfd-cdf6c88d09dd service nova] Lock "447cfd77-38cb-4696-b25e-3dd72d2d1adf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:01:46 user nova-compute[74960]: DEBUG nova.compute.manager [req-106eb56f-1dc4-4fe4-847f-f0b5b7ad28af req-5ef53d49-dd9e-4d62-8bfd-cdf6c88d09dd service nova] [instance: 447cfd77-38cb-4696-b25e-3dd72d2d1adf] No waiting events found dispatching network-vif-plugged-2b011242-2c0f-47cf-b1c6-e66bef17214b {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:01:46 user nova-compute[74960]: WARNING nova.compute.manager [req-106eb56f-1dc4-4fe4-847f-f0b5b7ad28af req-5ef53d49-dd9e-4d62-8bfd-cdf6c88d09dd service nova] [instance: 447cfd77-38cb-4696-b25e-3dd72d2d1adf] Received unexpected event network-vif-plugged-2b011242-2c0f-47cf-b1c6-e66bef17214b for instance with vm_state active and task_state deleting.
Nov 03 13:01:46 user nova-compute[74960]: DEBUG nova.compute.manager [req-106eb56f-1dc4-4fe4-847f-f0b5b7ad28af req-5ef53d49-dd9e-4d62-8bfd-cdf6c88d09dd service nova] [instance: 447cfd77-38cb-4696-b25e-3dd72d2d1adf] Received event network-vif-deleted-2b011242-2c0f-47cf-b1c6-e66bef17214b {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:01:47 user nova-compute[74960]: INFO nova.compute.manager [None req-8253a232-e7da-46c2-90ca-a82153c632fb tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 447cfd77-38cb-4696-b25e-3dd72d2d1adf] Took 0.94 seconds to detach 1 volumes for instance.
Nov 03 13:01:47 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-8253a232-e7da-46c2-90ca-a82153c632fb tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:01:47 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-8253a232-e7da-46c2-90ca-a82153c632fb tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:01:47 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-8253a232-e7da-46c2-90ca-a82153c632fb tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 13:01:47 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-8253a232-e7da-46c2-90ca-a82153c632fb tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 13:01:47 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-8253a232-e7da-46c2-90ca-a82153c632fb tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.142s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:01:47 user nova-compute[74960]: INFO nova.scheduler.client.report [None req-8253a232-e7da-46c2-90ca-a82153c632fb tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Deleted allocations for instance 447cfd77-38cb-4696-b25e-3dd72d2d1adf
Nov 03 13:01:47 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-8253a232-e7da-46c2-90ca-a82153c632fb tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lock "447cfd77-38cb-4696-b25e-3dd72d2d1adf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.135s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:01:49 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:01:50 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:01:55 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:01:59 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:02:00 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:02:04 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:02:05 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:02:09 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:02:10 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:02:12 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:02:14 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:02:15 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:02:19 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:02:19 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:02:19 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:02:19 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:02:19 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:02:19 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Auditing locally available compute resources for user (node: user) {{(pid=74960) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 13:02:19 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/719e66bb-99ac-4e98-bf1c-182bf640c28d/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:02:19 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/719e66bb-99ac-4e98-bf1c-182bf640c28d/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:02:19 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/719e66bb-99ac-4e98-bf1c-182bf640c28d/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:02:19 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/719e66bb-99ac-4e98-bf1c-182bf640c28d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:02:20 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:02:20 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:02:20 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Hypervisor/Node resource view: name=user free_ram=8966MB free_disk=24.943798065185547GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74960) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 13:02:20 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:02:20 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:02:20 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:02:20 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 719e66bb-99ac-4e98-bf1c-182bf640c28d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:02:20 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74960) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 13:02:20 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74960) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 13:02:20 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 13:02:20 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 13:02:20 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Compute_service record updated for user:user {{(pid=74960) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 13:02:20 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.198s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:02:23 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:02:24 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:02:24 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Starting heal instance info cache {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 13:02:24 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Rebuilding the list of instances to heal {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 03 13:02:24 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "refresh_cache-719e66bb-99ac-4e98-bf1c-182bf640c28d" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:02:24 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquired lock "refresh_cache-719e66bb-99ac-4e98-bf1c-182bf640c28d" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:02:24 user nova-compute[74960]: DEBUG nova.network.neutron [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: 719e66bb-99ac-4e98-bf1c-182bf640c28d] Forcefully refreshing network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 13:02:24 user nova-compute[74960]: DEBUG nova.objects.instance [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lazy-loading 'info_cache' on Instance uuid 719e66bb-99ac-4e98-bf1c-182bf640c28d {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:02:25 user nova-compute[74960]: DEBUG nova.network.neutron [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: 719e66bb-99ac-4e98-bf1c-182bf640c28d] Updating instance_info_cache with network_info: [{"id": "18d94345-48c9-4540-8053-a26390fb823b", "address": "fa:16:3e:97:86:d5", "network": {"id": "c50fc382-c1b9-49d8-8e38-ac681cbbcffd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1465428328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "255349fa349045ad8a554d3f818cdd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18d94345-48", "ovs_interfaceid": "18d94345-48c9-4540-8053-a26390fb823b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:02:25 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:02:25 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:02:25 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74960) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 13:02:25 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74960) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 13:02:25 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74960) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 13:02:25 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:02:25 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Releasing lock "refresh_cache-719e66bb-99ac-4e98-bf1c-182bf640c28d" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 13:02:25 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: 719e66bb-99ac-4e98-bf1c-182bf640c28d] Updated the network info_cache for instance {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 13:02:25 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:02:25 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:02:26 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:02:26 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:02:26 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74960) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 13:02:30 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:02:35 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:02:35 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:02:35 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74960) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 13:02:35 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74960) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 13:02:35 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74960) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 13:02:35 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:02:35 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Acquiring lock "69c2803e-38e1-4962-a1e1-beb1febe48ec" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:02:35 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lock "69c2803e-38e1-4962-a1e1-beb1febe48ec" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:02:35 user nova-compute[74960]: DEBUG nova.compute.manager [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 69c2803e-38e1-4962-a1e1-beb1febe48ec] Starting instance... {{(pid=74960) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 13:02:36 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:02:36 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:02:36 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74960) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 13:02:36 user nova-compute[74960]: INFO nova.compute.claims [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 69c2803e-38e1-4962-a1e1-beb1febe48ec] Claim successful on node user
Nov 03 13:02:36 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 13:02:36 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 13:02:36 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.202s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:02:36 user nova-compute[74960]: DEBUG nova.compute.manager [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 69c2803e-38e1-4962-a1e1-beb1febe48ec] Start building networks asynchronously for instance. {{(pid=74960) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 13:02:36 user nova-compute[74960]: DEBUG nova.compute.manager [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 69c2803e-38e1-4962-a1e1-beb1febe48ec] Allocating IP information in the background. {{(pid=74960) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 13:02:36 user nova-compute[74960]: DEBUG nova.network.neutron [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 69c2803e-38e1-4962-a1e1-beb1febe48ec] allocate_for_instance() {{(pid=74960) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 13:02:36 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 69c2803e-38e1-4962-a1e1-beb1febe48ec] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 13:02:36 user nova-compute[74960]: DEBUG nova.compute.manager [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 69c2803e-38e1-4962-a1e1-beb1febe48ec] Start building block device mappings for instance. {{(pid=74960) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 13:02:36 user nova-compute[74960]: DEBUG nova.policy [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '067a3f33438b4112b818b91ecb4dd0d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd64f3d9dae8f45bcb2e0677a0076ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74960) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 13:02:36 user nova-compute[74960]: INFO nova.virt.block_device [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 69c2803e-38e1-4962-a1e1-beb1febe48ec] Booting with volume 143d4bac-bf81-4e34-a5c2-30ed203b60d4 at /dev/vda
Nov 03 13:02:36 user nova-compute[74960]: DEBUG os_brick.utils [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 13:02:36 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:02:36 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:02:36 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a70458f-c053-4c1c-9f9f-da405f834940]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:75b8e219756\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:02:36 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:02:36 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:02:36 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[5191e046-2ce8-48d0-b3df-944b3cecae2a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:02:36 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:02:36 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:02:36 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cd22c95-3fa0-4f59-afde-b27ffb244861]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:02:36 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfb81c41-953a-437e-9b21-e6f0009e174d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:02:36 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Running cmd (subprocess): nvme version {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:02:36 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] 'nvme version' failed. Not Retrying. {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 13:02:36 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.nvmeof [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] nvme not present on system {{(pid=74960) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 13:02:36 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:02:36 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 13:02:36 user nova-compute[74960]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 13:02:36 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[8304a747-8930-49aa-83b9-45dbe9dcdbb2]: (4, '') {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:02:36 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74960) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 13:02:36 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74960) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 13:02:36 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] LIGHTOS: no hostnqn found. {{(pid=74960) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 13:02:36 user nova-compute[74960]: DEBUG os_brick.utils [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:75b8e219756', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 13:02:36 user nova-compute[74960]: DEBUG nova.virt.block_device [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 69c2803e-38e1-4962-a1e1-beb1febe48ec] Updating existing volume attachment record: 8d835959-0631-4879-b1d1-5cfae5bd8863 {{(pid=74960) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 13:02:36 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:02:37 user nova-compute[74960]: DEBUG nova.network.neutron [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 69c2803e-38e1-4962-a1e1-beb1febe48ec] Successfully created port: 1ee78f5d-2a2e-4840-bfec-78bb5b6745d7 {{(pid=74960) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 13:02:37 user nova-compute[74960]: DEBUG nova.network.neutron [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 69c2803e-38e1-4962-a1e1-beb1febe48ec] Successfully updated port: 1ee78f5d-2a2e-4840-bfec-78bb5b6745d7 {{(pid=74960) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 13:02:37 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Acquiring lock "refresh_cache-69c2803e-38e1-4962-a1e1-beb1febe48ec" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:02:37 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Acquired lock "refresh_cache-69c2803e-38e1-4962-a1e1-beb1febe48ec" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:02:37 user nova-compute[74960]: DEBUG nova.network.neutron [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 69c2803e-38e1-4962-a1e1-beb1febe48ec] Building network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 13:02:37 user nova-compute[74960]: DEBUG nova.compute.manager [req-72d46c23-6730-430d-a412-ac163f0c2637 req-69f9761b-b09b-4933-b658-d34bfbf896bb service nova] [instance: 69c2803e-38e1-4962-a1e1-beb1febe48ec] Received event network-changed-1ee78f5d-2a2e-4840-bfec-78bb5b6745d7 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:02:37 user nova-compute[74960]: DEBUG nova.compute.manager [req-72d46c23-6730-430d-a412-ac163f0c2637 req-69f9761b-b09b-4933-b658-d34bfbf896bb service nova] [instance: 69c2803e-38e1-4962-a1e1-beb1febe48ec] Refreshing instance network info cache due to event network-changed-1ee78f5d-2a2e-4840-bfec-78bb5b6745d7. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 13:02:37 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-72d46c23-6730-430d-a412-ac163f0c2637 req-69f9761b-b09b-4933-b658-d34bfbf896bb service nova] Acquiring lock "refresh_cache-69c2803e-38e1-4962-a1e1-beb1febe48ec" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:02:37 user nova-compute[74960]: DEBUG nova.network.neutron [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 69c2803e-38e1-4962-a1e1-beb1febe48ec] Instance cache missing network info. {{(pid=74960) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 13:02:38 user nova-compute[74960]: DEBUG nova.network.neutron [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 69c2803e-38e1-4962-a1e1-beb1febe48ec] Updating instance_info_cache with network_info: [{"id": "1ee78f5d-2a2e-4840-bfec-78bb5b6745d7", "address": "fa:16:3e:59:7c:fc", "network": {"id": "8e985ab3-9852-4f07-8b5c-19f7bf113939", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781795302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d64f3d9dae8f45bcb2e0677a0076ed64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ee78f5d-2a", "ovs_interfaceid": "1ee78f5d-2a2e-4840-bfec-78bb5b6745d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:02:38 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Releasing lock "refresh_cache-69c2803e-38e1-4962-a1e1-beb1febe48ec" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 13:02:38 user nova-compute[74960]: DEBUG nova.compute.manager [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 69c2803e-38e1-4962-a1e1-beb1febe48ec] Instance network_info: |[{"id": "1ee78f5d-2a2e-4840-bfec-78bb5b6745d7", "address": "fa:16:3e:59:7c:fc", "network": {"id": "8e985ab3-9852-4f07-8b5c-19f7bf113939", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781795302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d64f3d9dae8f45bcb2e0677a0076ed64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ee78f5d-2a", "ovs_interfaceid": "1ee78f5d-2a2e-4840-bfec-78bb5b6745d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74960) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 13:02:38 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-72d46c23-6730-430d-a412-ac163f0c2637 req-69f9761b-b09b-4933-b658-d34bfbf896bb service nova] Acquired lock "refresh_cache-69c2803e-38e1-4962-a1e1-beb1febe48ec" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:02:38 user nova-compute[74960]: DEBUG nova.network.neutron [req-72d46c23-6730-430d-a412-ac163f0c2637 req-69f9761b-b09b-4933-b658-d34bfbf896bb service nova] [instance: 69c2803e-38e1-4962-a1e1-beb1febe48ec] Refreshing network info cache for port 1ee78f5d-2a2e-4840-bfec-78bb5b6745d7 {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 13:02:38 user nova-compute[74960]: DEBUG nova.network.neutron [req-72d46c23-6730-430d-a412-ac163f0c2637 req-69f9761b-b09b-4933-b658-d34bfbf896bb service nova] [instance: 69c2803e-38e1-4962-a1e1-beb1febe48ec] Updated VIF entry in instance network info cache for port 1ee78f5d-2a2e-4840-bfec-78bb5b6745d7. {{(pid=74960) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 13:02:38 user nova-compute[74960]: DEBUG nova.network.neutron [req-72d46c23-6730-430d-a412-ac163f0c2637 req-69f9761b-b09b-4933-b658-d34bfbf896bb service nova] [instance: 69c2803e-38e1-4962-a1e1-beb1febe48ec] Updating instance_info_cache with network_info: [{"id": "1ee78f5d-2a2e-4840-bfec-78bb5b6745d7", "address": "fa:16:3e:59:7c:fc", "network": {"id": "8e985ab3-9852-4f07-8b5c-19f7bf113939", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781795302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d64f3d9dae8f45bcb2e0677a0076ed64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ee78f5d-2a", "ovs_interfaceid": "1ee78f5d-2a2e-4840-bfec-78bb5b6745d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:02:38 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-72d46c23-6730-430d-a412-ac163f0c2637 req-69f9761b-b09b-4933-b658-d34bfbf896bb service nova] Releasing lock "refresh_cache-69c2803e-38e1-4962-a1e1-beb1febe48ec" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 13:02:40 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:02:45 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:02:45 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:02:45 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74960) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 13:02:45 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74960) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 13:02:45 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74960) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 13:02:45 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:02:50 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:02:54 user nova-compute[74960]: DEBUG nova.compute.manager [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 69c2803e-38e1-4962-a1e1-beb1febe48ec] Start spawning the instance on the hypervisor. {{(pid=74960) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 13:02:54 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 69c2803e-38e1-4962-a1e1-beb1febe48ec] Creating instance directory {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 13:02:54 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 69c2803e-38e1-4962-a1e1-beb1febe48ec] Creating image(s)
Nov 03 13:02:54 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 69c2803e-38e1-4962-a1e1-beb1febe48ec] Did not create local disks {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 03 13:02:54 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 69c2803e-38e1-4962-a1e1-beb1febe48ec] Ensure instance console log exists: /opt/stack/data/nova/instances/69c2803e-38e1-4962-a1e1-beb1febe48ec/console.log {{(pid=74960) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 13:02:54 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:02:54 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:02:54 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:02:54 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 69c2803e-38e1-4962-a1e1-beb1febe48ec] Start _get_guest_xml network_info=[{"id": "1ee78f5d-2a2e-4840-bfec-78bb5b6745d7", "address": "fa:16:3e:59:7c:fc", "network": {"id": "8e985ab3-9852-4f07-8b5c-19f7bf113939", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781795302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d64f3d9dae8f45bcb2e0677a0076ed64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ee78f5d-2a", "ovs_interfaceid": "1ee78f5d-2a2e-4840-bfec-78bb5b6745d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UEgVDteh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '69c2803e-38e1-4962-a1e1-beb1febe48ec', 'attached_at': '', 'detached_at': '', 'volume_id': '143d4bac-bf81-4e34-a5c2-30ed203b60d4', 'serial': '143d4bac-bf81-4e34-a5c2-30ed203b60d4'}, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'device_type': 'disk', 'attachment_id': '8d835959-0631-4879-b1d1-5cfae5bd8863', 'boot_index': 0, 'guest_format': None, 'volume_type': None} {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 13:02:55 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:02:55 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:02:55 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 13:02:55 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] CPU controller missing on host. {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 13:02:55 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 13:02:55 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] CPU controller found on host. {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 13:02:55 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74960) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 13:02:55 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 13:02:55 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Flavor limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 13:02:55 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Image limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 13:02:55 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Flavor pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 13:02:55 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Image pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 13:02:55 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 13:02:55 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 13:02:55 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 13:02:55 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Got 1 possible topologies {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 13:02:55 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 13:02:55 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 13:02:55 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 69c2803e-38e1-4962-a1e1-beb1febe48ec] Calling os-brick to attach iSCSI Volume {{(pid=74960) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 13:02:55 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9aa420acb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UEgVDteh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 13:02:55 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 13:02:55 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 13:02:55 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 13:02:55 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 13:02:55 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 13:02:55 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 13:02:55 user nova-compute[74960]: INFO os_brick.initiator.connectors.iscsi [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 13:02:55 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4 -p 172.16.0.220:3260 {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:02:55 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:02:55 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[113299f2-dedd-477a-b36a-74193203dfc4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:02:55 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 13:02:55 user nova-compute[74960]:  {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:02:55 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4 -p 172.16.0.220:3260 --interface default --op new {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:02:55 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:02:55 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[12b72c7b-585e-4e46-a67e-9ac874604c7c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4] added\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:02:55 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4] added
Nov 03 13:02:55 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:02:55 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:02:55 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:02:55 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f34c688-b3a9-4976-a145-f1d24094a9c5]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:02:55 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:02:55 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:02:55 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:02:55 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[251f139a-988b-425d-a286-a4a898254dc2]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:02:55 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:02:55 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UEgVDteh {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:02:55 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UEgVDteh" returned: 0 in 0.017s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:02:55 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[afe3d60b-ea9c-491f-925c-965d6ec13dab]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:02:55 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UEgVDteh'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:02:55 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:02:55 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:02:55 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf6c8f3-e7cc-4f32-bd18-67b12aa088e2]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:02:55 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:02:55 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:02:55 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:02:55 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d55f8c-5863-4738-a0c1-f0a1969ea179]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:02:55 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 03 13:02:55 user nova-compute[74960]:  {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 13:02:55 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 03 13:02:55 user nova-compute[74960]:  {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 13:02:55 user nova-compute[74960]: WARNING os_brick.initiator.connectors.iscsi [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 03 13:02:55 user nova-compute[74960]: 
Nov 03 13:02:55 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4 -p 172.16.0.220:3260 --login {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:02:55 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:02:55 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:02:55 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74960) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 13:02:55 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74960) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 13:02:55 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74960) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 13:02:55 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:02:55 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:02:55 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cd537cb-0a7b-4b05-9460-6c3e6a457361]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:02:55 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4, portal: 172.16.0.220,3260]
Nov 03 13:02:55 user nova-compute[74960]: Login to [iface: default, target: iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4, portal: 172.16.0.220,3260] successful.
Nov 03 13:02:55 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:02:55 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:02:55 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:02:55 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d6cacf4-7895-4ab0-aea2-e66e45383bb4]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:02:55 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:02:55 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:02:55 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:02:55 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[55f8615f-61ea-45d5-9caf-6a2f5db673ef]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4 (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:02:55 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4 (non-flash)
Nov 03 13:02:55 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 13:02:55 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4 (non-flash)
Nov 03 13:02:55 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 13:02:55 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.259s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 13:02:55 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Connected to 172.16.0.220:3260 {{(pid=74960) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 13:02:55 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] HCTL ('33', '-', '-', 0) found on session 49 with lun 0 {{(pid=74960) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 13:02:55 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74960) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 13:02:55 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:02:55 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:02:55 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a5209c7-70b1-49d3-9ee9-31ea6bc4b60f]: (4, ('- - 0', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:02:55 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: None {{(pid=74960) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 13:02:56 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74960) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 13:02:56 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UEgVDteh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74960) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 13:02:56 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.288s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 13:02:56 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] <== connect_volume: return (1289ms) {'type': 'block', 'scsi_wwn': '23864636566386535', 'path': '/dev/sdb'} {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 13:02:56 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 69c2803e-38e1-4962-a1e1-beb1febe48ec] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23864636566386535', 'path': '/dev/sdb'} {{(pid=74960) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 13:02:56 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T13:02:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1423336979',display_name='tempest-TestVolumeBootPattern-server-1423336979',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1423336979',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG58VBMUGF35creXkaeLlS45qeSpHByygSbALoDPLyAkX8z0vqLaGfOF/PdmxhlSuzswK/zmWz4mkAMsQnGwfeIg0PnI682GlW4AY7e0K4aRcKwMAhIAhksojQg6Tc/b4g==',key_name='tempest-TestVolumeBootPattern-178111993',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d64f3d9dae8f45bcb2e0677a0076ed64',ramdisk_id='',reservation_id='r-0g8izwlc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1795947051',owner_user_name='tempest-TestVolumeBootPattern-1795947051-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T13:02:36Z,user_data=None,user_id='067a3f33438b4112b818b91ecb4dd0d2',uuid=69c2803e-38e1-4962-a1e1-beb1febe48ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1ee78f5d-2a2e-4840-bfec-78bb5b6745d7", "address": "fa:16:3e:59:7c:fc", "network": {"id": "8e985ab3-9852-4f07-8b5c-19f7bf113939", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781795302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d64f3d9dae8f45bcb2e0677a0076ed64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ee78f5d-2a", "ovs_interfaceid": "1ee78f5d-2a2e-4840-bfec-78bb5b6745d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74960) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 13:02:56 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Converting VIF {"id": "1ee78f5d-2a2e-4840-bfec-78bb5b6745d7", "address": "fa:16:3e:59:7c:fc", "network": {"id": "8e985ab3-9852-4f07-8b5c-19f7bf113939", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781795302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d64f3d9dae8f45bcb2e0677a0076ed64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ee78f5d-2a", "ovs_interfaceid": "1ee78f5d-2a2e-4840-bfec-78bb5b6745d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 13:02:56 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:7c:fc,bridge_name='br-int',has_traffic_filtering=True,id=1ee78f5d-2a2e-4840-bfec-78bb5b6745d7,network=Network(8e985ab3-9852-4f07-8b5c-19f7bf113939),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ee78f5d-2a') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 13:02:56 user nova-compute[74960]: DEBUG nova.objects.instance [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lazy-loading 'pci_devices' on Instance uuid 69c2803e-38e1-4962-a1e1-beb1febe48ec {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:02:56 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 69c2803e-38e1-4962-a1e1-beb1febe48ec] End _get_guest_xml xml=<domain type="kvm">
Nov 03 13:02:56 user nova-compute[74960]:   <uuid>69c2803e-38e1-4962-a1e1-beb1febe48ec</uuid>
Nov 03 13:02:56 user nova-compute[74960]:   <name>instance-00000033</name>
Nov 03 13:02:56 user nova-compute[74960]:   <memory>524288</memory>
Nov 03 13:02:56 user nova-compute[74960]:   <vcpu>1</vcpu>
Nov 03 13:02:56 user nova-compute[74960]:   <metadata>
Nov 03 13:02:56 user nova-compute[74960]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 13:02:56 user nova-compute[74960]:       <nova:package version="0.0.0"/>
Nov 03 13:02:56 user nova-compute[74960]:       <nova:name>tempest-TestVolumeBootPattern-server-1423336979</nova:name>
Nov 03 13:02:56 user nova-compute[74960]:       <nova:creationTime>2023-11-03 13:02:55</nova:creationTime>
Nov 03 13:02:56 user nova-compute[74960]:       <nova:flavor name="m1.tiny">
Nov 03 13:02:56 user nova-compute[74960]:         <nova:memory>512</nova:memory>
Nov 03 13:02:56 user nova-compute[74960]:         <nova:disk>1</nova:disk>
Nov 03 13:02:56 user nova-compute[74960]:         <nova:swap>0</nova:swap>
Nov 03 13:02:56 user nova-compute[74960]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 13:02:56 user nova-compute[74960]:         <nova:vcpus>1</nova:vcpus>
Nov 03 13:02:56 user nova-compute[74960]:       </nova:flavor>
Nov 03 13:02:56 user nova-compute[74960]:       <nova:owner>
Nov 03 13:02:56 user nova-compute[74960]:         <nova:user uuid="067a3f33438b4112b818b91ecb4dd0d2">tempest-TestVolumeBootPattern-1795947051-project-member</nova:user>
Nov 03 13:02:56 user nova-compute[74960]:         <nova:project uuid="d64f3d9dae8f45bcb2e0677a0076ed64">tempest-TestVolumeBootPattern-1795947051</nova:project>
Nov 03 13:02:56 user nova-compute[74960]:       </nova:owner>
Nov 03 13:02:56 user nova-compute[74960]:       <nova:ports>
Nov 03 13:02:56 user nova-compute[74960]:         <nova:port uuid="1ee78f5d-2a2e-4840-bfec-78bb5b6745d7">
Nov 03 13:02:56 user nova-compute[74960]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 03 13:02:56 user nova-compute[74960]:         </nova:port>
Nov 03 13:02:56 user nova-compute[74960]:       </nova:ports>
Nov 03 13:02:56 user nova-compute[74960]:     </nova:instance>
Nov 03 13:02:56 user nova-compute[74960]:   </metadata>
Nov 03 13:02:56 user nova-compute[74960]:   <sysinfo type="smbios">
Nov 03 13:02:56 user nova-compute[74960]:     <system>
Nov 03 13:02:56 user nova-compute[74960]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 13:02:56 user nova-compute[74960]:       <entry name="product">OpenStack Nova</entry>
Nov 03 13:02:56 user nova-compute[74960]:       <entry name="version">0.0.0</entry>
Nov 03 13:02:56 user nova-compute[74960]:       <entry name="serial">69c2803e-38e1-4962-a1e1-beb1febe48ec</entry>
Nov 03 13:02:56 user nova-compute[74960]:       <entry name="uuid">69c2803e-38e1-4962-a1e1-beb1febe48ec</entry>
Nov 03 13:02:56 user nova-compute[74960]:       <entry name="family">Virtual Machine</entry>
Nov 03 13:02:56 user nova-compute[74960]:     </system>
Nov 03 13:02:56 user nova-compute[74960]:   </sysinfo>
Nov 03 13:02:56 user nova-compute[74960]:   <os>
Nov 03 13:02:56 user nova-compute[74960]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 13:02:56 user nova-compute[74960]:     <boot dev="hd"/>
Nov 03 13:02:56 user nova-compute[74960]:     <smbios mode="sysinfo"/>
Nov 03 13:02:56 user nova-compute[74960]:   </os>
Nov 03 13:02:56 user nova-compute[74960]:   <features>
Nov 03 13:02:56 user nova-compute[74960]:     <acpi/>
Nov 03 13:02:56 user nova-compute[74960]:     <apic/>
Nov 03 13:02:56 user nova-compute[74960]:     <vmcoreinfo/>
Nov 03 13:02:56 user nova-compute[74960]:   </features>
Nov 03 13:02:56 user nova-compute[74960]:   <clock offset="utc">
Nov 03 13:02:56 user nova-compute[74960]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 13:02:56 user nova-compute[74960]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 13:02:56 user nova-compute[74960]:     <timer name="hpet" present="no"/>
Nov 03 13:02:56 user nova-compute[74960]:   </clock>
Nov 03 13:02:56 user nova-compute[74960]:   <cpu mode="custom" match="exact">
Nov 03 13:02:56 user nova-compute[74960]:     <model>Nehalem</model>
Nov 03 13:02:56 user nova-compute[74960]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 13:02:56 user nova-compute[74960]:   </cpu>
Nov 03 13:02:56 user nova-compute[74960]:   <devices>
Nov 03 13:02:56 user nova-compute[74960]:     <disk type="block" device="disk">
Nov 03 13:02:56 user nova-compute[74960]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 13:02:56 user nova-compute[74960]:       <source dev="/dev/sdb"/>
Nov 03 13:02:56 user nova-compute[74960]:       <target dev="vda" bus="virtio"/>
Nov 03 13:02:56 user nova-compute[74960]:       <serial>143d4bac-bf81-4e34-a5c2-30ed203b60d4</serial>
Nov 03 13:02:56 user nova-compute[74960]:     </disk>
Nov 03 13:02:56 user nova-compute[74960]:     <interface type="ethernet">
Nov 03 13:02:56 user nova-compute[74960]:       <mac address="fa:16:3e:59:7c:fc"/>
Nov 03 13:02:56 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 13:02:56 user nova-compute[74960]:       <mtu size="1442"/>
Nov 03 13:02:56 user nova-compute[74960]:       <target dev="tap1ee78f5d-2a"/>
Nov 03 13:02:56 user nova-compute[74960]:     </interface>
Nov 03 13:02:56 user nova-compute[74960]:     <serial type="pty">
Nov 03 13:02:56 user nova-compute[74960]:       <log file="/opt/stack/data/nova/instances/69c2803e-38e1-4962-a1e1-beb1febe48ec/console.log" append="off"/>
Nov 03 13:02:56 user nova-compute[74960]:     </serial>
Nov 03 13:02:56 user nova-compute[74960]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 13:02:56 user nova-compute[74960]:     <video>
Nov 03 13:02:56 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 13:02:56 user nova-compute[74960]:     </video>
Nov 03 13:02:56 user nova-compute[74960]:     <rng model="virtio">
Nov 03 13:02:56 user nova-compute[74960]:       <backend model="random">/dev/urandom</backend>
Nov 03 13:02:56 user nova-compute[74960]:     </rng>
Nov 03 13:02:56 user nova-compute[74960]:     <controller type="usb" index="0" model="none"/>
Nov 03 13:02:56 user nova-compute[74960]:     <memballoon model="virtio">
Nov 03 13:02:56 user nova-compute[74960]:       <stats period="10"/>
Nov 03 13:02:56 user nova-compute[74960]:     </memballoon>
Nov 03 13:02:56 user nova-compute[74960]:   </devices>
Nov 03 13:02:56 user nova-compute[74960]: </domain>
Nov 03 13:02:56 user nova-compute[74960]:  {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 13:02:56 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T13:02:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1423336979',display_name='tempest-TestVolumeBootPattern-server-1423336979',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1423336979',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG58VBMUGF35creXkaeLlS45qeSpHByygSbALoDPLyAkX8z0vqLaGfOF/PdmxhlSuzswK/zmWz4mkAMsQnGwfeIg0PnI682GlW4AY7e0K4aRcKwMAhIAhksojQg6Tc/b4g==',key_name='tempest-TestVolumeBootPattern-178111993',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d64f3d9dae8f45bcb2e0677a0076ed64',ramdisk_id='',reservation_id='r-0g8izwlc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1795947051',owner_user_name='tempest-TestVolumeBootPattern-1795947051-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T13:02:36Z,user_data=None,user_id='067a3f33438b4112b818b91ecb4dd0d2',uuid=69c2803e-38e1-4962-a1e1-beb1febe48ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1ee78f5d-2a2e-4840-bfec-78bb5b6745d7", "address": "fa:16:3e:59:7c:fc", "network": {"id": "8e985ab3-9852-4f07-8b5c-19f7bf113939", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781795302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d64f3d9dae8f45bcb2e0677a0076ed64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ee78f5d-2a", "ovs_interfaceid": "1ee78f5d-2a2e-4840-bfec-78bb5b6745d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 13:02:56 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Converting VIF {"id": "1ee78f5d-2a2e-4840-bfec-78bb5b6745d7", "address": "fa:16:3e:59:7c:fc", "network": {"id": "8e985ab3-9852-4f07-8b5c-19f7bf113939", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781795302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d64f3d9dae8f45bcb2e0677a0076ed64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ee78f5d-2a", "ovs_interfaceid": "1ee78f5d-2a2e-4840-bfec-78bb5b6745d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 13:02:56 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:7c:fc,bridge_name='br-int',has_traffic_filtering=True,id=1ee78f5d-2a2e-4840-bfec-78bb5b6745d7,network=Network(8e985ab3-9852-4f07-8b5c-19f7bf113939),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ee78f5d-2a') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 13:02:56 user nova-compute[74960]: DEBUG os_vif [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:7c:fc,bridge_name='br-int',has_traffic_filtering=True,id=1ee78f5d-2a2e-4840-bfec-78bb5b6745d7,network=Network(8e985ab3-9852-4f07-8b5c-19f7bf113939),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ee78f5d-2a') {{(pid=74960) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 13:02:56 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:02:56 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:02:56 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 13:02:56 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:02:56 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '236d27b6-b765-54e2-8797-74e60c5563a8', '_type': 'linux-noop'}}, row=False) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:02:56 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:02:56 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:02:56 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:02:56 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1ee78f5d-2a, may_exist=True, interface_attrs={}) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:02:56 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1ee78f5d-2a, col_values=(('qos', UUID('1e71942d-e120-423f-a31b-deb8b6a3e9eb')),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:02:56 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1ee78f5d-2a, col_values=(('external_ids', {'iface-id': '1ee78f5d-2a2e-4840-bfec-78bb5b6745d7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:59:7c:fc', 'vm-uuid': '69c2803e-38e1-4962-a1e1-beb1febe48ec'}),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:02:56 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:02:56 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:02:56 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:02:56 user nova-compute[74960]: INFO os_vif [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:7c:fc,bridge_name='br-int',has_traffic_filtering=True,id=1ee78f5d-2a2e-4840-bfec-78bb5b6745d7,network=Network(8e985ab3-9852-4f07-8b5c-19f7bf113939),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ee78f5d-2a')
Nov 03 13:02:56 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] No BDM found with device name vda, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 13:02:56 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] No VIF found with MAC fa:16:3e:59:7c:fc, not building metadata {{(pid=74960) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 13:02:57 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:02:57 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:02:57 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:02:57 user nova-compute[74960]: DEBUG nova.compute.manager [req-fd5ac80a-ac33-40c7-89dd-014ed2c12417 req-682c1b01-6fef-44da-939c-3bc2d120679b service nova] [instance: 69c2803e-38e1-4962-a1e1-beb1febe48ec] Received event network-vif-plugged-1ee78f5d-2a2e-4840-bfec-78bb5b6745d7 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:02:57 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-fd5ac80a-ac33-40c7-89dd-014ed2c12417 req-682c1b01-6fef-44da-939c-3bc2d120679b service nova] Acquiring lock "69c2803e-38e1-4962-a1e1-beb1febe48ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:02:57 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-fd5ac80a-ac33-40c7-89dd-014ed2c12417 req-682c1b01-6fef-44da-939c-3bc2d120679b service nova] Lock "69c2803e-38e1-4962-a1e1-beb1febe48ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:02:57 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-fd5ac80a-ac33-40c7-89dd-014ed2c12417 req-682c1b01-6fef-44da-939c-3bc2d120679b service nova] Lock "69c2803e-38e1-4962-a1e1-beb1febe48ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:02:57 user nova-compute[74960]: DEBUG nova.compute.manager [req-fd5ac80a-ac33-40c7-89dd-014ed2c12417 req-682c1b01-6fef-44da-939c-3bc2d120679b service nova] [instance: 69c2803e-38e1-4962-a1e1-beb1febe48ec] No waiting events found dispatching network-vif-plugged-1ee78f5d-2a2e-4840-bfec-78bb5b6745d7 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:02:57 user nova-compute[74960]: WARNING nova.compute.manager [req-fd5ac80a-ac33-40c7-89dd-014ed2c12417 req-682c1b01-6fef-44da-939c-3bc2d120679b service nova] [instance: 69c2803e-38e1-4962-a1e1-beb1febe48ec] Received unexpected event network-vif-plugged-1ee78f5d-2a2e-4840-bfec-78bb5b6745d7 for instance with vm_state building and task_state spawning.
Nov 03 13:02:58 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:02:58 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:02:58 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:02:59 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:02:59 user nova-compute[74960]: DEBUG nova.compute.manager [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 69c2803e-38e1-4962-a1e1-beb1febe48ec] Instance event wait completed in 0 seconds for  {{(pid=74960) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 13:02:59 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 69c2803e-38e1-4962-a1e1-beb1febe48ec] Guest created on hypervisor {{(pid=74960) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 13:02:59 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: 69c2803e-38e1-4962-a1e1-beb1febe48ec] Instance spawned successfully.
Nov 03 13:02:59 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 69c2803e-38e1-4962-a1e1-beb1febe48ec] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 13:02:59 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 69c2803e-38e1-4962-a1e1-beb1febe48ec] Found default for hw_cdrom_bus of ide {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:02:59 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 69c2803e-38e1-4962-a1e1-beb1febe48ec] Found default for hw_disk_bus of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:02:59 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 69c2803e-38e1-4962-a1e1-beb1febe48ec] Found default for hw_input_bus of None {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:02:59 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 69c2803e-38e1-4962-a1e1-beb1febe48ec] Found default for hw_pointer_model of None {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:02:59 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 69c2803e-38e1-4962-a1e1-beb1febe48ec] Found default for hw_video_model of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:02:59 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 69c2803e-38e1-4962-a1e1-beb1febe48ec] Found default for hw_vif_model of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:02:59 user nova-compute[74960]: DEBUG nova.compute.manager [req-6ec8da52-e4c7-4ef2-828a-36f17881412c req-e48d5093-56fa-43f1-a61b-3077c023f062 service nova] [instance: 69c2803e-38e1-4962-a1e1-beb1febe48ec] Received event network-vif-plugged-1ee78f5d-2a2e-4840-bfec-78bb5b6745d7 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:02:59 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-6ec8da52-e4c7-4ef2-828a-36f17881412c req-e48d5093-56fa-43f1-a61b-3077c023f062 service nova] Acquiring lock "69c2803e-38e1-4962-a1e1-beb1febe48ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:02:59 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-6ec8da52-e4c7-4ef2-828a-36f17881412c req-e48d5093-56fa-43f1-a61b-3077c023f062 service nova] Lock "69c2803e-38e1-4962-a1e1-beb1febe48ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:02:59 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-6ec8da52-e4c7-4ef2-828a-36f17881412c req-e48d5093-56fa-43f1-a61b-3077c023f062 service nova] Lock "69c2803e-38e1-4962-a1e1-beb1febe48ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:02:59 user nova-compute[74960]: DEBUG nova.compute.manager [req-6ec8da52-e4c7-4ef2-828a-36f17881412c req-e48d5093-56fa-43f1-a61b-3077c023f062 service nova] [instance: 69c2803e-38e1-4962-a1e1-beb1febe48ec] No waiting events found dispatching network-vif-plugged-1ee78f5d-2a2e-4840-bfec-78bb5b6745d7 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:02:59 user nova-compute[74960]: WARNING nova.compute.manager [req-6ec8da52-e4c7-4ef2-828a-36f17881412c req-e48d5093-56fa-43f1-a61b-3077c023f062 service nova] [instance: 69c2803e-38e1-4962-a1e1-beb1febe48ec] Received unexpected event network-vif-plugged-1ee78f5d-2a2e-4840-bfec-78bb5b6745d7 for instance with vm_state building and task_state spawning.
Nov 03 13:03:00 user nova-compute[74960]: INFO nova.compute.manager [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 69c2803e-38e1-4962-a1e1-beb1febe48ec] Took 5.04 seconds to spawn the instance on the hypervisor.
Nov 03 13:03:00 user nova-compute[74960]: DEBUG nova.compute.manager [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 69c2803e-38e1-4962-a1e1-beb1febe48ec] Checking state {{(pid=74960) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 13:03:00 user nova-compute[74960]: INFO nova.compute.manager [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 69c2803e-38e1-4962-a1e1-beb1febe48ec] Took 24.12 seconds to build instance.
Nov 03 13:03:00 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-990c50fd-dcd8-4dfc-8c9b-110774f4e591 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lock "69c2803e-38e1-4962-a1e1-beb1febe48ec" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 24.217s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:03:01 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:03:04 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:03:06 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:03:11 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:03:13 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:03:14 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:03:16 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:03:19 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:03:20 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:03:21 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:03:21 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:03:21 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:03:21 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:03:21 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Auditing locally available compute resources for user (node: user) {{(pid=74960) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 13:03:21 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:03:21 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74960) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 13:03:21 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/719e66bb-99ac-4e98-bf1c-182bf640c28d/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:03:21 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/719e66bb-99ac-4e98-bf1c-182bf640c28d/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:03:21 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/719e66bb-99ac-4e98-bf1c-182bf640c28d/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:03:21 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/719e66bb-99ac-4e98-bf1c-182bf640c28d/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:03:22 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:03:22 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:03:22 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Hypervisor/Node resource view: name=user free_ram=8804MB free_disk=24.942092895507812GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74960) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 13:03:22 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:03:22 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:03:22 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 719e66bb-99ac-4e98-bf1c-182bf640c28d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:03:22 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 69c2803e-38e1-4962-a1e1-beb1febe48ec actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:03:22 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74960) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 13:03:22 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74960) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 13:03:22 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 13:03:22 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 13:03:22 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Compute_service record updated for user:user {{(pid=74960) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 13:03:22 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.343s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:03:23 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:03:24 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:03:25 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:03:25 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Starting heal instance info cache {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 13:03:25 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Rebuilding the list of instances to heal {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 03 13:03:25 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "refresh_cache-719e66bb-99ac-4e98-bf1c-182bf640c28d" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:03:25 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquired lock "refresh_cache-719e66bb-99ac-4e98-bf1c-182bf640c28d" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:03:25 user nova-compute[74960]: DEBUG nova.network.neutron [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: 719e66bb-99ac-4e98-bf1c-182bf640c28d] Forcefully refreshing network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 13:03:25 user nova-compute[74960]: DEBUG nova.objects.instance [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lazy-loading 'info_cache' on Instance uuid 719e66bb-99ac-4e98-bf1c-182bf640c28d {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:03:25 user nova-compute[74960]: DEBUG nova.network.neutron [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: 719e66bb-99ac-4e98-bf1c-182bf640c28d] Updating instance_info_cache with network_info: [{"id": "18d94345-48c9-4540-8053-a26390fb823b", "address": "fa:16:3e:97:86:d5", "network": {"id": "c50fc382-c1b9-49d8-8e38-ac681cbbcffd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1465428328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "255349fa349045ad8a554d3f818cdd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18d94345-48", "ovs_interfaceid": "18d94345-48c9-4540-8053-a26390fb823b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:03:25 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Releasing lock "refresh_cache-719e66bb-99ac-4e98-bf1c-182bf640c28d" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 13:03:25 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: 719e66bb-99ac-4e98-bf1c-182bf640c28d] Updated the network info_cache for instance {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 13:03:25 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:03:26 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:03:26 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:03:27 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:03:27 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:03:27 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74960) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 13:03:27 user nova-compute[74960]: DEBUG nova.compute.manager [req-3ca2b3c6-66b9-4e56-b0a5-76e6c4b57367 req-e07b8819-22cb-4542-83c7-2d0ed9a08e50 service nova] [instance: 719e66bb-99ac-4e98-bf1c-182bf640c28d] Received event network-changed-18d94345-48c9-4540-8053-a26390fb823b {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:03:27 user nova-compute[74960]: DEBUG nova.compute.manager [req-3ca2b3c6-66b9-4e56-b0a5-76e6c4b57367 req-e07b8819-22cb-4542-83c7-2d0ed9a08e50 service nova] [instance: 719e66bb-99ac-4e98-bf1c-182bf640c28d] Refreshing instance network info cache due to event network-changed-18d94345-48c9-4540-8053-a26390fb823b. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 13:03:27 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-3ca2b3c6-66b9-4e56-b0a5-76e6c4b57367 req-e07b8819-22cb-4542-83c7-2d0ed9a08e50 service nova] Acquiring lock "refresh_cache-719e66bb-99ac-4e98-bf1c-182bf640c28d" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:03:27 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-3ca2b3c6-66b9-4e56-b0a5-76e6c4b57367 req-e07b8819-22cb-4542-83c7-2d0ed9a08e50 service nova] Acquired lock "refresh_cache-719e66bb-99ac-4e98-bf1c-182bf640c28d" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:03:27 user nova-compute[74960]: DEBUG nova.network.neutron [req-3ca2b3c6-66b9-4e56-b0a5-76e6c4b57367 req-e07b8819-22cb-4542-83c7-2d0ed9a08e50 service nova] [instance: 719e66bb-99ac-4e98-bf1c-182bf640c28d] Refreshing network info cache for port 18d94345-48c9-4540-8053-a26390fb823b {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 13:03:27 user nova-compute[74960]: DEBUG nova.network.neutron [req-3ca2b3c6-66b9-4e56-b0a5-76e6c4b57367 req-e07b8819-22cb-4542-83c7-2d0ed9a08e50 service nova] [instance: 719e66bb-99ac-4e98-bf1c-182bf640c28d] Updated VIF entry in instance network info cache for port 18d94345-48c9-4540-8053-a26390fb823b. {{(pid=74960) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 13:03:27 user nova-compute[74960]: DEBUG nova.network.neutron [req-3ca2b3c6-66b9-4e56-b0a5-76e6c4b57367 req-e07b8819-22cb-4542-83c7-2d0ed9a08e50 service nova] [instance: 719e66bb-99ac-4e98-bf1c-182bf640c28d] Updating instance_info_cache with network_info: [{"id": "18d94345-48c9-4540-8053-a26390fb823b", "address": "fa:16:3e:97:86:d5", "network": {"id": "c50fc382-c1b9-49d8-8e38-ac681cbbcffd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1465428328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "255349fa349045ad8a554d3f818cdd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18d94345-48", "ovs_interfaceid": "18d94345-48c9-4540-8053-a26390fb823b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:03:27 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-3ca2b3c6-66b9-4e56-b0a5-76e6c4b57367 req-e07b8819-22cb-4542-83c7-2d0ed9a08e50 service nova] Releasing lock "refresh_cache-719e66bb-99ac-4e98-bf1c-182bf640c28d" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 13:03:28 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:03:29 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:03:31 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:03:31 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Cleaning up deleted instances with incomplete migration  {{(pid=74960) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 03 13:03:31 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:03:33 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:03:33 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Cleaning up deleted instances {{(pid=74960) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 03 13:03:33 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] There are 0 instances to clean {{(pid=74960) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 03 13:03:33 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-a7eb5f02-67d0-4452-bff6-8885bc008718 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Acquiring lock "719e66bb-99ac-4e98-bf1c-182bf640c28d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:03:33 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-a7eb5f02-67d0-4452-bff6-8885bc008718 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Lock "719e66bb-99ac-4e98-bf1c-182bf640c28d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:03:33 user nova-compute[74960]: DEBUG nova.objects.instance [None req-a7eb5f02-67d0-4452-bff6-8885bc008718 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Lazy-loading 'flavor' on Instance uuid 719e66bb-99ac-4e98-bf1c-182bf640c28d {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:03:33 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-a7eb5f02-67d0-4452-bff6-8885bc008718 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Lock "719e66bb-99ac-4e98-bf1c-182bf640c28d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:03:33 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-a7eb5f02-67d0-4452-bff6-8885bc008718 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Acquiring lock "719e66bb-99ac-4e98-bf1c-182bf640c28d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:03:33 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-a7eb5f02-67d0-4452-bff6-8885bc008718 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Lock "719e66bb-99ac-4e98-bf1c-182bf640c28d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:03:33 user nova-compute[74960]: INFO nova.compute.manager [None req-a7eb5f02-67d0-4452-bff6-8885bc008718 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 719e66bb-99ac-4e98-bf1c-182bf640c28d] Attaching volume 477e1c52-6508-4d09-937d-6383b642ec9a to /dev/vdb
Nov 03 13:03:33 user nova-compute[74960]: DEBUG os_brick.utils [None req-a7eb5f02-67d0-4452-bff6-8885bc008718 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 13:03:33 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:03:33 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:03:33 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d5b392a-9cd8-46d2-bb5e-48fb08479244]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:75b8e219756\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:03:33 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:03:33 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:03:33 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[e118b764-3a75-4e62-b16f-69a29a455efc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:03:33 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:03:33 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:03:33 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3ea1737-2add-4ec3-9676-3f7ddacf1de4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:03:33 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c0cd3ac-1a64-43db-927b-1e7065c1ad38]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:03:33 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-a7eb5f02-67d0-4452-bff6-8885bc008718 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Running cmd (subprocess): nvme version {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:03:33 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-a7eb5f02-67d0-4452-bff6-8885bc008718 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] 'nvme version' failed. Not Retrying. {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 13:03:33 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a7eb5f02-67d0-4452-bff6-8885bc008718 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] nvme not present on system {{(pid=74960) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 13:03:33 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:03:33 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 13:03:33 user nova-compute[74960]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 13:03:33 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e162bc3-545f-45e8-a61e-b9ef1836e4d2]: (4, '') {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:03:33 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-a7eb5f02-67d0-4452-bff6-8885bc008718 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74960) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 13:03:33 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-a7eb5f02-67d0-4452-bff6-8885bc008718 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74960) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 13:03:33 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-a7eb5f02-67d0-4452-bff6-8885bc008718 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] LIGHTOS: no hostnqn found. {{(pid=74960) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 13:03:33 user nova-compute[74960]: DEBUG os_brick.utils [None req-a7eb5f02-67d0-4452-bff6-8885bc008718 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:75b8e219756', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 13:03:33 user nova-compute[74960]: DEBUG nova.virt.block_device [None req-a7eb5f02-67d0-4452-bff6-8885bc008718 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 719e66bb-99ac-4e98-bf1c-182bf640c28d] Updating existing volume attachment record: 2829ea83-83b9-484a-909d-a8967b9338e5 {{(pid=74960) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 13:03:34 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:03:36 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:03:41 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:03:41 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:03:41 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:03:41 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74960) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 13:03:41 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74960) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 13:03:41 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74960) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 13:03:41 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:03:44 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:03:46 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:03:51 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:03:56 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:03:56 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:03:56 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74960) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 13:03:56 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74960) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 13:03:56 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74960) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 13:03:56 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:03:59 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:04:01 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:04:02 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7eb5f02-67d0-4452-bff6-8885bc008718 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 719e66bb-99ac-4e98-bf1c-182bf640c28d] Calling os-brick to attach iSCSI Volume {{(pid=74960) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 13:04:02 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7eb5f02-67d0-4452-bff6-8885bc008718 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9aa420acb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:477e1c52-6508-4d09-937d-6383b642ec9a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bUhaKByG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 13:04:02 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-a7eb5f02-67d0-4452-bff6-8885bc008718 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 13:04:02 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-a7eb5f02-67d0-4452-bff6-8885bc008718 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 13:04:02 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-a7eb5f02-67d0-4452-bff6-8885bc008718 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 13:04:02 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-a7eb5f02-67d0-4452-bff6-8885bc008718 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 13:04:02 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-a7eb5f02-67d0-4452-bff6-8885bc008718 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:477e1c52-6508-4d09-937d-6383b642ec9a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 13:04:02 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-a7eb5f02-67d0-4452-bff6-8885bc008718 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:477e1c52-6508-4d09-937d-6383b642ec9a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 13:04:02 user nova-compute[74960]: INFO os_brick.initiator.connectors.iscsi [None req-a7eb5f02-67d0-4452-bff6-8885bc008718 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 13:04:02 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:477e1c52-6508-4d09-937d-6383b642ec9a -p 172.16.0.220:3260 {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:04:02 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:477e1c52-6508-4d09-937d-6383b642ec9a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:04:02 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f2ec112-aa24-44f2-ace6-45f505687195]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:04:02 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7eb5f02-67d0-4452-bff6-8885bc008718 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 13:04:02 user nova-compute[74960]:  {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:04:02 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:477e1c52-6508-4d09-937d-6383b642ec9a -p 172.16.0.220:3260 --interface default --op new {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:04:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:477e1c52-6508-4d09-937d-6383b642ec9a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:04:03 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e3142ba-ba99-487c-9496-60102879c19b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:477e1c52-6508-4d09-937d-6383b642ec9a] added\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:04:03 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7eb5f02-67d0-4452-bff6-8885bc008718 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:477e1c52-6508-4d09-937d-6383b642ec9a] added
Nov 03 13:04:03 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:04:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:477e1c52-6508-4d09-937d-6383b642ec9a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:04:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:477e1c52-6508-4d09-937d-6383b642ec9a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:04:03 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a653781-b030-4e46-bd20-4f0f45997a0b]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:04:03 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7eb5f02-67d0-4452-bff6-8885bc008718 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:04:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:477e1c52-6508-4d09-937d-6383b642ec9a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:04:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:477e1c52-6508-4d09-937d-6383b642ec9a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:04:03 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[033825c7-1408-4b6d-b118-ec30591f298e]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:04:03 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7eb5f02-67d0-4452-bff6-8885bc008718 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:04:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:477e1c52-6508-4d09-937d-6383b642ec9a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bUhaKByG {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:04:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:477e1c52-6508-4d09-937d-6383b642ec9a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bUhaKByG" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:04:03 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb130843-e52a-4734-821d-201186885880]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:04:03 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7eb5f02-67d0-4452-bff6-8885bc008718 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bUhaKByG'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:04:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:477e1c52-6508-4d09-937d-6383b642ec9a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:04:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:477e1c52-6508-4d09-937d-6383b642ec9a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:04:03 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[b67a5ab4-1eb2-452e-beeb-cb3b6b9f2e58]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:04:03 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7eb5f02-67d0-4452-bff6-8885bc008718 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:04:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:04:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:04:03 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a3528bd-5886-43ba-b021-899537218866]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4 (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:04:03 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7eb5f02-67d0-4452-bff6-8885bc008718 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4 (non-flash)
Nov 03 13:04:03 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 13:04:03 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7eb5f02-67d0-4452-bff6-8885bc008718 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4 (non-flash)
Nov 03 13:04:03 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 13:04:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:477e1c52-6508-4d09-937d-6383b642ec9a -p 172.16.0.220:3260 --login {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:04:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:477e1c52-6508-4d09-937d-6383b642ec9a -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:04:03 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b7aceaf-dd1a-465a-b4a6-a77ddac6ac75]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:477e1c52-6508-4d09-937d-6383b642ec9a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:477e1c52-6508-4d09-937d-6383b642ec9a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:04:03 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7eb5f02-67d0-4452-bff6-8885bc008718 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:477e1c52-6508-4d09-937d-6383b642ec9a, portal: 172.16.0.220,3260]
Nov 03 13:04:03 user nova-compute[74960]: Login to [iface: default, target: iqn.2010-10.org.openstack:477e1c52-6508-4d09-937d-6383b642ec9a, portal: 172.16.0.220,3260] successful.
Nov 03 13:04:03 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:04:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:477e1c52-6508-4d09-937d-6383b642ec9a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:04:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:477e1c52-6508-4d09-937d-6383b642ec9a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:04:03 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1956796-5d20-4989-be8d-acedfd80bebf]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:04:03 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7eb5f02-67d0-4452-bff6-8885bc008718 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:04:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:04:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:04:03 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e9a0069-d99d-458d-9adf-34cb5705a696]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:477e1c52-6508-4d09-937d-6383b642ec9a (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:04:03 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7eb5f02-67d0-4452-bff6-8885bc008718 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4 (non-flash)
Nov 03 13:04:03 user nova-compute[74960]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:477e1c52-6508-4d09-937d-6383b642ec9a (non-flash)
Nov 03 13:04:03 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 13:04:03 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7eb5f02-67d0-4452-bff6-8885bc008718 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4 (non-flash)
Nov 03 13:04:03 user nova-compute[74960]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:477e1c52-6508-4d09-937d-6383b642ec9a (non-flash)
Nov 03 13:04:03 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 13:04:03 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-a7eb5f02-67d0-4452-bff6-8885bc008718 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:477e1c52-6508-4d09-937d-6383b642ec9a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.261s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 13:04:03 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7eb5f02-67d0-4452-bff6-8885bc008718 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Connected to 172.16.0.220:3260 {{(pid=74960) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 13:04:03 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-a7eb5f02-67d0-4452-bff6-8885bc008718 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] HCTL ('34', '-', '-', 0) found on session 50 with lun 0 {{(pid=74960) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 13:04:03 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-a7eb5f02-67d0-4452-bff6-8885bc008718 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74960) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 13:04:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:04:03 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:04:03 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf65867f-ebd4-458b-8cd1-bb92e729fef2]: (4, ('- - 0', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:04:03 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-a7eb5f02-67d0-4452-bff6-8885bc008718 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Searching for a device in session 50 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74960) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 13:04:03 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7eb5f02-67d0-4452-bff6-8885bc008718 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:477e1c52-6508-4d09-937d-6383b642ec9a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bUhaKByG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74960) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 13:04:04 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-a7eb5f02-67d0-4452-bff6-8885bc008718 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 13:04:04 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7eb5f02-67d0-4452-bff6-8885bc008718 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] <== connect_volume: return (1299ms) {'type': 'block', 'scsi_wwn': '23563326534323132', 'path': '/dev/sdc'} {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 13:04:04 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7eb5f02-67d0-4452-bff6-8885bc008718 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 719e66bb-99ac-4e98-bf1c-182bf640c28d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23563326534323132', 'path': '/dev/sdc'} {{(pid=74960) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 13:04:04 user nova-compute[74960]: DEBUG nova.objects.instance [None req-a7eb5f02-67d0-4452-bff6-8885bc008718 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Lazy-loading 'flavor' on Instance uuid 719e66bb-99ac-4e98-bf1c-182bf640c28d {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:04:04 user nova-compute[74960]: DEBUG nova.virt.libvirt.guest [None req-a7eb5f02-67d0-4452-bff6-8885bc008718 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] attach device xml: <disk type="block" device="disk">
Nov 03 13:04:04 user nova-compute[74960]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 13:04:04 user nova-compute[74960]:   <source dev="/dev/sdc"/>
Nov 03 13:04:04 user nova-compute[74960]:   <target dev="vdb" bus="virtio"/>
Nov 03 13:04:04 user nova-compute[74960]:   <serial>477e1c52-6508-4d09-937d-6383b642ec9a</serial>
Nov 03 13:04:04 user nova-compute[74960]: </disk>
Nov 03 13:04:04 user nova-compute[74960]:  {{(pid=74960) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 03 13:04:04 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-a7eb5f02-67d0-4452-bff6-8885bc008718 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] No BDM found with device name vda, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 13:04:04 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-a7eb5f02-67d0-4452-bff6-8885bc008718 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 13:04:04 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-a7eb5f02-67d0-4452-bff6-8885bc008718 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] No VIF found with MAC fa:16:3e:97:86:d5, not building metadata {{(pid=74960) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 13:04:04 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-a7eb5f02-67d0-4452-bff6-8885bc008718 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Lock "719e66bb-99ac-4e98-bf1c-182bf640c28d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 31.257s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:04:05 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-72259f0b-657a-4b9e-b4bf-1703d5667b9f tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Acquiring lock "719e66bb-99ac-4e98-bf1c-182bf640c28d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:04:05 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-72259f0b-657a-4b9e-b4bf-1703d5667b9f tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Lock "719e66bb-99ac-4e98-bf1c-182bf640c28d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:04:05 user nova-compute[74960]: INFO nova.compute.manager [None req-72259f0b-657a-4b9e-b4bf-1703d5667b9f tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 719e66bb-99ac-4e98-bf1c-182bf640c28d] Detaching volume 477e1c52-6508-4d09-937d-6383b642ec9a
Nov 03 13:04:06 user nova-compute[74960]: INFO nova.virt.block_device [None req-72259f0b-657a-4b9e-b4bf-1703d5667b9f tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 719e66bb-99ac-4e98-bf1c-182bf640c28d] Attempting to driver detach volume 477e1c52-6508-4d09-937d-6383b642ec9a from mountpoint /dev/vdb
Nov 03 13:04:06 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-72259f0b-657a-4b9e-b4bf-1703d5667b9f tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Attempting to detach device vdb from instance 719e66bb-99ac-4e98-bf1c-182bf640c28d from the persistent domain config. {{(pid=74960) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 03 13:04:06 user nova-compute[74960]: DEBUG nova.virt.libvirt.guest [None req-72259f0b-657a-4b9e-b4bf-1703d5667b9f tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 13:04:06 user nova-compute[74960]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 13:04:06 user nova-compute[74960]:   <source dev="/dev/sdc"/>
Nov 03 13:04:06 user nova-compute[74960]:   <target dev="vdb" bus="virtio"/>
Nov 03 13:04:06 user nova-compute[74960]:   <serial>477e1c52-6508-4d09-937d-6383b642ec9a</serial>
Nov 03 13:04:06 user nova-compute[74960]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 13:04:06 user nova-compute[74960]: </disk>
Nov 03 13:04:06 user nova-compute[74960]:  {{(pid=74960) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 13:04:06 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-72259f0b-657a-4b9e-b4bf-1703d5667b9f tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Successfully detached device vdb from instance 719e66bb-99ac-4e98-bf1c-182bf640c28d from the persistent domain config.
Nov 03 13:04:06 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-72259f0b-657a-4b9e-b4bf-1703d5667b9f tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 719e66bb-99ac-4e98-bf1c-182bf640c28d from the live domain config. {{(pid=74960) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 03 13:04:06 user nova-compute[74960]: DEBUG nova.virt.libvirt.guest [None req-72259f0b-657a-4b9e-b4bf-1703d5667b9f tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 13:04:06 user nova-compute[74960]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 13:04:06 user nova-compute[74960]:   <source dev="/dev/sdc"/>
Nov 03 13:04:06 user nova-compute[74960]:   <target dev="vdb" bus="virtio"/>
Nov 03 13:04:06 user nova-compute[74960]:   <serial>477e1c52-6508-4d09-937d-6383b642ec9a</serial>
Nov 03 13:04:06 user nova-compute[74960]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 13:04:06 user nova-compute[74960]: </disk>
Nov 03 13:04:06 user nova-compute[74960]:  {{(pid=74960) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 13:04:06 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:04:06 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-72259f0b-657a-4b9e-b4bf-1703d5667b9f tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 719e66bb-99ac-4e98-bf1c-182bf640c28d {{(pid=74960) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 03 13:04:11 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:04:11 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:04:11 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74960) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 13:04:11 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74960) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 13:04:11 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74960) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 13:04:11 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:04:12 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._sync_power_states {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:04:12 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Triggering sync for uuid 719e66bb-99ac-4e98-bf1c-182bf640c28d {{(pid=74960) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 13:04:12 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Triggering sync for uuid 69c2803e-38e1-4962-a1e1-beb1febe48ec {{(pid=74960) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 13:04:12 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "719e66bb-99ac-4e98-bf1c-182bf640c28d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:04:12 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "69c2803e-38e1-4962-a1e1-beb1febe48ec" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:04:12 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "69c2803e-38e1-4962-a1e1-beb1febe48ec" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:04:12 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "69c2803e-38e1-4962-a1e1-beb1febe48ec" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.050s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:04:14 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:04:16 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:04:21 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:04:21 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:04:22 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:04:22 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:04:22 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:04:22 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:04:22 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Auditing locally available compute resources for user (node: user) {{(pid=74960) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 13:04:22 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74960) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 13:04:22 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/719e66bb-99ac-4e98-bf1c-182bf640c28d/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:04:22 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/719e66bb-99ac-4e98-bf1c-182bf640c28d/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:04:22 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/719e66bb-99ac-4e98-bf1c-182bf640c28d/disk --force-share --output=json {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:04:22 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/719e66bb-99ac-4e98-bf1c-182bf640c28d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:04:23 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:04:23 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:04:23 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Hypervisor/Node resource view: name=user free_ram=8899MB free_disk=24.940914154052734GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74960) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 13:04:23 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:04:23 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:04:23 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 719e66bb-99ac-4e98-bf1c-182bf640c28d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:04:23 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 69c2803e-38e1-4962-a1e1-beb1febe48ec actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:04:23 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74960) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 13:04:23 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74960) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 13:04:23 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Refreshing inventories for resource provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 03 13:04:23 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Updating ProviderTree inventory for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 03 13:04:23 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Updating inventory in ProviderTree for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 03 13:04:23 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Refreshing aggregate associations for resource provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0, aggregates: None {{(pid=74960) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 03 13:04:23 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Refreshing trait associations for resource provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0, traits: COMPUTE_NODE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE41,HW_CPU_X86_SSSE3,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_DEVICE_TAGGING,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_QXL {{(pid=74960) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 03 13:04:23 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 13:04:23 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 13:04:23 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Compute_service record updated for user:user {{(pid=74960) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 13:04:23 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.340s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:04:25 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:04:25 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:04:26 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:04:26 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:04:26 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:04:26 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74960) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 13:04:26 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74960) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 13:04:26 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74960) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 13:04:26 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:04:26 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-72259f0b-657a-4b9e-b4bf-1703d5667b9f tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 719e66bb-99ac-4e98-bf1c-182bf640c28d is timed out.
Nov 03 13:04:26 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-72259f0b-657a-4b9e-b4bf-1703d5667b9f tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Successfully detached device vdb from instance 719e66bb-99ac-4e98-bf1c-182bf640c28d from the live domain config.
Nov 03 13:04:26 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72259f0b-657a-4b9e-b4bf-1703d5667b9f tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 719e66bb-99ac-4e98-bf1c-182bf640c28d] calling os-brick to detach iSCSI Volume {{(pid=74960) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 13:04:26 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-72259f0b-657a-4b9e-b4bf-1703d5667b9f tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9aa420acb0>, {'target_iqn': 'iqn.2010-10.org.openstack:477e1c52-6508-4d09-937d-6383b642ec9a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bUhaKByG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 13:04:26 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-72259f0b-657a-4b9e-b4bf-1703d5667b9f tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 13:04:26 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-72259f0b-657a-4b9e-b4bf-1703d5667b9f tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 13:04:26 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-72259f0b-657a-4b9e-b4bf-1703d5667b9f tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 13:04:26 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:04:26 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:04:26 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d2058d6-d7bd-4997-a8b4-516f92499120]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:477e1c52-6508-4d09-937d-6383b642ec9a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:04:26 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-72259f0b-657a-4b9e-b4bf-1703d5667b9f tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 13:04:26 user nova-compute[74960]: No targets found.
Nov 03 13:04:26 user nova-compute[74960]: iSNS:
Nov 03 13:04:26 user nova-compute[74960]: No targets found.
Nov 03 13:04:26 user nova-compute[74960]: STATIC:
Nov 03 13:04:26 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4
Nov 03 13:04:26 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 13:04:26 user nova-compute[74960]:                 Iface Name: default
Nov 03 13:04:26 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:477e1c52-6508-4d09-937d-6383b642ec9a
Nov 03 13:04:26 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 13:04:26 user nova-compute[74960]:                 Iface Name: default
Nov 03 13:04:26 user nova-compute[74960]: FIRMWARE:
Nov 03 13:04:26 user nova-compute[74960]: No targets found.
Nov 03 13:04:26 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 13:04:26 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-72259f0b-657a-4b9e-b4bf-1703d5667b9f tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 13:04:26 user nova-compute[74960]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 13:04:26 user nova-compute[74960]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74960) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 13:04:26 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-72259f0b-657a-4b9e-b4bf-1703d5667b9f tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:477e1c52-6508-4d09-937d-6383b642ec9a', 0)] {{(pid=74960) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 13:04:26 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:04:26 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:04:26 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3c8b030-e2c3-4be2-9f8d-9eb817ee5cbb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:477e1c52-6508-4d09-937d-6383b642ec9a\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:04:26 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:04:26 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:04:26 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[d99f0a24-591b-4759-a6a2-69512d5f8099]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:477e1c52-6508-4d09-937d-6383b642ec9a (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:04:26 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-72259f0b-657a-4b9e-b4bf-1703d5667b9f tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4 (non-flash)
Nov 03 13:04:26 user nova-compute[74960]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:477e1c52-6508-4d09-937d-6383b642ec9a (non-flash)
Nov 03 13:04:26 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 13:04:26 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-72259f0b-657a-4b9e-b4bf-1703d5667b9f tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4 (non-flash)
Nov 03 13:04:26 user nova-compute[74960]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:477e1c52-6508-4d09-937d-6383b642ec9a (non-flash)
Nov 03 13:04:26 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 13:04:26 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-72259f0b-657a-4b9e-b4bf-1703d5667b9f tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9a8c2ca290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:477e1c52-6508-4d09-937d-6383b642ec9a'): ({'sdc'}, set())}) {{(pid=74960) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 13:04:26 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-72259f0b-657a-4b9e-b4bf-1703d5667b9f tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Removing single pathed devices sdc {{(pid=74960) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 13:04:26 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:04:26 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:04:26 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[cefa50b6-7ff3-4404-a82f-0d019c52b560]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:04:26 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:04:26 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:04:26 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[9524ac8b-5265-49e7-ac11-9212476a7c27]: (4, ('ok\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:04:26 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-72259f0b-657a-4b9e-b4bf-1703d5667b9f tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Flushing IO for device /dev/sdc {{(pid=74960) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 13:04:26 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:04:26 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:04:26 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[bce610b1-b89c-4dfb-a801-d2af49899873]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:04:26 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-72259f0b-657a-4b9e-b4bf-1703d5667b9f tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74960) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 13:04:26 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:04:26 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.035s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:04:26 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3d5db46-c0ad-415e-97ea-77dd83ded124]: (4, ('1', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:04:26 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-72259f0b-657a-4b9e-b4bf-1703d5667b9f tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74960) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 13:04:26 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-72259f0b-657a-4b9e-b4bf-1703d5667b9f tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] SCSI volumes sdc have been removed. {{(pid=74960) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 13:04:26 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-72259f0b-657a-4b9e-b4bf-1703d5667b9f tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:477e1c52-6508-4d09-937d-6383b642ec9a')] {{(pid=74960) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 13:04:26 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:477e1c52-6508-4d09-937d-6383b642ec9a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:04:26 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:477e1c52-6508-4d09-937d-6383b642ec9a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:04:26 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6454d04-c429-4646-a12e-b81d2a3eda56]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:04:26 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-72259f0b-657a-4b9e-b4bf-1703d5667b9f tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:04:26 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:477e1c52-6508-4d09-937d-6383b642ec9a -p 172.16.0.220:3260 --logout {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:04:26 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:477e1c52-6508-4d09-937d-6383b642ec9a -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:04:26 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb9f9e06-3d17-410d-b9d2-2fec9fca374e]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:477e1c52-6508-4d09-937d-6383b642ec9a, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:477e1c52-6508-4d09-937d-6383b642ec9a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:04:26 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-72259f0b-657a-4b9e-b4bf-1703d5667b9f tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:477e1c52-6508-4d09-937d-6383b642ec9a, portal: 172.16.0.220,3260]
Nov 03 13:04:26 user nova-compute[74960]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:477e1c52-6508-4d09-937d-6383b642ec9a, portal: 172.16.0.220,3260] successful.
Nov 03 13:04:26 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:04:26 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:477e1c52-6508-4d09-937d-6383b642ec9a -p 172.16.0.220:3260 --op delete {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:04:26 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:477e1c52-6508-4d09-937d-6383b642ec9a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.196s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:04:26 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[7338aa6e-7fea-4877-bafa-daddbad23eed]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:04:26 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-72259f0b-657a-4b9e-b4bf-1703d5667b9f tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:04:26 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-72259f0b-657a-4b9e-b4bf-1703d5667b9f tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.465s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 13:04:26 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-72259f0b-657a-4b9e-b4bf-1703d5667b9f tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] <== disconnect_volume: return (466ms) None {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 13:04:26 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72259f0b-657a-4b9e-b4bf-1703d5667b9f tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 719e66bb-99ac-4e98-bf1c-182bf640c28d] Disconnected iSCSI Volume {{(pid=74960) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 13:04:27 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:04:27 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:04:27 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Starting heal instance info cache {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 13:04:27 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "refresh_cache-69c2803e-38e1-4962-a1e1-beb1febe48ec" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:04:27 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquired lock "refresh_cache-69c2803e-38e1-4962-a1e1-beb1febe48ec" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:04:27 user nova-compute[74960]: DEBUG nova.network.neutron [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: 69c2803e-38e1-4962-a1e1-beb1febe48ec] Forcefully refreshing network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 13:04:27 user nova-compute[74960]: DEBUG nova.network.neutron [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: 69c2803e-38e1-4962-a1e1-beb1febe48ec] Updating instance_info_cache with network_info: [{"id": "1ee78f5d-2a2e-4840-bfec-78bb5b6745d7", "address": "fa:16:3e:59:7c:fc", "network": {"id": "8e985ab3-9852-4f07-8b5c-19f7bf113939", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781795302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d64f3d9dae8f45bcb2e0677a0076ed64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ee78f5d-2a", "ovs_interfaceid": "1ee78f5d-2a2e-4840-bfec-78bb5b6745d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:04:27 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Releasing lock "refresh_cache-69c2803e-38e1-4962-a1e1-beb1febe48ec" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 13:04:27 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: 69c2803e-38e1-4962-a1e1-beb1febe48ec] Updated the network info_cache for instance {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 13:04:27 user nova-compute[74960]: DEBUG nova.objects.instance [None req-72259f0b-657a-4b9e-b4bf-1703d5667b9f tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Lazy-loading 'flavor' on Instance uuid 719e66bb-99ac-4e98-bf1c-182bf640c28d {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:04:27 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-72259f0b-657a-4b9e-b4bf-1703d5667b9f tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Lock "719e66bb-99ac-4e98-bf1c-182bf640c28d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.023s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:04:27 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "719e66bb-99ac-4e98-bf1c-182bf640c28d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 15.139s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:04:27 user nova-compute[74960]: DEBUG nova.compute.manager [req-0af70205-5669-4541-8d42-f49f45c45123 req-64fa8dc1-86b7-44b2-b948-dd707febb8cf service nova] [instance: 69c2803e-38e1-4962-a1e1-beb1febe48ec] Received event network-changed-1ee78f5d-2a2e-4840-bfec-78bb5b6745d7 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:04:27 user nova-compute[74960]: DEBUG nova.compute.manager [req-0af70205-5669-4541-8d42-f49f45c45123 req-64fa8dc1-86b7-44b2-b948-dd707febb8cf service nova] [instance: 69c2803e-38e1-4962-a1e1-beb1febe48ec] Refreshing instance network info cache due to event network-changed-1ee78f5d-2a2e-4840-bfec-78bb5b6745d7. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 13:04:27 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-0af70205-5669-4541-8d42-f49f45c45123 req-64fa8dc1-86b7-44b2-b948-dd707febb8cf service nova] Acquiring lock "refresh_cache-69c2803e-38e1-4962-a1e1-beb1febe48ec" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:04:27 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-0af70205-5669-4541-8d42-f49f45c45123 req-64fa8dc1-86b7-44b2-b948-dd707febb8cf service nova] Acquired lock "refresh_cache-69c2803e-38e1-4962-a1e1-beb1febe48ec" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:04:27 user nova-compute[74960]: DEBUG nova.network.neutron [req-0af70205-5669-4541-8d42-f49f45c45123 req-64fa8dc1-86b7-44b2-b948-dd707febb8cf service nova] [instance: 69c2803e-38e1-4962-a1e1-beb1febe48ec] Refreshing network info cache for port 1ee78f5d-2a2e-4840-bfec-78bb5b6745d7 {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 13:04:28 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "719e66bb-99ac-4e98-bf1c-182bf640c28d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.032s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:04:28 user nova-compute[74960]: DEBUG nova.network.neutron [req-0af70205-5669-4541-8d42-f49f45c45123 req-64fa8dc1-86b7-44b2-b948-dd707febb8cf service nova] [instance: 69c2803e-38e1-4962-a1e1-beb1febe48ec] Updated VIF entry in instance network info cache for port 1ee78f5d-2a2e-4840-bfec-78bb5b6745d7. {{(pid=74960) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 13:04:28 user nova-compute[74960]: DEBUG nova.network.neutron [req-0af70205-5669-4541-8d42-f49f45c45123 req-64fa8dc1-86b7-44b2-b948-dd707febb8cf service nova] [instance: 69c2803e-38e1-4962-a1e1-beb1febe48ec] Updating instance_info_cache with network_info: [{"id": "1ee78f5d-2a2e-4840-bfec-78bb5b6745d7", "address": "fa:16:3e:59:7c:fc", "network": {"id": "8e985ab3-9852-4f07-8b5c-19f7bf113939", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781795302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d64f3d9dae8f45bcb2e0677a0076ed64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ee78f5d-2a", "ovs_interfaceid": "1ee78f5d-2a2e-4840-bfec-78bb5b6745d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:04:28 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:04:28 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:04:28 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74960) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 13:04:28 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-0af70205-5669-4541-8d42-f49f45c45123 req-64fa8dc1-86b7-44b2-b948-dd707febb8cf service nova] Releasing lock "refresh_cache-69c2803e-38e1-4962-a1e1-beb1febe48ec" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 13:04:29 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:04:31 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:04:34 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:04:36 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:04:39 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:04:41 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:04:44 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:04:46 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:04:47 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-4822598c-7278-44aa-9b9c-f1b695405998 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Acquiring lock "33383e72-2704-46b7-8f2d-92acc3a62eba" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:04:47 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-4822598c-7278-44aa-9b9c-f1b695405998 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lock "33383e72-2704-46b7-8f2d-92acc3a62eba" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:04:47 user nova-compute[74960]: DEBUG nova.compute.manager [None req-4822598c-7278-44aa-9b9c-f1b695405998 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 33383e72-2704-46b7-8f2d-92acc3a62eba] Starting instance... {{(pid=74960) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 13:04:47 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-4822598c-7278-44aa-9b9c-f1b695405998 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:04:47 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-4822598c-7278-44aa-9b9c-f1b695405998 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:04:47 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-4822598c-7278-44aa-9b9c-f1b695405998 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74960) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 13:04:47 user nova-compute[74960]: INFO nova.compute.claims [None req-4822598c-7278-44aa-9b9c-f1b695405998 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 33383e72-2704-46b7-8f2d-92acc3a62eba] Claim successful on node user
Nov 03 13:04:48 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-4822598c-7278-44aa-9b9c-f1b695405998 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 13:04:48 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-4822598c-7278-44aa-9b9c-f1b695405998 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 13:04:48 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-4822598c-7278-44aa-9b9c-f1b695405998 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.222s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:04:48 user nova-compute[74960]: DEBUG nova.compute.manager [None req-4822598c-7278-44aa-9b9c-f1b695405998 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 33383e72-2704-46b7-8f2d-92acc3a62eba] Start building networks asynchronously for instance. {{(pid=74960) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 13:04:48 user nova-compute[74960]: DEBUG nova.compute.manager [None req-4822598c-7278-44aa-9b9c-f1b695405998 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 33383e72-2704-46b7-8f2d-92acc3a62eba] Allocating IP information in the background. {{(pid=74960) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 13:04:48 user nova-compute[74960]: DEBUG nova.network.neutron [None req-4822598c-7278-44aa-9b9c-f1b695405998 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 33383e72-2704-46b7-8f2d-92acc3a62eba] allocate_for_instance() {{(pid=74960) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 13:04:48 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-4822598c-7278-44aa-9b9c-f1b695405998 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 33383e72-2704-46b7-8f2d-92acc3a62eba] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 13:04:48 user nova-compute[74960]: DEBUG nova.compute.manager [None req-4822598c-7278-44aa-9b9c-f1b695405998 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 33383e72-2704-46b7-8f2d-92acc3a62eba] Start building block device mappings for instance. {{(pid=74960) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 13:04:48 user nova-compute[74960]: INFO nova.virt.block_device [None req-4822598c-7278-44aa-9b9c-f1b695405998 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 33383e72-2704-46b7-8f2d-92acc3a62eba] Booting with volume 8f581f98-24ca-482e-b9de-7198873e1092 at /dev/vda
Nov 03 13:04:48 user nova-compute[74960]: DEBUG nova.policy [None req-4822598c-7278-44aa-9b9c-f1b695405998 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '067a3f33438b4112b818b91ecb4dd0d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd64f3d9dae8f45bcb2e0677a0076ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74960) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 13:04:48 user nova-compute[74960]: DEBUG os_brick.utils [None req-4822598c-7278-44aa-9b9c-f1b695405998 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 13:04:48 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:04:48 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:04:48 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[de69b64f-d97b-42ba-8ebe-f66601c9e47e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:75b8e219756\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:04:48 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:04:48 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:04:48 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[d84e9679-e277-4194-be0d-63ec82f24d5e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:04:48 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:04:48 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:04:48 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ed1d7cb-bdca-405c-88d4-67d873d0ca35]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:04:48 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[b52f1e9d-1866-4d0b-978a-46c79bcdf5fe]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:04:48 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-4822598c-7278-44aa-9b9c-f1b695405998 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Running cmd (subprocess): nvme version {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:04:48 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [None req-4822598c-7278-44aa-9b9c-f1b695405998 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] 'nvme version' failed. Not Retrying. {{(pid=74960) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 13:04:48 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4822598c-7278-44aa-9b9c-f1b695405998 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] nvme not present on system {{(pid=74960) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 13:04:48 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:04:48 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 13:04:48 user nova-compute[74960]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 13:04:48 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[9947b4fe-2477-45bf-a1b1-0f0cc0fef8be]: (4, '') {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:04:48 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-4822598c-7278-44aa-9b9c-f1b695405998 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74960) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 13:04:48 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-4822598c-7278-44aa-9b9c-f1b695405998 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74960) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 13:04:48 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.lightos [None req-4822598c-7278-44aa-9b9c-f1b695405998 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] LIGHTOS: no hostnqn found. {{(pid=74960) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 13:04:48 user nova-compute[74960]: DEBUG os_brick.utils [None req-4822598c-7278-44aa-9b9c-f1b695405998 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:75b8e219756', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 13:04:48 user nova-compute[74960]: DEBUG nova.virt.block_device [None req-4822598c-7278-44aa-9b9c-f1b695405998 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 33383e72-2704-46b7-8f2d-92acc3a62eba] Updating existing volume attachment record: 41a8ade6-0e9e-45f5-88df-513acf276a71 {{(pid=74960) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 13:04:49 user nova-compute[74960]: DEBUG nova.network.neutron [None req-4822598c-7278-44aa-9b9c-f1b695405998 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 33383e72-2704-46b7-8f2d-92acc3a62eba] Successfully created port: 8f74b9f4-8f5b-4b26-955b-ac07a6afdc44 {{(pid=74960) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 13:04:49 user nova-compute[74960]: DEBUG nova.network.neutron [None req-4822598c-7278-44aa-9b9c-f1b695405998 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 33383e72-2704-46b7-8f2d-92acc3a62eba] Successfully updated port: 8f74b9f4-8f5b-4b26-955b-ac07a6afdc44 {{(pid=74960) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 13:04:49 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-4822598c-7278-44aa-9b9c-f1b695405998 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Acquiring lock "refresh_cache-33383e72-2704-46b7-8f2d-92acc3a62eba" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:04:49 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-4822598c-7278-44aa-9b9c-f1b695405998 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Acquired lock "refresh_cache-33383e72-2704-46b7-8f2d-92acc3a62eba" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:04:49 user nova-compute[74960]: DEBUG nova.network.neutron [None req-4822598c-7278-44aa-9b9c-f1b695405998 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 33383e72-2704-46b7-8f2d-92acc3a62eba] Building network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 13:04:49 user nova-compute[74960]: DEBUG nova.network.neutron [None req-4822598c-7278-44aa-9b9c-f1b695405998 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 33383e72-2704-46b7-8f2d-92acc3a62eba] Instance cache missing network info. {{(pid=74960) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 13:04:49 user nova-compute[74960]: DEBUG nova.compute.manager [req-d329f7f3-98b1-40a6-b76a-d52205621ecc req-9a5f473d-25e6-4469-b043-1a971dce2afa service nova] [instance: 33383e72-2704-46b7-8f2d-92acc3a62eba] Received event network-changed-8f74b9f4-8f5b-4b26-955b-ac07a6afdc44 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:04:49 user nova-compute[74960]: DEBUG nova.compute.manager [req-d329f7f3-98b1-40a6-b76a-d52205621ecc req-9a5f473d-25e6-4469-b043-1a971dce2afa service nova] [instance: 33383e72-2704-46b7-8f2d-92acc3a62eba] Refreshing instance network info cache due to event network-changed-8f74b9f4-8f5b-4b26-955b-ac07a6afdc44. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 13:04:49 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-d329f7f3-98b1-40a6-b76a-d52205621ecc req-9a5f473d-25e6-4469-b043-1a971dce2afa service nova] Acquiring lock "refresh_cache-33383e72-2704-46b7-8f2d-92acc3a62eba" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:04:49 user nova-compute[74960]: DEBUG nova.network.neutron [None req-4822598c-7278-44aa-9b9c-f1b695405998 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 33383e72-2704-46b7-8f2d-92acc3a62eba] Updating instance_info_cache with network_info: [{"id": "8f74b9f4-8f5b-4b26-955b-ac07a6afdc44", "address": "fa:16:3e:57:0e:23", "network": {"id": "8e985ab3-9852-4f07-8b5c-19f7bf113939", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781795302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d64f3d9dae8f45bcb2e0677a0076ed64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f74b9f4-8f", "ovs_interfaceid": "8f74b9f4-8f5b-4b26-955b-ac07a6afdc44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:04:49 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-4822598c-7278-44aa-9b9c-f1b695405998 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Releasing lock "refresh_cache-33383e72-2704-46b7-8f2d-92acc3a62eba" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 13:04:49 user nova-compute[74960]: DEBUG nova.compute.manager [None req-4822598c-7278-44aa-9b9c-f1b695405998 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 33383e72-2704-46b7-8f2d-92acc3a62eba] Instance network_info: |[{"id": "8f74b9f4-8f5b-4b26-955b-ac07a6afdc44", "address": "fa:16:3e:57:0e:23", "network": {"id": "8e985ab3-9852-4f07-8b5c-19f7bf113939", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781795302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d64f3d9dae8f45bcb2e0677a0076ed64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f74b9f4-8f", "ovs_interfaceid": "8f74b9f4-8f5b-4b26-955b-ac07a6afdc44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74960) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 13:04:49 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-d329f7f3-98b1-40a6-b76a-d52205621ecc req-9a5f473d-25e6-4469-b043-1a971dce2afa service nova] Acquired lock "refresh_cache-33383e72-2704-46b7-8f2d-92acc3a62eba" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:04:49 user nova-compute[74960]: DEBUG nova.network.neutron [req-d329f7f3-98b1-40a6-b76a-d52205621ecc req-9a5f473d-25e6-4469-b043-1a971dce2afa service nova] [instance: 33383e72-2704-46b7-8f2d-92acc3a62eba] Refreshing network info cache for port 8f74b9f4-8f5b-4b26-955b-ac07a6afdc44 {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 13:04:50 user nova-compute[74960]: DEBUG nova.network.neutron [req-d329f7f3-98b1-40a6-b76a-d52205621ecc req-9a5f473d-25e6-4469-b043-1a971dce2afa service nova] [instance: 33383e72-2704-46b7-8f2d-92acc3a62eba] Updated VIF entry in instance network info cache for port 8f74b9f4-8f5b-4b26-955b-ac07a6afdc44. {{(pid=74960) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 13:04:50 user nova-compute[74960]: DEBUG nova.network.neutron [req-d329f7f3-98b1-40a6-b76a-d52205621ecc req-9a5f473d-25e6-4469-b043-1a971dce2afa service nova] [instance: 33383e72-2704-46b7-8f2d-92acc3a62eba] Updating instance_info_cache with network_info: [{"id": "8f74b9f4-8f5b-4b26-955b-ac07a6afdc44", "address": "fa:16:3e:57:0e:23", "network": {"id": "8e985ab3-9852-4f07-8b5c-19f7bf113939", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781795302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d64f3d9dae8f45bcb2e0677a0076ed64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f74b9f4-8f", "ovs_interfaceid": "8f74b9f4-8f5b-4b26-955b-ac07a6afdc44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:04:50 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-d329f7f3-98b1-40a6-b76a-d52205621ecc req-9a5f473d-25e6-4469-b043-1a971dce2afa service nova] Releasing lock "refresh_cache-33383e72-2704-46b7-8f2d-92acc3a62eba" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 13:04:51 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:04:51 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:04:51 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74960) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 13:04:51 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74960) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 13:04:51 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74960) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 13:04:51 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:04:56 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-ed42176b-6460-4915-929a-72cc9e661a64 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Acquiring lock "719e66bb-99ac-4e98-bf1c-182bf640c28d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:04:56 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-ed42176b-6460-4915-929a-72cc9e661a64 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Lock "719e66bb-99ac-4e98-bf1c-182bf640c28d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:04:56 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-ed42176b-6460-4915-929a-72cc9e661a64 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Acquiring lock "719e66bb-99ac-4e98-bf1c-182bf640c28d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:04:56 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-ed42176b-6460-4915-929a-72cc9e661a64 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Lock "719e66bb-99ac-4e98-bf1c-182bf640c28d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:04:56 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-ed42176b-6460-4915-929a-72cc9e661a64 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Lock "719e66bb-99ac-4e98-bf1c-182bf640c28d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:04:56 user nova-compute[74960]: INFO nova.compute.manager [None req-ed42176b-6460-4915-929a-72cc9e661a64 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 719e66bb-99ac-4e98-bf1c-182bf640c28d] Terminating instance
Nov 03 13:04:56 user nova-compute[74960]: DEBUG nova.compute.manager [None req-ed42176b-6460-4915-929a-72cc9e661a64 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 719e66bb-99ac-4e98-bf1c-182bf640c28d] Start destroying the instance on the hypervisor. {{(pid=74960) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 13:04:56 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:04:56 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:04:56 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:04:56 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:04:56 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:04:56 user nova-compute[74960]: DEBUG nova.compute.manager [req-c7251ef2-33d3-430e-8928-559faadb8039 req-21293301-3cf4-488a-bfc6-7821110fef00 service nova] [instance: 719e66bb-99ac-4e98-bf1c-182bf640c28d] Received event network-vif-unplugged-18d94345-48c9-4540-8053-a26390fb823b {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:04:56 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-c7251ef2-33d3-430e-8928-559faadb8039 req-21293301-3cf4-488a-bfc6-7821110fef00 service nova] Acquiring lock "719e66bb-99ac-4e98-bf1c-182bf640c28d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:04:56 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-c7251ef2-33d3-430e-8928-559faadb8039 req-21293301-3cf4-488a-bfc6-7821110fef00 service nova] Lock "719e66bb-99ac-4e98-bf1c-182bf640c28d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:04:56 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-c7251ef2-33d3-430e-8928-559faadb8039 req-21293301-3cf4-488a-bfc6-7821110fef00 service nova] Lock "719e66bb-99ac-4e98-bf1c-182bf640c28d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:04:56 user nova-compute[74960]: DEBUG nova.compute.manager [req-c7251ef2-33d3-430e-8928-559faadb8039 req-21293301-3cf4-488a-bfc6-7821110fef00 service nova] [instance: 719e66bb-99ac-4e98-bf1c-182bf640c28d] No waiting events found dispatching network-vif-unplugged-18d94345-48c9-4540-8053-a26390fb823b {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:04:56 user nova-compute[74960]: DEBUG nova.compute.manager [req-c7251ef2-33d3-430e-8928-559faadb8039 req-21293301-3cf4-488a-bfc6-7821110fef00 service nova] [instance: 719e66bb-99ac-4e98-bf1c-182bf640c28d] Received event network-vif-unplugged-18d94345-48c9-4540-8053-a26390fb823b for instance with task_state deleting. {{(pid=74960) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 13:04:57 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: 719e66bb-99ac-4e98-bf1c-182bf640c28d] Instance destroyed successfully.
Nov 03 13:04:57 user nova-compute[74960]: DEBUG nova.objects.instance [None req-ed42176b-6460-4915-929a-72cc9e661a64 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Lazy-loading 'resources' on Instance uuid 719e66bb-99ac-4e98-bf1c-182bf640c28d {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:04:57 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-ed42176b-6460-4915-929a-72cc9e661a64 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T13:01:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-805476514',display_name='tempest-AttachVolumeNegativeTest-server-805476514',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-805476514',id=50,image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN063e5yabxy55T87pgOsS6KJBpPIu++Rm5GqiQBhGCLkvnPKHKO2tcU3SNED8ka6m1byD6pM5od2m6jNpFXV54fxDJyISZ/P3ZZT0ioM0mliy6j4+mfAOdyg6iq6FlVDQ==',key_name='tempest-keypair-169734245',keypairs=<?>,launch_index=0,launched_at=2023-11-03T13:01:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='255349fa349045ad8a554d3f818cdd2e',ramdisk_id='',reservation_id='r-6fki4di8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549f51ba-ac69-494b-8de1-34635aa2d7cf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-787890049',owner_user_name='tempest-AttachVolumeNegativeTest-787890049-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T13:01:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c934e7c00ddd450087f904666473c0b4',uuid=719e66bb-99ac-4e98-bf1c-182bf640c28d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "18d94345-48c9-4540-8053-a26390fb823b", "address": "fa:16:3e:97:86:d5", "network": {"id": "c50fc382-c1b9-49d8-8e38-ac681cbbcffd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1465428328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "255349fa349045ad8a554d3f818cdd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18d94345-48", "ovs_interfaceid": "18d94345-48c9-4540-8053-a26390fb823b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 13:04:57 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-ed42176b-6460-4915-929a-72cc9e661a64 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Converting VIF {"id": "18d94345-48c9-4540-8053-a26390fb823b", "address": "fa:16:3e:97:86:d5", "network": {"id": "c50fc382-c1b9-49d8-8e38-ac681cbbcffd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1465428328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "255349fa349045ad8a554d3f818cdd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18d94345-48", "ovs_interfaceid": "18d94345-48c9-4540-8053-a26390fb823b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 13:04:57 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-ed42176b-6460-4915-929a-72cc9e661a64 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:97:86:d5,bridge_name='br-int',has_traffic_filtering=True,id=18d94345-48c9-4540-8053-a26390fb823b,network=Network(c50fc382-c1b9-49d8-8e38-ac681cbbcffd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18d94345-48') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 13:04:57 user nova-compute[74960]: DEBUG os_vif [None req-ed42176b-6460-4915-929a-72cc9e661a64 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:86:d5,bridge_name='br-int',has_traffic_filtering=True,id=18d94345-48c9-4540-8053-a26390fb823b,network=Network(c50fc382-c1b9-49d8-8e38-ac681cbbcffd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18d94345-48') {{(pid=74960) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 13:04:57 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:04:57 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap18d94345-48, bridge=br-int, if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:04:57 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:04:57 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:04:57 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2fc291a0-f192-40c0-8eaf-01d3189e7391) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:04:57 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:04:57 user nova-compute[74960]: INFO os_vif [None req-ed42176b-6460-4915-929a-72cc9e661a64 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:86:d5,bridge_name='br-int',has_traffic_filtering=True,id=18d94345-48c9-4540-8053-a26390fb823b,network=Network(c50fc382-c1b9-49d8-8e38-ac681cbbcffd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18d94345-48')
Nov 03 13:04:57 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-ed42176b-6460-4915-929a-72cc9e661a64 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 719e66bb-99ac-4e98-bf1c-182bf640c28d] Deleting instance files /opt/stack/data/nova/instances/719e66bb-99ac-4e98-bf1c-182bf640c28d_del
Nov 03 13:04:57 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-ed42176b-6460-4915-929a-72cc9e661a64 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 719e66bb-99ac-4e98-bf1c-182bf640c28d] Deletion of /opt/stack/data/nova/instances/719e66bb-99ac-4e98-bf1c-182bf640c28d_del complete
Nov 03 13:04:57 user nova-compute[74960]: INFO nova.compute.manager [None req-ed42176b-6460-4915-929a-72cc9e661a64 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] [instance: 719e66bb-99ac-4e98-bf1c-182bf640c28d] Took 0.83 seconds to destroy the instance on the hypervisor.
Nov 03 13:04:57 user nova-compute[74960]: DEBUG oslo.service.loopingcall [None req-ed42176b-6460-4915-929a-72cc9e661a64 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74960) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 13:04:57 user nova-compute[74960]: DEBUG nova.compute.manager [-] [instance: 719e66bb-99ac-4e98-bf1c-182bf640c28d] Deallocating network for instance {{(pid=74960) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 13:04:57 user nova-compute[74960]: DEBUG nova.network.neutron [-] [instance: 719e66bb-99ac-4e98-bf1c-182bf640c28d] deallocate_for_instance() {{(pid=74960) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 13:04:57 user nova-compute[74960]: DEBUG nova.network.neutron [-] [instance: 719e66bb-99ac-4e98-bf1c-182bf640c28d] Updating instance_info_cache with network_info: [] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:04:57 user nova-compute[74960]: INFO nova.compute.manager [-] [instance: 719e66bb-99ac-4e98-bf1c-182bf640c28d] Took 0.82 seconds to deallocate network for instance.
Nov 03 13:04:57 user nova-compute[74960]: DEBUG nova.compute.manager [req-c333bd3c-5329-43ed-bdb5-25bca36f2ee5 req-cff9d947-25c2-487d-b78b-8daf060ca876 service nova] [instance: 719e66bb-99ac-4e98-bf1c-182bf640c28d] Received event network-vif-deleted-18d94345-48c9-4540-8053-a26390fb823b {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:04:58 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-ed42176b-6460-4915-929a-72cc9e661a64 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:04:58 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-ed42176b-6460-4915-929a-72cc9e661a64 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:04:58 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-ed42176b-6460-4915-929a-72cc9e661a64 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 13:04:58 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-ed42176b-6460-4915-929a-72cc9e661a64 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 13:04:58 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-ed42176b-6460-4915-929a-72cc9e661a64 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.161s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:04:58 user nova-compute[74960]: INFO nova.scheduler.client.report [None req-ed42176b-6460-4915-929a-72cc9e661a64 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Deleted allocations for instance 719e66bb-99ac-4e98-bf1c-182bf640c28d
Nov 03 13:04:58 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-ed42176b-6460-4915-929a-72cc9e661a64 tempest-AttachVolumeNegativeTest-787890049 tempest-AttachVolumeNegativeTest-787890049-project-member] Lock "719e66bb-99ac-4e98-bf1c-182bf640c28d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.994s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:04:58 user nova-compute[74960]: DEBUG nova.compute.manager [req-a64ff4a6-7da6-4bfd-80e5-12ec1341c0b0 req-e958d7eb-f98d-43d0-9119-0aa7c2d4b9b8 service nova] [instance: 719e66bb-99ac-4e98-bf1c-182bf640c28d] Received event network-vif-plugged-18d94345-48c9-4540-8053-a26390fb823b {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:04:58 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-a64ff4a6-7da6-4bfd-80e5-12ec1341c0b0 req-e958d7eb-f98d-43d0-9119-0aa7c2d4b9b8 service nova] Acquiring lock "719e66bb-99ac-4e98-bf1c-182bf640c28d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:04:58 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-a64ff4a6-7da6-4bfd-80e5-12ec1341c0b0 req-e958d7eb-f98d-43d0-9119-0aa7c2d4b9b8 service nova] Lock "719e66bb-99ac-4e98-bf1c-182bf640c28d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:04:58 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-a64ff4a6-7da6-4bfd-80e5-12ec1341c0b0 req-e958d7eb-f98d-43d0-9119-0aa7c2d4b9b8 service nova] Lock "719e66bb-99ac-4e98-bf1c-182bf640c28d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:04:58 user nova-compute[74960]: DEBUG nova.compute.manager [req-a64ff4a6-7da6-4bfd-80e5-12ec1341c0b0 req-e958d7eb-f98d-43d0-9119-0aa7c2d4b9b8 service nova] [instance: 719e66bb-99ac-4e98-bf1c-182bf640c28d] No waiting events found dispatching network-vif-plugged-18d94345-48c9-4540-8053-a26390fb823b {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:04:58 user nova-compute[74960]: WARNING nova.compute.manager [req-a64ff4a6-7da6-4bfd-80e5-12ec1341c0b0 req-e958d7eb-f98d-43d0-9119-0aa7c2d4b9b8 service nova] [instance: 719e66bb-99ac-4e98-bf1c-182bf640c28d] Received unexpected event network-vif-plugged-18d94345-48c9-4540-8053-a26390fb823b for instance with vm_state deleted and task_state None.
Nov 03 13:04:59 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:05:02 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:05:07 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:05:07 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:05:07 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74960) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 13:05:07 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74960) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 13:05:07 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74960) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 13:05:07 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:05:08 user nova-compute[74960]: DEBUG nova.compute.manager [None req-4822598c-7278-44aa-9b9c-f1b695405998 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 33383e72-2704-46b7-8f2d-92acc3a62eba] Start spawning the instance on the hypervisor. {{(pid=74960) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 13:05:08 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-4822598c-7278-44aa-9b9c-f1b695405998 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 33383e72-2704-46b7-8f2d-92acc3a62eba] Creating instance directory {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 13:05:08 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-4822598c-7278-44aa-9b9c-f1b695405998 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 33383e72-2704-46b7-8f2d-92acc3a62eba] Creating image(s)
Nov 03 13:05:08 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-4822598c-7278-44aa-9b9c-f1b695405998 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 33383e72-2704-46b7-8f2d-92acc3a62eba] Did not create local disks {{(pid=74960) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 03 13:05:08 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-4822598c-7278-44aa-9b9c-f1b695405998 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 33383e72-2704-46b7-8f2d-92acc3a62eba] Ensure instance console log exists: /opt/stack/data/nova/instances/33383e72-2704-46b7-8f2d-92acc3a62eba/console.log {{(pid=74960) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 13:05:08 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-4822598c-7278-44aa-9b9c-f1b695405998 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:05:08 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-4822598c-7278-44aa-9b9c-f1b695405998 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:05:08 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-4822598c-7278-44aa-9b9c-f1b695405998 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:05:08 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-4822598c-7278-44aa-9b9c-f1b695405998 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 33383e72-2704-46b7-8f2d-92acc3a62eba] Start _get_guest_xml network_info=[{"id": "8f74b9f4-8f5b-4b26-955b-ac07a6afdc44", "address": "fa:16:3e:57:0e:23", "network": {"id": "8e985ab3-9852-4f07-8b5c-19f7bf113939", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781795302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d64f3d9dae8f45bcb2e0677a0076ed64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f74b9f4-8f", "ovs_interfaceid": "8f74b9f4-8f5b-4b26-955b-ac07a6afdc44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8f581f98-24ca-482e-b9de-7198873e1092', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JnEDpXuG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '33383e72-2704-46b7-8f2d-92acc3a62eba', 'attached_at': '', 'detached_at': '', 'volume_id': '8f581f98-24ca-482e-b9de-7198873e1092', 'serial': '8f581f98-24ca-482e-b9de-7198873e1092'}, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'device_type': 'disk', 'attachment_id': '41a8ade6-0e9e-45f5-88df-513acf276a71', 'boot_index': 0, 'guest_format': None, 'volume_type': None} {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 13:05:08 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-4822598c-7278-44aa-9b9c-f1b695405998 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:05:08 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-4822598c-7278-44aa-9b9c-f1b695405998 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:05:08 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-4822598c-7278-44aa-9b9c-f1b695405998 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 13:05:08 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-4822598c-7278-44aa-9b9c-f1b695405998 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] CPU controller missing on host. {{(pid=74960) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 13:05:08 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-4822598c-7278-44aa-9b9c-f1b695405998 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 13:05:08 user nova-compute[74960]: DEBUG nova.virt.libvirt.host [None req-4822598c-7278-44aa-9b9c-f1b695405998 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] CPU controller found on host. {{(pid=74960) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 13:05:08 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-4822598c-7278-44aa-9b9c-f1b695405998 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74960) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 13:05:08 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-4822598c-7278-44aa-9b9c-f1b695405998 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 13:05:08 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-4822598c-7278-44aa-9b9c-f1b695405998 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Flavor limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 13:05:08 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-4822598c-7278-44aa-9b9c-f1b695405998 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Image limits 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 13:05:08 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-4822598c-7278-44aa-9b9c-f1b695405998 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Flavor pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 13:05:08 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-4822598c-7278-44aa-9b9c-f1b695405998 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Image pref 0:0:0 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 13:05:08 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-4822598c-7278-44aa-9b9c-f1b695405998 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 13:05:08 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-4822598c-7278-44aa-9b9c-f1b695405998 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 13:05:08 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-4822598c-7278-44aa-9b9c-f1b695405998 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 13:05:08 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-4822598c-7278-44aa-9b9c-f1b695405998 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Got 1 possible topologies {{(pid=74960) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 13:05:08 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-4822598c-7278-44aa-9b9c-f1b695405998 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 13:05:08 user nova-compute[74960]: DEBUG nova.virt.hardware [None req-4822598c-7278-44aa-9b9c-f1b695405998 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74960) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 13:05:08 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4822598c-7278-44aa-9b9c-f1b695405998 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 33383e72-2704-46b7-8f2d-92acc3a62eba] Calling os-brick to attach iSCSI Volume {{(pid=74960) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 13:05:08 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-4822598c-7278-44aa-9b9c-f1b695405998 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9aa420acb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8f581f98-24ca-482e-b9de-7198873e1092', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JnEDpXuG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 13:05:08 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-4822598c-7278-44aa-9b9c-f1b695405998 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 13:05:08 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-4822598c-7278-44aa-9b9c-f1b695405998 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 13:05:08 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-4822598c-7278-44aa-9b9c-f1b695405998 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 13:05:08 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-4822598c-7278-44aa-9b9c-f1b695405998 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 13:05:08 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-4822598c-7278-44aa-9b9c-f1b695405998 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f581f98-24ca-482e-b9de-7198873e1092" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 13:05:08 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-4822598c-7278-44aa-9b9c-f1b695405998 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f581f98-24ca-482e-b9de-7198873e1092" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 13:05:08 user nova-compute[74960]: INFO os_brick.initiator.connectors.iscsi [None req-4822598c-7278-44aa-9b9c-f1b695405998 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 13:05:08 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f581f98-24ca-482e-b9de-7198873e1092 -p 172.16.0.220:3260 {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:05:08 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f581f98-24ca-482e-b9de-7198873e1092 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:05:08 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[b87eb33d-08fb-4677-b391-79b287f7d74e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:05:08 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-4822598c-7278-44aa-9b9c-f1b695405998 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 13:05:08 user nova-compute[74960]:  {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:05:08 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f581f98-24ca-482e-b9de-7198873e1092 -p 172.16.0.220:3260 --interface default --op new {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:05:08 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f581f98-24ca-482e-b9de-7198873e1092 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:05:08 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[457165e9-370c-440e-b563-23c7a4c77e89]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8f581f98-24ca-482e-b9de-7198873e1092] added\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:05:08 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-4822598c-7278-44aa-9b9c-f1b695405998 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8f581f98-24ca-482e-b9de-7198873e1092] added
Nov 03 13:05:08 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:05:08 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f581f98-24ca-482e-b9de-7198873e1092 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:05:08 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f581f98-24ca-482e-b9de-7198873e1092 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:05:08 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bd6f3d4-e11c-4869-90cb-06a38c3752f3]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:05:08 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-4822598c-7278-44aa-9b9c-f1b695405998 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:05:08 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f581f98-24ca-482e-b9de-7198873e1092 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:05:08 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f581f98-24ca-482e-b9de-7198873e1092 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:05:08 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dcd05a2-38de-4ed2-8fb2-12b90113be4b]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:05:08 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-4822598c-7278-44aa-9b9c-f1b695405998 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:05:08 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f581f98-24ca-482e-b9de-7198873e1092 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JnEDpXuG {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:05:08 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f581f98-24ca-482e-b9de-7198873e1092 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JnEDpXuG" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:05:08 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c46f132-f935-4387-ae53-6bcfdd535a7a]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:05:08 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-4822598c-7278-44aa-9b9c-f1b695405998 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JnEDpXuG'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:05:08 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f581f98-24ca-482e-b9de-7198873e1092 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:05:08 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f581f98-24ca-482e-b9de-7198873e1092 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:05:08 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[755717bf-bba6-4a41-9ba7-bbcf8c8c920a]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:05:08 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-4822598c-7278-44aa-9b9c-f1b695405998 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:05:08 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:05:08 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:05:08 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed5e0c92-ce80-421f-aab2-b069c9b2e250]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4 (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:05:08 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-4822598c-7278-44aa-9b9c-f1b695405998 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4 (non-flash)
Nov 03 13:05:08 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 13:05:08 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-4822598c-7278-44aa-9b9c-f1b695405998 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4 (non-flash)
Nov 03 13:05:08 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 13:05:08 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f581f98-24ca-482e-b9de-7198873e1092 -p 172.16.0.220:3260 --login {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:05:08 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f581f98-24ca-482e-b9de-7198873e1092 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:05:08 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[11ce1072-a44b-490a-b748-7b424a0ced29]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8f581f98-24ca-482e-b9de-7198873e1092, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8f581f98-24ca-482e-b9de-7198873e1092, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:05:08 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-4822598c-7278-44aa-9b9c-f1b695405998 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8f581f98-24ca-482e-b9de-7198873e1092, portal: 172.16.0.220,3260]
Nov 03 13:05:08 user nova-compute[74960]: Login to [iface: default, target: iqn.2010-10.org.openstack:8f581f98-24ca-482e-b9de-7198873e1092, portal: 172.16.0.220,3260] successful.
Nov 03 13:05:08 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:05:08 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f581f98-24ca-482e-b9de-7198873e1092 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:05:08 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f581f98-24ca-482e-b9de-7198873e1092 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:05:08 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb53bcd8-b22d-4455-add9-9f99e6bda8a7]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:05:08 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-4822598c-7278-44aa-9b9c-f1b695405998 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:05:08 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:05:08 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:05:08 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[a81a0a57-7865-4f64-b6cf-7602175a5369]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f581f98-24ca-482e-b9de-7198873e1092 (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:05:08 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-4822598c-7278-44aa-9b9c-f1b695405998 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4 (non-flash)
Nov 03 13:05:08 user nova-compute[74960]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f581f98-24ca-482e-b9de-7198873e1092 (non-flash)
Nov 03 13:05:08 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 13:05:08 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-4822598c-7278-44aa-9b9c-f1b695405998 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4 (non-flash)
Nov 03 13:05:08 user nova-compute[74960]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f581f98-24ca-482e-b9de-7198873e1092 (non-flash)
Nov 03 13:05:08 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 13:05:08 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-4822598c-7278-44aa-9b9c-f1b695405998 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f581f98-24ca-482e-b9de-7198873e1092" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.257s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 13:05:08 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-4822598c-7278-44aa-9b9c-f1b695405998 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Connected to 172.16.0.220:3260 {{(pid=74960) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 13:05:08 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-4822598c-7278-44aa-9b9c-f1b695405998 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] HCTL ('34', '-', '-', 0) found on session 51 with lun 0 {{(pid=74960) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 13:05:08 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-4822598c-7278-44aa-9b9c-f1b695405998 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74960) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 13:05:08 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:05:08 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:05:08 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[37ebdf05-fb05-42ab-8ae9-96a6b1734008]: (4, ('- - 0', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:05:08 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-4822598c-7278-44aa-9b9c-f1b695405998 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Searching for a device in session 51 and hctl ['34', '*', '*', 0] yield: None {{(pid=74960) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 13:05:09 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-4822598c-7278-44aa-9b9c-f1b695405998 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Searching for a device in session 51 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74960) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 13:05:09 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-4822598c-7278-44aa-9b9c-f1b695405998 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:8f581f98-24ca-482e-b9de-7198873e1092', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JnEDpXuG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74960) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 13:05:09 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-4822598c-7278-44aa-9b9c-f1b695405998 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.285s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 13:05:09 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-4822598c-7278-44aa-9b9c-f1b695405998 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] <== connect_volume: return (1286ms) {'type': 'block', 'scsi_wwn': '23437363731643531', 'path': '/dev/sdc'} {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 13:05:09 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4822598c-7278-44aa-9b9c-f1b695405998 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 33383e72-2704-46b7-8f2d-92acc3a62eba] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23437363731643531', 'path': '/dev/sdc'} {{(pid=74960) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 13:05:09 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-4822598c-7278-44aa-9b9c-f1b695405998 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T13:04:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2114848292',display_name='tempest-TestVolumeBootPattern-server-2114848292',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2114848292',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG58VBMUGF35creXkaeLlS45qeSpHByygSbALoDPLyAkX8z0vqLaGfOF/PdmxhlSuzswK/zmWz4mkAMsQnGwfeIg0PnI682GlW4AY7e0K4aRcKwMAhIAhksojQg6Tc/b4g==',key_name='tempest-TestVolumeBootPattern-178111993',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d64f3d9dae8f45bcb2e0677a0076ed64',ramdisk_id='',reservation_id='r-lsfb4aoy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1795947051',owner_user_name='tempest-TestVolumeBootPattern-1795947051-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T13:04:48Z,user_data=None,user_id='067a3f33438b4112b818b91ecb4dd0d2',uuid=33383e72-2704-46b7-8f2d-92acc3a62eba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f74b9f4-8f5b-4b26-955b-ac07a6afdc44", "address": "fa:16:3e:57:0e:23", "network": {"id": "8e985ab3-9852-4f07-8b5c-19f7bf113939", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781795302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d64f3d9dae8f45bcb2e0677a0076ed64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f74b9f4-8f", "ovs_interfaceid": "8f74b9f4-8f5b-4b26-955b-ac07a6afdc44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74960) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 13:05:09 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-4822598c-7278-44aa-9b9c-f1b695405998 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Converting VIF {"id": "8f74b9f4-8f5b-4b26-955b-ac07a6afdc44", "address": "fa:16:3e:57:0e:23", "network": {"id": "8e985ab3-9852-4f07-8b5c-19f7bf113939", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781795302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d64f3d9dae8f45bcb2e0677a0076ed64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f74b9f4-8f", "ovs_interfaceid": "8f74b9f4-8f5b-4b26-955b-ac07a6afdc44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 13:05:09 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-4822598c-7278-44aa-9b9c-f1b695405998 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:0e:23,bridge_name='br-int',has_traffic_filtering=True,id=8f74b9f4-8f5b-4b26-955b-ac07a6afdc44,network=Network(8e985ab3-9852-4f07-8b5c-19f7bf113939),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f74b9f4-8f') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 13:05:09 user nova-compute[74960]: DEBUG nova.objects.instance [None req-4822598c-7278-44aa-9b9c-f1b695405998 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lazy-loading 'pci_devices' on Instance uuid 33383e72-2704-46b7-8f2d-92acc3a62eba {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:05:09 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-4822598c-7278-44aa-9b9c-f1b695405998 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 33383e72-2704-46b7-8f2d-92acc3a62eba] End _get_guest_xml xml=<domain type="kvm">
Nov 03 13:05:09 user nova-compute[74960]:   <uuid>33383e72-2704-46b7-8f2d-92acc3a62eba</uuid>
Nov 03 13:05:09 user nova-compute[74960]:   <name>instance-00000034</name>
Nov 03 13:05:09 user nova-compute[74960]:   <memory>524288</memory>
Nov 03 13:05:09 user nova-compute[74960]:   <vcpu>1</vcpu>
Nov 03 13:05:09 user nova-compute[74960]:   <metadata>
Nov 03 13:05:09 user nova-compute[74960]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 13:05:09 user nova-compute[74960]:       <nova:package version="0.0.0"/>
Nov 03 13:05:09 user nova-compute[74960]:       <nova:name>tempest-TestVolumeBootPattern-server-2114848292</nova:name>
Nov 03 13:05:09 user nova-compute[74960]:       <nova:creationTime>2023-11-03 13:05:08</nova:creationTime>
Nov 03 13:05:09 user nova-compute[74960]:       <nova:flavor name="m1.tiny">
Nov 03 13:05:09 user nova-compute[74960]:         <nova:memory>512</nova:memory>
Nov 03 13:05:09 user nova-compute[74960]:         <nova:disk>1</nova:disk>
Nov 03 13:05:09 user nova-compute[74960]:         <nova:swap>0</nova:swap>
Nov 03 13:05:09 user nova-compute[74960]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 13:05:09 user nova-compute[74960]:         <nova:vcpus>1</nova:vcpus>
Nov 03 13:05:09 user nova-compute[74960]:       </nova:flavor>
Nov 03 13:05:09 user nova-compute[74960]:       <nova:owner>
Nov 03 13:05:09 user nova-compute[74960]:         <nova:user uuid="067a3f33438b4112b818b91ecb4dd0d2">tempest-TestVolumeBootPattern-1795947051-project-member</nova:user>
Nov 03 13:05:09 user nova-compute[74960]:         <nova:project uuid="d64f3d9dae8f45bcb2e0677a0076ed64">tempest-TestVolumeBootPattern-1795947051</nova:project>
Nov 03 13:05:09 user nova-compute[74960]:       </nova:owner>
Nov 03 13:05:09 user nova-compute[74960]:       <nova:ports>
Nov 03 13:05:09 user nova-compute[74960]:         <nova:port uuid="8f74b9f4-8f5b-4b26-955b-ac07a6afdc44">
Nov 03 13:05:09 user nova-compute[74960]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 03 13:05:09 user nova-compute[74960]:         </nova:port>
Nov 03 13:05:09 user nova-compute[74960]:       </nova:ports>
Nov 03 13:05:09 user nova-compute[74960]:     </nova:instance>
Nov 03 13:05:09 user nova-compute[74960]:   </metadata>
Nov 03 13:05:09 user nova-compute[74960]:   <sysinfo type="smbios">
Nov 03 13:05:09 user nova-compute[74960]:     <system>
Nov 03 13:05:09 user nova-compute[74960]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 13:05:09 user nova-compute[74960]:       <entry name="product">OpenStack Nova</entry>
Nov 03 13:05:09 user nova-compute[74960]:       <entry name="version">0.0.0</entry>
Nov 03 13:05:09 user nova-compute[74960]:       <entry name="serial">33383e72-2704-46b7-8f2d-92acc3a62eba</entry>
Nov 03 13:05:09 user nova-compute[74960]:       <entry name="uuid">33383e72-2704-46b7-8f2d-92acc3a62eba</entry>
Nov 03 13:05:09 user nova-compute[74960]:       <entry name="family">Virtual Machine</entry>
Nov 03 13:05:09 user nova-compute[74960]:     </system>
Nov 03 13:05:09 user nova-compute[74960]:   </sysinfo>
Nov 03 13:05:09 user nova-compute[74960]:   <os>
Nov 03 13:05:09 user nova-compute[74960]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 13:05:09 user nova-compute[74960]:     <boot dev="hd"/>
Nov 03 13:05:09 user nova-compute[74960]:     <smbios mode="sysinfo"/>
Nov 03 13:05:09 user nova-compute[74960]:   </os>
Nov 03 13:05:09 user nova-compute[74960]:   <features>
Nov 03 13:05:09 user nova-compute[74960]:     <acpi/>
Nov 03 13:05:09 user nova-compute[74960]:     <apic/>
Nov 03 13:05:09 user nova-compute[74960]:     <vmcoreinfo/>
Nov 03 13:05:09 user nova-compute[74960]:   </features>
Nov 03 13:05:09 user nova-compute[74960]:   <clock offset="utc">
Nov 03 13:05:09 user nova-compute[74960]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 13:05:09 user nova-compute[74960]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 13:05:09 user nova-compute[74960]:     <timer name="hpet" present="no"/>
Nov 03 13:05:09 user nova-compute[74960]:   </clock>
Nov 03 13:05:09 user nova-compute[74960]:   <cpu mode="custom" match="exact">
Nov 03 13:05:09 user nova-compute[74960]:     <model>Nehalem</model>
Nov 03 13:05:09 user nova-compute[74960]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 13:05:09 user nova-compute[74960]:   </cpu>
Nov 03 13:05:09 user nova-compute[74960]:   <devices>
Nov 03 13:05:09 user nova-compute[74960]:     <disk type="block" device="disk">
Nov 03 13:05:09 user nova-compute[74960]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 13:05:09 user nova-compute[74960]:       <source dev="/dev/sdc"/>
Nov 03 13:05:09 user nova-compute[74960]:       <target dev="vda" bus="virtio"/>
Nov 03 13:05:09 user nova-compute[74960]:       <serial>8f581f98-24ca-482e-b9de-7198873e1092</serial>
Nov 03 13:05:09 user nova-compute[74960]:     </disk>
Nov 03 13:05:09 user nova-compute[74960]:     <interface type="ethernet">
Nov 03 13:05:09 user nova-compute[74960]:       <mac address="fa:16:3e:57:0e:23"/>
Nov 03 13:05:09 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 13:05:09 user nova-compute[74960]:       <mtu size="1442"/>
Nov 03 13:05:09 user nova-compute[74960]:       <target dev="tap8f74b9f4-8f"/>
Nov 03 13:05:09 user nova-compute[74960]:     </interface>
Nov 03 13:05:09 user nova-compute[74960]:     <serial type="pty">
Nov 03 13:05:09 user nova-compute[74960]:       <log file="/opt/stack/data/nova/instances/33383e72-2704-46b7-8f2d-92acc3a62eba/console.log" append="off"/>
Nov 03 13:05:09 user nova-compute[74960]:     </serial>
Nov 03 13:05:09 user nova-compute[74960]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 13:05:09 user nova-compute[74960]:     <video>
Nov 03 13:05:09 user nova-compute[74960]:       <model type="virtio"/>
Nov 03 13:05:09 user nova-compute[74960]:     </video>
Nov 03 13:05:09 user nova-compute[74960]:     <rng model="virtio">
Nov 03 13:05:09 user nova-compute[74960]:       <backend model="random">/dev/urandom</backend>
Nov 03 13:05:09 user nova-compute[74960]:     </rng>
Nov 03 13:05:09 user nova-compute[74960]:     <controller type="usb" index="0" model="none"/>
Nov 03 13:05:09 user nova-compute[74960]:     <memballoon model="virtio">
Nov 03 13:05:09 user nova-compute[74960]:       <stats period="10"/>
Nov 03 13:05:09 user nova-compute[74960]:     </memballoon>
Nov 03 13:05:09 user nova-compute[74960]:   </devices>
Nov 03 13:05:09 user nova-compute[74960]: </domain>
Nov 03 13:05:09 user nova-compute[74960]:  {{(pid=74960) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 13:05:09 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-4822598c-7278-44aa-9b9c-f1b695405998 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T13:04:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2114848292',display_name='tempest-TestVolumeBootPattern-server-2114848292',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2114848292',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG58VBMUGF35creXkaeLlS45qeSpHByygSbALoDPLyAkX8z0vqLaGfOF/PdmxhlSuzswK/zmWz4mkAMsQnGwfeIg0PnI682GlW4AY7e0K4aRcKwMAhIAhksojQg6Tc/b4g==',key_name='tempest-TestVolumeBootPattern-178111993',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d64f3d9dae8f45bcb2e0677a0076ed64',ramdisk_id='',reservation_id='r-lsfb4aoy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1795947051',owner_user_name='tempest-TestVolumeBootPattern-1795947051-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T13:04:48Z,user_data=None,user_id='067a3f33438b4112b818b91ecb4dd0d2',uuid=33383e72-2704-46b7-8f2d-92acc3a62eba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f74b9f4-8f5b-4b26-955b-ac07a6afdc44", "address": "fa:16:3e:57:0e:23", "network": {"id": "8e985ab3-9852-4f07-8b5c-19f7bf113939", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781795302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d64f3d9dae8f45bcb2e0677a0076ed64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f74b9f4-8f", "ovs_interfaceid": "8f74b9f4-8f5b-4b26-955b-ac07a6afdc44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 13:05:09 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-4822598c-7278-44aa-9b9c-f1b695405998 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Converting VIF {"id": "8f74b9f4-8f5b-4b26-955b-ac07a6afdc44", "address": "fa:16:3e:57:0e:23", "network": {"id": "8e985ab3-9852-4f07-8b5c-19f7bf113939", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781795302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d64f3d9dae8f45bcb2e0677a0076ed64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f74b9f4-8f", "ovs_interfaceid": "8f74b9f4-8f5b-4b26-955b-ac07a6afdc44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 13:05:09 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-4822598c-7278-44aa-9b9c-f1b695405998 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:0e:23,bridge_name='br-int',has_traffic_filtering=True,id=8f74b9f4-8f5b-4b26-955b-ac07a6afdc44,network=Network(8e985ab3-9852-4f07-8b5c-19f7bf113939),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f74b9f4-8f') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 13:05:09 user nova-compute[74960]: DEBUG os_vif [None req-4822598c-7278-44aa-9b9c-f1b695405998 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:0e:23,bridge_name='br-int',has_traffic_filtering=True,id=8f74b9f4-8f5b-4b26-955b-ac07a6afdc44,network=Network(8e985ab3-9852-4f07-8b5c-19f7bf113939),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f74b9f4-8f') {{(pid=74960) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 13:05:09 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:05:09 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:05:09 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 13:05:09 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:05:09 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '702bdbb7-b0bf-500e-9c41-44c4df232e10', '_type': 'linux-noop'}}, row=False) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:05:09 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:05:09 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:05:09 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:05:09 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8f74b9f4-8f, may_exist=True, interface_attrs={}) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:05:09 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8f74b9f4-8f, col_values=(('qos', UUID('5f3aeac2-3c34-4006-b3dc-ffa577e355ba')),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:05:09 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8f74b9f4-8f, col_values=(('external_ids', {'iface-id': '8f74b9f4-8f5b-4b26-955b-ac07a6afdc44', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:57:0e:23', 'vm-uuid': '33383e72-2704-46b7-8f2d-92acc3a62eba'}),), if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:05:09 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:05:09 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:05:09 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:05:09 user nova-compute[74960]: INFO os_vif [None req-4822598c-7278-44aa-9b9c-f1b695405998 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:0e:23,bridge_name='br-int',has_traffic_filtering=True,id=8f74b9f4-8f5b-4b26-955b-ac07a6afdc44,network=Network(8e985ab3-9852-4f07-8b5c-19f7bf113939),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f74b9f4-8f')
Nov 03 13:05:09 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-4822598c-7278-44aa-9b9c-f1b695405998 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] No BDM found with device name vda, not building metadata. {{(pid=74960) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 13:05:09 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-4822598c-7278-44aa-9b9c-f1b695405998 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] No VIF found with MAC fa:16:3e:57:0e:23, not building metadata {{(pid=74960) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 13:05:10 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:05:10 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:05:10 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:05:10 user nova-compute[74960]: DEBUG nova.compute.manager [req-33f9f5ae-517a-46aa-b80f-fb942e13972b req-b952889c-ac31-4c69-9170-7ac0c5d43880 service nova] [instance: 33383e72-2704-46b7-8f2d-92acc3a62eba] Received event network-vif-plugged-8f74b9f4-8f5b-4b26-955b-ac07a6afdc44 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:05:10 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-33f9f5ae-517a-46aa-b80f-fb942e13972b req-b952889c-ac31-4c69-9170-7ac0c5d43880 service nova] Acquiring lock "33383e72-2704-46b7-8f2d-92acc3a62eba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:05:10 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-33f9f5ae-517a-46aa-b80f-fb942e13972b req-b952889c-ac31-4c69-9170-7ac0c5d43880 service nova] Lock "33383e72-2704-46b7-8f2d-92acc3a62eba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:05:10 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-33f9f5ae-517a-46aa-b80f-fb942e13972b req-b952889c-ac31-4c69-9170-7ac0c5d43880 service nova] Lock "33383e72-2704-46b7-8f2d-92acc3a62eba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:05:10 user nova-compute[74960]: DEBUG nova.compute.manager [req-33f9f5ae-517a-46aa-b80f-fb942e13972b req-b952889c-ac31-4c69-9170-7ac0c5d43880 service nova] [instance: 33383e72-2704-46b7-8f2d-92acc3a62eba] No waiting events found dispatching network-vif-plugged-8f74b9f4-8f5b-4b26-955b-ac07a6afdc44 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:05:10 user nova-compute[74960]: WARNING nova.compute.manager [req-33f9f5ae-517a-46aa-b80f-fb942e13972b req-b952889c-ac31-4c69-9170-7ac0c5d43880 service nova] [instance: 33383e72-2704-46b7-8f2d-92acc3a62eba] Received unexpected event network-vif-plugged-8f74b9f4-8f5b-4b26-955b-ac07a6afdc44 for instance with vm_state building and task_state spawning.
Nov 03 13:05:11 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:05:11 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:05:12 user nova-compute[74960]: DEBUG nova.compute.manager [None req-4822598c-7278-44aa-9b9c-f1b695405998 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 33383e72-2704-46b7-8f2d-92acc3a62eba] Instance event wait completed in 0 seconds for  {{(pid=74960) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 13:05:12 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-4822598c-7278-44aa-9b9c-f1b695405998 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 33383e72-2704-46b7-8f2d-92acc3a62eba] Guest created on hypervisor {{(pid=74960) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 13:05:12 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: 33383e72-2704-46b7-8f2d-92acc3a62eba] Instance spawned successfully.
Nov 03 13:05:12 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-4822598c-7278-44aa-9b9c-f1b695405998 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 33383e72-2704-46b7-8f2d-92acc3a62eba] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 13:05:12 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-4822598c-7278-44aa-9b9c-f1b695405998 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 33383e72-2704-46b7-8f2d-92acc3a62eba] Found default for hw_cdrom_bus of ide {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:05:12 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-4822598c-7278-44aa-9b9c-f1b695405998 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 33383e72-2704-46b7-8f2d-92acc3a62eba] Found default for hw_disk_bus of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:05:12 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-4822598c-7278-44aa-9b9c-f1b695405998 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 33383e72-2704-46b7-8f2d-92acc3a62eba] Found default for hw_input_bus of None {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:05:12 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-4822598c-7278-44aa-9b9c-f1b695405998 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 33383e72-2704-46b7-8f2d-92acc3a62eba] Found default for hw_pointer_model of None {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:05:12 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-4822598c-7278-44aa-9b9c-f1b695405998 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 33383e72-2704-46b7-8f2d-92acc3a62eba] Found default for hw_video_model of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:05:12 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-4822598c-7278-44aa-9b9c-f1b695405998 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 33383e72-2704-46b7-8f2d-92acc3a62eba] Found default for hw_vif_model of virtio {{(pid=74960) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:05:12 user nova-compute[74960]: INFO nova.compute.manager [None req-4822598c-7278-44aa-9b9c-f1b695405998 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 33383e72-2704-46b7-8f2d-92acc3a62eba] Took 4.93 seconds to spawn the instance on the hypervisor.
Nov 03 13:05:12 user nova-compute[74960]: DEBUG nova.compute.manager [None req-4822598c-7278-44aa-9b9c-f1b695405998 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 33383e72-2704-46b7-8f2d-92acc3a62eba] Checking state {{(pid=74960) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 13:05:13 user nova-compute[74960]: INFO nova.compute.manager [None req-4822598c-7278-44aa-9b9c-f1b695405998 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 33383e72-2704-46b7-8f2d-92acc3a62eba] Took 25.13 seconds to build instance.
Nov 03 13:05:13 user nova-compute[74960]: DEBUG nova.compute.manager [req-0c5efe58-8aa5-4122-b752-ab70b8ba3654 req-bc416819-e408-44aa-96ba-b4ab1b96a312 service nova] [instance: 33383e72-2704-46b7-8f2d-92acc3a62eba] Received event network-vif-plugged-8f74b9f4-8f5b-4b26-955b-ac07a6afdc44 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:05:13 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-0c5efe58-8aa5-4122-b752-ab70b8ba3654 req-bc416819-e408-44aa-96ba-b4ab1b96a312 service nova] Acquiring lock "33383e72-2704-46b7-8f2d-92acc3a62eba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:05:13 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-0c5efe58-8aa5-4122-b752-ab70b8ba3654 req-bc416819-e408-44aa-96ba-b4ab1b96a312 service nova] Lock "33383e72-2704-46b7-8f2d-92acc3a62eba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:05:13 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-0c5efe58-8aa5-4122-b752-ab70b8ba3654 req-bc416819-e408-44aa-96ba-b4ab1b96a312 service nova] Lock "33383e72-2704-46b7-8f2d-92acc3a62eba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:05:13 user nova-compute[74960]: DEBUG nova.compute.manager [req-0c5efe58-8aa5-4122-b752-ab70b8ba3654 req-bc416819-e408-44aa-96ba-b4ab1b96a312 service nova] [instance: 33383e72-2704-46b7-8f2d-92acc3a62eba] No waiting events found dispatching network-vif-plugged-8f74b9f4-8f5b-4b26-955b-ac07a6afdc44 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:05:13 user nova-compute[74960]: WARNING nova.compute.manager [req-0c5efe58-8aa5-4122-b752-ab70b8ba3654 req-bc416819-e408-44aa-96ba-b4ab1b96a312 service nova] [instance: 33383e72-2704-46b7-8f2d-92acc3a62eba] Received unexpected event network-vif-plugged-8f74b9f4-8f5b-4b26-955b-ac07a6afdc44 for instance with vm_state active and task_state None.
Nov 03 13:05:13 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-4822598c-7278-44aa-9b9c-f1b695405998 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lock "33383e72-2704-46b7-8f2d-92acc3a62eba" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 25.237s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:05:14 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:05:14 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:05:15 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:05:19 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:05:22 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:05:22 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:05:22 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:05:22 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:05:22 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:05:22 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Auditing locally available compute resources for user (node: user) {{(pid=74960) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 13:05:22 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74960) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 13:05:22 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74960) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 13:05:22 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:05:22 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:05:22 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Hypervisor/Node resource view: name=user free_ram=8845MB free_disk=24.958972930908203GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74960) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 13:05:22 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:05:22 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:05:22 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 69c2803e-38e1-4962-a1e1-beb1febe48ec actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:05:22 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 33383e72-2704-46b7-8f2d-92acc3a62eba actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:05:22 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74960) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 13:05:22 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74960) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 13:05:22 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 13:05:22 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 13:05:23 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Compute_service record updated for user:user {{(pid=74960) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 13:05:23 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.223s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:05:24 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:05:24 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:05:24 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74960) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 13:05:24 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74960) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 13:05:24 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74960) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 13:05:24 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:05:26 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:05:26 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:05:27 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:05:27 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Starting heal instance info cache {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 13:05:27 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Rebuilding the list of instances to heal {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 03 13:05:27 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "refresh_cache-69c2803e-38e1-4962-a1e1-beb1febe48ec" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:05:27 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquired lock "refresh_cache-69c2803e-38e1-4962-a1e1-beb1febe48ec" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:05:27 user nova-compute[74960]: DEBUG nova.network.neutron [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: 69c2803e-38e1-4962-a1e1-beb1febe48ec] Forcefully refreshing network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 13:05:27 user nova-compute[74960]: DEBUG nova.objects.instance [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lazy-loading 'info_cache' on Instance uuid 69c2803e-38e1-4962-a1e1-beb1febe48ec {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:05:27 user nova-compute[74960]: DEBUG nova.network.neutron [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: 69c2803e-38e1-4962-a1e1-beb1febe48ec] Updating instance_info_cache with network_info: [{"id": "1ee78f5d-2a2e-4840-bfec-78bb5b6745d7", "address": "fa:16:3e:59:7c:fc", "network": {"id": "8e985ab3-9852-4f07-8b5c-19f7bf113939", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781795302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d64f3d9dae8f45bcb2e0677a0076ed64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ee78f5d-2a", "ovs_interfaceid": "1ee78f5d-2a2e-4840-bfec-78bb5b6745d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:05:27 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Releasing lock "refresh_cache-69c2803e-38e1-4962-a1e1-beb1febe48ec" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 13:05:27 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: 69c2803e-38e1-4962-a1e1-beb1febe48ec] Updated the network info_cache for instance {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 13:05:28 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:05:28 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:05:28 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74960) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 13:05:29 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:05:29 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:05:29 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:05:34 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:05:34 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:05:39 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:05:39 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:05:44 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:05:44 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:05:44 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:05:47 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:05:49 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:05:54 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:05:59 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:06:04 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:06:04 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:06:04 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74960) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 13:06:04 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74960) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 13:06:04 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74960) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 13:06:04 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:06:09 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:06:14 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:06:17 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:06:19 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:06:22 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:06:24 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:06:24 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:06:24 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:06:24 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:06:24 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:06:24 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Auditing locally available compute resources for user (node: user) {{(pid=74960) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 13:06:24 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74960) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 13:06:24 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74960) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 13:06:24 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:06:24 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:06:24 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:06:24 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Hypervisor/Node resource view: name=user free_ram=8902MB free_disk=24.957653045654297GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74960) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 13:06:24 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:06:24 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:06:24 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 69c2803e-38e1-4962-a1e1-beb1febe48ec actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:06:24 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 33383e72-2704-46b7-8f2d-92acc3a62eba actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:06:24 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74960) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 13:06:24 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74960) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 13:06:25 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 13:06:25 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 13:06:25 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Compute_service record updated for user:user {{(pid=74960) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 13:06:25 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.218s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:06:28 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:06:28 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Starting heal instance info cache {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 13:06:28 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "refresh_cache-33383e72-2704-46b7-8f2d-92acc3a62eba" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:06:28 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquired lock "refresh_cache-33383e72-2704-46b7-8f2d-92acc3a62eba" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:06:28 user nova-compute[74960]: DEBUG nova.network.neutron [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: 33383e72-2704-46b7-8f2d-92acc3a62eba] Forcefully refreshing network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 13:06:28 user nova-compute[74960]: DEBUG nova.network.neutron [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: 33383e72-2704-46b7-8f2d-92acc3a62eba] Updating instance_info_cache with network_info: [{"id": "8f74b9f4-8f5b-4b26-955b-ac07a6afdc44", "address": "fa:16:3e:57:0e:23", "network": {"id": "8e985ab3-9852-4f07-8b5c-19f7bf113939", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781795302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d64f3d9dae8f45bcb2e0677a0076ed64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f74b9f4-8f", "ovs_interfaceid": "8f74b9f4-8f5b-4b26-955b-ac07a6afdc44", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:06:28 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Releasing lock "refresh_cache-33383e72-2704-46b7-8f2d-92acc3a62eba" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 13:06:28 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: 33383e72-2704-46b7-8f2d-92acc3a62eba] Updated the network info_cache for instance {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 13:06:28 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:06:28 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:06:28 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:06:28 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74960) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 13:06:29 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:06:29 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:06:29 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:06:29 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74960) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 13:06:29 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74960) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 13:06:29 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74960) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 13:06:29 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:06:31 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:06:34 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:06:39 user nova-compute[74960]: DEBUG nova.compute.manager [req-e9b846ac-9853-43ec-a0ac-17ea6317bfb3 req-48f3b474-1c4f-4f32-afc3-063b2fff4cda service nova] [instance: 33383e72-2704-46b7-8f2d-92acc3a62eba] Received event network-changed-8f74b9f4-8f5b-4b26-955b-ac07a6afdc44 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:06:39 user nova-compute[74960]: DEBUG nova.compute.manager [req-e9b846ac-9853-43ec-a0ac-17ea6317bfb3 req-48f3b474-1c4f-4f32-afc3-063b2fff4cda service nova] [instance: 33383e72-2704-46b7-8f2d-92acc3a62eba] Refreshing instance network info cache due to event network-changed-8f74b9f4-8f5b-4b26-955b-ac07a6afdc44. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 13:06:39 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-e9b846ac-9853-43ec-a0ac-17ea6317bfb3 req-48f3b474-1c4f-4f32-afc3-063b2fff4cda service nova] Acquiring lock "refresh_cache-33383e72-2704-46b7-8f2d-92acc3a62eba" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:06:39 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-e9b846ac-9853-43ec-a0ac-17ea6317bfb3 req-48f3b474-1c4f-4f32-afc3-063b2fff4cda service nova] Acquired lock "refresh_cache-33383e72-2704-46b7-8f2d-92acc3a62eba" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:06:39 user nova-compute[74960]: DEBUG nova.network.neutron [req-e9b846ac-9853-43ec-a0ac-17ea6317bfb3 req-48f3b474-1c4f-4f32-afc3-063b2fff4cda service nova] [instance: 33383e72-2704-46b7-8f2d-92acc3a62eba] Refreshing network info cache for port 8f74b9f4-8f5b-4b26-955b-ac07a6afdc44 {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 13:06:39 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:06:39 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:06:39 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=74960) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 13:06:39 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74960) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 13:06:39 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74960) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 13:06:39 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:06:40 user nova-compute[74960]: DEBUG nova.network.neutron [req-e9b846ac-9853-43ec-a0ac-17ea6317bfb3 req-48f3b474-1c4f-4f32-afc3-063b2fff4cda service nova] [instance: 33383e72-2704-46b7-8f2d-92acc3a62eba] Updated VIF entry in instance network info cache for port 8f74b9f4-8f5b-4b26-955b-ac07a6afdc44. {{(pid=74960) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 13:06:40 user nova-compute[74960]: DEBUG nova.network.neutron [req-e9b846ac-9853-43ec-a0ac-17ea6317bfb3 req-48f3b474-1c4f-4f32-afc3-063b2fff4cda service nova] [instance: 33383e72-2704-46b7-8f2d-92acc3a62eba] Updating instance_info_cache with network_info: [{"id": "8f74b9f4-8f5b-4b26-955b-ac07a6afdc44", "address": "fa:16:3e:57:0e:23", "network": {"id": "8e985ab3-9852-4f07-8b5c-19f7bf113939", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781795302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d64f3d9dae8f45bcb2e0677a0076ed64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f74b9f4-8f", "ovs_interfaceid": "8f74b9f4-8f5b-4b26-955b-ac07a6afdc44", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:06:40 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-e9b846ac-9853-43ec-a0ac-17ea6317bfb3 req-48f3b474-1c4f-4f32-afc3-063b2fff4cda service nova] Releasing lock "refresh_cache-33383e72-2704-46b7-8f2d-92acc3a62eba" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 13:06:40 user nova-compute[74960]: DEBUG nova.compute.manager [req-06863821-2627-4239-9137-a8e460e42a04 req-e808c666-9ea1-4690-9f2c-0775823271fe service nova] [instance: 33383e72-2704-46b7-8f2d-92acc3a62eba] Received event network-changed-8f74b9f4-8f5b-4b26-955b-ac07a6afdc44 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:06:40 user nova-compute[74960]: DEBUG nova.compute.manager [req-06863821-2627-4239-9137-a8e460e42a04 req-e808c666-9ea1-4690-9f2c-0775823271fe service nova] [instance: 33383e72-2704-46b7-8f2d-92acc3a62eba] Refreshing instance network info cache due to event network-changed-8f74b9f4-8f5b-4b26-955b-ac07a6afdc44. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 13:06:40 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-06863821-2627-4239-9137-a8e460e42a04 req-e808c666-9ea1-4690-9f2c-0775823271fe service nova] Acquiring lock "refresh_cache-33383e72-2704-46b7-8f2d-92acc3a62eba" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:06:40 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-06863821-2627-4239-9137-a8e460e42a04 req-e808c666-9ea1-4690-9f2c-0775823271fe service nova] Acquired lock "refresh_cache-33383e72-2704-46b7-8f2d-92acc3a62eba" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:06:40 user nova-compute[74960]: DEBUG nova.network.neutron [req-06863821-2627-4239-9137-a8e460e42a04 req-e808c666-9ea1-4690-9f2c-0775823271fe service nova] [instance: 33383e72-2704-46b7-8f2d-92acc3a62eba] Refreshing network info cache for port 8f74b9f4-8f5b-4b26-955b-ac07a6afdc44 {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 13:06:40 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-378886da-c29a-4a9e-8713-881282830a66 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Acquiring lock "33383e72-2704-46b7-8f2d-92acc3a62eba" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:06:40 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-378886da-c29a-4a9e-8713-881282830a66 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lock "33383e72-2704-46b7-8f2d-92acc3a62eba" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:06:40 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-378886da-c29a-4a9e-8713-881282830a66 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Acquiring lock "33383e72-2704-46b7-8f2d-92acc3a62eba-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:06:40 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-378886da-c29a-4a9e-8713-881282830a66 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lock "33383e72-2704-46b7-8f2d-92acc3a62eba-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:06:40 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-378886da-c29a-4a9e-8713-881282830a66 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lock "33383e72-2704-46b7-8f2d-92acc3a62eba-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:06:40 user nova-compute[74960]: INFO nova.compute.manager [None req-378886da-c29a-4a9e-8713-881282830a66 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 33383e72-2704-46b7-8f2d-92acc3a62eba] Terminating instance
Nov 03 13:06:40 user nova-compute[74960]: DEBUG nova.compute.manager [None req-378886da-c29a-4a9e-8713-881282830a66 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 33383e72-2704-46b7-8f2d-92acc3a62eba] Start destroying the instance on the hypervisor. {{(pid=74960) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 13:06:40 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:06:40 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:06:40 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:06:40 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:06:40 user nova-compute[74960]: DEBUG nova.network.neutron [req-06863821-2627-4239-9137-a8e460e42a04 req-e808c666-9ea1-4690-9f2c-0775823271fe service nova] [instance: 33383e72-2704-46b7-8f2d-92acc3a62eba] Updated VIF entry in instance network info cache for port 8f74b9f4-8f5b-4b26-955b-ac07a6afdc44. {{(pid=74960) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 13:06:40 user nova-compute[74960]: DEBUG nova.network.neutron [req-06863821-2627-4239-9137-a8e460e42a04 req-e808c666-9ea1-4690-9f2c-0775823271fe service nova] [instance: 33383e72-2704-46b7-8f2d-92acc3a62eba] Updating instance_info_cache with network_info: [{"id": "8f74b9f4-8f5b-4b26-955b-ac07a6afdc44", "address": "fa:16:3e:57:0e:23", "network": {"id": "8e985ab3-9852-4f07-8b5c-19f7bf113939", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781795302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d64f3d9dae8f45bcb2e0677a0076ed64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f74b9f4-8f", "ovs_interfaceid": "8f74b9f4-8f5b-4b26-955b-ac07a6afdc44", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:06:40 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-06863821-2627-4239-9137-a8e460e42a04 req-e808c666-9ea1-4690-9f2c-0775823271fe service nova] Releasing lock "refresh_cache-33383e72-2704-46b7-8f2d-92acc3a62eba" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 13:06:41 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: 33383e72-2704-46b7-8f2d-92acc3a62eba] Instance destroyed successfully.
Nov 03 13:06:41 user nova-compute[74960]: DEBUG nova.objects.instance [None req-378886da-c29a-4a9e-8713-881282830a66 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lazy-loading 'resources' on Instance uuid 33383e72-2704-46b7-8f2d-92acc3a62eba {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:06:41 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-378886da-c29a-4a9e-8713-881282830a66 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T13:04:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2114848292',display_name='tempest-TestVolumeBootPattern-server-2114848292',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2114848292',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG58VBMUGF35creXkaeLlS45qeSpHByygSbALoDPLyAkX8z0vqLaGfOF/PdmxhlSuzswK/zmWz4mkAMsQnGwfeIg0PnI682GlW4AY7e0K4aRcKwMAhIAhksojQg6Tc/b4g==',key_name='tempest-TestVolumeBootPattern-178111993',keypairs=<?>,launch_index=0,launched_at=2023-11-03T13:05:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d64f3d9dae8f45bcb2e0677a0076ed64',ramdisk_id='',reservation_id='r-lsfb4aoy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1795947051',owner_user_name='tempest-TestVolumeBootPattern-1795947051-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T13:05:13Z,user_data=None,user_id='067a3f33438b4112b818b91ecb4dd0d2',uuid=33383e72-2704-46b7-8f2d-92acc3a62eba,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8f74b9f4-8f5b-4b26-955b-ac07a6afdc44", "address": "fa:16:3e:57:0e:23", "network": {"id": "8e985ab3-9852-4f07-8b5c-19f7bf113939", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781795302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d64f3d9dae8f45bcb2e0677a0076ed64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f74b9f4-8f", "ovs_interfaceid": "8f74b9f4-8f5b-4b26-955b-ac07a6afdc44", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 13:06:41 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-378886da-c29a-4a9e-8713-881282830a66 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Converting VIF {"id": "8f74b9f4-8f5b-4b26-955b-ac07a6afdc44", "address": "fa:16:3e:57:0e:23", "network": {"id": "8e985ab3-9852-4f07-8b5c-19f7bf113939", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781795302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d64f3d9dae8f45bcb2e0677a0076ed64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f74b9f4-8f", "ovs_interfaceid": "8f74b9f4-8f5b-4b26-955b-ac07a6afdc44", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 13:06:41 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-378886da-c29a-4a9e-8713-881282830a66 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:57:0e:23,bridge_name='br-int',has_traffic_filtering=True,id=8f74b9f4-8f5b-4b26-955b-ac07a6afdc44,network=Network(8e985ab3-9852-4f07-8b5c-19f7bf113939),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f74b9f4-8f') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 13:06:41 user nova-compute[74960]: DEBUG os_vif [None req-378886da-c29a-4a9e-8713-881282830a66 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:0e:23,bridge_name='br-int',has_traffic_filtering=True,id=8f74b9f4-8f5b-4b26-955b-ac07a6afdc44,network=Network(8e985ab3-9852-4f07-8b5c-19f7bf113939),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f74b9f4-8f') {{(pid=74960) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 13:06:41 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:06:41 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8f74b9f4-8f, bridge=br-int, if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:06:41 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:06:41 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:06:41 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:06:41 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5f3aeac2-3c34-4006-b3dc-ffa577e355ba) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:06:41 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:06:41 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:06:41 user nova-compute[74960]: INFO os_vif [None req-378886da-c29a-4a9e-8713-881282830a66 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:0e:23,bridge_name='br-int',has_traffic_filtering=True,id=8f74b9f4-8f5b-4b26-955b-ac07a6afdc44,network=Network(8e985ab3-9852-4f07-8b5c-19f7bf113939),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f74b9f4-8f')
Nov 03 13:06:41 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-378886da-c29a-4a9e-8713-881282830a66 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 33383e72-2704-46b7-8f2d-92acc3a62eba] calling os-brick to detach iSCSI Volume {{(pid=74960) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 13:06:41 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-378886da-c29a-4a9e-8713-881282830a66 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9aa420acb0>, {'target_iqn': 'iqn.2010-10.org.openstack:8f581f98-24ca-482e-b9de-7198873e1092', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JnEDpXuG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 13:06:41 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-378886da-c29a-4a9e-8713-881282830a66 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 13:06:41 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-378886da-c29a-4a9e-8713-881282830a66 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 13:06:41 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-378886da-c29a-4a9e-8713-881282830a66 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 13:06:41 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:06:41 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:06:41 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb53c442-827e-43aa-85b2-b2b3e002f3d4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8f581f98-24ca-482e-b9de-7198873e1092\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:06:41 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-378886da-c29a-4a9e-8713-881282830a66 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 13:06:41 user nova-compute[74960]: No targets found.
Nov 03 13:06:41 user nova-compute[74960]: iSNS:
Nov 03 13:06:41 user nova-compute[74960]: No targets found.
Nov 03 13:06:41 user nova-compute[74960]: STATIC:
Nov 03 13:06:41 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4
Nov 03 13:06:41 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 13:06:41 user nova-compute[74960]:                 Iface Name: default
Nov 03 13:06:41 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:8f581f98-24ca-482e-b9de-7198873e1092
Nov 03 13:06:41 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 13:06:41 user nova-compute[74960]:                 Iface Name: default
Nov 03 13:06:41 user nova-compute[74960]: FIRMWARE:
Nov 03 13:06:41 user nova-compute[74960]: No targets found.
Nov 03 13:06:41 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 13:06:41 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-378886da-c29a-4a9e-8713-881282830a66 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 13:06:41 user nova-compute[74960]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 13:06:41 user nova-compute[74960]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74960) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 13:06:41 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-378886da-c29a-4a9e-8713-881282830a66 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8f581f98-24ca-482e-b9de-7198873e1092', 0)] {{(pid=74960) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 13:06:41 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:06:41 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:06:41 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[be20a75d-c5f7-440b-8cac-a1cde629740f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f581f98-24ca-482e-b9de-7198873e1092\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:06:41 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:06:41 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:06:41 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[453c8345-8c9e-4292-bed5-5e986b3849db]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f581f98-24ca-482e-b9de-7198873e1092 (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:06:41 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-378886da-c29a-4a9e-8713-881282830a66 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4 (non-flash)
Nov 03 13:06:41 user nova-compute[74960]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f581f98-24ca-482e-b9de-7198873e1092 (non-flash)
Nov 03 13:06:41 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 13:06:41 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-378886da-c29a-4a9e-8713-881282830a66 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4 (non-flash)
Nov 03 13:06:41 user nova-compute[74960]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f581f98-24ca-482e-b9de-7198873e1092 (non-flash)
Nov 03 13:06:41 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 13:06:41 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-378886da-c29a-4a9e-8713-881282830a66 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9a8c47e680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8f581f98-24ca-482e-b9de-7198873e1092'): ({'sdc'}, set())}) {{(pid=74960) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 13:06:41 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-378886da-c29a-4a9e-8713-881282830a66 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Removing single pathed devices sdc {{(pid=74960) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 13:06:41 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:06:41 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:06:41 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[445fd430-1bf5-49fb-9569-5c15eeb0de29]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:06:41 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:06:41 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:06:41 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[b033277a-73da-4685-a283-c4a39d5df985]: (4, ('ok\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:06:41 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-378886da-c29a-4a9e-8713-881282830a66 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Flushing IO for device /dev/sdc {{(pid=74960) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 13:06:41 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:06:41 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:06:41 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[3130cfff-9e06-45d8-81ec-48ca72497d0b]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:06:41 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-378886da-c29a-4a9e-8713-881282830a66 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74960) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 13:06:41 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:06:41 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:06:41 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[30286e42-fb6a-4461-92a7-e41e9ad7dccc]: (4, ('1', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:06:41 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-378886da-c29a-4a9e-8713-881282830a66 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74960) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 13:06:41 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-378886da-c29a-4a9e-8713-881282830a66 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] SCSI volumes sdc have been removed. {{(pid=74960) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 13:06:41 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-378886da-c29a-4a9e-8713-881282830a66 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8f581f98-24ca-482e-b9de-7198873e1092')] {{(pid=74960) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 13:06:41 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f581f98-24ca-482e-b9de-7198873e1092 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:06:41 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f581f98-24ca-482e-b9de-7198873e1092 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:06:41 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8930b44-d52c-4832-94ce-b6b9bc74ae52]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:06:41 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-378886da-c29a-4a9e-8713-881282830a66 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:06:41 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f581f98-24ca-482e-b9de-7198873e1092 -p 172.16.0.220:3260 --logout {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:06:41 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f581f98-24ca-482e-b9de-7198873e1092 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:06:41 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[10e33e5d-b66c-460f-ade2-918bf2227f22]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:8f581f98-24ca-482e-b9de-7198873e1092, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:8f581f98-24ca-482e-b9de-7198873e1092, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:06:41 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-378886da-c29a-4a9e-8713-881282830a66 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:8f581f98-24ca-482e-b9de-7198873e1092, portal: 172.16.0.220,3260]
Nov 03 13:06:41 user nova-compute[74960]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:8f581f98-24ca-482e-b9de-7198873e1092, portal: 172.16.0.220,3260] successful.
Nov 03 13:06:41 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:06:41 user nova-compute[74960]: DEBUG nova.compute.manager [req-abfc3e12-eab4-4fdb-95e6-7df21874e5f7 req-89c20872-a25d-4d35-bf4b-cb722a6a3143 service nova] [instance: 33383e72-2704-46b7-8f2d-92acc3a62eba] Received event network-vif-unplugged-8f74b9f4-8f5b-4b26-955b-ac07a6afdc44 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:06:41 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-abfc3e12-eab4-4fdb-95e6-7df21874e5f7 req-89c20872-a25d-4d35-bf4b-cb722a6a3143 service nova] Acquiring lock "33383e72-2704-46b7-8f2d-92acc3a62eba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:06:41 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-abfc3e12-eab4-4fdb-95e6-7df21874e5f7 req-89c20872-a25d-4d35-bf4b-cb722a6a3143 service nova] Lock "33383e72-2704-46b7-8f2d-92acc3a62eba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:06:41 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-abfc3e12-eab4-4fdb-95e6-7df21874e5f7 req-89c20872-a25d-4d35-bf4b-cb722a6a3143 service nova] Lock "33383e72-2704-46b7-8f2d-92acc3a62eba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:06:41 user nova-compute[74960]: DEBUG nova.compute.manager [req-abfc3e12-eab4-4fdb-95e6-7df21874e5f7 req-89c20872-a25d-4d35-bf4b-cb722a6a3143 service nova] [instance: 33383e72-2704-46b7-8f2d-92acc3a62eba] No waiting events found dispatching network-vif-unplugged-8f74b9f4-8f5b-4b26-955b-ac07a6afdc44 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:06:41 user nova-compute[74960]: DEBUG nova.compute.manager [req-abfc3e12-eab4-4fdb-95e6-7df21874e5f7 req-89c20872-a25d-4d35-bf4b-cb722a6a3143 service nova] [instance: 33383e72-2704-46b7-8f2d-92acc3a62eba] Received event network-vif-unplugged-8f74b9f4-8f5b-4b26-955b-ac07a6afdc44 for instance with task_state deleting. {{(pid=74960) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 13:06:41 user nova-compute[74960]: DEBUG nova.compute.manager [req-abfc3e12-eab4-4fdb-95e6-7df21874e5f7 req-89c20872-a25d-4d35-bf4b-cb722a6a3143 service nova] [instance: 33383e72-2704-46b7-8f2d-92acc3a62eba] Received event network-vif-plugged-8f74b9f4-8f5b-4b26-955b-ac07a6afdc44 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:06:41 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-abfc3e12-eab4-4fdb-95e6-7df21874e5f7 req-89c20872-a25d-4d35-bf4b-cb722a6a3143 service nova] Acquiring lock "33383e72-2704-46b7-8f2d-92acc3a62eba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:06:41 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-abfc3e12-eab4-4fdb-95e6-7df21874e5f7 req-89c20872-a25d-4d35-bf4b-cb722a6a3143 service nova] Lock "33383e72-2704-46b7-8f2d-92acc3a62eba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:06:41 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-abfc3e12-eab4-4fdb-95e6-7df21874e5f7 req-89c20872-a25d-4d35-bf4b-cb722a6a3143 service nova] Lock "33383e72-2704-46b7-8f2d-92acc3a62eba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:06:41 user nova-compute[74960]: DEBUG nova.compute.manager [req-abfc3e12-eab4-4fdb-95e6-7df21874e5f7 req-89c20872-a25d-4d35-bf4b-cb722a6a3143 service nova] [instance: 33383e72-2704-46b7-8f2d-92acc3a62eba] No waiting events found dispatching network-vif-plugged-8f74b9f4-8f5b-4b26-955b-ac07a6afdc44 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:06:41 user nova-compute[74960]: WARNING nova.compute.manager [req-abfc3e12-eab4-4fdb-95e6-7df21874e5f7 req-89c20872-a25d-4d35-bf4b-cb722a6a3143 service nova] [instance: 33383e72-2704-46b7-8f2d-92acc3a62eba] Received unexpected event network-vif-plugged-8f74b9f4-8f5b-4b26-955b-ac07a6afdc44 for instance with vm_state active and task_state deleting.
Nov 03 13:06:41 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f581f98-24ca-482e-b9de-7198873e1092 -p 172.16.0.220:3260 --op delete {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:06:41 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f581f98-24ca-482e-b9de-7198873e1092 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:06:41 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4f439a3-c511-4258-bc73-0f739936a6a3]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:06:41 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-378886da-c29a-4a9e-8713-881282830a66 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:06:41 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-378886da-c29a-4a9e-8713-881282830a66 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 13:06:41 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-378886da-c29a-4a9e-8713-881282830a66 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] <== disconnect_volume: return (315ms) None {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 13:06:41 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-378886da-c29a-4a9e-8713-881282830a66 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 33383e72-2704-46b7-8f2d-92acc3a62eba] Disconnected iSCSI Volume {{(pid=74960) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 13:06:41 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-378886da-c29a-4a9e-8713-881282830a66 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 33383e72-2704-46b7-8f2d-92acc3a62eba] Deleting instance files /opt/stack/data/nova/instances/33383e72-2704-46b7-8f2d-92acc3a62eba_del
Nov 03 13:06:41 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-378886da-c29a-4a9e-8713-881282830a66 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 33383e72-2704-46b7-8f2d-92acc3a62eba] Deletion of /opt/stack/data/nova/instances/33383e72-2704-46b7-8f2d-92acc3a62eba_del complete
Nov 03 13:06:41 user nova-compute[74960]: INFO nova.compute.manager [None req-378886da-c29a-4a9e-8713-881282830a66 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 33383e72-2704-46b7-8f2d-92acc3a62eba] Took 1.17 seconds to destroy the instance on the hypervisor.
Nov 03 13:06:41 user nova-compute[74960]: DEBUG oslo.service.loopingcall [None req-378886da-c29a-4a9e-8713-881282830a66 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74960) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 13:06:41 user nova-compute[74960]: DEBUG nova.compute.manager [-] [instance: 33383e72-2704-46b7-8f2d-92acc3a62eba] Deallocating network for instance {{(pid=74960) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 13:06:41 user nova-compute[74960]: DEBUG nova.network.neutron [-] [instance: 33383e72-2704-46b7-8f2d-92acc3a62eba] deallocate_for_instance() {{(pid=74960) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 13:06:42 user nova-compute[74960]: DEBUG nova.network.neutron [-] [instance: 33383e72-2704-46b7-8f2d-92acc3a62eba] Updating instance_info_cache with network_info: [] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:06:42 user nova-compute[74960]: INFO nova.compute.manager [-] [instance: 33383e72-2704-46b7-8f2d-92acc3a62eba] Took 0.39 seconds to deallocate network for instance.
Nov 03 13:06:43 user nova-compute[74960]: INFO nova.compute.manager [None req-378886da-c29a-4a9e-8713-881282830a66 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 33383e72-2704-46b7-8f2d-92acc3a62eba] Took 0.91 seconds to detach 1 volumes for instance.
Nov 03 13:06:43 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-378886da-c29a-4a9e-8713-881282830a66 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:06:43 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-378886da-c29a-4a9e-8713-881282830a66 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:06:43 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-378886da-c29a-4a9e-8713-881282830a66 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 13:06:43 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-378886da-c29a-4a9e-8713-881282830a66 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 13:06:43 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-378886da-c29a-4a9e-8713-881282830a66 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.157s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:06:43 user nova-compute[74960]: INFO nova.scheduler.client.report [None req-378886da-c29a-4a9e-8713-881282830a66 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Deleted allocations for instance 33383e72-2704-46b7-8f2d-92acc3a62eba
Nov 03 13:06:43 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-378886da-c29a-4a9e-8713-881282830a66 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lock "33383e72-2704-46b7-8f2d-92acc3a62eba" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.828s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:06:43 user nova-compute[74960]: DEBUG nova.compute.manager [req-7c0b98d3-4788-46e9-8064-e55085e0e28d req-793a93a6-5e32-46d3-a75f-9dc9d1e2d4ca service nova] [instance: 33383e72-2704-46b7-8f2d-92acc3a62eba] Received event network-vif-deleted-8f74b9f4-8f5b-4b26-955b-ac07a6afdc44 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:06:44 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:06:46 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:06:51 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:06:56 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:06:56 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:07:01 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:07:06 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:07:11 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:07:16 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:07:19 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:07:21 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:07:25 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:07:25 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:07:25 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:07:25 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:07:25 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Auditing locally available compute resources for user (node: user) {{(pid=74960) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 13:07:25 user nova-compute[74960]: DEBUG nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74960) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 13:07:25 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:07:25 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:07:25 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Hypervisor/Node resource view: name=user free_ram=8991MB free_disk=24.95578384399414GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74960) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 13:07:25 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:07:25 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:07:25 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 69c2803e-38e1-4962-a1e1-beb1febe48ec actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:07:25 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74960) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 13:07:25 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74960) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 13:07:25 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 13:07:25 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 13:07:25 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Compute_service record updated for user:user {{(pid=74960) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 13:07:25 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.169s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:07:26 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:07:26 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:07:27 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:07:28 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:07:28 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Starting heal instance info cache {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 13:07:28 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Rebuilding the list of instances to heal {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 03 13:07:28 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "refresh_cache-69c2803e-38e1-4962-a1e1-beb1febe48ec" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:07:28 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquired lock "refresh_cache-69c2803e-38e1-4962-a1e1-beb1febe48ec" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:07:28 user nova-compute[74960]: DEBUG nova.network.neutron [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: 69c2803e-38e1-4962-a1e1-beb1febe48ec] Forcefully refreshing network info cache for instance {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 13:07:28 user nova-compute[74960]: DEBUG nova.objects.instance [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lazy-loading 'info_cache' on Instance uuid 69c2803e-38e1-4962-a1e1-beb1febe48ec {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:07:29 user nova-compute[74960]: DEBUG nova.network.neutron [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: 69c2803e-38e1-4962-a1e1-beb1febe48ec] Updating instance_info_cache with network_info: [{"id": "1ee78f5d-2a2e-4840-bfec-78bb5b6745d7", "address": "fa:16:3e:59:7c:fc", "network": {"id": "8e985ab3-9852-4f07-8b5c-19f7bf113939", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781795302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d64f3d9dae8f45bcb2e0677a0076ed64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ee78f5d-2a", "ovs_interfaceid": "1ee78f5d-2a2e-4840-bfec-78bb5b6745d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:07:29 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Releasing lock "refresh_cache-69c2803e-38e1-4962-a1e1-beb1febe48ec" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 13:07:29 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] [instance: 69c2803e-38e1-4962-a1e1-beb1febe48ec] Updated the network info_cache for instance {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 13:07:29 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:07:29 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74960) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 13:07:30 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:07:31 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:07:31 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:07:33 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:07:36 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:07:41 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:07:46 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:07:49 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:07:51 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:07:56 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:08:01 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:08:06 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:08:10 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:08:11 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-cada462f-8c93-4613-b948-9ec581799bd9 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Acquiring lock "69c2803e-38e1-4962-a1e1-beb1febe48ec" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:08:11 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-cada462f-8c93-4613-b948-9ec581799bd9 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lock "69c2803e-38e1-4962-a1e1-beb1febe48ec" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:08:11 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-cada462f-8c93-4613-b948-9ec581799bd9 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Acquiring lock "69c2803e-38e1-4962-a1e1-beb1febe48ec-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:08:11 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-cada462f-8c93-4613-b948-9ec581799bd9 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lock "69c2803e-38e1-4962-a1e1-beb1febe48ec-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:08:11 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-cada462f-8c93-4613-b948-9ec581799bd9 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lock "69c2803e-38e1-4962-a1e1-beb1febe48ec-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:08:11 user nova-compute[74960]: INFO nova.compute.manager [None req-cada462f-8c93-4613-b948-9ec581799bd9 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 69c2803e-38e1-4962-a1e1-beb1febe48ec] Terminating instance
Nov 03 13:08:11 user nova-compute[74960]: DEBUG nova.compute.manager [None req-cada462f-8c93-4613-b948-9ec581799bd9 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 69c2803e-38e1-4962-a1e1-beb1febe48ec] Start destroying the instance on the hypervisor. {{(pid=74960) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 13:08:11 user nova-compute[74960]: DEBUG nova.compute.manager [req-959278e0-ff0a-43e3-9fce-552eef7a7394 req-fa8034b0-1b70-4d9f-993d-77d7c12f9a42 service nova] [instance: 69c2803e-38e1-4962-a1e1-beb1febe48ec] Received event network-changed-1ee78f5d-2a2e-4840-bfec-78bb5b6745d7 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:08:11 user nova-compute[74960]: DEBUG nova.compute.manager [req-959278e0-ff0a-43e3-9fce-552eef7a7394 req-fa8034b0-1b70-4d9f-993d-77d7c12f9a42 service nova] [instance: 69c2803e-38e1-4962-a1e1-beb1febe48ec] Refreshing instance network info cache due to event network-changed-1ee78f5d-2a2e-4840-bfec-78bb5b6745d7. {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 13:08:11 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-959278e0-ff0a-43e3-9fce-552eef7a7394 req-fa8034b0-1b70-4d9f-993d-77d7c12f9a42 service nova] Acquiring lock "refresh_cache-69c2803e-38e1-4962-a1e1-beb1febe48ec" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:08:11 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-959278e0-ff0a-43e3-9fce-552eef7a7394 req-fa8034b0-1b70-4d9f-993d-77d7c12f9a42 service nova] Acquired lock "refresh_cache-69c2803e-38e1-4962-a1e1-beb1febe48ec" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:08:11 user nova-compute[74960]: DEBUG nova.network.neutron [req-959278e0-ff0a-43e3-9fce-552eef7a7394 req-fa8034b0-1b70-4d9f-993d-77d7c12f9a42 service nova] [instance: 69c2803e-38e1-4962-a1e1-beb1febe48ec] Refreshing network info cache for port 1ee78f5d-2a2e-4840-bfec-78bb5b6745d7 {{(pid=74960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 13:08:11 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:08:11 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:08:11 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:08:11 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:08:11 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:08:11 user nova-compute[74960]: DEBUG nova.compute.manager [req-d44318c5-4098-4d55-bd1e-168faf264d9c req-f44eb290-9056-4d65-8e3c-062f86c86014 service nova] [instance: 69c2803e-38e1-4962-a1e1-beb1febe48ec] Received event network-vif-unplugged-1ee78f5d-2a2e-4840-bfec-78bb5b6745d7 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:08:11 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-d44318c5-4098-4d55-bd1e-168faf264d9c req-f44eb290-9056-4d65-8e3c-062f86c86014 service nova] Acquiring lock "69c2803e-38e1-4962-a1e1-beb1febe48ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:08:11 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-d44318c5-4098-4d55-bd1e-168faf264d9c req-f44eb290-9056-4d65-8e3c-062f86c86014 service nova] Lock "69c2803e-38e1-4962-a1e1-beb1febe48ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:08:11 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-d44318c5-4098-4d55-bd1e-168faf264d9c req-f44eb290-9056-4d65-8e3c-062f86c86014 service nova] Lock "69c2803e-38e1-4962-a1e1-beb1febe48ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:08:11 user nova-compute[74960]: DEBUG nova.compute.manager [req-d44318c5-4098-4d55-bd1e-168faf264d9c req-f44eb290-9056-4d65-8e3c-062f86c86014 service nova] [instance: 69c2803e-38e1-4962-a1e1-beb1febe48ec] No waiting events found dispatching network-vif-unplugged-1ee78f5d-2a2e-4840-bfec-78bb5b6745d7 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:08:11 user nova-compute[74960]: DEBUG nova.compute.manager [req-d44318c5-4098-4d55-bd1e-168faf264d9c req-f44eb290-9056-4d65-8e3c-062f86c86014 service nova] [instance: 69c2803e-38e1-4962-a1e1-beb1febe48ec] Received event network-vif-unplugged-1ee78f5d-2a2e-4840-bfec-78bb5b6745d7 for instance with task_state deleting. {{(pid=74960) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 13:08:11 user nova-compute[74960]: DEBUG nova.network.neutron [req-959278e0-ff0a-43e3-9fce-552eef7a7394 req-fa8034b0-1b70-4d9f-993d-77d7c12f9a42 service nova] [instance: 69c2803e-38e1-4962-a1e1-beb1febe48ec] Updated VIF entry in instance network info cache for port 1ee78f5d-2a2e-4840-bfec-78bb5b6745d7. {{(pid=74960) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 13:08:11 user nova-compute[74960]: DEBUG nova.network.neutron [req-959278e0-ff0a-43e3-9fce-552eef7a7394 req-fa8034b0-1b70-4d9f-993d-77d7c12f9a42 service nova] [instance: 69c2803e-38e1-4962-a1e1-beb1febe48ec] Updating instance_info_cache with network_info: [{"id": "1ee78f5d-2a2e-4840-bfec-78bb5b6745d7", "address": "fa:16:3e:59:7c:fc", "network": {"id": "8e985ab3-9852-4f07-8b5c-19f7bf113939", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781795302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d64f3d9dae8f45bcb2e0677a0076ed64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ee78f5d-2a", "ovs_interfaceid": "1ee78f5d-2a2e-4840-bfec-78bb5b6745d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:08:11 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-959278e0-ff0a-43e3-9fce-552eef7a7394 req-fa8034b0-1b70-4d9f-993d-77d7c12f9a42 service nova] Releasing lock "refresh_cache-69c2803e-38e1-4962-a1e1-beb1febe48ec" {{(pid=74960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 13:08:11 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:08:11 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:08:11 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:08:11 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:08:11 user nova-compute[74960]: INFO nova.virt.libvirt.driver [-] [instance: 69c2803e-38e1-4962-a1e1-beb1febe48ec] Instance destroyed successfully.
Nov 03 13:08:11 user nova-compute[74960]: DEBUG nova.objects.instance [None req-cada462f-8c93-4613-b948-9ec581799bd9 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lazy-loading 'resources' on Instance uuid 69c2803e-38e1-4962-a1e1-beb1febe48ec {{(pid=74960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:08:11 user nova-compute[74960]: DEBUG nova.virt.libvirt.vif [None req-cada462f-8c93-4613-b948-9ec581799bd9 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T13:02:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1423336979',display_name='tempest-TestVolumeBootPattern-server-1423336979',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1423336979',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG58VBMUGF35creXkaeLlS45qeSpHByygSbALoDPLyAkX8z0vqLaGfOF/PdmxhlSuzswK/zmWz4mkAMsQnGwfeIg0PnI682GlW4AY7e0K4aRcKwMAhIAhksojQg6Tc/b4g==',key_name='tempest-TestVolumeBootPattern-178111993',keypairs=<?>,launch_index=0,launched_at=2023-11-03T13:03:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d64f3d9dae8f45bcb2e0677a0076ed64',ramdisk_id='',reservation_id='r-0g8izwlc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1795947051',owner_user_name='tempest-TestVolumeBootPattern-1795947051-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T13:03:00Z,user_data=None,user_id='067a3f33438b4112b818b91ecb4dd0d2',uuid=69c2803e-38e1-4962-a1e1-beb1febe48ec,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1ee78f5d-2a2e-4840-bfec-78bb5b6745d7", "address": "fa:16:3e:59:7c:fc", "network": {"id": "8e985ab3-9852-4f07-8b5c-19f7bf113939", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781795302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d64f3d9dae8f45bcb2e0677a0076ed64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ee78f5d-2a", "ovs_interfaceid": "1ee78f5d-2a2e-4840-bfec-78bb5b6745d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 13:08:11 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-cada462f-8c93-4613-b948-9ec581799bd9 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Converting VIF {"id": "1ee78f5d-2a2e-4840-bfec-78bb5b6745d7", "address": "fa:16:3e:59:7c:fc", "network": {"id": "8e985ab3-9852-4f07-8b5c-19f7bf113939", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781795302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d64f3d9dae8f45bcb2e0677a0076ed64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ee78f5d-2a", "ovs_interfaceid": "1ee78f5d-2a2e-4840-bfec-78bb5b6745d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 13:08:11 user nova-compute[74960]: DEBUG nova.network.os_vif_util [None req-cada462f-8c93-4613-b948-9ec581799bd9 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:59:7c:fc,bridge_name='br-int',has_traffic_filtering=True,id=1ee78f5d-2a2e-4840-bfec-78bb5b6745d7,network=Network(8e985ab3-9852-4f07-8b5c-19f7bf113939),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ee78f5d-2a') {{(pid=74960) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 13:08:11 user nova-compute[74960]: DEBUG os_vif [None req-cada462f-8c93-4613-b948-9ec581799bd9 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:7c:fc,bridge_name='br-int',has_traffic_filtering=True,id=1ee78f5d-2a2e-4840-bfec-78bb5b6745d7,network=Network(8e985ab3-9852-4f07-8b5c-19f7bf113939),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ee78f5d-2a') {{(pid=74960) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 13:08:11 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:08:11 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1ee78f5d-2a, bridge=br-int, if_exists=True) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:08:11 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:08:11 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:08:11 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:08:11 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1e71942d-e120-423f-a31b-deb8b6a3e9eb) {{(pid=74960) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:08:11 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:08:11 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:08:11 user nova-compute[74960]: INFO os_vif [None req-cada462f-8c93-4613-b948-9ec581799bd9 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:7c:fc,bridge_name='br-int',has_traffic_filtering=True,id=1ee78f5d-2a2e-4840-bfec-78bb5b6745d7,network=Network(8e985ab3-9852-4f07-8b5c-19f7bf113939),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ee78f5d-2a')
Nov 03 13:08:11 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cada462f-8c93-4613-b948-9ec581799bd9 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 69c2803e-38e1-4962-a1e1-beb1febe48ec] calling os-brick to detach iSCSI Volume {{(pid=74960) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 13:08:11 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-cada462f-8c93-4613-b948-9ec581799bd9 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9aa420acb0>, {'target_iqn': 'iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UEgVDteh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 13:08:11 user nova-compute[74960]: WARNING os_brick.initiator.connectors.base [None req-cada462f-8c93-4613-b948-9ec581799bd9 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 13:08:11 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-cada462f-8c93-4613-b948-9ec581799bd9 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 13:08:11 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-cada462f-8c93-4613-b948-9ec581799bd9 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 13:08:11 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:08:11 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:08:11 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[71f904ae-ddab-4696-b302-ce6aae140aa7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:808f88b1-1f23-488f-a136-3bd5469206e4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:08:11 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-cada462f-8c93-4613-b948-9ec581799bd9 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 13:08:11 user nova-compute[74960]: No targets found.
Nov 03 13:08:11 user nova-compute[74960]: iSNS:
Nov 03 13:08:11 user nova-compute[74960]: No targets found.
Nov 03 13:08:11 user nova-compute[74960]: STATIC:
Nov 03 13:08:11 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4
Nov 03 13:08:11 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 13:08:11 user nova-compute[74960]:                 Iface Name: default
Nov 03 13:08:11 user nova-compute[74960]: Target: iqn.2010-10.org.openstack:808f88b1-1f23-488f-a136-3bd5469206e4
Nov 03 13:08:11 user nova-compute[74960]:         Portal: 172.16.0.220:3260,-1
Nov 03 13:08:11 user nova-compute[74960]:                 Iface Name: default
Nov 03 13:08:11 user nova-compute[74960]: FIRMWARE:
Nov 03 13:08:11 user nova-compute[74960]: No targets found.
Nov 03 13:08:11 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 13:08:11 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-cada462f-8c93-4613-b948-9ec581799bd9 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 13:08:11 user nova-compute[74960]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 13:08:11 user nova-compute[74960]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74960) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 13:08:11 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-cada462f-8c93-4613-b948-9ec581799bd9 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4', 0)] {{(pid=74960) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 13:08:11 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:08:11 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:08:11 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[80cf6d18-e7ca-4d88-baf8-5c253f42184a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:808f88b1-1f23-488f-a136-3bd5469206e4\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:08:11 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:08:11 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:08:11 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc8e0768-3726-41a9-9121-ce82d20fcc4e]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808f88b1-1f23-488f-a136-3bd5469206e4 (non-flash)\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:08:11 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-cada462f-8c93-4613-b948-9ec581799bd9 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4 (non-flash)
Nov 03 13:08:11 user nova-compute[74960]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808f88b1-1f23-488f-a136-3bd5469206e4 (non-flash)
Nov 03 13:08:11 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 13:08:11 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-cada462f-8c93-4613-b948-9ec581799bd9 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4 (non-flash)
Nov 03 13:08:11 user nova-compute[74960]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808f88b1-1f23-488f-a136-3bd5469206e4 (non-flash)
Nov 03 13:08:11 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 13:08:11 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-cada462f-8c93-4613-b948-9ec581799bd9 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9a8c47d990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4'): ({'sdb'}, set())}) {{(pid=74960) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 13:08:11 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-cada462f-8c93-4613-b948-9ec581799bd9 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Removing single pathed devices sdb {{(pid=74960) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 13:08:12 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:08:12 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:08:12 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd4bf38a-60af-41ca-b0c5-4e094fd18141]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:08:12 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:08:12 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:08:12 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[86469f84-240a-4f60-a276-df4369751515]: (4, ('ok\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:08:12 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-cada462f-8c93-4613-b948-9ec581799bd9 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Flushing IO for device /dev/sdb {{(pid=74960) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 13:08:12 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:08:12 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:08:12 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[580901f2-fded-4719-8b7d-700dc51ee963]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:08:12 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-cada462f-8c93-4613-b948-9ec581799bd9 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74960) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 13:08:12 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:08:12 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.117s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:08:12 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[f093e9f4-2f23-4a05-9a41-d685227dbd44]: (4, ('1', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:08:12 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-cada462f-8c93-4613-b948-9ec581799bd9 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74960) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 13:08:12 user nova-compute[74960]: DEBUG os_brick.initiator.linuxscsi [None req-cada462f-8c93-4613-b948-9ec581799bd9 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] SCSI volumes sdb have been removed. {{(pid=74960) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 13:08:12 user nova-compute[74960]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO18ec9e2c-8dcef8e5fcf40453', '/dev/disk/by-id/scsi-23864636566386535', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_18ec9e2c') {{(pid=86167) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 03 13:08:12 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b6d5e8-d1a7-4d44-8ed0-628a86aff346]: (4, None) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:08:12 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-cada462f-8c93-4613-b948-9ec581799bd9 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4')] {{(pid=74960) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 13:08:12 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:08:12 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:08:12 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[28de99a9-3359-4852-ad86-4999b0efb9a1]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:08:12 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-cada462f-8c93-4613-b948-9ec581799bd9 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:08:12 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4 -p 172.16.0.220:3260 --logout {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:08:12 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:08:12 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[5615e60b-c80e-4c8a-818a-2278af2f3b10]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:08:12 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-cada462f-8c93-4613-b948-9ec581799bd9 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4, portal: 172.16.0.220,3260]
Nov 03 13:08:12 user nova-compute[74960]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4, portal: 172.16.0.220,3260] successful.
Nov 03 13:08:12 user nova-compute[74960]:  stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:08:12 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4 -p 172.16.0.220:3260 --op delete {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:08:12 user nova-compute[74960]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:143d4bac-bf81-4e34-a5c2-30ed203b60d4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:08:12 user nova-compute[74960]: DEBUG oslo.privsep.daemon [-] privsep: reply[8426e87d-6fea-42c5-811a-305b09880c23]: (4, ('', '')) {{(pid=86167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:08:12 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-cada462f-8c93-4613-b948-9ec581799bd9 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74960) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:08:12 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.base [None req-cada462f-8c93-4613-b948-9ec581799bd9 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.407s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 13:08:12 user nova-compute[74960]: DEBUG os_brick.initiator.connectors.iscsi [None req-cada462f-8c93-4613-b948-9ec581799bd9 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] <== disconnect_volume: return (408ms) None {{(pid=74960) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 13:08:12 user nova-compute[74960]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cada462f-8c93-4613-b948-9ec581799bd9 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 69c2803e-38e1-4962-a1e1-beb1febe48ec] Disconnected iSCSI Volume {{(pid=74960) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 13:08:12 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-cada462f-8c93-4613-b948-9ec581799bd9 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 69c2803e-38e1-4962-a1e1-beb1febe48ec] Deleting instance files /opt/stack/data/nova/instances/69c2803e-38e1-4962-a1e1-beb1febe48ec_del
Nov 03 13:08:12 user nova-compute[74960]: INFO nova.virt.libvirt.driver [None req-cada462f-8c93-4613-b948-9ec581799bd9 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 69c2803e-38e1-4962-a1e1-beb1febe48ec] Deletion of /opt/stack/data/nova/instances/69c2803e-38e1-4962-a1e1-beb1febe48ec_del complete
Nov 03 13:08:12 user nova-compute[74960]: INFO nova.compute.manager [None req-cada462f-8c93-4613-b948-9ec581799bd9 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 69c2803e-38e1-4962-a1e1-beb1febe48ec] Took 1.31 seconds to destroy the instance on the hypervisor.
Nov 03 13:08:12 user nova-compute[74960]: DEBUG oslo.service.loopingcall [None req-cada462f-8c93-4613-b948-9ec581799bd9 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74960) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 13:08:12 user nova-compute[74960]: DEBUG nova.compute.manager [-] [instance: 69c2803e-38e1-4962-a1e1-beb1febe48ec] Deallocating network for instance {{(pid=74960) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 13:08:12 user nova-compute[74960]: DEBUG nova.network.neutron [-] [instance: 69c2803e-38e1-4962-a1e1-beb1febe48ec] deallocate_for_instance() {{(pid=74960) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 13:08:12 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:08:12 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:08:12 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:08:12 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:08:12 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:08:12 user nova-compute[74960]: DEBUG nova.network.neutron [-] [instance: 69c2803e-38e1-4962-a1e1-beb1febe48ec] Updating instance_info_cache with network_info: [] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:08:12 user nova-compute[74960]: INFO nova.compute.manager [-] [instance: 69c2803e-38e1-4962-a1e1-beb1febe48ec] Took 0.54 seconds to deallocate network for instance.
Nov 03 13:08:12 user nova-compute[74960]: DEBUG nova.compute.manager [req-c13ae6b6-0435-4b95-be12-bbcd6f5681e4 req-e67ea40a-beb0-47fe-803c-46741913f98f service nova] [instance: 69c2803e-38e1-4962-a1e1-beb1febe48ec] Received event network-vif-deleted-1ee78f5d-2a2e-4840-bfec-78bb5b6745d7 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:08:12 user nova-compute[74960]: INFO nova.compute.manager [req-c13ae6b6-0435-4b95-be12-bbcd6f5681e4 req-e67ea40a-beb0-47fe-803c-46741913f98f service nova] [instance: 69c2803e-38e1-4962-a1e1-beb1febe48ec] Neutron deleted interface 1ee78f5d-2a2e-4840-bfec-78bb5b6745d7; detaching it from the instance and deleting it from the info cache
Nov 03 13:08:12 user nova-compute[74960]: DEBUG nova.network.neutron [req-c13ae6b6-0435-4b95-be12-bbcd6f5681e4 req-e67ea40a-beb0-47fe-803c-46741913f98f service nova] [instance: 69c2803e-38e1-4962-a1e1-beb1febe48ec] Updating instance_info_cache with network_info: [] {{(pid=74960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:08:12 user nova-compute[74960]: DEBUG nova.compute.manager [req-c13ae6b6-0435-4b95-be12-bbcd6f5681e4 req-e67ea40a-beb0-47fe-803c-46741913f98f service nova] [instance: 69c2803e-38e1-4962-a1e1-beb1febe48ec] Detach interface failed, port_id=1ee78f5d-2a2e-4840-bfec-78bb5b6745d7, reason: Instance 69c2803e-38e1-4962-a1e1-beb1febe48ec could not be found. {{(pid=74960) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 03 13:08:13 user nova-compute[74960]: DEBUG nova.compute.manager [req-58e9bc76-85b4-457f-8d74-68d6fd5a9ea8 req-7e939f8d-b391-416c-8d25-266d8136dd17 service nova] [instance: 69c2803e-38e1-4962-a1e1-beb1febe48ec] Received event network-vif-plugged-1ee78f5d-2a2e-4840-bfec-78bb5b6745d7 {{(pid=74960) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:08:13 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-58e9bc76-85b4-457f-8d74-68d6fd5a9ea8 req-7e939f8d-b391-416c-8d25-266d8136dd17 service nova] Acquiring lock "69c2803e-38e1-4962-a1e1-beb1febe48ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:08:13 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-58e9bc76-85b4-457f-8d74-68d6fd5a9ea8 req-7e939f8d-b391-416c-8d25-266d8136dd17 service nova] Lock "69c2803e-38e1-4962-a1e1-beb1febe48ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:08:13 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [req-58e9bc76-85b4-457f-8d74-68d6fd5a9ea8 req-7e939f8d-b391-416c-8d25-266d8136dd17 service nova] Lock "69c2803e-38e1-4962-a1e1-beb1febe48ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:08:13 user nova-compute[74960]: DEBUG nova.compute.manager [req-58e9bc76-85b4-457f-8d74-68d6fd5a9ea8 req-7e939f8d-b391-416c-8d25-266d8136dd17 service nova] [instance: 69c2803e-38e1-4962-a1e1-beb1febe48ec] No waiting events found dispatching network-vif-plugged-1ee78f5d-2a2e-4840-bfec-78bb5b6745d7 {{(pid=74960) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:08:13 user nova-compute[74960]: WARNING nova.compute.manager [req-58e9bc76-85b4-457f-8d74-68d6fd5a9ea8 req-7e939f8d-b391-416c-8d25-266d8136dd17 service nova] [instance: 69c2803e-38e1-4962-a1e1-beb1febe48ec] Received unexpected event network-vif-plugged-1ee78f5d-2a2e-4840-bfec-78bb5b6745d7 for instance with vm_state active and task_state deleting.
Nov 03 13:08:16 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:08:19 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:08:21 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:08:25 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:08:25 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:08:25 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:08:25 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:08:25 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Auditing locally available compute resources for user (node: user) {{(pid=74960) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 13:08:25 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:08:25 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:08:25 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Hypervisor/Node resource view: name=user free_ram=9107MB free_disk=24.954341888427734GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74960) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 13:08:25 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:08:25 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:08:25 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Instance 69c2803e-38e1-4962-a1e1-beb1febe48ec actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74960) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:08:25 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74960) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 13:08:25 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74960) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 13:08:26 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 13:08:26 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 13:08:26 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Compute_service record updated for user:user {{(pid=74960) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 13:08:26 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.341s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:08:26 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:08:26 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:08:26 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74960) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 13:08:26 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74960) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 13:08:26 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74960) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 13:08:26 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:08:27 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:08:29 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:08:29 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:08:29 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74960) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 13:08:29 user nova-compute[74960]: INFO nova.compute.manager [None req-cada462f-8c93-4613-b948-9ec581799bd9 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] [instance: 69c2803e-38e1-4962-a1e1-beb1febe48ec] Took 16.82 seconds to detach 1 volumes for instance.
Nov 03 13:08:29 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-cada462f-8c93-4613-b948-9ec581799bd9 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:08:29 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-cada462f-8c93-4613-b948-9ec581799bd9 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:08:29 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-cada462f-8c93-4613-b948-9ec581799bd9 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 13:08:29 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-cada462f-8c93-4613-b948-9ec581799bd9 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 13:08:29 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-cada462f-8c93-4613-b948-9ec581799bd9 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.168s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:08:30 user nova-compute[74960]: INFO nova.scheduler.client.report [None req-cada462f-8c93-4613-b948-9ec581799bd9 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Deleted allocations for instance 69c2803e-38e1-4962-a1e1-beb1febe48ec
Nov 03 13:08:30 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-cada462f-8c93-4613-b948-9ec581799bd9 tempest-TestVolumeBootPattern-1795947051 tempest-TestVolumeBootPattern-1795947051-project-member] Lock "69c2803e-38e1-4962-a1e1-beb1febe48ec" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 19.125s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:08:30 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:08:30 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Starting heal instance info cache {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 13:08:30 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Rebuilding the list of instances to heal {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 03 13:08:30 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Didn't find any instances for network info cache update. {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 03 13:08:30 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:08:31 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:08:32 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:08:33 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:08:33 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:08:36 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:08:36 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:08:36 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74960) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 13:08:36 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74960) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 13:08:36 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74960) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 13:08:36 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:08:41 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:08:45 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:08:45 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Cleaning up deleted instances with incomplete migration  {{(pid=74960) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 03 13:08:46 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:08:46 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Cleaning up deleted instances {{(pid=74960) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 03 13:08:46 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] There are 0 instances to clean {{(pid=74960) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 03 13:08:46 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:08:51 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:08:51 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:08:51 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74960) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 13:08:51 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74960) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 13:08:51 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74960) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 13:08:51 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:08:56 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:09:01 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:09:01 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:09:01 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74960) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 13:09:01 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74960) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 13:09:01 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74960) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 13:09:01 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:09:06 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:09:06 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:09:06 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74960) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 13:09:06 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74960) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 13:09:06 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74960) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 13:09:06 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:09:11 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:09:11 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:09:11 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74960) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 13:09:11 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74960) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 13:09:11 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74960) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 13:09:11 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:09:12 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:09:16 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:09:16 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:09:19 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:09:21 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:09:21 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:09:25 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:09:25 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:09:25 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:09:25 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:09:25 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Auditing locally available compute resources for user (node: user) {{(pid=74960) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 13:09:25 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:09:25 user nova-compute[74960]: WARNING nova.virt.libvirt.driver [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:09:25 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Hypervisor/Node resource view: name=user free_ram=9174MB free_disk=24.952117919921875GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74960) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 13:09:25 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:09:25 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:09:25 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74960) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 13:09:25 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74960) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 13:09:25 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Refreshing inventories for resource provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 03 13:09:25 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Updating ProviderTree inventory for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 03 13:09:25 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Updating inventory in ProviderTree for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 03 13:09:25 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Refreshing aggregate associations for resource provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0, aggregates: None {{(pid=74960) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 03 13:09:25 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Refreshing trait associations for resource provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0, traits: COMPUTE_NODE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE41,HW_CPU_X86_SSSE3,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_DEVICE_TAGGING,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_QXL {{(pid=74960) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 03 13:09:25 user nova-compute[74960]: DEBUG nova.compute.provider_tree [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Inventory has not changed in ProviderTree for provider: 7ff44b50-6156-4cbc-80af-836e3c9d53d0 {{(pid=74960) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 13:09:25 user nova-compute[74960]: DEBUG nova.scheduler.client.report [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Inventory has not changed for provider 7ff44b50-6156-4cbc-80af-836e3c9d53d0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74960) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 13:09:25 user nova-compute[74960]: DEBUG nova.compute.resource_tracker [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Compute_service record updated for user:user {{(pid=74960) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 13:09:25 user nova-compute[74960]: DEBUG oslo_concurrency.lockutils [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.266s {{(pid=74960) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:09:26 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:09:27 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:09:29 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:09:29 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74960) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 13:09:30 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:09:31 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:09:32 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:09:32 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Starting heal instance info cache {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 13:09:32 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Rebuilding the list of instances to heal {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 03 13:09:32 user nova-compute[74960]: DEBUG nova.compute.manager [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Didn't find any instances for network info cache update. {{(pid=74960) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 03 13:09:32 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:09:33 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:09:33 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:09:36 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:09:36 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:09:36 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74960) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 13:09:36 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74960) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 13:09:36 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74960) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 13:09:36 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:09:41 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:09:46 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:09:49 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:09:51 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:09:56 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:10:01 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:10:06 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:10:11 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:10:11 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:10:11 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74960) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 13:10:11 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74960) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 13:10:11 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74960) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 13:10:11 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:10:16 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:10:16 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:10:16 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74960) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 13:10:16 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74960) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 13:10:16 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74960) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 13:10:16 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:10:21 user nova-compute[74960]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74960) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:10:22 user nova-compute[74960]: DEBUG oslo_service.periodic_task [None req-59f9a4ac-e6ae-4895-92c1-92f7de43946b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74960) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}